Leveraging replication in active learning

日付:

2024年6月24日

著者:

Hrvoje Stojic



Abstract

Many time-consuming simulators exhibit a complex noise structure that depends on the inputs. Advances in Gaussian process modeling with input-dependent noise, especially via replication (iid repetitions of the same experiment), allow efficient modeling with better uncertainty quantification on the predictions. We focus here on strategies for balancing replication, exploitation and exploration for various sequential design goals, possibly in parallel batches. These goals include global model accuracy, optimization, contour finding, and dimension reduction. Illustration on synthetic examples are provided as well as a large scale massively parallel real world epidemiology problem.


References:


  • Ozik, Jonathan, et al. "A population data-driven workflow for COVID-19 modeling and learning." The International Journal of High Performance Computing Applications 35.5 (2021): 483-499.

  • Binois, Mickael, Robert B. Gramacy, and Mike Ludkovski. "Practical heteroscedastic Gaussian process modeling for large simulation experiments." Journal of Computational and Graphical Statistics 27.4 (2018): 808-821.

  • Binois, Mickaël, et al. "Replication or exploration? Sequential design for stochastic simulation experiments." Technometrics 61.1 (2019): 7-23.

  • Binois, Mickael, Nicholson Collier, and Jonathan Ozik. "A portfolio approach to massively parallel Bayesian optimization." arXiv preprint arXiv:2110.09334 (2021).


Notes


  • Personal website can be found here.

ソーシャルメディアで共有

ソーシャルメディアで共有

ソーシャルメディアで共有

関連するセミナー

Linear combinations of latents in generative models: subspaces and beyond

Erik Bodin - University of Cambridge

2025/03/13

Linear combinations of latents in generative models: subspaces and beyond

Erik Bodin - University of Cambridge

2025/03/13

Return of the latent space cowboys: rethinking the use of VAEs in Bayesian optimisation over structured spaces

Henry Moss - University of Cambridge, Lancaster University

2025/01/21

Return of the latent space cowboys: rethinking the use of VAEs in Bayesian optimisation over structured spaces

Henry Moss - University of Cambridge, Lancaster University

2025/01/21

Advancing sequential decision-making: efficient querying in clustering and best of both worlds for contextual bandits

Yuko Kuroki - CENTAI Institute

2024/10/10

Advancing sequential decision-making: efficient querying in clustering and best of both worlds for contextual bandits

Yuko Kuroki - CENTAI Institute

2024/10/10

AI in drug discovery - from model to process, from academic publication to decision-making

Andreas Bender - University of Cambridge

2024/09/19

AI in drug discovery - from model to process, from academic publication to decision-making

Andreas Bender - University of Cambridge

2024/09/19