Integration for and as Bayesian inference

Date:

November 12, 2020

Author:

Hrvoje Stojic

Abstract

Integration is a key operation for probabilistic inference. In the first part of the talk, we will look at a very specific, yet ubiquitous and surprisingly hard integration problem: integrals over _linearly_ constrained multivariate Gaussian densities. One key observation is that elliptical slice sampling (ESS) allows to draw rejection-free samples from such domains. Together with multilevel splitting methods, the logarithm of the integral value can be efficiently computed by decomposing the integral into easier-to-compute conditional probabilities. The second part will focus on integration from a perspective of probabilistic numerics. Bayesian quadrature (BQ) treats numerical integration as an inference problem by constructing posterior measures over integrals given observations, i.e. evaluations of the integrand. Besides providing sound uncertainty estimates, the probabilistic approach permits the inclusion of prior knowledge about properties of the integrand and leverages active learning schemes for node selection as well as transfer learning schemes, e.g. when multiple similar integrals have to be jointly estimated.


Notes


  • Alexandra Gessner is a Ph.D. candidate at the Max Planck Institute for Intelligent Systems in Tübingen. Her website can be found here.

Share on social media

Share on social media

Share on social media

Related Seminars

Linear combinations of latents in generative models: subspaces and beyond

Erik Bodin - University of Cambridge

Mar 13, 2025

Linear combinations of latents in generative models: subspaces and beyond

Erik Bodin - University of Cambridge

Mar 13, 2025

Return of the latent space cowboys: rethinking the use of VAEs in Bayesian optimisation over structured spaces

Henry Moss - University of Cambridge, Lancaster University

Jan 21, 2025

Return of the latent space cowboys: rethinking the use of VAEs in Bayesian optimisation over structured spaces

Henry Moss - University of Cambridge, Lancaster University

Jan 21, 2025

Advancing sequential decision-making: efficient querying in clustering and best of both worlds for contextual bandits

Yuko Kuroki - CENTAI Institute

Oct 10, 2024

Advancing sequential decision-making: efficient querying in clustering and best of both worlds for contextual bandits

Yuko Kuroki - CENTAI Institute

Oct 10, 2024

AI in drug discovery - from model to process, from academic publication to decision-making

Andreas Bender - University of Cambridge

Sep 19, 2024

AI in drug discovery - from model to process, from academic publication to decision-making

Andreas Bender - University of Cambridge

Sep 19, 2024