Statistics

Mutual Information Neural Estimators featured image

Mutual Information Neural Estimators

Mutual Information As part of my work on Concept Bottleneck Models, I looked at mutual information and its estimation quite often! Mutual Information is a metric for measuring the …

Read more
Adaptive Random Walk Metropolis with Spectral Preconditioning featured image

Adaptive Random Walk Metropolis with Spectral Preconditioning

High-Level Overview In Bayesian inference, we often need to sample from complex, high-dimensional posterior distributions that are non-conjugate. While MCMC algorithms like the …

Read more