Information Theory

Tackling Information Leakage in Concept Bottleneck Models featured image

Tackling Information Leakage in Concept Bottleneck Models

Deep Neural Networks (DNNs) are powerful black boxes, but their lack of transparency makes them unsuitable for high-stakes domains like healthcare. Concept Bottleneck Models (CBMs) …

Read more
Mutual Information Neural Estimators featured image

Mutual Information Neural Estimators

Mutual Information As part of my work on Concept Bottleneck Models, I looked at mutual information and its estimation quite often! Mutual Information is a metric for measuring the …

Read more