Skip to main content

Information Theory and Foundations of the Learning Behaviour of Deep Neural Networks

An information theoretic view of deep learning can give us an excellent framework to describe and understand the dynamics of learning. We study deep neural networks with statistical mechanics and information theory to uncover the emergence of structure during the learning process.

Learning dynamics of Neural Networks

Photo: Talha Ersoy et al. 2025, arXiv:2505.06597

People, who like this, might also like...