Mean-field theory might be lying about how neural networks actually learn
Physicists found that the standard mean-field approximation for neural networks breaks down when you look at correlations between neurons.
Read the note 1 min read
From the notebook
1 note on this topic.