Almost Surely Asymptotic Freeness for Jacobian Spectrum of Deep Network
Free probability theory helps us to understand Jacobian spectrum of deep neural networks. We rigorously show almost surely asymptotic freeness of layer-wise Jacobians.
READ FULL TEXT