DNN or k-NN: That is the Generalize vs. Memorize Question

05/17/2018
by   Gilad Cohen, et al.
0

This paper studies the relationship between the classification performed by deep neural networks and the k-NN decision at the embedding space of these networks. This simple important connection shown here provides a better understanding of the relationship between the ability of neural networks to generalize and their tendency to memorize the training data, which are traditionally considered to be contradicting to each other and here shown to be compatible and complementary. Our results support the conjecture that deep neural networks approach Bayes optimal error rates.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset