Sum decomposition of divergence into three divergences

10/03/2018
by   Tomohiro Nishiyama, et al.
0

Divergence functions play a key role as to measure the discrepancy between two points in the field of machine learning, statistics and signal processing. Well-known divergences are the Bregman divergences, the Jensen divergences and the f-divergences. In this paper, we show that the symmetric Bregman divergence can be decomposed into the sum of two types of Jensen divergences and the Bregman divergence. Furthermore, applying this result, we show another sum decomposition of divergence is possible which includes f-divergences explicitly.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset