Polynomial functors and Shannon entropy

01/30/2022
โˆ™
by   David I. Spivak, et al.
โˆ™
0
โˆ™

Past work shows that one can associate a notion of Shannon entropy to a Dirichlet polynomial, regarded as an empirical distribution. Indeed, entropy can be extracted from any dโˆˆ๐–ฃ๐—‚๐—‹ by a two-step process, where the first step is a rig homomorphism out of ๐–ฃ๐—‚๐—‹, the set of Dirichlet polynomials, with rig structure given by standard addition and multiplication. In this short note, we show that this rig homomorphism can be upgraded to a rig functor, when we replace the set of Dirichlet polynomials by the category of ordinary (Cartesian) polynomials. In the Cartesian case, the process has three steps. The first step is a rig functor ๐๐จ๐ฅ๐ฒ^๐‚๐š๐ซ๐ญโ†’๐๐จ๐ฅ๐ฒ sending a polynomial p to แน—๐“Ž, where แน— is the derivative of p. The second is a rig functor ๐๐จ๐ฅ๐ฒโ†’๐’๐ž๐ญร—๐’๐ž๐ญ^op, sending a polynomial q to the pair (q(1),ฮ“(q)), where ฮ“(q)=๐๐จ๐ฅ๐ฒ(q,๐“Ž) can be interpreted as the global sections of q viewed as a bundle, and q(1) as its base. To make this precise we define what appears to be a new distributive monoidal structure on ๐’๐ž๐ญร—๐’๐ž๐ญ^op, which can be understood geometrically in terms of rectangles. The last step, as for Dirichlet polynomials, is simply to extract the entropy as a real number from a pair of sets (A,B); it is given by log A-logโˆš(B) and can be thought of as the log aspect ratio of the rectangle.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset

Sign in with Google

×

Use your Google Account to sign in to DeepAI

×

Consider DeepAI Pro