# Tag Info

As mentioned in the definitions section on page 2 of the paper, $D(q||p) = <ln(q/p)>_q$ is the Kullback-Leibler divergence or cross-entropy between two densities. The reason for the negative logs is that is the convention when discussing entropy in the context of information theory. This allows information to be combined additively. ...