Cross Entropy

A Loss Function used to find the difference between two distributions $p,q$

Formula

$$H(p,q)=-E_p[\log q]$$