Calculation of Shannon Entropy that calculates how ‘suprised’ a model is by a text. Calculated from the likelihood so is a more interpretable form
Calculation of Shannon Entropy that calculates how ‘suprised’ a model is by a text. Calculated from the likelihood so is a more interpretable form
Perplexity=2H(p)