Perplexity measures how well an AI can predict the next word. Lower perplexity indicates better AI models. Practical calculation involves probability calculation, logarithm, and average log probability.
Sort: