Perplexity measures how well an AI can predict the next word. Lower perplexity indicates better AI models. Practical calculation involves probability calculation, logarithm, and average log probability.
•2m read time• From blog.gopenai.com
Sort:
Perplexity measures how well an AI can predict the next word. Lower perplexity indicates better AI models. Practical calculation involves probability calculation, logarithm, and average log probability.
Sort: