Tag: perplexity
Monitoring Loss and Perplexity: A Practical Guide to LLM Training Signals
Learn how to interpret cross-entropy loss and perplexity during LLM training. Discover practical tips for reading training signals, avoiding overfitting, and diagnosing model health effectively.
Read more