LLM Training
SIGMA: Spectral Analysis Reveals Early Warning Signs of LLM Colla
New research introduces SIGMA, a scalable spectral method using eigenvalue analysis to detect model collapse during LLM training before performance degrades catastrophically.