model collapse - SkrewAI

model collapse

Model Collapse as Epidemic: SIR Dynamics for Synthetic Data

A new arXiv paper frames model collapse from synthetic data contamination as an epidemiological problem, applying bilayer SIR dynamics to model how AI-generated content spreads through training corpora and degrades future models.

model collapse

Model Collapse: How Synthetic Data Could Break AI

As AI-generated content floods the web, models increasingly train on synthetic data, risking model collapse—a degenerative process where outputs lose diversity, accuracy, and connection to reality.

LLM Training

SIGMA: Spectral Analysis Reveals Early Warning Signs of LLM Colla

New research introduces SIGMA, a scalable spectral method using eigenvalue analysis to detect model collapse during LLM training before performance degrades catastrophically.

diffusion models

Generative Collapse in Diffusion Models: The Domination Problem

New research reveals how diffusion models suffer 'generative collapse' when trained on synthetic data, with dominated samples disappearing while dominating ones proliferate across generations.