continual learning

Machine Learning

Neural Network Collapse: Why AI Systems Forget What They Learn

New research investigates representation collapse in continual learning, revealing why neural networks catastrophically forget previous tasks and proposing mechanisms to understand this fundamental limitation.

LLM Research

Soft Recursive Least-Squares: A New Approach to Lifelong LLM Edit

Researchers introduce S-RLS, a novel method for continuous LLM knowledge updates that avoids catastrophic forgetting through soft memory preservation instead of rigid constraints.