LLM
Gradient-Aware Data Selection Tackles LLM Forgetting
New research introduces gradient-aware approach to select training data that helps large language models retain prior knowledge while learning new information, addressing catastrophic forgetting through intelligent sample selection.