LLM Fine-Tuning

RVPO: Stabilizing LLM Fine-Tuning Through Variance Control

New research introduces Ratio-Variance Regularized Policy Optimization (RVPO), a method that stabilizes reinforcement learning from human feedback by controlling importance sampling variance in LLM training.

LLM Fine-Tuning

Chronicals Framework Achieves 3.51x LLM Fine-Tuning Speedup

New open-source framework Chronicals claims significant performance gains over popular fine-tuning tool Unsloth, promising faster and more efficient LLM training for researchers and developers.