LLM
LLM Quantization Explained: INT8, INT4, GPTQ & AWQ
A technical breakdown of how LLM quantization works, comparing INT8, INT4, GPTQ, and AWQ methods that shrink large models for faster, cheaper inference without destroying accuracy.
Model Efficiency
Liquid AI
Liquid AI's LFM2.5-350M: Big Performance, Tiny Model
Liquid AI releases a 350M parameter model trained on 28 trillion tokens with scaled reinforcement learning, challenging assumptions about what compact models can achieve.
LLM
Reinforcement-Aware Knowledge Distillation Advances LLM Reasoning
New research combines reinforcement learning with knowledge distillation to improve how smaller language models learn complex reasoning from larger teacher models.
LLM
AutoQRA: Joint Quantization and LoRA for Efficient LLM Training
New research introduces AutoQRA, a framework that jointly optimizes mixed-precision quantization and low-rank adapters, enabling more efficient fine-tuning of large language models on limited hardware.
LLM Research
New Method Internalizes LLM Reasoning Through Latent Actions
Researchers propose a novel approach to improve LLM reasoning by discovering and replaying latent actions, potentially reducing inference costs while maintaining reasoning quality.
Bayesian Optimization
Bayesian Optimization Framework Makes AI Self-Improvement Efficie
New research introduces a Bayesian optimization framework that enables AI models to self-improve with significantly fewer evaluations by operating directly in language space, addressing the computational bottleneck of traditional reinforcement learning approaches.