LLM Infrastructure
PROTEUS: Lagrangian RL Optimizes Multi-LLM Routing for SLAs
New research introduces PROTEUS, a reinforcement learning framework using Lagrangian optimization to intelligently route requests across multiple LLMs while meeting strict service level agreements.