Together AI - SkrewAI

Together AI

Together AI Open-Sources OSCAR for 2-Bit KV Cache

Together AI has open-sourced OSCAR, an attention-aware 2-bit KV cache quantization system that slashes memory costs for long-context LLM serving while preserving accuracy across reasoning and retrieval benchmarks.

AI Architecture

Parcae: Looped LLM Architecture Matches 2x Larger Models

UCSD and Together AI introduce Parcae, a stable looped transformer architecture that achieves the quality of models twice its size, potentially reshaping how efficient AI systems are built and deployed.