LLM Inference
DART Brings Diffusion Concepts to Accelerate LLM Inference
New research introduces DART, a speculative decoding method that borrows denoising concepts from diffusion models to dramatically accelerate large language model inference without sacrificing output quality.