LLM
Why the Last Token Isn't Your LLM's Best Embedding
New analysis challenges the standard practice of extracting embeddings from the final token of decoder-only LLMs, showing intermediate layers and alternative pooling strategies often produce richer semantic representations.