mechanistic interpretability
GPT-2 Dissected: How Transformer Layers Process Sentiment
New research reveals how GPT-2's layers divide labor between lexical and contextual processing during sentiment analysis, advancing our understanding of transformer internals.