Transformers
Building Transformers from Scratch with Tinygrad
Learn to implement transformer components and mini-GPT models from the ground up using Tinygrad. This technical deep dive covers attention mechanisms, layer normalization, and neural network fundamentals to understand how modern AI systems work.