Distillation

First principles distilled from research

Jul 26, 2026

Mini matrix factorization from scratch

Applied SVD and matrix factorization to recommender and LoRA. [1]

May 22, 2026

Mini auto-gradient from scratch

Understand what PyTorch does under the hood by building the API and components of an MLP in pure Python.