Notes on Gradient Descent
Working through the math of gradient descent — how the loss surface shapes training, and why small implementation details matter more than I expected.
Ml
Attention Mechanisms in Transformers
Working through scaled dot-product attention from scratch — the query/key/value framework, why it works, and the one scaling detail I kept overlooking.