Notes on Gradient Descent

Working through the math of gradient descent — how the loss surface shapes training, and why small implementation details matter more than I expected.

Attention Mechanisms in Transformers

Working through scaled dot-product attention from scratch — the query/key/value framework, why it works, and the one scaling detail I kept overlooking.