Big picture: mapping your work to CS336
You’ve basically done your own mini–CS336 project. Now you want to line it up with the official course: what you’ve already “taken” in practice, and what’s still to explore.
CS336 walks you end‑to‑end through building modern LLMs from scratch: tokenizer → Transformer → training systems → scaling, data, alignment, and more (course overview, Spring 2024 archive, review, notes).
Think of this lesson as building a map between:
- your pipeline (tokenization, model, training loop, optimizations), and
- the CS336 assignments and lectures.
We’ll walk through each alignment and note the gaps.
Rendering diagram…
1 / 6