Trace every transformation
Follow text through tokens, vectors, attention, logits, sampling, and the feedback loops that shape model behavior.
Start with the visible text-to-prediction loop, then add architecture, learning, serving, and safety. Formal mathematics stays available as optional depth after the mechanism is clear.
Language models now shape how we write software, search knowledge, create media, and automate work. Understanding what happens beneath the chat box turns you from a spectator into someone who can build, evaluate, and challenge these systems with confidence.
Follow text through tokens, vectors, attention, logits, sampling, and the feedback loops that shape model behavior.
Join training, post-training, inference, retrieval, tools, evaluation, and serving into one coherent engineering picture.
Separate fluent demos from reliable capability, benchmark movement from real usefulness, and model behavior from system safety.
The finish lineLeave with a working mental model of the entire LLM stack—and the judgment to use it well.
Five cumulative phases add one layer of machinery at a time. The active diagram shows where each phase changes the system.
Follow text through pieces, representations, position, attention, layers, and next-token prediction before opening the formal mathematics.
Return to the visible mechanism and formalize representations, probability, feedback, parameter updates, and the tiny GPT build.
First create broad capability with data and compute; then shape the response policy with demonstrations, preferences, rewards, and safety data.
Learn generation and memory before building retrieval, agents, evaluation, security, and operations around the model.
Distillation, LoRA, MoE, multimodality, and interpretability reuse the shared core but do not form one artificial dependency chain.
Lessons 01–40 form the cumulative foundations-to-deployment spine. Lessons 41–44 are parallel advanced specializations: choose them for your goal rather than treating their order as a prerequisite chain.
Build an intuitive account of representations, feedback, responsibility, and model updates before choosing the optional mathematics.
Turn text into predictions, one transparent mechanism at a time.
Learn how data, objectives, compute, and evaluation create capability.
Transform a text predictor into a helpful, safer assistant.
Control generation, memory, latency, throughput, precision, and reasoning budgets.
Design context, retrieval, agents, evaluation, security, and production operations.
Compress, adapt, route, connect modalities, and investigate modern models.
No black boxes. Build intuition, see the mechanism, then make the real engineering trade-offs.
44 connected lessons, hands-on labs, and a complete end-to-end build.