Stanford CS336 | Language Modeling from Scratch
Official course website for Stanford CS336: Language Modeling from Scratch (Spring 2026), including logistics, schedule, assignments, and course mater...
Welcome! Type "help" for available commands.
$
Academic Course Syllabus
Summary
A comprehensive Stanford University course syllabus covering the technical evolution of Transformers and Large Language Models. The curriculum spans from foundational NLP concepts to advanced topics like agentic workflows, reasoning, and evaluation methodologies.
Highlights
- Covers foundational Transformer architectures and advanced attention mechanisms like MQA and GQA
- Detailed instruction on LLM training, including pretraining, quantization, and LoRA
- Explores advanced tuning and reasoning methods such as RLHF, DPO, and GRPO
- Includes practical modules on RAG, agentic frameworks (ReAct), and LLM-as-a-judge evaluation
auto-generated
Context
Audience
Machine Learning Engineers, AI Researchers, and Computer Science Students
DomainMachine Learning
FormatAcademic course lectures and video recordings
AccessFree online
Topics
Related
Natural Language ProcessingReinforcement LearningRetrieval-Augmented GenerationParameter-Efficient Fine-Tuning
