esc to close
9 parts · 36 projects
All Projects
Every project ships a runnable build.py, a break_it.pysabotage experiment, and captured outputs. Read in order — each builds on the last.
Foundations
4 projectsBuilding a GPT
4 projectsTraining at Scale
4 projectsInference and Serving
5 projectsScaling and Experimentation
3 projectsAligning and Evaluating
4 projectsReasoning, Tools, and Retrieval
4 projectsBeyond the Transformer
3 projectsModular Composition
5 projects- 32Layer Freezing and Transferfreeze ratios, CKA, training speed vs forgetting.
- 33Fusing Independently Trained Specialistsshared base, specialist heads, router.
- 34The Interface Specificationmachine-readable contracts; loud vs silent failures.
- 35Incremental Assemblyorder independence; what "modular" actually means.
- 36Your Architecturefinal project; build one of your own.