A compact LLM training harness recommended for hands-on architecture experiments.
Source discussion: Attention Is Not What You Need (2025)
“If you find this fascinating and want to dive more, I encourage checking out nanochat (solid GPT-2 repro; minimal LoC); and trying to make architectural tweaks with a coding agent.”
dannyw · recommendation
Direct HN comment