Building makemore: Neural Networks for NLP — Andrej Karpathy

Andrej Karpathy's lecture series builds neural language models from scratch in Python — starting from bigram character models and progressing through multilayer perceptrons, batch normalisation, and WaveNet-style architectures. The series culminates in a minimal GPT implementation (nanoGPT) built from first principles. Karpathy was previously Director of AI at Tesla and a founding member of OpenAI; his ability to explain complex concepts with working code at each step is exceptional. For governance professionals: understanding what a language model actually is — as code, not metaphor — changes how you read regulation and compliance documents that describe these systems.

Access Free Resource →