Build an LLM From Scratch
From a first neuron to an agent, in six parts.
53 lessons, Premium, first 2 free
Included in Premium
₹597/month
Every lesson and more.
Already a member? Sign in
Course syllabus
53 lessons
01The network
- 01What a neural network is14 min14 minFree
- 02Inside one neuron15 min15 minFree
- 03Keeping score14 min14 min
- 04Which way to turn a knob16 min16 min
- 05Walking downhill22 min22 min
- 06What one neuron can’t learn18 min18 min
- 07Hidden neurons and the bend20 min20 min
- 08More neurons, more layers22 min22 min
- 09Writing a whole layer22 min22 min
- 10Blame24 min24 min
- 11The training run20 min20 min
- 12Did it really learn?16 min16 min
02From numbers to words
03The transformer
- 19Attention22 min22 min
- 20Queries, keys and values24 min24 min
- 21Keeping scores calm14 min14 min
- 22The mask22 min22 min
- 23Several heads24 min24 min
- 24Word order22 min22 min
- 25The feed-forward network22 min22 min
- 26Adding the input back22 min22 min
- 27Keeping numbers steady20 min20 min
- 28The block22 min22 min
- 29The whole model24 min24 min
- 30From diagram to code24 min24 min