Lesson 4
Which way to turn a knob
Build an LLM From Scratch, 53 lessons
Lesson 4: Which way to turn a knob
Build an LLM From Scratch, Lesson 4 of 53

Find which way to turn one connection's weight without trying both ways. Learn what a slope is, how to measure it with a tiny nudge, and which way it says to turn.
The question for this lesson: how can we tell which way to turn one connection’s weight?
Last lesson gave the network a score. Our hand-set network has a loss of 1.75, and a lower loss means it fits these twelve students better.
BREAF Premium
The rest of this lesson is in Premium
Premium includes every lesson, with its notes, practice and progress.