Build an LLM From Scratch

Lesson 4

Which way to turn a knob

Build an LLM From Scratch, 53 lessons

Find which way to turn one connection's weight without trying both ways. Learn what a slope is, how to measure it with a tiny nudge, and which way it says to turn.

The question for this lesson: how can we tell which way to turn one connection’s weight?

Last lesson gave the network a score. Our hand-set network has a loss of 1.75, and a lower loss means it fits these twelve students better.

BREAF Premium

The rest of this lesson is in Premium

Premium includes every lesson, with its notes, practice and progress.