Next Token Prediction

LLMs don't know facts; they calculate the probability of the next word based on patterns.

INPUT:

Tip: Sometimes the model picks a less likely word (Temperature), making it "creative".

Paul Gallacher

How LLMs Work