EXPERIMENT 04 / Temperature & sampling

Turn scores into choices

Adjust temperature and top-k, then sample from the resulting distribution.

TRY TO FIND OUT

Which settings change probabilities, and which remove candidates?

WHAT YOU ARE LOOKING AT

Illustrative logits; the probability and sampling calculations are real. The result is an educational calculation, not a claim about a commercial model’s internal state.

CONNECT THE IDEA

Sampling: choosing the next token

A distribution offers possibilities. A decoding rule turns those possibilities into one continuation.