Chapter 14

14Decoding and Sampling

Draft pending — this page is an outline of planned content. Write it by creating content/decoding.md.

14.1Greedy, beam, and why beam lost

Planned: Search vs sampling for open-ended generation; the degeneration problem.

14.2Temperature, top-k, top-p

Planned: Reshaping the distribution; intuitive pictures of each knob.

14.3Newer samplers

Planned: Min-p, typical, repetition penalties; when defaults are wrong.

14.4Structured and constrained decoding preview

Planned: Pointer forward to grammars and JSON-mode in the harness part.