Deterministic decoding
Selecting outputs without intentional sampling, commonly by choosing the highest-scoring next token.
What Deterministic decoding means
The same request can still change after model, prompt, tool, or serving updates.
Terms this definition uses
Related terms in Models and generation
How a model produces text, what its training and decoding controls change, and what none of them can prove about a source.
Autoregressive model · Transformer · Attention · Self-attention · Parameter · Inference · Pretraining · Fine-tuning · Supervised fine-tuning · Instruction tuning · RLHF · Preference optimization · Knowledge distillation · Quantization · Mixture of experts · Multimodal model · Vision-language model · Small language model · Tokenizer · Temperature · Top-p sampling · System prompt · Developer message · Tool call · Function calling · Structured output · Constrained decoding · Chain of thought · Reasoning trace · Context caching · Context compaction · Model routing · Model drift · Model version
Questions about Deterministic decoding
What is Deterministic decoding?
Selecting outputs without intentional sampling, commonly by choosing the highest-scoring next token.
What does Deterministic decoding not show or guarantee?
Selecting outputs without intentional sampling, commonly by choosing the highest-scoring next token.
Which area of the glossary does Deterministic decoding belong to?
Models and generation: How a model produces text, what its training and decoding controls change, and what none of them can prove about a source.
← Top-p sampling · System prompt →
See it in the full glossary · 731 terms across 19 areas.