Temperature

A decoding control that changes how strongly generation favors the highest-probability next tokens. Lower values reduce variation but do not make an answer deterministic across infrastructure or model versions.

Terms this definition uses

token · ARIA · Model version

Models and generation

How a model produces text, what its training and decoding controls change, and what none of them can prove about a source.

Autoregressive model · Transformer · Attention · Self-attention · Parameter · Inference · Pretraining · Fine-tuning · Supervised fine-tuning · Instruction tuning · RLHF · Preference optimization · Knowledge distillation · Quantization · Mixture of experts · Multimodal model · Vision-language model · Small language model · Tokenizer · Top-p sampling · Deterministic decoding · System prompt · Developer message · Tool call · Function calling · Structured output · Constrained decoding · Chain of thought · Reasoning trace · Context caching · Context compaction · Model routing · Model drift · Model version

← Tokenizer · Top-p sampling →

See it in the full glossary · 579 terms across 19 areas. Scan a site to see which of these apply to it.