Instruction tuning
Training on tasks expressed as natural-language instructions.
What Instruction tuning does not show
It improves instruction following but does not establish that the model understands an instruction as a person would.
Related terms in Models and generation
How a model produces text, what its training and decoding controls change, and what none of them can prove about a source.
Autoregressive model · Transformer · Attention · Self-attention · Parameter · Inference · Pretraining · Fine-tuning · Supervised fine-tuning · RLHF · Preference optimization · Knowledge distillation · Quantization · Mixture of experts · Multimodal model · Vision-language model · Small language model · Tokenizer · Temperature · Top-p sampling · Deterministic decoding · System prompt · Developer message · Tool call · Function calling · Structured output · Constrained decoding · Chain of thought · Reasoning trace · Context caching · Context compaction · Model routing · Model drift · Model version
Questions about Instruction tuning
What is Instruction tuning?
Training on tasks expressed as natural-language instructions.
What does Instruction tuning not show or guarantee?
It improves instruction following but does not establish that the model understands an instruction as a person would.
Which area of the glossary does Instruction tuning belong to?
Models and generation: How a model produces text, what its training and decoding controls change, and what none of them can prove about a source.
← Supervised fine-tuning · RLHF →
See it in the full glossary · 772 terms across 19 areas.
Free browser extension
See this on any site you visit, in one click.
CrawlCheck for Chrome grades every site you visit A–F and shows, from your own browser, what search engines and AI assistants are actually served. Free, no account.