Glossary · Measurement and evaluation
Golden dataset
A curated set treated as the reference truth for evaluation. It is only as reliable as its coverage, labels, update process, and disagreement handling.
Terms this definition uses
Measurement and evaluation
How a measurement earns trust: evaluation sets, error rates, calibration, reproducibility, and the biases that make a number look better than it is.
Benchmark · Evaluation set · Ground truth · Human evaluation · LLM-as-judge · Pairwise evaluation · Pointwise evaluation · Rubric · Inter-rater agreement · Accuracy · F1 score · False positive rate · False negative · True positive · True negative · Calibration · Confidence score · Coverage · Abstention · Reproducibility · Repeatability · Variance · Confidence interval · Sample size · Sampling bias · Selection bias · Survivorship bias · Data leakage · Test contamination
← Evaluation set · Ground truth →
See it in the full glossary · 579 terms across 19 areas. Scan a site to see which of these apply to it.