Reproducibility

The ability to obtain materially consistent findings from the documented inputs, versions, configuration, and procedure. Model and web drift can prevent exact repetition despite honest methods.

Measurement and evaluation

How a measurement earns trust: evaluation sets, error rates, calibration, reproducibility, and the biases that make a number look better than it is.

Benchmark · Evaluation set · Golden dataset · Ground truth · Human evaluation · LLM-as-judge · Pairwise evaluation · Pointwise evaluation · Rubric · Inter-rater agreement · Accuracy · F1 score · False positive rate · False negative · True positive · True negative · Calibration · Confidence score · Coverage · Abstention · Repeatability · Variance · Confidence interval · Sample size · Sampling bias · Selection bias · Survivorship bias · Data leakage · Test contamination

← Abstention · Repeatability →

See it in the full glossary · 579 terms across 19 areas. Scan a site to see which of these apply to it.