Sampling bias
Systematic difference between measured cases and the population a claim describes.
What Sampling bias does not show
More observations from the same biased source make the estimate more precise, not more representative.
Related terms in Measurement and evaluation
How a measurement earns trust: evaluation sets, error rates, calibration, reproducibility, and the biases that make a number look better than it is.
AI answer reading · name confusion · hedged answer · Benchmark · Evaluation set · Golden dataset · Ground truth · Human evaluation · LLM-as-judge · Pairwise evaluation · Pointwise evaluation · Rubric · Inter-rater agreement · Accuracy · F1 score · False positive rate · False negative · True positive · True negative · Calibration · Confidence score · Coverage · Abstention · Reproducibility · Repeatability · Variance · Confidence interval · Sample size · Selection bias · Survivorship bias · Data leakage · Test contamination
Questions about Sampling bias
What is Sampling bias?
Systematic difference between measured cases and the population a claim describes.
What does Sampling bias not show or guarantee?
More observations from the same biased source make the estimate more precise, not more representative.
Which area of the glossary does Sampling bias belong to?
Measurement and evaluation: How a measurement earns trust: evaluation sets, error rates, calibration, reproducibility, and the biases that make a number look better than it is.
← Sample size · Selection bias →
See it in the full glossary · 731 terms across 19 areas.