Predictive validity is how well a test, score or model measured today predicts an outcome measured later: whether an admissions test predicts grades, or a hiring assessment predicts job performance. It is a form of criterion validity and is usually reported as a correlation between the score and the later outcome. Personnel psychology has measured it for decades (Schmidt and Hunter, 1998), and a 2022 re-analysis found many of those estimates had been too high (Sackett et al., 2022).
How it works
Where you see it today
A large re-analysis found that range-restriction corrections had overstated the validity of many selection methods; structured interviews came out as the top-ranked procedure (Sackett et al., 2022). The ranking of methods held up better than the size of the numbers.
New York City’s Local Law 144 bars employers from using an automated employment decision tool unless it has had a bias audit within the past year and the results are public (NYC DCWP, 2023). Buyers now ask vendors for both validity and fairness evidence.
In a randomised trial, experienced open-source developers expected AI tools to cut task time; with early-2025 tools they actually took longer (Becker et al., 2025). A benchmark score is a predictor, and its validity has to be shown on the work you care about.
When one AI model scores another’s answers, the order in which answers are shown can change the verdict (Wang et al., 2023). An evaluation method needs its own predictive check against human judgment or real outcomes.
Predictive validity and other kinds of validity
How to use it
- Before you buy or build a scoring tool, write down the outcome it should predict and how you will measure it.
- Keep a holdout: track outcomes for people or cases the score would have rejected or ranked low, where ethics allow.
- Ask vendors for validity evidence from a population like yours, not only headline figures.
- Pair validity with a fairness check across groups; a tool can predict well and still screen unfairly.
- Re-validate AI benchmarks and evaluators on your own tasks before using them to choose models.
As AI scores candidates, customers and models, the business question is no longer whether a score exists but whether it predicts what you care about. The Business Engineer view: whatever can be benchmarked can be automated, so the benchmark’s predictive validity becomes the real bottleneck.
Read: What Can Be Benchmarked Can Be Made Autonomous โExplore the platform โRelated: Construct validity ยท Internal validity ยท External validity ยท Selection bias ยท Predictive analytics
Frequently asked questions
What is predictive validity?
It is the extent to which a score measured now predicts an outcome measured later, such as a hiring test predicting job performance.
How is predictive validity measured?
By collecting scores first, waiting for the outcome, and computing how strongly the two are correlated, with care over restricted ranges.
What is the difference between predictive and concurrent validity?
Predictive validity compares a score with an outcome measured later; concurrent validity compares it with an outcome measured at the same time.
Why does predictive validity matter for AI?
AI tools and benchmarks are predictors. A high benchmark score or a hiring model is only useful if it is shown to predict real outcomes in your setting.
Sources
- Schmidt & Hunter (1998), The validity and utility of selection methods in personnel psychology, Psychological Bulletin
- Sackett et al. (2022), Revisiting meta-analytic estimates of validity in personnel selection, Journal of Applied Psychology
- NYC DCWP (2023), Automated Employment Decision Tools (Local Law 144 of 2021)
- Becker et al. (2025), Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity, arXiv
- Wang et al. (2023), Large Language Models are not Fair Evaluators, arXiv
The full guide
The complete explainer, cleaned up and reformatted for mobile.

In education, standardized tests like the SAT or ACT are used to predict a student's future academic performance in college.
For example, depression assessments may have predictive validity in determining a patient's likelihood of recovery with a particular therapy.
Evaluating predictive validity often requires a significant amount of time to observe and assess the criterion.
For example, using a test to predict an individual's likelihood of criminal behavior may lead to discriminatory practices.
Layout refreshed 7 October 2026. The article text below is unchanged.
In healthcare and clinical settings, predictive validity guides the allocation of resources and treatment options to patients who are most likely to benefit from them.
By understanding and evaluating predictive validity, individuals, organizations, and policymakers can make more informed decisions, allocate resources effectively, and improve the quality of their practices and services.
Visual overview and quick answers (tap to expand)
Understanding Predictive Validity
What is Predictive Validity?
Predictive validity is a measure of the effectiveness of an assessment tool or measurement in forecasting future behaviors, outcomes, or events. It assesses how well a test or measurement can predict a criterion that occurs at a later time. In essence, it answers the question: “Does the measurement accurately forecast what it is intended to predict?”
Origins of the Concept
The concept of predictive validity has its roots in the field of psychometrics, which is the scientific study of psychological measurement. Psychologists and researchers developed this concept to evaluate the quality and accuracy of various psychological and educational assessments.
Key Characteristics of Predictive Validity
Predictive validity possesses several key characteristics:
1. Forward-Looking
It is forward-looking in nature, as it assesses the ability of a measurement to predict future events or outcomes. This differentiates it from concurrent validity, which examines the relationship between a measurement and a criterion that occurs simultaneously.
2. Criterion-Referenced
Predictive validity is criterion-referenced, meaning it evaluates the extent to which a measurement aligns with a specific criterion or standard.
3. Quantitative Assessment
It is often assessed quantitatively, using statistical measures to determine the strength and direction of the relationship between the measurement and the criterion.
4. Outcome-Based
Predictive validity is outcome-based, as it is commonly used to predict outcomes such as academic achievement, job performance, or clinical prognosis.
Methods of Assessing Predictive Validity
Several methods can be employed to assess predictive validity:
1. Correlation Coefficients
Correlation coefficients, such as the Pearson correlation coefficient (r), are often used to quantify the relationship between the measurement and the criterion. A high positive correlation indicates strong predictive validity.
2. Regression Analysis
Regression analysis can assess the extent to which the measurement can predict variations in the criterion. Multiple regression can account for the influence of multiple predictor variables.
3. Receiver Operating Characteristic (ROC) Analysis
ROC analysis is commonly used in medical and diagnostic contexts to assess the predictive validity of a diagnostic test. It measures the test’s ability to discriminate between individuals with and without a specific condition.
4. Sensitivity and Specificity
In medical and clinical settings, sensitivity (the ability to correctly identify true positives) and specificity (the ability to correctly identify true negatives) are used to evaluate the predictive validity of diagnostic tests.
Examples of Predictive Validity
Predictive validity is utilized in various fields and contexts to evaluate assessments and measurements. Here are some examples:
1. Education
In education, standardized tests like the SAT or ACT are used to predict a student’s future academic performance in college. High predictive validity suggests that high test scores are associated with better college performance.
2. Employment
Pre-employment assessments and tests are often used to predict an applicant’s future job performance. A high level of predictive validity indicates that the assessment can effectively identify individuals who are likely to succeed in a specific job role.
3. Clinical Psychology
In clinical psychology, assessments are used to predict a patient’s prognosis or response to treatment. For example, depression assessments may have predictive validity in determining a patient’s likelihood of recovery with a particular therapy.
4. Medical Diagnosis
Medical tests, such as mammograms or HIV tests, are evaluated for predictive validity to determine their accuracy in predicting the presence or absence of a medical condition.
5. Financial Markets
In financial markets, various economic indicators and models are used to predict future market trends and investment outcomes. The predictive validity of these indicators is crucial for making informed investment decisions.
The Significance of Predictive Validity
Predictive validity holds significant importance in various domains:
1. Informed Decision-Making
It allows decision-makers to make informed choices based on the likelihood of future outcomes. For example, it helps universities admit students who are likely to succeed academically.
2. Resource Allocation
In healthcare and clinical settings, predictive validity guides the allocation of resources and treatment options to patients who are most likely to benefit from them.
3. Quality Improvement
Organizations use predictive validity to improve the quality of their products and services. For instance, they can identify and address issues in the hiring process by assessing the predictive validity of pre-employment tests.
4. Risk Assessment
In finance and risk management, predictive validity aids in assessing potential risks and returns associated with investment decisions.
5. Research Validity
Researchers rely on predictive validity to ensure the accuracy and reliability of their measurements and assessments, strengthening the validity of their studies.
Challenges and Limitations
While predictive validity is a valuable concept, it is not without its challenges and limitations:
1. Time Constraints
Evaluating predictive validity often requires a significant amount of time to observe and assess the criterion. This may not be practical in situations where decisions need to be made quickly.
2. Changing Environments
Predictive validity can be affected by changes in the environment or context. A measurement that is valid in one setting may not be as valid in another.
3. Ethical Concerns
In some cases, assessing predictive validity may raise ethical concerns. For example, using a test to predict an individual’s likelihood of criminal behavior may lead to discriminatory practices.
4. Cost
Conducting research to assess predictive validity can be costly, particularly when dealing with large sample sizes and long observation periods.
Conclusion
Predictive validity is a crucial concept in the fields of psychology, education, medicine, and beyond. It helps assess the accuracy of assessments and measurements in predicting future outcomes or behaviors. By understanding and evaluating predictive validity, individuals, organizations, and policymakers can make more informed decisions, allocate resources effectively, and improve the quality of their practices and services. As the world continues to rely on data-driven decision-making, the significance of predictive validity remains undeniably important.
| Related Frameworks | Description | Purpose | Key Components/Steps |
|---|---|---|---|
| Predictive Validity | Predictive Validity is a measure of the extent to which a test or assessment accurately predicts future performance or behavior of individuals. It assesses the ability of a test to forecast outcomes that occur at a later point in time, allowing researchers to evaluate the usefulness and accuracy of the test in making predictions. | To assess the effectiveness of a test or assessment in predicting future performance, behavior, or outcomes based on current test scores or measurements, providing evidence for the practical utility and validity of the test in decision-making, selection, or evaluation contexts. | 1. Test Administration: Administer the test or assessment to a sample of individuals under standard conditions. 2. Outcome Measurement: Measure the relevant criterion or outcome of interest that will occur at a future point in time. 3. Correlation Analysis: Calculate the correlation between test scores and future outcomes, assessing the strength and direction of the relationship. 4. Prediction Analysis: Conduct regression analysis or other predictive modeling techniques to assess the ability of test scores to predict future outcomes, controlling for confounding variables. |
| Concurrent Validity | Concurrent Validity is a measure of the extent to which a test or assessment yields results that are consistent with those of other measures administered at the same time. It assesses the degree of agreement between a test and a criterion measure or gold standard, providing evidence for the accuracy and validity of the test in assessing a particular construct or behavior. | To evaluate the accuracy and validity of a test or assessment by comparing its results with those of other measures administered concurrently, providing evidence for the test’s ability to assess the intended construct or behavior in real-time or simultaneous situations. | 1. Test Administration: Administer the test or assessment to a sample of individuals under standard conditions. 2. Criterion Measurement: Administer one or more criterion measures or gold standard assessments that measure the same construct or behavior simultaneously. 3. Correlation Analysis: Calculate the correlation between test scores and criterion measures, assessing the strength and direction of the relationship. 4. Comparison: Compare the results of the test with those of criterion measures, evaluating the degree of agreement or consistency. |
| Construct Validity | Construct Validity is a measure of the extent to which a test or assessment accurately measures the theoretical construct or concept it is intended to assess. It assesses the degree to which the test scores reflect the underlying construct or attribute, providing evidence for the meaningfulness and interpretation of the test results in relation to the construct of interest. | To evaluate the degree to which a test or assessment measures the intended theoretical construct or concept, providing evidence for the validity and interpretation of the test scores in relation to the underlying construct, and supporting inferences about individuals’ traits, abilities, or characteristics based on test performance. | 1. Conceptual Definition: Clearly define the theoretical construct or concept of interest that the test intends to measure. 2. Test Development: Develop items or tasks that are theoretically relevant to the construct, ensuring content validity. 3. Empirical Validation: Collect data on test performance and analyze its relationship with other measures or behaviors that theoretically relate to the construct. 4. Factor Analysis: Conduct factor analysis or other statistical techniques to assess the underlying structure of the test and its alignment with the theoretical construct. |
| Criterion Validity | Criterion Validity is a measure of the extent to which a test or assessment accurately predicts or correlates with an external criterion or outcome. It assesses the degree of agreement between test scores and established criteria or standards, providing evidence for the test’s ability to predict relevant outcomes or behaviors. | To evaluate the accuracy and usefulness of a test or assessment by comparing its results with external criteria or outcomes that are relevant and meaningful, providing evidence for the test’s predictive validity and practical utility in making decisions or judgments about individuals’ performance, behavior, or attributes. | 1. Test Administration: Administer the test or assessment to a sample of individuals under standard conditions. 2. Criterion Measurement: Administer an external criterion or outcome measure that is relevant and meaningful to the construct being assessed. 3. Correlation Analysis: Calculate the correlation between test scores and criterion measures, assessing the strength and direction of the relationship. 4. Prediction Analysis: Conduct regression analysis or other predictive modeling techniques to assess the ability of test scores to predict criterion measures, controlling for confounding variables. |
| Content Validity | Content Validity is a measure of the extent to which a test or assessment adequately covers the content domain or universe it is intended to measure. It assesses the representativeness and relevance of test items or tasks in sampling the full range of content areas or dimensions within the construct of interest. | To evaluate the comprehensiveness and relevance of a test or assessment by examining the extent to which its items or tasks adequately represent the content domain or universe of the construct being measured, providing evidence for the validity and interpretation of the test scores in relation to the content coverage and sampling adequacy. | 1. Content Domain Definition: Define the content domain or universe of the construct being assessed, specifying the relevant content areas or dimensions. 2. Item Generation: Develop items or tasks that sample the full range of content areas within the construct, ensuring representativeness and relevance. 3. Expert Review: Subject test items to expert review to evaluate their alignment with the content domain and ensure content validity. 4. Pilot Testing: Pilot test the assessment with a sample of individuals to assess item difficulty, clarity, and representativeness of the content. |
Connected Analysis Frameworks
Failure Mode And Effects Analysis



































Related Strategy Concepts: Go-To-Market Strategy, Marketing Strategy, Business Models, Tech Business Models, Jobs-To-Be Done, Design Thinking, Lean Startup Canvas, Value Chain, Value Proposition Canvas, Balanced Scorecard, Business Model Canvas, SWOT Analysis, Growth Hacking, Bundling, Unbundling, Bootstrapping, Venture Capital, Porterโs Five Forces, Porterโs Generic Strategies, Porterโs Five Forces, PESTEL Analysis, SWOT, Porterโs Diamond Model, Ansoff, Technology Adoption Curve, TOWS, SOAR, Balanced Scorecard, OKR, Agile Methodology, Value Proposition, VTDF Framework, BCG Matrix, GE McKinsey Matrix, Kotterโs 8-Step Change Model.
Main Guides:
- Business Models
- Business Strategy
- Marketing Strategy
- Business Model Innovation
- Platform Business Models
- Network Effects In A Nutshell
- Digital Business Models








