This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Raju, N. S. Articles by Fleer, P. F. Search for Related Content Social Bookmarking                         What's this?

Methodology Review: Estimation of Population Validity and Cross-Validity, and the Use of Equal Weights in Prediction

Reyhan Bilgic

Illinois Institute of Technology

Jack E. Edwards

Defense Manpower Data Center

Paul F. Fleer

Illinois Institute of Technology

In multiple regression, optimal linear weights are obtained using an ordinary least squares (OLS) procedure. However, these linear weighted combinations of predictors may not optimally predict the same criterion in the population from which the sample was drawn (population validity) or other samples drawn from the same population (population cross-validity). To achieve more accurate estimates of population validity and population cross-validity, some researchers and practitioners use formulas or traditional empirical methods to obtain the estimates. Others have suggested using the equal weights procedure as an alternative to the formula-based and empirical procedures. This review found that formula-based procedures can be used in place of empirical validation for estimating population validity or in place of empirical cross-validation for estimating population cross-validity. The equal weights procedure is a viable alternative when the observed multiple correlation is low to moderate and the variability among predictor-criterion correlations is low. Despite these findings, it is difficult to recommend one formula-based estimate over another because no single study has included all of the currently available formulas. Suggestions are offered for future research and application of these techniques.

Applied Psychological Measurement, Vol. 21, No. 4, 291-305 (1997)
DOI: 10.1177/01466216970214001


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				P. Z. Schochet An Approach for Addressing the Multiple Testing Problem in Social Policy Impact Evaluations Eval Rev, December 1, 2009; 33(6): 539 - 567. [Abstract] [PDF]

				G. Shieh Improved Shrinkage Estimation of Squared Multiple Correlation Coefficient and Squared Cross-Validity Coefficient Organizational Research Methods, April 1, 2008; 11(2): 387 - 407. [Abstract] [PDF]

				J. Algina and H.J. Keselman Population Validity and Cross-Validity: Applications of Distribution Theory for Testing Hypotheses, Setting Confidence Intervals, and Determining Sample Size Educational and Psychological Measurement, April 1, 2008; 68(2): 233 - 244. [Abstract] [PDF]

				P. Bobko, P. L. Roth, and M. A. Buster The Usefulness of Unit Weights in Creating Composite Scores: A Literature Review, Application to Content Validity, and Meta-Analysis Organizational Research Methods, October 1, 2007; 10(4): 689 - 709. [Abstract] [PDF]

				E. F. Alf Jr. and R. G. Graf A New Maximum Likelihood Estimator for the Population Squared Multiple Correlation Journal of Educational and Behavioral Statistics, January 1, 2002; 27(3): 223 - 235. [Abstract] [PDF]

				J. Algina and H. J. Keselman Cross-Validation Sample Sizes Applied Psychological Measurement, June 1, 2000; 24(2): 173 - 179. [Abstract] [PDF]

				N. S. Raju, R. Bilgic, J. E. Edwards, and P. F. Fleer Accuracy of Population Validity and Cross-Validity Estimation: An Empirical Comparison of Formula-Based, Traditional Empirical, and Equal Weights Procedures Applied Psychological Measurement, June 1, 1999; 23(2): 99 - 115. [Abstract] [PDF]

				M. J. Ree, T. R. Carretta, and J. A. Earles In Top-Down Decisions, Weighting Variables does Not Matter: A Consequence of Wilks' Theorem Organizational Research Methods, October 1, 1998; 1(4): 407 - 420. [Abstract]