This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Humphreys, L. G. Search for Related Content Social Bookmarking                         What's this?

Further Comments on Reliability and Power of Significance Tests

University of Illinois, Urbana-Champaign

The controversy about the relationship between reliability and the power of significance tests exists because statisticians obtain numerical solutions by varying independently the parameters of the power of statistical tests. In contrast, researchers have empirical limitations placed on them in varying the same parameters. Reliability and power can legiti mately be decoupled by selection of the population from which to sample (Zimmerman & Williams, 1986), but this is an undependable way to increase power (Humphreys, 1991). Reducing population var iance by selection of the sample can be considered a special case of (and a crude approximation to) the analysis of covariance, which is also a more effective way of controlling individual differences in true scores than the use of difference scores. Both the regressed differences and the raw differences are less reliable within treatments than their components, but can have more power in statistical tests. As the reliability of derived scores increases, however, power increases.

Key Words: Index terms: difference scores • error of measurement • planning experiments • power • reliability, significance tests • t tests • true scores.

Applied Psychological Measurement, Vol. 17, No. 1, 11-14 (1993)
DOI: 10.1177/014662169301700102


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				J. T. Austin, K. A. Boyle, and J. C. Lualhati Statistical Conclusion Validity for Organizational Science Researchers: A Review Organizational Research Methods, April 1, 1998; 1(2): 164 - 208. [Abstract]

				R. H. Williams and D. W. Zimmerman Are Simple Gain Scores Obsolete? Applied Psychological Measurement, March 1, 1996; 20(1): 59 - 69. [Abstract]

				D. W. Zimmerman, R. H. Williams, and B. D. Zumbo Reliability, Power, Functions, and Relations: A Reply to Humphreys Applied Psychological Measurement, March 1, 1993; 17(1): 15 - 16.