|
Sign In to gain access to subscriptions and/or personal tools.
|
Methodology Review: Assessing Unidimensionality of Tests and ltenls
John Hattie
University of New England, Armidale, NSW 2351, Australia
Various methods for determining unidimensionality are reviewed and the rationale of these methods is as sessed. Indices based on answer patterns, reliability, components and factor analysis, and latent traits are reviewed. It is shown that many of the indices lack a rationale, and that many are adjustments of a previous index to take into account some criticisms of it. After reviewing many indices, it is suggested that those based on the size of residuals after fitting a two- or three-parameter latent trait model may be the most useful to detect unidimensionality. An attempt is made to clarify the term unidimensional, and it is shown how it differs from other terms often used inter changeably such as reliability, internal consistency, and homogeneity. Reliability is defined as the ratio of true score variance to observed score variance. Inter nal consistency denotes a group of methods that are intended to estimate reliability, are based on the vari ances and the covariances of test items, and depend on only one administration of a test. Homogeneity seems to refer more specifically to the similarity of the item correlations, but the term is often used as a synonym for unidimensionality. The usefulness of the terms in ternal consistency and homogeneity is questioned. Uni dimensionality is defined as the existence of one latent trait underlying the data.
Applied Psychological Measurement, Vol. 9, No. 2,
139-164 (1985)
DOI: 10.1177/014662168500900204

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
C. A. Brinkley, P. M. Diamond, P. R. Magaletta, and C. P. Heigel
Cross-Validation of Levenson's Psychopathy Scale in a Sample of Federal Female Inmates
Assessment,
December 1, 2008;
15(4):
464 - 482.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. D. Neal and D. Gursoy
A Multifaceted Analysis of Tourism Satisfaction
Journal of Travel Research,
August 1, 2008;
47(1):
53 - 62.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
Yanyan Sheng and C. K. Wikle
Bayesian Multidimensional IRT Models With a Hierarchical Structure
Educational and Psychological Measurement,
June 1, 2008;
68(3):
413 - 430.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
N. G. Waller
Commingled Samples: A Neglected Source of Bias in Reliability Analysis
Applied Psychological Measurement,
May 1, 2008;
32(3):
211 - 223.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. Deumes
Corporate Risk Reporting: A Content Analysis of Narrative Risk Disclosures in Prospectuses
Journal of Business Communication,
April 1, 2008;
45(2):
120 - 157.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
A. G. Froelich and B. Habing
Conditional Covariance-Based Subtest Selection for DIMTEST
Applied Psychological Measurement,
March 1, 2008;
32(2):
138 - 155.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
A. A. von Davier and C. Wilson
Investigating the Population Sensitivity Assumption of Item Response Theory True-Score Equating Across Two Subgroups of Examinees and Two Test Formats
Applied Psychological Measurement,
January 1, 2008;
32(1):
11 - 26.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
Y. Sheng and C. K. Wikle
Comparing Multiunidimensional and Unidimensional Item Response Theory Models
Educational and Psychological Measurement,
December 1, 2007;
67(6):
899 - 919.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
A. A. von Davier and C. Wilson
IRT True-Score Test Equating: A Guide Through Assumptions and Applications
Educational and Psychological Measurement,
December 1, 2007;
67(6):
940 - 957.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
M. D. Reisig, J. Bratton, and M. G. Gertz
The Construct Validity and Refinement of Process-Based Policing Measures
Criminal Justice and Behavior,
August 1, 2007;
34(8):
1005 - 1028.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
C. A. McHorney
Ten Recommendations for Advancing Patient-Centered Outcomes Measurement for Older Persons
Ann Intern Med,
September 2, 2003;
139(5_Part_2):
403 - 409.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. P. Reise and J. M. Henson
Computerization and Adaptive Administration of the NEO PI-R
Assessment,
December 1, 2000;
7(4):
347 - 364.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. G. Baker, J. B. Rounds, and M. A. Zevon
A Comparison of Graded Response and Rasch Partial Credit Models with Subjective Well-Being
Journal of Educational and Behavioral Statistics,
January 1, 2000;
25(3):
253 - 270.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. HATTIE, R. M. JAEGER, and L. BOND
Chapter 11 : Persistent Methodological Questions in Educational Testing
Review of Research in Education,
January 1, 1999;
24(1):
393 - 446.
[PDF]
|
 |
|

|
 |

|
 |
 
J.-G. Blais and M. D. Laurier
The dimensionality of a placement test from several analytical perspectives
Language Testing,
March 1, 1995;
12(1):
72 - 98.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Buck
The appropriacy of psychometric measurement models for testing second language listening comprehension
Language Testing,
July 1, 1994;
11(2):
145 - 170.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
F. Davidson
Norms appropriacy of achievement tests: Spanish-speaking children and English children's norms
Language Testing,
March 1, 1994;
11(1):
83 - 95.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. E. Millsap and H. T. Everson
Methodology Review: Statistical Approaches for Assessing Measurement Bias
Applied Psychological Measurement,
December 1, 1993;
17(4):
297 - 334.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. Nandakumar and W. Stout
Refinements of Stout's Procedure for Assessing Latent Trait Unidimensionality
Journal of Educational and Behavioral Statistics,
January 1, 1993;
18(1):
41 - 68.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Henning
Dimensionality and construct validity of language tests
Language Testing,
June 1, 1992;
9(1):
1 - 11.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
I.-C. Choi and L. F. Bachman
An investigation into the adequacy of three IRT models for data from two EFL reading tests
Language Testing,
June 1, 1992;
9(1):
51 - 78.
[PDF]
|
 |
|

|
 |

|
 |
 
M. Roznowski, L. R Tucker, and L. G. Humphreys
Three Approaches to Determining the Dimensionality of Binary Items
Applied Psychological Measurement,
June 1, 1991;
15(2):
109 - 127.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Henning
Meanings and implications of the principle of local independence
Language Testing,
June 1, 1989;
6(1):
95 - 108.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Henning
The influence of test and sample dimensionality on latent trait person ability and item difficulty calibrations
Language Testing,
June 1, 1988;
5(1):
83 - 99.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
L. L. Cook, N. J. Dorans, and D. R. Eignor
An Assessment of the Dimensionality of Three SAT-Verbal Test Editions
Journal of Educational and Behavioral Statistics,
January 1, 1988;
13(1):
19 - 43.
[Abstract]
[PDF]
|
 |
|
|
|