|
Sign In to gain access to subscriptions and/or personal tools.
|
Applied Psychological Measurement, Vol. 9, No. 4,
401-412 (1985)
DOI: 10.1177/014662168500900409
The Difficulty of Test Items That Measure More Than One Ability
Mark D. Reckase
The American College Testing Program
Many test items require more than one ability to obtain a correct response. This article proposes a mul tidimensional index of item difficulty that can be used with items of this type. The proposed index describes multidimensional item difficulty as the direction in the multidimensional space in which the item provides the most information and the distance in that direction to the most informative point. The multidimensional dif ficulty is derived for a particular item response theory model and an example of its application is given using the ACT Mathematics Usage Test.
References
- McKinley, R.L., & Reckase, M.D. (1983a). An extension of the two-parameter logistic model to the multidimensional latent space (Research Report ONR 83-2). Iowa City IA: The American College Testing Program .
- McKinley, R.L., & Reckase, M.D. (1983b). MAXLOG: A computer program for the estimation of the parameters of a multidimensional logistic model. Behavior Research Methods and Instrumentation, 15(3), 389-390.
- Reckase, M.D., & McKinley, R.L. (1983, April). The definition of difficulty and discrimination for multidimensional item response theory models . Paper presented at the meeting of the American Educational Research Association, Montreal, Canada.
- Traub, R.E., & Lam, Y.R. (1985). Latent structure and item sampling models for testing. Annual Review of Psychology, 36, 19-48.[CrossRef][ISI]
- Wingersky, M.S., Barton, M.A., & Lord, F.M. (1982). LOGIST user's guide. Princeton NJ: Educational Testing Service.
 CiteULike  Connotea  Del.icio.us  Digg  Reddit  Technorati What's this?
This article has been cited by other articles:
|
|
|
|
 
J. C. Immekus and P. K. Imbrie
Dimensionality Assessment Using the Full-Information Item Bifactor Analysis for Graded Response Data: An Illustration With the State Metacognitive Inventory
Educational and Psychological Measurement,
August 1, 2008;
68(4):
695 - 709.
[Abstract]
[PDF]
|
|
|
|
|
|
|
H. Finch and B. Habing
Performance of DIMTEST- and NOHARM-Based Statistics for Testing Unidimensionality
Applied Psychological Measurement,
July 1, 2007;
31(4):
292 - 307.
[Abstract]
[PDF]
|
|
|
|
|
|
|
C. E. DeMars
``Guessing'' Parameter Estimates for Multidimensional Item Response Theory Models
Educational and Psychological Measurement,
June 1, 2007;
67(3):
433 - 446.
[Abstract]
[PDF]
|
|
|
|
|
|
|
L. Yao and K. A. Boughton
A Multidimensional Item Response Modeling Approach for Improving Subscale Proficiency Estimation and Classification
Applied Psychological Measurement,
March 1, 2007;
31(2):
83 - 105.
[Abstract]
[PDF]
|
|
|
|
|
|
|
L. Yao and R. D. Schwarz
A Multidimensional Partial Credit Model With Associated Item and Test Statistics: An Application to Mixed-Format Tests
Applied Psychological Measurement,
November 1, 2006;
30(6):
469 - 492.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. M. te Marvelde, C. A. W. Glas, G. Van Landeghem, and J. Van Damme
Application of Multidimensional Item Response Theory Models to Longitudinal Data
Educational and Psychological Measurement,
February 1, 2006;
66(1):
5 - 34.
[Abstract]
[PDF]
|
|
|
|
|
|
|
C.-H. Chang and B. B. Reeve
Item Response Theory and its Applications to Patient-Reported Outcomes Measurement
Eval Health Prof,
September 1, 2005;
28(3):
264 - 282.
[Abstract]
[PDF]
|
|
|
|
|
|
|
W.-C. Wang, Y.-Y. Cheng, and M. Wilson
Local Item Dependence for Items Across Tests Connected by Common Stimuli
Educational and Psychological Measurement,
February 1, 2005;
65(1):
5 - 27.
[Abstract]
[PDF]
|
|
|
|
|
|
|
Y. H. Li and W. D. Schafer
Trait Parameter Recovery Using Multidimensional Computerized Adaptive Testing in Reading and Mathematics
Applied Psychological Measurement,
January 1, 2005;
29(1):
3 - 25.
[Abstract]
[PDF]
|
|
|
|
|
|
|
W.-C. Wang
Direct Estimation of Correlation as a Measure of Association Strength Using Multidimensional Item Response Models
Educational and Psychological Measurement,
December 1, 2004;
64(6):
937 - 955.
[Abstract]
[PDF]
|
|
|
|
|
|
|
W.-C. Wang and W. Chyi-In
Gain Score in Item Response Theory as an Effect Size Measure
Educational and Psychological Measurement,
October 1, 2004;
64(5):
758 - 780.
[Abstract]
[PDF]
|
|
|
|
|
|
|
W.-C. Wang and P.-H. Chen
Implementation and Measurement Efficiency of Multidimensional Computerized Adaptive Testing
Applied Psychological Measurement,
September 1, 2004;
28(5):
295 - 316.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. M. Bolt and V. F. Lall
Estimation of Compensatory and Noncompensatory Multidimensional Item Response Models Using Markov Chain Monte Carlo
Applied Psychological Measurement,
November 1, 2003;
27(6):
395 - 414.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. Tate
A Comparison of Selected Empirical Methods for Assessing the Structure of Responses to Test Items
Applied Psychological Measurement,
May 1, 2003;
27(3):
159 - 203.
[Abstract]
[PDF]
|
|
|
|
|
|
|
B. P. Veldkamp,
Multidimensional Constrained Test Assembly
Applied Psychological Measurement,
June 1, 2002;
26(2):
133 - 146.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. M. Bolt
Conditional Covariance-Based Representation of Multidimensional Test Structure
Applied Psychological Measurement,
September 1, 2001;
25(3):
244 - 257.
[Abstract]
[PDF]
|
|
|
|
|
|
|
E. Muraki, C. M. Hombo, and Y.-W. Lee
Equating and Linking of Performance Assessments
Applied Psychological Measurement,
December 1, 2000;
24(4):
325 - 337.
[Abstract]
[PDF]
|
|
|
|
|
|
|
Y. H. Li and R. W Lissitz
An Evaluation of the Accuracy of Multidimensional IRT Linking
Applied Psychological Measurement,
June 1, 2000;
24(2):
115 - 138.
[Abstract]
[PDF]
|
|
|
|
|
|
|
A. E. Seraphine
The Performance of Dimtest When Latent Trait and Item Difficulty Distributions Differ
Applied Psychological Measurement,
March 1, 2000;
24(1):
82 - 94.
[Abstract]
[PDF]
|
|
|
|
|
|
|
W. J. van der Linden
Multidimensional Adaptive Testing with a Minimum Error-Variance Criterion
Journal of Educational and Behavioral Statistics,
January 1, 1999;
24(4):
398 - 412.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. HATTIE, R. M. JAEGER, and L. BOND
Chapter 11 : Persistent Methodological Questions in Educational Testing
Review of Research in Education,
January 1, 1999;
24(1):
393 - 446.
[PDF]
|
|
|
|
|
|
|
K. M. Mazor, R. K. Hambleton, and B. E. Clauser
Multidimensional DIF Analyses: The Effects of Matching on Unidimensional Subtest Scores
Applied Psychological Measurement,
December 1, 1998;
22(4):
357 - 367.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. V. Budescu, Y. Cohen, and A. Ben-Simon
A Revised Modified Parallel Analysis for the Construction of Unidimensional Item Pools
Applied Psychological Measurement,
September 1, 1997;
21(3):
233 - 252.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. J. Adams, M. Wilson, and W.-c. Wang
The Multidimensional Random Coefficients Multinomial Logit Model
Applied Psychological Measurement,
March 1, 1997;
21(1):
1 - 23.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. D. Reckase
The Past and Future of Multidimensional Item Response Theory
Applied Psychological Measurement,
March 1, 1997;
21(1):
25 - 36.
[Abstract]
[PDF]
|
|
|
|
|
|
|
W. J. van der Linden
Assembling Tests for the Measurement of Multiple Traits
Applied Psychological Measurement,
December 1, 1996;
20(4):
373 - 388.
[Abstract]
|
|
|
|
|
|
|
R. M. Luecht
Multidimensional Computerized Adaptive Testing in a Certification or Licensure Context
Applied Psychological Measurement,
December 1, 1996;
20(4):
389 - 404.
[Abstract]
|
|
|
|
|
|
|
T. Davey, T.C. Oshima, and K. Lee
Linking Multidimensional Item Calibrations
Applied Psychological Measurement,
December 1, 1996;
20(4):
405 - 416.
[Abstract]
|
|
|
|
|
|
|
B. G. Dodd, R.J. De Ayala, and W. R. Koch
Computerized Adaptive Testing With Polytomous Items
Applied Psychological Measurement,
March 1, 1995;
19(1):
5 - 22.
|
|
|
|
|
|
|
E. Muraki and J. E. Carlson
Full-Information Factor Analysis for Polytomous Item Responses
Applied Psychological Measurement,
March 1, 1995;
19(1):
73 - 90.
|
|
|
|
|
|
|
T. A. Ackerman and J. A. Evans
The Influence of Conditioning Scores In Performing DIF Analyses
Applied Psychological Measurement,
December 1, 1994;
18(4):
329 - 342.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. A. Ackerman
Creating a Test Information Profile for a Two-Dimensional Latent Space
Applied Psychological Measurement,
September 1, 1994;
18(3):
257 - 275.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. Roznowski, L. G. Humphreys, and T. Davey
A Simplex Fitting Approach to Dimensionality Assessment of Binary Data Matrices
Educational and Psychological Measurement,
June 1, 1994;
54(2):
263 - 283.
[Abstract]
|
|
|
|
|
|
|
R. E. Millsap and H. T. Everson
Methodology Review: Statistical Approaches for Assessing Measurement Bias
Applied Psychological Measurement,
December 1, 1993;
17(4):
297 - 334.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R.-M. Batley and M. W. Boss
The Effects on Parameter Estimation of Correlated Dimensions and a Distribution-Restricted Trait in a Multidimensional Item Response Model
Applied Psychological Measurement,
June 1, 1993;
17(2):
131 - 141.
[Abstract]
|
|
|
|
|
|
|
R. Nandakumar
Assessing Essential Unidimensionality of Real Data
Applied Psychological Measurement,
March 1, 1993;
17(1):
29 - 38.
[Abstract]
|
|
|
|
|
|
|
R. Nandakumar and W. Stout
Refinements of Stout's Procedure for Assessing Latent Trait Unidimensionality
Journal of Educational and Behavioral Statistics,
January 1, 1993;
18(1):
41 - 68.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T.C. Oshima and M. D. Miller
Multidimensionality and Item Bias in Item Response Theory
Applied Psychological Measurement,
September 1, 1992;
16(3):
237 - 248.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. M. Luecht and T. R. Miller
Unidimensional Calibrations and Interpretations of Composite Traits for Multidimensional Tests
Applied Psychological Measurement,
September 1, 1992;
16(3):
279 - 293.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. D. Reckase and R. L. McKinley
The Discriminating Power of Items That Measure More Than One Dimension
Applied Psychological Measurement,
December 1, 1991;
15(4):
361 - 373.
[Abstract]
|
|
|
|
|
|
|
M. Roznowski, L. R Tucker, and L. G. Humphreys
Three Approaches to Determining the Dimensionality of Binary Items
Applied Psychological Measurement,
June 1, 1991;
15(2):
109 - 127.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. A. Ackerman
The Use of Unidimensional Parameter Estimates of Multidimensional Items in Adaptive Testing
Applied Psychological Measurement,
March 1, 1991;
15(1):
13 - 24.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. A. Ackerman
Unidimensional IRT Calibration of Compensatory and Noncompensatory Multidimensional Items
Applied Psychological Measurement,
June 1, 1989;
13(2):
113 - 127.
[Abstract]
|
|
|
|
|
|
|
R. J. Mislevy
Chapter 6: Recent Developments in Item Response Theory with Implications for Teacher Certification
Review of Research in Education,
January 1, 1987;
14(1):
239 - 275.
[PDF]
|
|
|
|
