This Article Free Full Text (Free PDF) Free References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Reckase, M. D. Search for Related Content Social Bookmarking                   What's this?

The Difficulty of Test Items That Measure More Than One Ability

The American College Testing Program

Many test items require more than one ability to obtain a correct response. This article proposes a mul tidimensional index of item difficulty that can be used with items of this type. The proposed index describes multidimensional item difficulty as the direction in the multidimensional space in which the item provides the most information and the distance in that direction to the most informative point. The multidimensional dif ficulty is derived for a particular item response theory model and an example of its application is given using the ACT Mathematics Usage Test.

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

This article has been cited by other articles:

				H. Finch and B. Habing Performance of DIMTEST- and NOHARM-Based Statistics for Testing Unidimensionality Applied Psychological Measurement, July 1, 2007; 31(4): 292 - 307. [Abstract] [PDF]

				C. E. DeMars ``Guessing'' Parameter Estimates for Multidimensional Item Response Theory Models Educational and Psychological Measurement, June 1, 2007; 67(3): 433 - 446. [Abstract] [PDF]

				L. Yao and K. A. Boughton A Multidimensional Item Response Modeling Approach for Improving Subscale Proficiency Estimation and Classification Applied Psychological Measurement, March 1, 2007; 31(2): 83 - 105. [Abstract] [PDF]

				L. Yao and R. D. Schwarz A Multidimensional Partial Credit Model With Associated Item and Test Statistics: An Application to Mixed-Format Tests Applied Psychological Measurement, November 1, 2006; 30(6): 469 - 492. [Abstract] [PDF]

				J. M. te Marvelde, C. A. W. Glas, G. Van Landeghem, and J. Van Damme Application of Multidimensional Item Response Theory Models to Longitudinal Data Educational and Psychological Measurement, February 1, 2006; 66(1): 5 - 34. [Abstract] [PDF]

				C.-H. Chang and B. B. Reeve Item Response Theory and its Applications to Patient-Reported Outcomes Measurement Eval Health Prof, September 1, 2005; 28(3): 264 - 282. [Abstract] [PDF]

				W.-C. Wang, Y.-Y. Cheng, and M. Wilson Local Item Dependence for Items Across Tests Connected by Common Stimuli Educational and Psychological Measurement, February 1, 2005; 65(1): 5 - 27. [Abstract] [PDF]

				Y. H. Li and W. D. Schafer Trait Parameter Recovery Using Multidimensional Computerized Adaptive Testing in Reading and Mathematics Applied Psychological Measurement, January 1, 2005; 29(1): 3 - 25. [Abstract] [PDF]

				W.-C. Wang Direct Estimation of Correlation as a Measure of Association Strength Using Multidimensional Item Response Models Educational and Psychological Measurement, December 1, 2004; 64(6): 937 - 955. [Abstract] [PDF]

				W.-C. Wang and W. Chyi-In Gain Score in Item Response Theory as an Effect Size Measure Educational and Psychological Measurement, October 1, 2004; 64(5): 758 - 780. [Abstract] [PDF]

				W.-C. Wang and P.-H. Chen Implementation and Measurement Efficiency of Multidimensional Computerized Adaptive Testing Applied Psychological Measurement, September 1, 2004; 28(5): 295 - 316. [Abstract] [PDF]

				D. M. Bolt and V. F. Lall Estimation of Compensatory and Noncompensatory Multidimensional Item Response Models Using Markov Chain Monte Carlo Applied Psychological Measurement, November 1, 2003; 27(6): 395 - 414. [Abstract] [PDF]

				R. Tate A Comparison of Selected Empirical Methods for Assessing the Structure of Responses to Test Items Applied Psychological Measurement, May 1, 2003; 27(3): 159 - 203. [Abstract] [PDF]

				B. P. Veldkamp, Multidimensional Constrained Test Assembly Applied Psychological Measurement, June 1, 2002; 26(2): 133 - 146. [Abstract] [PDF]

				D. M. Bolt Conditional Covariance-Based Representation of Multidimensional Test Structure Applied Psychological Measurement, September 1, 2001; 25(3): 244 - 257. [Abstract] [PDF]

				E. Muraki, C. M. Hombo, and Y.-W. Lee Equating and Linking of Performance Assessments Applied Psychological Measurement, December 1, 2000; 24(4): 325 - 337. [Abstract] [PDF]

				Y. H. Li and R. W Lissitz An Evaluation of the Accuracy of Multidimensional IRT Linking Applied Psychological Measurement, June 1, 2000; 24(2): 115 - 138. [Abstract] [PDF]

				A. E. Seraphine The Performance of Dimtest When Latent Trait and Item Difficulty Distributions Differ Applied Psychological Measurement, March 1, 2000; 24(1): 82 - 94. [Abstract] [PDF]

				W. J. van der Linden Multidimensional Adaptive Testing with a Minimum Error-Variance Criterion Journal of Educational and Behavioral Statistics, January 1, 1999; 24(4): 398 - 412. [Abstract] [PDF]

				J. HATTIE, R. M. JAEGER, and L. BOND Chapter 11: Persistent Methodological Questions in Educational Testing Review of Research in Education, January 1, 1999; 24(1): 393 - 446. [PDF]

				K. M. Mazor, R. K. Hambleton, and B. E. Clauser Multidimensional DIF Analyses: The Effects of Matching on Unidimensional Subtest Scores Applied Psychological Measurement, December 1, 1998; 22(4): 357 - 367. [Abstract] [PDF]

				D. V. Budescu, Y. Cohen, and A. Ben-Simon A Revised Modified Parallel Analysis for the Construction of Unidimensional Item Pools Applied Psychological Measurement, September 1, 1997; 21(3): 233 - 252. [Abstract] [PDF]

				R. J. Adams, M. Wilson, and W.-c. Wang The Multidimensional Random Coefficients Multinomial Logit Model Applied Psychological Measurement, March 1, 1997; 21(1): 1 - 23. [Abstract] [PDF]

				M. D. Reckase The Past and Future of Multidimensional Item Response Theory Applied Psychological Measurement, March 1, 1997; 21(1): 25 - 36. [Abstract] [PDF]

				W. J. van der Linden Assembling Tests for the Measurement of Multiple Traits Applied Psychological Measurement, December 1, 1996; 20(4): 373 - 388. [Abstract]

				R. M. Luecht Multidimensional Computerized Adaptive Testing in a Certification or Licensure Context Applied Psychological Measurement, December 1, 1996; 20(4): 389 - 404. [Abstract]

				T. Davey, T.C. Oshima, and K. Lee Linking Multidimensional Item Calibrations Applied Psychological Measurement, December 1, 1996; 20(4): 405 - 416. [Abstract]

				B. G. Dodd, R.J. De Ayala, and W. R. Koch Computerized Adaptive Testing With Polytomous Items Applied Psychological Measurement, March 1, 1995; 19(1): 5 - 22.

				E. Muraki and J. E. Carlson Full-Information Factor Analysis for Polytomous Item Responses Applied Psychological Measurement, March 1, 1995; 19(1): 73 - 90.

				T. A. Ackerman and J. A. Evans The Influence of Conditioning Scores In Performing DIF Analyses Applied Psychological Measurement, December 1, 1994; 18(4): 329 - 342. [Abstract] [PDF]

				T. A. Ackerman Creating a Test Information Profile for a Two-Dimensional Latent Space Applied Psychological Measurement, September 1, 1994; 18(3): 257 - 275. [Abstract] [PDF]

				M. Roznowski, L. G. Humphreys, and T. Davey A Simplex Fitting Approach to Dimensionality Assessment of Binary Data Matrices Educational and Psychological Measurement, June 1, 1994; 54(2): 263 - 283. [Abstract]

				R. E. Millsap and H. T. Everson Methodology Review: Statistical Approaches for Assessing Measurement Bias Applied Psychological Measurement, December 1, 1993; 17(4): 297 - 334. [Abstract] [PDF]

				R.-M. Batley and M. W. Boss The Effects on Parameter Estimation of Correlated Dimensions and a Distribution-Restricted Trait in a Multidimensional Item Response Model Applied Psychological Measurement, June 1, 1993; 17(2): 131 - 141. [Abstract]

				R. Nandakumar Assessing Essential Unidimensionality of Real Data Applied Psychological Measurement, March 1, 1993; 17(1): 29 - 38. [Abstract]

				R. Nandakumar and W. Stout Refinements of Stout's Procedure for Assessing Latent Trait Unidimensionality Journal of Educational and Behavioral Statistics, January 1, 1993; 18(1): 41 - 68. [Abstract] [PDF]

				T.C. Oshima and M. D. Miller Multidimensionality and Item Bias in Item Response Theory Applied Psychological Measurement, September 1, 1992; 16(3): 237 - 248. [Abstract] [PDF]

				R. M. Luecht and T. R. Miller Unidimensional Calibrations and Interpretations of Composite Traits for Multidimensional Tests Applied Psychological Measurement, September 1, 1992; 16(3): 279 - 293. [Abstract] [PDF]

				M. D. Reckase and R. L. McKinley The Discriminating Power of Items That Measure More Than One Dimension Applied Psychological Measurement, December 1, 1991; 15(4): 361 - 373. [Abstract]

				M. Roznowski, L. R Tucker, and L. G. Humphreys Three Approaches to Determining the Dimensionality of Binary Items Applied Psychological Measurement, June 1, 1991; 15(2): 109 - 127. [Abstract] [PDF]

				T. A. Ackerman The Use of Unidimensional Parameter Estimates of Multidimensional Items in Adaptive Testing Applied Psychological Measurement, March 1, 1991; 15(1): 13 - 24. [Abstract] [PDF]

				T. A. Ackerman Unidimensional IRT Calibration of Compensatory and Noncompensatory Multidimensional Items Applied Psychological Measurement, June 1, 1989; 13(2): 113 - 127. [Abstract]

				R. J. Mislevy Chapter 6: Recent Developments in Item Response Theory with Implications for Teacher Certification Review of Research in Education, January 1, 1987; 14(1): 239 - 275. [PDF]