This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Chang, H.-H. Articles by Ying, Z. Search for Related Content Social Bookmarking                         What's this?

a-Stratified Multistage Computerized Adaptive Testing

The Chinese University of Hong Kong and National Board of Medical Examinershchang{at}mail.nbme.org

Zhiliang Ying

Rutgers Universityzying{at}stat.rutgers.edu

Computerized adaptive tests (CAT) commonly use item selection methods that select the item which provides maximum information at an examinees estimated trait level. However, these methods can yield extremely skewed item exposure distributions. For tests based on the three-parameter logistic model, it was found that administering items with low discrimination parameter (a) values early in the test and administering those with high a values later was advantageous; the skewness of item exposure distributions was reduced while efficiency was maintained in trait level estimation. Thus, a new multistage adaptive testing approach is proposed that factors a into the item selection process. In this approach, the items in the item bank are stratified into a number of levels based on their a values. The early stages ofa test use items with lower as and later stages use items with higher as. At each stage, items are selected according to an optimization criterion from the corresponding level. Simulation studies were performed to compare a-stratified CATs with CATs based on the Sympson-Hetter method for controlling item exposure. Results indicated that this new strategy led to tests that were well-balanced, with respect to item exposure, and efficient. The a-stratifiedCATs achieved a lower average exposure rate than CATs based on Bayesian or information-based item selection and the Sympson-Hetter method.

Applied Psychological Measurement, Vol. 23, No. 3, 211-222 (1999)
DOI: 10.1177/01466219922031338


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				K. L. Rulison and E. Loken I've Fallen and I Can't Get Up: Can High-Ability Students Recover From Early Mistakes in CAT? Applied Psychological Measurement, March 1, 2009; 33(2): 83 - 101. [Abstract] [PDF]

				J. R. Barrada, B. P. Veldkamp, and J. Olea Multiple Maximum Exposure Rates in Computerized Adaptive Testing Applied Psychological Measurement, January 1, 2009; 33(1): 58 - 73. [Abstract] [PDF]

				Qing Yi, Jinming Zhang, and H.-H. Chang Severity of Organized Item Theft in Computerized Adaptive Testing: A Simulation Study Applied Psychological Measurement, October 1, 2008; 32(7): 543 - 558. [Abstract] [PDF]

				D. I. Belov, R. D. Armstrong, and A. Weissman A Monte Carlo Approach for Adaptive Testing With Content Constraints Applied Psychological Measurement, September 1, 2008; 32(6): 431 - 446. [Abstract] [PDF]

				M. MCGLOHEN and H.-H. CHANG Combining computer adaptive testing technology with cognitively diagnostic assessment Behav Res Methods, August 1, 2008; 40(3): 808 - 821. [Abstract] [PDF]

				Y.-H. Lee, E. H. Ip, and C.-D. Fuh A Strategy for Controlling Item Exposure in Multidimensional Computerized Adaptive Testing Educational and Psychological Measurement, April 1, 2008; 68(2): 215 - 232. [Abstract] [PDF]

				V. L. Passos, M. P. F. Berger, and F. E. S. Tan The D-Optimality Item Selection Criterion in the Early Stage of CAT: A Study With the Graded Response Model Journal of Educational and Behavioral Statistics, March 1, 2008; 33(1): 88 - 110. [Abstract] [Full Text] [PDF]

				Ying Cheng, H.-H. Chang, and Qing Yi Two-Phase Item Selection Procedure for Flexible Content Balancing in CAT Applied Psychological Measurement, November 1, 2007; 31(6): 467 - 482. [Abstract] [PDF]

				V. Lima Passos, M. P. F. Berger, and F. E. Tan Test Design Optimization in CAT Early Stage with the Nominal Response Model Applied Psychological Measurement, May 1, 2007; 31(3): 213 - 232. [Abstract] [PDF]

				S.-Y. Chen and P.-W. Lei Controlling Item Exposure and Test Overlap in Computerized Adaptive Testing Applied Psychological Measurement, May 1, 2005; 29(3): 204 - 217. [Abstract] [PDF]

				D. Xing and R. K. Hambleton Impact of Test Design, Item Quality, and Item Bank Size on the Psychometric Properties of Computer-Based Credentialing Examinations Educational and Psychological Measurement, February 1, 2004; 64(1): 5 - 21. [Abstract] [PDF]

				R. Nandakumar and L. Roussos Evaluation of the CATSIB DIF Procedure in a Pretest Setting Journal of Educational and Behavioral Statistics, January 1, 2004; 29(2): 177 - 199. [Abstract] [PDF]

				W. J van der Linden and B. P Veldkamp Constraining Item Exposure in Computerized Adaptive Testing With Shadow Tests Journal of Educational and Behavioral Statistics, January 1, 2004; 29(3): 273 - 291. [Abstract] [PDF]

				D. O. Segall A Sharing Item Response Theory Model for Computerized Adaptive Testing Journal of Educational and Behavioral Statistics, January 1, 2004; 29(4): 439 - 460. [Abstract] [PDF]

				H.-H. Chang and W. J. van der Linden Optimal Stratification of Item Pools in {alpha}-Stratified Computerized Adaptive Testing Applied Psychological Measurement, July 1, 2003; 27(4): 262 - 274. [Abstract] [PDF]

				P. E. Cheng and M. Liou Computerized Adaptive Testing Using the Nearest-Neighbors Criterion Applied Psychological Measurement, May 1, 2003; 27(3): 204 - 216. [Abstract] [PDF]

				C.-K. Leung, H.-H. Chang, and K.-T. Hau Incorporation Of Content Balancing Requirements In Stratification Designs For Computerized Adaptive Testing Educational and Psychological Measurement, April 1, 2003; 63(2): 257 - 270. [Abstract] [PDF]

				W. J. van der Linden and H.-H. Chang Implementing Content Constraints in Alpha-Stratified Adaptive Testing Using a Shadow Test Approach Applied Psychological Measurement, March 1, 2003; 27(2): 107 - 120. [Abstract] [PDF]

				W. J. van der Linden Some Alternatives to Sympson-Hetter Item-Exposure Control in Computerized Adaptive Testing Journal of Educational and Behavioral Statistics, January 1, 2003; 28(3): 249 - 265. [Abstract] [PDF]

				H.-H. Chang, J. Qian, and Z. Ying a-Stratified Multistage Computerized Adaptive Testing with b Blocking Applied Psychological Measurement, December 1, 2001; 25(4): 333 - 341. [Abstract] [PDF]