This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Sheehan, K. Articles by Lewis, C. Search for Related Content Social Bookmarking                         What's this?

Computerized Mastery Testing With Nonequivalent Testlets

Educational Testing Service

Charles Lewis

Educational Testing Service

A procedure for determining the effect of testlet nonequivalence on the operating characteristics of a testlet-based computerized mastery test (CMT) is introduced. The procedure involves estimating the CMT decision rule twice—once with testlets treated as equivalent and once with testlets treated as nonequivalent. In the equivalent testlet mode, the likelihood functions (LFS) estimated for specific number-correct (NC) scores are assumed to be con stant across testlets and a single set of cutscores is estimated for all testlets. In the nonequivalent testlet mode, the LFS estimated for specific NC scores are allowed to vary from one testlet to another and a different set of cutscores is estimated for each permutation of testlet presentation order. Small differences between the estimated operating characteristics of the equivalent testlet decision rule and the nonequivalent testlet decision rule indicate that the assumption of equivalent testlets was war ranted. This procedure is demonstrated with data from the Architect Registration Examination.

Key Words: Index terms: Bayesian methods • computerized mastery testing • decision theory • item response theory • test equivalence • testlets.

Applied Psychological Measurement, Vol. 16, No. 1, 65-76 (1992)
DOI: 10.1177/014662169201600108


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				B. Xiao Strategies for Computerized Adaptive Grading Testing Applied Psychological Measurement, June 1, 1999; 23(2): 136 - 146. [Abstract] [PDF]

				H. J. Vos Applications of Bayesian Decision Theory to Sequential Mastery Testing Journal of Educational and Behavioral Statistics, January 1, 1999; 24(3): 271 - 292. [Abstract] [PDF]

				J. A. Spray and M. D. Reckase Comparison of SPRT and Sequential Bayes Procedures for Classifying Examinees Into Two Categories Using a Computerized Test Journal of Educational and Behavioral Statistics, January 1, 1996; 21(4): 405 - 414. [Abstract] [PDF]