This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Scopus Google Scholar Articles by Lee, W.-C. Articles by Wan, L. Social Bookmarking                         What's this?

Classification Consistency and Accuracy for Complex Assessments Under the Compound Multinomial Model

University of Iowa, won-chan-lee{at}uiowa.edu

Robert L. Brennan

University of Iowa

Lei Wan

Pearson Educational Measurement

For a test that consists of dichotomously scored items, several approaches have been reported in the literature for estimating classification consistency and accuracy indices based on a single administration of a test. Classification consistency and accuracy have not been studied much, however, for ``complex'' assessments—for example, those that involve polytomously scored items or mixtures of different types of items. This article describes procedures for estimating various types of single-administration classification consistency and accuracy indices using the multinomial and compound multinomial models for individuals and groups who take a single administration of a complex assessment. An alternative procedure using the bootstrap is also proposed. These procedures are illustrated using real data sets obtained from tests consisting of both polytomous and dichotomous items.

Key Words: classification consistency • classification accuracy • compound multinomial model • bootstrap • complex assessment

Applied Psychological Measurement, Vol. 33, No. 5, 374-390 (2009)
DOI: 10.1177/0146621608321759


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?