This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Johnson, M. S. Articles by Sinharay, S. Search for Related Content Social Bookmarking                         What's this?

Calibration of Polytomous Item Families Using Bayesian Hierarchical Modeling

Baruch College, Matthew_Johnson{at}baruch.cuny.edu

Sandip Sinharay

Educational Testing Service

For complex educational assessments, there is an increasing use of item families, which are groups of related items. Calibration or scoring in an assessment involving item families requires models that can take into account the dependence structure inherent among the items that belong to the same item family. This article extends earlier works in three directions: (a) extends the model to take into account item families with polytomous items and implements a Markov chain Monte Carlo algorithm for the estimation of the model parameters, (b) generalizes family response functions to polytomous item families and defines the family score function as ways to examine each family graphically, and (c) uses Bayes factors to select either the more complicated model or a simple model. All three extensions of the earlier works on item families are demonstrated using two data sets: one simulated and one from the National Assessment of Educational Progress.

Key Words: Bayes factor • Markov chain Monte Carlo • automatic item generation • family response function • family score function • item score function

Applied Psychological Measurement, Vol. 29, No. 5, 369-400 (2005)
DOI: 10.1177/0146621605276675


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?