|
Sign In to gain access to subscriptions and/or personal tools.
|
A Comparison of Selected Empirical Methods for Assessing the Structure of Responses to Test Items
Richard Tate
Florida State University
Selected methods of empirically assessing the structure of tests with dichotomous items were compared. The methods included both exploratory and confirmatory procedures from two different families, those based on parametric models and nonparametric methods based on conditional item covariances. The analysis conditions considered were typical of large-scale assessments, for example, the tests were composed of a relatively large number of items, and it was assumed that a relatively large sample size would be available for analysis. Comparisons of the methods were conducted for real data from a 62-item test of reading ability and for computer-generated data for multiple unidimensional and multidimensional cases. For the most part, all methods performed reasonably well over a relatively wide range of conditions. The several exceptions to this outcome occurred when the test data departed appreciably from the assumptions or inherent limitations associated with a method, for example, when guessing was present but not allowed for in the analysis or when the multidimensional test structure was nonsimple but the goal of the method was to estimate the amount of multidimensional simple structure. Index terms: test structure, test dimensionality, local item dependencies, test factors.
Applied Psychological Measurement, Vol. 27, No. 3,
159-203 (2003)
DOI: 10.1177/0146621603027003001

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
J. Braeken and F. Tuerlinckx
Investigating latent constructs with item response models: A MATLAB IRTm toolbox
Behav Res Methods,
November 1, 2009;
41(4):
1127 - 1137.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Braeken and F. Tuerlinckx
A mixed model framework for teratology studies
Biostat.,
October 1, 2009;
10(4):
744 - 755.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
U. S. Tran and A. K. Formann
Performance of Parallel Analysis in Retrieving Unidimensionality in the Presence of Binary Data
Educational and Psychological Measurement,
February 1, 2009;
69(1):
50 - 61.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
W. Holmes Finch and B. F. French
Detection of Crossing Differential Item Functioning: A Comparison of Four Methods
Educational and Psychological Measurement,
August 1, 2007;
67(4):
565 - 582.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
C. A. Stone and C.-C. Yeh
Assessing the Dimensionality and Factor Structure of Multiple-Choice Exams: An Empirical Comparison of Methods Using the Multistate Bar Examination
Educational and Psychological Measurement,
April 1, 2006;
66(2):
193 - 214.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. P. Bowles, K. J. Grimm, and J. J. McArdle
A Structural Factor Analysis of Vocabulary Knowledge and Relations to Age
J. Gerontol. B. Psychol. Sci. Soc. Sci.,
September 1, 2005;
60(5):
P234 - P241.
[Abstract]
[Full Text]
[PDF]
|
 |
|
|
|