|
Sign In to gain access to subscriptions and/or personal tools.
|
Decision Models for Use with Criterion-Referenced Tests
Wim J. van der Linden
Twente University of Technology
The problem of mastery decisions and optimizing cutoff scores on criterion-referenced tests is con sidered. This problem can be formalized as an (em pirical) Bayes problem with decisions rules of a monotone shape. Next, the derivation of optimal cutoff scores for threshold, linear, and normal ogive loss functions is addressed, alternately using such psychometric models as the classical model, the beta-binomial, and the bivariate normal model. One important distinction made is between deci sions with an internal and an external criterion. A natural solution to the problem of reliability and validity analysis of mastery decisions is to analyze with a standardization of the Bayes risk (coefficient delta). It is indicated how this analysis proceeds and how, in a number of cases, it leads to coeffi cients already known from classical test theory. Fi nally, some new lines of research are suggested along with other aspects of criterion-referenced test ing that can be approached from a decision-the oretic point of view.
Applied Psychological Measurement, Vol. 4, No. 4,
469-492 (1980)
DOI: 10.1177/014662168000400404

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
W. J. van der Linden
A Decision Theory Model for Course Placement
Journal of Educational and Behavioral Statistics,
January 1, 1998;
23(1):
18 - 34.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
E. S. Tan, Tj. Imbos, R. J.M.M. Does, and M. Theunissen
An Optimal, Unbiased Classification Rule for Mastery Testing Based on Longitudinal Data
Educational and Psychological Measurement,
August 1, 1995;
55(4):
595 - 612.
[Abstract]
|
 |
|

|
 |

|
 |
 
H. J. Vos
Simultaneous Optimization of Decisions Using a Linear Utility Function
Journal of Educational and Behavioral Statistics,
January 1, 1990;
15(4):
309 - 340.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
W. J. van der Linden
The Use of Test Scores for Classification Decisions with Threshold Utility
Journal of Educational and Behavioral Statistics,
January 1, 1987;
12(1):
62 - 75.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. A. Berk
A Consumer's Guide to Setting Performance Standards on Criterion-Referenced Tests
Review of Educational Research,
January 1, 1986;
56(1):
137 - 172.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
D. N. M. de Gruijter and R. K. Hambleton
On de Encountered Using Decision Theory to Set Cutoff Scores
Applied Psychological Measurement,
January 1, 1984;
8(1):
1 - 8.
[Abstract]
|
 |
|

|
 |

|
 |
 
W. J. van der Linden
Some Thoughts on the Use of Decision Theory to Set Cutoff Scores: Comment on de Gruijter and Hambleton
Applied Psychological Measurement,
January 1, 1984;
8(1):
9 - 17.
[Abstract]
|
 |
|

|
 |

|
 |
 
W. J. Van Der Linden
The Use of Moment Estimators for Mixtures of Two Binomials with One Known Success Parameter
Educational and Psychological Measurement,
June 1, 1983;
43(2):
321 - 330.
[Abstract]
|
 |
|

|
 |

|
 |
 
W. J. van der Linden
Estimating the Parameters of Emrick's Mastery Testing Model
Applied Psychological Measurement,
October 1, 1981;
5(4):
517 - 530.
[Abstract]
|
 |
|

|
 |

|
 |
 
P. Vijn and I. W. Molenaar
Robustness Regions for Dichotomous Decisions
Journal of Educational and Behavioral Statistics,
January 1, 1981;
6(3):
205 - 235.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. E. Traub and R. G. Wolfe
Chapter 8: Latent Trait Theories and the Assessment of Educational Achievement
Review of Research in Education,
January 1, 1981;
9(1):
377 - 435.
[PDF]
|
 |
|

|
 |

|
 |
 
W. J. van der Linden
A Latent Trait Look at Pretest-Posttest Validation of Criterion-referenced Test Items
Review of Educational Research,
January 1, 1981;
51(3):
379 - 402.
[Abstract]
[PDF]
|
 |
|
|
|