This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Traub, R. E. Articles by Rowley, G. L. Search for Related Content Social Bookmarking                         What's this?

Reliability of Test Scores and Decisions

The Ontario Institute for Studies in Education

Glenn L. Rowley

La Trobe University

A criterion-referenced test can be viewed as testing either a continuous or a binary variable, and the scores on a test can be used as measurements of the variable or to make decisions (e.g., pass or fail). Recent work on the reliability of criterion-refer enced tests has focused on the use of scores from tests of continuous variables for decision-making purposes. This work can be categorized according to type of loss function—threshold, linear, or quad ratic. It is the loss function that is used either ex plicitly or implicitly to evaluate the goodness of the decisions that are made on the basis of the test scores. The literature in which a threshold loss function is employed can be further subdivided ac cording to whether the goodness of decisions is as sessed as the probability of making an erroneous decision or as a measure of the consistency of deci sions over repeated testing occasions. This review points to the need for simple procedures by which to estimate the probability of decision errors.

Applied Psychological Measurement, Vol. 4, No. 4, 517-545 (1980)
DOI: 10.1177/014662168000400406


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				R. R. Wilcox A Cautionary Note on Estimating the Reliability of a Mastery Test with the Beta-Binomial Model Applied Psychological Measurement, October 1, 1981; 5(4): 531 - 537. [Abstract]