|
Sign In to gain access to subscriptions and/or personal tools.
|
The Effect of Number of Rating Scale Categories on Levels of Interrater Reliability : A Monte Carlo Investigation
Domenic V. Cicchetti
VA Medical Center, West Haven CT 06516, U.S.A.
Donald Shoinralter
West Haven VA Medical Center
Peter J. Tyrer
Mapperley Hospital, England
A computer simulation study was designed to in vestigate the extent to which the interrater reliability of a clinical scale is affected by the number of cate gories or scale points (2, 3, 4, ... ,100). Results in dicate that reliability increases steadily up to 7 scale points, beyond which no substantial increases occur, even when the number of scale poirits is increased to as many as 100. These findings hold under the follow ing conditions: (1) The research investigator has insuf ficient a priori knowledge to use as a reliable guide line for deciding on an appropriate number of scale points to employ, and (2) the dichotomous and ordinal categories being considered all have an underlying metric or continuous scale format.
Applied Psychological Measurement, Vol. 9, No. 1,
31-36 (1985)
DOI: 10.1177/014662168500900103

CiteULike Connotea Del.icio.us Digg Reddit Technorati What's this?
This article has been cited by other articles:

|
 |

|
 |
 
S. M. Chafouleas, T. J. Christ, and T. C. Riley-Tillman
Generalizability of Scaling Gradients on Direct Behavior Ratings
Educational and Psychological Measurement,
February 1, 2009;
69(1):
157 - 173.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. L. Viljoen, G. M. Vincent, and R. Roesch
Assessing Adolescent Defendants' Adjudicative Competence: Interrater Reliability and Factor Structure of the Fitness Interview Test-Revised
Criminal Justice and Behavior,
August 1, 2006;
33(4):
467 - 487.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
Lei Chang
A Psychometric Evaluation of 4-Point and 6-Point Likert-Type Scales in Relation to Reliability and Validity
Applied Psychological Measurement,
September 1, 1994;
18(3):
205 - 215.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
C. J. Russell, J. K. Pinto, and P. Bobko
Appropriate Moderated Regression and Inappropriate Research Strategy: A Demonstration of Information Loss Due to Scale Coarseness
Applied Psychological Measurement,
September 1, 1991;
15(3):
257 - 266.
[PDF]
|
 |
|

|
 |

|
 |
 
K. J. Berry and P. W. Mielke Jr.
A Generalization of Cohen's Kappa Agreement Measure to Interval Measurement and Multiple Raters
Educational and Psychological Measurement,
December 1, 1988;
48(4):
921 - 933.
[Abstract]
|
 |
|
|
|