This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Cicchetti, D. V. Search for Related Content Social Bookmarking                   What's this?

Testing the Normal Approximation and Minimal Sample Size Requirements of Weighted Kappa When the Number of Categories is Large

West Haven VA Medical Center and Yale University

The results of this computer simulation study in dicate that the weighted kappa statistic, employing a standard error developed by Fleiss, Cohen, and Everitt (1969), holds for a large number of k cate gories of classification (e.g., 8 < k 10). These data are entirely consistent with an earlier study (Cicchetti & Fleiss, 1977), which showed the same results for 3 k 7. The two studies also indicate that the minimal N required for the valid ap plication of weighted kappa can be easily approxi mated by the simple formula 2k². This produces sample sizes that vary between a low of about 20 (when k = 3) to a high of about 200 (when k = 10). Finally, the range 3 k 10 should encompass most extant clinical scales of classification.

Applied Psychological Measurement, Vol. 5, No. 1, 101-104 (1981)
DOI: 10.1177/014662168100500114


CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

This article has been cited by other articles:

				D. V. Cicchetti, D. Shoinralter, and P. J. Tyrer The Effect of Number of Rating Scale Categories on Levels of Interrater Reliability : A Monte Carlo Investigation Applied Psychological Measurement, March 1, 1985; 9(1): 31 - 36. [Abstract]