Kappa statistics to measure interrater and intrarater agreement for 1790 cervical biopsy specimens among twelve pathologists: Qualitative histopathologic analysis and methodologic issues

Kappas in this expert group of pathologists were in the moderate, substantial, and almost perfect ranges for the overall and randomized samples. The randomized sample was representative of the larger sample. The kappa of the specimens for which disagreements arose was, predictably, in the slight range. Our findings will aid both the correlations with optical measurements using fluorescence and reflectance spectroscopy and the quantitative histopathologic analysis of these study specimens.