Evaluation & Reliability
Inter-Annotator Agreement
The degree to which independent reviewers assign the same labels or judgments to the same material. Raw agreement and chance-adjusted measures answer different questions. Agreement does not establish that the shared judgment is correct.
Also called: Inter-rater agreement
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.