Skip to main content

Table 3 interrater- agreement per population in ranking of risk factors according to their relevance for transmission and clinically relevant course of disease

From: Citizens, doctors, politicians - who´s an expert in times of COVID-19? A survey in Austria and Germany

  relevance for transmission relevance for course of disease
  coefficient 95 % confidence interval agreement coefficient benchmark interval agreement
population with healthcare background
percent agreement 0.10 0.06–0.14 slight 0.19 0.14–0.24 slight
Brennan & Prediger 0.00 -0.04-0.04 poor 0.10 0.04–0.16 slight
Cohen’s Kappa 0.00 -0.04-0.04 poor 0.10 0.04–0.16 slight
Scott/Fleiss’ Kappa 0.00 -0.04-0.04 poor 0.10 0.04–0.16 slight
Gwet’s Kappa 0.00 -0.04-0.04 poor 0.10 0.04–0.16 slight
Krippendorff’s Alpha 0.01 -0.03-0.05 slight 0.11 0.05–0.17 slight
general population
percent agreement 0.16 0.06–0.25 slight 0.12 0.07–0.18 slight
Brennan & Prediger 0.06 -0.04-0.17 slight 0.03 -0.04-0.09 slight
Cohen’s Kappa 0.05 -0.03-0.14 slight 0.03 -0.03-0.08 slight
Scott/Fleiss’ Kappa 0.05 0.03–0.14 slight 0.02 -0.04-0.08 slight
Gwet’s Kappa 0.07 -0.04-0.17 slight 0.03 -0.04-0.09 slight
Krippendorff’s Alpha 0.07 -0.02-0.15 slight 0.03 -0.02-0.09 slight
politically active population
percent agreement 0.11 0.07–0.15 slight 0.14 0.10–0.19 slight
Brennan & Prediger 0.01 -0.03-0.06 slight 0.05 -0.00-0.10 slight
Cohen’s Kappa 0.01 -0.03-0.06 slight 0.05 -0.00-0.10 slight
Scott/Fleiss’ Kappa 0.01 -0.03-0.06 slight 0.05 -0.00-0.10 slight
Gwet’s Kappa 0.01 -0.03-0.06 slight 0.05 -0.00-0.10 slight
Krippendorff’s Alpha 0.03 -0.02-0.07 slight 0.06 0.01–0.11 slight
  1. benchmark-scale: <0.00àpoor, 0.00-0.20àslight,0.20–0.40àfair, 0.40–0.60àmoderate,
  2. 0.60–0.80àsubstantial, 0.80-1.00àalmost perfect
Back to article page

Archives of Public Health

ISSN: 2049-3258