Skip to main content

Table 3 interrater- agreement per population in ranking of risk factors according to their relevance for transmission and clinically relevant course of disease

From: Citizens, doctors, politicians - who´s an expert in times of COVID-19? A survey in Austria and Germany

 

relevance for transmission

relevance for course of disease

 

coefficient

95 % confidence interval

agreement

coefficient

benchmark interval

agreement

population with healthcare background

percent agreement

0.10

0.06–0.14

slight

0.19

0.14–0.24

slight

Brennan & Prediger

0.00

-0.04-0.04

poor

0.10

0.04–0.16

slight

Cohen’s Kappa

0.00

-0.04-0.04

poor

0.10

0.04–0.16

slight

Scott/Fleiss’ Kappa

0.00

-0.04-0.04

poor

0.10

0.04–0.16

slight

Gwet’s Kappa

0.00

-0.04-0.04

poor

0.10

0.04–0.16

slight

Krippendorff’s Alpha

0.01

-0.03-0.05

slight

0.11

0.05–0.17

slight

general population

percent agreement

0.16

0.06–0.25

slight

0.12

0.07–0.18

slight

Brennan & Prediger

0.06

-0.04-0.17

slight

0.03

-0.04-0.09

slight

Cohen’s Kappa

0.05

-0.03-0.14

slight

0.03

-0.03-0.08

slight

Scott/Fleiss’ Kappa

0.05

0.03–0.14

slight

0.02

-0.04-0.08

slight

Gwet’s Kappa

0.07

-0.04-0.17

slight

0.03

-0.04-0.09

slight

Krippendorff’s Alpha

0.07

-0.02-0.15

slight

0.03

-0.02-0.09

slight

politically active population

percent agreement

0.11

0.07–0.15

slight

0.14

0.10–0.19

slight

Brennan & Prediger

0.01

-0.03-0.06

slight

0.05

-0.00-0.10

slight

Cohen’s Kappa

0.01

-0.03-0.06

slight

0.05

-0.00-0.10

slight

Scott/Fleiss’ Kappa

0.01

-0.03-0.06

slight

0.05

-0.00-0.10

slight

Gwet’s Kappa

0.01

-0.03-0.06

slight

0.05

-0.00-0.10

slight

Krippendorff’s Alpha

0.03

-0.02-0.07

slight

0.06

0.01–0.11

slight

  1. benchmark-scale: <0.00àpoor, 0.00-0.20àslight,0.20–0.40àfair, 0.40–0.60àmoderate,
  2. 0.60–0.80àsubstantial, 0.80-1.00àalmost perfect