Skip to main content

Table 3 Kappa (κ) and its 95% confidence interval and the proportion observed agreement as measures of agreement between multiple raters about assessments using the Belgian Evaluation Scale (BES) and the AGGIR scale, before and after an educational intervention in a nursing home.

From: A randomized clinical trial using an educational intervention demonstrated no effect on interobserver agreement on assessments of functional status

Instrument and items

Intervention group

Control group

  

First assessment

Second assessment

First assessment

Second assessment

  

κ (95% CI)

Po

κ (95% CI)

Po

κ (95% CI)

Po

κ (95%CI)

Po

BES

Washing

0.43 (0.37-0.49)

0.58

0.48 (0.42-0.54)

0.63

0.44 (0.38-0.50)

0.60

0.63 (0.56-0.70)

0.74

 

Clothing

0.45 (0.39-0.50)

0.59

0.53 (0.47-0.60)

0.67

0.48 (0.41-0.54)

0.62

0.56 (0.48-0.63)

0.71

 

Transfer

0.62 (0.55-0.68)

0.73

0.51 (0.44-0.57)

0.65

0.55 (0.48-0.61)

0.68

0.58 (0.52-0.64)

0.70

 

Toileting

0.56 (0.43-0.69)

0.76

0.51 (0.39-0.62)

0.72

0.48 (0.36-0.59)

0.69

0.53 (0.42-0.65)

0.73

 

Continence

0.29 (0.19-0.39)

0.56

0.27 (0.18-0.36)

0.54

0.40 (0.28-0.52)

0.66

0.39 (0.28-0.50)

0.63

 

Eating

0.44 (0.29-0.60)

0.75

0.37 (0.24-0.50)

0.68

0.27 (0.10-0.43)

0.66

0.37 (0.19-0.54)

0.74

 

Orientation in time

0.43 (0.31-0.55)

0.66

0.48 (0.38-0.59)

0.69

0.43 (0.31-0.54)

0.66

0.54 (0.43-0.66)

0.73

 

Oriëntation in place

0.43 (0.28-0.58)

0.71

0.42 (0.29-0.55)

0.68

0.38 (0.23-0.53)

0.69

0.49 (0.35-0.63)

0.74

AGGIR

Coherent behaviour

0.47 (0.35-0.60)

0.73

0.49 (0.38-0.59)

0.73

0.45 (0.33-0.58)

0.72

0.33 (0.23-0.44)

0.63

 

Orientation

0.57 (0.43-0.70)

0.78

0.48 (0.37-0.59)

0.71

0.48 (0.35-0.61)

0.72

0.52 (0.38-0.65)

0.75

 

Personal hygiene of upper body parts

0.47 (0.38-0.55)

0.67

0.53 (0.45-0.60)

0.69

0.56 (0.49-0.64)

0.72

0.60 (0.52-0.67)

0.75

 

Personal hygiene of lower body parts

0.54 (0.47-0.61)

0.70

0.61 (0.54-0.68)

0.75

0.59 (0.51-0.66)

0.73

0.57 (0.50-0.65)

0.73

 

Clothing: upper

0.51 (0.43-0.58)

0.69

0.60 (0.53-0.68)

0.74

0.60 (0.52-0.67)

0.74

0.59 (0.51-0.66)

0.74

 

Clothing: middle

0.48 (0.41-0.56)

0.67

0.61 (0.53-0.68)

0.75

0.54 (0.46-0.62)

0.71

0.67 (0.59-0.75)

0.80

 

Clothing: under (underwear)

0.51 (0.44-0.57)

0.67

0.63 (0.56-0.70)

0.75

0.55 (0.48-0.62)

0.71

0.63 (0.56-0.71)

0.77

 

Feeding: serve food

0.45 (0.33-0.57)

0.72

0.31 (0.20-0.42)

0.62

0.36 (0.25-0.47)

0.64

0.40 (0.28-0.51)

0.66

 

Feeding: eating

0.33 (0.05-0.61)

0.82

0.25 (-0.10-0.60)

0.85

0.21 (0.05-0.38)

0.66

0.29 (0.02-0.56)

0.79

 

Urinary elimination

0.46 (0.32-0.60)

0.73

0.51 (0.37-0.65)

0.75

0.58 (0.46-0.70)

0.77

0.49 (0.35-0.62)

0.74

 

Faecal elimination

0.43 (0.28-0.59)

0.73

0.52 (0.38-0.66)

0.75

0.53 (0.40-0.65)

0.74

0.47 (0.34-0.60)

0.72

 

Transfers (get up, go to bed, ...)

0.55 (0.43-0.66)

0.74

0.58 (0.48-0.68)

0.75

0.43 (0.34-0.53)

0.66

0.50 (0.39-0.60)

0.71

 

Ambulation inside the house

0.53 (0.45-0.62)

0.71

0.54 (0.46-0.62)

0.71

0.49 (0.41-0.57)

0.68

0.49 (0.41-0.58)

0.68

  1. The number of assessors was 6 per study condition and the number of assessed residents was 34. CI = confidence interval Po = proportion observed agreement