Inter-rater agreement of an alternative guideline for the assessment of the activities of daily living in home nursing
© Paquay et al. 2015
Published: 17 September 2015
To evaluate the effect of an alternative guideline on inter-rater agreement of assessments of the activities of daily living (ADL) performed by home care nurses and advising nurses of health insurance organisations.
High accuracy of assessments of ADL dependency is needed for correct reimbursement of nursing care. Health insurance organisations often report high numbers of disagreement between home care nurses and advising nurses on the assessments of functional status in ADL of patients receiving home nursing.
A quantitative comparative field study in a stratified random sample of 612 patients receiving home nursing for ADL deficiencies. A proportional stratification according to mutuality membership, region (Flanders, Brussels and the Walloon region) and the patient's level of ADL-dependency in 5 categories: minor dependency (T2 en T7), level A, level B, level C (which is the highest level) was performed. Home care nurses were invited by the ‘National College of Advising Physicians (NCAPh) and the Belgian sickness funds, to participate in the study and to perform ADL assessments according to two guidelines: the current guideline of the Belgian Evaluation Scale (BES) and an alternative guideline which was written by a workgroup of the Agreement Commission for home care nursing of the National Institute for Health and Disability Insurance. The weighted kappa statistic (κ) (and its 95% confidence interval) and the proportion agreement were the main outcome measures.
Inter-rater agreement for BES total score was κ = 0.70 (0.66 - 0.74) and 63.7% proportion agreement for the current guideline; κ = 0.60 (0.55 - 0.64) and 53.8% agreement for the alternative guideline.
Inter-rater agreement of assessments using the current guideline was substantial and did not improve using the alternative guideline. There was no evidence for adopting the alternative guideline in legislation.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.