Evaluating correlation and interrater reliability for four performance scales in the palliative care setting

Title

Evaluating correlation and interrater reliability for four performance scales in the palliative care setting

Creator

Myers J; Gardiner K; Harris K; Lilien T; Bennett M; Chow E; Selby D; Zhang L

Publisher

Journal Of Pain And Symptom Management

Date

2010

Subject

Validation Studies as Topic; Validation Studies

Description

Performance scales are used by clinicians to objectively represent a patient's level of function and have been shown to be important predictors of response to therapy and survival. Four different scales are commonly used in the palliative care setting, two of which were specifically developed to more accurately represent this population. It remains unclear which scale is best suited for this setting. The objectives of this study were to determine the correlations among the four scales and concurrently compare interrater reliability for each. Patients were each assessed at the same point in time by three different health care professionals, and all four scales were used to rate each patient. Spearman correlation coefficient values and both weighted and unweighted kappa values were calculated to determine correlation and interrater reliability. The results confirmed highly significant linear correlation among and between all four scales. Whether using a reliability measure that incorporates the concept of "partial credit" for "near misses" or a measure reflecting exact rater agreement, no one scale emerged as having a significantly higher likelihood of agreement among raters. We propose that what may be more important than clinical experience or rater profession is the level of training an individual health care professional rater receives on the administration of any particular performance scale. In addition, given that low levels of exact rater agreement could have substantial clinical implications for patients, we suggest that this parameter be considered in the design of future comparative studies.
2010

Rights

Article information provided for research and reference use only. PedPalASCNET does not hold any rights over the resource listed here. All rights are retained by the journal listed under publisher and/or the creator(s).

Type

Journal Article

Citation List Month

Backlog

Pages

250-258

Issue

2

Volume

39

Citation

Myers J; Gardiner K; Harris K; Lilien T; Bennett M; Chow E; Selby D; Zhang L, “Evaluating correlation and interrater reliability for four performance scales in the palliative care setting,” Pediatric Palliative Care Library, accessed September 23, 2021, https://pedpalascnetlibrary.omeka.net/items/show/14377.

Social Bookmarking