Response to: Reliability Of the International Spinal Cord Injury Musculoskeletal Basic Data Set; Methodological and Statistical Issue to Avoid Misinterpretation

Spinal Cord Series and Cases, 2016 · DOI: 10.1038/scsandc.2016.24 · Published: September 29, 2016

Spinal Cord Injury Bioinformatics Rehabilitation

Simple Explanation

The authors respond to comments regarding the use of Kappa statistics in their reliability study of the International Spinal Cord Injury Musculoskeletal Basic Data Set (ISCIMSBDS). They clarify that Kappa was appropriate because most outcome variables were dichotomous. They acknowledge Kappa's sensitivity to prevalence but argue it can be an advantage, as it adjusts for chance agreement. They reported prevalence and percentage agreement to address this. The authors also confirm that individual-based, pairwise comparisons were used for intra- and inter-rater evaluations, addressing concerns about group-based approaches.

Study Duration

Not specified

Participants

Not specified

Evidence Level

Not specified

Key Findings

1
The study defends the use of Kappa statistics for dichotomous variables in the ISCIMSBDS reliability study.
2
It acknowledges and addresses the limitations of Kappa, particularly its sensitivity to prevalence, explaining why it was still considered a suitable measure.
3
The response confirms the use of pairwise comparisons in the reliability analysis, ensuring an individual-based approach.

Research Summary

This correspondence addresses methodological concerns about using Kappa statistics to assess the reliability of the International Spinal Cord Injury Musculoskeletal Basic Data Set (ISCIMSBDS). The authors defend their statistical choices, clarify the nature of the variables assessed, and explain how they addressed potential limitations of the Kappa statistic, such as prevalence. They emphasize that individual-based comparisons were performed in the study, reinforcing the rigor of their reliability analysis.

Practical Implications

Statistical Method Justification

Provides a rationale for using Kappa statistics in spinal cord injury research when assessing dichotomous variables.

Data Set Reliability

Reinforces the importance of carefully considering statistical properties and limitations when assessing the reliability of data sets like the ISCIMSBDS.

Individual-Based Analysis

Highlights the need for individual-based analysis in reliability studies to ensure accurate and meaningful results.

Study Limitations

1
The correspondence is limited to addressing specific statistical concerns raised about a previous study.
2
It does not present new data or a comprehensive re-analysis of the ISCIMSBDS reliability.
3
The discussion focuses primarily on the use of Kappa statistics, with less attention to other potential statistical approaches.

Your Feedback

Was this summary helpful?

Back to Spinal Cord Injury