The application of generalizability theory to reliability assessment

An illustration using isometric force measurements

M. E. Roebroeck, J. Harlaar, G. J. Lankhorst, K. W. Hayes, T. A. Matyas, J. L. Keating, K. M. Greenwood

Research output: Contribution to journalArticleResearchpeer-review

182 Citations (Scopus)

Abstract

Background and Purpose. The objective of this study was to examine the potential use of the generalizability theory for assessing reliability of muscle force measurements in clinical applications. Reliability is expressed in terms of standard error of measurement (SEM) and the indexes derived from the SEM. Using generalizability theory, potential sources of measurement error can be recognized and estimated. Subjects. Ten healthy women, aged 23 to 47 years (X̄=29.5, SD=7.1), participated in the study. Methods. The method is illustrated by presenting a pilot study. Repeated measurements of maximal isometric knee extension force were carried out by two therapists. The time interval between measurement occasions was 1 week. A functional prototype of a hand-held dynamometer was used, and measurements were carried out according to standardized test protocols. Results. Relatively important sources of measurement error were associated with interaction effects between subject and therapist as well as with interactions including the factor occasion. The SEM of the net knee moment was estimated for various hypothetical applications of the dynamometer. Conclusion and Discussion. It is concluded that the SEM, the corresponding confidence interval, and the smallest detectable difference are practical measures for expressing reliability of measurements on an individual. Generalizability theory is a powerful tool for estimating the magnitude of multiple sources of measurement error and for assessing the reliability of measurements tailored to specific clinical applications.

Original languageEnglish
Pages (from-to)386-401
Number of pages16
JournalPhysical Therapy
Volume73
Issue number6
Publication statusPublished - 1 Jan 1993

Keywords

  • Analysis of variance
  • Dynamometry
  • Generalizability
  • Reliability
  • Standard error of measurement

Cite this

Roebroeck, M. E., Harlaar, J., Lankhorst, G. J., Hayes, K. W., Matyas, T. A., Keating, J. L., & Greenwood, K. M. (1993). The application of generalizability theory to reliability assessment: An illustration using isometric force measurements. Physical Therapy, 73(6), 386-401.
Roebroeck, M. E. ; Harlaar, J. ; Lankhorst, G. J. ; Hayes, K. W. ; Matyas, T. A. ; Keating, J. L. ; Greenwood, K. M. / The application of generalizability theory to reliability assessment : An illustration using isometric force measurements. In: Physical Therapy. 1993 ; Vol. 73, No. 6. pp. 386-401.
@article{a0ce858f5d834b2c88d7f969e73cbc0b,
title = "The application of generalizability theory to reliability assessment: An illustration using isometric force measurements",
abstract = "Background and Purpose. The objective of this study was to examine the potential use of the generalizability theory for assessing reliability of muscle force measurements in clinical applications. Reliability is expressed in terms of standard error of measurement (SEM) and the indexes derived from the SEM. Using generalizability theory, potential sources of measurement error can be recognized and estimated. Subjects. Ten healthy women, aged 23 to 47 years (X̄=29.5, SD=7.1), participated in the study. Methods. The method is illustrated by presenting a pilot study. Repeated measurements of maximal isometric knee extension force were carried out by two therapists. The time interval between measurement occasions was 1 week. A functional prototype of a hand-held dynamometer was used, and measurements were carried out according to standardized test protocols. Results. Relatively important sources of measurement error were associated with interaction effects between subject and therapist as well as with interactions including the factor occasion. The SEM of the net knee moment was estimated for various hypothetical applications of the dynamometer. Conclusion and Discussion. It is concluded that the SEM, the corresponding confidence interval, and the smallest detectable difference are practical measures for expressing reliability of measurements on an individual. Generalizability theory is a powerful tool for estimating the magnitude of multiple sources of measurement error and for assessing the reliability of measurements tailored to specific clinical applications.",
keywords = "Analysis of variance, Dynamometry, Generalizability, Reliability, Standard error of measurement",
author = "Roebroeck, {M. E.} and J. Harlaar and Lankhorst, {G. J.} and Hayes, {K. W.} and Matyas, {T. A.} and Keating, {J. L.} and Greenwood, {K. M.}",
year = "1993",
month = "1",
day = "1",
language = "English",
volume = "73",
pages = "386--401",
journal = "Physical Therapy",
issn = "0031-9023",
publisher = "American Physical Therapy Association",
number = "6",

}

Roebroeck, ME, Harlaar, J, Lankhorst, GJ, Hayes, KW, Matyas, TA, Keating, JL & Greenwood, KM 1993, 'The application of generalizability theory to reliability assessment: An illustration using isometric force measurements', Physical Therapy, vol. 73, no. 6, pp. 386-401.

The application of generalizability theory to reliability assessment : An illustration using isometric force measurements. / Roebroeck, M. E.; Harlaar, J.; Lankhorst, G. J.; Hayes, K. W.; Matyas, T. A.; Keating, J. L.; Greenwood, K. M.

In: Physical Therapy, Vol. 73, No. 6, 01.01.1993, p. 386-401.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - The application of generalizability theory to reliability assessment

T2 - An illustration using isometric force measurements

AU - Roebroeck, M. E.

AU - Harlaar, J.

AU - Lankhorst, G. J.

AU - Hayes, K. W.

AU - Matyas, T. A.

AU - Keating, J. L.

AU - Greenwood, K. M.

PY - 1993/1/1

Y1 - 1993/1/1

N2 - Background and Purpose. The objective of this study was to examine the potential use of the generalizability theory for assessing reliability of muscle force measurements in clinical applications. Reliability is expressed in terms of standard error of measurement (SEM) and the indexes derived from the SEM. Using generalizability theory, potential sources of measurement error can be recognized and estimated. Subjects. Ten healthy women, aged 23 to 47 years (X̄=29.5, SD=7.1), participated in the study. Methods. The method is illustrated by presenting a pilot study. Repeated measurements of maximal isometric knee extension force were carried out by two therapists. The time interval between measurement occasions was 1 week. A functional prototype of a hand-held dynamometer was used, and measurements were carried out according to standardized test protocols. Results. Relatively important sources of measurement error were associated with interaction effects between subject and therapist as well as with interactions including the factor occasion. The SEM of the net knee moment was estimated for various hypothetical applications of the dynamometer. Conclusion and Discussion. It is concluded that the SEM, the corresponding confidence interval, and the smallest detectable difference are practical measures for expressing reliability of measurements on an individual. Generalizability theory is a powerful tool for estimating the magnitude of multiple sources of measurement error and for assessing the reliability of measurements tailored to specific clinical applications.

AB - Background and Purpose. The objective of this study was to examine the potential use of the generalizability theory for assessing reliability of muscle force measurements in clinical applications. Reliability is expressed in terms of standard error of measurement (SEM) and the indexes derived from the SEM. Using generalizability theory, potential sources of measurement error can be recognized and estimated. Subjects. Ten healthy women, aged 23 to 47 years (X̄=29.5, SD=7.1), participated in the study. Methods. The method is illustrated by presenting a pilot study. Repeated measurements of maximal isometric knee extension force were carried out by two therapists. The time interval between measurement occasions was 1 week. A functional prototype of a hand-held dynamometer was used, and measurements were carried out according to standardized test protocols. Results. Relatively important sources of measurement error were associated with interaction effects between subject and therapist as well as with interactions including the factor occasion. The SEM of the net knee moment was estimated for various hypothetical applications of the dynamometer. Conclusion and Discussion. It is concluded that the SEM, the corresponding confidence interval, and the smallest detectable difference are practical measures for expressing reliability of measurements on an individual. Generalizability theory is a powerful tool for estimating the magnitude of multiple sources of measurement error and for assessing the reliability of measurements tailored to specific clinical applications.

KW - Analysis of variance

KW - Dynamometry

KW - Generalizability

KW - Reliability

KW - Standard error of measurement

UR - http://www.scopus.com/inward/record.url?scp=0027155544&partnerID=8YFLogxK

M3 - Article

VL - 73

SP - 386

EP - 401

JO - Physical Therapy

JF - Physical Therapy

SN - 0031-9023

IS - 6

ER -