When 'just doing it' is not enough: assessing the fidelity of player performance of an injury prevention exercise program

Lauren Fortington, Alex Donaldson, Timothy Lathlean, Warren Young, Belinda Jane Gabbe, David Lloyd, Caroline F Finch

Research output: Contribution to journalArticleResearchpeer-review

23 Citations (Scopus)

Abstract

Objectives: To obtain benefits from sports injury prevention programs, players are instructed to perform the exercises as prescribed. We developed an observational checklist to measure the quality of exercise performance by players participating in FootyFirst, a coach-led, exercise-based, lower-limb injury prevention program in community Australian Football (AF). Design: Observational. Methods: The essential performance criteria for each FootyFirst exercise were described in terms of the technique, volume and intensity required to perform each exercise. An observational checklist was developed to evaluate each criterion through direct visual observation of players at training. The checklist was trialled by two independent raters who observed the same 70 players completing the exercises at eight clubs. Agreement between observers was assessed by Kappa-statistics. Exercise fidelity was defined as the proportion of observed players who performed all aspects of their exercises correctly. Results: The raters agreed on 61/70 observations (87 ) (Kappa = 0.72, 95 CI: 0.55; 0.89). Of the observations with agreed ratings, 41 (67 ) players were judged as performing the exercises as prescribed. Conclusions: The observational checklist demonstrated high inter-rater reliability. Many players observed did not perform the exercises as prescribed, raising concern as to whether they would be receiving anticipated program benefits. Where quality of exercise performance is important, evaluation and reporting of program fidelity should include direct observations of participants.
Original languageEnglish
Pages (from-to)272 - 277
Number of pages6
JournalJournal of Science and Medicine in Sport
Volume18
Issue number3
DOIs
Publication statusPublished - 2015

Cite this

Fortington, Lauren ; Donaldson, Alex ; Lathlean, Timothy ; Young, Warren ; Gabbe, Belinda Jane ; Lloyd, David ; Finch, Caroline F. / When 'just doing it' is not enough: assessing the fidelity of player performance of an injury prevention exercise program. In: Journal of Science and Medicine in Sport. 2015 ; Vol. 18, No. 3. pp. 272 - 277.
@article{aa3c9b0020c9446fa0cea4c0698c2a04,
title = "When 'just doing it' is not enough: assessing the fidelity of player performance of an injury prevention exercise program",
abstract = "Objectives: To obtain benefits from sports injury prevention programs, players are instructed to perform the exercises as prescribed. We developed an observational checklist to measure the quality of exercise performance by players participating in FootyFirst, a coach-led, exercise-based, lower-limb injury prevention program in community Australian Football (AF). Design: Observational. Methods: The essential performance criteria for each FootyFirst exercise were described in terms of the technique, volume and intensity required to perform each exercise. An observational checklist was developed to evaluate each criterion through direct visual observation of players at training. The checklist was trialled by two independent raters who observed the same 70 players completing the exercises at eight clubs. Agreement between observers was assessed by Kappa-statistics. Exercise fidelity was defined as the proportion of observed players who performed all aspects of their exercises correctly. Results: The raters agreed on 61/70 observations (87 ) (Kappa = 0.72, 95 CI: 0.55; 0.89). Of the observations with agreed ratings, 41 (67 ) players were judged as performing the exercises as prescribed. Conclusions: The observational checklist demonstrated high inter-rater reliability. Many players observed did not perform the exercises as prescribed, raising concern as to whether they would be receiving anticipated program benefits. Where quality of exercise performance is important, evaluation and reporting of program fidelity should include direct observations of participants.",
author = "Lauren Fortington and Alex Donaldson and Timothy Lathlean and Warren Young and Gabbe, {Belinda Jane} and David Lloyd and Finch, {Caroline F}",
year = "2015",
doi = "10.1016/j.jsams.2014.05.001",
language = "English",
volume = "18",
pages = "272 -- 277",
journal = "Journal of Science and Medicine in Sport",
issn = "1440-2440",
publisher = "Elsevier",
number = "3",

}

When 'just doing it' is not enough: assessing the fidelity of player performance of an injury prevention exercise program. / Fortington, Lauren; Donaldson, Alex; Lathlean, Timothy; Young, Warren; Gabbe, Belinda Jane; Lloyd, David; Finch, Caroline F.

In: Journal of Science and Medicine in Sport, Vol. 18, No. 3, 2015, p. 272 - 277.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - When 'just doing it' is not enough: assessing the fidelity of player performance of an injury prevention exercise program

AU - Fortington, Lauren

AU - Donaldson, Alex

AU - Lathlean, Timothy

AU - Young, Warren

AU - Gabbe, Belinda Jane

AU - Lloyd, David

AU - Finch, Caroline F

PY - 2015

Y1 - 2015

N2 - Objectives: To obtain benefits from sports injury prevention programs, players are instructed to perform the exercises as prescribed. We developed an observational checklist to measure the quality of exercise performance by players participating in FootyFirst, a coach-led, exercise-based, lower-limb injury prevention program in community Australian Football (AF). Design: Observational. Methods: The essential performance criteria for each FootyFirst exercise were described in terms of the technique, volume and intensity required to perform each exercise. An observational checklist was developed to evaluate each criterion through direct visual observation of players at training. The checklist was trialled by two independent raters who observed the same 70 players completing the exercises at eight clubs. Agreement between observers was assessed by Kappa-statistics. Exercise fidelity was defined as the proportion of observed players who performed all aspects of their exercises correctly. Results: The raters agreed on 61/70 observations (87 ) (Kappa = 0.72, 95 CI: 0.55; 0.89). Of the observations with agreed ratings, 41 (67 ) players were judged as performing the exercises as prescribed. Conclusions: The observational checklist demonstrated high inter-rater reliability. Many players observed did not perform the exercises as prescribed, raising concern as to whether they would be receiving anticipated program benefits. Where quality of exercise performance is important, evaluation and reporting of program fidelity should include direct observations of participants.

AB - Objectives: To obtain benefits from sports injury prevention programs, players are instructed to perform the exercises as prescribed. We developed an observational checklist to measure the quality of exercise performance by players participating in FootyFirst, a coach-led, exercise-based, lower-limb injury prevention program in community Australian Football (AF). Design: Observational. Methods: The essential performance criteria for each FootyFirst exercise were described in terms of the technique, volume and intensity required to perform each exercise. An observational checklist was developed to evaluate each criterion through direct visual observation of players at training. The checklist was trialled by two independent raters who observed the same 70 players completing the exercises at eight clubs. Agreement between observers was assessed by Kappa-statistics. Exercise fidelity was defined as the proportion of observed players who performed all aspects of their exercises correctly. Results: The raters agreed on 61/70 observations (87 ) (Kappa = 0.72, 95 CI: 0.55; 0.89). Of the observations with agreed ratings, 41 (67 ) players were judged as performing the exercises as prescribed. Conclusions: The observational checklist demonstrated high inter-rater reliability. Many players observed did not perform the exercises as prescribed, raising concern as to whether they would be receiving anticipated program benefits. Where quality of exercise performance is important, evaluation and reporting of program fidelity should include direct observations of participants.

UR - http://www.sciencedirect.com/science/article/pii/S144024401400084X

U2 - 10.1016/j.jsams.2014.05.001

DO - 10.1016/j.jsams.2014.05.001

M3 - Article

VL - 18

SP - 272

EP - 277

JO - Journal of Science and Medicine in Sport

JF - Journal of Science and Medicine in Sport

SN - 1440-2440

IS - 3

ER -