TY - JOUR
T1 - Treatment fidelity monitoring, reporting and findings in a complex aphasia intervention trial
T2 - a substudy of the Very Early Rehabilitation in SpEech (VERSE) trial
AU - Godecke, Erin
AU - Brogan, Emily
AU - Ciccone, Natalie
AU - Rose, Miranda L.
AU - Armstrong, Elizabeth
AU - Whitworth, Anne
AU - Ellery, Fiona
AU - Holland, Audrey
AU - Middleton, Sandy
AU - Rai, Tapan
AU - Hankey, Graeme J.
AU - Cadilhac, Dominique
AU - Bernhardt, Julie
N1 - Funding Information:
We would like to thank all participants and their families for taking part in this trial, the therapists who allowed us to video-record the therapy sessions and our treatment fidelity team (Fiona Ellery, Sanita Kratina, Crystal Ladzinski, Oriana Borschmann, Katie Ilich, Robynne Stevenson, Gemma Hughes, Jan Chamberlain) for the hours of monitoring and analysis that went into this publication. Study data were collected and managed using REDCap® electronic data capture tools [19] hosted at The Florey Institute of Neuroscience and Mental Health, Victoria, Australia [1]. REDCap (Research Electronic Data Capture) is a secure, web-based application designed to support data capture for research studies, providing (1) an intuitive interface for validated data entry, (2) audit trails for tracking data manipulation and export procedures, (3) automated export procedures for seamless data downloads to common statistical packages and (4) procedures for importing data from external sources.
Funding Information:
This study was funded by the National Health and Medical Research Council (NHMRC) (#1044973), 2013–2017; The Tavistock Trust for Aphasia (UK), 2017–2018; and Edith Cowan University, Australia, 2017–2018. Author DAC was supported by a National Health and Medical Research Council fellowship (#1063761 co-funded by Heart Foundation). Author JB was supported by a National Health and Medical Research Council fellowship (# 1154904).
Publisher Copyright:
© 2022, The Author(s).
PY - 2022/6/16
Y1 - 2022/6/16
N2 - Background: Treatment fidelity is inconsistently reported in aphasia research, contributing to uncertainty about the effectiveness of types of aphasia therapy following stroke. We outline the processes and outcomes of treatment fidelity monitoring in a pre-specified secondary analysis of the VERSE trial. Methods: VERSE was a 3-arm, single-blinded RCT with a 12-week primary endpoint comparing Usual Care (UC) to two higher intensity treatments: Usual Care-Plus (UC-Plus) and VERSE, a prescribed intervention. Primary outcome results were previously reported. This secondary analysis focused on treatment fidelity. Video-recorded treatment sessions in the higher intensity study arms were evaluated for treatment adherence and treatment differentiation. Treatment components were evaluated using a pre-determined fidelity checklist. Primary outcome: prescribed amount of therapy time (minutes); secondary outcomes: (i) adherence to therapy protocol (%) and (ii) treatment differentiation between control and high intensity groups. Results: Two hundred forty-six participants were randomised to Usual Care (n=81), Usual Care-Plus (n=82), and VERSE (n=83). One hundred thirty-five (82%) participants in higher intensity intervention arms received the minimum prescribed therapy minutes. From 10,805 (UC 7787; UC-Plus 1450; VERSE 1568) service events, 431 treatment protocol deviations were noted in 114 participants. Four hundred thirty-seven videos were evaluated. The VERSE therapists achieved over 84% adherence to key protocol elements. Higher stroke and aphasia severity, older age, and being in the UC-Plus group predicted more treatment deviations. Conclusions: We found high levels of treatment adherence and differentiation between the intervention arms, providing greater confidence interpreting our results. The comprehensive systems for intervention fidelity monitoring and reporting in this trial make an important contribution to aphasia research and, we argue, should set a new standard for future aphasia studies.
AB - Background: Treatment fidelity is inconsistently reported in aphasia research, contributing to uncertainty about the effectiveness of types of aphasia therapy following stroke. We outline the processes and outcomes of treatment fidelity monitoring in a pre-specified secondary analysis of the VERSE trial. Methods: VERSE was a 3-arm, single-blinded RCT with a 12-week primary endpoint comparing Usual Care (UC) to two higher intensity treatments: Usual Care-Plus (UC-Plus) and VERSE, a prescribed intervention. Primary outcome results were previously reported. This secondary analysis focused on treatment fidelity. Video-recorded treatment sessions in the higher intensity study arms were evaluated for treatment adherence and treatment differentiation. Treatment components were evaluated using a pre-determined fidelity checklist. Primary outcome: prescribed amount of therapy time (minutes); secondary outcomes: (i) adherence to therapy protocol (%) and (ii) treatment differentiation between control and high intensity groups. Results: Two hundred forty-six participants were randomised to Usual Care (n=81), Usual Care-Plus (n=82), and VERSE (n=83). One hundred thirty-five (82%) participants in higher intensity intervention arms received the minimum prescribed therapy minutes. From 10,805 (UC 7787; UC-Plus 1450; VERSE 1568) service events, 431 treatment protocol deviations were noted in 114 participants. Four hundred thirty-seven videos were evaluated. The VERSE therapists achieved over 84% adherence to key protocol elements. Higher stroke and aphasia severity, older age, and being in the UC-Plus group predicted more treatment deviations. Conclusions: We found high levels of treatment adherence and differentiation between the intervention arms, providing greater confidence interpreting our results. The comprehensive systems for intervention fidelity monitoring and reporting in this trial make an important contribution to aphasia research and, we argue, should set a new standard for future aphasia studies.
KW - Aphasia
KW - Behavioural therapy
KW - Randomised control trial
KW - Rehabilitation
KW - Stroke
KW - Treatment fidelity
UR - https://www.scopus.com/pages/publications/85132080421
U2 - 10.1186/s13063-022-06433-3
DO - 10.1186/s13063-022-06433-3
M3 - Article
C2 - 35710437
AN - SCOPUS:85132080421
SN - 1745-6215
VL - 23
JO - Trials
JF - Trials
IS - 1
M1 - 501
ER -