Quantity and quality of homework compliance

A meta-analysis of relations with outcome in cognitive behavior therapy

Nikolaos Kazantzis, Craig J Whittington, Leah Zelencich, Michael Kyrios, Peter J Norton, Stefan G Hofmann

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Homework assignments have been shown to produce both causal and correlational effects in prior meta-analytic reviews of cognitive behavior therapy (CBT), but this
research area has been characterized by a focus on the amount of compliance (i.e., quantity), and little is known about the role of skill acquisition (i.e., quality). A landmark study by Neimeyer and Feixas (1990) showed stronger homework-outcome relations when quality was assessed, but previous reviews have not considered whether the same pattern is evident across studies. Seventeen studies of CBT (N = 2,312 clients) published following calls for research on homework quality were included in the current metaanalysis. In the present review, homework compliance relations were demonstrated when outcome was assessed at posttreatment (quality Hedges’ g = 0.78, 95% Confidence Interval [CI] = 0.03 to 1.53, k = 3, n = 417; quantity g = 0.79, 95% CI = 0.57 to 1.02, k = 15, n = 1537) and at follow-up (quality g = 1.07, 95% CI = 0.06 to 2.08, k = 3, n = 417; quantity g = 0.51, 95% CI = 0.28 to 0.74, k = 7, n = 1291). All effect sizes were different from 0, ps b .05. Differences that were obtained in homework-outcome relations among sources of compliance data (client, therapist, objective) were tentative due to overlapping CIs, but suggest a potential moderating effect. If confirmed by further research, the present findings would suggest that trial methods capable of assessing both quantity and quality have been an important omission in research on homework-outcome relations in CBT.
Original languageEnglish
Pages (from-to)755-772
Number of pages18
JournalBehavior Therapy
Volume47
Issue number5
DOIs
Publication statusPublished - Sep 2016

Keywords

  • homework compliance
  • meta-analysis
  • cognitive behavior therapy
  • cognitive therapy

Cite this

Kazantzis, Nikolaos ; Whittington, Craig J ; Zelencich, Leah ; Kyrios, Michael ; Norton, Peter J ; Hofmann, Stefan G. / Quantity and quality of homework compliance : A meta-analysis of relations with outcome in cognitive behavior therapy. In: Behavior Therapy. 2016 ; Vol. 47, No. 5. pp. 755-772.
@article{e9f3d662f20541cdad331522ff7210ae,
title = "Quantity and quality of homework compliance: A meta-analysis of relations with outcome in cognitive behavior therapy",
abstract = "Homework assignments have been shown to produce both causal and correlational effects in prior meta-analytic reviews of cognitive behavior therapy (CBT), but thisresearch area has been characterized by a focus on the amount of compliance (i.e., quantity), and little is known about the role of skill acquisition (i.e., quality). A landmark study by Neimeyer and Feixas (1990) showed stronger homework-outcome relations when quality was assessed, but previous reviews have not considered whether the same pattern is evident across studies. Seventeen studies of CBT (N = 2,312 clients) published following calls for research on homework quality were included in the current metaanalysis. In the present review, homework compliance relations were demonstrated when outcome was assessed at posttreatment (quality Hedges’ g = 0.78, 95{\%} Confidence Interval [CI] = 0.03 to 1.53, k = 3, n = 417; quantity g = 0.79, 95{\%} CI = 0.57 to 1.02, k = 15, n = 1537) and at follow-up (quality g = 1.07, 95{\%} CI = 0.06 to 2.08, k = 3, n = 417; quantity g = 0.51, 95{\%} CI = 0.28 to 0.74, k = 7, n = 1291). All effect sizes were different from 0, ps b .05. Differences that were obtained in homework-outcome relations among sources of compliance data (client, therapist, objective) were tentative due to overlapping CIs, but suggest a potential moderating effect. If confirmed by further research, the present findings would suggest that trial methods capable of assessing both quantity and quality have been an important omission in research on homework-outcome relations in CBT.",
keywords = "homework compliance, meta-analysis, cognitive behavior therapy, cognitive therapy",
author = "Nikolaos Kazantzis and Whittington, {Craig J} and Leah Zelencich and Michael Kyrios and Norton, {Peter J} and Hofmann, {Stefan G}",
year = "2016",
month = "9",
doi = "10.1016/j.beth.2016.05.002",
language = "English",
volume = "47",
pages = "755--772",
journal = "Behavior Therapy",
issn = "0005-7894",
publisher = "Elsevier",
number = "5",

}

Quantity and quality of homework compliance : A meta-analysis of relations with outcome in cognitive behavior therapy. / Kazantzis, Nikolaos; Whittington, Craig J; Zelencich, Leah; Kyrios, Michael; Norton, Peter J; Hofmann, Stefan G.

In: Behavior Therapy, Vol. 47, No. 5, 09.2016, p. 755-772.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Quantity and quality of homework compliance

T2 - A meta-analysis of relations with outcome in cognitive behavior therapy

AU - Kazantzis, Nikolaos

AU - Whittington, Craig J

AU - Zelencich, Leah

AU - Kyrios, Michael

AU - Norton, Peter J

AU - Hofmann, Stefan G

PY - 2016/9

Y1 - 2016/9

N2 - Homework assignments have been shown to produce both causal and correlational effects in prior meta-analytic reviews of cognitive behavior therapy (CBT), but thisresearch area has been characterized by a focus on the amount of compliance (i.e., quantity), and little is known about the role of skill acquisition (i.e., quality). A landmark study by Neimeyer and Feixas (1990) showed stronger homework-outcome relations when quality was assessed, but previous reviews have not considered whether the same pattern is evident across studies. Seventeen studies of CBT (N = 2,312 clients) published following calls for research on homework quality were included in the current metaanalysis. In the present review, homework compliance relations were demonstrated when outcome was assessed at posttreatment (quality Hedges’ g = 0.78, 95% Confidence Interval [CI] = 0.03 to 1.53, k = 3, n = 417; quantity g = 0.79, 95% CI = 0.57 to 1.02, k = 15, n = 1537) and at follow-up (quality g = 1.07, 95% CI = 0.06 to 2.08, k = 3, n = 417; quantity g = 0.51, 95% CI = 0.28 to 0.74, k = 7, n = 1291). All effect sizes were different from 0, ps b .05. Differences that were obtained in homework-outcome relations among sources of compliance data (client, therapist, objective) were tentative due to overlapping CIs, but suggest a potential moderating effect. If confirmed by further research, the present findings would suggest that trial methods capable of assessing both quantity and quality have been an important omission in research on homework-outcome relations in CBT.

AB - Homework assignments have been shown to produce both causal and correlational effects in prior meta-analytic reviews of cognitive behavior therapy (CBT), but thisresearch area has been characterized by a focus on the amount of compliance (i.e., quantity), and little is known about the role of skill acquisition (i.e., quality). A landmark study by Neimeyer and Feixas (1990) showed stronger homework-outcome relations when quality was assessed, but previous reviews have not considered whether the same pattern is evident across studies. Seventeen studies of CBT (N = 2,312 clients) published following calls for research on homework quality were included in the current metaanalysis. In the present review, homework compliance relations were demonstrated when outcome was assessed at posttreatment (quality Hedges’ g = 0.78, 95% Confidence Interval [CI] = 0.03 to 1.53, k = 3, n = 417; quantity g = 0.79, 95% CI = 0.57 to 1.02, k = 15, n = 1537) and at follow-up (quality g = 1.07, 95% CI = 0.06 to 2.08, k = 3, n = 417; quantity g = 0.51, 95% CI = 0.28 to 0.74, k = 7, n = 1291). All effect sizes were different from 0, ps b .05. Differences that were obtained in homework-outcome relations among sources of compliance data (client, therapist, objective) were tentative due to overlapping CIs, but suggest a potential moderating effect. If confirmed by further research, the present findings would suggest that trial methods capable of assessing both quantity and quality have been an important omission in research on homework-outcome relations in CBT.

KW - homework compliance

KW - meta-analysis

KW - cognitive behavior therapy

KW - cognitive therapy

U2 - 10.1016/j.beth.2016.05.002

DO - 10.1016/j.beth.2016.05.002

M3 - Article

VL - 47

SP - 755

EP - 772

JO - Behavior Therapy

JF - Behavior Therapy

SN - 0005-7894

IS - 5

ER -