The TDR MOOC on implementation science: An evaluation of behaviour change and results

This presentation reports on the evaluation of a MOOC on implementation research (IR) with a focus on infectious diseases of poverty using Kirkpatrick’s Model. The MOOC was developed by TDR. IR plays a critical role in the delivery of disease control interventions, particularly in low- and middle-income countries (LMICs). Recent growing demand for IR training has led to the development of a range of training programs, however, the majority cannot be accessed by learners in LMICs. This evaluation focuses on post-training changes in participant behaviour and professional results.
Participants were invited to take part in an anonymous online survey and follow-up tele-interview 1-2 years after completing the MOOC examining their IR knowledge, how they applied it in their professional practice and perceived benefits to their place of employment. The survey contained 43 multiple choice Likert-type and open-ended questions. 748 MOOC participants responded to the survey and 7 participants were interviewed. Descriptive statistics were calculated for the quantitative survey data and responses to the open-ended survey questions and interview data were thematically coded.
The MOOC was successful in targeting learners from LMICs. Findings revealed that respondents’ IR knowledge improved to a very large (18.1%) or large extent (50.5%) due to the MOOC, and that they frequently used the knowledge and skills gained in their professional lives. 66.5% stated that participation in the MOOC had benefited their place of employment. This suggests that the use of a MOOC as a training platform for IR for learners in LMICs, where implementation challenges are encountered often, is an ideal standalone learning tool or one that could be combined with other training formats.