Enhancing education activities for health care trainees and professionals using audience response systems: A systematic review

Introduction: This review examines the effect of incorporating clickers within practice-based education sessions on educational outcomes of health care trainees and professionals. Methods: A systematic literature review was conducted on primary research studies published up until August 2014. Studies were identified by database searching (Ovid MEDLINE, EMBASE, CINAHL, Scopus, Web of Science, and PsychInfo), citation searching, and reference list checking. Studies were restricted to those evaluating the use of clickers as part of the provision of postgraduate education or continuing education programs and were evaluated according to Kirkpatrick’s four levels of training evaluation (reaction, learning, behavior, and results). Results: Seventeen studies met the eligibility criteria. Twelve studies assessed learner and/or speaker reactions, with feedback overwhelmingly positive in all studies. Reported learner benefits included increased attentiveness, engagement, and enjoyment of presentations. Speakers reported that using clickers engaged the audience and assisted in assessing audience comprehension. Eight studies assessed learning outcomes. Higher level evidence obtained from four randomized studies demonstrated significant improvements in knowledge with the use of clickers compared with traditional didactic presentations, but no differences when clickers were compared with an interactive lecture with integrated questions. No studies adequately assessed higher level educational outcomes (behavior and results). Conclusion: Although the use of clickers improves learning environment and learner satisfaction, the limited high-quality data for improvements in learning and behavior outcomes make it uncertain whether the acceptance and implementation of clickers within routine practice-based education programs are warranted at this stage.