Assessment Practices for Dietetics Trainees: A Systematic Review

Research output: Contribution to journalReview ArticleResearchpeer-review

Abstract

High-quality education is essential to produce competent graduates in the field of dietetics. Assessment is a fundamental component of education and driver of learning, yet little is known about methods used to assess dietetics trainees. The objective of this review is to evaluate the practices and outcomes of methods used to assess dietetics trainees. A systematic review of the literature was undertaken. MEDLINE, the Cumulative Index to Nursing and Allied Health Literature Plus, Embase, and the Education Resources Information Center databases were searched from inception until May 31, 2017, using key terms that identified studies reporting practices for the assessment of dietetics trainees. Abstract and title screening was completed by three independent reviewers followed by full-text screening using the eligibility criteria. Quantitative and qualitative data were extracted. Study outcomes were evaluated using Miller's Pyramid, Kirkpatrick's Hierarchy, and the principles of programmatic assessment. Thirty-seven studies were identified. Assessments targeted all levels of Miller's Pyramid with the does level being the most prevalent (n=23). Most studies focussed on evaluating Level 1 (participation) (n=16) and Level 2b (n=16) (knowledge and skills) of Kirkpatrick's Hierarchy. Studies described single assessment instruments that focussed on instrument validity and reliability. Few studies considered a program of assessment or the role of expert judgment. Six themes were identified from qualitative data: (1) assessment for learning and professional development, (2) assessment requires motivated and skilled assessors, (3) trainees value authentic and global assessment, (4) assessment is evolving and context-sensitive, (5) poor assessment has negative implications, and (6) assessment evokes an emotional response. Studies focused on the development and evaluation of single quantitative-based instruments applied in isolation, with low-level outcomes sought. There is room to improve practices and design programs of assessment that combine quantitative and qualitative data for meaningful trainee feedback and credible assessment decisions. Comprehensive evaluation of assessment practices is required and must consider the contribution to improved health outcomes in all practice settings.

Original languageEnglish
Pages (from-to)272-292
Number of pages21
JournalJournal of the Academy of Nutrition and Dietetics
Volume119
Issue number2
DOIs
Publication statusPublished - 1 Feb 2019

Keywords

  • Assessment
  • Dietetics
  • Education
  • Systematic review
  • Trainee

Cite this

@article{98b40924cd4e41e891c0b009efe2dab5,
title = "Assessment Practices for Dietetics Trainees: A Systematic Review",
abstract = "High-quality education is essential to produce competent graduates in the field of dietetics. Assessment is a fundamental component of education and driver of learning, yet little is known about methods used to assess dietetics trainees. The objective of this review is to evaluate the practices and outcomes of methods used to assess dietetics trainees. A systematic review of the literature was undertaken. MEDLINE, the Cumulative Index to Nursing and Allied Health Literature Plus, Embase, and the Education Resources Information Center databases were searched from inception until May 31, 2017, using key terms that identified studies reporting practices for the assessment of dietetics trainees. Abstract and title screening was completed by three independent reviewers followed by full-text screening using the eligibility criteria. Quantitative and qualitative data were extracted. Study outcomes were evaluated using Miller's Pyramid, Kirkpatrick's Hierarchy, and the principles of programmatic assessment. Thirty-seven studies were identified. Assessments targeted all levels of Miller's Pyramid with the does level being the most prevalent (n=23). Most studies focussed on evaluating Level 1 (participation) (n=16) and Level 2b (n=16) (knowledge and skills) of Kirkpatrick's Hierarchy. Studies described single assessment instruments that focussed on instrument validity and reliability. Few studies considered a program of assessment or the role of expert judgment. Six themes were identified from qualitative data: (1) assessment for learning and professional development, (2) assessment requires motivated and skilled assessors, (3) trainees value authentic and global assessment, (4) assessment is evolving and context-sensitive, (5) poor assessment has negative implications, and (6) assessment evokes an emotional response. Studies focused on the development and evaluation of single quantitative-based instruments applied in isolation, with low-level outcomes sought. There is room to improve practices and design programs of assessment that combine quantitative and qualitative data for meaningful trainee feedback and credible assessment decisions. Comprehensive evaluation of assessment practices is required and must consider the contribution to improved health outcomes in all practice settings.",
keywords = "Assessment, Dietetics, Education, Systematic review, Trainee",
author = "Janica Jamieson and Claire Palermo and Margaret Hay and Simone Gibson",
year = "2019",
month = "2",
day = "1",
doi = "10.1016/j.jand.2018.09.010",
language = "English",
volume = "119",
pages = "272--292",
journal = "Journal of the Academy of Nutrition and Dietetics",
issn = "2212-2672",
publisher = "Elsevier",
number = "2",

}

Assessment Practices for Dietetics Trainees : A Systematic Review. / Jamieson, Janica; Palermo, Claire; Hay, Margaret; Gibson, Simone.

In: Journal of the Academy of Nutrition and Dietetics, Vol. 119, No. 2, 01.02.2019, p. 272-292.

Research output: Contribution to journalReview ArticleResearchpeer-review

TY - JOUR

T1 - Assessment Practices for Dietetics Trainees

T2 - A Systematic Review

AU - Jamieson, Janica

AU - Palermo, Claire

AU - Hay, Margaret

AU - Gibson, Simone

PY - 2019/2/1

Y1 - 2019/2/1

N2 - High-quality education is essential to produce competent graduates in the field of dietetics. Assessment is a fundamental component of education and driver of learning, yet little is known about methods used to assess dietetics trainees. The objective of this review is to evaluate the practices and outcomes of methods used to assess dietetics trainees. A systematic review of the literature was undertaken. MEDLINE, the Cumulative Index to Nursing and Allied Health Literature Plus, Embase, and the Education Resources Information Center databases were searched from inception until May 31, 2017, using key terms that identified studies reporting practices for the assessment of dietetics trainees. Abstract and title screening was completed by three independent reviewers followed by full-text screening using the eligibility criteria. Quantitative and qualitative data were extracted. Study outcomes were evaluated using Miller's Pyramid, Kirkpatrick's Hierarchy, and the principles of programmatic assessment. Thirty-seven studies were identified. Assessments targeted all levels of Miller's Pyramid with the does level being the most prevalent (n=23). Most studies focussed on evaluating Level 1 (participation) (n=16) and Level 2b (n=16) (knowledge and skills) of Kirkpatrick's Hierarchy. Studies described single assessment instruments that focussed on instrument validity and reliability. Few studies considered a program of assessment or the role of expert judgment. Six themes were identified from qualitative data: (1) assessment for learning and professional development, (2) assessment requires motivated and skilled assessors, (3) trainees value authentic and global assessment, (4) assessment is evolving and context-sensitive, (5) poor assessment has negative implications, and (6) assessment evokes an emotional response. Studies focused on the development and evaluation of single quantitative-based instruments applied in isolation, with low-level outcomes sought. There is room to improve practices and design programs of assessment that combine quantitative and qualitative data for meaningful trainee feedback and credible assessment decisions. Comprehensive evaluation of assessment practices is required and must consider the contribution to improved health outcomes in all practice settings.

AB - High-quality education is essential to produce competent graduates in the field of dietetics. Assessment is a fundamental component of education and driver of learning, yet little is known about methods used to assess dietetics trainees. The objective of this review is to evaluate the practices and outcomes of methods used to assess dietetics trainees. A systematic review of the literature was undertaken. MEDLINE, the Cumulative Index to Nursing and Allied Health Literature Plus, Embase, and the Education Resources Information Center databases were searched from inception until May 31, 2017, using key terms that identified studies reporting practices for the assessment of dietetics trainees. Abstract and title screening was completed by three independent reviewers followed by full-text screening using the eligibility criteria. Quantitative and qualitative data were extracted. Study outcomes were evaluated using Miller's Pyramid, Kirkpatrick's Hierarchy, and the principles of programmatic assessment. Thirty-seven studies were identified. Assessments targeted all levels of Miller's Pyramid with the does level being the most prevalent (n=23). Most studies focussed on evaluating Level 1 (participation) (n=16) and Level 2b (n=16) (knowledge and skills) of Kirkpatrick's Hierarchy. Studies described single assessment instruments that focussed on instrument validity and reliability. Few studies considered a program of assessment or the role of expert judgment. Six themes were identified from qualitative data: (1) assessment for learning and professional development, (2) assessment requires motivated and skilled assessors, (3) trainees value authentic and global assessment, (4) assessment is evolving and context-sensitive, (5) poor assessment has negative implications, and (6) assessment evokes an emotional response. Studies focused on the development and evaluation of single quantitative-based instruments applied in isolation, with low-level outcomes sought. There is room to improve practices and design programs of assessment that combine quantitative and qualitative data for meaningful trainee feedback and credible assessment decisions. Comprehensive evaluation of assessment practices is required and must consider the contribution to improved health outcomes in all practice settings.

KW - Assessment

KW - Dietetics

KW - Education

KW - Systematic review

KW - Trainee

UR - http://www.scopus.com/inward/record.url?scp=85060152452&partnerID=8YFLogxK

U2 - 10.1016/j.jand.2018.09.010

DO - 10.1016/j.jand.2018.09.010

M3 - Review Article

VL - 119

SP - 272

EP - 292

JO - Journal of the Academy of Nutrition and Dietetics

JF - Journal of the Academy of Nutrition and Dietetics

SN - 2212-2672

IS - 2

ER -