The relative predictive value of undergraduate versus graduate selection tools in two Australian medical schools

Annette Mercer, Margaret Hay, Wayne C. Hodgson, Ben J. Canny, Ian B. Puddey

Research output: Contribution to journalArticleResearchpeer-review

2 Citations (Scopus)

Abstract

Context: Monash University and the University of Western Australia admit both school-leavers and graduates into their Bachelor of Medicine and Bachelor of Surgery (MBBS) courses. The Undergraduate Medicine and Health Sciences Admission Test (UMAT) and the Graduate Medical Schools Admissions Test (GAMSAT) are used for selection, along with an academic score and an interview score. The aim of this study was to compare the relative predictive validity of the selected components in the two entry streams, particularly UMAT versus GAMSAT. Methods: Aggregated scores for course outcomes were calculated in the categories of knowledge, clinical and total scores, at four-time points. A path analysis was conducted based on multivariate regressions with model constraint parameters defined across the outcome variables to investigate change over time. Results: Academic scores were the strongest predictors of knowledge scores and end of course results. Interview scores had a small positive increasing effect, being stronger for clinical than knowledge outcomes. The effect size for GAMSAT was greater than for UMAT. Conclusions: Aptitude tests and interview scores added small but significant incremental predictive value to previous academic achievement. GAMSAT showed larger predictive value on outcomes than UMAT, for which one section (UMAT 3) had a negative effect.

Original languageEnglish
Pages (from-to)1183-1190
Number of pages8
JournalMedical Teacher
Volume40
Issue number11
DOIs
Publication statusPublished - 2 Nov 2018

Cite this

@article{049e7a5796f547d2b84758471368c80a,
title = "The relative predictive value of undergraduate versus graduate selection tools in two Australian medical schools",
abstract = "Context: Monash University and the University of Western Australia admit both school-leavers and graduates into their Bachelor of Medicine and Bachelor of Surgery (MBBS) courses. The Undergraduate Medicine and Health Sciences Admission Test (UMAT) and the Graduate Medical Schools Admissions Test (GAMSAT) are used for selection, along with an academic score and an interview score. The aim of this study was to compare the relative predictive validity of the selected components in the two entry streams, particularly UMAT versus GAMSAT. Methods: Aggregated scores for course outcomes were calculated in the categories of knowledge, clinical and total scores, at four-time points. A path analysis was conducted based on multivariate regressions with model constraint parameters defined across the outcome variables to investigate change over time. Results: Academic scores were the strongest predictors of knowledge scores and end of course results. Interview scores had a small positive increasing effect, being stronger for clinical than knowledge outcomes. The effect size for GAMSAT was greater than for UMAT. Conclusions: Aptitude tests and interview scores added small but significant incremental predictive value to previous academic achievement. GAMSAT showed larger predictive value on outcomes than UMAT, for which one section (UMAT 3) had a negative effect.",
author = "Annette Mercer and Margaret Hay and Hodgson, {Wayne C.} and Canny, {Ben J.} and Puddey, {Ian B.}",
year = "2018",
month = "11",
day = "2",
doi = "10.1080/0142159X.2018.1426839",
language = "English",
volume = "40",
pages = "1183--1190",
journal = "Medical Teacher",
issn = "0142-159X",
publisher = "Taylor & Francis",
number = "11",

}

The relative predictive value of undergraduate versus graduate selection tools in two Australian medical schools. / Mercer, Annette; Hay, Margaret; Hodgson, Wayne C.; Canny, Ben J.; Puddey, Ian B.

In: Medical Teacher, Vol. 40, No. 11, 02.11.2018, p. 1183-1190.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - The relative predictive value of undergraduate versus graduate selection tools in two Australian medical schools

AU - Mercer, Annette

AU - Hay, Margaret

AU - Hodgson, Wayne C.

AU - Canny, Ben J.

AU - Puddey, Ian B.

PY - 2018/11/2

Y1 - 2018/11/2

N2 - Context: Monash University and the University of Western Australia admit both school-leavers and graduates into their Bachelor of Medicine and Bachelor of Surgery (MBBS) courses. The Undergraduate Medicine and Health Sciences Admission Test (UMAT) and the Graduate Medical Schools Admissions Test (GAMSAT) are used for selection, along with an academic score and an interview score. The aim of this study was to compare the relative predictive validity of the selected components in the two entry streams, particularly UMAT versus GAMSAT. Methods: Aggregated scores for course outcomes were calculated in the categories of knowledge, clinical and total scores, at four-time points. A path analysis was conducted based on multivariate regressions with model constraint parameters defined across the outcome variables to investigate change over time. Results: Academic scores were the strongest predictors of knowledge scores and end of course results. Interview scores had a small positive increasing effect, being stronger for clinical than knowledge outcomes. The effect size for GAMSAT was greater than for UMAT. Conclusions: Aptitude tests and interview scores added small but significant incremental predictive value to previous academic achievement. GAMSAT showed larger predictive value on outcomes than UMAT, for which one section (UMAT 3) had a negative effect.

AB - Context: Monash University and the University of Western Australia admit both school-leavers and graduates into their Bachelor of Medicine and Bachelor of Surgery (MBBS) courses. The Undergraduate Medicine and Health Sciences Admission Test (UMAT) and the Graduate Medical Schools Admissions Test (GAMSAT) are used for selection, along with an academic score and an interview score. The aim of this study was to compare the relative predictive validity of the selected components in the two entry streams, particularly UMAT versus GAMSAT. Methods: Aggregated scores for course outcomes were calculated in the categories of knowledge, clinical and total scores, at four-time points. A path analysis was conducted based on multivariate regressions with model constraint parameters defined across the outcome variables to investigate change over time. Results: Academic scores were the strongest predictors of knowledge scores and end of course results. Interview scores had a small positive increasing effect, being stronger for clinical than knowledge outcomes. The effect size for GAMSAT was greater than for UMAT. Conclusions: Aptitude tests and interview scores added small but significant incremental predictive value to previous academic achievement. GAMSAT showed larger predictive value on outcomes than UMAT, for which one section (UMAT 3) had a negative effect.

UR - http://www.scopus.com/inward/record.url?scp=85056097560&partnerID=8YFLogxK

U2 - 10.1080/0142159X.2018.1426839

DO - 10.1080/0142159X.2018.1426839

M3 - Article

VL - 40

SP - 1183

EP - 1190

JO - Medical Teacher

JF - Medical Teacher

SN - 0142-159X

IS - 11

ER -