Abstract
Title: Undergraduate medical course applicants’ ratings of the value of a Situational Judgment Test (SJT) as a selection tool
Name: Irene Lichtwark, Margaret Hay
Origin: Monash University, Melbourne, Australia
Introduction/background
Candidate reactions to the SJT as a selection tool have been assessed in post-graduate medical selection, and teacher training, but not in undergraduate medical course applicants.
Methods
MBBS applicants at Monash University completed an online 80 scenario SJT (N=503, 57.9% female, mean age 18.2 years, SD 0.49). Candidates rated the difficulty of the SJT relative to the Undergraduate Medicine and Health Sciences Admissions Test (UMAT). Face validity of the SJT was assessed via ratings of scenario relevance, suitability as a selection tool, and ranking of the SJT relative to the UMAT, MMI, and Year 12 score.
Results
Most (72.3%) rated the SJT as easier than the UMAT, and 70% could relate to the SJT scenarios. Nearly all (91.1%) rated the SJT questions as relevant for medical course selection, with 66.5% rating the SJT as a suitable selection test. MMI was ranked as the most useful selection tool by 56.4%, with 31.6% nominating Year 12 score. The UMAT was ranked as the least useful selection tool by 45.5%, and the SJT by 23.6%. Candidates preferring the UMAT found the SJT repetitive, and lacking in variety of item type. Candidates preferring the SJT enjoyed the test, its shorter test time, realistic scenarios contextualized in medicine, and perceived relevance to future practice.
Discussion/Conclusion
This study provides evidence of higher face validity of the SJT relative to the UMAT, but not the MMI or Year 12 score. Despite their young age, most candidates were able to relate to the medically contextualized scenarios.
Name: Irene Lichtwark, Margaret Hay
Origin: Monash University, Melbourne, Australia
Introduction/background
Candidate reactions to the SJT as a selection tool have been assessed in post-graduate medical selection, and teacher training, but not in undergraduate medical course applicants.
Methods
MBBS applicants at Monash University completed an online 80 scenario SJT (N=503, 57.9% female, mean age 18.2 years, SD 0.49). Candidates rated the difficulty of the SJT relative to the Undergraduate Medicine and Health Sciences Admissions Test (UMAT). Face validity of the SJT was assessed via ratings of scenario relevance, suitability as a selection tool, and ranking of the SJT relative to the UMAT, MMI, and Year 12 score.
Results
Most (72.3%) rated the SJT as easier than the UMAT, and 70% could relate to the SJT scenarios. Nearly all (91.1%) rated the SJT questions as relevant for medical course selection, with 66.5% rating the SJT as a suitable selection test. MMI was ranked as the most useful selection tool by 56.4%, with 31.6% nominating Year 12 score. The UMAT was ranked as the least useful selection tool by 45.5%, and the SJT by 23.6%. Candidates preferring the UMAT found the SJT repetitive, and lacking in variety of item type. Candidates preferring the SJT enjoyed the test, its shorter test time, realistic scenarios contextualized in medicine, and perceived relevance to future practice.
Discussion/Conclusion
This study provides evidence of higher face validity of the SJT relative to the UMAT, but not the MMI or Year 12 score. Despite their young age, most candidates were able to relate to the medically contextualized scenarios.
| Original language | English |
|---|---|
| Publication status | Published - Mar 2017 |
| Event | Australian & New Zealand Association for Health Professional Educators Conference 2017 - Adelaide Convention Centre, Adelaide, Australia Duration: 11 Jul 2017 → 14 Jul 2017 https://www.anzahpe.org/resources/Documents/Conference/Past%20Conference%20documentation/Poster%20Proceedings%20-%20ANZAHPE%202017_200617.pdf (Poster Proceedings) https://www.anzahpe.org/resources/Documents/Conference/Past%20Conference%20documentation/Oral%20Proceedings%20-%20ANZAHPE%202017.pdf (Oral Proceedings) https://www.anzahpe.org/resources/Documents/Conference/Past%20Conference%20documentation/Proceedings%20-%20Workshop%20%20ANZAHPE%202017.pdf (Workshop proceedings) |
Conference
| Conference | Australian & New Zealand Association for Health Professional Educators Conference 2017 |
|---|---|
| Abbreviated title | ANZAHPE 2017 |
| Country/Territory | Australia |
| City | Adelaide |
| Period | 11/07/17 → 14/07/17 |
| Other | Theme: Transitions |
| Internet address |
|
Keywords
- SJT, candidate reactions, face validity