Entry tests for graduate medical programs: is it time to re-think?
Authors: Malcolm H Parker, David Wilkinson, Ray G Peterson, Ieva Z Ozolins, Haida Luke, Jenny Zhang and Gerard J A Byrne
Published online: 20 August 2007
To the Editor: We are concerned about aspects of the study of selection predictors of medical school performance in Australian medical schools by Groves et al,1 and how they may be interpreted.
A “voluntary” response rate of 13.6% is very small and unlikely to be representative, and selection or response bias is likely. Although noted by the authors, this fundamental flaw may be overlooked in interpreting the results. This aside, of what value is the outcome measure of clinical reasoning skills among students, some of whom are only in second year, and whom we would not expect to have developed substantial expertise in clinical reasoning at this early stage?
More significantly, we consider that the research question itself may be flawed, as we are not at all convinced that selection scores are intended to predict relative performance in programs. Groves et al, of course, show that, in fact, they do not.
Selection serves two purposes, one obvious and the other questionable. The first is to reduce the large pool of well qualified students to the available number of places. The second is the Holy Grail of selection: attempting to select those best suited to success in medicine. The key problem is that nobody can fully define, let alone measure, such success, other than in the negative terms of professional misconduct after graduation.2 Moreover, medicine offers a wide range of careers requiring different attributes, making a broad range of entry characteristics beneficial to the profession and the community at large, and putting in question the pursuit of a profile of critical criteria.
Further research is needed, involving large, representative samples to confirm or discount putative outcome measures, but most medical students succeed in medical school and do not create problems as doctors, indicating that we are currently getting more of this right than wrong. If the predictive value of entry attributes for (often questionable) outcomes is modest at best, and if we teach and assess communication skills, clinical reasoning and professionalism during the programs, does it not make sense to focus our energies and resources more effectively there, and relinquish our continuing anxiety over selection? We should remember what motivated the flurry of activity towards more complex selection processes in the first place: concern over communication by doctors, failure in aspects of professionalism, and to a much lesser extent, clinical competence.
References
- Groves MA, Gordon J, Ryan G. Entry tests for graduate medical programs: is it time to re-think? Med J Aust 2007; 186: 120-123.
- Papadakis MA, Teherani A, Banach MA, et al. Disciplinary action by medical boards and prior behaviour in medical school. N Engl J Med 2005; 353: 2673-2682. 0_i1091818
Shifting focus to adolescent wellbeing and inclusive participation in the digital age
Allyson R Todd, Elena Wang, Stephanie R Partridge
The clinical presentation, investigation, and management of women diagnosed with endometriosis in Australian general practices, 2011–2021: an open cohort study
Danielle Mazza, Kailash Thapaliya, Sharinne B Crawford, Alissia Hui, Maryam Moradi, Luke E Grzeskowiak
The impact of the Breast Screen NSW transition from film to digital mammography, 2002–2016: a linked population health data analysis
Rachel Farber, Nehmat Houssami, Katy J L Bell
Non‐technical errors associated with deaths in surgical care, Australia, 2012–2019, by surgical specialty (Australian and New Zealand Audit of Surgical Mortality): a retrospective cohort study
Jesse Ey, Victoria Kollias, Octavia Lee, Kelly Hou, Matheesha Herath, John B North, Ellie Treloar, Suzanne Edwards, Martin Bruening, Adam J Wells, Guy J Maddern
The CURE Asthma roadmap
Gary P Anderson, Anthony Flynn, Phil G Bardin, John D Blakey, Shyamali C Dharmage, Paul Foster, Peter G Gibson, Adam Jaffe, Alan James, Christine R Jenkins, Sundram Sivamalai, Peter D Sly, Guy B Marks, Vanessa M McDonald, Judy Wetttenhall
Evidence from Australian cohort studies about asthma trajectories and transitions across the life course: a narrative review
Caroline Lodge, Xin Dai, Ingrid A. Laing, Michael P Menden, Anthony Flynn, Gary P Anderson, Sarath Ranganathan, Shyamali C Dharmage