Entry tests for graduate medical programs: is it time to re-think?
Authors: Malcolm H Parker, David Wilkinson, Ray G Peterson, Ieva Z Ozolins, Haida Luke, Jenny Zhang and Gerard J A Byrne
Published online: 20 August 2007
To the Editor: We are concerned about aspects of the study of selection predictors of medical school performance in Australian medical schools by Groves et al,1 and how they may be interpreted.
A “voluntary” response rate of 13.6% is very small and unlikely to be representative, and selection or response bias is likely. Although noted by the authors, this fundamental flaw may be overlooked in interpreting the results. This aside, of what value is the outcome measure of clinical reasoning skills among students, some of whom are only in second year, and whom we would not expect to have developed substantial expertise in clinical reasoning at this early stage?
More significantly, we consider that the research question itself may be flawed, as we are not at all convinced that selection scores are intended to predict relative performance in programs. Groves et al, of course, show that, in fact, they do not.
Selection serves two purposes, one obvious and the other questionable. The first is to reduce the large pool of well qualified students to the available number of places. The second is the Holy Grail of selection: attempting to select those best suited to success in medicine. The key problem is that nobody can fully define, let alone measure, such success, other than in the negative terms of professional misconduct after graduation.2 Moreover, medicine offers a wide range of careers requiring different attributes, making a broad range of entry characteristics beneficial to the profession and the community at large, and putting in question the pursuit of a profile of critical criteria.
Further research is needed, involving large, representative samples to confirm or discount putative outcome measures, but most medical students succeed in medical school and do not create problems as doctors, indicating that we are currently getting more of this right than wrong. If the predictive value of entry attributes for (often questionable) outcomes is modest at best, and if we teach and assess communication skills, clinical reasoning and professionalism during the programs, does it not make sense to focus our energies and resources more effectively there, and relinquish our continuing anxiety over selection? We should remember what motivated the flurry of activity towards more complex selection processes in the first place: concern over communication by doctors, failure in aspects of professionalism, and to a much lesser extent, clinical competence.
References
- Groves MA, Gordon J, Ryan G. Entry tests for graduate medical programs: is it time to re-think? Med J Aust 2007; 186: 120-123.
- Papadakis MA, Teherani A, Banach MA, et al. Disciplinary action by medical boards and prior behaviour in medical school. N Engl J Med 2005; 353: 2673-2682. 0_i1091818