Topics

Medical education

The efficacy of medical student selection tools in Australia and New Zealand

To the Editor: In their recent article, Shulruf and colleagues1 concluded that prior academic achievement constituted the most effective means of predicting timely graduation. This outcome measure overlooks a more important graduate attribute: professionalism — the values and skills that the profession and society expects of doctors. This attribute is identifiable at admission, and it is possible to test for and select for this.2 When considering the desired outcome of satisfactory performance at junior medical officer level, the authors state that the “outcome of subsequent workplace performance, while important, is moderated by influences beyond the undergraduate environment”.1 This statement contradicts extensive literature suggesting otherwise. An erosion of vicarious empathy during medical education programs is well documented and is evident across other health care professions.3 Medical school education fails to consistently foster the development of advanced moral reasoning in medical students, with particular problems developing during the period of clinical immersion, when the influence of the “hidden curriculum” becomes evident to students.3 The above have been linked to the experience of burnout in students, which can manifest as professionalism lapses in both pre-clinical and clinical rotations.4 Papadakis and colleagues5 suggested that disciplinary action by a medical board was strongly associated with prior unprofessional behaviour in medical school. Most complaints against doctors are due to conduct, not competence. Many organisations have developed guidelines to ensure medical students adhere to professional standards. Academic and intellectual qualities alone cannot predict the ideal candidate for admission to medical school, and facets of professionalism such as moral orientation, resilience and self-control are acknowledged to contribute to one’s efficacy as a doctor. Furthermore, prioritising timely completion may promote students not seeking help, perpetuating poor performance in an effort to ensure timely completion. This perpetuates a workplace culture where people do not feel able to seek help, with significant repercussions as seen in the recent suicides of young doctors. Timely completion may indeed be predicted by prior academic success; however, attitudinal and behavioural factors are highly relevant at selection and throughout subsequent careers. An overemphasis on prior academic achievements may de-emphasise student characteristics associated with the development of professionalism.

Mark H Arnold · Jennifer Smith-Merry · Andrew S Lane

Selecting medical students: we need to assess more than academic excellence

To the Editor: Reading the article on the task of selecting candidates for medical school,1 I recalled my own trajectory into the profession. I was interviewed by a surgeon, who was the sole interviewer, our interaction being one of genteel conversation. My peers at the time had a similar interchange with the university officials. Uniformly, we have all proceeded to remain in medicine. Our careers have lasted. One has to wonder whether a selection process that is more time consuming is actually better than the above straightforward approach. Considering personality type, there will be a wide spread of introverts and extroverts. Academically adept and generally bright, the hopefuls can perform on the day to leap over any clever tests for entrance. Moreover, the profession has niches for all of them. The introvert can quietly tend towards microbiology, while the extrovert might heartily choose to be a surgeon. Like politics, the profession needs representatives from different areas of society. We should not aim to standardise too much. There will be nations today where entry into medicine is still standardised with reference to social status. If we recruit only the well-to-do youngsters, we will not have the level of understanding that can be brought into the profession from those of humbler backgrounds. Someone from a lower economic stratum will understand the community to which they wish to return after qualifying as a doctor. I have first-hand experience of observing such a course of career in my peers. It cannot be forgotten that the aspirants keen to join medicine are very young people whose personalities have yet to ripen through living. If they can pass tough exams, then they have an admirable trait as embryonic personalities. They can focus and work with diligence. They also hold an ambition to become doctors. If they can apply themselves and do not have any overt oddities of personality, they should be given a chance to become doctors. This has been a time-tested method in medical schools — in a world that needs more doctors than ever — and I fail to be convinced that finer filters on the path into medicine will be worthwhile.

Jagdeep Singh Gandhi

Letter to the Editor1

The efficacy of medical student selection tools in Australia and New Zealand

Objectives: To estimate the efficacy of selection tools employed by medical schools for predicting the binary outcomes of completing or not completing medical training and passing or failing a key examination; to investigate the potential usefulness of selection algorithms that do not allow low scores on one tool to be compensated by higher scores on other tools. Design, setting and participants: Data from four consecutive cohorts of students (3378 students, enrolled 2007–2010) in five undergraduate medical schools in Australia and New Zealand were analysed. Predictor variables were student scores on selection tools: prior academic achievement, Undergraduate Medicine and Health Sciences Admission Test (UMAT), and selection interview. Outcome variables were graduation from the program in a timely fashion, or passing the final clinical skills assessment at the first attempt. Main outcome measures: Optimal selection cut-scores determined by discriminant function analysis for each selection tool at each school; efficacy of different selection algorithms for predicting student outcomes. Results: For both outcomes, the cut-scores for prior academic achievement had the greatest predictive value, with medium to very large effect sizes (0.44–1.22) at all five schools. UMAT scores and selection interviews had smaller effect sizes (0.00–0.60). Meeting one or more cut-scores was associated with a significantly greater likelihood of timely graduation in some schools but not in others. Conclusions: An optimal cut-score can be estimated for a selection tool used for predicting an important program outcome. A “sufficient evidence” selection algorithm, founded on a non-compensatory model, is feasible, and may be useful for some schools.

Boaz Shulruf · Warwick Bagg · Mathew Begun · Margaret Hay · Irene Lichtwark · Allison Turnock · Emma Warnecke · Timothy J Wilkinson · Phillippa J Poole

17 00400

Subscribe to
MJA email alerts

No spam, you can unsubscribe anytime you want.

By providing your information, you agree to our Terms of Use and our Privacy Policy.

Good one! Your updates are coming

Thank you for subscribing to the MJA email alerts. Receive the latest content in your inbox.