eMJA     The Medical Journal of Australia

Home | Issues | eMJA shop | My account | Classifieds | Contact | More... | Topics | Search   

Letters

EBM in action

Richard L Prince
MJA 2002 177 (4): 223-224

To the Editor: I read with interest the recent correspondence in the Journal from Del Mar and Glasziou.1 Their appeal to one of their critics was to "abandon throwing bricks from the sidelines and join us in trying to help clinicians assess research evidence in [a] timely fashion". More recently, their defence in relying on generalists, rather than experts, to assess the evidence was, somewhat curiously, that "a cat may look at a king".2 In response to these comments, I believe that one of their recent presentations relating to natural remedies for osteoporosis in postmenopausal women3 falls short of current evidence-based medicine requirements. I suspect that this may be because they have no expert in the area they are reviewing to assist them in assessing the data.

An expert would have been able to tell them that their statement "Although no trials specifically compared 'just walking' with 'exercise in the gym', there was reasonable evidence supporting the beneficial role of walking in this patient group"3 was incorrect.4 Furthermore, an expert would have known that the fundamental biological basis of the effect of exercise on the skeleton relates to the induction of significant strains within the skeleton.5 Because these effects are site-specific and load-dependent, the physiological mechanisms differ from those involved in cardiovascular health. Secondly, an expert in the area may have pointed out that the principal constituent of codliver oil that affects the skeleton is vitamin D. To claim that there were no benefits on bone mineral density or fracture from vitamin D would not be supported by current data.6

Keeping up-to-date in medical practice has become more difficult as the information base expands. Performing an Internet search may be adequate for answering some patient-based specific questions, but, in general, reading an up-to-date review is probably better. Presenting the results of a rapidly performed, deficient analysis in an internationally renowned journal is another thing entirely.

  1. Del Mar CB, Glasziou PP. EBM in action: is laser treatment effective and safe for musculoskeletal pain? [letter]. Med J Aust 2002; 176: 195. <eMJA full text>
  2. Del Mar CB, Glasziou PP. Safety of hormone replacement therapy after mastectomy. Med J Aust 2002; 176: 618-620. <eMJA full text>
  3. Del Mar CB, Glasziou PP, Spinks AB, Sanders SL. Natural remedies for osteoporosis in postmenopausal women. Med J Aust 2002; 176: 182-183. <PubMed><eMJA full text>
  4. Kerr D, Ackland T, Maslen B, et al. Resistance training over 2 years increases bone mass in calcium-replete postmenopausal women. J Bone Miner Res 2001; 16(1): 175-181. <PubMed>
  5. Kerr D, Morton A, Dick I, Prince R. Exercise effects on bone mass in postmenopausal women are site-specific and load-dependent. J Bone Miner Res 1996; 11: 218-225. <PubMed>
  6. Chapuy MC, Arlot ME, Duboeuf F, et al. Vitamin D3 and calcium to prevent hip fractures in elderly women. N Engl J Med 1992; 327: 1637-1642. <PubMed>

(Received 20 Mar 2002, accepted 4 Jul 2002)


University Department of Medicine, University of Western Australia, Nedlands, WA.

Richard L Prince, MB BS FRACP MD, Associate Professor; and Department of Endocrinology and Diabetes, Sir Charles Gairdner Hospital.

Correspondence: Associate Professor Richard L Prince, University Department of Medicine, University of Western Australia, 4th Floor, G Block, Queen Elizabeth II Medical Centre, Nedlands, WA 6009, Australia. rlprinceATcyllene.uwa.edu.au


Christopher B Del Mar and Paul P Glasziou

In reply: We agree with Prince that expertise is needed. The only question is, expertise in what? If we rely on experts in the content area, we are subject to error from ignoring studies that do not fit the expert's view or from an overemphasis on studies familiar to the expert.1 On the other hand, if we rely on experts in systematic reviews, we are likely make other errors, especially errors of omission, because we do not know the content area so well.

Perhaps what we need is a marrying of the two. First, experts should learn the business of evidence-based medicine (EBM). It should be part of the training of specialists and general practitioners, as well as medical students. In addition, the Australasian Cochrane Centre runs Australia-wide courses in preparing and interpreting systematic reviews.2 Second, we should find a content expert to assist any review being undertaken (and, indeed, we try to do this when writing systematic Cochrane reviews).

But when we need to respond rapidly to clinicians' and our own questions, there is not time to consult experts for each one. (The doctor in question3 asked five rather separate questions, of which Prince addresses only two.) Instead, we try to do exactly what Prince has suggested: we first look for an up-to-date review (a systematic review, to avoid bias),1 and, in the absence of one of those, proceed with weaker levels of evidence progressively down a cascade. And that is exactly what we did in this case.3

The purpose of our rapid search service is to provide, as quickly as possible, the best available evidence to assist a doctor help a patient — "EBM in action". The five meta-analyses we identified3 did not include your references. We do not, and do not claim to, offer the last word in a very complicated area of clinical practice.

  1. McAlister FA, Clark HD, van Walraven C, et al. The medical review article revisited: has the science improved? Ann Intern Med 1999; 131: 947-951. <PubMed>
  2. Australasian Cochrane Centre. Available at: <http://www.cochrane.org.au/>. Link updated August 2005.
  3. Del Mar CB, Glasziou PP, Spinks AB, Sanders SL. Natural remedies for osteoporosis in postmenopausal women. Med J Aust 2002; 176: 182-183.<eMJA full text> <PubMed>

Centre for General Practice, University of Queensland, Herston, QLD.

Christopher B Del Mar, MD FRACGP FAFPHM, Professor of General Practice; Paul P Glasziou, MB BS PhD, Professor of Evidence Based Medicine.

Correspondence: Professor Christopher B Del Mar, Centre for General Practice, University of Queensland, Herston Road, Herston, QLD 4006, Australia. c.delmarATcgp.uq.edu.au

Home | Issues | eMJA shop | My account | Classifieds | More... | Contact | Topics | Search

The Medical Journal of Australia    eMJA  

©The Medical Journal of Australia 2002 www.mja.com.au PRINT ISSN: 0025-729X ONLINE ISSN: 1326-5377