CareTrack: assessing the appropriateness of health care delivery in Australia

William B Runciman, Tamara D Hunt, Natalie A Hannaford, Peter D Hibbert, Johanna I Westbrook, Enrico W Coiera, Richard O Day, Diane M Hindmarsh, Elizabeth A McGlynn and Jeffrey Braithwaite
Med J Aust 2012; 197 (2): 100-105. || doi: 10.5694/mja12.10510


Objective: To determine the percentage of health care encounters at which a sample of adult Australians received appropriate care (ie, care in line with evidence-based or consensus-based guidelines).

Design, setting and participants: Computer-assisted telephone interviews and retrospective review of the medical records (for 2009–2010) of a sample of at least 1000 Australian adults to measure compliance with 522 expert consensus indicators representing appropriate care for 22 common conditions. Participants were selected from households in areas of South Australia and New South Wales chosen to be representative of the socioeconomic profile of Australians. Health care encounters occurred in health care practices and hospitals with general practitioners, specialists, physiotherapists, chiropractors, psychologists and counsellors.

Main outcome measure: Percentage of health care encounters at which the sample received appropriate care.

Results: From 15 292 households contacted by telephone, 7649 individuals agreed to participate, 3567 consented, 2638 proved eligible, and 1154 were included after gaining the consent of their health care providers. The adult Australians in this sample received appropriate care at 57% (95% CI, 54%–60%) of 35 573 eligible health care encounters. Compliance with indicators of appropriate care at condition level ranged from 13% (95% CI, 1%–43%) for alcohol dependence to 90% (95% CI, 85%–93%) for coronary artery disease. For health care providers with more than 300 eligible encounters each, overall compliance ranged from 32% to 86%.

Conclusions: Although there were pockets of excellence and some aspects of care were well managed across health care providers, the consistent delivery of appropriate care needs improvement, and gaps in care should be addressed. There is a need for national agreement on clinical standards and better structuring of medical records to facilitate the delivery of more appropriate care.

  • William B Runciman1,2
  • Tamara D Hunt1
  • Natalie A Hannaford1,2
  • Peter D Hibbert3
  • Johanna I Westbrook3
  • Enrico W Coiera3
  • Richard O Day4
  • Diane M Hindmarsh3
  • Elizabeth A McGlynn5
  • Jeffrey Braithwaite3,2

  • 1 University of South Australia, Adelaide, SA.
  • 2 Australian Patient Safety Foundation, Adelaide, SA.
  • 3 Australian Institute of Health Innovation, University of New South Wales, Sydney, NSW.
  • 4 St Vincent’s Clinical School and School of Medical Sciences, University of New South Wales, Sydney, NSW.
  • 5 Kaiser Permanente, Pasadena, Calif, USA.



We thank the participants, health care providers and expert reviewers who generously gave of their time. We also thank the surveyors: Laura Mudge, Heather Andrews, Sally Gregurke, Sally Whitaker, Paula Abrego, Kathy Mitchell and Toni McCallum Pardey; expert colleagues: Shanthi Ramanathan, Martin Basedow, Tim Schultz, Sharyn Lymer, Ling Li, Adam Dunn, Julie Halbert, Helena Williams, and Kaye Dolman; and the database tool designers and data collectors, Intersect and the Hunter Valley Research Foundation, for their contributions. This study was funded by a National Health and Medical Research Council program grant (no. 568612).

Competing interests:

No relevant disclosures.

  • 1. McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med 2003; 348: 2635-2645.
  • 2. Hunt TD, Ramanathan SA, Hannaford NA, et al. CareTrack Australia: assessing the appropriateness of adult healthcare: protocol for a retrospective medical record review. BMJ Open 2012; 2: e000665.
  • 3. Evans A, Davis S, Kilpatrick C, et al. The morbidity related to atrial fibrillation at a tertiary centre in one year: 9.0% of all strokes are potentially preventable. J Clin Neurosci 2002; 9: 268-272.
  • 4. Berner ES, Baker CS, Funkhouser E, et al. Do local opinion leaders augment hospital quality improvement efforts? A randomized trial to promote adherence to unstable angina guidelines. Med Care 2003; 41: 420-431.
  • 5. Maxwell DJ, McIntosh KA, Pulver LK, Easton KL. Empiric management of community-acquired pneumonia in Australian emergency departments. Med J Aust 2005; 183: 520-524. <MJA full text>
  • 6. Williams CM, Maher CG, Hancock MJ, et al. Low back pain and best practice care: a survey of general practice physicians. Arch Intern Med 2010; 170: 271-277.
  • 7. Janus ED, Tideman PA, Dunbar JA, et al. Dyslipidaemia in rural Australia: prevalence, awareness, and adherence to treatment guidelines in the Greater Green Triangle Risk Factor Study. Med J Aust 2010; 192: 127-132. <MJA full text>
  • 8. Brand CA, Ibrahim JE, Cameron PA, Scott IA. Standards for health care: a necessary but unknown quantity. Med J Aust 2008; 189: 257-260. <MJA full text>
  • 9. Runciman WB. Is money spent on quality improvement money better spent on clinical care? No. Med J Aust 2011; 194: 641. <MJA full text>
  • 10. Australian Institute of Health and Welfare. Australia’s health 2010. Canberra: AIHW, 2010. (AIHW Cat. No. AUS 122; Australia’s Health Series No. 12.)
  • 11. Britt H, Miller GC, Charles J, et al. General practice activity in Australia 2000–01 to 2009–10: 10 year data tables. Canberra: AIHW, 2010. (AIHW Cat. No. GEP 28; General Practice Series No. 28.) (accessed Feb 2011).
  • 12. National Health Priority Action Council. National Chronic Disease Strategy. Canberra: Australian Government Department of Health and Ageing, 2006.
  • 13. National Institute of Clinical Studies. Evidence–practice gaps report, volume 1. Melbourne: NICS, 2003.
  • 14. Australian Council for Safety and Quality in Health Care. National strategy to address health care associated infections. Canberra: Commonwealth of Australia, 2003.
  • 15. University of Queensland Centre for Research in Geriatric Medicine. Programs of research. (accessed Feb 2011).
  • 16. Australian Bureau of Statistics. Socio-Economic Indexes for Areas: introduction, use and future directions, Sep 2006. Canberra: ABS, 2006. (ABS Cat. No. 1351.0.55.015.)
  • 17. Australian Bureau of Statistics. Australian demographic statistics, Jun 2010. Canberra: ABS, 2010. (ABS Cat. No. 3101.0.) (accessed Feb 2011).
  • 18. Australian Bureau of Statistics. Australian social trends, 2008. Canberra: ABS, 2008. (ABS Cat. No. 4102.0.) (accessed Feb 2011).
  • 19. Cochran WG. Sampling techniques. 3rd ed. New York: John Wiley & Sons, 1977.
  • 20. Australian Government Department of Health and Ageing. Prevention of Type 2 Diabetes Program. Australian type 2 diabetes risk assessment tool (AUSDRISK). (accessed Sep 2010).
  • 21. National Stroke Foundation. Clinical guidelines for acute stroke management. Canberra: National Health and Medical Research Council, 2007.
  • 22. Western Australian Therapeutic Advisory Group. Management of community acquired pneumonia (CAP) in adults: assessment of severity using CURB-65 score and treatment guidelines. Perth: WATAG, 2005.
  • 23. Royal Adelaide Hospital Safety and Quality Unit. Community acquired pneumonia management protocol. Adelaide: RAH, 2006. (accessed Aug 2010).
  • 24. Lilford RJ, Brown CA, Nicholl J. Use of process measures to monitor the quality of clinical practice. BMJ 2007; 335: 648-650.
  • 25. Runciman WB, Baker GR, Michel P, et al. The epistemology of patient safety research. Int J Evid Based Healthc 2008; 6: 476-486.
  • 26. Mangione-Smith R, DeCristofaro AH, Setodji CM, et al. The quality of ambulatory care delivered to children in the United States. N Engl J Med 2007; 357: 1515-1523.
  • 27. Bull AL, Russo PL, Friedman ND, et al. Compliance with surgical antibiotic prophylaxis — reporting from a statewide surveillance programme in Victoria, Australia. J Hosp Infect 2006; 63: 140-147.
  • 28. Centre for Epidemiology and Research. New South Wales Population Health Survey: 2010 report on adult health. Sydney: NSW Department of Health, 2011. (accessed May 2012).
  • 29. Thomas EJ, Lipsitz SR, Studdert DM, Brennan TA. The reliability of medical record review for estimating adverse event rates. Ann Intern Med 2002; 136: 812-816.
  • 30. Jamtvedt G, Young JM, Kristoffersen DT, et al. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2006; (2): CD000259.
  • 31. Rotter T, Kinsman L, James EL, et al. Clinical pathways: effects on professional practice, patient outcomes, length of stay and hospital costs. Cochrane Database Syst Rev 2010; (3): CD006632.
  • 32. Scott I. What are the most effective strategies for improving quality and safety of health care? Intern Med J 2009; 39: 389-400.
  • 33. Registered Nurses’ Association of Ontario. Toolkit: implementation of clinical practice guidelines. Toronto: RNAO, 2002. (accessed Jun 2012).
  • 34. Mazza D, Shand LK, Warren N, et al. General practice and preventive health care: a view through the eyes of community members. Med J Aust 2011; 195: 180-183. <MJA full text>
  • 35. Shekelle PG, Morton SC, Keeler EB. Costs and benefits of health information technology. Evidence Report/Technology Assessment No. 132 (prepared by the Southern California Evidence-based Practice Center under Contract No. 290-02-0003.) AHRQ Publication No. 06-E006. Rockville, Md: Agency for Healthcare Research and Quality, 2006.
  • 36. Runciman WB, Coiera EW, Day RO, et al. Towards the delivery of appropriate health care in Australia. Med J Aust 2012; 197: 78-81.


remove_circle_outline Delete Author
add_circle_outline Add Author

Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

Responses are now closed for this article.