Appropriateness of care: why so much variation
Authors: Richard C Madden, Andrew Wilson and Philip Hoyle
Published online: 21 November 2016
Broad descriptions of variation are a useful way of finding disparities, but to generate change they need to be carefully analysed and applied
The Supplement accompanying this issue of the MJA addresses variation in health care delivery as an important theme in ensuring appropriate care across the health system. While all would agree that health care should be provided as and where needed, and that only appropriate care should be delivered, difficulties arise when seeking consensus on what variation is “appropriate” and what should be done about it.
Complex systems are inherently variable. Indeed, a multitude of data shows variation in clinical practice but there is less consensus on its implications. For example, while one focus is high utilisation, there is also an issue with underutilisation, raising issues of equity. Aboriginal and Torres Strait Islander people receive fewer interventions for a range of major health conditions than non-Indigenous Australians; the age standardised rate of coronary procedures is 40% lower.1 Overall, the lowest quintile by socio-economic status of area of residence has 78.8 elective hospital admissions involving elective surgery per 1000 population compared with 91.5 for the highest quintile.2
Geographic variation is the focus of the recent Australian Atlas of Health Care Variation,3 summarised in the Supplement by Buchan and colleagues.4 The Atlas compares extreme high and low rates of interventions, using about 350 areas. An earlier report by the Australian Commission on Safety and Quality in Health Care (ACSQHC) and the Australian Institute of Health and Welfare calculated a systematic component of variation and provided a comprehensive picture covering 60 Medicare Locals, which were in place at that time.5
The two reports focus attention on variation, emphasising unwarranted variation, but crucially they do not define “unwarranted”. While presenting a high profile call for action, priority areas for action are not suggested.
It is not sufficient to publish an Atlas of Variation … and expect it to have remarkable impact. An Atlas of Variation needs to be an integral part of a larger transformational change program.6
The limited available evidence indicates that public reporting alone has minimal impact on changing clinical practice.7 Change may also be facilitated by considering local factors.8 Atkinson and colleagues identified 13 factors required for system change, including microsystem capacity, credible evidence, engagement, peer support and integration into routine practice.9
In 2016, the Grattan Institute released an analysis of variation in preventable conditions across Victoria and Queensland.10 The report set the bar higher for addressing variation, noting the need for a time series when targeting action. The Institute found that 15% of areas exceeded their variation benchmark each year, but only 5% exceeded it for 3 successive years. It proposed identifying areas showing sustained variation and developing response strategies in consultation with all stakeholders.
Financial incentives are another approach. In the Supplement, Hall and van Gool report disappointing evidence that financial incentives improve quality, and note possible unintended effects through gaming or patient selection.11 Moreover, complex Australian health care financing arrangements make it difficult to share the economic benefits of reductions in practice variations among the various stakeholders. Caution is therefore necessary in considering financial incentives.
A weakness of variation data is that they are always explicable by specific variables, such as patient factors or legitimate process differences. One way to deal with this is to use variation data to identify where change may appear warranted, and then focus on the development of mutually agreed standards of best practice care. Contributions in the Supplement reflect the important work that the ACSQHC has undertaken in this regard: Chew and colleagues describe the process for developing clinical care standards in Australia;12 important examples are provided by Caplan and colleagues (cognitive impairment)13 and Turnidge and colleagues (antimicrobial stewardship).14 However, as noted above, these need to be incorporated into broader micro and macro change strategies.
Wilcox and McNeil argue that clinical registries can play a role in identifying quality interventions and clinical pathways, and indeed the ACSQHC has published guidelines for clinical registries.15 Registries are potentially a link between high level policy and practice variables of interest to a given clinical community. A strategy is now needed to link clinical registries with national hospital data collections, to better inform understanding of in-patient activity variation and performance.
In conclusion, broad descriptions of variation are a useful way of finding disparities, but will not of themselves generate change. To point the way to useful policy change, they need to be carefully analysed and applied.
Variation needs to be addressed as part of the broader quality and safety agenda, where political commitment has been hard won over the past 20 years. Regular, considered reporting of variation may assist, but is not in itself a magic bullet.
Competing interests
References
- Australian Institute of Health and Welfare. Aboriginal and Torres Strait Islander Health Performance Framework 2014 report: detailed analyses (AIHW Cat. No. IHW 167). Canberra: AIHW, 2015.
- Australian Institute of Health and Welfare. Admitted patient care 2014–15: Australian hospital statistics (AIHW Cat. No. HSE 172). Canberra: AIHW, 2016.
- Australian Commission on Safety and Quality in Health Care. Atlas of health care variation. Sydney: ACSQHC, 2015. http://www.safetyandquality.gov.au/atlas (accessed Oct 2016).
- Buchan HA, Duggan A, Hargreaves J, et al. Health care variation: time to act. Med J Aust 2016; 205 (10 Suppl): S30-S33.
- Australian Commission on Safety and Quality in Health Care and Australian Institute of Health and Welfare. Exploring healthcare variation in Australia: analyses resulting from an OECD study. Sydney: ACSQHC 2014.
- Da Silva P, Gray JAM. English lessons: can publishing an atlas of variation stimulate the discussion on appropriateness of care? Med J Aust 2016; 205 (10 Suppl): S5-S7.
- Ketelaar N, Faber M, Flottorp S, et al. Public release of performance data in changing the behaviour of healthcare consumers, professionals or organisations. Cochrane Database Syst Rev 2011; (11): CD004538.
- Baker R, Camosso-Stefinovic J, Gillies C, et al. Tailored interventions to address determinants of practice. Cochrane Database Syst Rev 2015; (4): CD005470.
- Atkinson J, Patel C, Wilson A. Drivers of large-scale change in complex health systems: an Evidence Check rapid review brokered by the Sax Institute for the NSW Agency for Clinical Innovation. Sydney: Sax Institute, 2013.
- Duckett S, Griffiths K. Perils of place: identifying hotspots of health inequalities. Melbourne: Grattan Institute, 2016.
- Hall JP, van Gool KC. Paying hospitals for quality: can we buy better care? Med J Aust 2016; 205 (10 Suppl): S27-S29.
- Chew DP, Herkes R, Page MA. Clinical care standards: appropriate care everywhere — acute coronary syndromes as an example. Med J Aust 2016; 205 (10 Suppl): S8-S11.
- Caplan GA, Kurrle SE, Cumming A. Appropriate care for older people with cognitive impairment in hospital. Med J Aust 2016; 205 (10 Suppl): S12-S15.
- Turnidge JD, Thursky K, Chen CS. Antimicrobial use in Australian hospitals: how much and how appropriate? Med J Aust 2016; 205 (10 Suppl): S16-S20.
- Wilcox N, McNeil JJ. Clinical quality registries have the potential to drive improvements in the appropriateness of care. Med J Aust 2016; 205 (10 Suppl): S21-S26.
Provenance: Commissioned; not externally peer reviewed.