Connect
MJA
MJA

Using accountability for mental health to drive reform

Sebastian P Rosenberg, Ian B Hickie, Patrick D McGorry, Luis Salvador-Carulla, Jane Burns, Helen Christensen, John Mendoza, Alan Rosen, Lesley M Russell and Sally Sinclair
Med J Aust 2015; 203 (8): 328-330. || doi: 10.5694/mja15.00447
Published online: 19 October 2015

Summary

  • Greatly enhanced accountability can drive mental health reform. As extant approaches are ineffective, we propose a new approach.
  • Australia spends around $7.6 billion on mental health services annually, but is anybody getting better?
  • Effective accountability for mental health can reduce variation in care and increase effective service provision.
  • Despite 20 years of rhetoric, Australia’s approach to accountability in mental health is overly focused on fulfilling governmental reporting requirements rather than using data to drive reform.
  • The existing system is both fragmented and outcome blind. Australia has failed to develop useful local and regional approaches to benchmarking in mental health.
  • New approaches must address this gap and better reflect the experience of care felt by consumers and carers, as well as by service providers. There are important social priorities in mental health that must be assessed.
  • We provide a brief overview of the existing system and propose a new, modest but achievable set of indicators by which to monitor the progress of national mental health reform.
  • These indicators should form part of a new, system-wide process of continuous quality improvement in mental health care and suicide prevention.

Across the health care system, accurate measurement and frequent transparent reporting of patient experiences has the capacity to reduce variations in care and increase effective service provision.1 The merit of applying this principle to mental health is well understood.2,3 Over 20 years, four successive national mental health plans have each called for this kind of accountability. Despite the rhetoric, and as we now brace for a fifth plan, Australia still has no agreed set of priority indicators nor any process to enable useful benchmarking.

This is a critical management deficiency recognised by the National Mental Health Commission and the Mental Health Commission of New South Wales, which have both recently (and separately) published sets of preferred key indicators.4,5 Repeated Australian reports and reviews suggest mental health services are still best characterised as fragmented,6 bedevilled by major gaps in provision,7 inequitably distributed,8 increasingly costly (http://mhaustralia.org/submission/mental-health-australia-submission-senate-inquiry-extent-income-inequality-australia) and outcome blind.9

Australia’s current data collection systems focus on activity rather than outcomes and are typically aggregated to state and national levels. Local opportunities for benchmarking are limited to comparing inputs and processes, such as bed numbers and length of stay, and have not evolved to permit comparison of outcomes. Previous attempts to develop nationwide approaches to data definitions and reporting have proven a glacial (and expensive) affair. We propose a new, limited set of indicators for mental health that have the capacity to drive reform.

These should not only be useful nationally but also regionally. Evidence of the utility of such regional comparisons is strong and growing.4,10 There are significant regional differences in relation to issues such as suicide and rates of access to mental health care. Data need to be available at this level, rather than just statewide, to permit useful comparisons and propel reform.

An additional consideration is that the chosen indicators must reflect the broader concerns of the community and the validated experience of consumers, carers and service providers. Current data collections focus on governmental reporting requirements and do not reflect the social priorities that are evident in mental health care, such as in relation to social participation, employment and homelessness.

In proposing specific indicators, we build on our previous proposals on national service priorities.3 We propose 12 indicators across three domains (health, social and system reform), consistent with the core value of the National Mental Health Commission — the right to lead a contributing life.

The indicators emphasise proximal factors (eg, death rates in the 12 months after discharge from a health facility) that can drive reform, rather than distal outcomes that are likely to reflect more complex determinants acting over longer time frames (eg, life expectancy).

The 12 indicators are set out below, with a brief outline of current data and any limitations in relation to their current collection or use.

Health domain indicators

Suicide rate: attempts and completions

These data are already collected and reported, including in relation to the Indigenous community where the problem is acute.11 Data on suicide attempts are not available in Australia, unlike elsewhere.12 Data on completed and attempted suicides are needed at the regional level to support local, tailored prevention activities. In 2003, there were 2214 suicides and in 2013, there were 2522.13 By comparison, a national campaign has seen the road toll decrease from 1621 in 2003 to 1156 in 2014.14

Death rates < 3 and < 12 months after discharge from any mental health facility, including cause of death

These data are not collected, with infrequent exceptions.15 Cause of death permits new, vital linkage of mental and physical illness, critical given the frequency of comorbidities.

Proportion of the population receiving mental health care services — both among the general population and, specifically, the population aged 12–25 years

These data are already collected and reported every decade. There is recent evidence indicating some lift in the rate of overall access to care, mainly due to the Better Access to Psychiatrists, Psychologists and General Practitioners through the Medicare Benefits Schedule initiative,16 now costing around $15 million per week.17 However, with 75% of all mental illnesses manifesting before the age of 25 years,18 it is vital also to monitor access by young people,19 including to new e-mental health, early intervention and online services.20 For young men, the access rate is as low as 13%. This indicator would help to track whether services designed to meet the needs of young people were reaching their target audience.

Prevalence of mental illness

Prevalence data are already collected every decade. It would be useful to present these data by region in future iterations, to build understanding of comparative community resilience and vulnerability, and to better target resources where they are needed most.

Social domain indicators

Participation rates by people with a mental illness of working age in employment

Having a job is critical to the health, welfare and dignity of people with a mental illness.21 Addressing unemployment and minimising welfare spending has been a clear social priority for successive governments. Despite this confluence of interests, there is no current specific national data collection. The Organisation for Economic Co-operation and Development ranks Australia lowest in terms of the income of people with a severe mental disorder as a ratio of the average income of the population.22

Participation rates by people with mental illness aged 16–30 years in education and training

When young people are exhorted to “earn or learn”, it is critical to monitor their education outcomes. This is being done elsewhere (eg, the United Kingdom Office for National Statistics) but not in Australia.

People with a mental illness reporting they have stable housing

Each night, 105 000 Australians are homeless.23 It is estimated that more than a third of people who are homeless in inner city areas have severe mental illness.24 There is currently no specific data collection. Discharge into homelessness still occurs. These data would tell us about the impact of housing and supported accommodation services.

Community surveys of attitudes towards mental illness

Recovery is more likely when clinicians and service providers understand the social realities that people with a mental illness face in their daily lives.25 Community education campaigns help to demystify mental illness and counter stereotypes.26 Although some information exists, there is no regular national survey of community (and business) attitudes and stigma towards mental illness.

System domain indicators

Consumer and carer experience of care

Patient satisfaction is one of the core ingredients in making a service system accountable, transparent and responsive.9,27 There are no nationwide validated data collected on the experience of care of mental health consumers and carers.

Readmission rates to hospital or re-presentation to emergency departments within 28 days after discharge

Some readmission data are already reported. In 2010–11, the proportion of admissions to state and territory acute psychiatric inpatient units that were followed by a readmission within 28 days was 15% nationally.28 This figure has been stable since 2005–06. This indicator would enable detailed comparison of the approach taken to arranging community support on discharge from one region to another.

Life expectancy for people with severe and persistent mental illness

This measure has been reported previously, with the life expectancy of this cohort much shorter than that of the general community.29 This indicator would highlight the extent to which the mental health care system is addressing the complex needs of the cohort, managing both physical and mental health issues, housing and other matters.

Number of people accessing specialised programs to enhance economic and social recovery

In the community-managed mental health sector, no service-level data are currently reported. This measure would at least monitor whether the community mental health sector is becoming a more significant player in Australia’s mental health system.

Conclusion

There are clearly other areas of interest beyond the indicators listed here, including smoking rates, comorbidities and cost. There would also be considerable merit in tracking spending on mental health research so as to gauge our capacity to innovate.

There are currently hundreds of mental health indicators and multiple reports. We contend that very little of this information is used or usable at the local level to drive reform, and that much of this data collection should cease. All Australian governments should agree now to refocus their reporting priorities around these 12 indicators. Governance of their collection should reside in a body suitably independent from government which can identify gaps and inequity. This was an essential role played by the New Zealand Mental Health Commission30 but is yet to emerge in Australia.

It is critical that these indicators do not sit apart from a new, system-wide process of continuous quality improvement in mental health care and suicide prevention. No such process currently exists. This focused approach, around 12 agreed indicators, should drive quality improvement by making data available at the regional level for benchmarking by service providers, funders, decision makers and, importantly, consumers and carers. Every community wants to know the extent to which it has a mental health system on which it can rely. Local empowerment is the engine of mental health reform, and timely, useful accountability data are the fuel.

A further step would be to set some targets for these measures that reflect the scope and ambition of mental health reform in Australia. Across a myriad mental health plans and policies, this is yet to be articulated and is now long overdue.


Provenance: Not commissioned; externally peer reviewed.

  • Sebastian P Rosenberg1
  • Ian B Hickie1
  • Patrick D McGorry2
  • Luis Salvador-Carulla1
  • Jane Burns3
  • Helen Christensen4
  • John Mendoza1
  • Alan Rosen6
  • Lesley M Russell7
  • Sally Sinclair8

  • 1 University of Sydney, Sydney, NSW
  • 2 University of Melbourne, Melbourne, VIC
  • 3 University of Melbourne, Melbourne, VIC
  • 4 Black Dog Institute, Sydney, NSW
  • 5 ConNetica Consulting, Caloundra, QLD
  • 6 University of Wollongong, Wollongong, NSW
  • 7 Australian National University, Canberra, ACT
  • 8 National Employment Services Association, Melbourne, VIC



Competing interests:

Ian Hickie is a member of the National Mental Health Commission.

Author

remove_circle_outline Delete Author
add_circle_outline Add Author

Comment
Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

access_time 12:19, 27 November 2015
Roderick McKay

It is important to publically support the call for using increased accountability to drive mental health reform (1). However the supporting argument, that mental health services are without ability to compare outcomes within benchmarking, or make national comparisons, must be challenged.
Australia has implemented, and reviewed (2) a national system of outcome measures rated by clinicians and consumers within the public sector specialised mental health services (and private hospitals). Outcomes are publicly reported (https://wdst.amhocn.org/ and http://amhocn.org/analysis-reporting/publications/nocc-standard-reports ) at national and state levels in searchable data sets. These reports are used (3) to support clinical care, for local service management and clinical benchmarking (4), The reviews have resulted in recommendations for improvement: including spreading existing good use of measures; and refining measures . However the reviews clearly highlighted support from clinicians, managers, consumers and carers for continuation and improvement of the system: as well as international recognition (5) of leading work by Australia.
Integrating the work above with measures from broader providers of mental health care and population level measures is a better path than starting again.
1. Rosenberg SP, Hickie IB, McGorry P. et al.. 2015). Using accountability for mental health to drive reform. The Medical journal of Australia 2015; 203: 328-330.
2. National Mental Health Information Development Expert Advisory Panel. Mental Health National
Outcomes and Casemix Collection: NOCC Strategic Directions 2014 – 2024. Canberra: Commonwealth of Australia, 2013.
3. McKay R, Coombs T, Pirkis, J. A framework for exploring the potential of routine outcome measurement to improve mental health care. Australasian Psychiatry 2012; 20: 127-133.
4. McKay R, Coombs T, Duerden, D. The art and science of using routine outcome measurement in mental health benchmarking. Australasian Psychiatry 2014;. 22: 13-18.
5. Roe D, Drake RE, Slade M. Routine outcome monitoring: An international endeavour. International Review of Psychiatry 2015;, 27: 257-260.

Competing Interests: Both authors are members of the National Mental Health Information Development Expert Advisory Panel and completed work for the Australian Mental Health Outcomes and Classification Network. The views presented are the personal views of the authors only.

Dr Roderick McKay
NSW Institute of Psychiatry

Online responses are no longer available. Please refer to our instructions for authors page for more information.