eMJA     The Medical Journal of Australia

Home | Issues | eMJA shop | My account | Classifieds | Contact | More... | Topics | Search   

Viewpoint

Measuring outcomes in patients with depression or anxiety: an essential part of clinical practice

Ian B Hickie, Gavin Andrews and Tracey A Davenport
MJA 2002 177 (4): 205-207

A wide range of instruments is available for ongoing assessment of clinical status and outcome in patients with depressive or anxiety disorders. However, few doctors use these instruments in managing their patients. As depression and anxiety are relapsing or chronic conditions and are often comorbid with other medical conditions, standard outcome measures should be incorporated into the management plans for all such patients.

For most doctors, it would be inconceivable to manage common long term disorders (such as diabetes or asthma) or serious risk factors (like hypertension or hypercholesterolaemia) without using standard clinical, pathology or other investigative parameters. The data from standard clinical measures have underpinned the drive towards outcomes-based healthcare and have long been recognised as the optimal response to "uninformed patients, skeptical payers, frustrated physicians and besieged health care executives".1

Recent Commonwealth Department of Health and Ageing measures provide incentives for general practitioners to improve the management of patients with complex, chronic or relapsing disorders, including asthma, diabetes and mental disorders.2 Doctors do not need to be convinced of the need to monitor peak flow in asthma or blood glucose (or other metabolic parameters) in diabetes. These simple measures do not try to describe the aetiology of the disease, the breadth of clinical manifestations or the patient's experience of illness. However, as proxy measures of clinical status, they can be used reliably over time and be gauged by different care providers operating in different care settings. Furthermore, the significance of the results can be easily communicated to the patient. Such measures are also used to monitor the response to treatment over time or responses to different types of interventions. Hence, such outcome data, in combination with other clinical and patient factors, are a crucial part of high-quality clinical practice.

By contrast, few patients treated for depressive or anxiety disorders by GPs or psychiatrists will have any systematic measure of their ongoing clinical status or outcome documented.3 This deficit is confined largely to doctors, as clinical psychologists consider repeated systematic measurement an essential clinical tool.4 This deficiency in clinical record keeping by medical professionals persists despite the availability of valid and reliable outcome measures.

Depression and anxiety are relapsing or chronic conditions5 and are often comorbid with other medical conditions in primary care. Patients will be managed mainly by primary care providers6 and the time frame for such care is years (not weeks or months). Consequently, we propose that all medical providers need to incorporate standard outcome measures for depression or anxiety into the management plans of patients with depression or anxiety. The other, clinical reasons why such a practice should be pursued are detailed in Box 1.

Although not the prime concern for the treating clinician, health services planning and other research benefits rely on the collation of clinical data in combination with other practitioner and organisational information. The evidence base for high-quality mental health practice in primary care is limited and urgently needs relevant longitudinal data.9 These non-clinical outcomes (Box 2) should also be of concern to the wider medical profession.

What measures should be used in day-to-day practice?

Although there are no specific laboratory-based diagnostic tests for depression or anxiety, clinical diagnoses can be made reliable by determining whether a sufficient number and type of clinical symptoms are present. The number of diagnostic categories that are relevant to primary care is limited and easily incorporated within standard checklist formats.9 There are specialised neuroimaging and neuropsychology strategies that may emerge as useful clinical markers of risk factors for illness, severity of illness, or predictors of course or response to treatment; however, none are yet suitable for application in everyday clinical practice.

Consequently, our current focus is more on the use of appropriate outcome measures rather than diagnostic measures. We now have a wide range of instruments that rate relevant psychological symptoms or resultant disability. For people with depression or anxiety, it is necessary to recommend the measurement of symptoms and disability, because some people minimise their symptoms simply by avoiding stressful situations. For example, a housebound person with agoraphobia, or a socially withdrawn person with chronic depression, may show only mild elevations on current symptom measures but reveal severe disability on other measures. Similarly, while people with comorbid physical and mental disorders can show elevated symptom scores, inspection of the mental and physical scores on disability measures can be helpful in prioritising treatment. Importantly, the common general disability measures (eg, Short Form Health Survey [SF-12]14 and Brief Disability Questionnaire15) can be used across the broad spectrum of general medical practice.

To encourage widespread application in general medical settings, measures need to have a number of key characteristics. These include brevity, low cost (preferably being in the public domain), self-report rather than clinician-administered format, results that are readily communicated to the patient, and demonstrated responsiveness to change in clinical status. Further, symptom-based instruments should be focused on the common symptoms of depression, anxiety or related somatic constructs.9 Such instruments also lend themselves to automation and electronic record keeping. While illness-specific measures are commonly used in specialist practice (eg, for major depression, panic disorder, social anxiety or obsessive compulsive disorder only), they are far less attractive in general medical settings.

Given these considerations, we recommend a small series of instruments for use in general medical settings. For the assessment of common symptoms of depression and anxiety, we recommend the Kessler Psychological Distress Scale (K10),16 the Somatic and Psychological HEalth REport (SPHERE),8 or the Hospital Anxiety and Depression Scale (HADS).17 The K10 is a 10-item instrument that was developed internationally and has been used in the Australian National Survey of Mental Health and Wellbeing. Scores range from 10 to 50, with scores above 30 being highly predictive of a depressive or anxiety disorder. The sensitivity and specificity of the K10 (ie, its ability to predict diagnosis) is superior to that of the 30-item General Health Questionnaire (GHQ).18 In the national mental health survey, it correlated 0.5 with the GHQ, –0.6 with the SF-12 disability measure, and 0.3 with the number of consultations for a mental health problem in the previous year.19 It measures the relevant constructs, is simple to use and requires little expertise to score and interpret the results.

The SPHERE has a 34-item version that was developed to rate the psychological and somatic symptoms reported by people with common mental disorders in primary and other medical care settings. The utility of the shorter 12-item version for use in primary care was demonstrated as part of SPHERE: a national depression project and was based on more than 46 000 consultations in Australian general practice.8 The instrument is best used to differentiate two levels (and three types) of common mental disorders (patients reporting both characteristic psychological and somatic symptoms [Level 1, Type 1], and patients reporting either psychological symptoms [Level 2, Type 2] or somatic symptoms [Level 2, Type 3]). These levels predict not only formal psychiatric diagnoses, but also disability and doctor- and patient-perceived need for mental healthcare.8

The HADS is a 14-item instrument that was developed to rate the severity of specific depressive and anxiety symptoms in patients with comorbid medical disorders. Hence, it avoids rating those common somatic symptoms that accompany many mental disorders. While this narrower focus is advantageous for assessing changes in depressive and anxiety symptoms, it may mean that it is less useful in patients with the more mixed psychological states that are commonly seen in primary care.

For rating disability, we recommend the SF-12.14 The 36-item Medical Outcomes Study Short Form Health Survey (SF-36) was developed as a measure of disability or functioning and is applicable to people with any illness, physical or mental. It is now available as a 12-item version (SF-12) that correlates 0.95 with the results of the parent SF-36 instrument. It has three sections: a preliminary question about self-perceived health status; eight questions about the extent to which current health status limits activities; and three questions about feelings. Two scores are generated: a mental and a physical component score. The scoring method is complex and is arranged so that scores on the physical and mental components are independent. The SF-12 has excellent psychometric characteristics, is sensitive to change, and is probably the de facto world standard for measuring outcome of treatment for both physical and mental disorders.

Conclusions

For physicians who work predominantly in academic, specialist or administrative settings, the arguments for routine outcome measurement are obvious.3,20 In association with the move to manage the common psychological disorders like depression and anxiety more effectively in primary care, there is now an urgent need to promote the clinical utility of standard outcome measures to GPs. The historical and professional resistance to the use of such measures has hampered the delivery of standardised and effective treatment in primary care settings. As new treatments are developed and as governments move to support major service innovations in primary mental healthcare, we need to measure routinely whether "improved" treatments and services are actually changing the lives of the individual patients who present for treatment.

1: Clinical reasons for using standard outcome measures in individual patients with depression or anxiety

A. The instruction of patients in the collection of standardised illness measures maximises their involvement in a long term partnership. The provision of accurate information and recruitment to take an active role are empowering and serve to reduce both stigma and a sense of helplessness. These approaches improve compliance with standard clinical treatments.7

B. Standard measures can be used to document a range of clinical outcomes, including:

  • psychological and somatic symptom severity,

  • key illness-related behaviours (eg, extent of avoidance behaviour or substance misuse),

  • cognitive and interpersonal distortions,

  • comorbid medical difficulties, and

  • health-related disability.8

C. Patients with depression or anxiety who monitor their own symptom or disability state can recognise signs of early relapse and seek earlier intervention for subsequent episodes.

D. Patients with more severe or more complex disorders are likely to be exposed to an ever-increasing number of pharmacological or psychological treatments. Standardised outcome measurement permits comparison of responses (within each individual) to different treatment approaches.

E. Patients with depression or anxiety will often require assessment by specialist providers. Standardised measures permit the determination of the short and long term benefits achieved by such specialised interventions.

F. Clinical record keeping is enhanced and can be linked (electronically or through disease management systems) with appropriate triggers to consider changes in management planning. For example, if a patient treated for depression fails to achieve a significant reduction in standard symptom severity or disability measures, then a change in treatment approach or referral to a specialist service would need to be considered.

2: Health services planning and other research outcomes

A. Evaluation of clinical effectiveness of new pharmacological or psychological treatments in relevant primary care settings. Given the range of new treatments and the differing views of clinicians, such studies are an important aspect of the evidence base for mental health.10

B. Cost-effectiveness research focused on the long term benefits of new pharmacological or psychological treatments.

C. Investigation of the patient, practitioner and organisational factors that predict variations in the quality of clinical practice11 or access to various types of mental health assessments and treatments.12

D. Evaluation of the impact of major health service innovations on a range of clinical outcomes (eg, Primary Mental Health Care Teams in Victoria, 2001).

E. Evaluation of the impact of specific incentives (eg, Better Outcomes in Mental Health Care, 2001) or innovative education or disease management support processes on clinical practice (eg, mental health training and clinical audits).13

Competing interests

None identified.

References
  1. Ellwood PM. Outcomes management. A technology of patient experience. N Engl J Med 1988; 318: 1549-1556. <PubMed>
  2. Portfolio Budget Statements 2002–03. Health and Ageing Portfolio. Outcome 9: Health Investment. Available at <http://www.health.gov.au/internet/wcms/publishing.nsf/Content/health-budget2002-index1.htm/$FILE/outcome9.pdf>.
  3. Andrews G, Peters L, Teesson M. The measurement of consumer outcome in mental health. Canberra: Australian Government Publishing Service, 1994.
  4. Cone JD. Evaluating outcomes: empirical tools for effective practice. Washington, DC: American Psychological Association, 2001.
  5. Andrews G. Should depression be managed as a chronic disease? BMJ 2001; 322: 419-421. <PubMed>
  6. Andrews G, Henderson S, Hall W. Prevalence, comorbidity, disability and service utilisation. Overview of the Australian National Mental Health Survey. Br J Psychiatry 2001; 178: 145-153. <PubMed>
  7. Kemp R, Kirov G, Everitt B, et al. Randomised controlled trial of compliance therapy. 18-month follow-up. Br J Psychiatry 1998; 172: 413-419. <PubMed>
  8. Hickie IB, Davenport TA, Hadzi-Pavlovic D, et al. Development of a simple screening tool for common mental disorders in general practice. Med J Aust 2001; 175 Suppl Jul 16: S10-S17. <PubMed>
  9. Hickie I. Primary care psychiatry is not specialist psychiatry in general practice. Med J Aust 1999; 170: 171-173. <PubMed><eMJA full text>
  10. Hickie IB, Scott EM, Davenport TA. Are antidepressants all the same? Surveying the opinions of Australian psychiatrists. Aust N Z J Psychiatry 1999; 33: 642-649. <PubMed>
  11. Hickie IB, Davenport TA, Scott EM, et al. Unmet need for recognition of common mental disorders in Australian general practice. Med J Aust 2001; 175 Suppl Jul 16: S18-S24. <PubMed>
  12. Davenport TA, Hickie IB, Naismith SL, et al. Variability and predictors of mental disorder rates and medical practitioner responses across Australian general practices. Med J Aust 2001; 175 Suppl Jul 16: S37-S41. <PubMed>
  13. Naismith SL, Hickie IB, Scott EM, Davenport TA. Effects of mental health training and clinical audit on general practitioners' management of common mental disorders. Med J Aust 2001; 175 Suppl Jul 16: S42-S47. <PubMed>
  14. Ware JE, Kosinski M, Keller SD. A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care 1996; 34: 220-233. <PubMed>
  15. Von Korff M, Ustun TB, Ormel J, et al. Self-report disability in an international primary care study of psychological illness. J Clin Epidemiol 1996; 49: 297-303. <PubMed>
  16. Kessler RC, Andrews G, Colpe L, et al. Short screening scales to monitor population prevalences and trends in nonspecific psychological distress [paper]. Cambridge, MA: Department of Health Care Policy, Harvard Medical School, April 2000.
  17. Zigmond AS, Snaith RP. The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand 1983; 67: 361-370. <PubMed>
  18. Furukawa TA, Andrews G, Goldberg D. Stratum-specific likelihood ratios of the General Health Questionnaire in the community: help seeking and physical comorbidity affect the test characteristics. Psychol Med 2002; 32: 743-748. <PubMed>
  19. Andrews G, Slade T. Interpreting scores on the Kessler Psychological Distress Scale (K10). Aust N Z J Public Health 2001; 25: 494-497. <PubMed>
  20. Tobin M, Hickie I. Outcomes focussed service delivery: developing an academic-management partnership. Aust N Z J Psychiatry 1998; 32: 327-336. <PubMed>

(Received 21 Jan 2002, accepted 30 May 2002)

School of Psychiatry, University of New South Wales at St George Hospital, Sydney, NSW.

Ian B Hickie, MD, FRANZCP, Professor of Community Psychiatry, and CEO, 'beyondblue: the national depression initiative'; Tracey A Davenport, BA(Hons), Senior Research Officer.

School of Psychiatry, University of New South Wales at St Vincent's Hospital, Sydney, NSW.

Gavin Andrews, MD, FRANZCP, Professor of Psychiatry.

Correspondence: Professor I B Hickie, beyondblue, PO Box 6100, Hawthorn West, VIC 3122. ian.hickieATbeyondblue.org.au

Other articles have cited this article:

Home | Issues | eMJA shop | My account | Classifieds | More... | Contact | Topics | Search

The Medical Journal of Australia    eMJA  

©The Medical Journal of Australia 2002 www.mja.com.au PRINT ISSN: 0025-729X ONLINE ISSN: 1326-5377