eMJA     The Medical Journal of Australia

Home | Issues | eMJA shop | My account | Classifieds | Contact | More... | Topics | Search   

Healthcare

Implementing clinical practice guidelines: a community-based audit of breast cancer treatment

Paul S Craft, Yanping Zhang, Jennifer Brogan, Noel Tait, John M Buckingham,
and the Australian Capital Territory and South Eastern New South Wales Breast Cancer Treatment Group

MJA 2000; 172: 213-216
For editorial comment, see Redman & Reeve

Abstract - Methods - Results - Discussion - Acknowledgement - References - Authors' details
Make a comment - Register to be notified of new articles by e-mail - Current contents list - More articles on Oncology


Abstract Objective: To improve breast cancer management by facilitating implementation of treatment guidelines.
Design: A prospective, longitudinal study (developed by clinicians and consumers) of all patients with newly diagnosed breast cancer. Four locally agreed breast cancer management guidelines were established (based on 1995 National Health and Medical Research Council guidelines) as practice indicators.
Setting: Breast cancer treatment facilities and medical practices in the Australian Capital Territory and South Eastern New South Wales, May 1997 to July 1998.
Main outcome measures: Actual treatment received by patients for primary breast cancer during the study period.
Results: During the 14 months of the study, 19 clinicians registered 221 new patients with a proven diagnosis of breast cancer. Of 191 women with localised invasive breast cancer, 112 (59%) had tumours 2 cm or less in diameter. Axillary surgery in 173 (91%) of these women showed 107 (56%) had no axillary lymph node involvement. Of 87 women treated with breast-conserving surgery for locally invasive cancer, 85 (98%) also received postoperative radiotherapy. Some form of systemic adjuvant therapy was indicated in 99 women (axillary nodes positive or tumours > 2 cm diameter) and this treatment was received by 95 (96%). All 27 women aged under 50 years with node-positive disease received adjuvant chemotherapy.
Conclusions: Enhancing uptake of breast cancer management guidelines is feasible at a regional level with an audit program and broad support among clinicians and consumers.


Breast cancer is a major health problem in Australia, with 9800 new cases diagnosed each year.1 Management guidelines for early breast cancer were developed in 1995 by the National Health and Medical Research Council (NHMRC) to assist clinicians and consumers make decisions about treatment and thus to improve health outcomes.2

Observed differences in treatment outcome between populations suggest that opportunities for improvement are available.3 Moreover, potentially important variations in clinical practice are well documented in Australia and elsewhere.4-6 Treatment practice which appears to be informed by evidence, for example greater use of breast-conserving surgery, has been observed more frequently among clinicians who regularly treat patients with breast cancer.7 Furthermore, congruence of treatment practice with published guidelines has been directly associated with improved patient survival;8 improved treatment practice has the potential to improve survival by up to 10%.8,9 Therefore, enhanced implementation of soundly developed, evidence-based treatment guidelines is an appropriate goal for health services and individual clinicians.

In 1996, clinicians and consumers involved in breast cancer diagnosis and treatment in the Australian Capital Territory (ACT) and South Eastern New South Wales (SE NSW) formed a cooperative group aimed at improving breast cancer management and facilitating implementation of treatment guidelines. A prospective, longitudinal, community-based study of breast cancer treatment was established to assist with guidelines implementation. Our report describes the results of the first 14 months of this ongoing project.


Methods
Breast Cancer Treatment Group
All surgeons, radiation oncologists, medical oncologists, radiologists, pathologists, nurses and other health professionals who were known by the ACT Breast Screen Program to be involved in the treatment of breast cancer in the ACT and SE NSW were invited by mail to participate in a multidisciplinary breast cancer treatment group. Consumer representatives from "The Bosom Buddies", a community organisation of women with a history of breast cancer, were also invited to join the group. Fifty consumers and clinicians expressed interest and continue to receive all correspondence, with meetings every two months attracting between 15 and 30 attendees. A general practitioner representative from the ACT Division of General Practice also participated. The Breast Cancer Treatment Group adopted treatment guidelines based on the NHMRC Clinical Practice Guidelines, commenced a community-based audit, and later developed a set of agreed practice indicators against which treatment decisions could be compared.

The 1998 estimated populations of the ACT and South Eastern NSW were 311 000 and 118 000 respectively (source: Australian Bureau of Statistics, Estimated Residential Populations, 30 June 1998).

Practice indicators
The group adopted four indicators for which unanimous local agreement about the relevant guideline was available:

  • Women with operable invasive breast cancer should undergo some form of axillary surgery sufficient to develop a prognosis based on axillary node status;

  • Women undergoing less than total mastectomy for operable invasive breast cancer should receive postoperative adjuvant radiotherapy;

  • Women with a completely resected invasive breast cancer tumour greater than two centimetres in diameter or with involved axillary lymph nodes should receive adjuvant systemic therapy (either chemotherapy, endocrine therapy or both); and

  • Women under the age of 50 years with completely resected axillary lymph node positive breast cancer should receive adjuvant chemotherapy.

Audit A prospective study of breast cancer treatment was commenced in May 1997. The study was designed as a quality assurance project and notified as such under Section 7 of the Health Act 1993 (ACT) in June 1997. The study was approved by the Ethics Committee of the ACT Department of Health and Community Care.

All clinicians involved specifically with the care of patients with breast cancer were invited to participate in the study. Participating clinicians agreed to approach all of their patients presenting with newly diagnosed breast cancer requesting permission to include them in the study. Eligible patients were women or men with newly diagnosed invasive or in-situ breast cancer. For each eligible patient a brief notification form was completed and submitted by mail to the study centre at the Women's Health Program of ACT Community Care. Written informed consent was obtained from the patient by the notifying clinician, and subsequently a detailed data form was completed giving details of presentation, clinical and pathological staging, and treatment. The dataset was based on a prior survey conducted by the Provincial Surgeons of Australia (Dr David Adamthwaite, President of the Provincial Surgeons of Australia, personal communication). Additional data relating to enrolled patients were obtained from treatment units in the region.

Information from the audit forms, supplemented where necessary from pathology reports and treatment facility records, was entered into a secure database developed by the project officer. As well as facilitating project management, the database allows individualised, confidential reports to be produced for each participating clinician, providing detailed feedback about each clinician's practice, with comparisons across the group and against the agreed criteria.

Aggregated data across the whole clinician group are presented at regular meetings of the treatment group.

Data collected during the first 14 months of the project, and analysed to provide an initial report to contributing clinicians, form the basis of our report. Accrual of patients to the project is ongoing.


Results
Specialist participation
Since commencement of the project, 23 of 24 medical specialists known to treat breast cancer within the region have registered as participants, with 19 specialists contributing data to the study to date (13 surgeons, three radiation oncologists and three medical oncologists). All of the radiation and medical oncologists were based in Canberra, while the principal practices of six surgeons were based in SE NSW.

Patient accrual
During 14 months from May 1997 to July 1998, 221 patients, including four men, with a diagnosis of primary breast cancer were registered for the study (Box 1).

Some 123 new cases of invasive breast cancer (excluding male patients and patients with in-situ disease only) were registered with ACT addresses. In comparison, the observed mean annual incidence of breast cancer in the ACT during 1993-1996 was 134.1 Thus, during the 14-month study period, about 156 incident cases would be expected. The project therefore detected 79% of predicted ACT incident cases during the study period.

Of the 221 registered patients, there were 10 with distant metastases, 16 with carcinoma-in-situ only and four men, leaving 191 women with primary, localised, invasive breast cancer. It is to these women that the treatment guidelines apply. In five women with bilateral synchronous tumours, details are given of the tumour judged by the treating clinician to have the worse prognosis. Eighty-one per cent of tumours were oestrogen receptor (ER) positive or progesterone receptor (PgR) positive by immunohistochemical analysis done in routine diagnostic histopathology laboratories. The pathological characteristics of the tumours in these 191 women are presented in Box 2.

Comparisons with practice indicators (Box 3)
Axillary surgery was undertaken in 173 women. One elderly patient declined to have any surgery. Thus, 17 of 190 patients did not undergo any form of axillary surgery, at variance with the guideline. Of these women, six were aged 80 years or older. Seven of the remaining 11 patients had tumours less than 1 cm in diameter. Among women having axillary surgery, five (3%) had four or fewer nodes resected.

Only two of 87 women who underwent breast-conserving surgery did not also receive postoperative radiotherapy. Of the 191 patients with invasive breast cancer, 103 (54%; 95% CI, 47-61) underwent mastectomy.

The overall concordance of treatment with the practice indicators relating to systemic adjuvant therapy was strong. Of 33 women with tumours greater than 2 cm in diameter and negative or unknown axillary lymph node status, 32 (97%) received either tamoxifen (18), chemotherapy (4), or both (10). Of 66 women with axillary lymph node involvement, 63 (95%) received systemic adjuvant therapy with either tamoxifen (14), chemotherapy (19) or both (30). Thus, only four of 99 women for whom adjuvant systemic therapy was considered appropriate under the guidelines did not receive such therapy.

All 27 women under 50 years of age with axillary lymph node involvement received adjuvant chemotherapy.  

Data quality The project officer actively sought clarification of ambiguous or missing data items. Initial notification forms required clarification for 192 of 221 registrations. Of these queries, one follow-up data request was required for 91 patients, two requests for 60 patients and three requests for 41 patients. After these data requests, 3.6% of records remained incomplete in some way. Initial under-reporting of adjuvant treatments received was noted, particularly in regard to postoperative radiotherapy.


Discussion Our report demonstrates the feasibility of regionally based multidisciplinary groups adopting treatment guidelines and then assessing their implementation. Strong concordance of practice with the four practice indicators was observed. Despite a third of our patients living in rural areas, there were high rates of postoperative radiotherapy after breast-conserving surgery. The rate of axillary surgery was lower than recommended, but in almost all of these women a partial explanation was available (advanced age or very small primary tumour). Whether the decision not to perform axillary surgery in these patients was appropriate is the subject of debate and ongoing clinical trials.

Given the degree of involvement of clinicians in establishing the data collection and practice indicators, the strong concordance with actual practice observed is not surprising. The practice indicators chosen were not particularly controversial, enabling rapid consensus among the group members. Indicators relating to the use of breast-conserving surgery for early breast cancer and to the use of adjuvant chemotherapy for node-negative disease, although more contentious, are appropriate further areas for local consensus and audit. Observed concordance with guidelines for adjuvant chemotherapy in node-negative breast cancer has been relatively low, presumably because of the more modest benefits of treatment (in absolute terms) in this group.11

Implementing guidelines successfully can be difficult. Just producing and publishing guidelines for breast cancer treatment does not ensure their uptake into clinical practice.12 Over time clinical practice may adhere more closely to published guidelines, although a causal relationship cannot be easily proven.13 In a survey of clinicians in Sydney, most respondents supported the NHMRC Clinical Practice Guidelines, but only 20% believed the guidelines had influenced clinical practice.14

The introduction of guidelines has been a stimulus for institutionally focused audits of surgical practice.15 Audits incorporating structured feedback to clinicians may be a critical strategy in implementing guidelines. Organisations such as the Royal Australasian College of Surgeons have recognised audit as an important tool in the treatment of breast cancer, and Clinical Indicator 7.1 of the Australian Council of Healthcare Standards Internal Medicine Indicators, version 2, measures the proportion of premenopausal women with node-positive early breast cancer receiving chemotherapy.16

Many factors affect treatment decisions in primary breast cancer. Women bring to the process their own preferences and needs. Many of the treatment decisions require trade-offs between long term gain and unpleasant treatments, such as chemotherapy. We did not examine the decision-making processes followed by these patients and their attending health professionals.

Entry of any individual patient into the audit was voluntary, both for the clinician and for the patient. Participating clinicians undertook to offer enrolment to all of their patients, and every effort was made to enhance compliance. Nevertheless, complete enrolment was not achieved and this may have introduced bias, with patients receiving multimodality care possibly being more likely to be enrolled.

An advantage of our audit was that it was community based and prospective. Surgical audits have generally been based on retrospective casenote review and, as such, have sometimes been hampered by missing data.17 Some community-based studies assessing the process of treatment have relied on the secondary analysis of administrative data with linkage to population-based cancer registries.18 In Canada, a population-based cancer registry has been linked to clinical records to obtain treatment details and allow comparisons with treatment guidelines.19

Successful collection of community-based audit data requires both enthusiasm and trust on the part of the treating clinicians voluntarily submitting information about their own practice. We believe this may be best achieved within a framework of agreed treatment guidelines and indicators. An enthusiastic project officer and involvement of practice staff and institutional data managers is crucial. As new ways of managing breast cancer (and other diseases) become available, an ongoing implementation process with agreed, clinically relevant indicators and guidelines, and a regionally based audit, can be an effective tool.

Members of the Australian Capital Territory and South Eastern New South Wales Breast Cancer Treatment Group contributing to the study

Chairperson
Dr Doris Zonta.

Surgeons
Bega, NSW: Dr Andrew Thomson.
Canberra, ACT: Dr Guan Chong, Dr Ian Davis, Dr Dennis Dyason, Dr Diarmid McKeown, Dr John Stuchbery
Goulburn, NSW: Dr Margaret Beevors, Dr John Hayman.
Moruya, NSW: Dr Peter Gough, Dr John Groome, Dr David Thomson.

Medical Oncologists
Canberra, ACT: Associate Professor Robin Stuart-Harris, Dr William Coupland.

Radiation Oncologists
Canberra, ACT: Dr Deborah Thornton, Dr George Jacob, Dr Kenneth Sunderland.

Epidemiologist
Canberra, ACT: Dr Bruce Shadbolt.

Pathologists
Canberra, ACT: Dr Jane Dahlstrom, Dr Sanjiv Jain.



Acknowledgement
Initial funding was provided by the Commonwealth Department of Health and Aged Care Cancer Screening Unit.


References
  1. Australian Institute of Health and Welfare. Breast and cervical cancer screening in Australia 1996-1997. Canberra: AIHW, 1998: 33. (Cancer Series no. 8.)
  2. National Health and Medical Research Council. Clinical practice guidelines. The management of early breast cancer. Canberra: NHMRC, 1995.
  3. Richards M, Sainsbury R, Kerr D. Inequalities in breast cancer care and outcome. Br J Cancer 1997; 76: 634-638.
  4. Craft PS, Primrose JG, Lindner JA, McManus PR. Surgical management of breast cancer in Australian women in 1993: analysis of Medicare statistics. Med J Aust 1997; 166: 626-629.
  5. Nattinger AB, Goottlieb MS, Veum J, et al. Geographic variation in the use of breast-conserving treatment for breast cancer. N Engl J Med 1992; 326: 1102-1107.
  6. Samet JM, Hunt WC, Farrow DC. Determinants of receiving breast-conserving surgery. The surveillance, epidemiology and end results program 1983-1986. Cancer 1994; 73: 2344-2351.
  7. Hill DJ, White VM, Giles GG, et al. Changes in the investigation and management of primary operable breast cancer in Victoria. Med J Aust 1994; 161: 110-122.
  8. Sainsbury R, Haward B, Rider L, et al. Influence of clinician workload and patterns of treatment on survival from breast cancer. Lancet 1995; 345: 1265-1270.
  9. Gillis CR, Dole D. Survival outcome of care by specialist surgeons in breast cancer: a study of 3786 patients in the west of Scotland. BMJ 1996; 312: 145-148.
  10. Elston CW, Ellis IO. Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. Histopathology 1991; 19: 403-410.
  11. Sawaka C, Olivotto I, Coldman A, et al. The association between population-based treatment guidelines and adjuvant therapy for node-negative breast cancer. Br J Cancer 1997; 75: 1534-1542.
  12. Chouillet AM, Bell CM, Hiscox JG. Management of breast cancer in southeast England. BMJ 1994; 308: 168-171.
  13. Ray-Coquard I, Philip T, Lehmann M, et al. Impact of a clinical guidelines program for breast and colon cancer in a French cancer center. JAMA 1997; 278: 1591-1595.
  14. Ward JE, Boyages J, Gupta L. Local impact of the NHMRC early breast cancer guidelines: where to from here? Med J Aust 1997; 167: 362-365.
  15. McCarthy DO, Blamey RW, Robertson JF, Mitchell AK. A one-year audit of 255 operable breast cancers. Eur J Surg Oncol 1997; 23: 399-402.
  16. Australian Council on Healthcare Standards. Clinical indicators in summary. Revised edition. Sydney: ACHS, 1998.
  17. Clamp SE. Management of breast cancer. Incomplete case notes hamper research. BMJ 1994; 308: 715.
  18. Hillner BE, McDonald MK, Penberthy L, et al. Measuring standards of care for early breast cancer in an insured population. J Clin Oncol 1997; 15: 1401-1408.
  19. Olivotto IA, Coldman AJ, Hislop TG, et al. Compliance with practice guidelines for node-negative breast cancer. J Clin Oncol 1997; 15: 216-222.

(Received 29 Jul, accepted 4 Dec, 1999)


Authors' details Medical Oncology Unit, The Canberra Hospital, Canberra, ACT.
Paul S Craft, MPH, FRACP, Director.

Women's Health Program, ACT Community Care, Canberra, ACT.
Yanping Zhang, Project Officer;
Jennifer Brogan, Director.

The Calvary Clinic, Canberra, ACT.
Noel Tait, FRACS, Consultant Surgeon;
John M Buckingham, FRACS, Consultant Surgeon.

Reprints: Dr P S Craft, Medical Oncology Unit, The Canberra Hospital, PO Box 11, Woden, ACT 2606.
Paul_CraftATact.gov.au

©MJA 2000
Make a comment

Home | Issues | eMJA shop | My account | Classifieds | More... | Contact | Topics | Search

The Medical Journal of Australia    eMJA  


Readers may print a single copy for personal use. No further reproduction or distribution of the articles should proceed without the permission of the publisher. For permission, contact the Australasian Medical Publishing Company.
Journalists are welcome to write news stories based on what they read here, but should acknowledge their source as "an article published on the Internet by The Medical Journal of Australia <http://www.mja.com.au>".

<URL: http://www.mja.com.au/> © 2000 Medical Journal of Australia.
We appreciate your comments.


1: Patient and tumour characteristics for all registered breast cancer patients (n=221)

nPercentage (95% CI)

Median age, 57 years (range, 25-88)
Sex
Male42% (1%-5%)
Menopausal status
Premenopausal63 29% (23%-35%)
Postmenopausal12557% (50%-63%)
Perimenopausal2712% (8%-17%)
Unknown or male63% (1%-6%)
Place of residence
Australian Capital Territory14767% (61%-73%)
Diagnosis
In-situ disease only167% (4%-11%)
Invasive carcinoma20593% (89%-96%)
Tumour extent
Distant metastases at diagnosis105% (3%-9%)
Synchronous bilateral tumours52% (1%-5%)
Back to text

 
2: Pathological characteristics of the tumour in 191 women with invasive breast cancer and no distant metastases
 
CharacteristicnPercentage (95% CI)

Tumour size (mm)
0-103016% (11%-22%)
11-208243% (36%-50%)
21-506233% (27%-40%)
>50147% (4%-12%)
Unknown32% (1%-5%)
Axillary lymph node status
Negative107 56% (49%-63%)
Positive66 35% (29%-42%)
No axillary surgery168% (5%-13%)
Unknown21% (1%-5%)
 
CharacteristicnPercentage (95% CI)

Tumour type and grade*
Invasive ductal
Grade 12915% (11%-21%)
Grade 26635% (29%-42%)
Grade 35328% (22%-35%)
Invasive lobular2010% (7%-15%)
Special types†2312% (8%-17%)
Receptor status
ER positive or PgR positive15581% (75%-86%)
ER negative and PgR negative3016% (11%-22%)
Unknown63% (1%-6%)

*See Elston and Ellis. 10 †Includes seven tubular, four mucinous, six cribriform, one papillary, one medullary, one squamous cell, and one metaplastic carcinoma. There was also one spindle cell tumour and one cystosarcoma phylloides tumour reported. ER=Oestrogen receptor. PgR=Progesterone receptor.
Back to text

 
3: Women with breast cancer - comparison of treatment received with practice indicators
 
Indicatorn Percentage (95% CI)

Breast-conserving surgery
Radiotherapy8598% (92%-99%)
No radiotherapy22% (1%-8%)
Total87 100%
Surgery for invasive cancer
Axillary surgery17391% (86%-94%)
No axillary surgery179% (6%-14%)
Total190 100%
Axillary nodes positive or tumours >2 cm
Some form of adjuvant systemic therapy95 96% (90%-98%)
No adjuvant systemic therapy44% (2%-10%)
Total99100%
Women aged less than 50 years with positive axillary nodes
Adjuvant chemotherapy27100%
No adjuvant chemotherapy00
Back to text