Colorectal cancer is the commonest internal malignancy and second most common cause of cancer death in New South Wales.1 Surgery is the mainstay of treatment, with adjuvant chemotherapy and radiotherapy for specific subgroups of patients.
In 1999, the National Health and Medical Research Council (NHMRC) released evidence-based clinical practice guidelines for colorectal cancer.2 It was anticipated that adopting the guidelines would reduce variations in care and improve clinical outcomes and quality of life.
Release of guidelines does not guarantee their adoption. To develop strategies to promote guideline uptake, a detailed understanding of variations in clinical practice and their determinants is needed. This study was undertaken to provide a population-based description of care for people with colorectal cancer in NSW in the 12 months after the release of the 1999 guidelines. For the first 3 months, data were collected throughout Australia.3-5 This article presents multivariable analyses of the 12 months of NSW data, aiming to identify factors that predict the provision of care in accordance with recommendations.
All new patients with colorectal cancer reported to the NSW Central Cancer Registry between 1 February 2000 and 31 January 2001 were included.6 As each patient was registered, a questionnaire was mailed to their surgeon to obtain clinical information and referral details. Medical and radiation oncologists were then asked to complete a questionnaire about adjuvant therapy.
The questionnaires addressed 23 of 46 recommendations in the NHMRC guidelines.2 Of these, 13 that were supported by Level I (meta-analyses of randomised controlled trials) or Level II (randomised controlled trial) evidence were considered for this study. Where several guidelines related to the same aspect of care, the guideline with the most direct consequences for patient care was selected. For example, two guidelines pertained to thromboembolic prophylaxis; one recommended thromboembolic prophylaxis, and one stated that unfractionated heparin, low molecular weight heparin, and intermittent calf compression are all effective. In this case, only the guideline recommending thromboembolic prophylaxis was included.
Overall, seven guidelines that addressed different aspects of surgical care and had direct implications for patient outcomes were selected for specific study:
Colonic pouch reconstruction is recommended following resection of low rectal cancer;
Patients with resected node-positive colon cancer should be offered adjuvant therapy;
Combined modality therapy or radiotherapy is indicated for patients with high-risk rectal cancer;
Preoperative radiotherapy is indicated for patients with fixed or tethered rectal cancer if it is felt that down-staging will enable successful resection;
Preoperative prophylactic antibiotics are recommended;
Deep venous thromobosis (DVT) prophylaxis is recommended; and
Routine preoperative mechanical bowel preparation is not supported.
For guidelines relating to adjuvant therapy, care was considered concordant if a patient was referred for consideration of chemotherapy or radiotherapy, or declined referral. For other guidelines, care was considered concordant only if the guideline was actually followed.
Surgeons were identified as specialist colorectal surgeons if they were members of the Colorectal Surgical Society of Australia and New Zealand. Other surgeons were considered general surgeons. Surgeon and hospital caseloads were calculated as the number of patients entered into the study who had a surgical procedure, both for any colorectal cancer, and for rectal cancer separately.
Bivariate associations between guideline concordance and the following patient, surgeon and hospital characteristics were assessed: patient age, patient sex, presentation type (screening or symptomatic), admission type (elective or emergency), cancer site, cancer stage (Dukes classification), number of primary tumours (one or more), intent of surgery (curative or palliative), hospital location (metropolitan or rural), colorectal or general surgeon, surgeon caseload, hospital type (principal referral, other public, or private), and hospital caseload.
We conducted logistic regression modelling using generalised estimating equations with an exchangeable correlation matrix to identify independent predictors of concordance with individual recommendations, after accounting for patient clustering by surgeon. Variables with P < 0.25 in bivariate analyses were entered into the model. Hospital and surgeon caseloads and surgical specialty were entered into all full models regardless of bivariate significance. A manual backwards stepwise approach was used to eliminate variables in order of least significance. Only variables that were significant were retained in the final model. All analyses were undertaken using SAS, version 9.1 (SAS Institute Inc, Cary, NC, USA).
For a summary measure of concordance with the recommendations, each guideline was identified as being relevant or irrelevant for each patient based on clinical criteria. The proportion of relevant guidelines followed was calculated for each patient.
Between 1 February 2000 and 31 January 2001, 3443 new cases of colorectal cancer were notified. Of these, 66 patients were ineligible (36 did not have colorectal cancer; 9 were treated outside NSW; 21 had previous colorectal cancer). The treating doctor was unknown for 63 eligible patients (1.9%), precluding mailing of a questionnaire, and no response was received from doctors treating 219 eligible patients (6.5%). Responses were received for 3095 of 3377 eligible patients (91.6%) from 268 surgeons, and included care provided at 129 hospitals. There were no important differences in age, sex or accessibility to health services between patients for whom a questionnaire was or was not completed (data not shown).
Surgery was performed for 2984 patients (96.4% of those with a completed questionnaire) by 251 surgeons. Patient, disease and provider characteristics for these patients are summarised in Box 1. The median colorectal cancer caseloads were 5 for surgeons (range, 1–86; interquartile range [IQR], 2–14) and 12.5 for hospitals (range, 1–156; IQR, 4–35); for rectal cancer only, they were 3 (range, 1–44; IQR, 1–8) and 5 (range, 1–66; IQR, 2–16), respectively.
Seven hospitals that did not admit any patients having surgery were excluded from hospital-level analyses.
Box 2 presents the results of the logistic regression, including only the significant predictors of concordance.
Of 581 patients who had a low anterior resection or ultra-low anterior resection, 169 (29.1%; 95% CI, 23.4%–35.5%) had a colonic pouch reconstruction. Patients who had surgery with curative intent or who were treated by colorectal surgeons were more likely to receive colonic pouch reconstruction after low anterior resection. Neither hospital caseload nor surgeon caseload was a significant predictor of concordance with this guideline.
This guideline had the second highest intracluster correlation coefficient (0.29), which is consistent with the practice of colonic pouch reconstruction being more common among colorectal surgeons.
Of 483 patients with Dukes C colon cancer who had surgery with curative intent, 367 (76.0%; 95% CI, 69.4%–81.6%) were offered adjuvant chemotherapy or combined modality therapy. Patients offered adjuvant chemotherapy were younger (mean, 66.2 years) than those not offered chemotherapy (mean, 74.8 years) (t = 8.58; df = 263; P < 0.001), less likely to be treated by a colorectal surgeon, and more likely to be treated in metropolitan areas. These factors were independently predictive after accounting for clustering. Neither hospital caseload nor surgeon caseload was a significant predictor of concordance with this guideline.
Of 692 patients with cancer in the middle or lower third of the rectum, 314 (45.4%) had stage T3, and 34 (4.9%) had stage T4. Of these 348 patients with “high-risk” rectal cancers, 208 (59.8%; 95% CI, 52.4%–66.7%) were offered radiotherapy, alone or as combined modality therapy. Men, younger patients, and those treated by surgeons with lower caseloads were more likely to be offered adjuvant radiotherapy for high-risk rectal cancer. Neither hospital caseload nor surgeon specialty was predictive.
Of 113 patients with rectal cancer and preoperative evidence of tumour invasion into the adjacent structures, 67 (59.3%; 95% CI, 47.4%–70.3%) received preoperative radiotherapy. Patient age and intent of surgery were independently predictive of concordance with this guideline. Hospital caseload, surgeon caseload and surgeon specialty were not predictive.
This guideline was considered relevant only for people undergoing elective surgery for colon cancer. Of 1490 eligible patients, 95 (6.4%; 95% CI, 3.6%–10.9%) did not receive routine preoperative bowel preparation. Older patients and those treated at hospitals with higher caseloads were more likely not to receive routine bowel preparation. The intracluster correlation coefficient of 0.6 supports a strong effect of institutional policy in relation to this guideline.
We found varied uptake of specific management guidelines for colorectal cancer. Almost all patients received antibiotic and DVT prophylaxis, as recommended. For adjuvant therapy and preoperative radiotherapy, about 60% of eligible patients were offered the recommended therapy. Almost 95% of eligible patients received mechanical bowel preparation, despite the lack of support in the guidelines.
We found that older patients were less likely to be offered adjuvant therapy. Suboptimal use of adjuvant therapies has been reported elsewhere, with increasing patient age commonly predicting non-referral.7-10 However, recent data for elderly patients with advanced colorectal cancer treated with chemotherapy indicate no greater toxicity and similar probabilities of benefit as for younger patients.11 Preoperative radiotherapy was also less likely to be given to older patients, regardless of whether surgery was intended to be curative or palliative. Given these results, the development of resources focusing on appropriate care for older patients appears to be a priority.
The only guideline we investigated that related to technical aspects of colorectal cancer surgery was the use of colonic pouch reconstruction. This was also the only guideline where subspecialist training in colorectal surgery was predictive of concordance. Surgical education is an important component of any strategy to improve surgical care. Although the role of subspecialisation in colorectal surgery remains controversial,12 systematic training of surgeons in new, effective techniques can have a major effect on cancer outcomes. In Sweden, for example, training surgeons in total mesorectal excision for rectal cancer led to significant reductions in local recurrence rates and 2-year cancer-related mortality.13,14
We found that patients with node-positive colon cancer were significantly more likely to be offered adjuvant chemotherapy if they were treated by a general surgeon rather than a colorectal surgeon. The reason for this is unclear and warrants further investigation.
The greatest discordance we found related to bowel preparation, which has no support in the guidelines. Moreover, there is evidence that it may increase anastomotic leak rates.15 Lack of familiarity with the evidence may be one reason why the guideline is not followed. A survey of colorectal surgeons just before release of the NHMRC guidelines reported very low awareness of the evidence against bowel preparation.16 Even after dissemination of the national guidelines and publication of further studies on the topic, a survey in 2001 found that knowledge of this evidence had not changed.17 Technical and aesthetic considerations may also influence the readiness of surgeons to follow this guideline. However, surgeon-related factors were not predictive of concordance in our study. The only independently predictive factors were patient age and hospital caseload, highlighting the potential importance of institutional factors in determining guideline compliance.
Despite substantial literature supporting an association between higher caseload (particularly for rectal cancer) and improved care for people undergoing surgery for colorectal cancer,4,18 we found limited evidence of it. Use of antibiotic and DVT prophylaxis did relate to surgeon caseload, but the absolute differences were small. Use of adjuvant radiotherapy for patients with high-risk rectal cancer was lower among surgeons with higher caseloads. It is plausible that this is due to a lower perceived need for adjuvant radiotherapy if surgeons with higher caseloads are using better techniques. We focused only on care processes; patient outcomes such as survival and recurrence rates could vary by caseload. This will be further investigated as follow-up data become available for this cohort.
We calculated the overall proportion of relevant guidelines that were followed for individual patients. Our finding that, on average, 78% of relevant guidelines were followed for individual patients is encouraging. If found to be a robust yet discriminating measure of quality of care, a summary measure such as this could be useful for monitoring the uptake of evidence-based practice over time or between hospitals, while taking into account differences in patient numbers and clinical characteristics.
Strengths of our study include the population-based sample and very high participation rate — data were received for more than 90% of eligible patients. Furthermore, the accuracy of the clinicians’ self-reported data was confirmed in a pilot study, which found good agreement between questionnaire responses and independent medical record audit.6
Our identification of predictors of concordance with individual recommendations provides an empirical base for future strategies to promote uptake of evidence into patient care. In particular, strategies are needed to ensure that all patients who may benefit from adjuvant therapy, including older patients, are fully informed of their treatment options.
2 Independent predictors of concordance with guidelines
- Jane M Young1,2
- David C Leong3
- Katie Armstrong4
- Dianne O’Connell4,5
- Bruce K Armstrong6
- Allan D Spigelman7,8
- Stephen Ackland9,10
- Pierre Chapuis11,12
- Andrew B Kneebone1,12,13
- Michael J Solomon12
- 1 Surgical Outcomes Research Centre (SOuRCe), University of Sydney, Sydney, NSW.
- 2 Sydney South West Area Health Service, Sydney, NSW.
- 3 John James Medical Centre, Canberra, ACT.
- 4 Cancer Epidemiology Research Unit, Cancer Council NSW, Sydney, NSW.
- 5 Faculty of Health, University of Sydney, Sydney, NSW.
- 6 Sydney Cancer Centre and School of Public Health, University of Sydney, Sydney, NSW.
- 7 Professorial Surgical Unit, Faculty of Medicine, University of New South Wales, St Vincent’s Hospital Clinical School, Sydney, NSW.
- 8 Cancer Services, St Vincent’s and Mater Health, Sydney, NSW.
- 9 Department of Medical Oncology, Newcastle Mater Misericordiae Hospital, Newcastle, NSW.
- 10 Faculty of Health, University of Newcastle, Hunter Medical Research Institute, Newcastle, NSW.
- 11 Department of Surgery, Concord Repatriation General Hospital, Sydney, NSW.
- 12 Discipline of Surgery, University of Sydney, Sydney, NSW.
- 13 Department of Colorectal Surgery, Royal Prince Alfred Hospital, Sydney, NSW.
This research was supported by a grant-in-aid from MBF Australia and by project grant number 9937291 from the National Health and Medical Research Council. The survey was conducted through and generously supported by The Cancer Council NSW. Bruce Armstrong’s research is supported by a University of Sydney Medical Program Grant. The authors’ work was independent of the funders. We are grateful to specialists who treat colorectal cancer in NSW who generously gave of their time to complete questionnaires for this study.
None identified.
- 1. Tracey EA, Supramaniam R, Chen W. Cancer in New South Wales: incidence and mortality 2001. Sydney: Cancer Council NSW, 2003.
- 2. National Health and Medical Research Council. Guidelines for the prevention, early detection and management of colorectal cancer. Canberra: AGPS, 1999.
- 3. Clinical Governance Unit. The National Colorectal Cancer Survey. Australian clinical practice in 2000. Melbourne: National Cancer Control Initiative, 2002.
- 4. McGrath DR, Leong DC, Gibberd R, et al. Surgeon and hospital volume and the management of colorectal cancer patients in Australia. ANZ J Surg 2005; 75: 901-910.
- 5. McGrath DR, Leong DC, Armstrong BK, Spigelman AD. Management of colorectal cancer patients in Australia: the National Colorectal Cancer Care Survey. ANZ J Surg 2004; 74: 55-64.
- 6. Armstrong K, O’Connell D, Leong D, et al. The New South Wales Colorectal Cancer Survey 2000. Part 1. Surgical management. Sydney: Cancer Council NSW, 2004.
- 7. Ong S, Watters JM, Grunfeld E, O’Rourke K. Predictors of referral for adjuvant therapy for colorectal cancer. Can J Surg 2005; 48: 225-229.
- 8. Oliveria SA, Ulcickas Yood M, Campbell UB, et al. Treatment and referral patterns for colorectal cancer. Med Care 2004; 42: 901-906.
- 9. Engel J, Kerr J, Eckel R, et al. Quality of treatment in routine care in a population sample of rectal cancer patients. Acta Oncol 2005; 44: 65-74.
- 10. Schrag D, Cramer LD, Bach PB, Begg CB. Age and adjuvant chemotherapy use after surgery for stage III colon cancer. J Natl Cancer Inst 2001; 93: 850-857.
- 11. Twelves CJ, Butts CA, Cassidy J, et al. Capecitabine/oxaliplatin, a safe and active first-line regimen for older patients with metastatic colorectal cancer: post hoc analysis of a large phase II study. Clin Colorectal Canc 2005; 5: 101-107.
- 12. Solomon MJ, Thomas RJ, Gattellari M, Ward JE. Does type of surgeon matter in rectal cancer surgery? Evidence, guideline consensus and surgeons’ views. ANZ J Surg 2001; 71: 711-714.
- 13. Martling AL, Holm T, Rutqvist LE, et al. Effect of a surgical training programme on outcome of rectal cancer in the County of Stockholm. Lancet 2000; 356: 93-96.
- 14. Martling A, Cedermark B, Johansson H, et al. The surgeon as prognostic factor after the introduction of total mesorectal excision in the treatment of rectal cancer. Br J Surg 2002; 89: 1008-1013.
- 15. Guenaga K, Atallah AN, Castro AA, et al. Mechanical bowel preparation for elective colorectal surgery. Cochrane Database Syst Rev 2003; (1): CD001544.
- 16. Ward JE, Gattellari M, Solomon MJ. Management of patients with colorectal cancer: do Australian surgeons know the scientific evidence? Arch Surg 2002; 137: 1389-1394.
- 17. Cooney A, Gattellari M, Donnelly N, Ward J. Impact of national guidelines about the management of colorectal cancer on Australian surgeons’ awareness of evidence: a pre/post survey. Colorectal Dis 2004; 6: 418-427.
- 18. Hodgson DC, Zhang W, Zaslavsky AM, et al. Relation of hospital volume to colostomy rates and survival for patients with rectal cancer. J Natl Cancer Inst 2003; 95: 708-716.
Abstract
Objective: To investigate predictors of evidence-based surgical care in a population-based sample of patients with newly diagnosed colorectal cancer.
Design, patients and setting: Prospective audit of all new patients with colorectal cancer reported to the New South Wales Central Cancer Registry between 1 February 2000 and 31 January 2001.
Main outcome measures: Concordance with seven guidelines from the 1999 Australian evidence-based guidelines for colorectal cancer; predictors of guideline concordance; the mean proportion of relevant guidelines followed for individual patients.
Results: Questionnaires were received for 3095 patients (91.6%). Between 0 and 100% of relevant guidelines were followed for individual patients (median, 67%). Concordance with individual guidelines varied considerably. Patient age independently predicted non-concordance with guidelines for adjuvant therapy and preoperative radiotherapy. Adjuvant chemotherapy was more likely if a patient with node-positive colon cancer was treated in a metropolitan hospital or by a general surgeon. Surgeons with a high caseload or specialty in colorectal cancer were more likely to perform colonic pouch reconstruction, prescribe thromboembolism or antibiotic prophylaxis, and were less likely to refer patients with high-risk rectal cancer for adjuvant radiotherapy. Bowel preparation was less likely among older patients and in high-caseload hospitals.
Conclusion: Effective strategies to fully implement national colorectal cancer guidelines are needed. In particular, increasing the use of appropriate adjuvant therapy should be a priority, especially among older people.