The prevalence of diabetes is increasing worldwide, placing a major burden on individuals, communities and health services. In meeting this challenge, evidence suggests that the Chronic Care Model (CCM)1 leads to improved patient care and better health outcomes.2 The importance of the CCM delivery system — longitudinal planned care, regular follow-up and review, and multidisciplinary team care — is well established.3 Studies have shown that delivery system interventions are associated with improvements in clinical processes and outcomes,4 including glycated haemoglobin (HbA1c) and low-density lipoprotein (LDL) cholesterol levels5 and glycaemic control6 in patients with diabetes.
In Australia, Chronic Disease Management Medicare items were introduced to increase support for the management of chronic illness.7 These items provide rebates for General Practice Management Plans (GPMPs) to improve care planning, Team Care Arrangements (TCAs) to foster multidisciplinary care, and GPMP and TCA reviews to support ongoing care and regular follow-up.8 Evidence indicates that TCAs are associated with improved outcomes for patients with diabetes,9,10 but no detailed study on the impact of reviews for patients with diabetes has been done.
Web-based care management systems integrated with primary care are associated with improved glycaemic control,11 while modest improvements have been found in the absence of full integration.12-15 One such system, cdmNet (Precedence Health Care),16,17 is used by Australian practices to improve systematic management of patients with chronic disease. cdmNet supports key CCM processes: it creates best-practice, personalised GPMPs and TCAs; shares these plans with the care team and patient; continuously monitors the plans; facilitates collaboration and regular review; and supports patient self-management. Initial studies suggest that cdmNet is associated with improved team collaboration and adherence to best-practice guidelines.18
We aimed to investigate whether GPMPs, TCAs and their reviews improve the management and outcomes of patients with diabetes when supported by cdmNet.
This was a before-and-after study of prospectively collected data from cdmNet. This web-based care management system was chosen because of its relatively broad adoption in Australia.19 Patients with type 1 or 2 diabetes mellitus from across Australia (including metropolitan, rural and regional communities) who had been on a GPMP created using cdmNet for at least 14 months between June 2008 and November 2012 were selected for inclusion. cdmNet did not report comprehensive clinical data until 1 May 2011, so eligible patients had to still be actively involved in cdmNet after this date. Patients who sign up to use cdmNet agree to allow non-identifiable data collected in the system to be used for research purposes. The general practitioners in this study were those participating in the cdmNet care plans of the included patients.
The Monash University Human Research Ethics Committee approved this study (CF11/1035: 2011000519, CF11/1699: 2011000947).
Quality of care was measured using process and clinical outcomes.
Process outcomes measure adherence to best-practice care according to some standard. In this study, we used a single process outcome based on the proportion of completed clinical tests in the annual cycle of care (ACOC), as recommended in Australian diabetes guidelines.20 While the patients in the study were “available” to have multiple clinical tests done, not all patients had these done by their GPs. The process outcome was therefore defined as the percentage of ACOC clinical tests completed for the patient. The ACOC guidelines specify that seven clinical tests should be carried out within a 13-month period: one measurement each for HbA1c, total cholesterol, triglycerides, high-density lipoprotein (HDL) cholesterol, and microalbuminuria; and two measurements 5 months apart of body mass index (BMI) and blood pressure (BP).20 We calculated the process outcome by dividing the number of completed clinical tests (to a maximum of seven) by the recommended number of tests (seven). For each of BMI and BP, both tests needed to be done to count as completed. Tasks carried out by allied health personnel (eg, podiatrists, optometrists) were not included, as data on these before using cdmNet (ie, before a GPMP) were not available.
The process outcome was calculated for both the period of 1–14 months before the first cdmNet GPMP was created, and for the 13-month period after creation of the GPMP.
In this study, clinical outcomes refer to six of the clinical measurements included in the ACOC: HbA1c level, total cholesterol level, LDL cholesterol level (derived from the HDL cholesterol test), BMI, and systolic and diastolic BP.
Clinical outcomes before the first cdmNet GPMP was created were defined as the most recent value of each clinical measurement taken between 3 months before and 1 month after the creation of the GPMP. Measurements taken in this period represent the status of the patient before the intervention, even if they were measured after creation of the GPMP. Clinical outcomes after the GPMP were defined as the most recent value of each clinical measurement taken 13–18 months after the creation of the GPMP.
The analysis was carried out in three parts. First, we investigated the effect of creating a GPMP on process and clinical outcomes, irrespective of whether or not a TCA was also created. Second, we investigated the effect of creating both a GPMP and TCA. Third, we analysed the effect of reviews of GPMPs or GPMPs and TCAs, for which patients were divided into three groups based on the regularity of review:
No reviews: no GPMP or TCA reviews were performed within 13 months from creation of the GPMP.
Irregular reviews: at least one GPMP or TCA review was performed within 13 months from creation of the GPMP, but the conditions for regular reviews were not met.
Regular reviews: two or more GPMP or TCA reviews were performed within 13 months from creation of the GPMP, with the first performed at least 3 months after the GPMP, and with at least two performed more than 3 months apart.
Given the importance of glycaemic management in preventing or delaying complications of diabetes,21,22 a further analysis was carried out to compare HbA1c levels before and after a GPMP for patients whose HbA1c level before the GPMP was greater than the recommended Australian target of 53 mmol/mol.
The paired-samples t test23 was used to compare process and clinical outcomes before and after the GPMP. In analysing the effect of reviews, an additional analysis was carried out using one-way between-groups analysis of variance23 to compare outcomes among the three groups. Adjustment for multiple comparisons was made using the Tukey honestly significant difference test.24 For each test, effect size was determined by calculating eta-squared and interpreted using the guidelines proposed by Cohen (0.01 is considered a small effect, 0.06 is moderate and 0.14 is large).25 We used SPSS version 20 (SPSS Inc) for statistical analysis.
A total of 577 patients managed by 36 GPs satisfied the inclusion criteria. Characteristics of the patients are shown in the Appendix. There were 271 patients diagnosed with more than one chronic illness. The length of time since diagnosis of diabetes was unknown.
Patients with a GPMP had significant improvements in the proportion of ACOC tests completed and in total cholesterol level, LDL cholesterol level and BMI (Box 1).
For 89 patients whose HbA1c level was > 53 mmol/mol before the GPMP, there was a significant decrease in HbA1c level after the GPMP, with a large effect (mean [SD], 68.2 [16.9] v 58.8 [11.7]; t(88) = 4.7, P < 0.001). The mean decrease in HbA1c level in this group was 9.4 mmol/mol (95% CI, 5.5–13.3 mmol/mol).
For the 507 patients (87.9%) with both a GPMP and TCA, significant improvements were seen in the proportion of ACOC tests completed and in HbA1c, total cholesterol and LDL cholesterol levels and BMI (Box 2).
For 84 patients whose HbA1c level was > 53 mmol/mol before the GPMP, there was a significant decrease in HbA1c level after the GPMP, with a large effect (mean [SD], 68.7 [17.2] v 58.3 [11.5]; t(83) = 5.2, P < 0.001). The mean decrease in HbA1c level in this group was 10.4 mmol/mol (95% CI, 6.5–14.4 mmol/mol).
Of the 577 patients, 116 (20.1%) had no reviews, 270 (46.8%) had irregular reviews and 191 (33.1%) had regular reviews. Overall, 461 patients (79.9%) had their GPMP and/or TCA reviewed.
There were no significant improvements for patients with no reviews (Box 3). Patients having irregular reviews had significant improvements in the proportion of ACOC tests completed, total cholesterol level and BMI. Patients having regular reviews had significant improvements in the proportion of ACOC tests completed, HbA1c level, total and LDL cholesterol levels, and diastolic BP. The mean increase in the process outcome was 1.4 times higher for patients having regular reviews than for those having irregular reviews.
Improvements in the process outcome showed a significant difference (P < 0.05) among the three groups (F[2, 574] = 17.2, moderate effect [0.06]). Post-hoc comparisons indicated the mean change in process outcome for no reviews was significantly different from irregular reviews and regular reviews (Box 3). Improvements in HbA1c level also showed a significant difference (P < 0.05) among the three groups (F[2, 218] = 3.5, small effect [0.03]). The mean change in HbA1c level for regular reviews was significantly different from irregular reviews.
This study found improvements in process and clinical outcomes for patients for whom GPMPs or GPMPs and TCAs were created, particularly when these were followed up by GPMP or TCA reviews.
For managing diabetes, the proportion of ACOC tests completed gives an indication of quality of care.26 This measure increased by over 15% in magnitude for patients on a GPMP or GPMP and TCA. One explanation is that placing patients on a GPMP or TCA helps the GP implement best-practice guidelines and encourages the patient to adhere to these. cdmNet also reminds patients to make and attend appointments. As almost 90% of the patients in our study had both a GPMP and TCA, it was not possible to determine the effect of creating a TCA in addition to a GPMP.
Patients with a GPMP or GPMP and TCA also showed significant improvement in the clinical outcomes of HbA1c, total cholesterol and LDL cholesterol levels, and BMI, although the HbA1c measure was not significant for the GPMP group. This suggests that a GPMP alone may be insufficient to affect HbA1c levels. These improvements could be associated with the additional support, such as education on nutrition and weight management, that multidisciplinary teams provide.
GPMP and TCA reviews had a significant effect on the process outcome, with the proportion of ACOC tests completed increasing in magnitude by over 18% for patients receiving irregular reviews and 26% for those receiving regular reviews. In contrast, there was no improvement for patients who had no reviews. This important finding demonstrates how critical the follow-up and review process is for improving quality of care.
While both regular and irregular reviews were associated with improvements in clinical outcomes, improvements in key diabetes measures such as HbA1c and LDL cholesterol levels were only found in patients who had regular reviews. The improvement in HbA1c levels was statistically significantly different between patients who received irregular and regular reviews, and the magnitude of improvement was less for patients who received no reviews than for those with regular reviews. These findings reinforce the importance of GPMP and TCA reviews, especially when carried out regularly.
Another finding was the possible importance of the web-based management tool, cdmNet, in improving adherence to best-practice guidelines for chronic disease management. Patients using cdmNet were four times more likely to have their GPMP or TCA followed up through regular reviews than the national average (80% v 20%, respectively, within a 13-month period, based on the recommended frequency of three reviews for every GPMP or TCA).27
For patients with diabetes, demonstrating improvement in clinical measures of diabetes control, obesity, BP and lipid levels demonstrates not just a stabilisation of their diabetes but a reduction in their disease burden. For a single patient, small changes are not generally clinically meaningful, but in this study the averaged results of the group showed a significant and meaningful improvement.
Our study has some limitations. The patients were not randomly chosen but were prospectively assessed from among users of cdmNet. There was no control group, and possible bias and confounders could affect the outcomes. In addition, because the ACOC guidelines were not followed for all patients, data for each of the clinical outcomes were available for only about 20%–60% of participants. Therefore, the conclusions regarding clinical outcomes relate only to the subset of patients who had measurements available from both before and after the GPMP for analysis. The fact that data were not collected for many patients because of this divergence from the guidelines is an important finding and points to the need for future research to investigate the reasons for this.
This study provides an evidence base to support creating GPMPs and TCAs and conducting formal reviews at regular intervals. It indicates that the use of web-based tools for supporting collaborative care management for patients with diabetes has the potential for transformative change in best-practice care. Further analysis with a longer follow-up period would be beneficial in confirming these results. In the future, longitudinal data from cdmNet will allow extensive analyses that take patients’ disease and behavioural complexities into consideration, as well as analyses into health provider behaviour.
1 Process and clinical outcomes before and after creation of a General Practice Management Plan (GPMP)
2 Process and clinical outcomes before and after creation of a General Practice Management Plan (GPMP) for patients with a GPMP and Team Care Arrangement
3 Comparison of process and clinical outcomes before and after creation of a General Practice Management Plan (GPMP), by regularity of review
Received 6 February 2013, accepted 25 July 2013
- Leelani K Wickramasinghe1
- Peter Schattner1
- Marienne E Hibbert2
- Joanne C Enticott3
- Michael P Georgeff4,5
- Grant M Russell3
- 1 Department of General Practice, Monash University, Melbourne, VIC.
- 2 Department of Medicine, University of Melbourne, Melbourne, VIC.
- 3 Southern Academic Primary Care Research Unit, Monash University, Melbourne, VIC.
- 4 Precedence Health Care, Melbourne, VIC.
- 5 Faculty of Medicine, Nursing and Health Sciences, Monash University, Melbourne, VIC.
This work was supported by funding from the Australian Government under the Digital Regions Initiative and the Department of Health and Ageing and by the Victorian Department of Business and Innovation.
Michael Georgeff is the CEO and Marienne Hibbert is the clinical integration manager of Precedence Health Care, which developed cdmNet.
- 1. Wagner EH, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Q 1996; 74: 511-544.
- 2. Coleman K, Austin BT, Brach C, Wagner EH. Evidence on the Chronic Care Model in the new millennium. Health Aff (Millwood) 2009; 28: 75-85.
- 3. Improving Chronic Illness Care. The Chronic Care Model: delivery system design. http://www.improvingchroniccare.org/index.php?p=Delivery_System_Design&s=21 (accessed May 2012).
- 4. Dennis SM, Zwar N, Griffiths R, et al. Chronic disease management in primary care: from evidence to policy. Med J Aust 2008; 188 (8 Suppl): S53-S56. <MJA full text>
- 5. Sperl-Hillen JM, Solberg LI, Hroscikoski MC, et al. Do all components of the chronic care model contribute equally to quality improvement? Jt Comm J Qual Saf 2004; 30: 303-309.
- 6. Shojania KG, Ranji SR, McDonald KM, et al. Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA 2006; 296: 427-440.
- 7. Australian Government Department of Health and Ageing. MBS Primary Care Items. History of key MBS primary care initiatives 1999–2010. http://www.health.gov.au/internet/main/publishing.nsf/Content/mbsprimarycare-History (accessed Sep 2012).
- 8. Australian Government Department of Health and Ageing. MBS Primary Care Items. Chronic Disease Management (CDM) Medicare Items. http://www.health.gov.au/internet/main/publishing.nsf/Content/mbsprimarycare-factsheet-chronicdisease.htm (accessed Jul 2012).
- 9. Zwar NA, Hermiz O, Comino EJ, et al. Do multidisciplinary care plans result in better care for patients with type 2 diabetes? Aust Fam Physician 2007; 36: 85-89.
- 10. Zwar N, Hasan I, Hermiz O, et al. Multidisciplinary care plans and diabetes — benefits for patients with poor glycaemic control. Aust Fam Physician 2008; 37: 960-962.
- 11. Ralston JD, Hirsch IB, Hoath J, et al. Web-based collaborative care for type 2 diabetes: a pilot randomized trial. Diabetes Care 2009; 32: 234-239.
- 12. Bond GE, Burr R, Wolf FM, et al. The effects of a web-based intervention on the physical outcomes associated with diabetes among adults age 60 and older: a randomized trial. Diabetes Technol Ther 2007; 9: 52-59.
- 13. McMahon GT, Gomes HE, Hickson Hohne S, et al. Web-based care management in patients with poorly controlled diabetes. Diabetes Care 2005; 28: 1624-1629.
- 14. Shea S, Weinstock RS, Starren J, et al. A randomized trial comparing telemedicine case management with usual care in older, ethnically diverse, medically underserved patients with diabetes mellitus. J Am Med Inform Assoc 2006; 13: 40-51.
- 15. McCarrier KP, Ralston JD, Hirsch IB, et al. Web-based collaborative care for type 1 diabetes: a pilot randomized trial. Diabetes Technol Ther 2009; 11: 211-217.
- 16. Georgeff M, Piterman L, Dunning T, et al. CDM-Net: a broadband health network for transforming chronic disease management. Final report. Melbourne: Precedence Health Care, 2010.
- 17. Jones K, Dunning T, Costa B, et al. The CDM-Net Project: the development, implementation and evaluation of a broadband-based network for managing chronic disease. Int J Family Med 2012; (2012): 453450. doi: 10.1155/2012/453450.
- 18. Wickramasinghe LK, Schattner P, Enticott J, et al. Care plans for patients with type 2 diabetes: patient variables that contribute to plan formation. Primary Health Care Research Conference; 18-20 July 2012; Canberra, Australia. In: 2012 Primary Health Care Research Conference: program and abstracts. Primary Health Care Research and Information Service. http://www.phcris.org.au/conference/browse.php?id=7352 (accessed Jul 2013).
- 19. Precedence Health Care. Digital Regions Initiative: cdmNet Australia. Final report July 2009 – September 2012. http://precedence healthcare.com/site/wp-content/uploads/DRI-Final-Report-20121212.pdf (accessed Aug 2013).
- 20. Australian Government Department of Human Services. Practice Incentives Program. Diabetes incentive guidelines — July 2012. http://www.medicareaustralia.gov.au/provider/incentives/pip/files/9520-1206en.pdf (accessed Jul 2012).
- 21. The Diabetes Control and Complications Trial Research Group. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med 1993; 329: 977-986.
- 22. UK Prospective Diabetes Study (UKPDS) Group. Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). Lancet 1998; 352: 837-853.
- 23. Dekking FM, Kraaikamp C, Lopuhaa HP, Meester LE. A modern introduction to probability and statistics: understanding why and how. London: Springer Verlag, 2005.
- 24. Lowry R. Chapter 14. One-way analysis of variance for independent samples. In: Concepts and applications of inferential statistics. http://vassarstats.net/textbook (accessed Mar 2013).
- 25. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ; Lawrence Erlbaum Associates, 1988: 284-287.
- 26. Australian Institute of Health and Welfare. Annual cycle of care. http://www.aihw.gov.au/diabetes-indicators/annual-cycle-of-care (accessed May 2013).
- 27. Australian Government Department of Human Services. Medicare item reports. https://www.medicareaustralia.gov.au/statistics/mbs_item.shtml (accessed May 2013).
Abstract
Objectives: To investigate whether General Practice Management Plans (GPMPs), Team Care Arrangements (TCAs) and reviews of these improve the management and outcomes of patients with diabetes when supported by cdmNet, a web-based chronic disease management system; and to investigate adherence to the annual cycle of care (ACOC), as recommended in diabetes guidelines.
Design, participants and setting: A before-and-after study to analyse prospectively collected data on 577 patients with type 1 or 2 diabetes mellitus who were managed with a GPMP created using cdmNet between June 2008 and November 2012.
Main outcome measures: Completion of the clinical tests in the ACOC (process outcome) and values of six of these clinical measurements (clinical outcomes).
Results: Significant improvements were seen after creation of a GPMP in the proportion of ACOC clinical tests completed (57.9% v 74.8%, P < 0.001), total cholesterol level (P < 0.01), low-density lipoprotein (LDL) cholesterol level (P < 0.001) and body mass index (BMI) (P < 0.01). Patients using GPMPs and TCAs also improved their glycated haemoglobin (HbA1c) level (P < 0.05). Patients followed up with irregular reviews had significant improvements in the proportion of ACOC clinical tests completed (59.2% v 77.6%, P < 0.001), total cholesterol level (P < 0.05), and BMI (P < 0.01), but patients with regular reviews had greater improvements in the proportion of ACOC clinical tests completed (58.9% v 85.0%, P < 0.001), HbA1c level (57.7 v 53.0 mmol/mol, P < 0.05), total cholesterol level (4.8 v 4.5 mmol/L, P < 0.05), LDL cholesterol level (2.8 v 2.4 mmol/L, P < 0.01) and diastolic blood pressure (76.0 v 74.0 mmHg, P < 0.05).
Conclusion: There were significant improvements in process and clinical outcomes for patients on a GPMP or a GPMP and TCA, particularly when these were followed up by regular reviews. Patients using cdmNet were four times more likely to have their GPMP or TCA followed up through regular reviews than the national average.