Connect
MJA
MJA

A multifaceted health-service intervention in remote Aboriginal communities: 3-year follow-up of the impact on diabetes care

Ross S Bailie, Damin Si, Samantha J Togni, Gary W Robinson and Peter H N d’Abbs
Med J Aust 2004; 181 (4): 195-200. || doi: 10.5694/j.1326-5377.2004.tb06235.x
Published online: 16 August 2004

Abstract

Objective: To examine the trends in processes of diabetes care and in participant outcomes after an intervention in two remote regions of Australia.

Design: Follow-up study over 3 years.

Setting: Seven health centres in the Tiwi Islands and the Katherine West region of the Northern Territory.

Participants: 137 Aboriginal people with type 2 diabetes.

Intervention: Implementation of a multifaceted trial, including transfer of purchasing and planning responsibility to local health boards, the development and dissemination of clinical guidelines supported by electronic registers, recall and reminder systems and associated staff training, and audit and feedback.

Main outcome measures: Trends in the proportion of Aboriginal people receiving services in accordance with clinical guidelines and in the proportion for whom specified levels of blood pressure and glycosylated haemoglobin (HbA1c) were achieved; health staff perceptions of barriers to effective service delivery.

Results: An initial improvement in overall service levels from 40% to 49% was not fully sustained over the 3-year period. The overall proportion of services delivered varied from 22% to 64% between communities and over time. The proportion of participants whose most recent HbA1c level was less than 7% improved from 19% to 32%, but there was little change in blood pressure control. Perceived barriers to service delivery included discontinuities in staffing, lack of work-practice support and patients’ acceptance of services.

Conclusions: Multifaceted interventions can improve quality of care in this environment, but achieving sustainable, high-quality care in a range of services and local conditions presents particular challenges. Developing and testing strategies for consistent and sustained improvement should be a priority for service providers and researchers.

Indigenous Australians experience both high rates1 and early age of onset2 of type 2 diabetes. Interventions to improve the medical management of diabetes in primary care have been shown to improve process and outcomes of care.3 However, there is limited research on the long-term effectiveness of such interventions,4 or on the impact of broader healthcare system reforms on specific aspects of care. Recent health reform initiatives — the “coordinated care trials” (CCTs) — in two remote regions of the Northern Territory aimed to enhance governance and funding arrangements. A health board was established in each region with the responsibility for planning and purchasing a wide range of healthcare services for the population, and government funds were transferred to these health boards.5,6 Improved coordination of care for chronic illness was also a major aim of the trials, with the implementation of locally developed clinical-practice guidelines supported by an electronic-care planning, recall and reminder system.7

We report on changes in levels of compliance with diabetes-care guidelines, processes of care, and participant outcome measures before and after implementation of the multifaceted health-service intervention.

Methods
Study setting and population

The trial was conducted in two remote regions of the Northern Territory which differ significantly — the Tiwi Islands and the Katherine West region (Box 1). The Tiwi Islands cover 7900 km2 and are located about 60 km north of Darwin. An estimated 90% of the population of 2000 are Aboriginal.6 The two islands contain three main communities and a number of smaller settlements. The Katherine West region covers 162 000 km2 and includes several large Aboriginal communities and smaller outstations, a number of cattle stations, and a small township. The southernmost community is about 890 km from Darwin. About 85% of the regional population of 2800–3000 are Aboriginal, drawn from 10 language groups.5 By Australian standards, the health and socioeconomic profiles of both regions are very poor.

The nature of the intervention meant that everyone using the healthcare services in these regions was subject to the intervention. Signed consent was required from individuals to use their health records for trial evaluation purposes. At the end of the first, intensive recruitment phase of the trial, 1205 people in the Tiwi Islands (about 60% of the population) and 1340 people in the Katherine West region (about 45% of the population) had provided consent. The study was approved by the local formally constituted ethics committee in accordance with National Health and Medical Research Council guidelines.

Intervention

The clinical guidelines, electronic systems to support the guidelines, and associated staff training were introduced progressively, starting in late 1998. Three aspects of the intervention and associated evaluation were expected to directly affect clinical practice. Firstly, each health centre received a comprehensive set of evidence-based clinical guidelines, including specific guidelines on diabetes management.7 Services and service intervals specified in the guidelines are shown in Box 2 (columns 1 and 2).

Secondly, the guidelines were incorporated into a computerised information system, which was installed in all participating community health centres. The system provided the facility for scheduling guideline services for individual participants, for identification of people due for scheduled services, and reminders to clinicians. Two non-Indigenous health department staff were engaged to visit the health centres to train health centre staff in using the software packages.

Thirdly, a “clinical audit cycle”8 was implemented, with audits conducted at baseline, and 6, 12, 24 and 36 months after commencement of the trials. Findings from the audits were fed back to, and their interpretation discussed with, health centre clinicians and managers. This usually occurred within a few months of each audit, and within a timeframe which allowed a response to feedback to influence the next audit.

Statistical analyses

Multilevel analysis9 was conducted with the participant and the health centre defined as Level 1 and Level 2 units, respectively. The regression coefficient of the time variable (value of 0, 0.5, 1, 2, 3 for each audit respectively) was used to indicate the average magnitude of improvement in delivery of scheduled services per year from baseline, with the associated P value indicating a significant increasing or decreasing trend in delivery of services from year to year across the full period of follow-up.

A logistic (random-effects) model was used for the dichotomous outcome for each process outcome and participant outcome in terms of, for example, the percentage of the sample with “controlled blood pressure” and “controlled glycaemia”. A linear randomeffects model was used for participant-based continuous outcome measures (systolic and diastolic blood pressure and HbA1c levels). Separate analyses were conducted for each community. Mean values for the continuous outcome measures (and associated confidence intervals), where appropriate, were also calculated. All multilevel analyses were performed using Stata version 7.010 (commands xtlogit and xtreg with defined iis for Level 2 and tis for Level 1 identifiers).

Results
Trends in service delivery

During the first 6 months of the intervention, there was little change in the percentage of overall delivered services (40% to 39%). This was followed by a significant improvement at Year 1 (49%), with subsequent decline in Years 2 and 3 to close to baseline (44% in each year). There was no significant linear trend across the full study period (P for trend, 0.16). This pattern was the same for male and female participants. There was a significant increase in the proportion of people in the sample taking oral hypoglycaemic agents (75% at baseline to 79% at Year 3; P for trend, 0.001), insulin (4.4% to 6.8%; P for trend, 0.001), and angiotensin-converting enzyme (ACE) inhibitors (70.8% to 83.6%; P for trend, 0.0001).

There were wide variations in the trends for specific services over the study period (Box 2). Delivery of almost all services in the categories of clinical examination, laboratory investigation and vaccination increased significantly.

Delivery of most services relating to basic measurements tended to decrease. Delivery of counselling about diet, activity, weight, smoking, alcohol and medication fluctuated from baseline to Year 2, but declined substantially at Year 3. Rates of delivery of services that were being delivered at low levels at baseline tended to improve across the study period, while those being delivered at higher levels at baseline tended to decline.

Trends in service delivery varied between communities (Box 3). In all three Tiwi communities there was an increasing trend to Years 1 and 2, followed by a decline to Year 3. In two of these communities, the overall increasing trend was statistically significant. In Katherine West there was more variation between communities. A striking feature of the patterns was the sharp decline in two communities between Year 1 and Year 2. For one of these communities, the overall trend was a statistically significant decline.

Participant outcomes

There were no statistically significant trends in the mean systolic or mean diastolic blood pressures, or in the proportion of participants in whom targeted levels of blood pressure control were achieved across the study period (Box 4). There was also no statistically significant trend in mean HbA1c level or in the proportion of participants with HbA1c level < 8%. However, the proportion in whom a target HbA1c level < 7% was achieved increased significantly from 19% at baseline to 32% at Year 3.

Interviews with health centre staff and health service managers identified that the following factors were the main barriers to delivering and sustaining best-practice chronic disease care:

  • discontinuities in staffing;

  • lack of ongoing training and support for the care coordination process;

  • lack of development of relevant work practices;

  • lack of capacity to monitor service activity through timely analysis of service data; and

  • reluctance on the part of patients to accept offered services when presenting for acute, non-scheduled services.

Discussion

An initial improvement in overall service delivery after implementation of the health services intervention was not sustained over 3 years of follow-up. There was significant variation in trends between different services and between different communities. Importantly, the increase in monitoring of HbA1c level and use of hypoglycaemic agents and insulin was associated with an increase in the proportion of participants achieving HbA1c level < 7%. Monitoring of blood pressure declined, but there was little change in blood-pressure control. Our qualitative findings suggest that there are difficulties in maintaining systems designed to improve practice, as well as in ensuring that health staff continue to respond to these systems.

Political constraints and the extent of health service reforms implemented through the CCTs precluded a randomised study, leaving a time-series design as the best alternative.12 The inclusion of several communities over an extended period before and after the intervention enhanced validity and generalisability. However, relatively low rates of consent, particularly in Katherine West, mean that the possibility of bias in the estimates of the level of service delivery cannot be excluded. Comparison between regions and generalisability of the findings to other populations should be made with caution.

A more focused diabetes intervention in the Torres Strait reported greater positive impacts on processes of care, intermediate outcomes and diabetes-related admissions.13 In contrast, the diffusion of energy across the broad reform agenda of the CCTs may have limited the potential for sustained impact on a specific condition such as diabetes, which, in the context of these trials, was used as an indicator of expected impact on chronic illness care more generally. Nevertheless, the importance of the design and implementation of focused interventions is highlighted by the failure to sustain improvement in blood-pressure control in a specialised treatment program in the Tiwi Islands after integration of the program into routine services.14,15

The failure to demonstrate sustained impacts on a number of aspects of diabetes care should be considered in the context of high levels of care relative to national16 and international17 reports. It should also be considered in the context of the environment in which the trials took place, which is characterised by heavy burdens of chronic and acute illness, pervasive social disadvantage and geographic isolation. At the same time, evaluations of the trials themselves demonstrated that the trials have contributed to increased resources for healthcare services in both the Tiwi Islands and Katherine West regions, and have focused commitment on the part of local health services to prevention and management of chronic disease.18 A priority in chronic illness care is for policymakers and researchers to develop and test strategies to sustain improvements in care within the context of enhanced community control. Local challenges for achieving sustained improvement and possible strategies for overcoming these challenges identified through this research (Box 5) complement and are consistent with international models for improving chronic illness care.19,20

2 Proportion of scheduled services delivered to participants with diabetes (%)*

Scheduled frequency (months)

Percentage of services delivered


Scheduled services

Baseline (n = 137)

Month 6  (n = 137)

Year 1  (n = 133)

Year 2  (n = 123)

Year 3  (n = 146)

  Odds ratio  
(95% CI)

P for trend


Basic measurements

Weight

3

77

72

70

59

51

0.64 (0.55–0.75)

< 0.001

Blood pressure

3

88

80

81

76

76

0.80 (0.67–0.95)

0.01

Waist circumference

3

34

34

40

42

32

0.97 (0.84–1.13)

0.74

Body mass index

6

29

25

19

27

28

1.02 (0.86–1.20)

0.86

Blood glucose (test strip)

3

85

79

73

70

71

0.78 (0.66–0.91)

0.002

Urine dipstick testing

6

63

60

62

42

45

0.73 (0.63–0.84)

< 0.001

Clinical examinations

Heart auscultation

6

22

31

12

15

12

0.69 (0.57–0.85)

< 0.001

Peripheral pulses

6

9

31

34

17

33

1.24 (1.05–1.45)

0.009

Visual acuity

6

31

37

56

49

57 (145)§

1.38 (1.19–1.60)

< 0.001

Cataracts

6

28

34

47

46

52 (145)§

1.36 (1.18–1.58)

< 0.001

Optic fundi

6

29

39

49

46

56 (145)§

1.38 (1.19–1.60)

< 0.001

Feet: sensation

6

8

18

40

27

38

1.58 (1.34–1.86)

< 0.001

Feet: reflexes

6

4

6

28

24

19

1.49 (1.23–1.80)

< 0.001

Feet: pressure areas

6

6

7

33

23

27

1.61 (1.34–1.93)

< 0.001

Feet: infection

3

17

9

37

22

29

1.30 (1.10–1.54)

0.002

Ophthalmologist

24

39

39

59

53

67 (145)§

1.45 (1.25–1.68)

< 0.001

Vaccinations

Pneumococcal

60

74 (69)

91

91

1.77 (1.14–2.74)

0.01

Influenza

12

71 (69)

84

81

1.07 (0.74–1.53)

0.73

Counselling/inquiry**

History of personal or family illness

3

74

31

50

33

1

0.35 (0.28–0.42)

< 0.001

Diet

3

45

37

56

41

27

0.79 (0.68–0.92)

0.002

Activity

3

29

31

41

31

19

0.80 (0.68–0.95)

0.01

Weight loss

3

23

18

21

28

4

0.70 (0.57–0.86)

0.001

Smoking

3

31

29

39

30

24

0.85 (0.71–1.01)

0.06

Alcohol

3

34

26

38

30

18

0.75 (0.63–0.89)

0.001

Vaccinations††

6

44

65

67 (64)††

††

††

2.43 (1.25–4.71)

0.009

Diabetes control and medications

6

73

65

71

71

48

0.74 (0.64–0.86)

< 0.001

Investigations

Albumin to creatinine ratio

6

53

46

65

46

50

0.92 (0.80–1.07)

0.29

Urea level

6

53

54

61

57

69

1.22 (1.06–1.42)

0.007

Creatinine level

6

57

56

61

58

69

1.15 (0.99–1.33)

0.07

HbA1c level

3

56

58

62

56

70

1.16 (1.00–1.35)

0.04

Fasting lipid levels

6

16

27

41

42

52

1.65 (1.42–1.93)

< 0.001


* Proportions were calculated using n as denominator, unless otherwise indicated by an alternative denominator shown in parentheses. † Odds ratios represent the average changing of probability for the delivery of each service with the increase of one unit of time (1 year), using two-level logistic random-effect model. ‡ P values significant at the 0.05 level are shown in bold. § Clinical examinations of visual acuity, cataracts and optic fundi, and ophthalmologist examination were not applicable to one participant who was blind. Records of providing pneumococcal and influenza vaccines were considered as evidence for vaccinations at Year 2 and Year 3 audits; these audits were introduced at Year 1 in Katherine West. ** Counselling/inquiry refers to a record of discussion of, or inquiry about, significant personal or family history of, for example, illness, dietary habits, physical activity. †† Audits of counselling/inquiries about vaccinations were replaced by audits of vaccination records at Year 1 in Katherine West and at Year 2 and Year 3 elsewhere.

5 Some challenges and strategies for sustaining improvement in chronic illness care

Challenge: The local impact of clinical interventions is likely to be mediated by an array of contextual factors, including governance arrangements, remoteness, staffing issues, and quality of transportation and communications infrastructure.

Strategy: Tailor strategies to address local mediating factors. Overarching strategies include:

  • providing strong systemic support from central agencies to buffer the effects of mediating factors on regional and local organisations;

  • providing transparent work-practice systems backed by written protocols and manuals and appropriate staffing and training policies at regional and local levels; and

  • recognising local knowledge and interest and using this to address local problems.

Challenge: A range of practitioner types (eg, general practitioners, registered nurses and Aboriginal health workers) are involved in delivery of care. Specific interventions may reach some categories of health staff more effectively than others.

Strategy: Operationalise care processes through development of work practices; delineate roles and practices for all practitioner types and support these with appropriate aids and specific in-service training.

Challenge: People may be unwilling to take up health services even when they are offered, limiting the intensification of care.

Strategy: Raise awareness in communities of appropriate care through developing and implementing education and health-promotion strategies with strong local participation.

Challenge: Response to demands for acute care may interfere with effective chronic illness care.

Strategy: Provide sustained institutional support and protected staff time for core chronic illness care functions. Develop acute-care processes to maximise potential for opportunistic chronic illness care.

  • Ross S Bailie1
  • Damin Si2
  • Samantha J Togni3
  • Gary W Robinson4
  • Peter H N d’Abbs5

  • 1 Menzies School of Health Research; Institute of Advanced Studies, Charles Darwin University, Darwin, NT.
  • 2 School of Humanities, Social Sciences and Management, Charles Darwin University, Darwin, NT.
  • 3 School of Public Health and Tropical Medicine, James Cook University, Cairns, QLD.


Correspondence: 

Acknowledgements: 

We would like to acknowledge the assistance of the Health Boards and staff of the health centres where the study was conducted. We also gratefully acknowledge the constructive comments of five anonymous reviewers. The article is based on work conducted for evaluations of the Coordinated Care Trials. These evaluations were funded by the Australian Department of Health and Ageing.

Competing interests:

R B, G R, S T and P d’A have conducted contract evaluations and follow-up studies of the Coordinated Care Trials on behalf of the local Health Boards of Katherine West and the Tiwi Islands. The funders of the evaluations on which this work is based had no influence on the preparation of the manuscript or the decision to publish.

  • 1. Zimmet P, Alberti KGMM, Shaw J. Global and societal implications of the diabetes epidemic. Nature 2001; 414: 782-787.
  • 2. O’Dea K, Patel M, Kubisch D, et al. Obesity, diabetes, and hyperlipidemia in a central Australian aboriginal community with a long history of acculturation. Diabetes Care 1993; 16: 1004-1010.
  • 3. Renders CM, Valk GD, Griffin SJ, et al. Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review. Diabetes Care 2001; 24: 1821-1833.
  • 4. Renders CM, Valk GD, Franse LV, et al. Long-term effectiveness of a quality improvement program for patients with type 2 diabetes in general practice. Diabetes Care 2001; 24: 1365-1370.
  • 5. d’Abbs PH, Togni SJ. Jirntangku Miyrta Katherine West Coordinated Care Trial final report. Darwin: Menzies School of Health Research, 2000.
  • 6. Robinson G, Bailie R. Tiwi Coordinated Care Trial final local evaluation report. Volumes 1 and 2. Darwin: NTU Centre for Social Research, 2000.
  • 7. Weeramanthri T, Connors C, O’Leary S, et al. Chronic disease guidelines and the indigenous Coordinated Care Trials. Aust Health Rev 2002; 25: 1-6.
  • 8. National Institute of Clinical Excellence, National Health Service, UK. Principles for best practice in clinical audit. Available at: http://www.nice.org.uk/page.aspx?o=202257 (accessed April 2004).
  • 9. Goldstein H. Multilevel statistical models. London: Hodder Arnold, 2003.
  • 10. StataCorp. Stata statistical software: Release 7.0. College Station, Texas: StataCorp, 2001.
  • 11. Robinson G, d’Abbs PH, Togni SJ, Bailie R. Aboriginal participation in health service delivery: coordinated care trials in the Northern Territory of Australia. Int J Healthcare Technology Management 2003; 5: 45-62.
  • 12. Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin Company, 2002.
  • 13. McDermott R, Tulip F, Schmidt B, Sinha A. Sustaining better diabetes care in remote indigenous Australian communities. BMJ 2003; 327: 428-430.
  • 14. Hoy WE, Baker PR, Kelly AM, Wang Z. Reducing premature death and renal failure in Australian Aboriginals. A community-based cardiovascular and renal protective program. Med J Aust 2000; 172: 473-478. <MJA full text>
  • 15. Robinson G, Bailie R, Wang Z, Snelling P, et al. A follow-up study of outcomes of the Tiwi Renal Treatment Program, Darwin: Northern Territory University, 2003.
  • 16. Australian Institute of Health and Welfare. Diabetes: Australian facts 2002. AIHW Cat. No. CVD 20 (Diabetes Series No. 3). Canberra: AIHW, 2002.
  • 17. US Department of Health and Human Services, Agency for Healthcare Research and Quality. National healthcare quality report December 2003. Available at: www.qualitytools.ahrq.gov/qualityreport/documents/quality_report.pdf (accessed Jan 2004).
  • 18. KPMG. The Aboriginal and Torres Strait Islander Coordinated Care Trials national evaluation report. Volume 1. Main report. Canberra: Commonwealth Department of Health and Aged Care, 2001.
  • 19. Wagner EH, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Q 1996; 74: 511-544.
  • 20. Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA 2002; 288: 1775-1779.

Author

remove_circle_outline Delete Author
add_circle_outline Add Author

Comment
Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

Online responses are no longer available. Please refer to our instructions for authors page for more information.