Implementing change: evaluating the Accelerated Chest pain Risk Evaluation (ACRE) project

William A Parsonage, Tanya Milburn, Sarah Ashover, Wade Skoien, Jaimi H Greenslade, Louise McCormack and Louise Cullen
Med J Aust 2017; 207 (5): 201-205. || doi: 10.5694/mja16.01479
Published online: 4 September 2017


Objective: To evaluate hospital length of stay (LOS) and admission rates before and after implementation of an evidence-based, accelerated diagnostic protocol (ADP) for patients presenting to emergency departments (EDs) with chest pain.

Design: Quasi-experimental design, with interrupted time series analysis for the period October 2013 – November 2015.

Setting, participants: Adults presenting with chest pain to EDs of 16 public hospitals in Queensland.

Intervention: Implementation of the ADP by structured clinical re-design.

Main outcome measures: Primary outcome: hospital LOS. Secondary outcomes: ED LOS, hospital admission rate, proportion of patients identified as being at low risk of an acute coronary syndrome (ACS).

Results: Outcomes were recorded for 30 769 patients presenting before and 23 699 presenting after implementation of the ADP. Following implementation, 21.3% of patients were identified by the ADP as being at low risk for an ACS. Following implementation of the ADP, mean hospital LOS fell from 57.7 to 47.3 hours (rate ratio [RR], 0.82; 95% CI, 0.74–0.91) and mean ED LOS for all patients presenting with chest pain fell from 292 to 256 minutes (RR, 0.80; 95% CI, 0.72–0.89). The hospital admission rate fell from 68.3% (95% CI, 59.3–78.5%) to 54.9% (95% CI, 44.7–67.6%; P < 0.01). The estimated release in financial capacity amounted to $2.3 million as the result of reduced ED LOS and $11.2 million through fewer hospital admissions.

Conclusions: Implementing an evidence-based ADP for assessing patients with chest pain was feasible across a range of hospital types, and achieved a substantial release of health service capacity through reductions in hospital admissions and ED LOS.


The known Chest pain is among the most common primary problems with which patients present to emergency departments. Excluding acute coronary syndrome in most patients without missing cases requires a conservative approach, but places a considerable burden on service delivery. 

The new A safe, evidence-based accelerated diagnostic protocol (ADP) substantially reduced hospital admission rates and length of stay for patients presenting to emergency departments with chest pain. 

The implications Implementing ADPs for assessing chest pain, such as those described in recently revised national clinical guidelines, should be actively encouraged. Similar strategies for managing other common and resource-intensive clinical problems merit evaluation. 




Chest pain is among the most common primary problems with which patients present to emergency departments (EDs) in Australia.1 Causes of acute chest pain include pulmonary embolus and aortic dissection, but by far the most common life-threatening causes are acute coronary syndromes (ACS), which must accordingly be investigated in all patients presenting with chest pain. Minimising the risk of missing a serious condition while recognising that most patients do not have serious underlying causes for their symptoms constitutes a management dilemma for clinicians.2 Consensus guidelines have traditionally adopted a conservative approach, recommending clinical pathways that include comprehensive diagnostic assessment at the time of the initial presentation, and this often requires admitting the patient to hospital.3

The 2006 guidelines of the National Heart Foundation and the Cardiac Society of Australia and New Zealand (NHF/CSANZ) recommend stratifying patients presenting with possible ACS into low, intermediate and high risk categories.3 We have previously reported that adherence to these guidelines results in a small proportion of patients satisfying the criteria for low risk (1%), while the incidence of ACS in the intermediate risk group (62.6% of patients) is less than 2%.2 These guidelines recommend that intermediate risk patients undergo evaluation for 6–8 hours when sensitive troponin assays and other early objective testing for coronary artery disease are employed. The cost of identifying one ACS event in intermediate risk patients has recently been estimated to be $174 191, compared with $31 895 in patients with high risk features.4

Accelerated diagnostic protocols (ADPs) that can improve efficiency while maintaining patient safety have been described. The ADP based on the 2-hour Accelerated Diagnostic protocol to Assess Patients with chest pain symptoms using contemporary Troponins as the only biomarker (ADAPT) study allows identification of patients at very low short term risk (30 days) of a major adverse cardiac event who could be redefined as “low risk” after clinical risk stratification, serial troponin tests, and electrocardiography (ECG) 0 and 2 hours after presentation to the ED (Box 1).5 These patients can be discharged from the ED earlier, with further care undertaken in an ambulatory setting. The reported outcomes of implementing the ADAPT ADP at a single site indicated that the strategy translated well into clinical practice.6 Other studies have reported varying proportions of patients identified with the ADAPT ADP as being at low risk.7,8

The Accelerated Chest pain Risk Evaluation (ACRE) Project was a large scale initiative that aimed to translate the ADAPT ADP into clinical practice across Queensland public hospitals. Our aims were to assess the feasibility of applying the ADP in a broad range of acute hospital settings, to quantify changes in hospital length of stay (LOS) and admission rates, and to estimate its net cost.


All public hospitals with EDs treating adult patients and with 24-hour access to laboratory-based troponin testing were eligible for inclusion in the project. Access to pathology testing was required to ensure that clinical pathways were aligned with the core elements of the ADAPT ADP. Clinical pathways were applicable to patients with possible cardiac chest pain once other serious causes had been considered and excluded. The protocol was implemented incrementally across sites between October 2013 and September 2015, as previously described in detail.9

Data collection

Data were collected from the Emergency Department Information System (EDIS; CSC Healthcare) and the Hospital Based Corporate Information System (HBCIS) by extracting reports from the Queensland Health Enterprise Reporting Service (QHERS), stratified by study site. Pre-implementation data were collected for the 12 months prior to implementation at each hospital, using a pre-existing QHERS report to obtain all ED presentations by adults for the relevant diagnosis-related groups (online Appendix, table 1). Diagnosis codes were inclusive, to maximise the probability of capturing patients with possible cardiac chest pain while excluding patients with clearly non-cardiac causes (eg, trauma).

Post-implementation EDIS data were collected between May 2014 and November 2015. Following implementation at each site, EDIS was reprogrammed to prompt clinicians to identify patients in relevant diagnosis-related groups with chest pain who were at low risk for ACS according to the ADP (using a binary code: 1 = yes, 2 = no). After implementation, a customised QHERS report containing the same parameters as the pre-implementation report was prepared, stratified by risk group (low risk v not low risk). EDIS data were linked with HBCIS inpatient records by the Queensland Health Research Linkage Group when relevant.

Outcome measures

The primary outcome was the total hospital LOS for patients presenting to an ED with chest pain. Secondary outcome measures included hospital admission rate, ED LOS, and the proportion of patients identified by the ADP as being at low risk of an ACS within 30 days.

Data analysis

Data were analysed in Stata 14 (StataCorp). For all analyses, the pre-implementation period comprised the 12 months before implementation; the post-implementation period included all available data for 12 months after implementation. Data for two weeks immediately before and after implementation were excluded to allow for transition education and implementation. Baseline demographic data for the pre- and post-implementation groups were compared. The proportion of patients assessed with the ADP was computed. We compared mean and median LOS, and the proportions of patients admitted during the pre- and post-implementation periods. The LOS variables were overdispersed, so a negative binomial distribution was applied when calculating standard errors of the mean. Robust standard errors were calculated for all 95% confidence intervals (CIs) to account for clustering of patients within hospitals.

Interrupted time series analyses ensured that any differences in outcome variables before and after implementation of ACRE were not attributable to downward trends across the entire study period. Trends in hospital LOS were estimated by Prais–Winsten regression, which accounted for serial correlation across time, while also adjusting for clustering within hospitals. The median LOS by week was regressed on time (weeks from the beginning of data collection) to assess the linear trend prior to implementing ACRE. Time after implementation (weeks) was also entered to assess any change in the trend in LOS after implementing ACRE. Study period (pre- v post-implementation) was entered as a dichotomous variable to assess whether there was a quantitative change in LOS immediately after implementing ACRE. Clustered robust standard errors accounted for clustering within hospitals. A second regression compared trends in hospital admission rates; hospital admission was regressed on time, weeks after implementation, and study period.

Economic analysis

The cost of evaluating patients with chest pain was calculated on the basis of a previous economic analysis of the Brisbane cohort of the ADAPT study.4 Change in the cost of ED care was calculated from the number of patients, the change in mean ED LOS, and the hourly cost of ED care. Change in the cost of inpatient care was calculated from the change in the number of admissions, the mean inpatient LOS before implementation, and the hourly cost of inpatient care for chest pain.

Ethics approval

The Queensland Health Human Research Ethics Committee waived review of the study (reference, HREC/13/QGC/142) as the project was a quality activity and not recognised as research according to the definition in the National Statement on Ethical Conduct in Human Research of the National Health and Medical Research Council.


The ADP was implemented in 16 public hospitals with ED presentation numbers of 28 000–100 000 patients per year, including all major regional and large metropolitan hospitals and most major metropolitan hospitals in Queensland (online Appendix, table 2).

Data were collected from 30 770 patients prior to implementation and 23 702 patients after implementation. One patient was removed from the pre-implementation and three patients from the post-implementation period for implausible LOS figures, leaving 30 769 and 23 699 patients respectively. Baseline characteristics for the pre- and post-intervention cohorts were similar (Box 2). Post-implementation, 5041 patients (21.3%; 95% CI, 16.5–27.0%) presenting with possible cardiac chest pain were classified by the ADP as being at low risk for an ACS.

Total mean hospital LOS fell from 57.7 hours to 47.3 hours (rate ratio [RR], 0.82; 95% CI, 0.74–0.91). The mean ED LOS fell from 292 minutes to 256 minutes (RR, 0.88; 95% CI, 0.82–0.94). Median total hospital LOS fell by 6.1 hours (95% CI, 5.5–6.6 h), while median ED LOS fell by 20 minutes (95% CI, 17.9–22.1 min). The hospital admission rate fell from 68.3% pre-implementation to 54.9% post-implementation (RR, 0.80; 95% CI, 0.72–0.89) (Box 3). The outcomes for individual hospitals are listed in Box 4.

Box 5 depicts the median hospital LOS by week and Box 6 the hospital admission rates for the 12 months before and after the intervention. The regression of LOS on time and study period indicated that LOS was stable during the 12 months before implementation of ACRE (trend, –0.02 hours/week; 95% CI; –0.08 to 0.03 hours/week; P = 0.35). The median LOS declined after implementation (by 3.86 h; 95% CI, 0.27–7.45 h; P = 0.04). LOS stabilised 12 months after the start of the intervention (trend, –0.05 hours per week; 95% CI, –0.16 to 0.06 hours/week; P = 0.35). Inspection of the residuals identified one outlier, removal of which caused only minor changes to the regression coefficients; it was therefore retained in the analysis. Regression of admission on time and study period indicated that admission rates were stable prior to implementation (trend, –0.04% per week; 95% CI; –0.17% to 0.09% per week; P = 0.51). The proportion of patients admitted after ACRE was implemented declined (by 13.3 percentage points; 95% CI, 2.8–23.7 percentage points; P = 0.02), and remained stable during the 12 months after the intervention (trend, –0.04 percentage points per week; 95% CI; –0.28 to 0.36 percentage points per week; P = 0.80).

Economic analysis

The estimated released capacity resulting from the reduction in hospital admissions during the post-implementation period was $11.2 million; the estimated released capacity resulting from reducing ED LOS was $2.3 million.


We report several important findings. Firstly, implementing an ADP to identify patients at very low 30-day risk of an ACS was associated with significant reductions in ED LOS, total hospital LOS, and hospital admissions. Secondly, the implementation of the ADP was feasible across a variety of hospital types, including large metropolitan centres and smaller regional hospitals; the proportion of patients defined as low risk was comparable with that in the original observational study in which the ADP was developed. Thirdly, a widespread, sustainable change in clinical practice was achieved within 4 years of the publication of the original evidence by applying a structured program of clinician-led knowledge transfer (clinical re-design). Finally, using contemporary estimates of the cost of evaluating patients with possible cardiac chest pain, we found that a substantial release of health service capacity was achieved within 12 months of implementing the program.

Timely and safe evaluation of patients with possible cardiac chest pain is an essential service in acute care hospitals. However, a large majority of patients presenting with chest pain are at low risk of an ACS, and earlier clinical guidelines have been inefficient in identifying these individuals. We found that an efficient ADP, such as the ADAPT ADP, can substantially improve the efficiency of health service delivery without compromising patient safety. The need to increase the value of care delivered by improving or maintaining outcomes relative to expenditure is widely recognised. Health service providers face a major challenge from increased demand in an environment of constrained funding. As the total cost for implementing the ADP in all 16 hospitals was about $1.6 million, the return on investment was better than 8:1 during the first year.

Successful knowledge transfer in health service provision is difficult. Non-adherence to clinical pathways is a common problem, and the full impact of novel strategies is often diminished when translated from the research setting to clinical care.10 Reassuringly, we found that the proportion of patients defined as being at low risk was similar to that in the pilot study; two randomised controlled trials employing the ADAPT ADP have also reported that 20–30% of patients were eligible for early discharge.8,11 Further, reductions in hospital admission rates and LOS were sustained for up to 12 months after implementing the program.

When introducing a simple innovation into a complex health care environment at several sites, each with its own barriers and enablers, some heterogeneity of response is expected. A detailed consideration of the causes of such heterogeneity is beyond the scope of this article, but has been discussed previously.9 The ADP aimed to facilitate reductions in LOS and admission rates; it achieved lower admission rates at all sites, and reduced LOS at all but one of 16 sites (Box 4).

Translation of the ADAPT ADP into practice was achieved more rapidly than is often the case with more traditional approaches to change. These rely on incorporating research evidence into consensus clinical guidelines that are not always supported by local or broader health policies and programs. This time lag in translating health research into practice has been estimated to average 17 years.12 The time between publishing the ADAPT study and completing and evaluating its implementation was 4 years. Our findings should encourage those considering evidence-based ADPs, such as those described in the recently revised national clinical guidelines for managing ACS.13

One limitation of our study was that tracking clinical outcomes for individual patients was beyond the ambit of our analysis. However, the clinical pathway at all sites complied with the ADP derived from the original ADAPT study, at the time of its publication the largest observational study of chest pain evaluation in Australia and New Zealand. The sensitivity and negative predictive value of its approach to risk stratification has been validated overseas.8,14 Further, the ADAPT principle (Box 1) has subsequently been endorsed in recent revisions of clinical practice guidelines for the management of ACS in Australia, New Zealand, and Europe.13,15 Secondly, we relied on administrative datasets for hospital admissions and LOS data, which may have introduced some error that might have been excluded by a study-specific research dataset. Our results are nevertheless likely to be representative, given the importance of measures of patient flow in EDs following the introduction of National Emergency Access Targets in 2011. Thirdly, the before-and-after design of our study, without control data, means that other changes in the health care system may have influenced our findings. Finally, we relied on local clinicians to identify patients who were at low risk of ACS according to the ADP, and central adjudication of this risk stratification was not undertaken. However, implementing the ADP at each site was supported by education and site-specific documentation. The similarity of the proportions of low risk patients in the ADAPT study (20%) and this study (22%) suggest that this process was robust.


Implementing an evidence-based ADP for evaluating patients with possible cardiac chest pain through a structured program of clinical re-design was associated with a substantial release of health service capacity. This approach to reform could be applied to other high volume clinical services in order to increase the value of health care delivery.

Box 1 – Criteria for classifying a patient as being at low risk of an acute coronary syndrome, according to the ADAPT accelerated diagnostic protocol

  • Troponin I (cTnI) level at 0 and 2 h below institutional cut-off for an elevated troponin concentration
  • No new ischaemic changes on the initial electrocardiogram (ECG)
  • Thrombolysis In Myocardial Infarction (TIMI) score = 0; ie, none of the following pertain:
    • Age ≥ 65 years;
    • Three or more risk factors for coronary artery disease (family history of coronary artery disease, hypertension, hypercholesterolaemia, diabetes, current smoker);
    • Aspirin taken in the past 7 days;
    • Significant coronary stenosis (eg, documented coronary stenosis ≥ 50%);
    • Severe angina (two or more angina events in past 24 hours, or persisting discomfort);
    • ST-segment deviation of 0.05 mV on initial ECG;
    • Increased blood troponin or creatine kinase-MB levels (during assessment)

Box 2 – Baseline characteristics of pre- and post-intervention patient cohorts




Number of patients

30 769

23 699

Age (years), mean (SD)

60.6 (16.0)

58.9 (16.5)

Sex (male)

16 680 (54.2%)

12 801 (54.0%)

Triage category




263 (0.9%)

280 (1.2%)


22 709 (73.8%)

17 975 (75.8%)


7233 (23.5%)

5004 (21.1%)


562 (1.8%)

424 (1.8%)


12 (< 0.1%)

16 (0.1%)


Box 3 – Primary and secondary outcomes for pre- and post-intervention patients





Number of patients

30 769

23 699


Inpatient admission rate (95% CI)

68.3% (59.3–78.5%)

54.9% (44.7–67.6%)

< 0.01

ED length of stay (minutes), mean (95% CI)

292 (259–328)

256 (226–290)

< 0.01

ED length of stay (minutes), median (IQR)

227 (161–348)

207 (146–296)

< 0.01

Hospital length of stay (hours), mean (95% CI)

57.7 (50.3–66.1)

47.3 (42.4–52.8)

< 0.01

Hospital length of stay (hours), median (IQR)

18.7 (7.9–54.8)

12.6 (5.9–41.1)

< 0.01

CI = confidence interval; ED = emergency department; IQR = interquartile range.

Box 4 – Primary and secondary outcomes of the implementation of the ADAPT accelerated diagnostic protocol, by hospital


Number of patients

Reduction in median emergency department LOS (95% CI)

Reduction in median hospital LOS (95% CI)

Absolute reduction in admission rate (95% CI)


54 468

20 min
(17.9–22.1 min)

6.1 h
(5.5–6.6 h)




25 min
(14.2–35.8 min)

2.5 h
(0.7–4.3 h)




18 min
(8.2–27.8 min)

0.6 h
(–1.7 to 2.9 h)




–9 min
(–19.2 to 1.2 min)

1.6 h
(–0.9 to 4.2 h)




11 min
(5.8–16.2 min)

2.6 h
(1.6–3.7 h)




55 min
(22.5–87.5 min)

9.6 h
(3.0–16.2 h)




20 min
(13.1–26.9 min)

20.2 h
(18.0–22.4 h)




14 min
(–1.3 to 29.3 min)

6.9 h
(4.8–8.9 h)




62 min
(44.0–80.0 min)

10.4 h
(4.4–16.5 h)




12 min
(2.3–21.7 min)

2.1 h
(1.1–3.1 h)




30 min
(20.3–39.7 min)

1.4 h
(–0.1 to 2.8 h)




–5 min
(–19.4 to 9.4 min)

–1.8 h
(–3.5 to –0.1 h)




2 min
(–4.0 to 8.0 min)

4.4 h
(3.1–5.7 h)




39 min
(29.1–48.9 min)

4.5 h
(3.1–5.8 h)




–4 min
(–13.4 to 5.4 min)

4.5 h
(2.2–6.9 h)




31 min
(23.5–38.5 min)

8.7 h
(7.3–10.0 h)




52 min
(39.3–64.7 min)

13.7 h
(10.3–17.1 h)


CI = confidence interval; LOS = length of stay. Differences are computed with robust standard errors to adjust for patients with multiple admissions.

Box 5 – Median hospital length of stay before and after implementation of the accelerated diagnostic protocol

Box 6 – Hospital admission rates for possible cardiac chest pain before and after implementation of the accelerated diagnostic protocol

Received 4 January 2017, accepted 28 March 2017

  • William A Parsonage1,2
  • Tanya Milburn1
  • Sarah Ashover1
  • Wade Skoien1
  • Jaimi H Greenslade1,3
  • Louise McCormack1
  • Louise Cullen1,2,3

  • 1 Royal Brisbane and Women's Hospital, Brisbane, QLD
  • 2 Queensland University of Technology, Brisbane, QLD
  • 3 The University of Queensland, Brisbane, QLD



The ACRE Project was funded by the Queensland Government Department of Health. We acknowledge the support of the Healthcare Improvement Unit, Queensland Department of Health. We thank the Queensland Research Linkage Group of the Department of Health for assistance with linking data from the emergency department and inpatient datasets. We also gratefully acknowledge the contributions of former project officers Jennifer Bilesky, Jo Sippel and Vandana Bettens in the early development of the project, and the staff of the participating hospitals.

Competing interests:

No relevant disclosures.

  • 1. Australian Institute of Health and Welfare. Emergency department care 2015–16: Australian hospital statistics (AIHW Cat. No. HSE 182; Health Services Series No. 72). Canberra: AIHW, 2016.
  • 2. Cullen L, Greenslade J, Hammett CJ, et al. Comparison of three risk stratification rules for predicting patients with acute coronary syndrome presenting to an Australian emergency department. Heart Lung Circ 2013; 22: 844-851.
  • 3. Aroney CN, Aylward P, Kelly A, et al. Guidelines for the management of acute coronary syndromes. Med J Aust 2006; 184 (8 Suppl): S1-S29. <MJA full text>
  • 4. Cullen L, Greenslade J, Merollini K, et al. Cost and outcomes of assessing patients with chest pain in an Australian emergency department. Med J Aust 2015; 202: 427-432. <MJA full text>
  • 5. Than M, Cullen L, Aldous S, et al. A 2-hour accelerated diagnostic protocol to assess patients with chest pain symptoms using contemporary troponins as the only biomarker (ADAPT). J Am Coll Cardiol 2012; 59: 2091-2098.
  • 6. George T, Ashover S, Cullen L, et al. Introduction of an accelerated diagnostic protocol in the assessment of emergency department patients with possible acute coronary syndrome: the Nambour Short Low-Intermediate Chest pain project. Emerg Med Australas 2013; 25: 340-344.
  • 7. Mahler SA, Miller CD, Litt HI, et al. Performance of the 2-hour accelerated diagnostic protocol within the American College of Radiology Imaging Network PA 4005 cohort. Acad Emerg Med 2015; 22: 452-460.
  • 8. Than M, Pickering J, Aldous S, et al. Effectiveness of EDACS versus ADAPT accelerated diagnostic pathways for chest pain: a pragmatic randomized controlled trial embedded within practice. Ann Emerg Med 2016; 68: 93-102.
  • 9. Skoien W, Page K, Parsonage W, et al. Use of the theoretical domains framework to evaluate factors driving successful implementation of the Accelerated Chest pain Risk Evaluation (ACRE) project. Implement Sci 2016; 11: 136.
  • 10. Mahler SA, Riley RF, Hiestand BC, et al. The HEART Pathway randomized trial: identifying emergency department patients with acute chest pain for early discharge. Circ Cardiovasc Qual Outcomes 2015; 8: 195-203.
  • 11. Mahler SA, Miller CD, Litt HI, et al. Performance of the 2-hour Accelerated Diagnostic Protocol within the American College of Radiology Imaging Network PA 4005 cohort. Acad Emerg Med 2015; 22: 452-460.
  • 12. Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med 2011; 104: 510-520.
  • 13. Chew DP, Scott IA, Cullen L, et al. National Heart Foundation of Australia and Cardiac Society of Australia and New Zealand: Australian clinical guidelines for the management of acute coronary syndromes 2016. Med J Aust 2016; 205: 128-133. <MJA full text>
  • 14. Fanaroff AC, Schulteis RD, Pieper KS, et al. Simplified predictive instrument to rule out acute coronary syndromes in a high-risk population. J Am Heart Assoc 2015; 4: e002351.
  • 15. Roffi M, Patrono C, Collet JP, et al. Task Force for the Management of Acute Coronary Syndromes in Patients Presenting without Persistent ST-Segment Elevation of the European Society of Cardiology (ESC). 2015 ESC guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation. Eur Heart J 2016; 37: 267-315.


remove_circle_outline Delete Author
add_circle_outline Add Author

Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

Responses are now closed for this article.