Trauma care verification relies on benchmarking, and it has recently moved towards verification of trauma systems rather than individual centres
Traumatic injuries are a leading cause of mortality, and can be challenging to treat, particularly in situations of polytrauma.1 In Australia, traumatic injuries resulted in 532500 hospitalisations in 2017– 2018, and in 2015, they accounted for 7% of long term health conditions and were responsible for $8.9 billion of health expenditure.2 Initiatives to improve trauma care quality can be delineated into clinician-led activities, such as morbidity and mortality meetings, and organisational initiatives, such as benchmarking.3,4 Across Australia and New Zealand (Aotearoa), key organisational quality improvement initiatives include the Australia New Zealand Trauma Registry (ATR) and the Australian and New Zealand Trauma Care Verification Program (TCVP). This perspective aims to highlight the utilisation, barriers, facilitators and future directions of the ATR and the TCVP. Data were derived from a systematic search of PubMed (13 April 2021), and the expert opinion of a working group of trauma professionals (CSP, GC, MCR, RO, ZJB) was used to develop the novel quality indicators suitable for the Australian and New Zealand practice that are proposed.
Trauma care verification in Australia and New Zealand
The TCVP is an important quality improvement initiative led by Royal Australasian College of Surgeons (RACS), with active participation from the Australasian College for Emergency Medicine, the Australian and New Zealand College of Anaesthetists, the College of Intensive Care Medicine of Australia and New Zealand, and the Australasian Trauma Society. It is a peer review‐based benchmarking process (Box 1) and participation is voluntary. To date, 40 sites have undergone verification, including the entire New Zealand trauma system (Box 2). The New South Wales Institute of Trauma and Injury Management recommended that all trauma services in the state undergo verification every 5 years,5 a position strongly supported by the RACS.
Trauma care verification relies on benchmarking, a process designed to improve care via the standardisation of clinical and administrative processes (Box 1).6 Trauma care verification in Australia and New Zealand benchmarks centres in accordance with the model resource criteria,7 and is a three‐stage process consisting of a pre‐review questionnaire, site visit, and the provision of feedback.8,9 The pre‐review questionnaire is designed to appraise the institution’s trauma service in accordance with the model resource criteria and identify areas of focus for the site visit. It is ideally sent to the institution 6 months before the visit.9 The site visit is performed by a multidisciplinary team of trauma experts over 2 days. Case notes, guidelines and protocols are reviewed, and a tour following the path of the severely injured patient is performed.7 After the visit, a report is generated identifying the strengths, weakness and recommendations for improvement; this report is disseminated to hospital administrators and trauma service leaders about 3 months after the site visit.9 Recently, trauma verification has moved towards verification of trauma systems rather than individual centres.10 This is particularly relevant for geographically challenging countries such as Australia and New Zealand which also have a wide range of socio‐economic settings, and where time to definitive care may be impeded by distance and resources, making coordinated, system‐wide care crucial.11
Effectiveness of trauma care verification
In an analysis of 109 American hospitals, verified level I trauma centres had lower mortality and complications and shorter intensive care unit and hospital stays compared with unverified centres.12 Verified centres were also more likely to comply with published guidelines.13 Trauma care verification also resulted in cost savings and greater investment in adjunct care.14 Following the implementation of several recommendations by the Trauma Care Verification Subcommittee when reviewing New Zealand, greater research support and funding was provided for the New Zealand Trauma Registry.8 Despite recent promising evidence, a meta‐analysis evaluating the effectiveness of trauma care verification noted limited generalisability of findings.13 The included studies were also exclusively performed in the United States and reflect the American College of Surgeons verification process. There is a need to conduct research evaluating trauma care verification in Australia and New Zealand, given the countries’ unique geographic, socio‐economic and health care system considerations.
The Australia New Zealand Trauma Registry
The ATR was established in 2011 under the Australian Trauma Quality Improvement Program and currently collects data from 34 sites across Australia and New Zealand.15 The registry captures data from severely injured patients or patients who died following injury who were admitted to participating sites. It uses an agreed Bi‐National Trauma Minimum Dataset,16 which was developed to standardise trauma monitoring, facilitate international comparisons, and enable benchmarking of trauma systems in Australia and New Zealand.17 The ATR is committed to supporting hospitals in their quality improvement efforts. To achieve this, trauma centres are encouraged to submit complete data to the ATR to facilitate further research.
Contributing to national research is an essential criterion in the TCVP for level I trauma centres. However, institutions face many barriers when collecting and recording data; examples include a lack of funding and resources and an inability to capture pre‐hospital and post‐discharge data.18 Further, ten of the 67 fields lack comparability with international datasets, reducing comparisons and benchmarking to international standards.17 Clinicians want the ATR to capture additional patient outcomes, such as quality of life and long term function; data from patients with minor traumatic injuries; pre‐hospital and post‐discharge information; and data from non‐major trauma centres.18,19
Quality indicators
Quality indicators are evidence‐based metrics evaluating the quality of health care processes that influence patient outcomes.20 They facilitate the tracking and comparison of clinical performance with the purpose of identifying potential improvements and are routinely used for internal and external benchmarking. However, developing quality indicators for trauma care is challenging due to case heterogeneity. Many existing quality indicators are also limited in their utility as they are not evidence‐based and do not accurately identify process problems or capture the incremental improvements of modern quality improvement initiatives.21 There is a need to identify and incorporate new quality indicators of trauma management which may more accurately reflect clinical care performance. Ideally, new quality indicators should encompass structural, process and outcome elements of care, as reflected in Donabedian’s health care quality framework.22
There have been several attempts to develop standardised trauma care quality indicators internationally. A 2021 systematic review proposed a core set of 82 trauma quality indicators following international expert consensus.23 A 2020 evaluation identified 13 indicators from the German Trauma Register using a systematic review and input from a working group of trauma experts.24 The RACS Trauma Quality Improvement Subcommittee developed and defined eight binational process indicators to allow cross‐comparison and benchmarking of trauma care between sites and jurisdictions in Australia and New Zealand.15 The RACS model resource criteria require collection and reporting of all eight indicators by level I and II trauma centres.7 The identified indicators are mostly process and in‐hospital indicators. The bias towards these may relate to the ease of measurement and the perceived importance of in‐hospital care over pre‐hospital and post‐discharge care.23
Proposal for novel quality indicators
Following discussion of the above systematic search of the international literature, a working group of trauma professionals (CSP, GC, MCR, RO, ZJB) developed 31 novel indicators for Australia and New Zealand trauma care (Box 3). These are not ranked in any particular order. Optimising anaesthetist and emergency medicine physician coverage in trauma centres will also benefit patients. The specific indicators were selected via a synthesis of literature review and expert opinion, and encompass a range of structural, process and outcome elements as per Donabedian’s health care quality framework,22 with time to interventions being a common theme among process indicators. This approach was used to enhance local and international applicability across trauma services, settings or resources. This may lead to increased adoption of the schema by trauma centres and to increased compliance with the quality indicators, without additional dedicated funding. However, they require validation to ensure optimal reliability and ideally, validation and cost–benefit analyses of the individual indicators. A key requirement of this validation assessment will be to ensure that, for those indicators that measure only certain aspects of global trauma system performance, the indicator goal correlates with improved patient outcomes. Importantly, several proposed indicators are already captured by the ATR and could thus be readily investigated. If the remaining indicators are valid and correlate with clinical improvement, the ATR should consider expanding their dataset to assess additional elements of care.
Future directions
A recent survey of trauma professionals in Australia and New Zealand highlighted that trauma registries are underutilised.19 The recent agreement between the RACS, the NSW Agency for Clinical Innovation Institute of Trauma and Injury Management and the NSW State Insurance Regulatory Authority to verify all trauma centres in NSW, including regional centres, is a timely opportunity to generate Australian‐specific evidence. If trauma verification proves efficacious in NSW, it should serve as encouragement to the remaining jurisdictions to undertake the process. The ATR can potentially assist in the development of evidence‐based guidelines and policy and perform benchmarking and case reviews. Further, the ATR could link with other databases to track the long term outcomes.
Participation in quality improvement initiatives such as trauma verification and the ATR should be encouraged through additional government funding and policy support. Further research validating the 31 proposed quality indicators relevant to Australia and New Zealand trauma care is needed to determine their utility in practice.
Provenance: Not commissioned; externally peer reviewed.
Box 1 – Levels of trauma services with descriptors of trauma care provided7
Trauma service level |
Description of services provided |
||||||||||||||
|
|||||||||||||||
Level I |
|
||||||||||||||
Level II |
|
||||||||||||||
Level III |
|
||||||||||||||
Level IV |
|
||||||||||||||
|
|||||||||||||||
|
Box 2 – Map of trauma care verification sites in Australia and New Zealand (Aotearoa)
Source: Figure reproduced with permission from the Trauma Care Verification and Quality Improvement Writing Group, Royal Australasian College of Surgeons.
Box 3 – Proposed quality indicators for measuring quality of trauma care in Australia and New Zealand (Aotearoa)*
Category and subcategory |
Quality indicator |
Data can be obtained/calculated from the ATR |
|||||||||||||
|
|||||||||||||||
Structure |
|
|
|||||||||||||
In‐hospital |
Blood alcohol screen within 6 hours |
Yes |
|||||||||||||
|
Massive transfusion protocol |
Yes |
|||||||||||||
|
Complete basic diagnostics available |
No |
|||||||||||||
|
24‐Hour on‐site surgeon |
No |
|||||||||||||
|
Trauma team activation |
No |
|||||||||||||
|
Rate of organ donation |
No |
|||||||||||||
Pre‐hospital |
Pre‐hospital time |
Yes |
|||||||||||||
|
Pre‐hospital airway management in unconscious patient |
Yes |
|||||||||||||
|
Pelvic binder in pelvic fracture |
No |
|||||||||||||
Process |
|
|
|||||||||||||
In‐hospital |
Time in first facility if transferred |
Yes |
|||||||||||||
|
Time to CT |
Yes |
|||||||||||||
|
Time to first surgical intervention |
Yes |
|||||||||||||
|
CO2 monitoring in intubated patients |
No |
|||||||||||||
|
Time to first emergency surgery |
Yes |
|||||||||||||
|
Time to craniotomy for severe TBI |
Yes |
|||||||||||||
|
Time to surgery for haemorrhage control |
Yes |
|||||||||||||
|
Time to soft tissue coverage of open tibia fractures |
Yes |
|||||||||||||
|
Time to debridement and skeletal stabilisation of open long bone fractures |
Yes |
|||||||||||||
|
Time to blood and products in shocked patients |
No |
|||||||||||||
|
Time to rehabilitation from referral |
Yes |
|||||||||||||
|
Discharge destination |
Yes |
|||||||||||||
Outcome |
|
|
|||||||||||||
In‐hospital |
Incidence of nosocomial infection |
No |
|||||||||||||
|
Pulmonary embolism, venous thromboembolism |
Partial |
|||||||||||||
|
Length of emergency department stay |
Yes |
|||||||||||||
|
Length of ICU stay |
Yes |
|||||||||||||
|
Length of hospital stay |
Yes |
|||||||||||||
|
Unplanned ICU readmission |
No |
|||||||||||||
|
Unplanned return to operating room |
No |
|||||||||||||
|
Unplanned hospital readmission rate related to the index trauma |
No |
|||||||||||||
|
Mortality |
Yes |
|||||||||||||
After discharge |
Functional outcome at time of discharge and at 6 months after injury |
No |
|||||||||||||
|
|||||||||||||||
ATR = Australia New Zealand Trauma Registry; CO2 = carbon dioxide; CT = computed tomography; ICU = intensive care unit; TBI = traumatic brain injury. * The proposed quality indicators for Australia and New Zealand were selected by a working group of trauma professionals (CSP, GC, MCR, RO, ZJB). |
- 1. Pape HC, Lefering R, Butcher N, et al. The definition of polytrauma revisited: an international consensus process and proposal of the new “Berlin definition”. J Trauma Acute Care Surg 2014; 77: 780‐786.
- 2. Australian Institute of Health and Welfare. Injury in Australia [website]. https://www.aihw.gov.au/reports/australias‐health/injury (viewed Aug 2021).
- 3. World Health Organization. Guidelines for trauma quality improvement programmes. Geneva: WHO, 2009. https://apps.who.int/iris/handle/10665/44061 (viewed Aug 2022).
- 4. Gomez D, Sarrami P, Singh H, et al. External benchmarking of trauma services in New South Wales: Risk‐adjusted mortality after moderate to severe injury from 2012 to 2016. Injury 2019; 50: 178‐185.
- 5. NSW Institute of Trauma and Injury Management. Trauma patient outcome evaluation: qualitative report. Sydney: NSW Agency for Clinical Innovation, 2016. https://aci.health.nsw.gov.au/__data/assets/pdf_file/0020/340850/NSW_Trauma_Patient_Outcome_Evaluation_Qualitative_Report_final.pdf (viewed Mar 2022).
- 6. Royal Australasian College of Surgeons. Trauma care verification. https://www.surgeons.org/research‐audit/trauma‐verification (viewed July 2021).
- 7. Royal Australasian College of Surgeons. Australian and Aotearoa New Zealand Trauma Verification Program: model resource criteria for trauma services. Melbourne: RACS, 2020. https://www.surgeons.org/‐/media/Project/RACS/surgeons‐org/files/trauma‐verification/model‐resource‐criteria.pdf?rev=71ad3d4faf9049dcb542a38a18dd2e7e&hash=6757B62EFA5715EC752B85E35EC3FB45 (viewed Aug 2022).
- 8. Flabouris A, Civil IDS, Balogh ZJ, Isles S. The New Zealand trauma system verification. J Trauma Acute Care Surg 2020; 89: 585‐596.
- 9. Royal Australasian College of Surgeons. The trauma verification process [website]. https://www.surgeons.org/research‐audit/trauma‐verification/the‐trauma‐verification‐process (viewed July 2021).
- 10. Balogh ZJ. Trauma verification: for the trauma centre or for the trauma system? ANZ J Surg 2014; 84: 499‐500.
- 11. Delprado AM. Trauma systems in Australia. J Trauma Nurs 2007; 14: 93‐97.
- 12. Agrawal V, Deramo PJ, Lowrance E, et al. ACS verified level I centers have better clinical outcomes than state designated level I trauma centers. Trauma Mon 2018; 23: e14435.
- 13. Batomen B, Moore L, Carabali M, et al. Effectiveness of trauma centre verification: a systematic review and meta‐analysis. Can J Surg 2021; 64: E25‐E38.
- 14. Piontek FA, Coscia R, Marselle CS, et al. Impact of American College of Surgeons verification on trauma outcomes. J Trauma 2003; 54: 1041‐1046; discussion 1046‐7.
- 15. Australia New Zealand Trauma Registry. Annual report 1 July 2019 to 30 June 2020. https://static1.squarespace.com/static/5b761ed3f93fd491065f7839/t/614808ed200a41594dcdcdbf/1632110845316/ATR_Annual+Report_19‐20_FA_2web.pdf (viewed Sept 2021).
- 16. Australian Trauma Quality Improvement Program. Bi‐National Trauma Minimum Data Set (BNTMDS) for Australia and New Zealand. ATR, 2018. https://atr.org.au/data‐set (viewed July 2021).
- 17. Palmer CS, Davey TM, Mok MT, et al. Standardising trauma monitoring: the development of a minimum dataset for trauma registries in Australia and New Zealand. Injury 2013; 44: 834‐841.
- 18. Zehtabchi S, Nishijima DK, McKay MP, Clay Mann N. Trauma registries: history, logistics, limitations, and contributions to emergency medicine research. Acad Emerg Med 2011; 18: 637‐643.
- 19. Curtis K, Gabbe B, Shaban RZ, et al. Priorities for trauma quality improvement and registry use in Australia and New Zealand. Injury 2020; 51: 84‐90.
- 20. Characteristics of clinical indicators. QRB Qual Rev Bull 1989; 15: 330‐339.
- 21. Stelfox HT, Straus SE, Nathens A, et al. Trauma center quality improvement programs in the United States, Canada, and Australasia. Ann Surg 2012; 256: 163‐169.
- 22. Donabedian A. Evaluating the quality of medical care. Milbank Q 1966; 44: 166‐206.
- 23. Coccolini F, Kluger Y, Moore EE, et al. Trauma quality indicators: internationally approved core factors for trauma management quality evaluation. World J Emerg Surg 2021; 16: 6.
- 24. Bieler D, Hörster A, Lefering R, et al. Evaluation of new quality indicators for the Trauma Register DGU using the systematic QUALIFY methodology. Eur J Trauma Emerg Surg 2020; 46: 449‐460.
Open access
Open access publishing facilitated by The University of Newcastle, as part of the Wiley ‐ The University of Newcastle agreement via the Council of Australian University Librarians.
The authors acknowledge the Trauma Verification Subcommittee and the Trauma Quality Improvement Subcommittee for reviewing the content of the manuscript and Jo Vabolis for copy‐editing the manuscript.
No relevant disclosures.