Connect
MJA

Validating Indigenous status in a regional Queensland hospital emergency department dataset with patient‐linked data

Mary O'Loughlin, Linton Harriss, Jane Mills, Fintan Thompson and Robyn McDermott
Med J Aust 2020; 212 (5): 230-231. || doi: 10.5694/mja2.50401
Published online: 17 February 2020

Indicators used to plan and evaluate health services for Aboriginal and Torres Strait Islander (Indigenous) people are based upon administrative data. In major Queensland public hospitals, the Emergency Department Information System (EDIS) captures records of patient progress in emergency departments (EDs).1 Inaccurate representation of Indigenous status in datasets has been previously identified, and government agencies have been directed to improve data quality, and particularly to reduce the under‐reporting of Indigenous status.2,3

In a study published elsewhere,4 we explored factors that influenced the presentation of adults to the Cairns Hospital ED. Ethics approval for the study was obtained from the Far North Queensland Human Research Ethics Committee (reference, HREC/16/QCH/81‐1068). We linked data from a face‐to‐face patient perspective survey with EDIS data. Both the face‐to‐face patient survey and EDIS datasets were independently cleaned and validated prior to merging. For this article, we compared the patient‐reported responses regarding Indigenous status with the corresponding EDIS records. As the survey data and EDIS record for each patient were generated during the same episode of ED care, it would be anticipated that the two data sets should be congruent.

During the one‐month survey period (March–April 2014), 3229 individual people aged at least 18 years attended the Cairns Hospital ED; of these, 1000 who were local residents participated in a face‐to‐face patient survey that included self‐identification of Indigenous status. Indigenous status as reported to the patient survey was concordant with EDIS records for 102 Indigenous people. In the face‐to‐face survey, 21 people identified as being Indigenous but in their EDIS records they were recorded as being non‐Indigenous (17 people) or status data were missing (four people) (Box). This degree of under‐reporting (21 of 123, 17%) is consistent with previous estimates of under‐reporting of Indigenous status in Australian hospital data.2

Twelve people who reported being non‐Indigenous in the face‐to‐face survey were identified as Indigenous in the EDIS dataset. Discussions of Indigenous status reporting have focused on under‐identification rather than over‐identification.3,5 Although the number was small, the potential effect of this type of discrepancy on population health statistics and the risk of erroneous conclusions caused by the quality of the recorded data should be considered.

We assessed the sensitivity, specificity, and accuracy (with binomial exact 95% confidence intervals [CIs]) of the EDIS dataset, with survey responses as the comparator; these analyses were conducted in Stata 13.1. Sensitivity (the proportion of self‐identifying Indigenous people recorded by EDIS as being Indigenous) was 85.7% (95% CI, 78.1–91.5%); specificity (proportion of true negatives) was 98.6% (95% CI, 97.6–99.3%); and overall accuracy (proportion of true positives and negatives) was 97.0% (95% CI, 95.8–98.0%).

Inaccuracies in administrative datasets can influence health service decision making. Our validation study identified discrepancies between face‐to‐face patient survey data and EDIS data on Indigenous status in both directions. Efforts to minimise dataset inaccuracies in recorded Indigenous identification are warranted.

Box – Indigenous status according to face‐to‐face patient survey and Emergency Department Information System (EDIS) record

 

Patient survey


Indigenous

Non‐Indigenous

Total status recorded

Status not recorded

Total


EDIS record

 

 

 

 

 

Indigenous

102

12

114

0

114

Non‐Indigenous

17

847

864

2

866

Total status recorded

119

859

978

 

 

Status not recorded

4

16

 

 

 

Total

123

875

 

 

1000


 

Received 8 February 2019, accepted 6 August 2019

  • Mary O'Loughlin1
  • Linton Harriss1
  • Jane Mills2
  • Fintan Thompson1
  • Robyn McDermott1,3

  • 1 James Cook University, Cairns, QLD
  • 2 Massey University, Wellington, New Zealand
  • 3 University of South Australia, Adelaide, SA


Acknowledgements: 

Our investigation was supported by the Australian Institute of Tropical Health and Medicine, James Cook University, and an Australian Government Research Training Program Scholarship. The face‐to‐face patient survey was funded by Far North Queensland Medicare Local and the Cairns and the Hinterland Hospital and Health Service. We thank members of the original study team and patients and staff of the Cairns Hospital for their support.

Competing interests:

No relevant disclosures.

Author

remove_circle_outline Delete Author
add_circle_outline Add Author

Comment
Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

Online responses are no longer available. Please refer to our instructions for authors page for more information.