Skip to main content
Download PDF

Comparison of the performance of mental health, drug and alcohol comorbidities based on ICD-10-AM and medical records for predicting 12-month outcomes in trauma patients

BMC Health Services Research volume 18, Article number: 408 (2018) Cite this article

Abstract

Background

Many outcome studies capture the presence of mental health, drug and alcohol comorbidities from administrative datasets and medical records. How these sources compare as predictors of patient outcomes has not been determined. The purpose of the present study was to compare mental health, drug and alcohol comorbidities based on ICD-10-AM coding and medical record documentation for predicting longer-term outcomes in injured patients.

Methods

A random sample of patients (n = 500) captured by the Victorian State Trauma Registry was selected for the study. Retrospective medical record reviews were conducted to collect data about documented mental health, drug and alcohol comorbidities while ICD-10-AM codes were obtained from routinely collected hospital data. Outcomes at 12-months post-injury were the Glasgow Outcome Scale – Extended (GOS-E), European Quality of Life Five Dimensions (EQ-5D-3L), and return to work. Linear and logistic regression models, adjusted for age and gender, using medical record derived comorbidity and ICD-10-AM were compared using measures of calibration (Hosmer-Lemeshow statistic) and discrimination (C-statistic and R2).

Results

There was no demonstrable difference in predictive performance between the medical record and ICD-10-AM models for predicting the GOS-E, EQ-5D-3L utility sore and EQ-5D-3L mobility, self-care, usual activities and pain/discomfort items. The area under the receiver operating characteristic (AUC) for models using medical record derived comorbidity (AUC 0.68, 95% CI: 0.63, 0.73) was higher than the model using ICD-10-AM data (AUC 0.62, 95% CI: 0.57, 0.67) for predicting the EQ-5D-3L anxiety/depression item. The discrimination of the model for predicting return to work was higher with inclusion of the medical record data (AUC 0.69, 95% CI: 0.63, 0.76) than the ICD-10-AM data (AUC 0.59, 95% CL: 0.52, 0.65).

Conclusions

Mental health, drug and alcohol comorbidity information derived from medical record review was not clearly superior for predicting the majority of the outcomes assessed when compared to ICD-10-AM. While information available in medical records may be more comprehensive than in the ICD-10-AM, there appears to be little difference in the discriminative capacity of comorbidities coded in the two sources.

Peer Review reports

Background

Injuries accounted for 11% of the global burden of disease in terms of Years Lived with Disability in 2015 [1]. Risk-adjustment analyses of long-term outcomes after injury have included compensable status, injury mechanism, injury severity, perceived level of social support, socioeconomic position and educational level [2,3,4,5]. Mental health, drug and alcohol comorbidities have been cited as factors that impact on recovery and quality of life following injury [6, 7]. However, the importance of these comorbidities may be under-estimated in risk modelling of long-term outcomes [8]. Data sources used in research studies to capture comorbid conditions are ostensibly linked to the research question, patient population and resources available. Consequently, poor comorbidity capture in different data sources has an impact on the resulting comorbidity profile of injured people and the ability to predict patient outcomes after injury.

Although time- and labour-intensive to review, medical records represent a comprehensive source of comorbidity data, due to the detailed clinical information contained within the notes [9]. Alternatively, routinely collected administrative data are commonly relied on in epidemiological research as they are relatively cost-effective and readily available [10]. Findings from previous research suggest that mental health, drug and alcohol comorbidities derived from administrative data has been shown to be a strong predictor of in-hospital mortality [11], hospital-acquired infection [12] and longer hospital length of stay [13]. However, prediction of longer-term recovery outcomes using comorbidities based on administrative data have generated inconsistent results [14,15,16]. This could be explained by biases in administrative data, such as those associated with collecting data in order to account for different types of patient episodes and services provided, in the case of activity-based funding [17].

Direct comparisons between administrative coded mental health, drug and alcohol diagnoses with other sources of data in injured populations are scarce [18, 19]. The completeness of administrative coding largely relies on the quality of the medical record documentation but little is known about the impact of using the two alternative data sources on long-term outcome modelling. The aim of this study was to compare the contribution of two different sources of mental health, drug and alcohol comorbidity data in predicting 12-month functional, return to work and health-related quality of life outcomes in a major trauma population.

Methods

Study design and inclusion criteria

The Victorian State Trauma Registry (VSTR) is a population-based registry which captures information about virtually all major trauma patients across the state of Victoria [20]. The VSTR follows up all adult survivors to discharge after their injury including function, health-related quality of life (HRQoL), return to work and post-discharge mortality. Standardised telephone interviews are conducted by trained interviewers [21]. A random sample of 500 patients registered on the VSTR were selected for the study. Patients were eligible for inclusion in this study if they met each of the following criteria:

  1. i.

    Aged 18 years or older;

  2. ii.

    Definitively managed at one of the two adult major trauma services in Victoria;

  3. iii.

    Survived to 12 months post-injury and 12-month follow-up completed.

Procedures

In Australia, hospital data are collected in the form of International Statistical Classification of Diseases, Tenth Revision, Australian Modification (ICD-10-AM) codes and apply to all public and private hospitals. In Victoria, each code contains a prefix with “P” representing principal diagnosis requiring treatment during the stay, “A” representing additional diagnoses and “C” representing in-hospital complications. These codes are assigned by the hospital coders as part of routinely collected hospital data and are used for activity-based funding purposes [22].

Data were extracted from the VSTR for patients in the sample including clinical and demographic data and follow-up outcome data collected at 12-months post-injury. This included patients’ compensation status by the no-fault, third party insurers for road traffic injury and work-related injury and the Charlson Comorbidity Index (CCI), a weighting used to assess comorbidity [23]. The ICD-10-AM “P” and “A” prefixed codes, which are provided to the VSTR by the hospitals, were also extracted. Retrospective review of the medical records of the sample of patients was conducted, by the author of this paper in consultation with researchers with clinical and health expertise, at the two adult major trauma services.

To enable comparison with ICD-10-AM codes, all mental health, drug and alcohol comorbidities described in the medical record were captured based on the categories of mental and behavioural disorder (Chapter V) specified by ICD-10-AM. If a mental health, drug or alcohol condition was documented, based on clinical notation in addition to substantiating evidence such as an alcohol withdrawal scale or psychiatrist referral letter for ongoing treatment, this was recorded on a project data collection form in addition to the specified diagnosis. Pre-existing mental health disorders were captured from the medical record based on the following categories: organic mental disorders, schizophrenia, mood disorders, neurotic disorders, behavioural and personality disorders and other specified mental disorders.

A single binary indicator variable were generated to represent the presence of ICD-10-AM coded mental, drug and alcohol use disorders. This indicator variable included the major categories: alcohol use disorders (F10), drug use disorders (F11-F15, F16, F19) and mental disorders (F00-F03, F07, F09, F20-F48, F60-F69, F90-F99, U792, U793).

Outcome measures

The primary outcome measure recorded on the VSTR used to assess patients’ level of function is the Glasgow Outcome Scale-Extended (GOS-E). The GOS-E classifies patients into eight levels of function from death (GOS-E = 1), upper severe disability (GOS-E = 4) to upper good recovery (GOS-E = 8), indicating a complete return to normal activities of daily life [24]. The three-level European Quality of Life Five Dimensions (EQ-5D-3L) is used to measure of health-related quality of life and consists of five dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression), with each item having three possible responses: no problems, some problems and extreme problems. The EQ-5D-3L item responses are used to calculate a single utility score using age and gender specific social preference weights [25]. Algorithms were used to convert EQ-5D-3L responses into health utility scores [range: 0 (equivalent to death) to 1 (equivalent to full health)]. The original preference weights for the EQ-5D-3L from the UK population were applied as these are most commonly used [25]. If patients worked or studied prior to injury, they were asked whether they had returned to work or study.

To establish whether the capacity to predict patient outcomes at 12-months post-injury differed between medical record review of drug, alcohol and mental health comorbidities and those coded in ICD-10-AM, comparison of model performance was undertaken. A ‘good recovery’ was defined as a GOS-E score of 7–8 and a score less than seven represented ongoing functional limitations. The EQ-5D-3L item responses were dichotomised as no problems versus some or severe problems.

Analysis

In order to detect a statistically significant difference between the area under the Receiver Operating Characteristic (AUC) of 0.7 and 0.8 with a 5% one-sided type I error and 80% power, 158 patients was the smallest sample size required for each hospital [26]. We over-sampled patients beyond this minimum sample size and accessed the medical records of 250 patients from each hospital, in order to account for issues with availability of paper medical records and missing volumes which are common in medical record review studies [27]. Binary logistic regression models were fitted for the categorical outcomes functional recovery, return to work, and the EQ-5D-3L items of mobility, self-care, usual activities, pain/discomfort and anxiety/depression. A linear regression model was fitted for the continuous outcome EQ-5D-3L utility score. Age was categorised for inclusion in the models as it was not linearly related to the log odds of the outcomes of interest for the logistic models in its continuous form.

The following models were fitted for each the outcomes measured:

  1. i)

    Age and gender;

  2. ii)

    Medical record coded mental health, drug and alcohol comorbidities, adjusted for age and gender

  3. iii)

    ICD-10-AM coded mental health, drug and alcohol comorbidities, adjusted for age and gender

Discrimination was evaluated using the C-statistic, or area under the receiver operating characteristic curve (AUC), which ranges from zero to one, with a value of 0.5 representing a model with no predictive power and a value of 1 indicating a model with perfect predictive power. A value between 0.7 and 0.8 is considered acceptable predictive performance, while values greater than 0.8 demonstrate excellent predictive performance [28]. To investigate model fit, likelihood ratio (LR) tests were used. A higher LR statistic and significant p-value supports the hypothesis that including the comorbidity data was a significant improvement in model fit over the model of age and gender alone [29]. Hosmer-Lemeshow (H-L) statistics were used to compare model calibration of logistic regression models [28]. A linear regression model was fitted for the EQ-5D-3L utility scores outcome and the coefficient of determination (R2) of the models used to assess predictive performance. A p-value < 0.05 was considered significant. All analyses were conducted using Stata 13.0 (StataCorp, College Station, TX).

Results

The clinical and demographic characteristics of the study sample are shown in Table 1. There was an even distribution of patients among the age groups and most patients were male. The median (IQR) injury severity score was 17 (14–22), and these figures are representative of major trauma patients in Victoria [30]. Most patients did not have a Charlson Comorbidity Index condition recorded and did not claim compensation for their injuries (Table 1).

Table 1 Demographic and clinical characteristics of patients within the sample (n = 500)
Full size table

Based on the GOS-E measure, 41% (n = 205) of patients in the sample reported a good recovery at 12-months post-injury. According to the H-L statistic, the models predicting functional recovery demonstrated acceptable calibration. Inclusion of the mental health, drug and alcohol comorbidity data, from either the medical record or ICD-10-AM, improved the model fit but none of the models showed acceptable discrimination (Table 2) (Additional file 1).

Table 2 Discrimination and calibration statistics for predicting GOS-E good recovery and return to work
Full size table

Three hundred and thirty eight (68%) patients reported that they were working or studying prior to injury. Of those who were working/studying prior to injury, 71% (n = 240) had returned to work or study at 12-months post-injury. The models predicting return to work all showed less than acceptable discrimination but demonstrated acceptable calibration (Table 2). The addition of the medical record data, but not the ICD-10-AM coded data, improved discrimination over age and gender.

The EQ-5D-3L was complete for 98% of patients at 12 months. The mean (SD) EQ-5D-3L utility score in the sample was 0.75 (0.29). The prevalence of problems was highest for the mobility and anxiety or depression items (Table 3). Overall, the prevalence of problems was lowest for the self-care item.

Table 3 EQ-5D-3L responses at 12-months post-injury
Full size table

The models predicting problems on each of the dimensions of the EQ-5D-3L showed less than acceptable discrimination (Table 4). The capacity to discriminate between patients with and without problems in the mobility, self-care, usual activities, pain/discomfort items and utility score was similar for the ICD-10-AM and medical record models except for patients with anxiety/depression problems. For predicting the EQ-5D-3L utility score, the highest R2 was observed for the medical record model. Both models were an improvement over the age and gender model, but addition of the ICD-10-AM coded conditions was only a marginal improvement over age and gender (Table 4). Calibration was acceptable according to the H-L statistic for predicting all of the EQ-5D-3L items.

Table 4 Discrimination and calibration statistics for predicting EQ-5D-3L dimensions and utility score
Full size table

Discussion

Comorbidity information available in different data sources have their own advantages and limitations, which can affect the validity of studies relying on such data [31]. It has been acknowledged that routinely collected administrative data sub-optimally represent a patient’s condition and the totality of their comorbid illnesses, particularly for mental health, drug and alcohol comorbidities which are historically difficult to characterise, classify and diagnose [32]. Previous analyses of administrative coding in routinely collected hospital data compared with medical records have revealed the prevalence of comorbid conditions are frequently under-estimated [33,34,35]. Observable discrepancies between the data sources exist [36], and are driven largely by coding rules, activity-based funding, variability in coder interpretation and inconsistent or unclear charting [17, 37]. We sought to compare the statistical performance of two commonly used data sources: medical record documentation and ICD-10-AM administrative data. Mental health, drug and alcohol comorbidities were shown to be important for predicting long-term outcomes, as the addition of the comorbidity data fit the data better than age and gender alone. Overall, the addition of comorbidities obtained from medical record review did not provide improvement in discrimination over age and gender, which was comparable with the ICD-10-AM coded comorbidities, for most of the outcomes assessed.

Mental health, drug and alcohol comorbidities are associated with delays in recovery and disability after injury, but the majority of the evidence predicting these outcomes have relied on self-report or clinical interview to assess comorbidity [38,39,40]. Pre-injury mental health diagnoses derived from the medical record has been associated with poorer function in previous studies [41, 42], whereas ascertaining pre-existing mental health history based on administrative data coding has yielded differing results [16, 43]. Despite the lower prevalence of comorbidities coded in ICD-10-AM than in the medical record, the findings of this study indicate the capacity to predict functional recovery was largely comparable with the medical record. This suggests that key mental health, drug and alcohol comorbidities, which are predictors and have significant impacts on long-term function after injury, are not comprehensively captured in the medical record at the outset. Notably, some comorbidities within the medical record could have been inadvertently excluded from the review due to missing documentation or illegible handwriting. As a result, mental health, drug and alcohol comorbidities obtained from the medical record may not be reliably predictive of long-term function. Further research is needed to compare the predictive performance of medical record data with self-report and clinical interview to assess these comorbidities for long-term outcome modelling.

Mental health, drug and alcohol comorbidity data derived from medical records have been used previously for risk-adjustment in studies of return to work [42, 44]. Mental health, drug and alcohol comorbidities coded in ICD-10-AM may not be as reliable or be able to perform to the same capacity as medical record abstracted conditions for predicting return to work. This is difficult to assess, as few existing studies have evaluated the association between ICD-10 coded mental health comorbidities and returning to work after injury. A previous study of major trauma patients using ICD-10-AM coded data reported with no significant association with returning to work [15], but this may have been attributed to limited statistical power. While the medical record may provide a high degree of detail about mental health factors that are associated with lower odds of returning to work following severe injury, this information may be incomplete when coded in the ICD-10-AM.

Survivors of traumatic injuries often experience deficits in perceived health status, including pain or discomfort, and difficulty with usual activities and mobility [45]. Aside from anxiety or depression, there were no differences in the discriminative ability of the ICD-10-AM and medical record data for predicting the remaining EQ-5D-3L dimensions or utility score. Neither the medical record documentation nor the ICD-10-AM data were able to differentiate between groups at risk of ongoing problems with mobility, self-care, usual activities and pain/discomfort with any great accuracy. An explanation for this finding may be that self-reported measures of comorbidity may be a better predictor of the EQ-5D-3L outcomes whereas indirect comorbidity measures may not be optimal for predicting these health status outcomes [46]. This suggests the importance of other factors not explained by mental health, drug and alcohol comorbidities including personal and environmental factors for predicting HRQoL following injury. Other factors that have been shown to be important in the literature include compensable status, education, and social circumstances [47,48,49].

The strengths of the study were the use of long-term outcomes data at 12-months post-injury and the random sample of a population-based cohort, which was representative of major trauma patients in Victoria. Although patients from each hospital were over-sampled in order to mitigate potential issues with missing charts, only seven patient records (3%) of the total sample could not be located, and these patients were replaced from the VSTR. A limitation of the study includes the extent to which these findings may be extrapolated to other patients. This research relied on ICD-10-AM recorded mental health, drug and alcohol diagnoses which were originally collected primarily for activity-based funding. The findings may not be applicable to other jurisdictions, which vary in coding practices and funding systems. This aim of the study was not to develop the best prediction model for long-term outcomes. The selection of variables to identify the ‘optimal’ risk prediction model is based on trying to choose the best predictors of the outcome [50], and the results cannot be interpreted for this purpose without careful selection and further examination of other variables.

Conclusion

While the prevalence of mental health, drug and alcohol comorbidities is lower in ICD-10-AM than medical records, data derived from medical record review was not clearly superior for predicting the majority of the outcomes assessed. There was no demonstrable difference in discriminative capacity between the medical record and ICD-10-AM models for predicting the GOS-E, EQ-5D-3L utility sore and EQ-5D-3L mobility, self-care, usual activities and pain/discomfort items. Further research is needed to compare the contribution of medical record documented mental health, drug and alcohol comorbidities with alternative data sources.

Abbreviations

ACS:

Australian Coding Standards

AUC:

Area under the curve

EQ-5D:

European Quality of Life Five Dimensions

H-L:

Hosmer-Lemeshow

HRQoL:

Health-related quality of life

ICD-10-AM:

International Classification of Diseases, Tenth Revision, Australian Modification

ROC:

Receiver operating characteristic

VSTR:

Victorian State Trauma Registry

References

  1. GBD 2015 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388:1545–602.

    Article  Google Scholar 

  2. Vles WJ, Steyerberg EW, Essink-Bot ML, van Beeck EF, Meeuwis JD, Leenen LP. Prevalence and determinants of disabilities and return to work after major trauma. J Trauma. 2005;58:126–35.

    Article  PubMed  Google Scholar 

  3. Holbrook TL, Hoyt DB. The impact of major trauma: quality-of-life outcomes are worse in women than in men, independent of mechanism and injury severity. J Trauma. 2004;56:284–90.

    Article  PubMed  Google Scholar 

  4. Langley J, Davie G, Wilson S, Lilley R, Ameratunga S, Wyeth E, Derrett S. Difficulties in functioning 1 year after injury: the role of preinjury sociodemographic and health characteristics, health care and injury-related factors. Arch Phys Med Rehabil. 2013;94:1277–86.

    Article  PubMed  Google Scholar 

  5. Michaels AJ, Michaels CE, Smith JS, Moon CH, Peterson C, Long WB. Outcome from injury: general health, work status, and satisfaction 12 months after trauma. J Trauma Acute Care Surg. 2000;48:841–50.

    Article  CAS  Google Scholar 

  6. Wan JJ, Morabito DJ, Khaw L, Knudson MM, Dicker RA. Mental illness as an independent risk factor for unintentional injury and injury recidivism. J Trauma. 2006;61:1299–304.

    Article  PubMed  Google Scholar 

  7. Dicker RA, Mah J, Lopez D, Tran C, Reidy R, Moore M, Kreniske P, Crane I, Knudson MM, Li M, et al. Screening for mental illness in a trauma center: rooting out a risk factor for unintentional injury. J Trauma. 2011;70:1337–44.

    Article  PubMed  Google Scholar 

  8. Archer KR, Heins SE, Abraham CM, Obremskey WT, Wegener ST, Castillo RC. Clinical significance of pain at hospital discharge following traumatic orthopedic injury: general health, depression, and PTSD outcomes at 1 year. Clin J Pain. 2016;32:196–202.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Gregory KE, Radovinsky L. Research strategies that result in optimal data collection from the patient medical record. Appl Nurs Res. 2012;25:108–16.

    Article  PubMed  Google Scholar 

  10. Gavrielov-Yusim N, Friger M. Use of administrative medical databases in population-based research. J Epidemiol Community Health. 2014;68:283–7.

    Article  PubMed  Google Scholar 

  11. Pine M, Norusis M, Jones B, Rosenthal GE. Predictions of hospital mortality rates: a comparison of data sources. Ann Intern Med. 1997;126:347–54.

    Article  PubMed  CAS  Google Scholar 

  12. Dickinson CM, Karlin DR, Nunez HR, Cao SA, Heffernan DS, Monaghan SF, Kheirbek T, Adams CA, Stephen AH. Do patients with pre-existing psychiatric illness have an increased risk of infection after injury? Surg Infect. 2017;18:545.

    Article  Google Scholar 

  13. Falsgraf E, Inaba K, de Roulet A, Johnson M, Benjamin E, Lam L, Matsushima K, Strumwasser A, Demetriades D. Outcomes following traumatic injury in patients with preexisting psychiatric illness. J Trauma Acute Care Surg. 2017;83:882.

    Article  PubMed  Google Scholar 

  14. Davydow DS, Zatzick DF, Rivara FP, Jurkovich GJ, Wang J, Roy-Byrne PP, Katon WJ, Hough CL, Kross EK, Fan MY, et al. Predictors of posttraumatic stress disorder and return to usual major activity in traumatically injured intensive care unit survivors. Gen Hosp Psychiatry. 2009;31:428–35.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Nguyen TQ, Simpson PM, Braaf SC, Gabbe BJ. Mortality, functional and return to work outcomes of major trauma patients injured from deliberate self-harm. Injury. 2017;48:184–94.

    Article  PubMed  Google Scholar 

  16. Cameron CM, Purdie DM, Kliewer EV, McClure RJ. Mental health: a cause or consequence of injury? A population-based matched cohort study. BMC Public Health. 2006;6:114.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Steinbusch PJ, Oostenbrink JB, Zuurbier JJ, Schaepkens FJ. The risk of upcoding in casemix systems: a comparative study. Health Policy. 2007;81:289–99.

    Article  PubMed  Google Scholar 

  18. Kim HM, Smith EG, Stano CM, Ganoczy D, Zivin K, Walters H, Valenstein M. Validation of key behaviourally based mental health diagnoses in administrative data: suicide attempt, alcohol abuse, illicit drug abuse and tobacco use. BMC Health Serv Res. 2012;12:18.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Fowles JB, Fowler EJ, Craft C. Validation of claims diagnoses and self-reported conditions compared with medical records for selected chronic diseases. J Ambul Care Manage. 1998;21:24–34.

    Article  PubMed  CAS  Google Scholar 

  20. Cameron PA, Finch CF, Gabbe BJ, Collins LJ, Smith KL, McNeil JJ. Developing Australia’s first statewide trauma registry: what are the lessons? ANZ J Surg. 2004;74:424–8.

    Article  PubMed  Google Scholar 

  21. Gabbe BJ, Cameron PA, Hannaford AP, Sutherland AM, McNeil JJ. Routine follow up of major trauma patients from trauma registries: what are the outcomes? J Trauma. 2006;61:1393–9.

    Article  PubMed  Google Scholar 

  22. National Centre for Classification in Health. International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification (ICD-10-AM) Australian Coding Standards. Darlinghurst: University of Sydney; 1998.

    Google Scholar 

  23. Charlson ME, Charlson RE, Peterson JC, Marinopoulos SS, Briggs WM, Hollenberg JP. The Charlson comorbidity index is adapted to predict costs of chronic disease in primary care patients. J Clin Epidemiol. 2008;61:1234–40.

    Article  PubMed  Google Scholar 

  24. Jennett B, Bond M. Assessment of outcome after severe brain damage. Lancet. 1975;1:480–4.

    Article  PubMed  CAS  Google Scholar 

  25. Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35:1095–108.

    Article  PubMed  CAS  Google Scholar 

  26. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.

    Article  PubMed  CAS  Google Scholar 

  27. Badcock D, Kelly A-M, Kerr D, Reade T. The quality of medical record review studies in the international emergency medicine literature. Ann Emerg Med. 2005;45:444–7.

    Article  PubMed  Google Scholar 

  28. Hosmer DW, Lemeshow S. Applied logistic regression. 2nd ed. New York: Wiley; 2000.

    Book  Google Scholar 

  29. Steyerberg EW, Eijkemans MJ, Harrell FE Jr, Habbema JD. Prognostic modelling with logistic regression analysis: a comparison of selection and estimation methods in small data sets. Stat Med. 2000;19:1059–79.

    Article  PubMed  CAS  Google Scholar 

  30. Gabbe BJ, Harrison JE, Lyons RA, Edwards ER, Cameron PA, Victorian Orthopaedic Trauma Outcomes R. Comparison of measures of comorbidity for predicting disability 12-months post-injury. BMC Health Serv Res. 2013;13:30.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Bender M, Smith TC. Using administrative mental health indicators in heart failure outcomes research: comparison of clinical records and international classification of disease coding. J Card Fail. 2016;22:56–60.

    Article  PubMed  Google Scholar 

  32. McGorry PD. The next stage for diagnosis: validity through utility. World Psychiatry. 2013;12:213–5.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Henderson T, Shepheard J, Sundararajan V. Quality of diagnosis and procedure coding in ICD-10 administrative data. Med Care. 2006;44:1011–9.

    Article  PubMed  Google Scholar 

  34. Humphries KH, Rankin JM, Carere RG, Buller CE, Kiely FM, Spinelli JJ. Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? J Clin Epidemiol. 2000;53:343–9.

    Article  PubMed  CAS  Google Scholar 

  35. Malenka DJ, McLerran D, Roos N, Fisher ES, Wennberg JE. Using administrative data to describe casemix: a comparison with the medical record. J Clin Epidemiol. 1994;47:1027–32.

    Article  PubMed  CAS  Google Scholar 

  36. O'Malley KJ, Cook KF, Price MD, Wildes KR, Hurdle JF, Ashton CM. Measuring diagnoses: ICD code accuracy. Health Serv Res. 2005;40:1620–39.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Cheng P, Gilchrist A, Robinson KM, Paul L. The risk and consequences of clinical miscoding due to inadequate medical documentation: a case study of the impact on health services funding. HIM J. 2009;38:35–46.

    Article  Google Scholar 

  38. Hibbard MR, Ashman TA, Spielman LA, Chun D, Charatz HJ, Melvin S. Relationship between depression and psychosocial functioning after traumatic brain injury. Arch Phys Med Rehabil. 2004;85:S43–53.

    Article  PubMed  Google Scholar 

  39. O’Dell KM, Hannay HJ, Biney FO, Robertson CS, Tian TS. The effect of blood alcohol level and pre-injury chronic alcohol use on outcome from severe traumatic brain injury in Hispanics, Anglo-Caucasians, and African Americans. J Head Trauma Rehabil. 2012;27:361–9.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Schweininger S, Forbes D, Creamer M, McFarlane AC, Silove D, Bryant RA, O'Donnell ML. The temporal relationship between mental health and disability after injury. Depress Anxiety. 2015;32:64–71.

    Article  PubMed  Google Scholar 

  41. Lankester BJA, Garneti N, Gargan MF, Bannister GC. Factors predicting outcome after whiplash injury in subjects pursuing litigation. Eur Spine J. 2006;15:902–7.

    Article  PubMed  CAS  Google Scholar 

  42. MacMillan PJ, Hart RP, Martelli MF, Zasler ND. Pre-injury status and adaptation following traumatic brain injury. Brain Inj. 2002;16:41–9.

    Article  PubMed  Google Scholar 

  43. Chubb HL, Bisson JI. The development of psychological reactions in a group of individuals with pre-existing and enduring psychiatric disorder following a fatal coach crash. J Ment Health. 1999;8:203–12.

    Article  Google Scholar 

  44. Brych SB, Engrav LH, Rivara FP, Ptacek JT, Lezotte DC, Esselman PC, Kowalske KJ, Gibran NS. Time off work and return to work rates after burns: systematic review of the literature and a large two-center series. J Burn Care Rehabil. 2001;22:401–5.

    Article  PubMed  CAS  Google Scholar 

  45. Black JA, Herbison GP, Lyons RA, Polinder S, Derrett S. Recovery after injury: an individual patient data meta-analysis of general health status using the EQ-5D. J Trauma. 2011;71:1003–10.

    Article  PubMed  Google Scholar 

  46. Tan Z, Liang Y, Liu S, Cao W, Tu H, Guo L, Xu Y. Health-related quality of life as measured with EQ-5D among populations with and without specific chronic conditions: a population-based survey in Shaanxi Province, China. PLoS One. 2013;8:e65958.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  47. Hu XB, Feng Z, Fan YC, Xiong ZY, Huang QW. Health-related quality-of-life after traumatic brain injury: a 2-year follow-up study in Wuhan, China. Brain Inj. 2012;26:183–7.

    Article  PubMed  Google Scholar 

  48. Leduc BE, Lepage Y. Health-related quality of life after spinal cord injury. Disabil Rehabil. 2002;24:196–202.

    Article  PubMed  Google Scholar 

  49. Polinder S, Haagsma JA, van Klaveren D, Steyerberg EW, van Beeck EF. Health-related quality of life after TBI: a systematic review of study design, instruments, measurement properties, and outcome. Popul Health Metr. 2015;13:4.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35:1925–31.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge The Alfred and Royal Melbourne Hospitals and all project-associated investigators: Susan McLellan, Jane Ford, Melissa Hart, Adrian Buzgau, Tani Thomas, Mimi Morgan. The Victorian State Trauma Outcomes Registry and Monitoring (VSTORM) Group is thanked for the provision of data. The authors acknowledge the data collectors and participating hospitals of the VSTR and members of the VSTR Steering Committee. The authors would also like to thank Mary Lou Greer and Carol Roberts who facilitated the study.

Funding

The Victorian State Trauma Registry (VSTR) is a Department of Health and Human Services, State Government of Victoria and Transport Accident Commission funded project. Tu Nguyen was supported by an Australian Government Research Training Program Scholarship during the preparation of this manuscript. Belinda Gabbe was supported by an Australian Research Council Future Fellowship (FT170100048) during the preparation of this manuscript. The funding sources had no role in the design or conduct of the study.

Availability of data and materials

The data that support the findings of this study are available from the Victorian State Trauma Outcomes Registry and Monitoring Group (VSTORM) but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of VSTORM.

Author information

Authors and Affiliations

  1. Department of Epidemiology and Preventive Medicine, Monash University, Melbourne, Victoria, Australia

    Tu Q. Nguyen, Pamela M. Simpson, Sandra C. Braaf, Peter A. Cameron & Belinda J. Gabbe

  2. Emergency and Trauma Centre, The Alfred Hospital, Melbourne, Victoria, Australia

    Peter A. Cameron

  3. Trauma Service, Royal Melbourne Hospital, Melbourne, Victoria, Australia

    Rodney Judson

  4. Farr Institute, Swansea University Medical School, Swansea University, Swansea, UK

    Belinda J. Gabbe

Authors
  1. Tu Q. Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pamela M. Simpson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sandra C. Braaf
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peter A. Cameron
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rodney Judson
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Belinda J. Gabbe
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TQN contributed to the study design, collected and analysed the data and drafted the manuscript. SCB contributed to the study design, data interpretation, and drafting and revising of the manuscript. PMS contributed to statistical analysis, interpretation of the data and revision of the manuscript for important intellectual content. PAC and RJ contributed to interpretation of the data and revision of the manuscript for important intellectual content. BJG oversaw the project, contributed to the study design, data interpretation, and drafting and revising of the manuscript. All authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to Tu Q. Nguyen.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Alfred Hospital Human Research Ethics Committee (Project Number: 275/16), the Royal Melbourne Hospital (Project Number: 2016.179) and the Monash University Human Research Ethics Committee (Project Number: 0290). Access to the VSTR data for this study was granted by the Victorian State Trauma Outcomes Registry and Monitoring (VSTORM) Group after receiving ethical approvals. Identifiable information extracted from the VSTR was only used to identify the correct medical record for the sample of patients at the hospitals. Thereafter, all analyses were performed in non-identifiable format.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Figure S1. Receiver operating characteristic curves for the models incorporating medical record and ICD-10 data predicting a good recovery (GOS-E 7–8), Figure S2. Receiver operating characteristic curves for the models incorporating medical record and ICD-10 data predicting return to work, Figure S3. Receiver operating characteristic curves for models incorporating medical record and ICD-10 data predicting EQ-5D-3L problems with ongoing mobility, Figure S4. Receiver operating characteristic curves for models incorporating medical record and ICD-10 data predicting EQ-5D-3L problems with ongoing self-care, Figure S5. Receiver operating characteristic curves for models incorporating medical record and ICD-10 data predicting EQ-5D-3L ongoing problems with usual activities, Figure S6. Receiver operating characteristic curves for models incorporating medical record and ICD-10 data predicting EQ-5D-3L problems with ongoing pain or discomfort, Figure S7. Receiver operating characteristic curves for models incorporating medical record and ICD-10 data predicting EQ-5D-3L problems with ongoing anxiety or depression (DOCX 11452 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nguyen, T.Q., Simpson, P.M., Braaf, S.C. et al. Comparison of the performance of mental health, drug and alcohol comorbidities based on ICD-10-AM and medical records for predicting 12-month outcomes in trauma patients. BMC Health Serv Res 18, 408 (2018). https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-018-3248-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-018-3248-x

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us