Skip to main content
  • Letter to the Editor
  • Open access
  • Published:

Letter to the Editor regarding the article: "identifying pre-hospital factors associated with outcome for major trauma patients in a regional trauma network: an exploratory study"

The Original Article was published on 23 August 2017

Abstract

The aim of this Letter to the Editor was to report some methodological shortcomings in a recently published article. Issues regarding missing values and overfitting are mentioned. First, Complete Case (CC) analysis was used instead of an imputation method. Second, there was a high chance of overfitting and lack of model validation. In conclusion, the results of this study should be interpret with caution and further research is necessary.

With great interest we read the study by Thompson et al. [1] where they identified pre-hospital factors associated with major trauma outcomes. This study showed that Glasgow Coma Score (GCS), Respiration Rate (RR) and Age are potential predictive triggers for direct transport to a Major Trauma Center (MTC). This is an interesting finding, which might help in the challenging decision which patients will benefit from treatment in MTCs. However, some methodological issues should be taken into consideration.

First, the authors used ‘listwise’ exclusion, also known as complete case (CC) analysis, to handle their missing data. This resulted in excluding almost 45% of their entire sample (462 out of 1033 casualties). Obviously, this leads to less efficiency and possibly bias [2, 3]. In dealing with missing data, the CC analysis could be biased when Missing at Random (MAR) on the outcome variable is present [2,3,4], for example when GCS is missing in patients with high GCS who have a high probability to die. Thus imputation methods should have been considered. This could certainly increase efficiency and potentially reduce bias dependent on the mechanism of missing data [2,3,4].

Second, the authors stated that their model including GCS, RR and Age correctly predicted 97.4% of the casualties. This high prediction rate could be the result of overfitting and might not be generalizable to the population [3]. Three strategies could be followed to avoid overfitting. First, the use of a more liberal p-value than 0.050 and preselection of variables based on clinical knowledge could have decreased the chance of testimation bias and overestimation of the effect of the selected predictors, especially with few events [3, 5]. Two other important steps in prediction modelling are internal and external validation [3, 6]. Internal validation is about the stability of the selected predictors and the quality of the predictions in the underlying population [3, 6]. External validation is about the generalizability of the predictors and predictions in comparable populations [3, 6]. Unfortunately none of these strategies to decrease overfitting and increase the quality of the prediction models have been used and therefore overfitting is likely in this study.

In conclusion, results of this study should be interpret with caution and further research is necessary to estimate the predictive ability of pre-hospital factors with special emphasis on model validity and overfitting.

Abbreviations

CC:

Complete case

GCS:

Glasgow coma score

MAR:

Missing at random

MTC:

Major trauma center

RR:

Respiration rate

References

  1. Thompson L, Hill M, Davies C, Shaw G, Kiernan MD. Identifying pre-hospital factors associated with outcome for major trauma patients in a regional trauma network: an exploratory study. Scand J Trauma Resusc Emerg Med. 2017;25(1):83.

    Article  PubMed  PubMed Central  Google Scholar 

  2. White IR, Carlin JB. Bias and efficiency of multiple imputation compared with complete-case analysis for missing covariate values. Stat Med. 2010;29(28):2920–31.

    Article  PubMed  Google Scholar 

  3. Steyerberg EW. Clinical prediction models: a practical approach to development, validation, and updating. New York: Springer; 2008.

    Google Scholar 

  4. Vach W, Blettner M. Missing data in epidemiologic studies. Encyclopedia of biostatistics. New Jersey: Wiley; 2005.

  5. Harrell FE. Regression modeling strategies: with applications to linear models, logistic and ordinal regression, and survival analysis. Cham: Springer International Publishing; 2015.

  6. Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35(29):1925–31.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

No funding was sought or obtained for this study.

Availability of data and materials

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

CS and EW were the leading authors, EV: proofreading and intellectual input, HL: proofreading and intellectual input. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Charlie A. Sewalt.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sewalt, C.A., Wiegers, E.J.A., Venema, E. et al. Letter to the Editor regarding the article: "identifying pre-hospital factors associated with outcome for major trauma patients in a regional trauma network: an exploratory study". Scand J Trauma Resusc Emerg Med 25, 113 (2017). https://doi.org/10.1186/s13049-017-0454-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13049-017-0454-1

Keywords