- Original research
- Open access
- Published:
Does the prehospital National Early Warning Score predict the short-term mortality of unselected emergency patients?
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine volume 26, Article number: 48 (2018)
Abstract
Objectives
The prehospital research field has focused on studying patient survival in cardiac arrest, as well as acute coronary syndrome, stroke, and trauma. There is little known about the overall short-term mortality and its predictability in unselected prehospital patients. This study examines whether a prehospital National Early Warning Score (NEWS) predicts 1-day and 30-day mortalities.
Methods
Data from all emergency medical service (EMS) situations were coupled to the mortality data obtained from the Causes of Death Registry during a six-month period in Northern Finland. NEWS values were calculated from first clinical parameters obtained on the scene and patients were categorized to the low, medium and high-risk groups accordingly. Sensitivities, specificities, positive predictive values (PPVs), negative predictive values (NPVs), and likelihood ratios (PLRs and NLRs) were calculated for 1-day and 30-day mortalities at the cut-off risks.
Results
A total of 12,426 EMS calls were included in the study. The overall 1-day and 30-day mortalities were 1.5 and 4.3%, respectively. The 1-day mortality rate for NEWS values ≤12 was lower than 7% and for values ≥13 higher than 20%. The high-risk NEWS group had sensitivities for 1-day and 30-day mortalities 0.801 (CI 0.74–0.86) and 0.42 (CI 0.38–0.47), respectively.
Conclusion
In prehospital environment, the high risk NEWS category was associated with 1-day mortality well above that of the medium and low risk NEWS categories. This effect was not as noticeable for 30-day mortality. The prehospital NEWS may be useful tool for recognising patients at early risk of death, allowing earlier interventions and responds to these patients.
Background
Prompt emergency identification and correct risk assessment are corner stones of a successful emergency medical service (EMS) system. Both also affect patient survival. [1] While the use of early warning scores (EWS) has been shown to be feasible for predicting mortality and deterioration of hospitalized patients [2], it is unclear whether the use of early warning scores in the prehospital setting is efficient to detect patients at risk of death. [3, 4] The prehospital research field has mainly focused on the identification and outcome of out-of-hospital cardiac arrest patients as well as other specific patient groups, [5,6,7] but only few studies have related to the outcome of unselected prehospital patients [8].
In 2012, the use of the National Early Warning Score (NEWS) throughout the entire chain of medical care was recommended by the Royal College of Physicians. [9] Since then, the use of NEWS has been increasingly implemented in hospital wards, emergency departments, as well as in several EMSs in Finland. The use of NEWS in prehospital setting may facilitate earlier identification of patients at risk. In one study, the prehospital NEWS was shown to predict 48-h mortality. [10] However, in daily practice the value of risk assessment to support decision-making in prehospital setting is unclear.
This study aimed to examine the accuracy of the prehospitally implemented NEWS in predicting 1-day and 30-day mortalities in an unselected EMS population. A secondary aim was to describe the causes of death in this prehospital patient population.
Methods
This was an observational six-month cohort study in two hospital districts, Kainuu and Länsi-Pohja, in northern Finland. Permission to perform the study was obtained from both hospital districts (12Mar2014 & 8Apr2014) and the Office of Data Protection Ombudsman (719/4225/2014). The study protocol was submitted to and approved by the local ethics committee (Northern Ostrobothnia ethics committee 15/2015).
Study setting
In Finland, the common European emergency phone number 112 is used for all (medical, fire and rescue, police) emergencies. The national dispatch authority directs the operation of the six regional emergency medical communication centres (EMCCs) in the country. For medical calls, the emergency dispatchers evaluate the calls according to a Finnish criteria-based national standardized dispatch protocol. Finnish EMSs are administrated by the hospital districts and are usually three-tiered. The first tier consists of basic life support (BLS) ambulances and first response units (FRU), such as fire engines, police, or the Border patrols. The second tier is the advanced life support (ALS) ambulance staffed with nurses or paramedics, and the third tier is a physician manned ground or helicopter unit. The EMSs in the catchment areas annually respond to approximately 35,000 incidents.
The catchment areas are home to a total of 140,000 inhabitants, representing 2.6% of the Finnish population, with a population density of 4.7 inhabitants per square km. The areas are mostly suburban and rural settings.
Study data
Data from all prehospital emergency calls from January 1st-June 30th 2014 were reviewed from EMS databases and run sheets. Patients less than 16 years of age were excluded, as were inter-facility transports, homecare missions, and situations where the patient was not encountered. The NEWS was calculated post hoc using a statistical programme from the first clinical variables (respiratory rate, oxygen saturation, temperature, systolic blood pressure, heart rate and level of consciousness) documented by the EMS personnel on the scene. Based on the aggregate NEWS, patients were categorized into low, medium, and high risk groups according the statement by the Royal College of Physicians. [9] (See Additional file 1) Pre-hospital data, including prehospital NEWS, were coupled to the mortality data retrieved from the Causes of Death Registry maintained by Statistic Finland [11] using the patients’ national personal identification numbers.
Statistical analyses
Statistical analyses were performed using SPSS Statistics, version 24 (IBM Corp., Armonk, NY). Summary measurements are expressed as the mean, standard deviation, and range, unless otherwise stated. When calculating the NEWS, missing values and symbols indicating normal values (e.g., ϕ, N) were considered within normal range.
We used an EMS mission (as each mission represent one patient) as the unit in all analyses and calculations. Kaplan-Meier survival curves were drawn for the 30-day mortality. Risk ratios (RR) with 95% confidence intervals were calculated and Wald’s test was used for statistical comparison with reference level. Sensitivities, specificities, positive predictive values (PPVs), negative predictive values (NPVs), positive likelihood ratios (PLRs), and negative likelihood ratios (NLRs) were calculated for 1-day and 30-day mortalities at the cut-off risks. The selection criteria with a high sensitivity and high NPV were indicated as efficient to predict patients at risk of death.
Results
The EMS responded to a total of 16,177 missions during the study period. In 303 cases (1.9%), the unique personal identification number was lacking and a link to follow-up data was not available. After excluding these and the other emergencies fulfilling the exclusion criteria, 12,426 missions representing 7620 individual patients were included in the final analysis (see Additional file 2). Of these patients, EMS encountered 5419 patients once during the study period, while 2201 patients had two or more EMS contacts. The patients’ mean age was 63.1 (SD 22.6) years and 49.6% were female (Table 1).
The records of all patient charts showed symbols indicating normal values or missing data rather than exact numeric measurements for heart rate in 7.0% of the cases, systolic blood pressure in 10.6%, oxygen saturation in 10.9%, level of consciousness in 12.7%, temperature in 23.0%, and respiratory rate in 57.4% (in the low, medium and high risk NEWS groups for respiratory rate in 63.8, 43.3 and 9.9%, respectively) of the cases.
In 561 cases, the patient died within 30 days from the EMS contact, representing a 4.5% overall 30-day mortality. Of these 561 cases, 191 deaths occurred within 24 h: 118 during the prehospital phase, and 73 in the hospital.
The calculated prehospital NEWS ranged from 0 to 18, with a median score of 2. In 34.9% (4342) of the cases the NEWS was 0. The distribution of the prehospital NEWS and relation with 1-day and 30-day mortalities are shown in Fig. 1, which points out that the 1-day mortality rate for NEWS values ≤12 was lower than 7% and for values ≥13 higher than 20%. 30-day mortality rate was higher than 10% with prehospital NEWS value above 6 (Fig. 1).
The 1-day and 30-day mortalities according to prehospital NEWS are explained in more detail in Tables 2 and 3. The cumulative 30-day Kaplan-Meier survival curves are presented in Fig. 2. Patients in the high risk NEWS group demonstrated a relative risk for 1-day and 30-day mortality of 101.5 and 16, respectively, compared with the low risk group. There was a 4.4 increase in the relative risk for 1-day mortality for the medium risk NEWS group compared with the low risk category (Table 2). The 30-day mortality rate in the high risk NEWS group differed substantially from the medium and low risk groups (Fig. 2). The highest NEWS category showed a good sensitivity for 1-day mortality (0.801) but 30-day sensitivity was low (0.424). Specificities and NPVs were high. (Table 3).
Circulatory system diseases were the leading causes of death in this unselected EMS population, representing 44.2% of deaths during the 30 days after the EMS encounter. Other causes were neoplasms (16.6%), diseases of the nervous system (10.5%), and external causes (e.g. injuries, poisonings) (9.8%). The proportion of circulatory system diseases and external causes dominated in deaths within 24 h from the EMS encounter; while neoplasms and diseases of the nervous system increased during days 2–30 (Table 4).
Discussion
This study showed a rather twofold accuracy of using NEWS in the prehospital patient population to predict short-term mortality. The high risk NEWS category could predict 8 in 10 early deaths within 24 h, but failed to acceptably predict 30-day mortality due to a high rate of false negatives. Since the prehospital NEWS is often based on the single values measured in the brief time interval, it may not adequately discriminate patients who may deteriorate later. Although NEWS is designed and used to detect patients who may develop critical illness, and not directly intended to predict mortality, it is of interest to discuss the use of NEWS to support prehospital decision-making.
Overall, prehospital NEWS showed low sensitivity for 30-day mortality. This may be explained by the patients’ higher ages and the greater proportion of deaths occurring 2–30 days after EMS contact, caused by chronic diseases (e.g. neoplasms and diseases of the nervous system). A Scottish study, describing a cohort of 1684 transported EMS patients, identified high-risk prehospital NEWS patients with 48-h and 30-day sensitivities for mortality of 0.71 and 0.40, [10] respectively, which resembles our results. However, compared with our study, only in-hospital deaths were included, and follow-up after discharge was incomplete, causing a potential underestimation of the mortality rate.
Our present results showed that the overall 1-day mortality in the EMS population was 1.5%, whereas 30-day mortality was 4.3%. This concurs with a recent population-based Danish study, which reported 1.8 and 4.7% for the 1-day and 30-day mortalities, respectively, of EMS patients transported to the hospital. [12] A Swiss population-based study demonstrated a 48-h mortality rate of EMS patients as high as 11%. [13] However, those figures are not fully comparable to our result due to differences between countries in the dispatch protocols and the EMS systems.
Interestingly, our results differ from the in-hospital cohort related to 1-day mortality. [14] The study by Smith et al. showed that 1-day mortality for hospital patients increased promptly as the NEWS value exceed 7, [14] while in our material the increase in 1-day mortality occurred with NEWS value greater than 12. However, in our series the 30-day mortality was above 10% in those patients with NEWS value higher than 6.
The diagnostic pattern of causes of death were different between 1-day and 2–30 –day deaths. In both groups, the deaths caused by the cardiovascular diseases dominate, but the proportion of traumatic deaths was greater within 1-day. Although prehospital emergency care has developed significantly over the last decades, a notable proportion of traumatic deaths are still estimated to be preventable. [15] A large number of deaths due to neoplasms and diseases of the nervous system indicate that many chronically ill patients need EMS during their last days of life, either due to acute exacerbation or to deterioration of general condition.
A somewhat surprising finding was that in more than half of all patient charts, a numeric number for respiratory rate was missing although it was recorded as normal. Respiratory rate is an important parameter in several scoring systems, and it may be that the significance of accurate documentation has received too little attention during training. The importance of documenting this has been recognised in the development of the national electronic EMS charting system where respiratory rate will be a compulsory data field to fill.
Limitations and strengths
An evident limitation of this study was that in 303 cases, a Finnish personal identification number was missing and, therefore, mortality data could not be retrieved. These patients may have had a higher or lower mortality, and thus caused a bias in the study. However, they represent only 1.9% of the EMS calls. In addition, when calculating the NEWS, missing values and markings indicating normal values were considered normal; thus, some patients might have been incorrectly classified with a lower risk. Especially in respiratory rate, paramedics tend to mark value as normal if the breathing is considered normal according to the clinical judgement. However, in daily practice, patients with more severe disease are more comprehensively assessed; therefore, excluding a significant proportion of low risk patients with incomplete data would distort the results. In addition, in this study, there were a number of patients with several EMS contacts within a short period of time, which may have distorted the results. Finally, the results may not apply to systems with different population densities or morbidity indexes.
The main strength of this study was that we included an entire prehospital patient population in two hospital districts. The EMS entity is better described, if not only focused on specific conditions. Both the EMS databases as well as the Death Cause Registry were complete with no missing information. The quality of the Finnish Death Cause Registry is also high [16].
Clinical significance
In Finland, the prehospital NEWS is designed to be implemented in the national EMS database. Our results imply that NEWS in the prehospital setting may be of value when assessing the mortality risk within 24 h and hence immediate need for medical care. However, based on this cohort, NEWS alone cannot guide decision-making about the urgency of transport, the destination of transport, or whether to transport or not, and needed to be further studied. Other tools are needed to predict long-time mortality risk and may include other risk scoring systems applied at the emergency units.
Conclusion
In prehospital environment, the high risk NEWS category was associated with 1-day mortality well above that of the medium and low risk NEWS categories. This effect was not as noticeable for 30-day mortality. The prehospital NEWS may be useful tool for recognising patients at early risk of death, allowing earlier interventions and responds to these patients.
Abbreviations
- ALS:
-
Advanced life support
- BLS:
-
Basic life support
- EMCC:
-
Emergency medical communication centre
- EMS:
-
Emergency medical service
- FRU:
-
First responding unit
- NEWS:
-
National Early Warning Score
- NPV:
-
negative predictive value
- PPV:
-
positive predictive value
References
Ornato JP. Science of emergency medical dispatch. Circulation. 2009;119:2023–5.
Goldhill D, R., McNarry A, F. Physiological abnormalities in early warning scores are related to mortality in adult inpatientsâ€. BJA. Br J Anaesth. 2004;92:882–4.
Wilson S, Cooke M, Morrell R, Bridge P. Allan T. A systematic review of the evidence supporting the use of priority dispatch of emergency ambulances. Prehosp Emerg Care. 2002;6:42–9.
Williams TA, Tohira H, Finn J, Perkins GD, Ho KM. The ability of early warning scores (EWS) to detect critical illness in the prehospital setting: a systematic review. Resuscitation. 2016;102:35–43.
Schoos MM, Sejersten M, Baber U, Treschow PM, Madsen M, Hvelplund A, et al. Outcomes of patients calling emergency medical Services for Suspected Acute Cardiovascular Disease. Am J Cardiol. 2015;115:13–20.
Sasson C, Rogers MAM, Dahl J, Kellermann AL. Predictors of survival from out-of-hospital cardiac arrest. Circ Cardiovasc Qual Outcomes. 2010;3:63–81.
Rawshani A, Larsson A, Gelang C, Lindqvist J, Gellerstedt M, Bång A, et al. Characteristics and outcome among patients who dial for the EMS due to chest pain. Int J Cardiol. 2014;176:859–65.
Brice JH, Garrison HG, Evans AT. Study design and outcomes in out-of-hospital emergency medicine research: a ten-year analysis. Prehosp Emerg Care. 2000;4:144–50.
Royal College of Physicians. National Early Warning Score (NEWS): standardizing the assessment of acute-illness severity in the NHS. Report of a working party. In: London; 2012.
Silcock DJ, Corfield AR, Gowens PA, Rooney KD. Validation of the National Early Warning Score in the prehospital setting. Resuscitation. 2015;89:31–5.
Statistic Finland. Statistical database. 2015.
Christensen EF, Larsen TM, Jensen FB, Bendtsen MD, Hansen PA, Johnsen SP, et al. Diagnosis and mortality in prehospital emergency patients transported to hospital: a population-based and registry-based cohort study. BMJ Open. 2016;6(7):e011558.
Pittet V, Burnand B, Yersin B, Carron P. Trends of pre-hospital emergency medical services activity over 10 years: a population-based registry analysis. BMC Health Serv Res. 2014;14:380.
Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84:465–70.
Bakke HK, Wisborg T. The trauma chain of survival — each link is equally important (but some links are more equal than others). Injury. 2017;48:975–7.
Sund R. Quality of the Finnish hospital discharge register: a systematic review. Scand J Public Health. 2012;40:505–15.
Acknowledgements
The authors thank MSc. Pasi Ohtonen for statistical assistance, and the EMS managers, Jukka Angerman and Markku Alalahti, for processing research data. The authors also thank all EMS providers.
Funding
The study was funded by an Oulu University Hospital EVO grant.
Availability of data and materials
Please contact the author for data requests.
Author information
Authors and Affiliations
Contributions
All authors designed the study, analysed and interpreted the data, and drafted and critically revised the manuscript. MH collected and extracted the data. All authors have read and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This was a registry study with an observational study design, and no clinical interventions were performed. In Northern Finland, including the Kainuu and Länsi-Pohja hospital districts, the Regional Ethics Committee is centralized in the Northern Ostrobothnia Hospital District, which granted approval for the study. Permission to perform this study was also obtained from both Hospital Districts and the Office of Data Protection Ombudsman. Due to the study design and the large sample size, the consent of the individual patient was not required.
Competing interests
MH reports EVO research funding to Oulu University Hospital. TS and TA declare that they have no financial or any other conflicts of interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional files
Additional file 1:
NEWS usage; calculation of NEW-score and definition of the clinical risk. (DOCX 137 kb)
Additional file 2:
Flow chart of study cohort. (PDF 35 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Hoikka, M., Silfvast, T. & Ala-Kokko, T.I. Does the prehospital National Early Warning Score predict the short-term mortality of unselected emergency patients?. Scand J Trauma Resusc Emerg Med 26, 48 (2018). https://doi.org/10.1186/s13049-018-0514-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13049-018-0514-1