- Original research
- Open Access
Low sensitivity of qSOFA, SIRS criteria and sepsis definition to identify infected patients at risk of complication in the prehospital setting and at the emergency department triage
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicinevolume 25, Article number: 108 (2017)
Sepsis is defined as life-threatening organ dysfunction caused by a host response to infection. The quick SOFA (qSOFA) score has been recently proposed as a new bedside clinical score to identify patients with suspected infection at risk of complication (intensive care unit (ICU) admission, in-hospital mortality). The aim of this study was to measure the sensitivity of the qSOFA score, SIRS criteria and sepsis definitions to identify the most serious sepsis cases in the prehospital setting and at the emergency department (ED) triage.
We performed a retrospective study of all patients transported by emergency medical services (EMS) to the Lausanne University Hospital (CHUV) over twelve months. All patients with a suspected or proven infection after the ED workup were included. We retrospectively analysed the sensitivity of the qSOFA score (≥2 criteria), SIRS criteria (≥2 clinical criteria) and sepsis definition (SIRS criteria + one sign of organ dysfunction or hypoperfusion) in the pre-hospital setting and at the ED triage as predictors of ICU admission, ICU stay of ≥3 days and early (i.e. 48 h) mortality. No direct comparison between the three tools was attempted.
Among 11,411 patients transported to the University hospital, 886 (7.8%) were included. In the pre-hospital setting, the sensitivity of qSOFA reached 36.3% for ICU admission, 17.4% for ICU stay of three days or more and 68.0% for 48 h mortality. The sensitivity of SIRS criteria reached 68.8% for ICU admission, 74.6% for ICU stay of three days or more and 64.0% for 48 h mortality. The sensitivity of sepsis definition did not reach 60% for any outcome. At ED triage, the sensitivity of qSOFA reached 31.2% for ICU admission, 30.5% for ICU stay of ≥3 days and 60.0% for mortality at 48 h. The sensitivity of SIRS criteria reached 58.8% for ICU admission, 57.6% for ICU stay of ≥3 days 80.0% for mortality at 48 h. The sensitivity of sepsis definition reached 60.0% for 48 h mortality.
Incidence of sepsis in the ED among patients transported by ambulance was 3.8 percent. This rate, associated to the mortality of sepsis, confirms the necessity to dispose of a test to early identify those patients.
The sensitivity performance of all three tools was suboptimal. The qSOFA score, SIRS criteria and sepsis definition have low identification sensitivity in selecting septic patients in the pre-hospital setting or upon arrival in the ED at risk of complication.
Sepsis is a frequently encountered life-threatening condition with a mortality rate greater than that of acute coronary syndrome or ischemic vascular stroke . In 1992  and 2001 , clinical criteria were proposed to define four different stages of sepsis: systemic inflammatory response syndrome (SIRS), sepsis, severe sepsis and septic shock. These criteria were used in the Early Goal-Directed Therapy (EGDT) strategy [4,5,6,7,8]: early recognition of sepsis, improvements in diagnostic procedures and prompt antibiotic therapy were largely implemented, leading to a decrease in overall mortality [9,10,11].
In 2016, the Sepsis Definition Task Force updated these criteria to increase the specificity for predicting mortality or intensive care unit (ICU) admission. This was done by adapting the criteria to the concepts of pathophysiology (in particular, organ dysfunction), and by removing the concept of SIRS . Regardless of definition, sepsis is still underdiagnosed or diagnosed with delay in the pre-hospital emergency setting and in the emergency department (ED), thereby prejudicing best delivery of care [13,14,15,16]. A study of paramedics’ decision-making, for example, considered 30–50% of septic patients as non-urgent [1, 13]. Unfortunately, the existing scores are limited in terms of performance at initial evaluation of patients; the diagnosis of sepsis is therefore still largely dependent on clinical training and physician experience. The SOFA score is intended to be used in the ICU and to a lesser extent in the ED, and is a valuable predictor of severe outcome . Nevertheless, it requires laboratory values, which are usually unavailable in the pre-hospital setting and at ED triage. Owing to these limitations, the task force suggested the use of the “quick SOFA” (qSOFA) score outside of critical care settings, to identify patients with suspected infection who are likely to develop complications of sepsis (ICU admission, in-hospital mortality) . The qSOFA score appears to be a better predictor of in-hospital mortality and ICU admissions for infected patients in the ED than the SOFA score . A recent study also suggested that qSOFA is better than previous criteria at predicting in-hospital mortality among patients with suspected infection in the ED, but in this study, data on the three components of qSOFA were collected at their worst level during the ED stay . Thus, the qSOFA score may be used as an additional tool to prompt prehospital and ED clinicians to consider the possibility of sepsis and escalate care appropriately. For paramedics as well as for ED triage, it is of prime interest to identify a clinical score to recognize the most serious cases among infected patients as early as possible.
The primary aim of this retrospective study was, in the prehospital emergency setting and at ED initial triage, to compare the identification sensitivity of the qSOFA with other clinical criteria or definition (SIRS, sepsis), in selecting, among infected patients, the most severe cases or those at risk of complication (in-hospital mortality at 48 h, admission to the ICU and ICU stay ≥3 days). The secondary goal was to measure the incidence and mortality of septic patients transported by emergency medical services (EMS) to a Swiss urban University Hospital ED.
Study design and setting
We performed a retrospective study on all patients transported by EMS to the Lausanne University Hospital (CHUV), between 1st January and 31st December 2012. The state of Vaud, an area of 3200 km2 in western Switzerland, supports a mainly urban and suburban population (730,000 in 2012). A centralised criteria-based dispatch centre covers the whole state and handles c.27,000 primary ambulance transports per year (secondary transfers between hospitals were excluded). There are seven regional hospitals equally distributed throughout the state and one University Hospital, CHUV, a 1050-bed tertiary referral centre. Ambulances are all staffed with emergency medical technicians (EMT) and/or paramedics using state protocols for autonomous intravenous access, cardiopulmonary resuscitation procedures, defibrillation and emergency drug administration. They assess the severity of a patient’s condition according to the National Advisory Committee for Aeronautics (NACA) score [20, 21]. In 2012, the ED triage station of CHUV received 56,836 patients (20% arriving by ambulance); they were all triaged by a four-level emergency scale, the Swiss Emergency Triage Scale . The ED admits adults (except ophthalmology and gynaecology patients) and the most critical paediatric cases; there is another specific paediatric ED for less severe cases. Of the 56,836 patients, 36,129 (63.5%) were treated in to the ED, while others were reoriented towards specialist consultants or to the out-patient primary care clinic. The most severe patients were admitted to ICU or ‘intermediate care’ units following their ED work up.
Population and data sources
The state health services gave us access to the prehospital charts of all patients transported by EMS to the CHUV ED during the year 2012. Patients <18 years old, prisoners, pregnant women, patients in cardio-respiratory arrest, severe trauma victims, and epileptic seizure cases were excluded. The charts, ED and hospital medical records were evaluated by one reviewer. All patients with a suspected infection without alternative diagnosis, or microbiologically proven infection found in the ED workup, were included. A suspicion or diagnosis of infection was made using the following data extracted from prehospital and electronic hospital records in the pre-hospital setting, at ED triage, and then during the first 6 h in the ED: clinical characteristics (systolic blood pressure [SBP], respiratory rate [RR], heart rate [HR], oxygen saturation, body temperature, neurological evaluation (glasgow coma scale (GCS)). Diagnosis on the discharge letter (source of infection, underlying conditions, immune status, outcomes), biological characteristics (laboratory values, microbiological data) and therapy (antibiotic treatment) were also used to include patients. Demographic characteristics (sex, age, date of death) were collected as well. The severity of the infection was assessed within the first 6 h in the ED. This allowed classification of the studied patients into two groups, according to the new definitions of the Third International Consensus Definitions : an infection group (infection without organ dysfunction) and a sepsis group (infection with organ dysfunction, including septic shock). Patients with advance directives requesting limited care were not excluded.
We calculated the qSOFA score and recorded if SIRS and sepsis definitions could be applied to each patient in both groups, at two specific time points: in the prehospital setting with data collected by EMS and at ED triage, with data collected by nurses.
The qSOFA score ranges from 0 to 3 with one point awarded for each of the following clinical signs: SBP ≤100 mmHg, RR ≥22/min, and altered mental status from baseline. A score ≥ 2 signals a greater risk of prolonged ICU stay or increased mortality.
The SIRS criteria use the clinical criteria of the Surviving Sepsis Campaign (SSC) for SIRS , comprising at least two of the following criteria: HR >90/min, RR >20/min and temperature < 36° or ≥38.3 °C.
The Sepsis definition used in this work follows the clinical criteria of SSC for severe sepsis : the SIRS definition plus one sign of organ dysfunction or hypoperfusion (GCS < 15 or decline from baseline, oxygen saturation < 90% or SBP <90 mmHg). We analysed the sensitivity of these entities at two specific time points, in the prehospital setting and at the ED’s triage, to predict ICU admission, ICU stay of ≥3 days and mortality at 48 h.
No direct comparison between the three tools was attempted.
Simple descriptive statistics were used to analyze population characteristics. We described data using percentages or medians with interquartile range (IQR). Sensitivities, medians, averages and percentages were calculated using XLSTAT, statistical software compatible with Microsoft Excel (https://www.xlstat.com).
There were 26,632 primary EMS transports within the State of Vaud in 2012. In total, 11,411 patients were transported to CHUV. In total, 890 patients fulfilled the criteria of a diagnosis or suspicion of infection in the ED; four had missing data and were excluded. Finally, 886 (7.8%) patients were included (Fig. 1).
In all, 462 (52.1%) patients were male, the mean age was 80 years (range: 22–102), and 131 (14.8%) were immunosuppressed (Table 1). Following the ED workup, 454 (51.2%) patients were classified in the infection group and 432 (48.8%) in the sepsis group (Fig. 1). The incidence of sepsis in the ED among patients transported by ambulance to CHUV was 3.8/100 patients.
Eighty patients (9.0%) were admitted to the ICU (16.9% of the sepsis group (73) and 1.5% of the infection group (7)), of whom 59 (73.8%) stayed in the ICU for ≥3 days (75.3% of the sepsis group (55) and 57.1% of the infection group (4)) (Table 1). Twenty-five (2.8%) patients died within 48 h after admission (5.3% of the sepsis group (23) and 0.4% of the infection group (2)) (Table 1). The site of infection was respiratory in 486 patients (54.9%), genitourinary in 178 (20.0%), gastrointestinal in 115 (13.0%) and skin and joint in 66 (7.4%) (Table 1). Infections were microbiologically documented in 354 patients (40%). The most commonly encountered pathogens were Escherichia coli (n = 137, 38.7%), Streptococci (n = 61, 17.2%), and Staphylococcus aureus (n = 27, 7.6%). Polymicrobial flora was found in 40 cases (11.3%).
Table 2 shows the numbers and rates of patients corresponding to the clinical entities studied correlated to the outcomes.
Sensitivity of the clinical tools in the prehospital setting
The sensitivity of qSOFA (≥2) reached 36.3% for ICU admission, 17.4% for ICU stay of ≥3 days and 68% for 48 h mortality. The sensitivity of SIRS criteria reached 68.8% for ICU admission, 74.6% for ICU stay of ≥3 days and 64% for 48 h mortality. The sensitivity of sepsis definition did not reach 60% for any outcome (Table 3).
Sensitivity of the clinical tools at ED triage
The sensitivity of qSOFA (≥2) reached 31.2% for ICU admission, 30.5% for ICU stay of ≥3 dayse and 60% for 48 h mortality. The sensitivity of SIRS criteria reached 58.8% or ICU admission, 57.6% for ICU stay of ≥3 days and 80.0% for mortality at 48 h. The sensitivity of sepsis definition reached 60.0% for 48 h mortality. All other measured values did not reach 60% for any outcome (Table 3).
Incidence of sepsis in the ED among patients transported by ambulance to CHUV is 3.8 per 100 patients. The high number of patients admitted with sepsis confirms the importance of this diagnosis in terms of volume and severity. Thus early recognition, which allows the possibility of initiating early treatment, is important [1, 11].
The qSOFA is a relatively new clinical score used to identify septic patients outside the critical care unit likely to develop complications. It has been validated in a prospective multicentric study for patients already ongoing ED work-up .
For patients in the pre-hospital setting or in the ED with infection diagnosed or suspected afterward, we retrospectively calculated the sensitivity of the qSOFA score, SIRS criteria and sepsis definitions to identify cases at risk of complication. In summary, the sensitivity performance of all three tools was suboptimal. The qSOFA score, in particular, does not achieve in recognizing the most seriously infected patients early, and so brings no extra value to paramedics or prehospital physicians in their quest to identify such. A similar conclusion was reached by Dorsett et al. , but on a much smaller population than in our study.
At ED triage, as previously reported [24, 25], qSOFA scored poorly in identifying severe sepsis, and was likewise poor in both pre-hospital and at ED triage in predicting ICU stays ≥3 days. In both settings, it was best in identifying infected patients at risk of mortality at 48 h.
The sepsis definition also performed poorly, as its sensitivity never exceeded 60%. However, the SIRS criteria performed well, both in the prehospital setting and at the ED triage, with sensitivity results from 68 to 80%, probably owing to the absence of specificity for organ dysfunction, which exists already at an advanced stage of infection. The SSC considers that SIRS criteria remain useful for the identification of infection . Williams et al. go even further by establishing that SIRS is associated with an increased risk of deleterious response to infection and mortality, and would be a useful screening tool . In the meantime, for the prehospital setting in particular, we are still awaiting a validated sensitive clinical tool to identify early septic patients of any severity, let alone those at risk.
Ours is a monocentric, retrospective study, conducted in a specific prehospital setting. qSOFA score, SIRS and sepsis definitions were only applied to confirmed or suspected infected patients within the ED; therefore, sensitivity was the sole performance measured. A sole reviewer determined the clinical categories and final diagnosis.
The qSOFA score, SIRS criteria and sepsis definition exhibited suboptimal performance for early recognition of infected patients at risk of complication in the prehospital setting or at ED triage. There is still a lack of a clinical tool to help prehospital caregivers and ED clinicians to identify early, prior to any laboratory results, infected patients at greater risk of poor outcome.
Lausanne University Hospital
Early goal-directed therapy
Emergency medical services
Emergency medical technicians
Glasgow coma scale
Intensive care unit
Mean arterial pressure
quick SOFA score
Systolic blood pressure
Systemic inflammatory response syndrome
Sepsis-related Organ Failure Assessment
Surviving sepsis campaign
Seymour CW, Rea TD, Kahn JM, Walkey AJ, Yealy DM, Angus DC. Severe sepsis in pre-hospital emergency care: analysis of incidence, care, and outcome. Am J Respir Crit Care Med. 2012;186(12):1264–71.
Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, Schein RM, Sibbald WJ. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM consensus conference committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992;101(6):1644–55.
Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS international sepsis definitions conference. Intensive Care Med. 2003;29(4):530–8.
Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R, et al. Surviving sepsis campaign: international guidelines for management of severe sepsis and septic shock: 2012. Crit Care Med. 2013;41(2):580–637.
Glickman SW, Cairns CB, Otero RM, Woods CW, Tsalik EL, Langley RJ, van Velkinburgh JC, Park LP, Glickman LT, Fowler VG Jr, et al. Disease progression in hemodynamically stable patients presenting to the emergency department with sepsis. Acad Emerg Med. 2010;17(4):383–90.
Kumar A, Roberts D, Wood KE, Light B, Parrillo JE, Sharma S, Suppes R, Feinstein D, Zanotti S, Taiberg L, et al. Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit Care Med. 2006;34(6):1589–96.
Rivers E, Nguyen B, Havstad S, Ressler J, Muzzin A, Knoblich B, Peterson E, Tomlanovich M. Early goal-directed therapy collaborative G: early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345(19):1368–77.
Seoane L, Winterbottom F, Nash T, Behrhorst J, Chacko E, Shum L, Pavlov A, Briski D, Thibeau S, Bergeron D, et al. Using quality improvement principles to improve the care of patients with severe sepsis and septic shock. Ochsner J. 2013;13(3):359–66.
Martin GS, Mannino DM, Eaton S, Moss M. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003;348(16):1546–54.
Sharif S, Owen JJ, Upadhye S. The end of early-goal directed therapy? Am J Emerg Med. 2016;34(2):292–4.
Stoller J, Halpin L, Weis M, Aplin B, Qu W, Georgescu C, Nazzal M. Epidemiology of severe sepsis: 2008-2012. J Crit Care. 2016;31(1):58–62.
Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801–10.
Groenewoudt M, Roest AA, Leijten FM, Stassen PM. Septic patients arriving with emergency medical services: a seriously ill population. Eur J Emerg Med. 2014;21(5):330–5.
Seymour CW, Band RA, Cooke CR, Mikkelsen ME, Hylton J, Rea TD, Goss CH, Gaieski DF. Out-of-hospital characteristics and care of patients with severe sepsis: a cohort study. J Crit Care. 2010;25(4):553–62.
Seymour CW, Carlbom D, Engelberg RA, Larsen J, Bulger EM, Copass MK, Rea TD. Understanding of sepsis among emergency medical services: a survey study. J Emerg Med. 2012;42(6):666–77.
Smyth MA, Brace-McDonnell SJ, Perkins GD. Identification of adults with sepsis in the prehospital environment: a systematic review. BMJ Open. 2016;6(8):e011218.17.
Vincent JL, Moreno R, Takala J, Willatts S, De Mendonca A, Bruining H, Reinhart CK, Suter PM, Thijs LG. The SOFA (sepsis-related organ failure assessment) score to describe organ dysfunction/failure. On behalf of the working group on sepsis-related problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996;22(7):707–10.
Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, Rubenfeld G, Kahn JM, Shankar-Hari M, Singer M, et al. Assessment of clinical criteria for sepsis: for the third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):762–74.
Freund Y, Lemachatti N, Krastinova E, Van Laer M, Claessens YE, Avondo A, Occelli C, Feral-Pierssens AL, Truchot J, Ortega M et al: Prognostic accuracy of Sepsis-3 criteria for in-hospital mortality among patients with suspected infection presenting to the emergency department. JAMA 2017, 317(3):301–308.
Tryba M, Brüggemann H, Echtermeyer V. Klassifizierung von Erkrankungen und Verletzungen im Notarztrettungssystemen. Notfallmedizin. 1980;6:725–7.
Weiss M, Bernoulli L, Zollinger A. The NACA scale. Construct and predictive validity of the NACA scale for prehospital severity rating in trauma patients. Anaesthesist. 2001;50:150–4.
Rutschmann OT, Hugli OW, Marti C, Grosgurin O, Geissbuhler A, Kossovsky M, Simon J, Sarasin FP. Reliability of the revised Swiss emergency triage scale: a computer simulation study. Eur J Emerg Med. 2017 Feb 14; doi: 10.1097/MEJ.0000000000000449.
Dorsett M, Kroll M, Smith CS, Asaro P, Liang SY, Moy HP. qSOFA has poor sensitivity for Prehospital identification of severe sepsis and septic shock. Prehosp Emerg Care. 2017:1–9.
Brabrand M, Havshoj U, Graham CA. Validation of the qSOFA score for identification of septic patients: a retrospective study. Eur J Intern Med. 2016;36:e35–6.
Giamarellos-Bourboulis EJ, Tsaganos T, Tsangaris I, Lada M, Routsi C, Sinapidis D, Koupetori M, Bristianou M, Adamis G, Mandragos K, et al. Validation of the new Sepsis-3 definitions: proposal for improvement in early risk identification. Clin Microbiol Infect. 2017;23(2):104–9.
Antonelli M, DeBacker D, Dorman T, Kleinpell R, Levy M, Rhodes A: Surviving sepsis campaign responds to Sepsis-3. 2016.
Williams JM, Greenslade JH, McKenzie JV, Chu K, Brown AF, Lipman J. SIRS, qSOFA and organ dysfunction: insights from a prospective database of emergency department patients with infection. Chest. 2017;151(3):586–96.
Marina Braschler for her contribution to the retrospective database.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study was approved by the local Institutional Review and Ethics Boards of the University of Lausanne (Commission cantonale d’éthique de la recherche sur l’être humain (CER_VD), protocol 186/15). No authorisation from patients was required as ours was a retrospective study on de-identified lists of patients.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.