Performance of the efferent limb of a rapid response system: an observational study of medical emergency team calls
© Sørensen and Petersen. 2015
Received: 11 March 2015
Accepted: 27 June 2015
Published: 17 September 2015
To determine the distribution of outcomes following a medical emergency team (MET) call using a modified version of the multidisciplinary audit and evaluation of outcomes of rapid response (MAELOR) tool, and to evaluate its usefulness in monitoring the performance of the efferent limb of the rapid response system (RRS) at our institution.
An observational study of prospectively collected data including all MET calls at our institution during the 36 weeks study period (23 December 2013 – 31 august 2014). Outcomes of MET calls were registered 24 h after the call occurred and categorized according to the MAELOR tool.
Fifty-five of a total of 308 MET calls were excluded due to prior limitations in treatment. Of the remaining cases 66 % had positive outcomes. Thirty two percent of the calls resulted in transfer to the ICU, of these 73 % occurred within 4 h. Patients remained on the ward in 53 % of the cases, and 56 % of these were no longer triggering at follow up. Nine patients had died at follow-up, three without a DNAR order. Three patients were lost to follow-up, two patients were discharged from the hospital and 25 remained alive on the ward with a DNAR as a consequence of the MET call.
ICU transfer was implemented rapidly in most cases once the decision was made, but a disturbingly large number of patients, who remained on the ward were still triggering at 24 h follow-up. We found the MAELOR-tool useful to evaluate RRS efferent limb performance.
It is well documented that serious adverse events (SAEs) such as cardiac arrest, unanticipated intensive care unit (ICU) admission and unexpected death among hospitalized patients frequently are preceded by signs of physiological instability [1, 2]. To prevent these events from occurring an increasing number of hospitals use rapid response systems (RRS) to identify at-risk patients early and intervene appropriately. RRS consist of an afferent limb with a track-and-trigger system based on vital signs to identify deteriorating patients early and trigger a call to the efferent limb, usually a medical emergency team (MET). MET is manned with clinicians and/or nurses with special knowledge and skills in critical care or emergency medicine .
Despite its widespread use unequivocal documentation of effect of RRS is lacking. A number of observational studies and and two randomized controlled trials have shown conflicting results of RRS’ effects on the overall hospital mortality or incidence of SAEs [3–6]. Care of deteriorating on the ward patients is a complex process involving a wide number of staff with different backgrounds. In order for the system to be successful individuals involved have to fulfil their specific role at each level of the system. Lack of effect of RRS’s is often blamed on suboptimal implementation rather than inherent flaws of the system and accordingly a number of studies have shown that especially failure of the afferent limb is prevalent whereas performance of the efferent limb is less well investigated [7–10]. Afferent limb failure can be fairly easily described as delayed or absent activation of the MET, however efferent limb failure is much harder to evaluate, partly due to lack of definition of clinical deterioration. The usual outcome parameters based on the abovementioned SAEs all have their drawbacks. Cardiac arrest and unexpected death are variably defined in different studies, and are highly influenced by the number of limitations in treatment issued by the MET including do not attempt resuscitation (DNAR) orders . Admission to the ICU is not necessarily a bad outcome, and is also highly dependent on institutional practices. In order to overcome some of these shortcomings Morris et al recently introduced the multidisciplinary audit and evaluation of outcomes of rapid response (MAELOR) tool to evaluate the performance of the efferent limb of the RRS . The tool has been tested in two facilities in the UK to demonstrate the feasibility of measuring the effect of RRS on patient outcomes. It was found that the tool served well to classify patient outcomes following RRS activation, to improve areas of suboptimal performance, and to operate as a benchmarking tool.
In this study we used a modified version of the MAELOR-tool. The purpose was to determine whether or not the tool was reproducible and applicable at our institution. Furthermore we examined the distribution of positive and negative outcomes, and evaluated the usefulness of MAELOR in monitoring the performance of the efferent limb of our RRS.
Materials and method
Study design and setting
This was an observational study of prospectively collected data on outcomes of medical emergency team (MET) calls at our institution during a 36 weeks study period (23 December 2013 – 31 August 2014). We included data on all MET calls reported to our database by the members of the MET. The study was conducted at Bispebjerg University Hospital, Copenhagen, Denmark an inner-city hospital that serves a population of 300.000 with 280 medical and 195 surgical beds, and a mixed ICU with ten beds. The manuscript was prepared in accordance with the STROBE guidelines on reporting observational cohort studies that includes but is not limited to a detailed description of: study design and settings, data collection, eligibility and exclusion criteria for participants, methods of follow up, definition of relevant variables of outcomes, and statistical methods used .
MET and early warning score system
Early warning score with physiological parameters and corresponding weighted score and normal range
Respiratory Rate per min
9 – 11
12 – 20
21 – 24
92 – 93 %
94 – 95 %
Temperature degrees centigrade
35.1 – 36.0
36.1 – 38.0
38.1 – 39.0
Systolic blood pressure mmHg
91 – 100
101 – 110
111 – 219
Heart rate per min
41 – 50
51 – 90
91 – 110
111 – 130
Level of consciousness
V, P, U
Since 1 November 2013 data from MET calls have been registered electronically. Data is collected by a member of the team and includes: date of admission, date of call-out, arrival time of MET, last EWS prior to MET review, patient status after MET visit, and treatment limitations either prior to MET call or as a consequence of the call. ICU admissions and medical records including EWS were extracted from separate registers (CIS, Daintel, Denmark) and KISO (CSC, Denmark), respectively.
All patients that received a MET call during the study period were eligible for inclusion. Patients with preexisting treatment limitations were excluded from the analysis, because the effect of MET review was considered limited in this population. Cardiac arrests were also excluded, as they were treated by a separate team. Patients were categorized as either surgical or medical, and we included ambulatory and psychiatric patients in the latter.
Patient follow-up and outcomes
We registered clinical outcomes for all calls included during the study period 24 h after MET review and categorized them according to a modified version of the MAELOR-tool . MAELOR supplies a matrix with mutually exclusive patient-related clinical outcomes that can be categorized as either positive or negative according to specific criteria. These include: admission to an ICU, alive on ward without DNAR, dead or other outcomes. ICU admission is labeled positive if it takes place within 4 h after call-out, otherwise it is negative. The time limit is chosen because previous studies have shown higher APACHE scores for patients with delayed ICU admission . Patients alive on the ward at 24 h follow-up were categorized as positive outcomes if they no longer triggered, i.e. had an EWS < 7, and negative outcomes if they had an EWS ≥ 7 unless the trigger was due to new pathology or chronically impaired vital signs due to and underlying chronic comorbidity. Option three included patients not admitted to the ICU and who had died at follow-up. They were categorized as positive outcomes if death occurred in extension to treatment limitations ordered by MET; all other deaths or cardiac arrests were labeled negative outcomes. The fourth and final option includes the following positive outcomes: alive on ward with DNAR order, alive on ward with EWS ≥ 7 due to chronic condition or new trigger, and patients discharged from hospital. Patients lost to follow up were categorized as negative outcome.
We used median and interquartile range for continuous data in descriptive statistics. Categorical variables were compared using Chi square test. Calculations were performed with RStudio, Version 0.98.501 software package (RStudio, Inc).
According to Danish law approval of the ethics committee is not required for observational studies, and the study was approved by the Danish Data Protection Agency (J.nr. 2013-41-1944). Data were collected and analyzed as part of a quality insurance initiative.
Age (+/- IQR)
73 (61 – 84)
69 (58 – 78)
71 (60 – 80)
Correlation between type of ward, gender, weekday, time of day and age with outcome
Day (8:00 – 16:00)
Evening (16:00 – 24:00)
Night (0:00 – 8:00)
Distribution of outcomes of the 253 included call-outs
Admission to ICU
1. Timely admission (<4 hrs)
2. Delayed admission (≥4 hrs)
Alive on ward
3. No longer triggering
4. Still triggering
5. With DNAR
6. No DNAR/ cardiac arrest
7. Alive with DNAR
9. Lost to follow up
We found no statistically significant differences for outcomes between ward type, gender, day of the week, time of day, or age.
In this study of MET calls we used a modified version of the newly introduced MAELOR-tool to assign patient outcomes to four mutually exclusive categories, and evaluated the performance according to predefined standards for each category as positive or negative . Two-thirds of all MET calls at our institution could be labeled as positive outcomes according to this tool. The largest group of poor outcomes is found among patients on the ward who still trigger 24 h after the call. They make up a concerning 23 % of all calls. Almost one-third of all MET calls result in transfer to the ICU, 73 % within the chosen time frame of less than 4 h, which still leaves a substantial number of MET-patients exposed to the risk of delayed admission. Thirty-one calls (12 %) resulted in limitations of treatment, with 20 % of these patients dead within 24 h.
MAELOR provides a useful tool to evaluate the performance of the efferent limb of RRS, both over time at the same institution and between institutions. Morris et al reported on the performance of RRS using MAELOR in a district general hospital with limited RRS coverage and a university hospital with a fully implemented 24 h RRS in place, and found a substantial difference in positive outcome rates of 75 % and 93 % between them. Transfer to the ICU was found to be delayed in 62 % and 2 % of all ICU admission respectively, and 25 % and 6 % of patients who remained on the ward were still triggering at 24 h follow-up. To be applicable for benchmarking it is mandatory that trigger tools, MET composition and case-mix are comparable between hospitals; consequently direct comparison of outcomes with our study is difficult. In addition we included all MET calls during the study period, unlike Morris who only included the first call per patient, and we used a trigger of EWS ≥ 7 in contrast to a modified EWS (MEWS) ≥ 3. Despite these differences we found an overall lower number of positive outcomes (66 %) compared to the other hospitals, and a 73 % rate of timely ICU transfers, which places our hospital between the other two. In 23 % of all calls at our institution the patients remained on the ward still triggering, compared to 15 % and 4 % of patients previously reported. So while it seems that ICU transfer is implemented fairly rapidly once the decision is made, far too many patients remain on the wards with inadequate care, many of whom might have benefited from transfer to higher levels of care in order to receive proper treatment for the underlying causes of their distress. A certain delay in ICU transfer can be acceptable if appropriate treatment is commenced on the ward in collaboration with MET, yet missed ICU transfers are to be avoided, both to ensure the best interest of the patient at risk, but also because proper monitoring and treatment of these patients often require resources both in competency and staffing, which are seldom met by general wards and could compromise care of the remaining patients. The reason so many patients stay on the ward with high triggers at our hospital is highly speculative, but could include commonly known barriers to MET activation, such as: negative feedback from MET, reluctance to call due to fear of reprimands from peers and superiors, or a feeling that a new MET call was not an option, since it already had been tried [7, 15].
There are a number of weaknesses in our study. Firstly, not all patients meeting the calling criteria are seen by MET. If MET is not activated by the staff, or if the patients are treated successfully by a doctor on the ward they will not be included in the study. We have earlier shown that many of the serious adverse events occurring at our institution are preceded by missed or delayed activation of the MET . These patients could affect the results in the outcome matrix, but it is impossible to predict in which direction. Secondly, for an unknown number of patients that are transferred to the ICU directly in connection with MET call, registration to the database is lacking due to time constraints of the staff, since the nurses and physicians manning MET also take care of the patient on admission. These patients would have improved the proportion of positive outcomes in category one. Thirdly, the study period covered a rather short period of time (36 weeks); this precludes us from drawing conclusions on seasonal variations, which could stem from differences in staffing during summer or higher disease burden during winter. Finally, an inherent drawback of the MAELOR tool is that it does not describe the causes of poor outcomes; it is also quite labor intensive which limits its usefulness for continuous quality surveillance. Despite these limitations we find MAELOR to be a useful tool to monitor the performance of the efferent limb of the RRS, and it could have a role as an intermittent measure of performance at the same institution over time. However it needs further evaluation in different institutions and healthcare systems, before its general use can be recommended.
In this study we evaluated the performance of the efferent limb of the RRS at our institution by using the recently introduced MAELOR tool that categorizes MET calls into clinically relevant, patient centered outcomes. We found an overall of 66 % positive outcomes according to this tool, including rapid transfer to the ICU in 73 % of all admissions to the ICU following review by the MET. However a disturbingly large number of patients (23 %) remained on the ward and were still triggering at 24 h follow-up. We found the MAELOR-tool useful to evaluate RRS efferent limb performance.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Devita M a, Bellomo R, Hillman K, Kellum J, Rotondi A, Teres D, et al. Findings of the first consensus conference on medical emergency teams. Crit Care Med. 2006;34(9):2463–78.View ArticlePubMedGoogle Scholar
- Kause J, Smith G, Prytherch D, Parr M, Flabouris A, Hillman K. A comparison of Antecedents to Cardiac Arrests, Deaths and EMergency Intensive care Admissions in Australia and New Zealand, and the United Kingdom - The ACADEMIA study. Resuscitation. 2004;62(3):275–82.View ArticlePubMedGoogle Scholar
- McGaughey J, Alderdice F, Fowler R, Kapila A, Mayhew A, Moutray M. Outreach and Early Warning Systems (EWS) for the prevention of intensive care admission and death of critically ill adult patients on general hospital wards. Cochrane Database Syst Rev. 2007;3:CD005529.PubMedGoogle Scholar
- McNeill G, Bryden D. Do either early warning systems or emergency response teams improve hospital patient survival? A systematic review. Resuscitation. 2013;84(12):1652–67.View ArticlePubMedGoogle Scholar
- Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, et al. Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet. 2005;365(9477):2091–7.View ArticlePubMedGoogle Scholar
- Priestley G, Watson W, Rashidian A, Mozley C, Russell D, Wilson J, et al. Introducing Critical Care Outreach: a ward-randomised trial of phased introduction in a general hospital. Intensive Care Med. 2004;30(7):1398–404.View ArticlePubMedGoogle Scholar
- Davies O, DeVita M, Ayinla R, Perez X. Barriers to activation of the rapid response system. Resuscitation. 2014;85(11):1557–61.View ArticlePubMedGoogle Scholar
- DeVita M a, Smith GB, Adam SK, Adams-Pizarro I, Buist M, Bellomo R, et al. “Identifying the hospitalised patient in crisis”-A consensus conference on the afferent limb of Rapid Response Systems. Resuscitation. 2010;81(4):375–82.View ArticlePubMedGoogle Scholar
- Trinkle RM, Flabouris A. Documenting Rapid Response System afferent limb failure and associated patient outcomes. Resuscitation. 2011;82(7):810–4.View ArticlePubMedGoogle Scholar
- Petersen JA, Mackel R, Antonsen K, Rasmussen LS. Serious adverse events in a hospital using early warning score - What went wrong? Resuscitation. 2014;85(12):1699–703.View ArticlePubMedGoogle Scholar
- Morris A, Owen HM, Jones K, Hartin J, Welch J, Subbe CP. Objective patient-related outcomes of rapid-response systems - a pilot study to demonstrate feasibility in two hospitals. Crit Care Resusc. 2013;15(1):33–9.PubMedGoogle Scholar
- Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PG, Vandenbrouke JP. The strengthening the reporting of observational Studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370:1453–7.View ArticleGoogle Scholar
- Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84(4):465–70.View ArticlePubMedGoogle Scholar
- Oglesby KJ, Durham L, Welch J, Subbe CP. “Score to Door Time”, a benchmarking tool for rapid response systems: a pilot multi-centre service evaluation. Crit Care. 2011;15(4):R180.PubMed CentralView ArticlePubMedGoogle Scholar
- Shearer B, Marshall S, Buist MD, Finnigan M, Kitto S, Hore T, et al. What stops hospital clinical staff from following protocols? An analysis of the incidence and factors behind the failure of bedside clinical staff to activate the rapid response system in a multi-campus Australian metropolitan healthcare service. BMJ Qual Saf. 2012;21(7):569–75.PubMed CentralView ArticlePubMedGoogle Scholar