Multiple failed intubation attempts are associated with decreased success rates on the first rescue intubation in the emergency department: a retrospective analysis of multicentre observational data

Background

Although the international guidelines emphasize early and systematic use of rescue intubation techniques, there is little evidence to support this notion. We aimed to test the hypothesis that preceding multiple failed intubation attempts are associated with a decreased success rate on the first rescue intubation in emergency departments (EDs).

Methods

We analysed data from two multicentre prospective registries designed to characterize current ED airway management in Japan between April 2010 and June 2013. All patients who underwent a rescue intubation after a failed attempt or a series of failed attempts were included for the analysis. Multiple failed intubation attempts were defined as ≥2 consecutive failed intubation attempts before a rescue intubation. Primary outcome measure was success rate on the first rescue intubation attempt.

Results

Of 6,273 consecutive patients, 1,151 underwent a rescue intubation. The success rate on the first rescue intubation attempt declined as the number of preceding failed intubation attempts increased (81% [95% CI, 79%-84%] after one failed attempt; 71% [95% CI, 66%-76%] after two failed attempts; 67% [95% CI, 55%-78%] after three or more failed attempts; P_trend <0.001). In the multivariable analysis adjusting for age, sex, principal indication, change in methods, devices, and intubator specialty, and clustering of patients within EDs, success rate on the first rescue intubation after two failed attempts was significantly lower (OR, 0.56; 95% CI, 0.41-0.77) compared to that after one failed attempt. Similarly, success rate on the first rescue intubation attempt after three or more failed attempts was significantly lower (OR, 0.49; 95% CI, 0.25-0.94) compared to that after one failed attempt.

Conclusion

Preceding multiple failed intubation attempts was independently associated with a decreased success rate on the first rescue intubation in the ED.

Successful intubation is a critical and central intervention in the emergency department (ED). In particular, the concept of first pass success is frequently promoted as the goal of emergency airway management [1-4]. However, first intubation attempts in EDs are often unsuccessful; the literature documents that 17% to 29% of all ED intubations require two or more intubation attempts [4-8].

Given the emerging evidence that repetitive intubation attempts are associated with an increased risk of adverse events in the ED [3,4], early and successful rescue intubation approaches – e.g., use of alternative methods, devices, and intubators – become important. The international anaesthesia consensus statement emphasizes early use of rescue intubation approaches in the airway management [9-12], and several studies from the anaesthesia and pre-hospital literature support this approach [13-16]. However, to the best of our knowledge, there is no evidence to support or refute the early use of rescue intubation in the ED.

To address this knowledge gap in the literature, by using large prospective multicentre registry data of emergency airway management, we aimed to examine whether preceding multiple failed intubation attempts are associated with a decreased success rate on the first rescue intubation in the ED.

Study design and setting

We conducted a retrospective analysis of the Japanese Emergency Airway Network (JEAN) 1 and 2 registries. These multicentre prospective data registries were designed to describe current ED airway management across Japan. The study setting, methods of data collection, and measured variables of the JEAN 1 registry have been reported elsewhere [3,7,17,18]. Briefly, JEAN 1 was a consortium of 13 academic and community medical centres from different geographic regions across Japan. The participating institutions were certified as Level I (n = 11) or Level II equivalent (n = 2) trauma centres. These EDs had a median of 25,000 patient visits in the ED per year (range, 4,200 - 67,000). After the completion of JEAN 1 in March 2012, the JEAN 2 was initiated in April 2012.

JEAN 2 registry is also a prospective multicentre registry that aims to investigate the emergency airway management in the EDs. The study design and methods of data collection were similar to JEAN 1. JEAN 2 was a consortium of 11 academic and community medical centres across Japan. The participating institutions were certified as Level I (n = 9) or Level II equivalent (n = 2) trauma centres. These EDs had a median ED census of 30,000 patient visits per year (range, 14,000-67,000).

The EDs of all JEAN 1 and JEAN 2 participating centres were staffed by emergency medicine physicians, and all but one ED in JEAN 1 were affiliated with an emergency medicine residency training program. Non-emergency medicine residents also rotated through all EDs and participated in intubations. Paediatric patients were treated in all EDs. Each ED maintained individual protocols for the procedures and policies for emergency airway management. Airway management was performed by attending physicians, or by residents at the discretion of attending physicians in the EDs. The institutional ethics committee at each participating institution approved the study with waiver of informed consent.

Participants

The registries collected information on all adult and paediatric patients who underwent intubation attempts in the ED between April 2010 and June 2013. Among these patients, those who underwent a rescue intubation after a failed attempt or a series of failed attempts were eligible for this analysis. We excluded patients who died before achieving intubation success, and those who were intubated by unknown intubator status or with using unknown methods or devices.

Data collection and processing

After each intubation encounter in the ED, the intubator completed a standardized data collection form. The measured variables were age, sex, principal indication for intubation, methods of intubation, all medications used to facilitate intubation, intubator’s level of training and specialty, number of intubation attempts, intubation success or failure, and associated adverse events [3,7,17,18]. The compliance of data form completion was monitored by site investigators with reviewing professional billing records. Where the data were missing or contradicting, the involved physicians were interviewed by site investigators to ascertain airway management details. These post hoc interviews occurred within two weeks of the patient encounter.

Outcome measurements

The outcome of interest was the success rate on the first rescue intubation. We defined a “first rescue intubation” as an intubation with a change in intubators, devices, and/or methods after a failed initial attempt or a series of failed attempts [5]. For example, when the intubator failed the initial intubation attempt with the use of sedative and attempted the second intubation with RSI, the following attempt with RSI was considered as “first rescue intubation.” In this study, we focused solely on first rescue intubation attempts given the clinical importance of early rescue success in EDs [4,19]. An oral attempt was defined as a single insertion of a laryngoscope (or other devices) past the teeth. For nasal intubations, an attempt was defined as a single insertion of a tracheal tube past the turbinates. An attempt was successful if it resulted in a tracheal tube being placed through the vocal cords, with confirmation by quantitative or colorimetric end-tidal carbon dioxide monitoring [6,7]. The alternative methods after a failed intubation attempt included rapid sequence intubation (RSI), intubation with sedatives, nasal intubation, and cricothyrotomy/tracheotomy. The adjunctive devices included video laryngoscopes, fiberoptic bronchoscopes, other types of direct laryngoscope, combination of a gum elastic bougie with direct laryngoscope or video laryngoscope, and supraglottic devices.

Statistical analysis

Summary statistics were presented by means (with standard deviations [SDs]), medians (with interquartile ranges [IQRs]), and proportions (with 95% confidence intervals [CIs]) as appropriate.

For the purpose of this retrospective analysis, we classified the eligible patients into three groups based on the number of failed intubation attempts before the first rescue intubation: one failed attempt, two failed attempts, and three or more failed attempts. We defined multiple failed intubation attempts as two or more consecutive failed intubation attempts before the first rescue intubation attempt. To examine the association between the number of failed attempts before the first rescue intubation and the success rate on the first rescue intubation, we constructed a random effects model with binomial response and with one failed attempt as the reference. We adjusted for a set of patient-level confounders that was chosen based on biological plausibility and a priori knowledge [3,5,6,8,20], and account for the clustering of patients at the ED level. These patient-level variables included age, sex, principal indication for intubation, change in methods of intubation, change in devices, and change in intubator. We treated the number of failed intubation as a categorical variable after checking the linearity assumption. Similarly, age variables also treated as the categorical variable after checking the linearity assumption. Clinically meaningful interactions were tested as a group to avoid inflating type I error. Specifically, interactions between an indication for intubation and (1) a change in methods of intubation, (2) a change in devices of intubation, and (3) a change in intubator were tested using the likelihood ratio test. However, these interactions were not statistically significant, and therefore were not included in the final model (result not shown).

In sensitivity analysis, to assess the consistency of the association between the number of failed attempts and success rates on the first rescue intubation, we repeated the multivariable analysis, modelling with the number of failed attempts as dichotomous (2 or more vs. 1) and ordinal variables. In addition, to assess whether the success rate improves or declines with an increase in the number of failed attempts before the first rescue intubation, we used the Cochran-Armitage test. Summary statistics were conducted with JMP statistical software (version 10.0.2; SAS Institute, Inc., Cary, NC). The random effects model was conducted with R software version 3.0.3 (R Development Core Team, Vienna, Austria), with the lme4 package to fit the random effects models [21]. Two-sided P < 0.05 was considered statistically significant.

During the study period, a total of 6,273 patients required emergency airway management in 15 EDs. Among these, the database recorded 6,024 patients (capture rate, 96%). We excluded 4,093 patients with successful first intubation attempts, with unknown airway management status, and those who died before achieving intubation success in the ED (Figure 1). Of the remaining 1,931 patients, 1,151 patients underwent the first rescue intubation after one or more failed intubation attempts, and were eligible for the current analysis.

Patients receiving intubations in emergency departments, according the number of failed intubation attempts. All of the 23 patients who died during intubation had cardiac arrest as the primary indication of intubation (i.e., these patients had cardiac arrest prior to the intubation attempts).

Full size image

Overall, the median age of the patients was 65 years and 37% were female. The primary indication for intubation was medical in 80%, and cardiac arrest in 34%. Patient characteristics differed across the patient groups according to the number of failed attempts (Table 1). For example, the patients with two or more (multiple) consecutive failed attempts had a higher proportion of medical indications for intubation compared to the patients who underwent a rescue intubation after one failed attempt.

Overall, approximately half of the first rescue intubation attempts were performed without any medications, and rapid sequence intubation was used in an additional fifth of attempts. Direct laryngoscope was used in approximately 80% of rescue intubation attempts. Emergency physicians (including emergency medicine residents) performed approximately 80% of rescue intubation attempts. Similar to the patient characteristics, airway management at the first rescue intubation differed across the patient groups (Table 2). The patients with two or more consecutive failed attempts were more likely to receive the rescue intubation by an emergency medicine resident.

The overall success rate on first rescue intubation attempts was 78% (95% CI, 75%- 80%). The success rate on first rescue intubation attempts declined as the number of preceding failed intubation attempts increased (81% [95% CI, 79%-84%] after one failed attempt; 71% [95% CI, 66%-76%] after two failed attempts; 67% [95% CI, 55%-78%] after three or more failed attempts; P_trend <0.001; Figure 2).

First rescue intubation success rates, according to the number of failed intubation attempts. I bars represent 95% confidence intervals. The success rate on first rescue intubation attempts declined as the number of failed intubation attempts increased (81% [95% CI, 79%-84%] after one failed attempt; 71% [95% CI, 66%-76%] after two failed attempts; 67% [95% CI, 55%-78%] after three or more failed attempts; P_trend <0.001).

Full size image

In multivariable analysis adjusting for age, sex, principal indication, change in methods, devices, and intubator specialty, and clustering of patients within EDs, the success rate on first rescue intubations after two failed attempts was significantly lower (OR, 0.56; 95% CI, 0.41-0.77; Table 3) compared to that after one failed attempt. Similarly, the success rate on first rescue intubations after three or more failed attempts were significantly lower (OR, 0.49; 95% CI, 0.25-0.94) compared to that after one failed attempt. In the sensitivity analysis, the adjusted association between multiple failed intubation attempts and decreased success rates on first rescue attempts persisted with the use of different definitions of multiple failed attempts (Table 3).

Using the data from two large prospective multicentre observational registries of patients undergoing airway management in the EDs, we demonstrated that the success rate on the first rescue intubation attempt declined as the number of preceding failed intubation attempts increased. To the best of our knowledge, this is the first demonstration of an association between multiple failed intubation attempts and success rates at the rescue intubations in ED airway management.

Airway management has been advocated as the first step for critically ill patients in the ED. However, most of scientific knowledge of airway management originates from out-of-hospital or anaesthesia settings [10,22-28]. Generalizability of these data to the ED setting might be limited because of the difference in patient population (e.g., most of ED patients undergoing airway management are critically ill and have a limited physiologic reserve), setting (i.e., EDs are less controlled setting), individual training level of intubators, and resources. Many vital questions about ED-based airway management to avoid ineffective or potentially harmful interventions remains to be elucidated [29]. Although high-quality prospective clinical trials will provide more rigorous evidence to advance the science of ED airway management, it is often difficult to study airway management in critically ill patients in the ED setting. In the last decade, large prospective registries represented by the National Emergency Airway Registry, Korean Emergency Airway Management Registry, and JEAN registries have provided scientific evidence of emergency airway management [5-7,20]. These registries allow insights into not only individual and group performance but also infrequent outcomes such as failed intubations and rescue intubations. Although rescue intubation is deemed to be important [3,30-32], previous studies in the ED setting only examined the characteristics of rescue intubations and the predictors for successful rescue attempts after one failed attempt (i.e., not after multiple failed intubation attempts) [8,19].

The American Society of Anesthesiologists guidelines recommend the early use of alternative approaches after multiple failed intubations [10]. Several studies in the non-ED setting support this approach [13-15,33-35]. For example, two small single-centre studies reported successful implementations of the predefined algorisms that use alternative devices (e.g., gum elastic bougie and supraglottic airways) after two failed laryngoscopic attempts, both in the operating room (n = 100) [34] and prehospital settings (n = 160) [35]. Another single-centre observational study reported that the use of video laryngoscope was effective as a primary rescue device in failed intubation attempts in the ED setting [36]. These studies collectively suggest the importance of early and systematic approaches in rescue intubations after failed intubation attempts. Our data from the large multicentre registries extend these prior investigations by demonstrating the independent association between the number of preceding failed intubation attempts and lower success rates on the first rescue intubation. Our inference supports the recommendation to minimizing the number of initial intubation attempts and focus on changing or optimizing the next attempt to maximize chances of success.

If not directly causative, multiple failed attempts before the rescue attempt have a plausible relationship with the observed lower success rates on the first rescue intubation. Potential reasons for the observed association include the difference in patient characteristics, rescue methods, devices, and providers among the groups according the number of failed attempts. However, the observed association persisted after conditioning on these factors. Alternatively, multiple intubation attempts are known to result in direct airway trauma [3,4], thereby interfering with airway visualization. Additionally, multiple failed attempts may be an identifiable surrogate marker for a number of factors – e.g., unanticipated difficult airway, limited provider awareness of difficult airways, lack of resource or education for emergency airway management – that affect success rates but are difficult to quantify individually.

Our findings have several implications for airway management in the ED. For clinicians, our data support the strategy limiting the number of intubation attempts and the conventional wisdom emphasizing the early and systematic use of rescue interventions during ED intubation efforts. However, the use of patient characteristics to assess difficult airways and the evidence to guide the provision of optimal airway management in the ED remain limited. For emergency researchers, our findings should underscore the importance of high-quality research into risk stratification and integrated rescue intubation approach, coupled with dissemination of these findings to improve care for patients in the ED.

Our data consist predominantly of academic and urban EDs in Japan where emergency airway management is highly variable across the EDs [7]. Thus, similar studies with data from other countries with different training systems may result in different findings. Although one may surmise a limited generalizability of our inferences, the observed association between the number of preceding failed intubation attempts and decreased rescue success rates was large and persisted across various statistical assumptions. In addition, there are plausible mechanisms to support this conclusion. While we acknowledge that validations of our study findings in systems with established emergency medicine education and training are warranted, we believe that our inferences are clinically plausible and likely applicable to different practice settings.

In sum, based on data from two prospective multicentre observational studies of patients undergoing airway management in the ED, we demonstrated that an increased number of failed attempts was independently associated with a decreased success rate of the first rescue intubation attempt. Our results support the early and systematic use of rescue intubation techniques for emergency airway management, including the use of an experience intubator [5], RSI [37], and video laryngoscope [36,38] supported by the literature.

The current study has several limitations. There are inherent limitations related to the use of surveillance data. The surveillance system used in these registries is subject to self-reporting bias, thereby resulting in an overestimation of intubation success rates. Although independent real-time monitoring of airway management is difficult to perform in the ED, we used the previously applied self-reporting systems with standardized data forms and high capture rates [6,7]. Therefore, we believe that our data represent the best available data.

Second, the JEAN registries were not designed to measure intubation-associated adverse events according to each intubation attempt; therefore, we were unable to examine associations between delayed rescue intubations and adverse events.

Third, as with any observational study, the observed association between the multiple failed intubation attempts and lower rescue success rates does not necessarily prove causality and might be confounded by unmeasured factors. Potential confounding factors include underlying comorbidities, difficulty in intubation (e.g., anatomical deformities and obesity), individual intubator training levels and skill sets, and institution-level characteristics. However, the adjustment for the specialty as a proxy of individual training levels might have partially addressed this potential confounding.

Fourth, a smaller proportion of patients in our registries underwent intubation attempts using RSI and video laryngoscope compared to the previous studies in different practice settings [4-6,8,16,20], owing to, at least in part, a high degree of variation in airway management practices [7]. To address this concern, we fitted mixed model accounting for the potential clustering of patients at the ED level. Interestingly, we found that neither the use of RSI nor video laryngoscope had a higher odds of first rescue success, both of which were not consistent with the literature [8,28,36]. The potential explanation of these findings includes the presence of residual confounders between these factors and rescue success rates, the limited statistical power owing to the small number of RSI and video laryngoscope use, the use of video laryngoscope by novices, and random errors.

Fifth, because our sample consisted predominantly of EDs affiliated with emergency medicine residency programs in Japan, our inferences may not be generalizable to the other healthcare settings (e.g., emergency airway management performed by experienced anaesthesiologists, with a higher use of RSI and video laryngoscope). However, the observed association has plausible mechanisms and persisted across different analytic assumptions. Although formal validation of the study in other healthcare settings is warranted, our inference is likely present in different practice settings.

Finally, our objective was not to examine predictors of the success rates by multiple rescue attempts but those on first rescue attempts. However, as the literature documented that intubation-associated adverse event rates accelerate with the increased number of intubation attempts [3,4], our observations are of direct relevance to the development of more effective emergency airway management for critically ill patients.

ED:

Emergency department

JEAN:

Japanese emergency airway network

RSI:

Rapid sequence intubation

We acknowledge the following participating hospitals and research personnel for their assistance with this project: Fukui University Hospital (Takahisa Kawano, MD, Hideya Nagai, MD), Fukui Prefectural Hospital (Hidenori Higashi, MD, Shojiro Oka, MD, Takashi Matsumoto, MD), Kameda Medical Centre (Kenzo Tanaka, MD), Nagoya Ekisaikai Hospital (Shigeki Tsuboi, MD, Yukari Goto, MD), Nigata City General Hospital (Nobuhiro Sato, MD), Okinawa Chubu Prefectural Hospital (Masashi Okubo, MD, Yukiko Nakayama, MD), Shonan Kamakura General Hospital (Taichi Imamura, MD, Azusa Wendan, MD), St. Marianna University School of Medicine Hospital (Yasuaki Koyama, MD), Kurashiki Central Hospital (Hiroshi Okamoto, MD), Japanese Red Cross Wakayama Medical Centre (Hiroshi Okamoto, MD), Obama Municipal Hospital (Takuyo Chiba, MD, Yukinori Kato, MD), Tokyobay Urayasu Ichikawa Medical Centre (Hiroshi Kamura, MD), Osaka Saiseikai Senri Hospital (Kazuaki Shigemitsu, MD), National Centre for Global Health and Medicine (Shunichiro Nakao, MD), University Hospital, Kyoto Prefectural University of Medicine (Kotaro Takebe, MD); and our many emergency physicians and residents for their perseverance in pursuing new knowledge about this vital resuscitative procedure. We also thank Hisashi Ofuchi, MD (Shonan Kamakura General Hospital) for his logistical support.

This study was supported by a grant from St. Luke’s Life Science Institute and a grant from Massachusetts General Hospital and Brigham and Women’s Hospital (PI, Hasegawa). The study sponsors have no involvement in the study design, in the collection, analysis and interpretation of data; in the writing of the manuscript; and in the decision to submit the manuscript for publication

Affiliations

1. Department of Emergency Medicine, University of Fukui Hospital, 23-3, Shimoaiduki, Matsuoka, Eiheiji, Yoshida, Fukui, 910-1193, Japan

   • Tadahiro Goto
   •  & Hiroshi Morita

2. Department of Emergency Medicine, Okinawa Prefectural Chubu Hospital, Miyazato, Uruma, Okinawa, 904-2293, Japan

   • Koichiro Gibo

3. Division of Pediatric Emergency Medicine, Department of Pediatric Emergency and Critical Care Medicine, Tokyo Metropolitan Children’s Medical Centre, 2-8-29 Musashidai, Fuchu, Tokyo, 183-8561, Japan

   • Yusuke Hagiwara

4. Department of Emergency Medicine, Massachusetts General Hospital, Harvard Medical School Boston, Boston, Massachusetts, USA

   • David FM Brown
   •  & Kohei Hasegawa

5. Department of Emergency Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, Massachusetts, USA

   • Calvin A Brown III

Consortia

Corresponding author

Correspondence to Tadahiro Goto.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

TG, HM and KH conceived the study. KH obtained research funding. CAB, DFMB, and KH supervised the conduct of the study and data collection. KG and YH managed the data, including quality control. KG, YH, and KH provided statistical advice on study design and analysed the data; CAB, DFMB, and KH chaired the data oversight committee. TG drafted the manuscript, and all authors contributed substantially to its revision. TG takes responsibility for the paper as a whole. All authors read and approved the final manuscript.

Reprints and Permissions