- Original research
- Open Access
A randomised controlled trial of cognitive aids for emergency airway equipment preparation in a Paediatric Emergency Department
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine volume 24, Article number: 8 (2016)
Safety of emergency intubation may be improved by standardising equipment preparation; the efficacy of cognitive aids is unknown.
This randomised controlled trial compared no cognitive aid (control) with the use of a checklist or picture template for emergency airway equipment preparation in the Emergency Department of The Royal Children’s Hospital, Melbourne.
Sixty-three participants were recruited, 21 randomised to each group. Equal numbers of nursing, junior medical, and senior medical staff were included in each group. Compared to controls, the checklist or template group had significantly lower equipment omission rates (median 30 % IQR 20–40 % control, median 10 % IQR 5–10 % checklist, median 10 % IQR 5–20 % template; p < 0.05). The combined omission rate and sizing error rate was lower using a checklist or template (median 35 % IQR 30–45 % control, median 15 % IQR 10–20 % checklist, median 15 % IQR 10–30 % template; p < 0.05). The template group had less variation in equipment location compared to checklist or controls. There was no significant difference in preparation time in controls (mean 3 min 14 s sd 56 s) compared to checklist (mean 3 min 46 s sd 1 min 15 s) or template (mean 3 min 6 s sd 49 s; p = 0.06).
Template use reduces variation in airway equipment location during preparation foremergency intubation, with an equivalent reduction in equipment omission rate to the use of a checklist. The use of a template for equipment preparation and a checklist for team, patient, and monitoring preparation may provide the best combination of both cognitive aids.
The use of a cognitive aid for emergency airway equipment preparation reduces errors of omission. Template utilisation reduces variation in equipment location.
Australian and New Zealand Trials Registry (ACTRN12615000541505).
In every setting reported, non-operating room (OR) intubation is a high-risk, low frequency procedure. The adverse event rate is significantly higher and the first pass success rate significantly lower than that reported in the OR [1–11]. In addition to patient-related factors, several technical and non-technical (human) factors for this have been proposed, including: the time-critical nature of non-OR intubations, the infrequency with which they are performed, the high cognitive load on team members, the “flash teams” consisting of members who may be unfamiliar with each other and the intubation environment, the lack of standardised equipment and approach, and failure to plan for unanticipated difficulties with airway management [12–14]. Strategies aimed at minimising the risk of non-OR intubations include standardised equipment preparation through the use of a cognitive aid. Both checklists and templates have been used for this purpose. Checklists have been shown to reduce the number of items omitted during a standard induction protocol in the OR , and to reduce the adverse event rate of Emergency Department (ED) intubations in trauma patients . Templates have been described to ensure airway equipment is available and located in a standardised position during pre-hospital emergency airway equipment preparation (EAEP) , though their impact on patient-centred outcomes has not been studied. Use of cognitive aids during EAEP relies on two assumptions. Firstly that standardised preparation may reduce intubation related adverse events by reducing equipment errors. Secondly that standardised preparation should always include equipment for unanticipated difficulty with airway management. This involves setting up equipment for initial and subsequent intubation attempts, for failed intubation, and for a can’t intubate can’t oxygenate (CICO) scenario during preparation for every non-OR intubation. Standardisation and planning for unanticipated difficulty during EAEP is recommended by governing bodies and academic societies [18–22]. The United Kingdom’s 4th National Audit Project (NAP4) of major ED airway complications recommended that intubation equipment be standardised and that all equipment likely to be required for intubation (including rescue devices) be immediately available .
We aimed to compare the equipment omission rate during EAEP using no cognitive aid, using an airway checklist, or using an airway template. Standard airway cart intubation equipment recommended by the Australian Resuscitation Council (ARC) was used as a gold standard (Table 1) .
The study was conducted in the Emergency Department (ED) of The Royal Children’s Hospital, Melbourne. The ED has an annual census of >85 000 presentations, and performs regular audit of ED intubations . During routine clinical shifts, 2 ED resuscitation nurses, 1 junior and 1 senior emergency medical staff member comprise a resuscitation team caring for critically unwell or injured patients. Any of these team members are expected to be able to perform EAEP. ED resuscitation nurses receive airway education during training to work as part of the resuscitation team, and all nursing and junior medical staff participate in a half day multidisciplinary airway workshop during their ED term. Members of the resuscitation team (nursing, junior and senior medical staff) were recruited individually during clinical shifts and randomised to one of three groups: no cognitive aid (control), checklist (Fig. 1a), or template (Fig. 1b). The checklist was developed by adapting published versions [6, 24], and drafted using validated guidelines (http://www.projectcheck.org/). It included challenge-response prompts for the set-up of standardised airway equipment. The equipment template design was novel, and was undertaken by the study investigators in conjunction with the hospital’s Airway Special Interest Group. Equipment location and color-coding on the template was intended to reinforce a local Emergency Intubation Algorithm based on the Difficult Airway Societies plans A-D (http://www.das.uk.com). Equipment for pre-oxygenation and initial intubation attempts was located on the left-hand side of the template, and progressed from left to right to include equipment for subsequent intubation attempts, supra-glottic airway (SGA) rescue, and can’t intubate can’t oxygenate (CICO) kit. The template included endotracheal tube and laryngeal mask sizing charts for age/weight, and was intended to sit on top of the airway cart with equipment placed on its surface. Both the intubation checklist and template were piloted prior to inclusion in the study. This process involved feedback from all participant groups regarding layout and ease of use following simulated scenario-based patient encounters. The study was conducted in situ, in a fully equipped ED resuscitation bay. After obtaining written informed consent, participants were given identical clinical scenarios (Additional file 1) and asked to prepare the airway cart for intubation. Equipment not normally laid out on the airway cart (suction, oxygen and T-piece, medications, continuous waveform end-tidal CO2 monitor, video laryngoscope) was not included in the study. When the participant finished setting up the airway cart, their preparation time was recorded. A photograph of the airway cart was taken and the equipment prepared was manually logged on a clinical report form (Additional file 2). Equipment data was entered blindly into a study database, and equipment location was separately mapped using the un-blinded photographs. The primary outcome measure was the equipment omission rate in each study group. Secondary outcome measures included the combined errors of omission and sizing errors, the time taken for EAEP, and the location of airway equipment in each study group.
Our sample size calculation was based upon an absolute equipment omission rate of 80 % observed during an unpublished local observational study pilot. We estimated that introduction of a template or checklist would decrease in the equipment omission rate to 20 %. We aimed to recruit equal numbers nursing, junior, and senior medical staff. Using a superiority design, the study aimed to recruit 21 participants per group to deliver a power of 0.99 with an alpha of 0.05 (63 participants overall). Block randomisation using computer generated quasi-random numbers was stratified according to clinician seniority with equal distribution of strata (nursing, junior medical, and senior medical staff) per arm. The statistical analysis was based on intention to treat. Primary outcome analysis was the comparison of proportions of two independent samples using χ2 test. Standard deviation for normative data and interquartile ranges for skewed data were calculated.
The study was approved by the institutional ethics committee (HREC 35078a) and registered through the Australian and New Zealand Trials Registry (ACTRN12615000541505).
The equipment omission rate was significantly higher in the control group compared to the groups using a cognitive aid (checklist or template) (Table 2). There was no significant difference in omission rate between the groups using a checklist or template (p = 0.69). All participants in the control group omitted one or more items of equipment during EAEP. The combined rate of errors of omission and sizing errors was higher in the control group compared to the groups using a cognitive aid (checklist or template). There was no significant difference in the rate of errors of omission and sizing errors between the groups using a checklist or template (p = 0.32). The time taken to complete emergency airway preparation was quickest in the template group however this did not reach statistical significance. The only group to achieve 100 % completion within the time allocated in the clinical scenario (<5 min) was the template group.
Overall, junior medical staff had the highest rate of combined errors of omission and sizing (21 % and 8 %, respectively). Nursing staff had the lowest rate of error of omission (13 %), and senior medical staff the lowest rate of sizing errors (5 %).
The most commonly omitted equipment varied according to interventions used (Fig. 2). The omission rate in the control group was higher for all critical equipment, with only the nasogastric tube being omitted more frequently in the template group.
Equipment location was the most consistent in the template group (Fig. 3). There was no clear pattern of equipment location in the control or checklist groups.
In this randomised controlled trial, we found that the use of a cognitive aid (either checklist or template) was associated with a reduction in equipment omission rates during EAEP. In addition, combined errors of omission and sizing errors were reduced, and confidence with EAEP was improved using a cognitive aid. The use of a cognitive aid was not associated with an increase in time to complete EAEP. The variation in equipment location was reduced with the use of a template.
This is the first randomised controlled trial comparing equipment omission rates during EAEP with and without the use of a cognitive aid. Prior studies have shown a reduction in the intubation equipment omission rate in the OR setting , and a reduction in the adverse event rate during ED intubations of trauma patients after the introduction of a pre-intubation checklist into clinical practice . The most common equipment omissions in these studies included: back-up laryngoscope handles, stylets, and alternative ETT sizes. In our study, the most commonly omitted items were: alternative oropharyngeal airway sizes, a back-up laryngoscope handle, and a bougie. Before and after quality improvement studies aiming to improve the safety of non-OR intubations have demonstrated a reduction in adverse event rates through the use of protocolised checklist-driven care bundles . Additionally, intubation process measures, such as non-technical (human) factors, have been improved through checklist-driven protocols for rapid-sequence intubation (RSI) in trauma patients in the ED  and medical Intensive Care Unit (ICU) patients . These interventions address more than EAEP, though standardised equipment preparation may contribute to their effectiveness.
This study is generalisable to most non-OR intubations. Similar technical and non-technical factors exist between ED, ICU, medical emergency team, and pre-hospital environments, making standardised equipment preparation valid across these areas. For study purposes we used standard intubation equipment recommended by the ARC, though this could be modified for local use.
It was not the purpose of this study to demonstrate superiority of one cognitive aid over the other. Both the use of a checklist and template resulted in similar rates of equipment omission, though the equipment location was less variable using the template. The intubation checklist may, however, contain challenge-response prompts to address more than the equipment laid out on the airway cart, including team and patient factors, monitoring and medication factors, as well as equipment not routinely laid out on the airway cart (such as suction, oxygen, face-mask, and video laryngoscope). The airway template may be used in conjunction with the intubation checklist by incorporating “template completion” as a challenge response item. This may speed up the equipment checking process by “batching” the equipment listed on the airway cart. As demonstrated by the percentage errors of omission by study group (Fig. 2) the design of the cognitive aid clearly impacts on the type of omissions that result. In particular, the high rate of nasogastric tube omissions in the template group may have resulted from unclear equipment prompts on the template, which may be addressed by template refinement.
Some factors may have influenced the internal validity of this study. The intubation checklist used during the study had been in routine use for over one year at the time the study was conducted. The template, however, was introduced solely for the purposes of the study. This lack of familiarity may have resulted in poorer performance of those participants randomised to the template group. The CICO kit was routinely located on the side of the airway cart and was therefore never omitted in any study group. The study involved a simulated scenario, and therefore may not reflect how participants would perform during real scenarios. The study was, however, designed to simulate real ED pre-notification of patient arrival with a potential airway emergency. EAEP under these circumstances should occur regardless of whether the equipment ends up being used or not. We believe therefore that the study reflects real-life EAEP in the ED.
The predicted omission rate in the control group was much lower than anticipated by the local observational study pilot (80 % predicted vs 30 % observed). This may be explained by the Hawthorn Effect  and/or simulation artefact. Improved control group performance may have resulted in an underestimate of the effect size of the cognitive aids. Conversely, the presence of a cognitive aid does not ensure that it is used in clinical practice .
This study focussed on equipment preparation for non-OR intubation. Other aspects of non-OR intubation, such as patient, team, medication, and monitoring aspects of EAEP, were beyond the scope of this study. Though our results showed a clear improvement in the process of EAEP through the use of cognitive aids, it remains unclear whether this may translate into improved patient-centred outcomes.
Standardised airway equipment preparation using a cognitive aid may make emergency intubation a safer procedure. Further studies might examine the impact of standardised preparation on patient-centred outcomes.
Australian Resuscitation Council
can’t intubate can’t oxygenate
emergency airway equipment preparation
Intensive Care Unit
4th National Airway Project
Kerrey BT, Rinderknecht AS, Geis GL, Nigrovic LE, Mittiga MR. Rapid sequence intubation for pediatric emergency patients: higher frequency of failed attempts and adverse effects found by video review. Ann Emerg Med. 2012;60(3):251–9.
Nishisaki A, Turner DA, Brown 3rd CA, Walls RM, Nadkarni VM. A National Emergency Airway Registry for children: landscape of tracheal intubation in 15 PICUs. Crit Care Med. 2013;41(3):874–85.
Oglesby AJ, Graham CA, Beard D, McKeown DW. Paediatric intubation in Scottish emergency departments. Paediatr Anaesth. 2003;13(7):589–95.
Carroll CL, Spinella PC, Corsi JM, Stoltz P, Zucker AR. Emergent endotracheal intubations in children: be careful if it’s late when you intubate. Pediatr Crit Care Med. 2010;11(3):343–8.
Long E, Sabato S, Babl FE. Endotracheal intubation in the pediatric emergency department. Paediatr Anaesth. 2014;24(12):1204–11.
Cook TM, Woodall N, Harper J, Benger J. Major complications of airway management in the UK: results of the Fourth National Audit Project of the Royal College of Anaesthetists and the Difficult Airway Society. Part 2: intensive care and emergency departments. Br J Anaesth. 2011;106(5):632–42.
Heffner AC, Swords DS, Neale MN, Jones AE. Incidence and factors associated with cardiac arrest complicating emergency airway management. Resuscitation. 2013;84(11):1500–4.
Schwartz DE, Matthay MA, Cohen NH. Death and other complications of emergency airway management in critically ill adults. A prospective investigation of 297 tracheal intubations. Anesthesiology. 1995;82(2):367–76.
Mort TC. Complications of emergency tracheal intubation: immediate airway-related consequences: part II. J Intensive Care Med. 2007;22(4):208–15.
Walls RM, Brown 3rd CA, Bair AE, Pallin DJ. Emergency airway management: a multi-center report of 8937 emergency department intubations. J Emerg Med. 2011;41(4):347–54.
Mort TC. Complications of emergency tracheal intubation: hemodynamic alterations--part I. J Intensive Care Med. 2007;22(3):157–65.
Morton T, Brady S, Clancy M. Difficult airway equipment in English emergency departments. Anaesthesia. 2000;55(5):485–8.
Guidelines for difficult airway equipment in emergency departments
Leeuwenberg T. Airway Management of the Criticall Ill Patient: Modifications of Traditional Rapid Sequence Induction and Intubation. Critical Care Horizons. 2015;1(1):1–10.
Thomassen O, Brattebo G, Softeland E, Lossius HM, Heltne JK. The effect of a simple checklist on frequent pre-induction deficiencies. Acta Anaesthesiol Scand. 2010;54(10):1179–84.
Smith KA, High K, Collins SP, Self WH. A Preprocedural Checklist Improves the Safety of Emergency Department Intubation of Trauma Patients. Acad Emerg Med. 2015;22(8):989–92.
R Mackenzie JF, Lewis S, Steel A. A pre-hospital emergency anaesthesia pre-procedure checklist. Scandanavian Journal of Trauma, Resuscitation, and. Emerg Med. 2009;17:O26.
Benger J, Hopkinson S. Rapid sequence induction of anaesthesia in UK emergency departments: a national census. Emerg Med J. 2011;28(3):217–20.
Advanced life support for infants and children diagnosis and management. ARC and NZRC Guideline 2010. Emerg Med Australas. 2011;23(4):400–2.
Lockey DJ, Crewdson K, Lossius HM. Pre-hospital anaesthesia: the same but different. Br J Anaesth. 2014;113(2):211–9.
UK HEMS. Standard operating procedure: Rapid sequence intubation. 2007. Available from: http://www.ukhRa/RapidSequenceIntubationpdf. Accessed 01 May 2015.
Association of Anaesthetists of Great Britain and Ireland. Recommendations for standards of monitoring (4th edition). 2007. Available from: http://www.aagbiorg/sites/default/files/standardsofmonitoring07pdf. Accessed 01 May 2015.
Australian Resuscitation Council. Standards for Resuscitation: Clinical Practice and Education. 2014. Available from: http://resusorgau/standards-for-resuscitation-clinical-practice-and-education-release/. Accessed 01 May 2015.
Sherren PB, Tricklebank S, Glover G. Development of a standard operating procedure and checklist for rapid sequence induction in the critically ill. Scand J Trauma Resusc Emerg Med. 2014;22:41.
Jaber S, Jung B, Corne P, Sebbane M, Muller L, Chanques G, et al. An intervention to decrease complications related to endotracheal intubation in the intensive care unit: a prospective, multiple-center study. Intensive Care Med. 2010;36(2):248–55.
Ballow SL, Kaups KL, Anderson S, Chang M. A standardized rapid sequence intubation protocol facilitates airway management in critically injured patients. J Trauma Acute Care Surg. 2012;73(6):1401–5.
Mayo PH, Hegde A, Eisen LA, Kory P, Doelken P. A program to improve the quality of emergency endotracheal intubation. J Intensive Care Med. 2011;26(1):50–6.
McCarney R, Warner J, Iliffe S, van Haselen R, Griffin M, Fisher P. The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol. 2007;7:30.
Marshall SD, Mehra R. The effects of a displayed cognitive aid on non-technical skills in a simulated ‘can’t intubate, can’t oxygenate’ crisis. Anaesthesia. 2014;69(7):669–77.
The study investigators would like to thank the following individuals for their help with participant recruitment: Mr. David Beckerman and Mrs. Felicity Spencer-Keefe. In addition, we would like to thank the study participants for their voluntary inclusion. This study was supported in part by a National Health and Medical Research Council Centre of Research Excellence Grant for Paediatric Emergency Medicine (GNT1058560), Canberra, ACT, Australia and the Victorian Governments Infrastructure Support Program, Melbourne, Australia.
This study was funded internally by the Emergency Department of The Royal Children’s Hospital, Melbourne, Australia. This study was supported in part by a National Health and Medical Research Council Centre of Research Excellence Grant for Paediatric Emergency Medicine (GNT1058560), Canberra, ACT, Australia and the Victorian Governments Infrastructure Support Program, Melbourne, Australia.
None of the authors have declared any financial or personal relationships with other people or organisations that could inappropriately influence their work.
EL, PF and MJB conceived of the study and designed the trial. EL, PF, DRC, JG, and MJB supervised the conduct of the trial, recruited patients, and performed data collection. MJB performed statistical analysis. PF and DRC designed figures. EL drafted the manuscript, and all of the authors contributed substantially to its revision. EL takes responsibility for the paper as a whole. All authors read and approved the final manuscript.
Additional file 1:
Clinical scenario used by all participants for emergency airway equipment preparation. (DOC 201 kb)
Additional file 2:
Clinical report form used for study data collection. (DOCX 73 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Long, E., Fitzpatrick, P., Cincotta, D.R. et al. A randomised controlled trial of cognitive aids for emergency airway equipment preparation in a Paediatric Emergency Department. Scand J Trauma Resusc Emerg Med 24, 8 (2016). https://doi.org/10.1186/s13049-016-0201-z
- Airway management
- Decision support systems
- Quality assurance