- Study protocol
- Open Access
Randomized controlled trial of multidisciplinary team stress and performance in immersive simulation for management of infant in shock: study protocol
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine volume 24, Article number: 36 (2016)
Human error and system failures continue to play a substantial role in adverse outcomes in healthcare. Simulation improves management of patients in critical condition, especially if it is undertaken by a multidisciplinary team. It covers technical skills (technical and therapeutic procedures) and non-technical skills, known as Crisis Resource Management. The relationship between stress and performance is theoretically described by the Yerkes-Dodson law as an inverted U-shaped curve. Performance is very low for a low level of stress and increases with an increased level of stress, up to a point, after which performance decreases and becomes severely impaired. The objectives of this randomized trial are to study the effect of stress on performance and the effect of repeated simulation sessions on performance and stress.
This study is a single-center, investigator-initiated randomized controlled trial including 48 participants distributed in 12 multidisciplinary teams. Each team is made up of 4 persons: an emergency physician, a resident, a nurse, and an ambulance driver who usually constitute a French Emergency Medical Service team. Six multidisciplinary teams are planning to undergo 9 simulation sessions over 1 year (experimental group), and 6 multidisciplinary teams are planning to undergo 3 simulation sessions over 1 year (control group). Evidence of the existence of stress will be assessed according to 3 criteria: biological, electrophysiological, and psychological stress. The impact of stress on overall team performance, technical procedure and teamwork will be evaluated. Participant self-assessment of the perceived impact of simulations on clinical practice will be collected. Detection of post-traumatic stress disorder will be performed by self-assessment questionnaire on the 7th day and after 1 month.
We will concomitantly evaluate technical and non-technical performance, and the impact of stress on both. This is the first randomized trial studying repetition of simulation sessions and its impact on both clinical performance and stress, which is explored by objective and subjective assessments. We expect that stress decreases team performance and that repeated simulation will increase it. We expect no variation of stress parameters regardless of the level of performance.
ClinicalTrials.gov registration number NCT02424890
Performance, stress, and coping mechanisms
Human error and system failures substantially contribute to adverse outcomes in health care . The safety of a patient in vital distress depends on coordinated actions of providers in an algorithm defined by international recommendations [2, 3]. Performance, i.e. overall quality of care, requires that team leader and members have sufficient knowledge and master procedural skills , and that they effectively communicate  by developing non-technical skills . Improved team performance and reduction of errors during teamwork have been reported in Emergency Medicine for several decades . Simulation improves management of patients in critical condition, especially if it is undertaken by a multidisciplinary team (MDT) [1, 8] in adult  or pediatric [10, 11] cases. Systematic team training improves performance  and patients’ safety  and correlation between non-technical skills and clinical performance has been established . Non-technical skills are known as CRM—Crisis Resource Management –, which includes task management, teamwork, situational awareness, and decision-making . Some of the CRM assessment tools used in simulation were reported by Selvadilis . Simulation-based training should focus on leadership as a target because it could improve many team processes and performance . Emergency teams face unexpected and unpredictable situations requiring prompt decision-making, and may develop poor management of life-threatening events because of stress .
Excessive stress impairs performance . Stress is ‘the non-specific response of the body to any demand for change’ , defined as a ‘state of real or perceived threat to homeostasis’ . Stressors, as threats, activate the endocrine, nervous, and immune systems, known as stress response . So, stress can be measured both subjectively and objectively. It refers to psychological (perceived stress), biological, and electrophysiological modulation due to an aggression of the organism causing an emotional response—particularly acute anxiety—and impairment of cognitive processes [23, 24]. The relationship between stress and performance is described as an inverted U-shaped curve . Performance is very low for a low level of stress and increases with an increased level of stress, up to a point, after which performance decreases and becomes severely impaired . The Yerkes-Dodson law is applicable to technical skills in simulation. Positive association between stress and performance in high-fidelity simulation-based training has been decribed , whereas excessive stress impairs technical performance [28–30]. Stress also impairs all CRM principles  as well as attention, memory, decision-making, and group performance . It can lead to human errors and decrease recognition of these errors . Excessive stress impairs team capabilities like communication, as the leader becomes less receptive to suggestions and fails to share the mental model . When stress is intense or repeated, it might expose providers to a psychological impact  and the risk of post-traumatic stress disorder (PTSD) [35, 36]. PTSD usually occurs between 1 week and 1 month after a psychologically traumatic event , characterized by pathognomonic repetition syndrome and other non-specific symptoms.
Acute stress leads to coping mechanisms . It has been shown that poor management of stress has a negative impact, particularly on performance . In simulation, surgeons’ stress and coping are likely to influence surgical performance . However, even if the relationship between stress, coping and performance has been widely studied, to our knowledge there is no study describing concomitant changes in performance and stress during repetitive simulations. Do repeated simulations increase performance and reduce stress, or is there increased performance with the same level of stress, which would suggest coping and shift the Yerkes-Dodson curve to the left? Contradictory findings have been published on subjective and objective parameters of stress: correlation between the State-Trait Anxiety Inventory (STAI) scores and salivary amylase levels  but not with salivary cortisol (SC) levels , differences between perceived stress and objective stress measured by heart rate (HR), respiratory sinus arrhythmia, and SC . Consequently, using a combination of perceived and physiological markers of stress may be more reliable than using a single measurement. Concomitant changes in objective and subjective stress parameters have been poorly studied during repeated simulation sessions. Furthermore, there is no data on the possible occurrence of a PTSD after simulation session(s) and its impact on performance whereas simulated emergency is likely to be more stressful than a similar case in real life .
Rationale for a model of infant shock
Team training should improve management of infant shock as previously suggested [44, 45]. Moreover, life-threatening situations are less frequent in pediatric than in adult emergencies. Likewise, requirements for ethics may be stronger in pediatrics than in other fields of healthcare , which leads to high error rates to management of children in exceedingly busy and stressful workplaces . Given this context, a model for infant shock may facilitate assessment of a significantly enhanced performance by repeated simulations in a stressful environment in which stress parameters are recorded during sessions. Inasmuch as it is supposed to generate high stress, this model should optimize analysis of the benefit of repeated simulations and the relationship between stress and performance.
Hypotheses and aim of the study
We hypothesize that compared to three simulation sessions, nine simulation sessions over 1 year will have a greater effect on MDTs’ technical and non-technical performance and reduce stress. We speculate that high-fidelity simulation can generate a state of acute stress (identified by objective parameters of stress) without generating post-traumatic stress disorder because the scenarios have been designed to be appropriately stressful and are followed by systematic standardized post-scenario debriefing.
To investigate some of the non-elucidated points in immersive simulation researches, the aim of this study is to explore the effect of stress on performance and the effect of repeated simulation sessions on performance and stress, with three objectives: evidence of stress, evolution of performance under stress, and evolution of stress and performance during repeated simulations.
Methods and design
The design is a single-center, investigator-initiated randomized controlled trial. The study was scheduled from September 2013 to December 2015, including 12 months for the simulation sessions (December 2014 to December 2015), and followed by a data management period. Performance and stress are assessed and correlation between all the components of performance and stress, and between stress and performance will be analyzed (Fig. 1).
Setting and participants
The trial is being undertaken in the Laboratory of Simulation SiMI—INSERM 1402, Faculty of Medicine, University of Poitiers, France. Each MDT is made up of 4 persons: an emergency physician, a resident, a nurse, and an ambulance driver who usually constitute Emergency Medical Service team in France. All emergency physicians with less than 7 years of experience working in an Emergency Department of one of the hospitals in the Poitou-Charentes region (1.8 106 inhabitants) were eligible for inclusion in the trial. All healthcare providers (nurses and ambulance drivers) from the Emergency Medical System of the University Hospital of Poitiers were likewise eligible.
Inclusion criteria are: participation on a voluntary basis; being more than 18 years old; informed consent for research and video.
The constitution of a team of 4 persons relies on: 1) Emergency physicians from the Poitou-Charentes area, having obtained the University Diploma of Pediatric Emergency Procedures (University of Poitiers, France) after issue of the 2010 guidelines by the American Heart Association  and the European Resuscitation Council ; 2) Residents specialized in Emergency Medicine, trained in pediatric emergency procedures: clinical training in a Pediatric Emergency Unit and/or the university course; 3) Nurses belonging to the Emergency Medical Service of the University Hospital of Poitiers, with less than 7 years of experience and having obtained the European Pediatric Immediate Life Support degree over the past 2 years; 4) Ambulance drivers belonging to the Emergency Medical Service of the University Hospital of Poitiers, with less than 7 years of experience.
Non-inclusion criteria are: pregnant women; past history (any disease that could induce modifications related to stress, or worsen in relation to stress) and/or psychiatric disease modifying stress response; cardiac or neurological history with convulsions; pacemaker or implantable defibrillator; treatment with medication having a potential effect on stress parameters: cardiotropic agents, β2-agonist bronchodilators, steroids, hormone replacement therapy, and psychotropic agents.
This study was considered as a biomedical research on healthy volunteers by the Agence Nationale de Sécurité du Médicament (National Medication Safety Agency) and registered under the number 2013-A00648-37. The research site (Simulation Laboratory of the Faculty of Medicine of Poitiers, France) was approved by the Agence Régionale de la Santé (Health Regional Agency) of the Poitou-Charentes region of France. The study protocol, information form, and consent form were approved by the Comité de Protection des Personnes III de la region Ouest (Western France Person Protection Committee III) and were registered under the number 13.05.16. Furthermore, the registration number from ClinicalTrials.gov (a WHO-approved primary registry) is NCT02424890 .
Strict inclusion criteria were used to obtain a homogeneous professional experience and training of participants, whatever their status. For each status, an exhaustive list of personnel was used for sampling. Because of an estimated refusal rate of 50 %, we considered 24 persons of each status to be interested in the study. Participants were randomly chosen and contacted by email for presentation of the study and consent to participate. In case of agreement, a final consent form was signed before the first session. Twelve participants for each status were drawn by lots by the trial coordinator among each status population (until all consented) and randomized to form different teams. Twelve MDTs of 4 persons were constituted. Participant recruitment, treatment and analysis throughout the trial are reported on Fig. 2 . A second randomization was performed on the 12 MDTs by the methodologist to obtain the two groups: an experimental group constituted by 6 MDTs to undertake a simulation session every 6 weeks, i.e., 9 simulation sessions over 1 year, and a control group constituted by 6 MDTs to undertake a simulation session every 6 months, i.e., 3 simulation sessions over 1 year. This latter group constituted the active comparator.
The repetition rate of simulation sessions is the only varying component between the 2 randomized groups (9 or 3 simulation sessions over 1 year) (Fig. 3). The scenarios were designed using a typology of simulation, which incorporates three elements of fidelity in simulation: environmental, equipment, and psychological fidelity . A high-fidelity manikin (SimNewB*, Laerdal®) from the Laboratory of Simulation of Poitiers is used to illustrate scenarios of infant shock with requirement of IO access insertion. Nine scenarios were drawn by lots among 18 cases of infant shock: 4 hypovolemic shocks, hemorrhagic shock in severe trauma, anaphylactic shock, 2 cardiogenic shocks, and septic shock. Prior to the research protocol, all emergency physicians had identical training in insertion of intra-osseous (IO) access in infants with performance assessment on the validated scale for simulated IO insertion developed in our Simulation Laboratory . Because there exists no scale to assess clinical performance of emergency teams, our Simulation Laboratory designed and validated a team average performance assessment scale (TAPAS). Psychometric characteristics of TAPAS were calculated (publication submitted). Non-technical skills are assessed by The Clinical Teamwork Scale (CTS) for teamwork and CRM , and by the Behavioral Assessment Tool (BAT) for leadership . All sessions are scheduled the same day of the week at 2:00 pm because of the circadian cycle of cortisol. Each simulation—lasting 25–30 min—is preceded by a briefing (15 min), and followed by a “good judgment” debriefing (30–45 min) . The purpose of debriefing is to improve professional performance through facilitated (supervisor) recognition and closure of gaps in performance . Moreover, three periods of 15mn are dedicated to saliva samples and data collection (HR, BP, and STAI). Then there is a 45–60mn “snack break” lasting until 5:00 pm including participants, supervisors, and the investigator to allow physiological variables to return to normal conditions (Fig. 4). During the simulation, stressful conditions are related to different sources: scenarios themselves (hypoxia, worsening of shock, seizures, cardiac arrest), realistic environment (beeps and alarms), and the untimely irruption of simulated parents in the Emergency Room according to each scenario. Stress is assessed in 3 ways: psychological, biological and electrophysiological (Fig. 4). We considered stress assessment methods that were compatible with simulated team management of life-threatening events. Self-reporting of stress applies various scales: the Stress-O-Meter (SOM)  and the State-Trait Anxiety Inventory (STAI) , commonly used in simulation [29, 58]. PSTD is detected by the Impact of Event Scale-Revised (IES-R) on the 7th day after the event [59, 60] and the Post-traumatic Check-List Scale (PCLS) 1 month later . Electrophysiological stress is assessed by HR and heart rate variability (HRV) in time and frequency domain from Holter data, and timely measurements of HR and BP. Temporal and spectral analysis of HRV  is based on collection of a continuous signal beat-to-beat RR interval (or NN interval, i.e. normal to normal) detected on electrocardiography (ECG) and its decomposition through fast Fourier transform. Time-domain method was based on the the number of interval differences of successive NN intervals greater than 50 ms and the analysis of PNN50 (the proportion of successive NN that differ by more than 50 ms divided by total number of NN) . Spectral analysis (frequency domain) can differentiate the two components of cardiac autonomic nervous system: parasympathetic nerve activity, by measurement of “high frequency” (HF) spectral powers, and sympathetic nerve activity by the “low frequency” (LF)/HF ratio, also known as “sympathovagal balance” . Biological stress is assessed by a non-invasive measurement of SC, a well-established biomarker of stress used in simulation [19, 65, 66].
All sessions are videotaped in order to replay them for assessment if necessary. Two independent observers (among a group of 8) evaluate each simulation session. They work in the Simulation Laboratory of the Faculty of Medicine of Poitiers and are randomly chosen. All were trained in simulation and debriefing. They assess overall team performance with respect for the algorithm and therapy, insertion of the IO access, and CRM. Mean scores between the two observers will be used as the reference value.
The allocation was concealed from the two independent observers assessing participants and data managers. Participants are not blinded to the intervention. Data recording will be carried out after the end of all simulation sessions to avoid bias related to knowledge of data by the investigator. Table 1 provides the different evaluation times and data collection on stress. Table 2 provides an overview of variables and outcomes. It is inspired by SPIRIT 2013 guidance for clinical trial protocols . The analysis will focus on: 1 primary outcome and 2 secondary outcome measures.
Primary outcome measure: Evidence of the existence of stress
Acute stress immediately acts on the autonomic nervous system , resulting in a massive release of norepinephrine in sympathetic nerve endings, and leading to tachycardia and increased blood pressure (BP). The most prolonged somatic responses to stress involve the adrenal cortical axis , releasing ACTH and increasing cortisol. There exist many types of stress assessment in simulation studies , which often use a combination of physiological markers , such as increased heart rate (HR) [65, 71], and BP , modification of HRV, increased skin conductance level , and increased number of eye blinks (electrooculogram) . Hormones modified by stress can be measured in saliva: SC [75, 76], and salivary alpha amylase [40, 77, 78]. All participants undergo significant stress during immersive simulation  and perceived-stress is commonly assessed in simulation  based on a questionnaire [57, 79, 80] or on a self-report score . However, to our knowledge, the occurrence of PTSD has not been searched during repetitive simulations. Throughout the scenarios of this study, evidence of stress is assessed in 3 ways: biological stress (SC), electrophysiological stress (Holter 24 h and punctual measures), and psychological stress. SC is measured by an ELISA kit (IBL international®, Hamburg, Germany). The microtitter plate is read at 450 nm. Holter parameters (HR, PNN50 and the ratio LF/HF) are obtained with the software Synscope® (Sorin Group®) during 24 h recording, starting the day prior to the simulation until the break after simulation. Timely measures of HR and BP are associated with this analysis. Psychological stress is assessed by self-evaluation (SOM self-rating scale, STAI) after the simulation in a calm room where participants are seated. Many scales exist to detect PTSD [59–61, 68, 82–84]. In the present study IES-R is e-mailed to participants on day 7th  and PCLS at 1 month  to detect occurrence of PTSD.
Secondary outcome measures
Evaluation of the effect of stress on performance
Impact of stress on performance is assessed in three ways: TAPAS score (submitted for publication) for overall technical performance, IO access performance assessment score , and non-technical performance by BAT score for leadership assessment  and CTS score for CRM assessment .
Evaluation of the effect of repetition of simulation sessions
The evaluation of the effect of repeated stimulation sessions will be carried out by comparison of experimental group (9 simulation sessions over 1 year) versus control group (3 sessions over 1 year) (Table 2). It will be evaluated for team performance using the same assessment tools: TAPAS, IO access performance assessment scale, BAT, and CTS. The effect of repeated simulation sessions on stress will be investigated through variation of the same stress markers and by studying the development of coping. This will allow us to determine whether repeated simulation sessions, which are expected to improve performance, are actually occurring with or without a high level of stress. Occurrence of coping strategies will be investigated by the evolution of BAT and CTS scores despite high level of stress. Participant self-assessment will be requested at 6 and 12 months after the end of simulations exploring levels 1, 2, and 3 of the Kirkpatrick model .
The number of required subjects was calculated to meet the primary objective of the study: evidence of a relationship between stress and performance. We consider a relationship between stress and performance to be significant if the correlation coefficient R2 reaches a minimum value of 0.50. For a risk of the first kind at 5 %, with a power of 90 % and a bilateral situation, the number of subjects to be included was calculated at 48 (Proc POWER, SAS). We included 12 MDTs, each of them including 1 emergency physician, 1 resident, 1 nurse, and 1 ambulance driver. This will enable us to find a difference of 2.1 points in the IO access performance assessment score (standard deviation of 1.02) . A p <0.05 will be considered statistically significant.
All data will be transformed to a 100 basis, kept anonymous, and analyzed with Statview version 4.5 (SAS Institute Inc., Cary, NC). Intra-class correlation coefficient will be calculated for assessment scales. Statistical analyses are given on Table 2. Quantitative variables will be described as mean, standard deviation and/or median and interquartile range. Categorical variables will be summarized by raw numbers and percentage. Relationship between stress parameters themselves and with performance scores will be assessed on the whole population and within each group with Pearson (or Spearman) correlation coefficient. Variations of performance scores will be evaluated over time by ANOVA for repeated measures (or Kruskal-Wallis test) in each group. Relative variation will be calculated as different scores ((final score—baseline score)/baseline score) to evaluate repeated simulations on performance. Comparison between groups will use Student t-test. We will look for a status effect using ANOVA. A p value <0.05 will be considered significant.
The originality of this study resides in three points: 1) Stress is explored by subjective and objective assessments at different times of a high-fidelity simulation session, and stress response after debriefing as well as PTSD had never previously been studied; 2) Concomitant evaluation of technical and non-technical performance, and the impact of stress on both; 3) Finally, this is the first randomized trial studying repeated simulation sessions and their impact on both clinical performance and stress. These assessments are carried out on complete real French Emergency Medical Service teams. Few studies have been performed on real teams . With regard to stress pathways, an exhaustive analyze is done, including hypothalamic pituitary adrenal axis, autonomic nervous system, and self-perceived stress as previously suggested to study stress response . To our knowledge this is the first simulation study addressing the ECG signal by spectral analysis (LF/HF), allowing a more thorough approach to stress. Perceived-stress is punctually studied in simulation immediately after the session  with usually high level of stress . However the psychological impact of repeated stressful simulations has not yet studied. We will report the first study of a potential PTSD in medical simulation domain. The results of this study will provide important findings: we expect that stress decreases performances based on technical and non-technical skills and that repeated simulations increase performance. This study will determine in which field repeated simulation sessions are accompanied by an improvement in performance (procedure, teamwork, leadership), and when it occurs.
We are aware of the limitations of this protocol. The number of required subjects was calculated to provide evidence of a relationship between stress and performance. However, some comparisons may be rendered difficult due to large inter-individual variability in terms of both performance and stress. It is consequently difficult to compare groups in terms of leadership (6 vs. 6) whereas it seems easier to compare teams including all participants (24 vs. 24). However, we will be able to correlate whole teams’ performance (technical and non-technical skills) to the leaders’ performance. To our knowledge, no previous study has reported such correlations. It will also be possible to analyze and to correlate changes in absolute and relative variations of stress and performance over time. As regards stress response, paramedics of the French Emergency Medical System have usually spent several years in other departments (anesthesiology or emergency) before recruitment. Therefore, they are older than medical staff with the same level of experience. We have supposed that this age difference will not impact stress parameters . The real challenge is the respect of schedules so as to avoid influencing the stress parameters. We obtained the consent of participants prior to their inclusion in the protocol to respect the comprehensively planned dates of simulations.
Discussion of study design
After an initial simulation course, skills are preserved in case of retraining ; intervals of repetition should range from 6 weeks to 6 months . However, to our knowledge no previous study has defined the optimal frequency of repetition of simulation leading to maximal benefit at minimal cost. Indeed, significant cost and time are known to be associated with high-fidelity simulation training . There is also a lack of homogeneity in the repetition simulation sessions designed to improve procedural skills and team performance [92–94]. With this study design, the two groups cannot be compared throughout the whole period. In fact, comparison can be performed only on a common scenario. As a compromise, an intermediate scenario of the experimental group will be used to analyze the development of skills over time as well as stress parameter evolution. Pre-hospital life-threatening cases of infant with shock are sufficiently rare in clinic for the parameter of repeated simulations to be held solely responsible for observed changes.
Discussion of primary outcome criterion
A rise in all markers of stress during simulation of MDT management of an infant in shock should be evidenced for all participants . However, literature data suggest a complex mechanism of stress pathways with contradictory conclusions in simulation domain necessitating study of subjective stress and stress response, including the hypothalamic pituitary adrenal axis and the autonomic nervous system. Some authors have found an increase of subjective and objective measures , whereas others have found only partial or negligible variation of stress parameters . STAI might increase  or decrease  in the same field of simulation. Studies on emergency residents have found that self-reported stress increased  or did not . There is no data for PTSD assessment in simulation. For objective markers of stress, SC was found to increase , to have minor variation  or to have no variation . For electrophysiological parameters (HR, HRV, and BP), there is a lack of homogeneity in correlation with other stress parameters: correlation , no correlation , or partial correlation . Stress response will be studied during simulation but also after debriefing. We have assumed that stress level will increase after simulation and decrease after debriefing using an appropriate technique .
Discussion of the intervention
The model of infant shock was chosen to study stress response and performance in repeated immersive simulation because we expect clear stress response and performance evolution. All scenarios apply the case of a decompensated shock or cardiac arrest to study the same technical skill of IO access, according to the international recommendations [2, 3]. This objectively ensures possible correlation of technical performance between different teams and over time. There is no scenario of respiratory or neurological impairment which reduces the extent of life-threatening emergencies in a child. The field of intervention is consequently focused on only one part of the pediatric emergencies. Nevertheless, diversified clinical situations offer the possibility to have different scenarios with a common objective of IO access. Stress genesis varies in the scenario (monitoring, parental presence, external care-giver…) in order to increase realism. Repeating the same scenario would have been better in terms of focusing on the repetition of scenario as the intervention variable. Nevertheless, it would inevitably have led to a huge bias due to memory retention and creation of automatisms. So the variety of scenarios—none of them were identical—were created to develop MDT management with the same technical skills for IO access and ABCDE approach  as well as non-technical skills for CRM and leadership, and to generate stress in different ways.
Behavioral assessment tool
Crisis resource management
Clinical teamwork scale
Heart rate variability
Impact of event scale-revised
Post-traumatic check-list scale
Proportion of successive NN that differ by more than 50 ms divided by total number of NN
Post-traumatic stress disorder
State trait anxiety inventory
Team average performance assessment scale
Blum RH, Raemer DB, Carroll JS, Sunder N, Felstein DM, Cooper JB. Crisis resource management training for an anaesthesia faculty: A new approach to continuing education. Med Educ. 2004;38(1):45–55.
Kleinman ME, Chameides L, Schexnayder SM, Samson RA, Fran Hazinski M, Atkins DL, et al. Pediatric advanced life support: 2010 American Heart Association. Guidelines for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. 2010;122 Suppl 3:876–908.
Biarent D, Bingham R, Eich C, López-Herce J, Maconochie I, Rodríguez-Núnez A, et al. European resuscitation council guidelines for resuscitation 2010. Section 6. Paediatric life support. Resuscitation. 2010;81(10):1364–88.
King HB, Battles J, Baker DP, Alonso A, Salas E, Webster J, Toomey L, Salisbury M. TeamSTEPPS™: Team Strategies and Tools to Enhance Performance and Patient Safety. In: Henriksen K, Battles JB, Keyes MA, Grady ML, editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 3: Performance and Tools). Rockville (MD): Agency for Healthcare Research and Quality (US); 2008.
Rosen MA, Salas E, Wu TS, Silvestri S, Lazzara EH, Lyons R, et al. Promoting teamwork: an event-based approach to simulation-based teamwork training for emergency medicine residents. Acad Emerg Med. 2008;15(11):1190–8.
Hull L, Arora S, Aggarwal R, Darzi A, Vincent CA, Sevdalis N. The impact of non-technical skills on technical performance in surgery: A systematic review. J Am Coll Surg. 2012;214(2):214–30.
Risser DT, Rice MM, Salisbury ML, Simon R, Jay GD, Berns SD. The potential for improved teamwork to reduce medical errors in the emergency department. The MedTeams Research Consortium. Ann Emerg Med. 1999;34(3):373–83.
Birnbach DJ, Salas E. Can medical simulation and team training reduce errors in labor and delivery? Anesthesiol Clin. 2008;26(1):159–68.
Shapiro MJ, Morey JC, Small SD, Langford V, Kaylor CJ, Jagminas L, et al. Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum? Qual Saf Health Care. 2004;13(6):417–21.
Gilfoyle E, Gottesman R, Razack S. Development of a leadership skills workshop in paediatric advanced resuscitation. Med Teach. 2007;29(9):276–83.
Eppich WJ, Brannen M, Hunt FA. Team training: implications for emergency and critical care paediatrics. Curr Opin Pediatr. 2008;20(3):255–60.
Sevdalis N. Non-technical skills and the future of teamwork in healthcare settings. The Health Foundation. 2013. http://patientsafety.health.org.uk/sites/default/files/resources/non_technical_skills_and_the_future_of_teamwork_in_healthcare_settings.pdf. Accessed 18 Mar 2016.
Morey JC, Simon R, Jay DG, Wears RL, Salisbury M, Dukes KA, et al. Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the Med Teams project. Health Serv Res. 2002;37(6):1553–81.
Schmutz J, Manser T. Do team processes really have an effect on clinical performance? A systematic literature review. Br J Anaesth. 2013;110(4):529–44.
Yee B, Naik VN, Joo HS, Savoldelli GL, Chung DY, Houston PL, et al. Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology. 2005;103(2):241–8.
Sevdalis N, Hull L, Birnbach DJ. Improving patient safety in the operating theatre and perioperative care: Obstacles, interventions, and priorities for accelerating progress. Br J Anaesth. 2012;109 Suppl 1:i3–i16.
Shapiro MJ, Gardner R, Godwin SA, Jay GD, Lindquist DG, Salisbury ML, et al. Defining team performance for simulation-based training: methodology, metrics, and opportunities for emergency medicine. Acad Emerg Med. 2008;15(11):1088–97.
LeBlanc VR. The effects of acute stress on performance: implications for health professions education. Acad Med. 2009;84 Suppl 10:25–33.
Harvey A, Bandiera G, Nathens AB, LeBlanc VR. Impact of stress on resident performance in simulated trauma scenarios. J Trauma Acute Care Surg. 2012;72(2):497–503.
Selye H. A syndrome produced by diverse nocuous agents. J Neuropsychiatr. 1998;10:230–1.
Smith SM, Vale WW. The role of the hypothalamic-pituitary-adrenal axis in neuroendocrine responses to stress. Dialogues Clin Neurosci. 2006;8:383–95.
Carrasco GA, Van de Kar LD. Neuroendocrine pharmacology of stress. Eur J Pharmacol. 2003;463(1-3):235–72.
Kirschbaum C, Wolf OT, May M, Wippich W, Hellhammer DH. Stress- and treatment-induced elevations of cortisol levels associated with impaired declarative memory in healthy adults. Life Sci. 1996;58(17):1475–83.
Wolf OT. HPA axis and memory. Best Pract Res Cl En. 2003;17(2):287–99.
Yerkes RM, Dodson JD. The relation of strength of stimulus to rapidity of habit-formation. J Comp Neurol Psychol. 1908;18:459–82.
Duffy E. The psychological significance of the concept of “arousal” or “activation.”. Psychol Rev. 1957;64(5):265–75.
Keitel A, Ringleb M, Schwartges I, Weik U, Picker O, Stockhorst U, et al. Endocrine and psychological stress responses in a simulated emergency situation. Psychoneuroendocrino. 2011;36(1):98–108.
Cavanagh JF, Frank MJ, Allen JJ. Social stress reactivity alters reward and punishment learning. Soc Cogn Affect Neurosci. 2011;6(3):311–20.
Wetzel CM, Black SA, Hanna GB, Athanasiou T, Kneebone RL, Nestel D, et al. The effects of stress and coping on surgical performance during simulations. Ann Surg. 2010;251(1):171–6.
McGraw LK, Out D, Hammermeister JJ, Ohlson CJ, Pickering MA, Granger DA. Nature, correlates, and consequences of stress-related biological reactivity and regulation in Army nurses during combat casualty simulation. Psychoneuroendocrino. 2013;38(1):135–44.
Weinstock P. Pediatric Simulation Instructor Workshop course. Boston: Harvard Medical School; 2013.
Sexton JB, Thomas EJ, Helmreich LR. Error, stress, and teamwork in medicine and aviation: cross sectional surveys. Brit Med J. 2000;320(7237):745–9.
Bong CL, Fraser K, Oriot D. Cognitive Load and Stress in Simulation. In: Cheng A, Grant V, editors. Comprehensive Healthcare Simulation: Pediatric Edition. New York City: Springer; 2015 (in press).
Laurent A, Chahraoui K, Carli P. Les répercussions psychologiques des interventions médicales urgentes sur le personnel SAMU. Etude portant sur 50 intervenants SAMU. Ann Med Psychol. 2007;165:570–8.
Laposa J, Alden L. Posttraumatic stress disorder in the emergency room: exploration of a cognitive model. Behav Res Ther. 2003;41(1):49–65.
Laurent A. Les équipes mobiles d’urgence et de réanimation face aux interventions potentiellement traumatiques. Ann Med Psychol. 2014;172(6):457–62.
Yehuda R. Post-traumatic stress disorder. N Engl J Med. 2002;346(2):108–14.
Anshel MH, Anderson DI. Coping with acute stress in sport: Linking athletes’ coping style, coping strategies, affect, and motor performance. Anxiety Stress Copin. 2002;15(2):193–209.
Hassan I, Weyers P, Maschuw K, Dick B, Gerdes B, Rothmund M, et al. Negative stress-coping strategies among novices in surgery correlate with poor virtual laparoscopic performance. Br J Surg. 2006;93(12):1554–9.
Takai N, Yamaguchi M, Aragaki T, Eto K, Uchihashi K, Nishikawa Y. Effect of psychological stress on the salivary cortisol and amylase levels in healthy young adults. Arch Oral Biol. 2004;49(12):963–8.
Noto Y, Sato T, Kudo M, Kurata K, Hirota K. The relationship between salivary biomarkers and state-trait anxiety inventory score under mental arithmetic stress: a pilot study. Anesth Analg. 2005;101(6):1873–6.
Oldehinkel AJ, Ormel J, Bosch NM, Bouma EMC, Van Roon AM, Rosmalen JGM, et al. Stressed out? Associations between perceived and physiological stress responses in adolescents: The TRAILS study. Psychophysiology. 2011;48(4):441–52.
Quilici AP, Pogetti RS, Fontes B, Zantut LFC, Chaves ET, Birolini D. Is the Advanced Trauma Life Support simulation exam more stressful for the surgeon than emergency department trauma care? Clinics. 2005;60(4):287–92.
Sahu S, Lata I. Simulation in resuscitation teaching and training, an evidence based practice review. J Emerg Trauma Shock. 2010;3(4):378–84.
Hunt EA, Walker AR, Shaffner DH, Miller MR, Pronovost PJ. Simulation of in-hospital pediatric medical emergencies and cardiopulmonary arrests: highlighting the importance of the first 5 minutes. Pediatrics. 2008;121(1):e34–43.
Ziv A, Wolpe PR, Small SD, Glick S. Simulation-based medical education: An ethical imperative. Acad Med. 2003;78:783–8.
Kalaniti K, Campbell DM. Simulation-based medical education: time for a pedagogical shift. Indian Pediatr. 2015;52(1):41–5.
Ghazali DA. Trial of multidisciplinary team stress and performance in immersive simulation for management of infant in shock. ClinicalTrials.gov Protocol Registration and Results System. https://register.clinicaltrials.gov/prs/app/action/DownloadReceipt?uid=U00005JU&ts=74&sid=S0005EMU&cx=ccq46o. Accessed March 18 2016.
Moher D, Schulz KF, Altman D. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA. 2001;285(15):1987–91.
Power D, Henn D, O’Driscoll P, Power T, McAdoo J, Hynes H, et al. An evaluation of high fidelity simulation training for paramedics in Ireland. Int Paramed Pract. 2013;3(1):11–8.
Oriot D, Darrieux E, Boureau-Voultoury A, Ragot S, Scépi M. Validation of a performance assessment scale for simulated intraosseous access. Sim Healthcare. 2012;7(3):171–5.
Guise JM, Deering SH, Kanki BG, Osterweil P, Li H, Mori M, Lowe NK. Validation of a tool to measure and promote clinical teamwork. Sim Healthcare. 2008;3(4):217–23.
Anderson JDM, Meckler G, Boyle K, LeFlore J, Warre J. How to use the Behavioral Assessment Tool: assessment of CRM-based behavioral skills in simulation using a validated, reliable tool. 2010. http://sites.uci.edu/medsim/files/2015/03/BAT.pdf. Accessed March 18 2016.
Rudolph JW, Simon R, Raemer DB, Eppich WJ. Debriefing as formative assessment: closing performance gaps in medical education. Acad Emerg Med. 2008;15(11):1010–6.
Rudolph JW, Simon R, Dufresne RL, Raemer DB. There’s no such thing as “non judgmental” debriefing: a theory and method for debriefing with good judgment. Sim Healthcare. 2006;1(1):49–55.
Dawson MA, Hamson-Utley JJ, Hansen R, Olpin M. Examining the effectiveness of psychological strategies on physiologic markers: evidence-based suggestions for holistic care of the athlete. J Athl Train. 2014;49(3):331–7.
Speilberger CD, Gorsuch RL, Lushene R. STAI manual. Palo Alto: Consulting Psychologist Press; 1970.
Harvey A, Nathens AB, Bandiera G, LeBlanc VR. Threat and challenge: cognitive appraisal and stress responses in simulated trauma resuscitations. Med Educ. 2010;44(6):587–94.
Weiss DS, Marmar CR. The Impact of Event Scale - Revised. In: Wilson JP, Keane TM, editors. Assessing psychological trauma and PTSD. New York: Guilford Press; 1997. p. 399–411.
Brunet A, St-Hilaire A, Jehel L, King S. Validation of a French version of the impact of event scale-revised. Can J Psychiatry. 2003;48(1):56–61.
Weathers FW, Huska JA, Keane TM. The PTSD Checklist Civilian Version (PCL-C). Boston: National Center for PTSD (Boston Veterans Affairs Medical Center); 1991.
Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. Heart rate variability. Standards of measurement, physiological interpretation, and clinical use. Eur Heart J. 1996;17(3):354–81.
Bilchick KC, Berger RD. Heart rate variability. J Cardiovasc Electrophysiol. 2006;17(6):691–4.
Eckberg DL. Sympathovagal balance: a critical appraisal. Circulation. 1997;96(9):3224–32.
Bong C, Lightdale J, Fredette M, Weinstock P. Effects of simulation versus traditional tutorial-based training on physiologic stress levels among clinicians: a pilot study. Sim Healthcare. 2010;5(5):272–8.
Arora S, Sevdalis N, Aggarwal R, Sirimanna P, Darzi A, Kneebone R. Stress impairs psychomotor performance in novice laparoscopic surgeons. Surg Endosc. 2010;24(10):2588–93.
Chan AW, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.
Widmaier EP, Raff H, Strang KT. Defense mechanisms of the body. In: Widmaier EP, Raff H, Strang KT, editors. Vander, Sherman, and Luciano’s Human Physiology: The Mechanisms of Body Function. Boston: McGraw-Hill; 2004. p. 695–738.
Everly Jr GS, Lating JM. The Anatomy and Physiology of the Human Stress Response. In: Everly Jr GS, Lating JM, editors. A Clinical Guide to the Treatment of the Human Stress Response. 3rd ed. New York: Springer; 2013. p. 17–51.
Arora S, Sevdalis N, Nestel D, Woloshynowych M, Darzi A, Kneebone RL. The impact of stress on surgical performance: A systematic review of the literature. Surgery. 2010;147(3):318–30.
Shaw J, Brown R, Heinrich P, Dunn S. Doctors’ experience of stress during simulated bad news consultations. Pat Educ Counsel. 2013;93:203–8.
Pagani M, Furlan R, Pizzinelli P, Crivellaro W, Cerutti S, Malliani A. Spectral analysis of R-R and arterial pressure variabilities to assess sympatho-vagal interaction during mental stress in humans. J Hypertens. 1989;7(6):s14–5.
Boucsein W. Electrodermal activity. New York: Plenum Press; 1992.
Smith WD, Chung YH, Berguer R. A virtual instrument ergonomics workstation for measuring the mental workload of performing video-endoscopic surgery. Stud Health Technol Inform. 2000;70:309–15.
Schreinicke G, Hinz A, Kratzsch J, Hüber B, Voigt G. Stress-related changes of saliva cortisol in VDU operators. Int Arch Occup Environ Health. 1990;62(4):319–21.
Wagner J, Cik M, Marth E, Santner BI, Gallasch E, Lackner A, et al. Feasibility of testing three salivary stress biomarkers in relation to naturalistic traffic noise exposure. Int J Hyg Environ Health. 2010;213(2):153–5.
Thoma MV, Kirschbaum C, Wolf JM, Rohleder N. Acute stress responses in salivary alpha-amylase predict increases of plasma norepinephrine. Biol Psychol. 2012;91(3):342–8.
Nater UM, Rohleder N, Schlotz W, Ehlert U, Kirschbaum C. Determinants of the diurnal course of salivary alpha-amylase. Psychoneuroendocrino. 2007;32(4):392–401.
Lovibond SH, Lovibond PF. Manual for the Depression Anxiety Stress Scales. 2nd ed. Sydney: Psychology Foundation; 1995.
Antony MM, Bieling PJ, Cox BJ, Enns MW, Swinson RP. Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychol Assessment. 1998;10(2):176–81.
Lesage FX, Berjot S, Deschamps F. Clinical stress assessment using a visual analogue scale. Occup Med. 2012;62(8):600–5.
Marmar CR, Weiss DS, Metzler TJ. The Peritraumatic Dissociative Experiences Questionnaire. In: Wilson JP, Keane TM, editors. Assessing psychological trauma and PTSD. New York: Guilford Press; 1997.
Weathers FW, Keane TM, Davidson JRT. Clinician-administered PTSD scale: a review of the first ten years of research. Depress Anxiety. 2001;13(3):132–56.
Keane TM, Caddell JM, Taylor KL. Mississippi scale for combat-related Posttraumatic Stress Disorder: three studies in reliability and validity. J Consult Clin Psych. 1988;56(1):85–90.
Kirkpatrick DL. Techniques for evaluating training programs. J ASTD. 1959;13(11):3–9.
Sørensen JL, Van der Vleuten C, Lindschou J, Gluud C, Østergaard D, LeBlanc V, et al. ‘In situ simulation’ versus’off site simulation’ in obstetric emergencies and their effect on knowledge, safety attitudes, team performance, stress, and motivation: study protocol for a randomized controlled trial. Trial. 2013;14:220.
Laurent HK, Powers SI, Granger DA. Refining the multisystem view of the stress response: Coordination among cortisol, alpha-amylase, and subjective stress in response to relationship conflict. Physiol Behav. 2013;119:52–60.
Ordaz S, Luna B. Sex differences in physiological reactivity to acute psychosocial stress in adolescence. Psychoneuroendocrinology. 2012;37(8):1135–57.
Andresen D, Arntz HR, Gräfling W, Hoffmann S, Hofmann D, Kraemer R, Krause-Dietering B, Osche S, Wegscheider K. Public access resuscitation program including defibrillator training for laypersons: a randomized trial to evaluate the impact of training course duration. Resuscitation. 2008;76(3):419–24.
Kuduvalli PM, Jervis A, Tighe SQ, Robin NM. Unanticipated difficult airway management in anaesthetised patients: a prospective study of the effect of mannequin training on management strategies and skill retention. Anaesthesia. 2008;63(4):364–9.
Cooper A. High-fidelity simulation for neonatal nursing education: an integrative review of the literature. Neonatal Netw. 2015;34(6):345–54.
Christenson J, Nafziger S, Compton S, Vijayaraghavan K, Slater B, Ledingham R, et al. The effect of time on CPR and automated external defibrillator skills in the Public Access Defibrillation Trial. Resuscitation. 2007;74(1):52–62.
Cordero L, Hart BJ, Hardin R, Mahan JD, Nankervis CA. Deliberate practice improves pediatric residents’ skills and team behaviors during simulated neonatal resuscitation. Clin Pediatr (Phila). 2013;52(8):747–52.
Picard M, Curry N, Collins H, Soma L, Hill J. Comparison of high-fidelity simulation versus didactic instruction as a reinforcement intervention in a comprehensive curriculum for radiology trainees in learning contrast reaction management: does it matter how we refresh? Acad Radiol. 2015;22(10):1268–76.
Girzadas Jr DV, Delis S, Bose S, Hall J, Rzechula K, Kulstad EB. Measures of stress and learning seem to be equally affected among all roles in a simulation scenario. Simul Healthc. 2009;4(3):149–54.
Hulsman RL, Pranger S, Koot S, Fabriek M, Karemaker JM, Smets EM. How stressful is doctor–patient communication? Physiological and psychological stress of medical students in simulated history taking and bad-news consultations. Int J Psychophys. 2010;77:26–34.
Leotsakos LD, Stachtea XP, Fragkiadis EM, Gogos AI, Papageorgiou CC, Mitrpoulos DN. Training on surgical simulators for urological operations: stress assessment and evaluation of the educational process. Hellenic Urol. 2014;26(2):58–65.
Kharasch M, Aitchison P, Pettineo C, Pettineo L, Wang EE. Physiological stress responses of emergency medicine residents during an immersive medical simulation scenario. Dis Mon. 2011;57(11):700–5. doi:10.1016/j.disamonth.2011.08.007.
Clarke S, Horeczko T, Cotton D, Bair A. Heart rate, anxiety and performance of residents during a simulated critical clinical encounter: a pilot study. BMC Med Educ. 2014;14:153. doi:10.1186/1472-6920-14-153.
Müller MP, Hansel M, Fichtner A, Hardt F, Weber S, Kirschbaum C, et al. Excellence in performance and stress reduction during two different full scale simulator training courses: a pilot study. Resuscitation. 2009;80(8):919–24.
Valentin B, Grottke O, Skorning M, Bergrath S, Fischermann H, Rörtgen D, et al. Cortisol and alpha-amylase as stress response indicators during pre-hospital emergency medicine training with repetitive high-fidelity simulation and scenarios with standardized patients. Scand J Trauma Resusc Emerg Med. 2015;23:31.
Van Dulmen S, Tromp F, Grosfeld F, ten Cate O, Bensing J. The impact of assessing simulated bad news consultations on medical students’ stress response and communication performance. Psychoneuroendocrinology. 2007;32(8-10):943–50.
Hunziker S, Semmer NK, Tschan F, Schuetz P, Mueller B, Marsch S. Dynamics and association of different acute stress markers with performance during a simulated resuscitation. Resuscitation. 2012;83(5):572–8.
Thim T, Krarup NHV, Grove EL, Rohde CV, Løfgren B. Initial assessment and treatment with the Airway, Breathing, Circulation, Disability, Exposure (ABCDE) approach. Int J Gen Med. 2012;5:117–21.
The authors would like to thank the Société Française de Médecine d’Urgence (French Emergency Medicine Society) for the research grant.
We would like to thank Dr. Christine Millet, who provided significant help in analyzing SC.
We would like to thank Jeffrey Arsham, an American medical translator, for having reviewed the English language text.
‘The author(s) declare that they have no competing interests’.
AG and DO: has made substantial contributions to conception and design; will perform acquisition of data, analysis and interpretation of data, and will be involved in drafting the manuscript or revising it critically for important intellectual content. SR: has made substantial contributions to conception and design; will perform analysis of data, and will be involved in drafting the manuscript or revising it critically for important intellectual content. CB: has made substantial contributions to design; will make acquisition of data. YG, ABV and FP: will make substantial contributions to acquisition of data. All the authors have given final approval of the version to be published, and agree to be accountable for all aspects of the work by ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
About this article
Cite this article
Ghazali, D.A., Ragot, S., Breque, C. et al. Randomized controlled trial of multidisciplinary team stress and performance in immersive simulation for management of infant in shock: study protocol. Scand J Trauma Resusc Emerg Med 24, 36 (2016). https://doi.org/10.1186/s13049-016-0229-0
- Randomized controlled trial
- Multidisciplinary team