Cortisol and alpha-amylase as stress response indicators during pre-hospital emergency medicine training with repetitive high-fidelity simulation and scenarios with standardized patients
© Valentin et al.; licensee BioMed Central. 2015
Received: 22 September 2014
Accepted: 11 March 2015
Published: 8 April 2015
In emergency medicine, the benefits of high-fidelity simulation (SIM) are widely accepted and standardized patients (SP) are known to mimic real patients accurately. However, only limited data are available concerning physicians’ stress markers within these training environments.
The aim of this pilot study was to investigate repetitive stress among healthcare professionals in simulated pre-hospital emergency scenarios using either SIM or SPs.
Teams with one emergency medical services (EMS) physician and two paramedics completed three SIM scenarios and two SP scenarios consecutively. To evaluate stress, salivary cortisol and alpha-amylase were measured in saliva samples taken before, during and after the scenarios.
A total of 14 EMS physicians (29% female; mean age: 36.8 ± 5.0 years; mean duration of EMS-experience: 9.1 ± 5.8 years) and 27 paramedics (11% female; age: 30.9 ± 6.9 years; EMS experience: 8.1 ± 6.0 years) completed the study. Alpha-amylase and cortisol levels did not differ significantly between the two professions. Cortisol values showed a gradual and statistically significant reduction over time but little change was observed in response to each scenario. In contrast, alpha-amylase activity increased significantly in response to every SIM and SP scenario, but there was no clear trend towards an overall increase or decrease over time.
Increases in salivary alpha-amylase activity suggest that both SIM and SP training produce stress among emergency healthcare professionals. Corresponding increases in salivary cortisol levels were not observed. Among physicians in the emergency setting, it appears that alpha-amylase provides a more sensitive measure of stress levels than cortisol.
High-fidelity simulation (SIM) and its benefits are well accepted in undergraduate as well as postgraduate educational settings and SIM is widely used in medicine [1-5]. Human patient simulation represents an alternative: used in teaching environments since 1969, the benefits of this approach have gained acceptance in fields such as aviation training, military war fighter preparation and industry, as well as in medicine [6-10]. Despite the acceptance of these methods, few data exist regarding the occurrence of stress among physicians within these training environments [11,12]. Repetitive stress, which is common in emergency medical care, has been particularly poorly investigated.
Stress is frequently defined as a state of unacceptable divergence between perceived demands and capabilities to adapt . Healthcare professionals in the emergency setting are often confronted with complex situations that lead to stress. Importantly, it has been shown that stress affects the performance of healthcare professionals in different settings .
Established methods of measuring stress include heart rate and blood pressure . Biochemical markers of stress are also known to exist in humans. Alpha-amylase is one of the major salivary enzymes in humans, secreted from the salivary gland in response to sympathetic stimuli . Takai et al. reported that alpha-amylase increased by psychological stressors . Cortisol is a stress hormone produced in the adrenal cortex, and its concentration in saliva is strongly correlated with its concentration in blood plasma .
This observational study was designed to investigate stress among teams of healthcare professionals in repetitive simulation scenarios using both SIM and standard patients (SP). Salivary levels of cortisol and alpha-amylase were used as markers of stress. This study was part of a broader investigation, where telemedical support in emergency medical services (EMS) was examined .
Materials and methods
This study was approved by the local ethics committee (registration number EK065/09). A standardized leaflet was used to describe the study to each participant and to explain that their performance would be videotaped and evaluated. Participants were then asked to complete a demographic questionnaire and to provide signed consent.
Setting and interventions
The study was conducted in September 2009 at the interdisciplinary Skillslab facility and the interdisciplinary medical simulation centre of Aachen University Hospital in Germany, and was part of a interdisciplinary research project, where telemedical support in emergency medical services was investigated respective various aspects [18-20]. Five standardized emergency scenarios were designed and tested by an expert committee of five experienced EMS physicians. The scenarios were handled consecutively by teams of 2 paramedics and 1 EMS physician. Lots were used to determine which healthcare professionals would join each team. Realistic environmental conditions were arranged for all scenarios in the simulation centre.
Study participants were equipped with collar microphones (EW 200, Sennheiser, Germany) to record communication with the manikin or the SP, and three cameras in each room (EVI D 70, Sony, Japan) were used to videotape each scenario. Audio and video signals were synchronized.
Scenario setup: simulation sessions
Scenario setup: standardized patient sessions
Methods of measurement: biochemical analyses
Post-scenario A-samples were taken immediately after termination of the scenarios, post-scenario B-samples 5 min later after the recreation phase and consequently right before the start of the following scenario.
Each specimen was centrifuged at 3000 rpm for 5 min (Dresden, Germany). An enzyme kinetic method was then used to determine the concentration of alpha-amylase . The concentration of free cortisol was measured with a commercially available chemiluminescence immunoassay (CLIA; IBL, Germany).
Data collection and processing
In the absence of similar previous studies, this was an exploratory study and a sample size calculation could not be performed. Instead, the sample size was chosen to be comparable with those of previous studies investigating stress response using biochemical markers [11,12].
Continuous variables following a normal distribution are expressed as mean values ± standard deviation (SD). Non-normally distributed data (amylase and cortisol) are presented as box plots with median, interquartile range (IQR) and range. For both cortisol and alpha-amylase, analysis of covariance (ANCOVA) was conducted for repeated measurements using PROC MIXED software. The following factors were included as covariates: timepoint [1-14], role (EMS physician, paramedic1, paramedic2), group [3-16], gender and age. Time was considered as a repeated factor, and the covariance structure was autoregressive. Due to the exponential distribution of cortisol and alpha-amylase, data were log transformed for the model. A post-hoc analysis was performed to compare the cortisol concentration after the familiarization scenario (timepoint 3) with the levels at subsequent timepoints. Adjusted p-values <0.0038 were considered to be significant. All statistical analysis was carried out with SAS (Version 9.1.3, SAS Institute Inc., Cary, NC, USA).
Characteristics of study participants
In total, 16 EMS physicians and 27 paramedics were enrolled for the study. Two EMS physicians were withdrawn due to non-attendance on study day, so 14 groups were evaluated. The dataset of one paramedic was not complete and was eliminated from analysis as well. Among the 14 evaluated EMS physicians, four (29%) were female, the mean age was 36.8 ± 5.0 years, and the mean duration of EMS experience was 9.1 ± 5.8 years. A smaller proportion of the 27 evaluated paramedics were female (11% [n = 3]), they were younger (mean age 30.9 ± 6.9 years) and they had slightly less EMS experience (mean 8.1 ± 6.0 years). Nevertheless, these differences are not considered to be of major importance.
Salivary alpha-amylase and cortisol levels
Salivary alpha-amylase (U/ml) and cortisol levels (nmol/l) at each assessment timepoint
P-value for decrease versus time-point 3
38.0 ± 40.7
13.3 ± 7.5
51.3 ± 47.2
11.9 ± 6.5
54.8 ± 46.3
12.5 ± 6.5
35.8 ± 29.0
11.6 ± 5.9
54.2 ± 45.4
10.8 ± 5.6
35.2 ± 29.5
9.8 ± 5.0
52.4 ± 47.4
8.4 ± 4.3
41.6 ± 36.2
7.2 ± 3.6
60.7 ± 47.2
7.2 ± 3.5
33.9 ± 28.4
6.5 ± 3.0
51.5 ± 41.4
5.9 ± 2.4
44.9 ± 39.5
5.9 ± 3.2
61.1 ± 65.5
6.7 ± 3.9
58.6 ± 46.5
5.0 ± 2.1
Alpha-amylase activity and cortisol concentration did not differ significantly between professions. Also, there were no significant differences in relation to the gender (p = 0.6275) or age (p = 0.7458) of the participants for cortisol, resp. for alpha-amylase (gender: p = 0.8827; age: p = 0.0433).
The primary aim of this observational study was to investigate stress in multidisciplinary teams of emergency care physicians undertaking repetitive simulation scenarios using SIM and SP. The results show for the first time that alpha-amylase exhibits a characteristic increase in response to simulation scenarios, indicating a degree of stress among the physicians. Increases in alpha-amylase were observed in response to both SIM and SP scenarios. In contrast, cortisol showed no clear changes in response to the simulation scenarios, although a gradual decrease over time was evident.
No significant differences between the two scenario types were observed with respect to concentrations of cortisol or amylase. Interestingly, we also found that neither gender nor age had a significant influence on stress levels. In our study, a pre-hospital setting was chosen, where repetitive management of different cases is routine. Further studies would be needed to ascertain whether our results are applicable to other settings.
High-fidelity simulation is well established in academic settings, but more research is necessary to ascertain its value in medical education . In principle, simulation represents a useful and effective means of promoting and advancing best practice in critical situations. Such training can enhance participant performance and improves physicians’ memory of best practice .
Our results are consistent with previous studies showing that simulator training in medicine is able to produce realistic stress [11,12,14]. One study comparing simulated advanced trauma life support training with real-world management of trauma showed a higher degree of stress in response to the simulation . A significant increase in alpha-amylase in response to simulator training has also been shown previously . Müller et al. included two short test scenarios, one performed before and one after a 1-day simulator course. The increase in alpha-amylase in response to the scenario after the 1-day course was smaller than that with the scenario before the course. We did not observe any decrease in the alpha amylase response to later versus earlier scenarios. This could be due to our study design with five scenarios in one day. It is possible that participants were not able to recover adequately between scenarios, or that the learning process induced by the scenario cannot reduce stress in such a short time. Cortisol values in our study were in the same range as those reported by Müller et al. but, unlike in the study by Müller et al., we observed a significant reduction over time in cortisol levels. This suggests that, despite the alpha amylase results, perhaps there was a decrease in stress over time in the current study. Further investigations using additional measurements of stress would be valuable to ascertain the true changes in stress over time among physicians completing five simulation scenarios in one day.
Stress is liable to impair individual as well as team performance in the treatment of patients. For example, it has been shown that medical students with poor stress-coping strategies have reduced laparoscopic dexterity . Similarly, Moorthy et al. investigated the effect of stress-inducing conditions on the performance of laparoscopic task and demonstrated increases in skill- and knowledge-based errors . On the other hand, stress may have some positive effects. Demaria et al. investigated the addition of emotional stressors to training in simulated cardiopulmonary arrest. Participants could remember the events of scenarios in which they felt they had failed, demonstrating that emotional stress can improve memory stages, creation of new memories or the persistence of memories, as well as the ability to recall these memories .
In light of these considerations, stress levels induced by training are of significant interest. A degree of stress may be valuable for optimal learning. Future studies could be designed to ascertain the optimal time period between scenarios and which setting – SIM or SP – should be used for the most effective learning. In addition, there is a possibility that training could be used to reduce the stress response to a given situation, potentially translating into improved clinical performance. Our study was not designed to determine the impact of stress on participants’ performance. Future studies investigating whether a reduced stress response after several simulation scenarios has a positive or negative impact on performance would be valuable. A key aim would be to ascertain how best to design training for improvement of performance.
As biochemical markers of stress, salivary alpha-amylase and cortisol seem to have different reaction profiles . Cortisol is a corticosteroid hormone with an influence on memory consolidation in humans ; it reacts and recovers less quickly than alpha-amylase . The present findings are consistent with this difference. This is an important difference between our study and others.
There are some limitations to our study. Firstly, the evaluated subjects were not chosen randomly, and this could have introduced a positive selection bias because volunteers often outperform other potential participants . However, because we focused on biochemical measurements instead of performance data, the potential impact of this selection bias on the results should have been reduced. Secondly, for organizational reasons, it was not possible to implement a cross-over-design for rigorous comparison of SIM scenarios with SP scenarios. It was only possible to use one SIM scenario for acclimatization and, as a result, three SIM scenarios were included in the study compared with only two SP scenarios. This could have influenced the results because of possible adaptation during the different types of simulation. Lastly, all data for our study were collected in a single day. In previous studies using levels of cortisol to investigate stress during simulated scenarios, such as that conducted by Müller et al , baseline data were typically collected during the day before simulation.
Over all, this study showed that both SIM and SP training produce stress in teams of paramedics and EMS physicians. Salivary alpha-amylase appears to be a more sensitive marker than salivary cortisol for detecting stress in a simulated pre-hospital environment. Further research is needed to validate these findings in other settings, and to determine how training should be designed for optimal learning and performance improvement.
We thank all physicians and emergency medical technicians who participated voluntarily in this study. In addition, the authors would like to thank the simulation team, especially M. Brandt MD, R. Döring and V. Miklosch MD, for their support in preparing and using simulation technology during the study. Furthermore, we thank the standardized patient trainer, A. Pirkl of the Skillslab facility AIXTRA, for her work in preparing the role-play and training the standardized patients. Additionally, we appreciate the support provided for video documentation and content management of the video data, by F. Schenkat, P. Aretz, U. Heuter, U. Malchus, and A. Czepluch.
Funding sources and disclosures
The study was conducted within the joint research project “Med-on-@ix“funded by the German Federal Ministry of Economics and Technology (BMWi), Project-No.: 01 MB07022. Philips Healthcare (Hamburg, Germany) provided the monitoring devices (Heartstart MRx) and the IntelliVue Information Centre Software. Neither the BMWi nor Philips Healthcare was involved in study design, data collection, analysis or interpretation of gathered data, writing of the manuscript or the decision to submit the manuscript for publication.
- Breuer G, Riss R, Schroder T, Monk S, Schuttler J. The intensive care simulator: a new teaching-concept to train severe sepsis management. Dtsch Med Wochenschr. 2004;129(48):2586–9.View ArticlePubMedGoogle Scholar
- Chopra V, Gesink BJ, de Jong J, Bovill JG, Spierdijk J, Brand R. Does training on an anaesthesia simulator lead to improvement in performance? Br J Anaesth. 1994;73(3):293–7.View ArticlePubMedGoogle Scholar
- Lighthall GK, Barr J, Howard SK, Gellar E, Sowb Y, Bertacini E, et al. Use of a fully simulated intensive care unit environment for critical event management training for internal medicine residents. Crit Care Med. 2003;31(10):2437–43.View ArticlePubMedGoogle Scholar
- Mueller MP, Heller AR, Koch T. A new simulator-based psychological training on crisis management. MedEduc. 2005;39:1155.Google Scholar
- Timmermann A, Eich C, Russo SG, Barwing J, Hirn A, Rode H, et al. Teaching and simulation: methods, demands, evaluation and visions. Anaesthesist. 2007;56(1):53–62.View ArticlePubMedGoogle Scholar
- Abrahamson S, Denson JS, Wolf RM. Effectiveness of a simulator in training anesthesiology residents. J Med Educ. 1969;44(6):515–9.PubMedGoogle Scholar
- Alkov RA, Borowsky MS, Williamson DW, Yacavone DW. The effect of trans-cockpit authority gradient on Navy/Marine helicopter mishaps. Aviat Space Environ Med. 1992;63(8):659–61.PubMedGoogle Scholar
- Denson JS, Abrahamson S. A computer-controlled patient simulator. JAMA. 1969;208(3):504–8.View ArticlePubMedGoogle Scholar
- Hendrickse AD, Ellis AM, Morris RW. Use of simulation technology in Australian defence force resuscitation training. JRArmy Med Corps. 2001;147:173–8.View ArticleGoogle Scholar
- Orlansky J. Human factors in aircraft design. Med News LettAviat. 1948;9:1–4.Google Scholar
- Keitel A, Ringleb M, Schwartges I, Weik U, Picker O, Stockhorst U, et al. Endocrine and psychological stress responses in a simulated emergency situation. Psychoneuroendocrinology. 2011;36(1):98–108.View ArticlePubMedGoogle Scholar
- Müller MP, Hansel M, Fichtner A, Hardt F, Weber S, Kirschbaum C, et al. Excellence in performance and stress reduction during two different full scale simulator training courses: a pilot study. Resuscitation. 2009;80(8):919–24.View ArticlePubMedGoogle Scholar
- Sanders AF. Towards a model of stress and human performance. Acta Psychol. 1983;53:61–97. Amst.View ArticleGoogle Scholar
- Quilici AP, Pogetti RS, Fontes B, Zantut LF, Chaves ET, Birolini D. Is the advanced trauma life support simulation exam more stressful for the surgeon than emergency department trauma care? Clinics. 2005;60:287–92. Sao Paulo.View ArticlePubMedGoogle Scholar
- Gallacher DV, Petersen OH. Stimulus-secretion coupling in mammalian salivary glands. Int Rev Physiol. 1983;28:1–52.PubMedGoogle Scholar
- Takai N, Yamaguchi M, Aragaki T, Eto K, Uchihashi K, Nishikawa Y. Effect of psychological stress on the salivary cortisol and amylase levels in healthy young adults. Arch Oral Biol. 2004;49(12):963–8.View ArticlePubMedGoogle Scholar
- Kirschbaum C, Hellhammer DH. Salivary cortisol in psychoneuroendocrine research: recent developments and applications. Psychoneuroendocrinology. 1994;19(4):313–33.View ArticlePubMedGoogle Scholar
- Rörtgen D, Bergrath S, Rossaint R, Beckers SK, Fischermann H, Na I, et al. Comparison of physician staffed emergency teams with paramedic teams assisted by telemedicine – a randomized, controlled simulation study. Resuscitation. 2013;84(1):85–92.View ArticlePubMedGoogle Scholar
- Skorning M, Bergrath S, Rörtgen D, Beckers SK, Brokmann JC, Gillmann B, et al. Teleconsultation in pre-hospital emergency medical services: real-time telemedical support in a prospective controlled simulation study. Resuscitation. 2012;83(5):626–32.View ArticlePubMedGoogle Scholar
- Skorning M, Bergrath S, Rörtgen D, Brokmann JC, Beckers SK, Protogerakis M, et al. E-health in emergency medicine - the research project Med-on-@ix. Anaesthesist. 2009;58(3):285–92.View ArticlePubMedGoogle Scholar
- Rohleder N, Wolf JM, Maldonado EF, Kirschbaum C. The psychosocial stress-induced increase in salivary alpha-amylase is independent of saliva flow rate. Psychophysiology. 2006;43(6):645–52.View ArticlePubMedGoogle Scholar
- Bligh J, Bleakley A. Distributing menus to hungry learners: can learning by simulation become simulation of learning? Med Teach. 2006;28(7):606–13.View ArticlePubMedGoogle Scholar
- DeMaria Jr S, Bryson EO, Mooney TJ, Silverstein JH, Reich DL, Bodian C, et al. Adding emotional stressors to training in simulated cardiopulmonary arrest enhances participant performance. Med Educ. 2010;44:1006–15.View ArticlePubMedGoogle Scholar
- Hassan I, Weyers P, Maschuw K, Dick B, Gerdes B, Rothmund M, et al. Negative stress-coping strategies among novices in surgery correlate with poor virtual laparoscopic performance. Br J Surg. 2006;93(12):1554–9.View ArticlePubMedGoogle Scholar
- Moorthy K, Munz Y, Dosis A, Bann S, Darzi A. The effect of stress-inducing conditions on the performance of a laparoscopic task. Surg Endosc. 2003;17(9):1481–4.View ArticlePubMedGoogle Scholar
- Gordis E, Granger D, Susman E, Trickett P. Asymmetry between salivary cortisol and α-amylase reactivity to stress: Relation to aggressive behavior in adolescents. Psychoneuroendocrinology. 2006;31(8):976–87.View ArticlePubMedGoogle Scholar
- van Stegeren AH, Roozendaal B, Kindt M, Wolf OT, Joëls M. Interacting noradrenergic and corticosteroid systems shift human brain activation patterns during encoding. Neurobiol Learn Mem. 2010;93(1):56–65.View ArticlePubMedGoogle Scholar
- Callahan CA, Hojat M, Gonnella JS. Volunteer bias in medical education research: an empirical study of over three decades of longitudinal data. Med Educ. 2007;41(8):746–53.View ArticlePubMedGoogle Scholar
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.