- Original research
- Open Access
Short structured feedback training is equivalent to a mechanical feedback device in two-rescuer BLS: a randomised simulation study
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicinevolume 24, Article number: 70 (2016)
Resuscitation guidelines encourage the use of cardiopulmonary resuscitation (CPR) feedback devices implying better outcomes after sudden cardiac arrest. Whether effective continuous feedback could also be given verbally by a second rescuer (“human feedback”) has not been investigated yet. We, therefore, compared the effect of human feedback to a CPR feedback device.
In an open, prospective, randomised, controlled trial, we compared CPR performance of three groups of medical students in a two-rescuer scenario. Group “sCPR” was taught standard BLS without continuous feedback, serving as control. Group “mfCPR” was taught BLS with mechanical audio-visual feedback (HeartStart MRx with Q-CPR-Technology™). Group “hfCPR” was taught standard BLS with human feedback. Afterwards, 326 medical students performed two-rescuer BLS on a manikin for 8 min. CPR quality parameters, such as “effective compression ratio” (ECR: compressions with correct hand position, depth and complete decompression multiplied by flow-time fraction), and other compression, ventilation and time-related parameters were assessed for all groups.
ECR was comparable between the hfCPR and the mfCPR group (0.33 vs. 0.35, p = 0.435). The hfCPR group needed less time until starting chest compressions (2 vs. 8 s, p < 0.001) and showed fewer incorrect decompressions (26 vs. 33 %, p = 0.044). On the other hand, absolute hands-off time was higher in the hfCPR group (67 vs. 60 s, p = 0.021).
The quality of CPR with human feedback or by using a mechanical audio-visual feedback device was similar. Further studies should investigate whether extended human feedback training could further increase CPR quality at comparable costs for training.
Immediate cardiopulmonary resuscitation (CPR) is considered the most important life-saving intervention for sudden cardiac arrest (SCA) [1, 2]. Reported outcomes of SCA vary largely between different emergency systems, regions and facilities [3–5]. Despite many studies having demonstrated the importance of high quality CPR on patient outcome [6–10], most CPR does not meet these criteria  and even healthcare practitioners exhibit sub-optimal performance . Experts agree that without understanding CPR performance, an improvement of performance, which could prevent many deaths due to cardiac arrest, cannot occur .
To address this issue, the 2010 International Liaison Committee on Resuscitation (ILCOR) guidelines highlighted the importance of optimising the resuscitation process and CPR parameters while endorsing the use of feedback devices in clinical practice as part of a comprehensive system of care for cardiac arrest . Good evidence supports the use of feedback devices during training to achieve CPR parameters closer to guideline criteria , and to improve skill acquisition [13, 14] and retention . A systematic meta-analysis of feedback devices in human and manikin studies simulating CPR scenarios showed chest compression parameters closer to recommendations, however there is no evidence that this would translate into better patient outcomes .
While knowledge about CPR quality is constantly growing, its optimal application in clinical practice remains challenging. Feedback devices could help us improve CPR skills and CPR quality. However, it is not known whether alternative methods to supply feedback might be as effective. There could also be limitations of mechanical devices, since feedback is restricted to the parameters measured. In addition, mechanical devices are not ubiquitous, neither for training, nor for real CPR.
The aim of our study was to investigate in a two-rescuer scenario whether feedback from trained humans could be as effective for CPR quality as from a mechanical audio-visual feedback device. We hypothesised that continuous feedback during CPR improves CPR quality irrespective of feedback type.
We enrolled undergraduate third year medical students in this open, prospective, randomised, controlled parallel group study. The study was performed at the Medical University of Vienna, a university-affiliated tertiary care centre, over a period of 4 weeks in October and November 2013. Students with basic BLS skills were recruited from the second unit of a compulsory BLS training course of the curriculum. Upon inclusion in the study, all students had received 2 h of basic BLS training on a manikin following a standardised teaching protocol of the Medical University of Vienna according to the ILCOR guidelines for adult automated external defibrillator BLS (AED-BLS) . Study participants had to be 18 years or older and provide written informed consent. Study participation was voluntary. Students unable to perform BLS (e.g. physical ability due to injury) were not eligible. The study protocol was in line with the Declaration of Helsinki and was approved by the local Ethics Committee of The Medical University of Vienna (EK No. 1754/2013). Informed consent was obtained from all participants and they were assured that participation would not influence their grades for the course.
After providing written informed consent, students were randomised in 3 groups using block randomisation by means of sealed envelopes. The envelopes were generated by the Department of Statistics, assuring a random allocation sequence with equal allocation ratios. After assignment to the group, students were put into pairs according to the assignment of randomised codes. Prior to study measurements, all participants received initial training using a modified 4-stage approach [16, 17]: following a standardised video according to their group, students were allowed to practice their basic life support (BLS) scenario under supervision until they felt sufficiently confident with the method. The duration of the training videos and the free practice differed between the different groups. After completion of training, participants performed 8 min of two-rescuer BLS with bag-valve mask ventilation according to ERC 2015 guidelines .
The standard BLS (sCPR) group performed resuscitation with a compression to ventilation ratio of 30:2 with a change of rescuer position after 2 min as recommended by the ERC 2010 guidelines .
Students in the human feedback (hfCPR) group were trained to specifically consider five pre-defined CPR parameters, i.e. compression rate, compression depth, correct hand position, correct decompression and hands-off time. The study participant performing ventilation was instructed to give verbal feedback about the aforementioned CPR parameters to the rescuer performing chest compressions at the beginning of each new cycle and to correct in any case of deviation from the trained criteria. The teaching video highlighted these five parameters showing examples of correct CPR and deviations in each of the parameters one by one with verbal corrections from the ventilating participant.
The QCPR feedback device (mfCPR) group performed BLS using the HeartStart MRx with Q-CPR-Technology™ (Philips, Netherlands) feedback device. The device is connected to the MRx™ defibrillator and placed over the sternum of the manikin right under the hands of the rescuer. An integrated accelerometer and a pressure sensor measure compression rate and depth. Real time visual feedback is provided using graphs and numbers on the display of the MRx™ defibrillator placed next to the manikin. Furthermore, automated audio feedback advises the rescuer about necessary corrections if values diverge from the programmed range.
CPR quality was assessed by using two Ambu®ManC manikins (Ambu, Ballerup, Denmark) with medium thorax resistance. The manikins were placed on a firm even floor to avoid inaccuracies in measuring compression depth and were connected to personal computers (Fujitsu Siemens, Amilo PA 1510). Data recording and analysis were performed with the Ambu® CPR Software (version 2.3.9, Ambu®, Ballerup, Denmark) as previously described . Prior to the start of the study, the accuracy of sensing compression depth was assessed and set to various compression depths between 10 and 63 mm using Thumper® model 1005 (Michigan Instruments Inc., Grand Rapids, MI) . Bag-valve mask ventilation (Laerdal LSR Adult Standard, Stavanger, Norway) was performed at a compression-to-ventilation ratio of 30:2.
Measurement and outcomes
Effective compression ratio (ECR), a parameter combining correct hand position, chest compression depth, and complete decompression multiplied by flow-time fraction, which has recently been established to assess quality of CPR, was defined as the primary outcome parameter . The primary hypothesis to be tested was that there is no difference in ECR between the groups sCPR, hfCPR and mfCPR. In brief, ECR was defined as effective compressions in % (EC: correct hand position, depth (50–60 mm) and complete decompression) multiplied by flow-time fraction (FTF) in %. Complete decompression was considered sufficient with no residual leaning of more than 10 mm in accordance with previous studies to eliminate artefacts . The ratio of ECs during CPR duration was assessed by a Visual Basic based excel macro and then multiplied by the FTF. With a 30:2 compression-to-ventilation ratio and a resulting FTF of 79 %, a guideline compliant ECR would be indicated by 0.79.
Secondary outcome parameters of chest compressions such as EC, compression rate (CR), compression depth, complete decompressions and incorrect pressure point were assessed. Additionally, time related parameters such as FTF (flow time fraction of chest compressions), absolute hands-off time (time fraction without compressions or ventilation) and time until first chest compression as well as ventilation parameters such as ventilation volume, ventilation minute volume, ventilation time and the number of gastric inflations were evaluated.
Subjective assessment by study participants
Following the BLS testing, all study participants were requested to complete a form focusing on their experience with the applied method. Answers were rated on a 10-point Likert scale (most difficult = 1 to easiest = 10). As a final question, participants were asked which method they would prefer in a real-life BLS situation.
The CRP related primary and secondary outcome parameters were regarded pairwise for the 8-min CPR period, while baseline characteristics of the participants and the subjective assessment forms were analysed for each study participant separately. Based on previous studies , we estimated a standard deviation of 0.21 for our primary study endpoint (effective compression ratio). Hence, based on a two-sided t-test with an alpha = 0.0167 (Bonferroni corrected for all pairwise comparisons between the 3 groups) and a power of 80 %, a total sample size of 60 study participants per group was needed. To adjust for potential dropouts, we estimated a dropout rate of 10 % and therefore increased the group size to 70 participants per group. Sample size calculation was performed using NQuery 6.01 (Statistical Solutions Ltd., USA). Normal distribution was tested by visual assessment of the investigated variables. Normally distributed continuous data was presented as mean ± standard deviation (SD) and compared using Student’s t-test. In the absence of normal distribution, continuous variables were expressed as median and interquartile range (IQR) and compared using Kruskal-Wallis statistics. Analysis of variance (ANOVA) was used to compare all three groups. Frequencies were compared by means of the Chi-Square test. SPSS 21 for Mac (IBM SPSS, USA) was used for all analysis. P-values <0.05 were considered statistically significant.
Out of a total of 370 screened students, we enrolled and randomised 326 participants, no dropouts occurred after randomisation (Fig. 1). Baseline characteristics are shown in Table 1. No significant differences in anthropological parameters, prior resuscitation training or real life CPR experience between the groups was found. Total training time differed between the groups and was shortest for the sCPR group compared to mfCPR (357 vs. 378 s, p = 0.010) or hfCPR (357 vs. 572 s, p < 0.001). The training video in the hfCPR group was longest, leading also to significantly more time to feel competent with the method compared to mfCPR or sCPR (258 s in hfCPR vs. 210 s in mfCPR, p = 0.038; and hfCPR vs. 210 s in sCPR, p < 0.001). Differences in sensitivity between the two manikins were negligible and clinically not relevant. No participant had to discontinue the test.
ECR was higher in the mfCPR group compared to sCPR (0.35 vs. 0.27, p = 0.018), however, not significantly different to hfCPR (0.35 vs. 0.33, p = 0.435). Mean compression depth and compression rate were within the recommended range in all three groups. Numerically, the use of the QCPR device resulted in the lowest compression depth of 55 mm and a compression rate of 102 min−1. However, the mfCPR group showed the highest percentage of compressions within the recommended range of depth and a tighter control of CPR quality for this parameter through the device.
The percentage of incorrect decompressions was highest in the mfCPR group (33 % in mfCPR vs. 16 % in sCPR, p = 0.023; and mfCPR vs. 26 % in hfCPR, p = 0.044). The percentage of incorrect pressure points and the occurrence of injuries (blisters on the participants’ palms) were comparable between the three groups. A more detailed description of compression parameters is displayed in Table 2.
Time related parameters
mfCPR was superior regarding flow time fraction compared to sCPR and hfCPR (82 % in mfCPR vs. 81 % in sCPR, p = 0.003; and mfCPR vs. 80 % in hfCPR, p = 0.001). No significant difference could be found between the sCPR and hfCPR group (p = 0.408). Absolute hands-off time was highest in the hfCPR group with significant difference to mfCPR (67 vs. 60 s, p = 0.021), whereas hands-off time in the hfCPR group was comparable to the sCPR group (Table 2).
Minute volume, ventilation volume and gastric inflations were similar among all three groups (Table 2).
In a real-life resuscitation scenario, the majority of participants would prefer CPR with human feedback (42 %), followed by mechanical feedback (27 %). Only 5 % favour CPR without feedback at all, indicating rescuers’ desire for objective evaluation in this setting. At the same time, the participants using the QCPR prompt device rated the difficulty of performing CPR on a scale between 0 and 10 as highest compared to the other groups (8.0 in mfCPR vs. 7.2 in hfCPR, p < 0.001; and mfCPR vs. 6.9 in sCPR, p < 0.001), while perception of human feedback difficulty did not significantly differ compared to standard BLS (7.2 in hfCPR vs. 6.9 in sCPR, p = 0.328).
To the best of our knowledge, this study is one of the few studies to investigate the effectiveness of standardised verbal feedback by trained humans compared to feedback prompt devices and the first study using a two-rescuer BLS scenario. The results demonstrate an equivalent effect of human feedback compared to audio-visual feedback by a feedback prompt device assessed by the compound parameter ECR reflecting CPR quality.
Feedback prompt devices in clinical practice
The use of audio-visual feedback devices resulted in rescuers providing CPR closer to the ERC recommendations both in manikin and human studies . In accordance with these results, we found a higher CPR quality in the group using the audio-visual feedback device compared to sCPR. Additionally, ECR using the QCPR feedback device was comparable with previous studies [21–23]. Our results extend previous knowledge, since this is the first study testing the HeartStart MRx with Q-CPR-Technology™ in a two-rescuer BLS scenario. The better CPR quality found in this study compared to our earlier studies, where the QCPR technology was used in single-rescuer BLS , might be triggered by the fact that additional visual and verbal feedback were provided from the HeartStart MRx monitor. Interestingly, more incorrect decompressions occurred in the feedback prompt device group, which might have been caused by an underestimation of compression depth by the device.
An important issue in the use of CPR devices is the time needed to install the device. In our study the time until the first chest compression was significantly less in the hfCPR group. On the other hand, absolute hands-off time resulting in a significantly smaller flow time fraction was significantly higher in the hfCPR group. The good performance of the feedback prompt device regarding hands-off time and flow time fraction might be attributed to the better visualisation and indication of timing for rescuer change.
We are only aware of three studies comparing human feedback to feedback through technical measures. In the first study, verbal feedback from an instructor was compared to a “voice advisory manikin” for CPR training of medical students. For overall CPR performance both methods were comparable, however instructor facilitated training was superior for teaching ventilations . As an important limitation, prompts given by a manikin may not be translated into real life scenarios, where patients are unable to give feedback. The second study addressed the effect of verbal feedback on ventilation training in neonatal resuscitation , with no overall difference between verbal feedback and a tidal volume monitor. The third study investigated ventilation training in lay BLS courses, reporting that verbal feedback increased hyperventilation and excessive stomach inflation of manikins .
Feedback prompt devices provide precise information about the device parameters. Our study showed that human feedback identifies and corrects deviations from ideal CPR parameters in a similar fashion to CPR feedback prompt devices. Experienced rescuers are able to provide a semi-quantitative assessment of the technical skills, such as chest compression depth and rate or sufficiency of decompressions, and quickly recognise incorrect hand position. Although currently there is no evidence supporting the possibility that integrated non-technical skills in human feedback could also improve CPR quality in terms of the five parameters or beyond, it may be assumed that the ability to combine complex information from well-trained human observers in a CPR setting may be beneficial and would lead to an enhanced CPR environment (e.g. recognition of rescuer fatigue and organising the alternation of rescuers providing chest compressions or psychological factors, such as motivation and shared decision making). On the other hand, human feedback would need at least two experienced rescuers.
This raises the question to what extent human feedback can contribute to the improvement of CPR performance in the absence of a feedback prompt device. We found a comparable ECR (quality of CPR) between the hfCPR and the mfCPR group, but on the other hand, no statistical difference between the sCPR and the hfCPR group could be shown. Could more intensive human feedback training improve the performance even more? Or would the combined approach of a feedback prompt device together with feedback-trained humans be the ‘silver bullet’ for the best CPR performance? All in all, we need to start thinking about the interaction of feedback prompt devices and human feedback providers. In summary, human feedback has demonstrated having at least a similar ability to potentially improve CPR quality compared to feedback prompt devices, which are considerably more expensive.
Limitations and strengths of the study
Naturally, manikin studies simulate cardiac arrest conditions only to a limited extent. On the other hand, simulation allows standardisation of training and testing conditions leading to an enhanced interpretability of performance and CPR quality.
Due to the nature of a single centre study, the generalisation of the results is limited. The study population consisted of recently trained BLS providers with limited experience in real-life BLS. Training time varied inevitably between the groups because of the different teaching content according to the CPR method used (training of verbal feedback was substantially more time-intensive than becoming familiar with the feedback prompt device) and that could definitely be a confounder. Furthermore, the subjective assessment form was not pre-validated.
We did not formally assess the costs of the training. However, future investigations might look at the most suitable duration of training with respect to the best CPR performance after verbal feedback and its cost efficiency compared to commercially available feedback prompt devices requiring large investments.
This study demonstrated a significant advantage of continuous feedback compared to no feedback during two-rescuer BLS. In addition, verbal human feedback (acquired in a short training session) was not inferior to a mechanical audio-visual feedback prompt device.
automated external defibrillator
basic life support
effective compression ratio
human feedback group
international liaison committee on resuscitation
sudden cardiac arrest
standard BLS group
Kouwenhoven WB, Jude JR, Knickerbocker GG. Closed-chest cardiac massage. JAMA. 1960;173:1064–7.
Hasselqvist-Ax I, Riva G, Herlitz J, Rosenqvist M, Hollenberg J, et al. Early cardiopulmonary resuscitation in out-of-hospital cardiac arrest. N Engl J Med. 2015;372:2307–15.
Nichol G, Thomas E, Callaway CW, Hedges J, Powell JL, et al. Regional variation in out-of-hospital cardiac arrest incidence and outcome. JAMA. 2008;300:1423–31.
Meaney PA, Bobrow BJ, Mancini ME, Christenson J, de Caen AR, et al. Cardiopulmonary resuscitation quality: [corrected] improving cardiac resuscitation outcomes both inside and outside the hospital: a consensus statement from the American Heart Association. Circulation. 2013;128:417–35.
Lindner TW, Soreide E, Nilsen OB, Torunn MW, Lossius HM. Good outcome in every fourth resuscitation attempt is achievable–an Utstein template report from the Stavanger region. Resuscitation. 2011;82:1508–13.
Berg RA, Sanders AB, Kern KB, Hilwig RW, Heidenreich JW, et al. Adverse hemodynamic effects of interrupting chest compressions for rescue breathing during cardiopulmonary resuscitation for ventricular fibrillation cardiac arrest. Circulation. 2001;104:2465–70.
Kern KB, Hilwig RW, Berg RA, Sanders AB, Ewy GA. Importance of continuous chest compressions during cardiopulmonary resuscitation: improved outcome during a simulated single lay-rescuer scenario. Circulation. 2002;105:645–9.
Sayre MR, Koster RW, Botha M, Cave DM, Cudnik MT, et al. Part 5: adult basic life support: 2010 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations. Circulation. 2010;122:S298–324.
Eftestol T, Sunde K, Steen PA. Effects of interrupting precordial compressions on the calculated probability of defibrillation success during out-of-hospital cardiac arrest. Circulation. 2002;105:2270–3.
Kramer-Johansen J, Myklebust H, Wik L, Fellows B, Svensson L, et al. Quality of out-of-hospital cardiopulmonary resuscitation with real time automated feedback: a prospective interventional study. Resuscitation. 2006;71:283–92.
Wik L, Kramer-Johansen J, Myklebust H, Sorebo H, Svensson L, et al. Quality of cardiopulmonary resuscitation during out-of-hospital cardiac arrest. JAMA. 2005;293:299–304.
Kirkbright S, Finn J, Tohira H, Bremner A, Jacobs I, et al. Audiovisual feedback device use by health care professionals during CPR: a systematic review and meta-analysis of randomised and non-randomised trials. Resuscitation. 2014;85:460–71.
Dine CJ, Gersh RE, Leary M, Riegel BJ, Bellini LM, et al. Improving cardiopulmonary resuscitation quality and resuscitation training by combining audiovisual feedback and debriefing. Crit Care Med. 2008;36:2817–22.
Lukas RP, Van Aken H, Engel P, Bohn A. Real-time feedback systems for improvement of resuscitation quality. Anaesthesist. 2011;60:653–60.
Isbye DL, Hoiby P, Rasmussen MB, Sommer J, Lippert FK, et al. Voice advisory manikin versus instructor facilitated training in cardiopulmonary resuscitation. Resuscitation. 2008;79:73–81.
Greif R, Stumpf D, Neuhold S, Rutzler K, Theiler L, et al. Effective compression ratio–a new measurement of the quality of thorax compression during CPR. Resuscitation. 2013;84:672–7.
Sopka S, Biermann H, Rossaint R, Knott S, Skorning M, et al. Evaluation of a newly developed media-supported 4-step approach for basic life support training. Scand J Trauma Resusc Emerg Med. 2012;20:37.
Travers AH, Perkins GD, Berg RA, Castren M, Considine J, et al. Part 3: adult basic life support and automated external defibrillation: 2015 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science with Treatment Recommendations. Circulation. 2015;132:S51–83.
Zapletal B, Greif R, Stumpf D, Nierscher FJ, Frantal S, et al. Comparing three CPR feedback devices and standard BLS in a single rescuer scenario: a randomised simulation study. Resuscitation. 2014;85:560–6.
Aufderheide TP, Pirrallo RG, Yannopoulos D, Klein JP, von Briesen C, et al. Incomplete chest wall decompression: a clinical evaluation of CPR performance by EMS personnel and assessment of alternative manual chest compression-decompression techniques. Resuscitation. 2005;64:353–62.
Noordergraaf GJ, Drinkwaard BW, van Berkom PF, van Hemert HP, Venema A, et al. The quality of chest compressions by trained personnel: the effect of feedback, via the CPREzy, in a randomized controlled trial using a manikin model. Resuscitation. 2006;69:241–52.
Pozner CN, Almozlino A, Elmer J, Poole S, McNamara D, et al. Cardiopulmonary resuscitation feedback improves the quality of chest compression provided by hospital health care professionals. Am J Emerg Med. 2011;29:618–25.
Fischer H, Neuhold S, Zapletal B, Hochbrugger E, Koinig H, et al. A manually powered mechanical resuscitation device used by a single rescuer: a randomised controlled manikin study. Resuscitation. 2011;82:913–9.
Binder C, Schmolzer GM, O’Reilly M, Schwaberger B, Urlesberger B, et al. Human or monitor feedback to improve mask ventilation during simulated neonatal cardiopulmonary resuscitation. Arch Dis Child Fetal Neonatal Ed. 2014;99:F120–3.
Paal P, Falk M, Gruber E, Beikircher W, Ellerton J, et al. Effects of training time and feedback on ventilation skills in lay rescuers. Emerg Med J. 2010;27:313–6.
We gratefully and sincerely acknowledge Erich Pawelka, Katharina Skvarc, Christoph Schriefl, Christoph Diabiasi and Matthias Müller for the extraordinary organisation and valuable support as well as Irene Steiner and Christoph Krall for the statistical support and Emily Lemon for the proofreading.
None of the authors has a conflict of interest. Philips provided the HeartStart MRx with Q-CPR-Technology™ free of charge for the period of our study. Philips never reviewed or revised the manuscript at any stage.
HF, MH, JB and RG participated in the design of the study. HF, NP, GG, FN, DS carried out the study and participated in data preparation. HF, NP and GG participated in statistical interpretation of the data and NP drafted the manuscript. HF, GG and KR contributed to substantial changes to the manuscript. All authors reviewed the manuscript critically and approved the final manuscript.