Developing an analytical tool for evaluating EMS system design changes and their impact on cardiac arrest outcomes: combining geographic information systems with register data on survival rates
© Sund; licensee BioMed Central Ltd. 2013
Received: 15 November 2012
Accepted: 8 February 2013
Published: 15 February 2013
Out-of-hospital cardiac arrest (OHCA) is a frequent and acute medical condition that requires immediate care. We estimate survival rates from OHCA in the area of Stockholm, through developing an analytical tool for evaluating Emergency Medical Services (EMS) system design changes. The study also is an attempt to validate the proposed model used to generate the outcome measures for the study.
Methods and results
This was done by combining a geographic information systems (GIS) simulation of driving times with register data on survival rates. The emergency resources comprised ambulance alone and ambulance plus fire services. The simulation model predicted a baseline survival rate of 3.9 per cent, and reducing the ambulance response time by one minute increased survival to 4.6 per cent. Adding the fire services as first responders (dual dispatch) increased survival to 6.2 per cent from the baseline level. The model predictions were validated using empirical data.
We have presented an analytical tool that easily can be generalized to other regions or countries. The model can be used to predict outcomes of cardiac arrest prior to investment in EMS design changes that affect the alarm process, e.g. (1) static changes such as trimming the emergency call handling time or (2) dynamic changes such as location of emergency resources or which resources should carry a defibrillator.
KeywordsOut-of-hospital cardiac arrest Defibrillation Response time Survival rate Geographic information systems Fire services
Out-of-hospital cardiac arrest (OHCA) is a frequent and acute medical condition that requires immediate care [1, 2]. Immediate treatment implies a survival chance of approximately 67 per cent, while the decline in survival rate without treatment is 5.5 per cent per minute and after 12 minutes a patient does not survive . Resuscitation of OHCA victims can be improved with early alarm to emergency medical systems, early cardiopulmonary resuscitation (CPR), early defibrillation, early advanced care and post-resuscitation care, i.e. the ‘chain-of-survival’ concept [4, 5]. Since survival is extremely time-sensitive, organisation of the emergency medical services (EMS) and other resources involved in the process is important.
Rational decisions about the organisation cannot be made without qualified estimations of the outcomes resulting from a specific intervention. In the present paper, we present an analytical tool for evaluating EMS system design changes and their impact on cardiac arrest outcomes. We evaluate marginal changes in the response time (defined as the interval between the OHCA incident and defibrillation) in the County of Stockholm, Sweden. Both extended and shortened response times were included as well as two alternative organisation forms of EMS defibrillation (ambulance alone and ambulance plus fire services). The latter form was useful for analysing the potential of alternative first-responders, which has been shown to improve the survival rate among patients with OHCA .
To estimate the survival rates, we use geographic information systems (GIS) simulation and combine it with register data on survival rates. GIS has previously been applied to locate potential areas of high and low rates of survival from OHCA [7, 8], as well as to determine optimal locations for EMS resources . As far as we know, this is the first study using GIS to analyse the association between location and organization of EMS resources and response times, which is directly related to survival. Alternatively, the association could be estimated by using logistic regressions on registered OHCA cases . A limitation of the regression method is that it is bound to use the existing organisation of emergency resources.
We had a unique opportunity to validate the simulation results compared to published empirical data. As part of the Saving Lives in the Stockholm Area (SALSA) project, all fire stations in the County of Stockholm were first provided with automated external defibrillators (AEDs) and fire and rescue vehicles were then dispatched in parallel with ambulances to all OHCA cases . The outcome of the SALSA project (16 additional survivors) showed good compliance with the predicted outcome (16 additional survivors). The results from the analytical tool can be used to support rational planning processes regarding interventions that affect the alarm process for OHCAs.
- 1.The number of individuals in region i who suffer an OHCA and who can be saved by emergency resource j is given by
Ii = annual incidence of OHCA in region i (we follow Hollenberg et al.  and include the patients where some type of resuscitation measure was started)
PA = probability that OHCA occurred after ambulance personnel arrival
- 2.The survival rate of patients resuscitated by emergency resource j in region i is given by a function of the time (t) from OHCA to defibrillation, i.e.
N = total number of time periods (minutes)
bi,t = population in region i reached by emergency resource j at time t
POPi = total population in region i
VFi,t = probability in region i that a patient has ventricular fibrillation (VF) at time t
si,t = probability in region i that a patient having VF survives at time t
- 3.The number of patients surviving as a result of emergency resource j in region i is given by
Finally, to obtain the marginal effects of an intervention, the procedure was repeated for the relevant alternatives and the difference in survival rates could thus be established.
GIS simulation of time from when emergency services are alerted to arrival at the incident site
The first step of our analytic model was to establish the gain in time from an OHCA to defibrillation achieved by dispatching fire services in parallel to ambulances. By using a geographic accessibility platform, PinPoint Sweden (PiPoS), developed by the Swedish Agency for Growth Policy Analysis, we arrived at the share of the population reached per minute by (1) ambulance, (2) fire services and (3) ambulance plus fire services. The simulation was performed by measuring the drive time plus the station reaction time from ambulance/fire stations to each person’s home in the County of Stockholm on 31 December 2007. The speed limits of the road network were assumed to be an approximation of the speed of the emergency vehicles. In localities, speed was assumed to be reduced by 20 per cent due to e.g. traffic congestion. ‘A locality consists of a group of buildings normally not more than 200 metres apart from each other, and must fulfil a minimum criterion of having at least 200 inhabitants’ . Only the population in the County of Stockholm was considered, but no limitation for ambulance/fire services outside this area to be called out was set, i.e. a person suffering from an OHCA may be reached by an ambulance or fire services from a neighbouring county.
The station reaction time, i.e. the time from when the emergency services are alerted until the first vehicle departs, was estimated for ambulances but we have data for that time interval for fire services. The time was set to 90 seconds for all ambulance stations. Normally there is no stipulated station reaction time. Instead a ‘priority 1’ (highest priority) alarm is supposed to be responded to ‘immediately’. However, in practice and to achieve comparability with the fire services, 90 seconds is a good approximation and there is no reason to expect fire services and ambulance to have significantly different reaction times (Fredric Jonsson, Fire protection engineer, County of Jönköping, Sweden). For the fire services the station reaction time was more complicated, since there are both full-time and part-time stations. Full-time fire-fighters usually had a station reaction time of 90 seconds, while the time was longer and varied for part-time stations. Fortunately, the Swedish Rescue Services Agency had data on each fire station’s reaction time and these were included in the simulation.
To be able to perform the simulation, we also needed to assume a specific location where OHCAs occur. Most OHCAs, 65–74 per cent, occur in the person’s home [8, 15, 16]. We therefore used the inhabitants’ homes as the location of the OHCAs. The risk was assumed to be identical in all homes, i.e. we did not use any real data to identify actual cardiac arrest patient homes. Discussion of this limitation is included in the final section.
The time from incident to start of emergency response work
The GIS simulation only displayed part of the alarm process. In addition to the station reaction time and the driving time to incident (time from emergency services alerted to arrival at incident site), which were simulated, we had to account for the process before and after this period of time in the case of an OHCA (see Figure 1). The alarm process after an OHCA starts with the time from incident to first call to the emergency call centre (in Sweden: 112). According to data from SCAR, this time was 2 minutes (median) in 2005–2006 in the County of Stockholm, which was shorter than the Swedish median time of 3 minutes . Then the emergency call handling time starts. During this time, the operator handles the case and forwards it to the appropriate emergency services.
Following the emergency call handling time, the GIS-simulated time begins. Finally there is a time interval between arrival at the site and ‘hooking up’ the defibrillator to the patient (preparation time at incident site). With help from EMS experts in the SALSA project, we approximated both the emergency call handling time and the preparation time to be 1.5 minute on average. Now, summarising the total time from OHCA to defibrillation yields 2+1.5+GIS simulation time+1.5 minutes = 5 minutes plus GIS simulation time. Since the minimum station reaction time is 1.5 minutes, the shortest time from OHCA to defibrillation would be 5+1.5=6.5 minutes when driving time to incident is shorter than 1 minute. This implies that any cardiac arrest could not have treatment in < 6.5 minutes in the model.
OHCA survival rates at various lengths of time from OHCA to defibrillation
Time is extremely important for successful treatment of OHCA and we used data from SCAR to estimate the probability of survival depending on the length of time from OHCA to defibrillation. A number of other factors also influenced the outcome, e.g. whether the OHCA was witnessed by a bystander, whether CPR was started prior to arrival of emergency services and the severity of the arrhythmia recorded by the first emergency responder . These factors were kept constant, except for the severity of the arrhythmia, which depends on time. VF (including cases of pulseless ventricular tachycardia) is the only arrhythmia that can be effectively treated with defibrillation. More severe states of arrhythmia, i.e. asystole and pulseless electrical activity (PEA), are not influenced by a quicker defibrillation response. Admittedly, a quicker emergency response is likely to have a positive effect on patients with asystole or PEA as well, e.g. CPR can be performed while waiting for the ambulance. We did not include this effect in the analysis.
Simulations and marginal effects of response time
Is the simulation model valid?
With all due respect for models, we were fortunate to be able to compare the modelled results of parallel dispatch with the ‘real’ outcome of the ‘Saving Lives in the Stockholm Area’ (SALSA) project. The results and a detailed description of the project are presented in Hollenberg et al. . As part of the project, which was introduced in 2005, all 43 fire stations in the County of Stockholm were equipped with automated external defibrillators (AED) and fire services were dispatched in parallel with ambulances to all suspected cases of OHCA. The first emergency resource to arrive started CPR and attached an AED. Ambulances were dispatched in exactly the same manner as before and the length of time from incidence to defibrillation was only affected when the fire services were first on the scene.
The effects of the project were measured and evaluated during a pilot period from 1 December 2005 to 31 December 2006. A total of 863 patients with OHCA, where some type of resuscitation measure was started, were included and the proportion of patients alive after 1 month increased significantly from 4.4 to 6.8 per cent. Since the incidence of OHCA patients in the County of Stockholm was approximately 650–700 in 2006, the estimated number of additional lives saved by the project was 16 per year.
The analytic model predicted that 26 patients would survive when only an ambulance was dispatched and that 42 patients would survive when ambulance plus fire services were dispatched (baseline level). Thus, the simulation tells us that 16 extra patients would survive through an intervention of dual dispatch, which is also what ‘reality’ tells us. We believe that the compliance of the analytic model with the results of the ‘real’ situation (SALSA) validates our model, although there were a number of uncertainty factors in both cases.
A historical control of the baseline level of survival was also possible. The model predicted that approximately 3.9 per cent of the OHCA patients would survive (ambulance EMS only). Hollenberg et al.  estimated that 4.4 per cent would survive (2004), yet earlier studies have estimated survival rates of 2.3 per cent (2000) and 3.3 per cent (2000–2002) in the Stockholm area [5, 18]. In summary, we believe that the model did comply fairly well with the baseline level.
The SALSA project has continued its dispatch of fire and rescue vehicles with ambulances. It has also expanded the first responders to include all police vehicles (approximately 120 more defibrillators). Unpublished results indicate that survival from OHCA has further increased since the pilot period.
We have presented a model that combines geographic information systems (GIS) simulations of the lengths of emergency services times from an out-of-hospital cardiac arrest (OHCA) incident to defibrillation with data on survival rates from the Swedish Cardiac Arrest Register (SCAR). Simulations of ambulance alone as well as ambulance plus fire services were utilised as emergency resources. The results can be used to support rational planning processes regarding interventions that affect the alarm process for OHCAs, e.g. by using economic evaluations . When informed about the outcomes involved, the decision maker has the opportunity to make a more enlightened policy choice and select the least expensive way to achieve a specific objective.
Implementation of policies, e.g. changes in regions or dynamic changes such as location of emergency resources or which resources should carry a defibrillator, requires new GIS simulations of the type we showed for dual dispatch. Trimming of the static time intervals in the alarm process (alarm: 2 minutes; emergency call handling: 1.5 minutes; preparation: 1.5 minutes) is important and can be directly impacted by e.g. public education (to decrease time to first call) and optimizing call handling (to decrease time to emergency service first alert). Marginal effects of changes in these intervals on survival rates can be evaluated directly by our model.
The model has several limitations that could potentially bias the results. Among other things, it was assumed that all OHCAs occur in the patients’ homes and that the risk is identical in all homes, despite the fact that OHCAs have been shown to have definite time-geographic distribution patterns . E.g. commercial and business areas are more clustered during the day than at night and demographic factors such as age also matter. It has also been shown that there is a lower prevalence of and survival from initial VF from arrests at home versus public settings . This factor should be considered in further analysis, although the proportions of VF used in the model are general for all cases of OHCA. Inclusion of actual locations of OHCAs could be used to improve upon the specific geographic risk, but it is not certain that actual locations alone would improve the prediction of future OHCAs (compared to patients’ homes).
Also, although a flat rate reduction of the driving speed in localities was included in the model, we are uncertain whether it correctly captures variations in the driving speed of emergency vehicles. Traffic congestion, road works and the choices of route may be factors that complicate the simulation. The model does not take vertical distances, e.g. floors above street level, into account, which naturally leads to further delays in arrival at patients’ side. Actual call-to-on-scene times for real OHCA events could be used to validate the speed limit based numbers as well as the assumption that the response teams are always in their stations.
Moreover, there are uncertainties regarding the estimations of the static time intervals, e.g. the emergency call handling time. In our model the emergency call handling time is estimated to be 1.5 minutes on average, yet according to SOS Alarm AB, the company responsible for handling 112 emergency calls and coordinating rescue work, it might be as long as 4 minutes on average for ‘priority 1’ ambulance calls (Mikael Björkander, SOS Alarm AB, e-mail 23 October 2008). If so, there certainly exists potential to improve this time interval. Using SOS Alarm AB’s figure of 4 minutes, the simulation model yields the baseline numbers of survivors of 15 (ambulance) and 24 (ambulance plus fire services); the baseline level of survivors is as low as 2.2% and the additional lives saved through dual dispatch is 9 instead of 16 per year. One minute shorter emergency call handling time would yield a large benefit to the OHCA population, +3 survivors (ambulance) and +5 survivors (ambulance plus fire services).
It is clear that a sensitivity analysis of the results is necessary to provide a good basis for decisions. One further opportunity for improvement is to address variability in the model. We used point estimates for all components of the model. Variability around each of these estimates can have a compounding effect and ultimately affect the accuracy of the model. Assessment of the effects of errors in assumptions for values of variables used in the model should be addressed in some way, either internalized in the model or as a sensitivity analysis of the outcome e.g. .
With the limitations, the simulation results for dual dispatch comply well with the results from a ‘real life’ intervention. In addition, Pell et al. (2001) estimated that a reduced ambulance response time from arrival at the scene within 14 minutes in 90 per cent of all emergency calls to arrival within 8 minutes would increase the survival rate from 6 to 8 per cent; reducing the response time to 5 minutes would increase the survival rate to 10–11 per cent . Even if these results are not directly comparable with ours, they are in the same order of magnitude.
Although the analytic model was calibrated for the County of Stockholm, it can be generalised to other Swedish counties or regions, as well as other countries. The data that is needed to calculate the number of patients surviving as a result of a specific EMS design change in a region is very general and easily available (see Section 2). By adjusting the model specification for r (number of patients) and s (survival rate) we may calculate effects of other changes as well, e.g. the effect of earlier CPR or the effect of faster response to other diagnoses than OHCA. Before analysing the impact of the EMS design changes on other diagnoses, we need to establish a relation between survival rates as a function of time depending on the intervention considered.
The geographic location of defibrillators is possibly the most interesting factor to elaborate on and it also affects the marginal benefits of static response time changes, e.g. the increase in number of survivors was larger after introducing dual dispatch. When we consider geographic placement, the model is useful for analysing the effect of defibrillator placement in emergency vehicles (or at least professionals in moving vehicles, e.g. taxis, security personnel, home care staff). One natural step to further increase OHCA survival would be to introduce public access defibrillation (PAD), i.e. to place AEDs in the community for use by laypersons. The analytic model does not apply to this setting with stationary AEDs. However, although evaluations of PAD trials have shown a positive impact of survival, the cost-effectiveness of these programs remains uncertain. This is due to the large resources involved and the limited potential to save lives (less than 5 percent of OHCA occur in large public buildings) [21–23].
In summary, despite the complexity of modelling an intervention of this type, we believe that the results at hand are useful for deploying effective EMS system design strategies. The possibility of testing where defibrillators should be placed geographically is deemed particularly useful and focuses on first responder defibrillation, which has potential to have an effect in private homes where the vast majority of OHCAs happen . Extension of the tool to analyse changes in e.g. the proportion where CPR was started prior to arrival of emergency services is possible. More applications using GIS technology in time-sensitive emergency conditions would be equally interesting.
I would like to thank Peter Frykblom, Catharina Hjortsberg, Jacob Hollenberg, Lars Hultkrantz, Henrik Jaldell, Ulf Persson, Leif Svensson and Mikael Svensson for helpful comments and Mikael Gustafsson, Lars Hallander and Johan Lahti for research assistance. The work was financed by the Swedish Civil Contingencies Agency (MSB).
- Holmberg M, Holmberg S, Herlitz J: Incidence, duration and survival of ventricular fibrillation in out-of-hospital cardiac arrest patients in Sweden. Resuscitation. 2000, 44: 7-17. 10.1016/S0300-9572(99)00155-0.View ArticlePubMed
- Salomaa V, Ketonen M, Koukkunen H: Decline in out-of-hospital coronary heart disease deaths has contributed the main part to the overall decline in coronary heart disease mortality rates among persons 35 to 64 years of age in Finland. The FINAMI study. Circulation. 2000, 108: 691-696.View Article
- Larsen MP, Eisenberg MS, Cummins RO: Predicting survival from out-of-hospital cardiac arrest: A graphic model. Ann Emerg Med. 1993, 22 (11): 1652-1658. 10.1016/S0196-0644(05)81302-2.View ArticlePubMed
- Cummins RO, Ornato JP, Thies WH: Improving survival from sudden cardiac arrest: the ‘chain-of-survival’ concept. A statement for health professionals from the advanced cardiac life support subcommittee and the emergency cardiac care committee, american heart association. Circulation. 1991, 83: 1832-1847. 10.1161/01.CIR.83.5.1832.View ArticlePubMed
- Hollenberg J, Lindqvist J, Ringh M: An evaluation of post-resuscitation care as a possible explanation of a difference in survival after out-of-hospital cardiac arrest. Resuscitation. 2007, 74: 242-252. 10.1016/j.resuscitation.2006.12.014.View ArticlePubMed
- Hollenberg J, Riva G, Bohm K: Dual dispatch early defibrillation in out-of-hospital cardiac arrest: the SALSA-pilot. Eur Hear J. 2009, 30: 1781-1789. 10.1093/eurheartj/ehp177.View Article
- Warden CR, Daya M, LeGrady LA: Using geographic information systems to evaluate cardiac arrest survival. Prehosp Emerg Care. 2007, 2007: 11(1)-January/March
- Ong MEH, Hoe T, Eng Y: An observational study describing the geographic-time distribution of cardiac arrest in Singapore: What is the utility of geographic information systems for planning public access defibrillation? (PADS Phase I). Resuscitation. 2008, 76: 388-396. 10.1016/j.resuscitation.2007.09.006.View ArticlePubMed
- Foo CPZ, Ahghari M, MacDonald RD: Use of geographic information systems to determine new helipad location and improve timely response while mitigating risk of helicopter emergency medical services operations. Prehosp Emerg Care. 2010, 14: 461-468. 10.3109/10903127.2010.493983.View ArticlePubMed
- Pell JP, Sirel JM, Marsden AK: Effect of reducing ambulance response times on deaths from out of hospital cardiac arrest: cohort study. Br Med J. 2001, 322: 1385-1388. 10.1136/bmj.322.7299.1385. 9 June 2001View Article
- Herlitz J: Nationellt register för hjärtstopp. Årsrapport 2011. FLISA och HLR-rådet. 2007, In Swedish, http://www.hlr.nu/sites/hlr.nu/files/attachment/Rapport%202011_0.pdf (accessed 2013-02-12)
- Rauner MS, Bajmoszy N: How many AEDs in which region? An economic decision model for the austrian Red cross. Eur J Oper Res. 2003, 150: 3-18. 10.1016/S0377-2217(02)00777-4.View Article
- Ringh M, Herlitz J, Hollenberg J: Out of hospital cardiac arrest outside home in Sweden, change in characteristics, outcome and availabilityfor public access defibrillation. Scand J Trauma Resusc Emerg Med. 2009, 17: 18-10.1186/1757-7241-17-18.PubMed CentralView ArticlePubMed
- Statistics Sweden: Tätorter 2000. Localities 2000. Sveriges officiella statistik. Statistiska meddelanden. 2002, MI 38 SM 0101. (In Swedish with English summary). http://www.scb.se/statistik/MI/MI0810/2000A01/MI0810_2000A01_SM_MI38SM0101.pdf (accessed 2013-02-12)
- Engdahl J, Herlitz J: Localization of out-of-hospital cardiac arrest in göteborg 1994–2002 and implications for public access defibrillation. Resuscitation. 2005, 64: 171-175. 10.1016/j.resuscitation.2004.08.006.View ArticlePubMed
- Iwami T, Hiraide A, Nakanishi N: Outcome and characteristics of out-of-hospital cardiac arrest according to location of arrest: a report from a large-scale, population-based study in Osaka. Japan. Resuscitation. 2006, 69: 221-228. 10.1016/j.resuscitation.2005.08.018.View ArticlePubMed
- Herlitz J: Nationellt register för hjärtstopp utanför sjukhus. Årsrapport 2007. FLISA och HLR-rådet. 2007, In Swedish, http://www.hlr.nu/sites/hlr.nu/files/attachment/rapport2007_0.pdf (accessed 2013-02-12)
- Hollenberg J, Bång A, Lindqvist J: Difference in survival after out-of-hospital cardiac arrest between the two largest cities in Sweden: a matter of time?. J Intern Med. 2005, 257: 247-254. 10.1111/j.1365-2796.2004.01447.x.View ArticlePubMed
- Sund B, Svensson L, Rosenqvist M: Favourable cost-benefit in an early defibrillation programme using dual dispatch of ambulance and fire services in out-of-hospital cardiac arrest. Eur J Heal Econ. 2012, 13: 811-818. 10.1007/s10198-011-0338-7.View Article
- Weisfeldt ML, Everson-Stewart S, Sitlani C: Ventricular tachyarrhythmias after cardiac arrest in public versus at home. N Engl J Med. 2011, 364: 313-21. 10.1056/NEJMoa1010663.PubMed CentralView ArticlePubMed
- De Maio VJ, Stiell IG, Wells GA: Potential impact of public access defibrillation based upon cardiac arrest [abstract]. Acad Emerg Med. 2001, 8: 415-416.
- Richardson LD, Gunnels MD, Groh WJ: Implementation of community-based public access defibrillation in the PAD trial. Acad Emerg Med. 2005, 12 (8): 688-697. 10.1197/j.aem.2005.03.525.View ArticlePubMed
- Pell JP, Sirel JM, Marsden AK: Potential impact of public access defibrillators on survival after out of hospital cardiopulmonary arrest: retrospective cohort study. BMJ. 2002, 325: 515-10.1136/bmj.325.7363.515.PubMed CentralView ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.