- Original research
- Open Access
The effect of a terrorist attack on emergency department inflow: an observation study using difference-in-differences methodology
© The Author(s). 2019
- Received: 5 March 2019
- Accepted: 17 May 2019
- Published: 24 May 2019
The objective of this study was to investigate how the terrorist attack in Stockholm, Sweden affected patient inflow to the general emergency departments (EDs) in close proximity of the attack. The study analyzed if, and to what extent, the attack impacted ED inflow during the following days and weeks.
In a retrospective observational study, anonymized aggregated data on ED arrivals (inflow of patients) to all seven of the EDs in the Stockholm County was analyzed using the Difference-in-Differences (DiD) estimator. The control groups were the affected hospitals in the years prior to the terrorist attack. The number of ED visits was retrieved from the Stockholm County Council administrative database.
The study shows a statistically significant reduction in overall ED inflow of 7–9% following the attack. The effect was strongest initially after the attack, and ED inflow regained normal levels within approximately three weeks’ time, without any significant rebound effect. The effect on ED inflow also decreased with distance from ground zero, and was not significant further away than 10 km.
The results showed that ED inflow was significantly decreased in the weeks immediately following the Stockholm terrorist attack. The reasons for this cannot be fully explained in this observational study. However, the results suggest that some patients actively choose when, where and if they should go to the ED.
- Emergency service
- Patient acceptance of health care
- Health behavior
At 2:43 pm, Friday, April 7th 2017 a single terrorist drove a delivery truck down one of the busiest shopping streets of Stockholm, Sweden. Five people were killed and 14 were severely injured during the truck’s short campaign, which abruptly ended with the truck crashing into the front of a major department store [1, 2].
In the past, terrorist attacks have been shown to have a large immediate impact on the inflow of patients to emergency departments (EDs). E.g. more than 1000 victims were treated in the five closest hospitals during the first 48 days after the terrorist attack on the World Trade Center in 2001 . While many victims were seriously injured, over-triage was also reported. I.e. minimally injured victims received a high triage priority and were sent to the hospitals despite the lack of medical necessity , a problem observed during other terrorist attacks as well [5–7]. During and immediately after a terrorist attack with many victims EDs in the close proximity will be burdened, both by severely and less injured.
Terrorist attacks also affect the ED inflow on the longer term for specific symptoms and diagnoses, even for people not directly injured in the attack. While some people act bravely and philanthropically in the community right after an attack, acute stress reactions are common . Again, exemplified by the attack on the World Trade Center, there was a 10% increase in behavioral and mental health diagnoses in the EDs in close geographical proximity to the attack . In addition, media plays a role in affecting the longer-term inflow. Previous studies have found that media coverage of adverse events influences healthcare related behavior, leading to more people seeking care when the media coverage is intense [9, 10]. However, there is little research investigating how ED inflow is affected in the following weeks after a terrorist attack.
A terrorist attack is a strain on the society in general and on the health care system in particular. Since ED crowding is a constant problem in many countries, it is important to understand how extreme events like terrorist attacks may impact the inflow of patients to the ED. More importantly, such studies may help us better understand factors and events that influence patients’ decisions to seek medical care at the ED. An understanding of this decision process is of practical value in the planning of ED operations, as well as in the design of the emergency care system in general.
The objective of this study is to investigate how the terrorist attack affected patient inflow to the emergency departments in close proximity to the attack. While the number of casualties and injured people in the Stockholm terrorist attack could be considered low compared to other recent attacks in Europe and USA , it was the largest terrorist attack in Sweden in modern time and received extensive media coverage, both from national and international media . As such, it can be hypothesized that the attack influenced individual’s healthcare seeking decisions. In this study we analyze if, and to what extent, this influence impacted the ED inflow.
The study is a retrospective observational study that uses anonymized aggregated data on ED arrivals.
Study setting and selection of participants
Emergency Hospitals in Stockholm County. Km = kilometers
Emergency census / year (year 2016)
Distance to site of terrorist attack (km)
St Görans sjukhus
Karolinska sjukhuset Solna
Karolinska sjukhuset Huddinge
Data collection and processing
Data was gathered from the Stockholm County Council data warehouse, VAL [18, 19]. VAL is a comprehensive database consisting of all administrative health care data generated in the Stockholm County on individual level. All health care contacts and the corresponding diagnoses for each visit are stored in VAL, with exception of a few private clinics that operate without subsidies in the Stockholm area . VAL has more than 99% coverage of hospital care in the county . Numbers on daily inflow to all seven hospital bound EDs in Stockholm County were collected and stratified on age for the period of January 1st 2013 –May 31st 2017. The Norrtälje ED (the smallest of the seven EDs) was excluded from the analysis since the surrounding municipality had a different Easter holiday week in 2017 than the rest of Stockholm County. This would make it difficult to disentangle the potential effect of the attack from potential holiday effects. Also, given that the Norrtälje ED is in a rural area more than twice as far away from the attack as the second furthest ED, it is unlikely to have been affected.1 Specialized psychiatric EDs were not included.
To analyze the effect of the terrorist attack on the ED inflow we use the Difference-in-Differences (DiD) estimator, where the control groups are the affected hospitals in the years prior to the terrorist attack. The DiD technique is commonly used to assess treatment effects in observational studies [20–22]. The DiD estimator estimates the effect of the treatment (terrorist attack) by comparing the average change in the outcome (ED inflow) in the treatment group with the average change in the outcome in the control group. This ensures unbiased causal estimates of the treatment effect under the assumption that, without treatment, the treatment and control would have followed parallel trends over time.
To better understand the duration and dynamics of the reduction in ED inflow we use the method outlined by Granger  and implemented by Autor  to examine how the effect size evolves over time. The technique builds on introducing “leads” and “lags” of the treatment effect. In essence, the ‘leads’ measure the effect of treatment before the treatment (which, of course, is hypothesized to be insignificant), and the ‘lags’ measure the effect of treatment in the periods that follow treatment. The “leads” can be interpreted as placebo effects and the “lags” indicate the duration of the treatment effect.
The outcome of interest is the number of patients of each age group arriving at the ED during a given day. To simplify the interpretation of the results, we logarithmized the dependent variable. We also controlled for month, weekday and Easter holiday as well as time-fixed effects on the age group x hospital level. To correct for potential correlation within hospitals, the model is estimated with cluster robust standard errors. The regressions are run with the software Stata (version 15, StataCorp LLC, Texas, USA) and the command xtreg.
The effect of the Stockholm terrorist attack on ED inflow
Difference-in-Differences estimation results. The treatment effect (effect of the terrorist attack) is given by the Treatment group x After coefficients and can be interpreted as the absolute percentage decrease in ED visits caused by the attack. The predicted reduction hence ranges from 7.03% (Model 2) to 8.98% (Model 3). The regressions also control for Easter holiday, month, weekday, age group, holiday and age group x holiday fixed effects. These coefficients are omitted for the sake of readability
Dependent variable = log(Visits)
5 Day Window
10 Day Window
15 Day Window
Treatment group x After
The Treatment group coefficients indicate an relative increase of 17% in ED inflow in the treatment year (2017) compared to the control years (2013–2016). The After coefficient in Model 3 is positive and significant, which shows that, across all years, the after period has slightly higher inflow than the before period. The Between R-Square is high compared to the Within R-Square, which is typical for fixed effects models, and the F Statistic indicate a high overall statistical significance of the regression model.
The impact of distance from the attack
The estimated impact of the terrorist attack on ED inflow for increasing distances from the epicenter of the attack. The Table shows that the effect no longer becomes significant over 10 km distance. Note that the maximum distance in the data is 28.5 km and that the results cannot be extrapolated beyond this point due to the linearity assumption
Distance from attack [km]
Additional analyses were performed as robustness checks of the main results. Data on ED inflow from four hospitals in the two counties adjacent to Stockholm were collected. Since the effect of the terrorist attack diminished with the distance from the epicenter of attack, no significant effect from the terrorist attack was to be expected at hospitals in adjacent regions. The Post-hoc analysis confirmed this. For the first county, Uppsala, arrivals at a single hospital were analyzed. The analysis revealed no significant change in inflow after the attack (− 0.0988, p-value: 0.143, n = 280). For the second, Södermanland, visits at three hospitals were analyzed. Also, these results did not indicate any significant change in ED inflow (− 0.0546, p-value: 0.237, n = 1890), despite the relatively large data set.
This study documents a significant decrease in ED patient inflow during the weeks following the Stockholm terrorist attack. The inflow was reduced by 8% during more than two weeks after the terrorist attack compared to the control years. To our knowledge, this is the first study on how general ED attendance is affected in the days and weeks following a terrorist attack. The current results display a different result from previous studies, which conversely point to an increase in the inflow after a terrorist attack [8, 25, 26]. This discrepancy may, in part, be explained by the current study measuring the entire ED inflow rather than a sub-population with specific conditions such as PTSD and other psychiatric disorders .
There is no previous work studying the effect of ED inflow in the aftermath of a terrorist attack like the one studied in the article at hand. Similar studies have been made of the hurricane Sandy in the USA 2012. Those studies show an increase of the ED inflow during the period subsequent to the hurricane which would contradict the findings in the study at hand [27, 28]. The two events, though, are inherently different; the hurricane was known in advance and prolonged in time, whereas the terrorist attack bore neither of those characteristics.
Although the results clearly demonstrate that the ED inflow decreased after the terrorist attack, the study does not explain the reasons behind this. While it cannot be ruled out, it must be considered extremely unlikely that 8% of potential patients were healthier during this exact time and in this exact region. A more plausible explanation is that some of the patients that otherwise would have gone to the ED chose not to go during this period. It is possible that the patients did not visit the ED due to fear , altruism to avoid congestion at the ED in times of a crisis , or unwillingness to visit what could be thought to be a crowded ED.  Altmayer et al. has shown that 7.2% of ED visits are best suited for primary care . The observed reduction of ED inflow in the current study is of the same magnitude, which could imply that the decrease in ED inflow represents people that could seek help from other health care providers. The question of whether these 8% actually did seek healthcare elsewhere, and what sort of patients they were, are important questions that we plan to address in future research. A better understanding of the behavior of ED attendees could be useful for the design of health care systems and when deciding actions to reduce ED crowding.
The reduction in patient inflow was seen across all six hospitals, but the effect decreased with the distance from the epicenter of the terrorist attack. Similar distance related differences have been observed in other studies. DiMaggio et al. showed that the number of PTSD related visits to the ED after a terrorist attack was related to the proximity of the hospital to the area of the attack . Similarly, Laugharnea et al. argue that the risk of PTSD is increased by geographic proximity to the attack . Also, the proximity of an indirectly exposed individual (where indirect exposure is defined as “repeated or extreme exposure to aversive details”) to the site of an adverse event predicts the severity or amount of symptoms this individual may experience. The effect on ED inflow as a function of the distance to ground zero observed in this study may be a result of this phenomenon .
The changes in ED inflow during the study period may also be an effect of the media coverage of the terrorist attack and the considerable amount of indirectly exposed people having psychological symptoms caused by this exposure. The level of media exposure has been shown to predict both the length and severity of psychological symptoms, but the symptoms appear over a limited period of time. This may, in part, explain the unexpected pattern of decreased ED inflow during a period of no more than three weeks seen in this study .
It is well known that ED inflow varies over time. Calendar data (time, day of week, season and holidays) and the number of previous visits have been shown to be the strongest predictors of ED inflow [39, 40]. Though not the primary aim, the current study adds new knowledge by showing how events, e.g. a terrorist attack, can have an effect on ED inflow over a time window of 2–3 weeks.
The study investigates the effect of a single terrorist attack on ED inflow in one county. This may be seen a limitation. However, Stockholm is the most densely populated county in Sweden, and is served by seven large hospital EDs. Therefore, we believe that the results can be generalized to similar urban settings. Moreover, the study includes only aggregated effects on the numbers of visits to the EDs. A detailed understanding of which patients (gender, chief complaints, socioeconomic background etc.) that did not visit the EDs was not analyzed, but is planned for future studies. Neither were visits to psychiatric EDs nor primary care facilities assessed in this study.
The research at hand studies the difference-in-differences effect over a time-period relative to Easter. As Easter may occur during a time period between the end of March and the end of April depending on the year, the dates compared are not the same between years, although weekdays are compared to corresponding weekdays. The variation of ED inflow between March and April is low, why the biasing effect of this conduct is considered to be low.
In addition, the method in this study is that of a retrospective register study and does therefore not explain causation. This being said, a prospective randomized controlled study of this sort of phenomenon, i.e. a terrorist attack, would be difficult to undertake.
This research shows that ED inflow significantly decreased in the weeks immediately following the Stockholm terrorist attack. This is surprising and raises a number of questions for future research. The results suggest that some patients actively choose when, where and if they should go to the ED. It would be of great value to better understand which type of patients they are, how they make healthcare seeking decisions and where they are best treated.
Grant from Stockholm County Council, LS 2016–1448, Awarded to Assistant Professor Olov Isaksson. Funding has been used for time for data gathering, analysis and writing.
MN conceived the study and collected the data. LK advised on study design. FEL and OI chose statistical methods and conducted the data analysis. AE made the background literature review and drafted of the manuscript. All authors concluded the results and jointly made substantial contributions to its revision. MN takes responsibility for the paper as a whole. All authors read and approved the final manuscript.
Ethics approval and consent to participate
The study was conducted with the permission from the Regional Ethical Review Board in Stockholm (dnr 2017/205–31/5).
Consent for publication
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Sweden becomes the latest victim of vehicular terrorism. The Economist. http://www.economist.com/news/europe/21720497-attack-stockholms-central-shopping-district-kills-four-sweden-becomes-latest-victim. Published 2017. Accessed May 20, 2017.
- About the suspected terrorist attack. Swedish police Departement. https://polisen.se/siteassets/dokument/utvarderingar/utvardering-av-attentatet-i-stockholm-7-april-2017.pdf.
- Pryor JP. The 2001 world trade center disaster: summary and evaluation of experiences. Eur J Trauma Emerg Surg. 2009;35(3):212–24. https://doi.org/10.1007/s00068-009-9902-6.View ArticlePubMedGoogle Scholar
- Silver RC, Fischhoff B. What should we expect after the next attack? Am Psychol. 2011;66(6):567–72. https://doi.org/10.1037/a0024893.View ArticlePubMedGoogle Scholar
- Feliciano DV, Anderson GV, Rozycki GS, et al. Management of casualties from the bombing at the centennial Olympics. Am J Surg. 1998;176(6):538–43. https://doi.org/10.1016/S0002-9610(98)00263-3.View ArticlePubMedGoogle Scholar
- Frykerberg ER, Tepas JJ. Terrorist bombings lessons learned from Belfast to Beirut. Ann Surg. 1998;208:569–76.View ArticleGoogle Scholar
- Scheibner AD. World trade center perspective from a Manhattan emergency medicine resident. Ann Emerg Med. 2002;39(1):9–10. https://doi.org/10.1067/mem.2002.120734.View ArticlePubMedGoogle Scholar
- DiMaggio C, Galea S, Richardson LD. Emergency department visits for behavioral and mental health care after a terrorist attack. Ann Emerg Med. 2007;50(3):327–34. https://doi.org/10.1016/j.annemergmed.2006.10.021.View ArticlePubMedGoogle Scholar
- Keays G, Pless IB. Impact of a celebrity death on children’s injury-related emergency room visits. Can J Public Heal. 2010;101(2):115–8. https://doi.org/10.1136/ip.2010.029215.450.View ArticleGoogle Scholar
- Codish S, Novack L, Dreiher J, et al. Impact of mass media on public behavior and physicians: an ecological study of the H1N1 influenza pandemic. Infect Control Hosp Epidemiol. 2014;35(6):709–16. https://doi.org/10.1086/676426.View ArticlePubMedGoogle Scholar
- Global Terrorism Database. National Consortium for the Study of Terrorism and Responses to Terrorism, University of Maryland. http://www.start.umd.edu/gtd/. Published 2017.
- Thorell AR. Efter terrordådet: Så lyftes Stockholm i utländsk media. Resumé. https://www.resume.se/nyheter/artiklar/2017/04/10/efter-terrordadet-sa-lyftes-stockholm-i-utlandsk-media/. Published 2017.
- Folkmängden efter region, civilstånd, ålder och kön. År 1968–2016. Statistics Sweden (SCB). http://www.statistikdatabasen.scb.se/pxweb/sv/ssd/START__BE__BE0101__BE0101A/BefolkningNy/table/tableViewLayout1/?rxid=87519564-e99f-4194-9b98-62dc96678d64. Published 2017.
- Pubmed. National Center for Biotechnology Information (NCBI). National Library of Medicine (US). https://www.ncbi.nlm.nih.gov/.
- PsycARTICLES. American Psychological Association. http://www.apa.org/pubs/databases/psycarticles/index.aspx.
- reSEARCH. Karolinska Institutet, University Library. http://pmt-eu.hosted.exlibrisgroup.com/primo_library/libweb/action/search.do?vid=46KIB_VU1&reset_config=true.
- Google Scholar. https://scholar.google.se.
- Wändell P, Carlsson AC, Wettermark B, Lord G, Cars T, Ljunggren G. Most common diseases diagnosed in primary care in Stockholm, Sweden, in 2011. Fam Pract. 2013;30(5):506–13. https://doi.org/10.1093/fampra/cmt033.View ArticlePubMedGoogle Scholar
- Ekstrom A, Kurland L, Farrokhnia N, Castren M, Nordberg M. Forecasting emergency department visits using internet data. Ann Emerg Med. 2015. https://doi.org/10.1016/j.annemergmed.2014.10.008.View ArticleGoogle Scholar
- Angrist JD, Pischke JS. Mostly harmless econometrics : an empiricist ’ s companion. Massachusettts I nstitute Technol London Sch econ; 2008. https://doi.org/10.1017/CBO9781107415324.004.View ArticleGoogle Scholar
- Imbens GW, Wooldridge JM. Recent developments in the econometrics of program evaluation. J Econ Lit. 2009. https://doi.org/10.1257/jel.47.1.5.View ArticleGoogle Scholar
- Card D, Krueger A. Minimum wages and employment: a case study of the fast-food industry in New Jersey and Pennsylvania. Am Econ Rev. 1994. https://doi.org/10.2307/2118030.
- Granger CWJ. Investigating causal relations by econometric models and cross-spectral methods. Econometrica. 1969. https://doi.org/10.2307/1912791.View ArticleGoogle Scholar
- Autor DH. Outsourcing at will: the contribution of unjust dismissal doctrine to the growth of employment outsourcing. J Labor Econ. 2003. https://doi.org/10.1086/344122.View ArticleGoogle Scholar
- Adinaro DJ, Allegra JR, Cochrane DG, Cable G. Anxiety-related visits to New Jersey emergency departments after September 11, 2001. J Emerg Med. 2008;34(3):311–4. https://doi.org/10.1016/j.jemermed.2007.05.014.View ArticlePubMedGoogle Scholar
- Allegra PC, Cochrane D, Dunn E, Milano P, Rothman J, Allegra J. Emergency department visits for concern regarding anthrax--New Jersey. 2001 MMWR Suppl. 2005;54:163–7.PubMedGoogle Scholar
- Kim H, Schwartz RM, Hirsch J, Silverman R, Liu B, Taioli E. Effect of hurricane Sandy on Long Island emergency departments visits. Disaster Med Public Health Prep. 2016;10(3):344–50.View ArticleGoogle Scholar
- Gotanda H, Fogel J, Husk G, Levine JM, Peterson M, Baumlin K, Habboushe J. Hurricane Sandy: impact on emergency department and hospital utilization by older adults in lower Manhattan, New York (USA). Prehosp Disaster Med. 2015;30(5):496–502.View ArticleGoogle Scholar
- Beare JM, Burrows D, Merrett JD. The effects of mental and physical stress on the incidence of skin disorders. Br J Dermatol. 1978;98(5):553–8 http://www.ncbi.nlm.nih.gov/pubmed/656328.View ArticleGoogle Scholar
- Thompson DA, Yarnold PR, Williams DR, Adams SL. Effects of actual waiting time, perceived waiting time, information delivery, and expressive quality on patient satisfaction in the emergency department. Ann Emerg Med. 1996. https://doi.org/10.1016/S0196-0644(96)70090-2.View ArticleGoogle Scholar
- C a A, Ardal S, Woodward GL, Schull MJ. Variation in emergency department visits for conditions that may be treated in alternative primary care settings. CJEM. 2005;7(4):252–6 http://www.ncbi.nlm.nih.gov/pubmed/17355682.View ArticleGoogle Scholar
- Laugharne J, Janca A, Widiger T. Posttraumatic stress disorder and terrorism: 5 years after 9/11. Curr Opin Psychiatry. 2007;20(1):36–41. https://doi.org/10.1097/YCO.0b013e328010dc2c.View ArticlePubMedGoogle Scholar
- May CL, Wisco BE. Defining trauma: how level of exposure and proximity affect risk for posttraumatic stress disorder. Psychol Trauma Theory Res Pract Policy. 2015;8(2):233–40. https://doi.org/10.1037/tra0000077.View ArticleGoogle Scholar
- Google Trends. http://trends.google.com.
- Reilly S, Richey S, Taylor JB. Using Google search data for state politics research. State Polit Policy Q. 2012;12(2):146–59. https://doi.org/10.1177/1532440012438889.View ArticleGoogle Scholar
- Vosen S, Schmidt T. Forecasting private consumption: survey-based indicators vs. Google trends. J Forecast. 2011;30(6):565–78. https://doi.org/10.1002/for.1213.View ArticleGoogle Scholar
- Baram-Tsabari A, Segev E. Exploring new web-based tools to identify public interest in science. Public Underst Sci. 2011;20(1):130–43. https://doi.org/10.1177/0963662509346496.View ArticleGoogle Scholar
- Ripberger JT. Capturing curiosity: using internet search Trends to measure public attentiveness. Policy Stud J. 2011. https://doi.org/10.1111/j.1541-0072.2011.00406.x.View ArticleGoogle Scholar
- Wargon M, Guidet B, Hoang TD, Hejblum G. A systematic review of models for forecasting the number of emergency department visits. Emerg Med J. 2009;26(6):395–9. https://doi.org/10.1136/emj.2008.062380.View ArticlePubMedGoogle Scholar
- Jones SS, Thomas A, Evans RS, Welch SJ, Haug PJ, Snow GL. Forecasting daily patient emergency department. Acad Emerg Med. 2008;15(2):159–70. https://doi.org/10.1111/j.1553-2712.2007.00032.x.View ArticlePubMedGoogle Scholar