Skip to main content
Download PDF

Trends in reasons for emergency calls during the COVID-19 crisis in the department of Gironde, France using artificial neural network for natural language classification

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine volume 29, Article number: 55 (2021) Cite this article

Abstract

Objectives

During periods such as the COVID-19 crisis, there is a need for responsive public health surveillance indicators in order to monitor both the epidemic growth and potential public health consequences of preventative measures such as lockdown. We assessed whether the automatic classification of the content of calls to emergency medical communication centers could provide relevant and responsive indicators.

Methods

We retrieved all 796,209 free-text call reports from the emergency medical communication center of the Gironde department, France, between 2018 and 2020. We trained a natural language processing neural network model with a mixed unsupervised/supervised method to classify all reasons for calls in 2020. Validation and parameter adjustment were performed using a sample of 39,907 manually-coded free-text reports.

Results

The number of daily calls for flu-like symptoms began to increase from February 21, 2020 and reached an unprecedented level by February 28, 2020 and peaked on March 14, 2020, 3 days before lockdown. It was strongly correlated with daily emergency room admissions, with a delay of 14 days. Calls for chest pain and stress and anxiety, peaked 12 days later. Calls for malaises with loss of consciousness, non-voluntary injuries and alcohol intoxications sharply decreased, starting one month before lockdown. No noticeable trends in relation to lockdown was found for other groups of reasons including gastroenteritis and abdominal pain, stroke, suicide and self-harm, pregnancy and delivery problems.

Discussion

The first wave of the COVID-19 crisis came along with increased levels of stress and anxiety but no increase in alcohol intoxication and violence. As expected, call related to road traffic crashes sharply decreased. The sharp decrease in the number of calls for malaise was more surprising.

Conclusion

The content of calls to emergency medical communication centers is an efficient epidemiological surveillance data source that provides insights into the societal upheavals induced by a health crisis. The use of an automatic classification system using artificial intelligence makes it possible to free itself from the context that could influence a human coder, especially in a crisis situation. The COVID-19 crisis and/or lockdown induced deep modifications in the population health profile.

Introduction

Coronavirus 2019 Disease (COVID-19) caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) was detected for the first time in December 2019 in China [1]. Since then, as of first November 2020, more than 40 million cases and more than 1,100,000 deaths have been reported worldwide [2].

Health-related surveillance data are indispensable for the adjustment of public health policies aimed at curbing the spread of the virus and protecting vulnerable populations, for adapting the means of caring for the most seriously ill, and for assessing the indirect consequences of the pandemic and of the measures implemented to control it: lockdown, movement restriction, social distancing and quarantine for some countries.

Many countries have relied on an extrapolation of classic infection-control and public-health measures to contain the COVID-19 pandemic, similar to those used for Severe Acute Respiratory Syndrome virus in 2003 and H1N1 influenza virus in 2009. These range from extreme quarantine measures in China to painstaking detailed contact tracing with hundreds of contact tracers (e.g., Singapore, Hong Kong, South Korea). However, these measures may not be effective in 2020 for tackling the scale of COVID-19 [3]. Monitoring, surveillance, detection and prevention of COVID-19 have launched a new challenge on a global scale and data sciences technologies have so far failed to address it with a few notable exceptions [4].

The monitoring of the number of people who test positives by Reverse Transcriptase-Polymerase Chain reaction (PCR) or with chest computerized tomography images with characteristic lung damage is the most reliable indicator of the number of people with the virus. It is, however, heavily dependent on the screening strategy, which varies greatly from one country to another. The number of people entering an Emergency Room (ER) with symptoms suggesting SARS-CoV-2 infection was implemented nationally in France on March 16, 2020, with specific coding of the main diagnosis in ER summary reports centralized by Santé Publique France in the OSCOUR® Emergency Department Surveillance Network [5] set up in 2004. The French health authorities are also monitoring the number of COVID-19 patients hospitalized, admitted to intensive care units, and the number of deaths in hospital and in nursing homes (EHPAD).

All these tools, completed by a large set of ad-hoc surveys and specific surveillance systems have been mobilized to monitor the course of the epidemics and its consequences. For example, analysis of the registry of the Paris-Sudden Death Expertise Center observed a transient increase in cardiac arrest incidence during the COVID-19 crisis [6]. A similar observation was reported in Lombardy, Italy, a region heavily impacted by the COVID-19 pandemic [7].

Reports of call content to emergency medical communication centers (EMCC) is a source of information that needs to be considered for health surveillance during such a pandemic. By dialing 15, French citizens can get medical advice and, if necessary, a medical mobile care unit can be sent to the scene. In addition, the health authorities had instructed the population to call 15 in the case of symptoms or concerns, and to avoid spontaneous uninvited visits to the ER [8].

We used an automatic classification tool based on an artificial neural network language model we recently adapted for free-text clinical notes [9] to identify the main reasons for calls to the Gironde EMCC, in order to monitor trends in the nature of these calls before, during and after the national lockdown established in France on March 17, 2020 and eased on May, 11, 2020.

Method

Setting

The Gironde department (1.6 million inhabitants) is served by a medicalized EMCC known as SAMU 33 (Service d’Aide Médicale Urgente de la Gironde) which answers calls to the French toll-free number dedicated to medical emergencies (the “15”). A call is first received by a medical assistant, and then an emergency physician or a general practitioner (depending on the severity of the case) decides on the appropriate response, from medical advice to the dispatch of an ambulance or a mobile intensive care unit [5].

Clinical reports

For all cases handled, a clinical report is created in the form of a computerized free-text note and updated by a medical assistant and a physician through the various telephone interactions with the patient, family, witnesses, and then with the paramedics if applicable. These clinical notes contain all the elements that make it possible to know the circumstances of the event at the origin of the call and the clinical observations made by the protagonists, whether they are witnesses, the patients themselves, or the medical personnel involved on site or responding to the call.

Classification of clinical reports using the GPT-2 neural language model

Over the past 10 years, neural language models have progressively taken the largest share in the field of natural language, with applications like machine translation, document classification, text summarization and speech recognition.

New levels of performance have only recently been achieved with the use of models based on the concept of attention, which consists in learning dependencies between words in a sentence with-out regard to their distances. This mechanism has been implemented in a sequence to sequence neural network model, the Transformer architecture, proposed in 2017 [10]. One of the latest examples is the Generative Pretrained Transformer 2 (GPT-2), published in February 2019 by OpenAI. GPT-2 is a large transformer-based language model trained on a dataset of 8 million web pages [11]. Beyond the capability to generate coherent texts, Transformer models have the potential to perform other tasks such as question answering and document classification with a limited number of training examples. The training of the model is performed in two distinct phases [12]: the first pre-training unsupervised phase (i.e. not needing a human classification), consists in exploitation of a text corpus. In our application, this consisted in the 312,367 clinical reports of the year 2018. This leads to the ability of automatic text generation (see Additional file 1). The relevance of these synthetic sentences suggests that the networks learn contextual semantic representations. The second training phase, this time a supervised one (i.e. using examples classified by humans), creates a system able to perform the specific classification tasks.

The 117-million parameters version of the GPT-2 model was trained on a workstation with one Nvidia GeForce RTX Titan Graphic Processing Unit with 24GB of video random access memory. The computation time for the pre-training phase was 26 h per epoch (an epoch corresponds to the entire training set going through the entire network once). On average, 12 samples were processed per second in the training phase.

Extraction of free-text digital calls reports from the EMCC of the Gironde department, France

We retrieved call reports from the digital medical record system of the EMCC of the Gironde department, France. Five EMCC datasets were extracted corresponding to the years 2016, 2017, 2018, 2019 and 2020. The three 2016, 2017, 2018 datasets consisted of 888,469 calls with a free-text clinical report and were used both for the unsupervised pre-training of the GPT-2 model and for the building of the training sample based, when available, on standardized diagnosis coded during the calls. The 2019 dataset corresponded to the 302,925 free-text clinical call reports of the year 2019. A random sample of this dataset was manually coded by a trained pool of emergency nurses for validation. The trained and validated models were applied to the 2020 dataset which corresponded to the COVID-19 period, with 255,556 handled calls with a free-text report from January 1, 2020 to September 30, 2020. This provided a classification of reasons for calls before (January 1–March 16), during (March 17–May 10) and after (May 11–September 30) COVID-19 lockdown.

Selected groups of reasons for calls

A first model was built by grouping calls according to the main reasons into 12 broad categories (chest pain, gastroenteritis and abdominal pain, flu-like symptoms and breathing difficulties, focal neurologic deficit and stroke, road traffic crash, violence, suicide and self-harm, injury other than violence, self-harm and road crash, pregnancy and delivery problems, malaise with loss of consciousness, stress and anxiety). Many symptoms or situations did not fall into these broad categories and were grouped into a thirteenth “other” category.

Another distinct model was built to count calls for which an acute alcohol intoxication was involved.

Classification procedure

Classification models were built and validated using a five-phase procedure:

  1. (i)

    A total of 888,469 records with call reports of 2016, 2017 and 2018 were used to pre-train the GPT-2 model in an unsupervised manner with 1 epoch.

  2. (ii)

    A dataset of training examples for supervised training was built extracting the 690,103 (out of 888,469) call reports from the same 2016, 2017, 2018 years with a diagnosis code manually coded in real time by the people handling calls (medical regulation assistants, emergency physicians and general practitioners); The pre-trained model was then fine-tuned using these training labelled examples to build the model used to classified main reasons for call in 12 categories and a distinct model to identify calls for which an acute alcohol intoxication was involved.

  3. (iii)

    These two models were validated using the manual coding of a 39,907 random sample from the 2019 dataset.

  4. (iv)

    All 254,633 call reports of 2020 (January to September) were classified using the two models built in the previous steps;

Emergency room admissions with suspected COVID-19, SARS-CoV2–2 PCR tests result and general practitioner house call network (SOS Médecins)

We retrieved daily aggregated data of ER admission with suspected COVID-19, the daily number of SARS-Cov-2 PCR positive tests in the department of Gironde, and the daily number of calls to the general practitioner house call network (SOS Médecins) [13] from the national public health agency “Santé Publique France”. All data are available on the Geodes website (https://geodes.santepubliquefrance.fr/).

Analysis

For all call reasons, a probability cutpoint was determined in order to optimize the accuracy of the number of calls estimated by the model. This was done by selecting the cutpoint for which precision and recall are equal in the validation sample (i.e. when the number of false positive predictions equals the number of false negative predictions). The confidence of the method was assessed using a bootstrap procedure with 10,000 1:1 random partitions of the validation sample. For each partition (and each reasons), the cutpoint is selected using the first half of this partition sample and is the one for which precision equals recall. The difference between the manually determined prevalence of the given reasons and the predicted prevalence (using the selected cutpoint) is then computed in the second half of the sample. Median bias and 95% confidence interval were derived from the distribution of these 10,000 bias measures. Estimated daily counts of calls to EMCC were plotted against time with a 7-days moving average window to smooth the one-week periodicity in calls, which were systematically 25% more frequent on Saturday and Sunday.

Results

Model training, parametrization and validation

The unsupervised training phase led to a model capable of generating artificial texts with the same structure as the learning texts, containing essentially the same clinical notions, but whose coherence is often inconsistent (see examples in the Additional file 1). The content of these synthetic reports however suggests that the model has learned contextual semantic representations.

The training sample included from 1829 (road traffic crash) to 412,218 (other reasons) samples per group (see Table 1). Performance statistics computed using the 39,907 manually-coded samples are shown in Table 1. Area under the ROC curve ranged from 0.785 to 0.990.

Table 1 Training sample size (from 2016 to 8 datasets) and validation from manually coded samples from 2019 dataset
Full size table

The optimal cutpoints to minimize bias in prevalence estimates were chosen using the same manually-coded sample of 39,907 call reports. Bootstrap 95% confidence interval assessment showed that the method provided narrow confidence intervals (Table 1).

Reasons for calls during the Covid-19 crisis

In 2020, the median daily number of calls to the EMCC with a report was 892 with a total number of 254,633 and a peak of 1926 on March 14. The distribution of the estimated number of calls per group of reasons and according to the lockdown period is shown in Table 2.

Table 2 Reasons for calls to EMS in 2020 as determined by the GPT-2 model. Calls per day and per motive
Full size table

Three groups exhibited a peak at the onset of the lockdown period. Figure 1 shows that calls for flu-like symptoms and breathing difficulties began to rise on February 21, 20 days before the rise in ER admission for COVID-19, and peaked on March 14 with 928 calls out of a total of 1926 calls that day. By the 16th day after February 21, the number of calls in this group had reached 403 calls per day, which is higher than all levels over the past 5 years. Starting from March, 1, 2020, the correlation between daily calls for flu-like symptoms and daily ER admissions with a delay of 14 days was 0.80 (p < 10− 15; Pearson’s test). Two other reasons, chest pain and stress and anxiety, were found to peak 12 days after March 14, with a curve of the same shape as the number of ER visits for COVID-19.

Fig. 1
figure 1

Number of calls to the Gironde to emergency medical communication center in 2020 by reasons from GPT-2 classification with a significant increase around the onset of the lockdown period

Full size image

Figure 2 shows that calls for alcohol intoxication, road traffic crash and malaise with loss of consciousness experienced a sharp decline around the onset of lockdown and that these trends started several days before the first day of lockdown. In a lesser extent, the latter curves were parallel with those for violence and injuries other than violence and road crash. Finally, no noticeable trends in relation to lockdown was found for other groups of reasons including gastroenteritis and abdominal pain, stroke, suicide and self-harm, pregnancy and delivery problems.

Fig. 2
figure 2

Number of calls to the Gironde to emergency medical communication center in 2020 by reasons for calls from GPT-2 classification with a significant decline around the onset of the lockdown period

Full size image

Discussion

The number of calls to EMCC showed a significant spike centered on the March 14, the day before the closure of all non-essential public places in France, three days before lockdown. The main reasons were related to flu-like symptoms (cough and/or fever), followed 14 days later by a peak in ER admissions, in calls for chest pain and calls for stress and anxiety. Calls for road traffic crashes, malaises with loss of consciousness, non-voluntary injuries and alcohol intoxication fell by 59, 38, 24 and 23% respectively during lockdown.

Probably the most interesting finding of our study is the delay we observed between the rise in calls for flu-like symptoms (mainly cough and fever) and the rise in ER visits for suspected COVID-19. Thus, the curve began to rise 20 days before the increase in ER visits. By the 16th day after the start of this rise, the levels reached a level higher than any levels in the past 5 years. One could hypothesize that the peak of calls recorded around March 14 was due by the concern, if not anxiety, caused by the announcement on television of the closure of public places by the French President on that day. However, in a more affected part of the country, the Ile-de-France region, the peak was reached much earlier (10 days earlier) [13], suggesting that most of the calls we recorded were more motivated by symptoms than by concerns raised by communication by the authorities. Further, a spike in calls for stress and anxiety was measure 14 days later. EMCC call content is therefore probably the most predictive early indicator of the start of the epidemic, as recently shown by Riou and colleagues who found in the Ile-de-France region a strong correlation between calls regarding suspected COVID-19 and the number of patients in intensive care, with a delay of 23 days [14]. This is why this is considered for the monitoring of a potential relapses in the epidemic [15]. Finally, while the number of calls for flu-like symptoms proved to be an early and relevant signal, its intensity was probably increased by the request of the authorities not to go directly to the ER and to contact instead the EMCC.

An important difference between the work of Riou and colleagues and this study is that our process was clearly agnostic to the COVID-19 epidemic or to lockdown, as the automatic classification used models trained using reports from previous years. This results in a procedure that remains independent of the COVID-19 epidemic and lockdown, which would have influenced human codification. The signal thus obtained depends less on the context and is more likely to be an indicator of the actual public health situation. More generally, the added value of using an automatic classification procedure based on a natural language processing model is that it frees us from the context in which the reported events are coded. For this reason, we did not use the coded diagnoses at the time of the call to observe trends. In addition, these diagnoses were absent from one-third of the reports.

In the context of the COVID-19 epidemic, several research teams have used a similar approach, attempting to investigate the internet or social media to build early indicators of the epidemic [16, 17]. However, no such signal could be found from a Google keyword search [18], as the peak for cough, fever, coronavirus or COVID-19 was not reached until the week of 15–21 March.

Contrary to what was observed in Paris [19], no increase in calls related to cardiac arrest was observed in our study. This observation supports the hypothesis that the transient twofold increase in out-of-hospital cardiac arrests observed in Paris and its suburbs could be due to COVID-19 infections and to pandemic-related health system issues in heavily impacted regions. This was clearly not the case in the Gironde department where EMCC and intensive care units have never been overwhelmed.

A very significant decrease in calls for malaise with loss of consciousness, and to a lesser extent for strokes, was observed, starting one week before lockdown. This paralleled the sudden drop in ER visits that was observed in many countries that issued a statewide stay-at-home order [20], raising concerns that patients who needed medical care were not presenting to the hospitals and, for example, that stroke patients arrived too late to receive tissue plasminogen activator. The actual overall public health impact of this phenomenon will have to be carefully assessed when we have enough hindsight to appreciate its medium-term health consequences.

The decrease in calls associated with interpersonal violence and alcohol intoxication is less surprising as it is probably due to the reduction in social interactions. Interestingly, the figures returned to normal levels by the end of the lockdown period. Early on, concerns were raised about the risk of domestic violence as a result of lockdown [21]. This was not confirmed here by calls to EMCC. Although, unfortunately, not all domestic violence is reported to EMCC, this is an interesting result because most statistics used during lockdown to estimate the incidence of intimate partner violence were derived from Police reports and not all violent events reported to EMCC are reported to the police.

In order to produce results in a time frame compatible with the health emergency related to the recent lifting of lockdown measures, we used the samples from 2016 to 2018 for which a diagnosis was coded during the call by the medical assistant in charge of handling it. The ideal procedure would have been to perform a manual coding of this training sample, which was done for a sample of 39,907 reports from 2019, but retained in this work as a validation sample. Our previous work has shown that it takes about a thousand different examples to maximize the performance of the model [9]. This would have meant manually coding more than 100,000 notes, a task that was out of reach in a short period of time. The performances of the GPT-2 model measured with the manually coded validation samples were, however, very high and allowed us to derive a reason for call for all reports including the 22% of them with a missing value for the diagnosis.

Some limitations need to be acknowledged. First, although we have shown that an AI-based natural language model shows high performance in classifying free-text clinical reports, a small proportion of reports remains misclassified. Because our exercise here was to provide prevalence estimates, we adjusted the decision cutpoints so that precision equals recall. The bootstrap analysis showed that this was a very reliable strategy. Second, not all calls are handled by the EMCC, a proportion of them remains unanswered and this proportion increases during peak periods. It is therefore likely that around March 14 the number of attempted calls was higher than those handled. Finally, the study was done in Gironde, a department with a reportedly low rate of SARS-Cov-2 infection if compared to the Ile de France and the north-east regions of France. However, lockdown and fear of the epidemic affected all French people and the Gironde EMCC are the third largest in terms of the number of calls received in France, which has made it possible to build up a sufficiently large database.

Conclusion

Major changes in the pattern of calls to EMCC were observed during the COVID-19 crisis in Gironde, starting for most of them a few days before the implementation of the lockdown and then gradually returning to pre-crisis levels around the date the containment was lifted. The observation of calls for flu-like symptoms anticipates an increase in ER admissions by about 14 days. The results of this study illustrate the extent to which automated classification of the reasons for calling EMCC is a powerful epidemiological surveillance tool, provides insights into the societal upheavals induced by a health crisis and would be instrumental to better anticipate the needs of the health care system.

Availability of data and materials

A subset of the dataset analysed during the current study can be made available from the corresponding author on reasonable request.

Abbreviations

COVID-19:

Coronavirus disease 2019

EHPAD:

Etablissement d’hébergement pour personnes âgées dépendantes

EMCC:

Emergency medical communication centers

ER:

Emergency room

GPT-2 :

Generative pretrained transformer 2

INSERM:

Institut national de la santé et de la recherche médicale

ISPED:

Institut de santé publique et de développement

PCR:

Reverse transcriptase-polymerase chain reaction

ROC:

Receiver operating characteristic curve

SAMU:

Service d’aide médicale urgente

SARS-CoV-2:

Severe acute respiratory syndrome coronavirus 2

References

  1. Zhu N, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. 2020;382:727–33. https://doi.org/10.1056/NEJMoa2001017.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. WHO. Coronavirus (COVID-19) events as they happen. https://www.who.int/emergencies/diseases/novel-coronavirus-2019. (Accessed Nov 1, 2020) (2020).

  3. Ting DSW, et al. Digital technology and COVID-19. Nat Med. 2020;26:459–61. https://doi.org/10.1038/s41591-020-0824-5.

    Article  CAS  PubMed  Google Scholar 

  4. Park S, Choi GJ, Ko H. Information Technology–Based Tracing Strategy in Response to COVID-19 in South Korea—Privacy Controversies. JAMA. 2020;323(21):2129–30. https://doi.org/10.1001/jama.2020.6602.

    Article  CAS  PubMed  Google Scholar 

  5. Josseran L, et al. Assessment of a syndromic surveillance system based on morbidity data: results from the Oscour network during a heat wave. PLoS One. 2010;5(8):e11984. https://doi.org/10.1371/journal.pone.0011984 Published 2010 Aug 9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Marijon E, et al. Out-of-hospital cardiac arrest during the COVID-19 pandemic in Paris, France: a population-based, observational study [published online ahead of print, 2020 may 27]. Lancet Public Health. 2020;S2468-2667(20):30117–1. https://doi.org/10.1016/S2468-2667(20)30117-1.

    Article  Google Scholar 

  7. Baldi E, et al. Out-of-hospital cardiac arrest during the Covid-19 outbreak in Italy. N Engl J Med; published online April 29. 2020. https://doi.org/10.1056/NEJMc2010418.

  8. Adnet F, Lapostolle F. International EMS systems: France. Resuscitation. 2004;63(1):7–9. https://doi.org/10.1016/j.resuscitation.2004.04.001.

    Article  PubMed  Google Scholar 

  9. Xu B, et al. Pre-Training a Neural Language Model Improves the Sample Efficiency of an Emergency Room Classification Model. In: FLAIRS-32 - Thirty-Third International Flairs Conference, May 2020, North Miami Beach, United States; 2020.

    Google Scholar 

  10. Vaswani A, et al. Attention is all you need. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R, editors. Advances in neural information processing systems 30, pages 5998–6008. NY, United States: Curran Associates, Inc.; 2017.

    Google Scholar 

  11. Radford A, et al. Language models are unsupervised multitask learners. OpenAI Blog. 2019;1(8). https://d4mucfpksywv.cloudfront.net/better-language-models/language-models.pdf. Accessed 26 Mar 2021.

  12. Radford A, Narasimhan K, Salimans T, Sutskever I. Improving language understanding by generative pre-training. Open AI. 2018. https://s3-us-west-2.amazonaws.com/openai-assets/researchcovers/languageunsupervised/language understanding paper.pdf. Accessed 26 Mar 2021.

  13. Meurice L, Chapon T, Chemin F, Gourinchas L, Sauvagnac S, Uijttewaal S, et al. General practitioner house call network (SOS Médecins): an essential tool for Syndromic surveillance - Bordeaux, France. Prehosp Disaster Med. 2020;35(3):326–30.

    Article  Google Scholar 

  14. The COVID-19 APHP-Universities-INRIA-INSERM Group, Riou B. Emergency calls are early indicators of ICU bed requirement during the COVID-19 epidemic. medRxiv 2020.06.02.20117499. 2020. https://doi.org/10.1101/2020.06.02.20117499.

  15. Salje H, Tran Kiem C, Lefrancq N, Courtejoie N, Bosetti P, Paireau J, Andronico A, Hozé N, Richet J, Dubost CL, Le Strat Y, Lessler J, Levy-Bruhl D, Fontanet A, Opatowski L, Boelle PY, Cauchemez S. Estimating the burden of SARS-CoV-2 in France. Science. 2020;369(6500):208-11. https://doi.org/10.1126/science.abc3517.

  16. Li C, Chen LJ, Chen X, Zhang M, Pang CP, Chen H. Retrospective analysis of the possibility of predicting the COVID-19 outbreak from Internet searches and social media data, China, 2020. Euro Surveill. 2020;25(10):2000199. https://doi.org/10.2807/1560-7917.

  17. Ayyoubzadeh SM, Ayyoubzadeh SM, Zahedi H, Ahmadi M, Niakan Kalhori RS. Predicting COVID-19 incidence through analysis of Google trends data in Iran: Data mining and deep learning pilot study. JMIR Public Health Surveill. 2020;6:e18828. https://doi.org/10.2196/18828.

    Article  PubMed  PubMed Central  Google Scholar 

  18. [Google Trends 2020]. https://trends.google.fr/trends/?geo=FR. (Accessed june 3, 2020) (2020).

  19. Lapostolle F, Agostinucci JM, Alhéritière A, Petrovic T, Adnet F. Collateral consequences of COVID-19 epidemic in greater Paris. Resuscitation. 2020;151:6–7. https://doi.org/10.1016/j.resuscitation.2020.04.010.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Wong LE, Hawkins JE, Langness S, Murrell KL, Iris P, Sammann A. Where Are All the Patients? Addressing Covid-19 Fear to Encourage Sick Patients to Seek Emergency Care. NEJM Catal Innov Care Deliv. 2020;10.1056/CAT.20.0193. https://doi.org/10.1056/CAT.20.0193.

  21. Mazza M, Marano G, Lai C, Janiri L, Sani G. Danger in danger: Interpersonal violence during COVID-19 quarantine [published online ahead of print, 2020 Apr 30]. Psychiatry Res. 2020;289:113046. https://doi.org/10.1016/j.psychres.113046.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank the university hospital of Bordeaux for providing the logistical support that allowed us to access and analyse the data needed for the manuscript in such a short period. We are also grateful to Julien Anjoubault, Clarisse Marguinaud, Virginie Cocuelle, Delphine Vauthier, Alexandra Barbe, François Garreau, Quentin Bana, Claire Riou, Pauline Soubelet and Elisabeth Verbitskaya for their expertise, which allowed proper manual coding for validation and to Benjamin Contrand, Loïck Bourdois and Marie-Odile Coste for data management and administrative assistance. We also thank Sylviane Lafont for her help in the beginning of the project. BPH IETO Team activities are supported by the Institut National de la Santé et de la Recherche Médicale (INSERM), University of Bordeaux, Ministère de l’Intérieur (Délégation à la Sécurité Routière).

Confidentiality, ethics and data protection

No personal data were necessary for this work. All reports were automatically de-identified using a grep-based text-search procedure that was applicable because of the standardized format of personal information inserted in the reports. This work conforms in terms of the protection of personal health data and the protection of privacy to the application framework provided by Article 65–2 of the amended French Data Protection Act and the General Regulation on the protection of personal data. It was approved by the Bordeaux Teaching Hospital committee for ethics and data protection.

Funding

The study was founded by the French Agence Nationale de la Recherche (ANR-20-COV1–0004-01).

Author information

Authors and Affiliations

  1. Inserm, ISPED, University of Bordeaux, Bordeaux Population Health Research Center Inserm U1219 Injury Epidemiology Transport Occupation team, Bordeaux, France

    Cédric Gil-Jardiné, Gabrielle Chenais, Catherine Pradeau, Philippe Revel, Xavier Combes, Michel Galinski, Eric Tellier & Emmanuel Lagarde

  2. University Hospital of Bordeaux, Pole of Emergency Medicine, Bordeaux, France

    Cédric Gil-Jardiné, Catherine Pradeau, Eric Tentillier, Philippe Revel, Xavier Combes, Michel Galinski & Eric Tellier

Authors
  1. Cédric Gil-Jardiné
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gabrielle Chenais
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Catherine Pradeau
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Eric Tentillier
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Philippe Revel
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xavier Combes
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Michel Galinski
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Eric Tellier
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Emmanuel Lagarde
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CGJ and PC collected the data. GC and EL were involved in NLP models design. CGJ and EL analyzed the data and all authors were involved in results interpretation. EL and CGJ were a major contributor in writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Emmanuel Lagarde.

Ethics declarations

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:.

Example of real and synthetic EMS clinical reports.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gil-Jardiné, C., Chenais, G., Pradeau, C. et al. Trends in reasons for emergency calls during the COVID-19 crisis in the department of Gironde, France using artificial neural network for natural language classification. Scand J Trauma Resusc Emerg Med 29, 55 (2021). https://doi.org/10.1186/s13049-021-00862-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13049-021-00862-w

Keywords

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine

ISSN: 1757-7241