- Original research
- Open Access
The final assessment and its association with field assessment in patients who were transported by the emergency medical service
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicinevolume 26, Article number: 111 (2018)
In patients who call for the emergency medical service (EMS), there is a knowledge gap with regard to the final assessment after arriving at hospital and its association with field assessment.
In a representative population of patients who call for the EMS, to describe a) the final assessment at hospital discharge and b) the association between the assessment in the field and the assessment at hospital discharge.
Thirty randomly selected patients reached by a dispatched ambulance each month between 1 Jan and 31 Dec 2016 in one urban, one rural and one mixed ambulance organisation in Sweden took part in the study. The exclusion criteria were age < 18 years, dead on arrival, transport between health-care facilities and secondary missions. Each patient received a unique code based on the ICD code at hospital discharge and field assessment.
In all, 1080 patients took part in the study, of which 1076 (99.6%) had a field assessment code. A total of 894 patients (83%) were brought to a hospital and an ICD code (ICD-10-SE) was available in 814 patients (91% of these cases and 76% of all cases included in the study). According to these ICD codes, the most frequent conditions were infection (15%), trauma (15%) and vascular disease (9%). The most frequent body localisation of the condition was the thorax (24%), head (16%) and abdomen (13%). In 118 patients (14% of all ICD codes), the condition according to the ICD code was judged as time critical. Among these cases, field assessment was assessed as potentially appropriate in 75% and potentially inappropriate in 12%.
Among patients reached by ambulance in Sweden, 83% were transported to hospital and, among them, 14% had a time-critical condition. In these cases, the majority were assessed in the field as potentially appropriate, but 12% had a potentially inappropriate field assessment. The consequences of these findings need to be further explored.
A large proportion of patients with acute symptoms and a variety of diseases are seen by health-care providers in the emergency medical service (EMS) system . These patients have a wide spectrum of diseases and the degree of urgency in terms of further evaluation and treatment varies considerably.
Previous studies [2,3,4] of prehospital patient safety have speculated that the main threat to prehospital patient safety is bias in clinical reasoning and decision-making. One consequence of this bias could be diagnostic errors which can lead to EMS clinicians failing to treat the patient as specified in prehospital guidelines . Another risk is diagnostic momentum, which is described as a diagnostic error following the patient through the chain of care .
There is a lack of knowledge about the final outcome for the majority of EMS missions, as well as a shortage of knowledge of EMS clinicians’ diagnostic abilities. There is one study  which has described emergency physicians’ diagnostic ability in prehospital care. There are also some studies which have evaluated EMS clinicians’ diagnostic accuracy in connection with specific diagnoses, such as stroke  and sepsis [9, 10]. The epidemiology of EMS clinicians’ work is mostly described according to findings at the scene or, at best, according to findings and assessments on arrival at the emergency department (ED) [8, 9].
Few studies have described the epidemiology of EMS missions according to the final hospital assessment . However, a final assessment can only be made in patients who have been transported by the EMS to a health-care unit, mostly the ED at a hospital.
Furthermore, not much is known about the appropriateness of the field assessment as made by an EMS clinician at the scene and how an assessment of this kind relates to the final assessment a few days later in patients who are brought to a hospital. Even less is known about the appropriateness of the field assessment in patients for whom a decision was made to let them stay on the scene with advice for self-care.
In order to understand more about the appropriateness of the field assessments that were made by EMS clinicians, there is an urgent need to study the association between field assessment and the final hospital assessment.
There are some problems when attempting to compare prehospital assessments with the final assessment at a hospital. One reason is the number of differential diagnoses related to a single initial symptom. For example, the symptom of “chest discomfort” relates to a number of differential diagnoses. Another problem is that EMS clinicians sometimes describe the patient in terms of symptoms and sometimes in terms of diagnoses. It is therefore often problematic to evaluate the clinical consequences of a prehospital assessment.
Against this background, the present study has the following aims:
To describe the epidemiology of the EMS clinicians’ work in relation to the final assessment after arrival at hospital
To describe the association between the field assessment and the final hospital assessment with the aim of critically evaluating the appropriateness of the field assessment. The final goal of an approach like this was to highlight the eventual need for an improvement in the early decision-making by EMS clinicians.
To relate the final assessment to the estimated risk at the scene with particular emphasis on the patients who had a final assessment equivalent to a time-critical condition.
The study had a retrospective observational design where 30 prehospital medical records were chosen at random for screening each month in three prehospital organisations in Sweden during 1 year.
The study material consisted of prehospital and hospital medical records. The 30 records were randomly selected by a random number generator. The 30 records were first screened for inclusion and exclusion criteria. In cases of excluded records, the procedure was repeated until 30 records which fulfilled the inclusion criteria and had no exclusion criteria were sampled. A total of 1080 ambulance missions were included in the study. Originally, there were 1664 patients who fulfilled the inclusion criteria and 584 of them were excluded.
Inclusion criterion: An ambulance mission which included patient assessment and care.
Exclusion criteria: 1) Patient aged < 18 years, 2) Ambulance missions without patient contact, 3) Ambulance missions which were secondary support to another ambulance team, 4) Ambulance transportation between health-care facilities, 5) Patient deceased upon EMS arrival.
The study excluded children, as there are specific conditions for field assessments among children with other criteria for field assessment .
The study was conducted in three prehospital organisations in Sweden during 1 year, starting on 1 January 2016 and ending on 31 December 2016. The organisations were chosen so that they represented three different geographical areas in Sweden. One organisation represented an urban area with generally short transport times. The second organisation represented a mixed area with a combination of urban and rural areas including both long and short transport times. The third organisation represented mostly rural areas with the majority of cases having long transport times. We estimate that this study population gives a reasonable representation of prehospital care in Sweden.
The ambulance clinicians in the three participating organisations included registered nurses (RN), with and without a specialist education in prehospital care, and emergency medical technicians (EMT), with a shorter medical education. One ambulance team could thus consist of either two RNs or one RN and one EMT. It was always the RN that had the medical responsibility in the team. Since 2005, all ambulances in Sweden have been obliged to be run by at least one RN .
In each participating organisation, there was one primary reviewer. These reviewers were all active ambulance nurses working in the organisation. Secondary reviewers consisted of two researchers/ambulance nurses and two researchers/medical doctors, one cardiologist and one anaesthesiologist. The primary reviewer made the first decision on the association between the field assessment and the final hospital assessment. In cases where there was any doubt about the association, a medical doctor in the review team reviewed the case and made the final decision.
The instruments that were used were designed to compare the field assessment with the final hospital Sassessment (Fig. 1). The patients were categorised in one of six major categories according to the final diagnosis and depending on: a) the seriousness of the diagnosis (time-critical condition or not); b) the precision of the assessment (reflecting a disease such as myocardial infarction or a symptom such as chest pain or a more diffuse condition (such as disorientation or feeling of malaise or fatigue) and c) the availability of the final assessment (sometimes not available).
As a result, the six major categories according to the final assessment were:
a final diagnosis equivalent to a time-critical condition (i.e. myocardial infarction or pulmonary embolism)
a final diagnosis equivalent to a non-time-critical condition (i.e. herpes zoster or cystitis)
the final diagnosis is equivalent to a symptom (chest pain or dyspnoea)
the final diagnosis is expressed in non-specified terms (desorientation or feeling of malaise and fatigue).
the patient is brought to hospital, but information on the final assessment is not available
the patient is not brought to hospital and information on the final assessment is therefore not available
This means that the first category includes time-critical conditions in contrast to the following categories.
The next step is to evaluate the association between the field assessment and the final assessment. For categories A and B, there are six possibilities:
the field diagnosis is in agreement with the final diagnosis
the field diagnosis is not in agreement with the final diagnosis
the field assessment is a typical symptom when related to the final diagnosis (i.e. chest discomfort when the final diagnosis is a myocardial infarction)
the field assessment is an atypical symptom in relation to the final diagnosis (i.e. dyspnoea, when the final diagnosis is a myocardial infarction)
the field assessment is a more unusual symptom in relation to the final diagnosis (i.e. abdominal pain when the final diagnosis is myocardial infarction)
the field assessment describes the patient’s problems in a less detailed way (i.e. “problems with circulation” or “problems with the airways”).
For categories C and D, there are only five subcategories, as the final assessment is not specified as a diagnosis (Fig. 1).
These subcategories are:
the field assessment is a diagnosis in agreement with the final assessment
the field assessment is a diagnosis not in agreement with the final assessment
the field assessment is a symptom in agreement with the final assessment
the field assessment is a symptom not in agreement with the final assessment
the field assessment describes the patient’s problem in a less detailed way, as described in categories A and B subcategory 6.
For category E, there are three subcategories:
the patient leaves the ED before being seen by any health-care provider .
the patient is only assessed by a nurse at the ED who does not make any final assessment.
information on the final assessment is missing for unknown reasons.
For category F, there are three subcategories:
the patient is referred to primary care
the patient stays in home or in a nursing home with extended home care
the patient stays at home with advice on self-care.
The final hospital assessment was related not only to the field assessment in terms of diagnosis or symptoms at the scene but also to the risk assessment at the scene. The risk at the scene was assessed using an instrument called the Rapid Emergency Triage and Treatment System (RETTS) . The RETTS assessment determines the time that is required until the patient is seen by a physician according to the five colours of red, orange, yellow, green and blue. The determination is based on the five vital parameters of consciousness, heart rate, blood pressure, respiratory rate and body temperature, in combination with the Emergency Signs and Symptoms (ESS) code which defines the main type of complaint (i.e. chest pain or dyspnoea etc.). Red is defined as life threatening and orange as potentially life threatening and these patients should be monitored and a physician assessment made as soon as possible. Yellow and green are defined as non-life threatening and can wait regarding individual medical risk and both categories should be assessed by a physician within a reasonable time. Blue is the lowest triage level and referral to other levels of care may be more appropriate.
The following diagnoses were classified as time-critical conditions: anaphylaxis, myocardial infarction, unstable angina pectoris, TIA/stroke, unconsciousness, septicaemia, aortic rupture, aortic dissection, any form of shock, pulmonary embolism, heart failure including pulmonary oedema, failing heart conducting system, cardiac arrest, intoxication, status epilepticus, obstructive airway, tension/open pneumothorax, cardiac tamponade/contusion, pulmonary contusion, massive haemothorax, flail chest, oesophageal/trachea bronchial/diaphragm rupture.
This study is part of larger prehospital patient safety project and is further described in a published study protocol . The instrument used for comparing field assessments with the final hospital diagnosis is also described in another publication .
For all statistical analyses and data processing, the SAS package, version 9.1, was used.
The results are presented as percentages. When women were compared with men and younger patients were compared with the elderly, Fisher’s exact test was used for dichotomous variables. A p- value of < 0.05 was regarded as significant.
The study was approved by the Regional Ethics Committee, Gothenburg, Sweden (Dnr 047–15).
In all, there were 1080 patients who fulfilled the inclusion criterion and did not have any exclusion criteria. Among these patients, 1076 (99.6%) were given a field assessment code.
The remainder of this article will deal with these 1076 patients.
Among the 1076 patients, 894 (83.1%) were transported to hospital. In 19 cases (1.8%), the patients were transported to primary care. In 16 cases (1.5%), the patients were left at home or its equivalent with extensive home care and, in 147 cases (13.7%), the patients were left at home with advice on self-care.
In principle, a final diagnosis was available for all the patients who were brought to hospital, with the exception of 11 patients who left the ED without being assessed by a physician, 16 patients who were only assessed by a specialist nurse at the ED before discharge and a further 53 cases for whom a final diagnosis was not available for unclear reasons. In overall terms, a final assessment was thus reported in 814 patients (76% of all available cases).
The most frequent main groups of conditions according to the final diagnosis were infection, which occurred in 125 cases (15.4%), trauma in 121 cases (14.9%) and vascular diseases in 77 cases (9.5%) (Table 1, Fig. 2).
The most frequent body localisation of the condition was the thorax in 192 cases (23.5%), head in 135 cases (16.5%), abdomen in 106 cases (13.0%) and lower extremities in 60 cases (7.4%).
In Table 2 is shown the distribution of patients according to the classification into the 22 major groups of ICD codes. In the Additional file 1: Table S1 is the same table expanded given the number of patients with each separate ICD code within each major ICD classification.
Field assessment in relation to final outcome
The distribution of patients according to the six main categories is shown in Table 3. In 114 patients (14.0% of all cases in which a final diagnosis was available), the condition was categorised as a time-critical condition according to final outcome (ICD code). In 87 patients (75.0% of the 114 cases), the field assessment was judged as potentially appropriate (A1 or A3). In 14 cases (12.0%), the field assessment was judged as potentially inappropriate (A2 or A6). The final diagnoses among the 14 patients who were judged as potentially inappropriate are shown in Table 4.
In 439 patients (53.9%), the condition was categorised as a specified non-time-critical condition according to final outcome (ICD code). In 269 of these cases (61.2%), the field assessment was judged as potentially appropriate (B1 or B3). In 129 patients (29.8%), the field assessment was judged as potentially inappropriate (B2 or B6).
In 185 patients (22.7%), the final outcome according to the ICD code was described as a symptom (Category C) and, in 70 patients (8.6%), the final outcome was described in more general terms according to the ICD code (Category D).
Among patients who were classified as Category A (n = 114), the patients were distributed according to RETTS colour, as shown in Table 5. As a result, 39 (34%) were given a red colour (the highest priority) and 86 patients (75%) were given one of the two highest priorities. There was no significant difference when the distribution was related to age or gender (Table 5).
Patients who are not transported to hospital
Among these patients (n = 182), 26 (14.6%; missing information in four patients) sought medical care ≤72 h after the first assessment and nine (5.1%; missing information in four patients) died ≤30 days after the first assessment.
In this study comprising 1080 patients, who were representative of patients seen by an EMS clinician, the main findings were as follows.
The most frequent group of conditions according to the final ICD code was infection, followed by trauma, followed by a vascular disease. In 14% of the cases in which an ICD code was available, the condition was classified as time critical. Among these cases, the field assessment was judged to be potentially inappropriate in 12% of the cases.
The observation that patients with an infection constituted the most frequent group of patients is new, but it must also be related to the fact that many of these infections were relatively harmless, did not require hospitalisation and only a minority (2%) had a severe condition like sepsis.
To the best of our knowledge, the observation that trauma represents the second largest group of patients seen by the EMS among those with available ICD codes has not previously been reported. Here, it is important to highlight that all types of trauma were included, many of which were minor and not always requiring hospitalisation.
The group of patients who had a confirmed vascular disease as the underlying aetiology could be regarded as fewer than expected (only 9%). This should be related to the fact that chest pain and dyspnoea are the most frequent symptoms in an ambulance-transported patient cohort . However, only a minority of these patients have a final diagnosis indicating vascular disease aetiology such as myocardial infarction. This is in agreement with previous findings .
We found that only 14% of patients with an available ICD code had a time-critical condition according to the given criteria. In a recently published study of patients who used the EMS on multiple occasions, the corresponding figure was 13% . We found that, among these patients, the field assessment could be retrospectively judged to be potentially inappropriate in 12%. The corresponding figure in the study previously referred to was 22% . These cases can be regarded as representing the greatest risks of an adverse event. Among patients with a time-critical condition and a potentially inappropriate field assessment, the final diagnoses most frequently represented patients with cerebrovascular disease, followed in order of frequency by sepsis, myocardial infarction, aortic dissection and status epilepticus.
Among the patients with a time-critical condition, only 34% were given the highest priority by the EMS nurse. This finding highlights the need for better instruments to improve the initial prioritisation in the future. Our results also highlight the fact that the field assessment and initial priority may not always provide the same information.
Nurses have always been involved in the diagnostic process  and, for EMS clinicians, establishing a field diagnosis is an important task . A correct field diagnosis is important for several reasons. On many occasions, the treatment in the prehospital setting is based on diagnoses and, with an incorrect assessment there is a risk that the patient will not receive the treatment which has been specified in the prehospital guidelines. In many cases, some specific conditions are indications for direct transport to facilities for specialist assessment and treatment, thereby bypassing the ED. Examples of this are patients with an ST-elevation myocardial infarction , stroke  and sepsis . Another problem with prehospital diagnostic errors is that important information in the hand-over and in medical journals may be missing.
Diagnostic error is a major patient safety threat in health care, but it is difficult to estimate diagnostic error rates [23, 24]. Emergency medicine is an area in which diagnostic errors are a common reason for adverse events . Kachalia et al.  listed several reasons for diagnostic errors at the ED. The most common factor was cognitive factors, such as knowledge and judgement, followed by system factors, such as workload and interruptions, communication factors, such as hand-overs and conflicts, and patient-related factors, such as patient non-adherence and a complicated medical history. Croskerry  highlights cognitive bias as the most important factor in relation to diagnostic errors and a systematic review confirms this view . The reasons for cognitive bias can be explained by the dual process theory  in which human reasoning is divided into two systems. System 1 is described as a subconscious, automatic, rapid system. System 1 is dependent on experience and the most common bias is premature closure (omission bias) where the decision-maker makes decisions too early in the process. System 2 is described as an analytical, slow process and is the most commonly used system in new and complex situations. The most common errors in System 2 processes are mistakes of commission where the clinicians gather too much information and thereby risk cognitive overload [29, 30]. Cognitive processes are sparsely investigated in prehospital care. The few studies reveal a similarity in the cognitive methods used in the prehospital setting compared with methods used in in-hospital emergency care [31,32,33]. It has been suggested that the main difference between in-hospital and prehospital emergency care is the settings in which clinical reasoning is executed . Another feature suggested to differentiate prehospital clinical reasoning from the in-hospital setting is the frequent use of cognitive tools such as guidelines and protocols . This form of reasoning has been labelled System 2-by proxy. It includes elements of algorithmic reasoning and ruling out the worst-case scenario . However, there are indications that cognitive tools in the prehospital setting are frequently poorly adapted to the context .
In a review, Graber et al.  found three main interventions that reduce diagnostic errors. The first was interventions to increase knowledge and experience and the main method in this category is the use of medical simulation. The second category is interventions to improve clinical reasoning with methods like reflective practice and metacognition and the third category is cognitive tools such as decision support. Graber et al.  also concluded that the evidence base for these interventions was low and that there was a need for further research. Croskerry et al. suggest similar methods to prevent diagnostic errors . Ely et al.  argue in favour of the development of checklists to prevent diagnostic errors.
The same interventions are probably applicable in prehospital care. Medical simulation has the potential to improve EMS clinicians’ clinical performance . Since the use of different cognitive tools is important in prehospital care, the development of these tools is urgent. Research in the area is limited , but there are indications that compliance with guidelines can be increased by using a computerised decision-support system in the prehospital setting [5, 41]. However, the effect on diagnostic accuracy is unknown.
Our study only includes a subset of patients from three different regions in Sweden. It is therefore possible to question whether these patients should be regarded as representative of Sweden.
This was a retrospective observational study with a number of potential weaknesses. Missing data is probably the most important one. The assessment that was made by the EMS clinician can only be evaluated from what was written in the case records. In some cases, he or she may have had other thoughts that were not appropriately recorded.
Furthermore, is the frequency of various conditions based on the number of patients who had an available ICD code (76% of all patients). The true percentage values will therefore most probably be lower in a number of respects that were addressed in this manuscript.
In prehospital care, there is a knowledge gap regarding the association between the field assessment and the final assessment after arriving at hospital. Critical voices have been raised saying that these comparisons are difficult to make, as new events may have developed between the two assessments. To reduce this error, comparisons have been made with the first required diagnosis in the hospital; for example, the intoxicated patient who was given depression as a final diagnosis was not compared, but a first diagnosis of acute intoxication was made when he/she was released from the medical ward and transferred to a psychiatric ward. Therefore, it is our belief that this comparison provides valuable knowledge to prehospital patient safety research.
Among patients reached by ambulance in Sweden, 83% were transported to hospital and, of them, 14% had a time-critical condition. Among these cases, the majority were assessed in the field as potentially appropriate, but 12% had a potentially inappropriate field assessment. The consequences of these findings need to be further explored.
Emergency medical systems
Emergency medical technicians
Department of Health. Tackling demand together: a toolkit for improving urgent and emergency care pathways by understanding increases in 999 demand. Crown; 2009. https://kingsfund.blogs.com/health_management/2009/10/tackling-demand-together-a-toolkit-for-improving-urgent-and-emergency-care-pathways-by-understanding.html. Assessed 12 Dec 2016.
Bigham BL, Bull E, Morrison M, Burgess R, Maher J, Brooks SC. Patient safety in emergency medical services: executive summary and recommendations from the Niagara Summit. CJEM. 2011;13:13–8.
Bigham BL, Buick JE, Brooks SC, Morrison M, Shojania KG, Morrison LJ. Patient safety in emergency medical services: a systematic review of the literature. Prehosp Emerg Care. 2012;16:20–35.
Brice JH, Studnek JR, Bigham BL, Martin-Gill C, Custalow CB, Hawkins E. EMS provider and patient safety during response and transport: proceedings of an ambulance safety conference. Prehosp Emerg Care. 2012;16:3–19.
Andersson Hagiwara M, Suserud B-O, Andersson-Gare B, Sjoqvist B, Henricson M, Jonsson A. The effect of a computerised decision support system (CDSS) on compliance with the prehospital assessment process: results of an interrupted time-series study. BMC Med Inform Decis Mak. 2014;14:70–5.
Croskerry P, Singhal G, Mamede S. Cognitive debiasing 1: origins of bias and theory of debiasing. BMJ Qual Saf. 2013;22(Suppl2):58–64.
Heuer FJ, Gruschka AD, Crozier AT, Bleckmann AA, Plock AE, Moerer AO, et al. Accuracy of prehospital diagnoses by emergency physicians: comparison with discharge diagnosis. Eur J Emerg Med. 2012;19:292–6.
Wireklint Sundström B, Herlitz J, Hansson PO, Brink P. Comparison of the university hospital and county hospitals in western Sweden to identify potential weak links in the early chain of care for acute stroke: results of an observational study. BMJ Open. 2015;5:e008228.
Axelsson C, Herlitz J, Karlsson A, Sjöberg H, Jiménez-Herrera M, Bång A, et al. The early chain of Care in Patients with Bacteraemia with the emphasis on the prehospital setting. Prehosp Disaster Med. 2016;31:272–7.
Green RS, Travers AH, Cain E, Campbell SG, Jensen JL, Petrie DA, et al. Paramedic recognition of Sepsis in the prehospital setting: a prospective observational study. Emergency Medicine International. 2016;2016:5.
Tärnqvist J, Dahlén E, Norberg G, Magnusson C, Herlitz J, Strömsöe A, et al. On-scene and final assessments and their interrelationship among patients who use the EMS on multiple occasions. Prehosp Disaster Med. 2017;32:1–8.
Lammers R, Byrwa M, Fales W. Root causes of errors in a simulated prehospital pediatric emergency. Acad Emerg Med. 2012;19:37–47.
Suserud B-O. A new profession in the pre-hospital care field—the ambulance nurse. Nurs Crit Care. 2005;10:269–71.
Widgren BR, Jourak M. Medical emergency triage and treatment system (METTS): a new protocol in primary triage and secondary priority decision in emergency medicine. J Emerg Med. 2011;40:623–8.
Hagiwara MA, Nilsson L, Strömsöe A, Axelsson C, Kängström A, Herlitz J. Patient safety and patient assessment in pre-hospital care: a study protocol. Scand J Trauma Resusc Emerg Med. 2016;24:1–7.
Statistics from EMS organisations in Västra Götaland region in Sweden. 2016.
Rawshani A, Larsson A, Gelang C, Lindqvist J, Gellerstedt M, Bång A, et al. Characteristics and outcome among patients who dial for the EMS due to chest pain. Int J Cardiol. 2014;176:859–65.
Gleason T, Davidson M, Tanner K, Baptiste D, Rushton C, Day J, et al. Defining the critical role of nurses in diagnostic error prevention: a conceptual framework and a call to action. Diagnosis. 2017;4:201–24.
Carter H, Thompson J. Defining the paramedic process. Aust J Prim Health. 2015;21:22–6.
Hagiwara M, Bremer A, Claesson A, Axelsson C, Norberg G, Herlitz J. The impact of direct admission to a catheterisation lab/CCU in patients with ST-elevation myocardial infarction on the delay to reperfusion and early risk of death: results of a systematic review including meta-analysis. Scand J Trauma Resusc Emerg Med. 2014;22:67.
De Luca A, Toni D, Lauria L, Sacchetti ML, Giorgi Rossi P, Ferri M, et al. An emergency clinical pathway for stroke patients--results of a cluster randomised trial (isrctn41456865). BMC Health Serv Res. 2009;9:14.
Hayden GE, Tuuri RE, Scott R, Losek JD, Blackshaw AM, Schoenling AJ, et al. Triage sepsis alert and sepsis protocol lower times to fluids and antibiotics in the ED. Am J Emerg Med. 2016;34:1–9.
Graber ML. The incidence of diagnostic error in medicine. BMJ Qual Saf. 2013;22(Suppl 2):ii21–7.
Graber ML, Carlson HA. Diagnostic error: the hidden epidemic. Physician Executive. 2011;37:8–9.
Calder L, Forster A, Nelson M, Leclair J, Perry J, Vaillancourt C, et al. Adverse events among patients registered in high-acuity areas of the emergency department: a prospective cohort study. CJEM. 2010;12:421–30.
Kachalia A, Gandhi TK, Puopolo AL, Yoon C, Thomas EJ, Griffey R, et al. Missed and delayed diagnoses in the emergency department: a study of closed malpractice claims from 4 liability insurers. Ann Emerg Med. 2007;49:196–205.
Croskerry P. The importance of cognitive errors in diagnosis and strategies to minimize them. Acad Med. 2003;78:775–80.
Saposnik G, Redelmeier D, Ruff CC, Tobler PN. Cognitive biases associated with medical decisions: a systematic review. BMC Med Inform Decis Mak. 2016;16:138.
Evans JS. Dual-processing accounts of reasoning, judgment, and social cognition. Annu Rev Psychol. 2008;59:255–78.
Croskerry P. A universal model of diagnostic reasoning. Acad Med. 2009;84:1022–8.
Alexander M. Reasoning processes used by paramedics to solve clinical problems. Ann Arbor: The George Washington University; 2009.
Jensen JL. Paramedic clinical decision-making: result of two Canadian studies. J Paramedic Pract. 2011;1:63–71.
Jensen JL, Bienkowski A, Travers AH, Calder LA, Walker M, Tavares W, et al. A survey to determine decision-making styles of working paramedics and student paramedics. CJEM. 2016;18:213–22.
Jensen J, Croskerry P, Travers A. EMS: consensus on paramedic clinical decisions during high-acuity emergency calls: results of a Canadian Delphi study. CJEM. 2011;13:310–8.
Hagiwara M, Suserud B-O, Jonsson A, Henricson M. Exclusion of context knowledge in the development of prehospital guidelines: results produced by realistic evaluation. Scand J Trauma Resusc Emerg Med. 2013;21:46.
Graber ML, Kissam S, Payne VL, Meyer AN, Sorensen A, Lenfestey N, et al. Cognitive interventions to reduce diagnostic error: a narrative review. BMJ Qual Saf. 2012;21:535–57.
Croskerry P, Singhal G, Mamede S. Cognitive debiasing 2: impediments to and strategies for change. BMJ Qual Saf. 2013;22(Suppl 2):65–72.
Ely JW, Graber ML, Croskerry P. Checklists to reduce diagnostic errors. Acad Med. 2011;86:307–13.
Andersson Hagiwara M, Kängström A, Jonsson A, Lundberg L. Effect of simulation on the clinical competence of Swedish ambulance nurses. Australasian Journal of Paramedicine. 2014;11:2.
Hagiwara M, Henricson M, Jonsson A, Suserud B-O. Decision-support tool in prehospital care: a systematic review of randomized trials. Prehosp Dis Med. 2011;26:319–29.
Hagiwara MA, Sjöqvist BA, Lundberg L, Suserud BO, Henricson M, Jonsson A. Decision support system in prehospital care: a randomized controlled simulation study. Am J Emerg Med. 2013;31:145–53.
We would like to acknowledge the participating ambulance organisations which have kindly helped us with access to medical record databases.
The study was supported by the Västra Götaland Region.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author in response to reasonable requests.
Ethics approval and consent to participate
The study was approved by the Regional Ethics Committee, Gothenburg, Sweden (Dnr: 047–15).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
List of ICD-codes and the number of patients with different ICD-codes within parenthesis (ICD-10-SE) (DOCX 16 kb)