- Study protocol
- Open Access
The Copenhagen Triage Algorithm: a randomized controlled trial
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine volume 24, Article number: 123 (2016)
Crowding in the emergency department (ED) is a well-known problem resulting in an increased risk of adverse outcomes. Effective triage might counteract this problem by identifying the sickest patients and ensuring early treatment. In the last two decades, systematic triage has become the standard in ED’s worldwide. However, triage models are also time consuming, supported by limited evidence and could potentially be of more harm than benefit. The aim of this study is to develop a quicker triage model using data from a large cohort of unselected ED patients and evaluate if this new model is non-inferior to an existing triage model in a prospective randomized trial.
The Copenhagen Triage Algorithm (CTA) study is a prospective two-center, cluster-randomized, cross-over, non-inferiority trial comparing CTA to the Danish Emergency Process Triage (DEPT). We include patients ≥16 years (n = 50.000) admitted to the ED in two large acute hospitals. Centers are randomly assigned to perform either CTA or DEPT triage first and then use the other triage model in the last time period. The CTA stratifies patients into 5 acuity levels in two steps. First, a scoring chart based on vital values is used to classify patients in an immediate category. Second, a clinical assessment by the ED nurse can alter the result suggested by the score up to two categories up or one down. The primary end-point is 30-day mortality and secondary end-points are length of stay, time to treatment, admission to intensive care unit, and readmission within 30 days.
If proven non-inferior to standard DEPT triage, CTA will be a faster and simpler triage model that is still able to detect the critically ill. Simplifying triage will lessen the burden for the ED staff and possibly allow faster treatment.
Clinicaltrials.gov: NCT02698319, registered 24. of February 2016, retrospectively registered
Crowding in emergency departments (ED) poses a serious patient safety concern in hospitals worldwide . Since not every patient can be seen by a doctor on arrival, ED’s prioritize patients according to their perceived urgency of care. In most hospitals today, this prioritization is done by systematic triage . Patients are classified on the basis of a pre-specified algorithm into 5 acuity groups according to vital signs and primary symptom. Before systematic triage was introduced, a simple clinical assessment was used to prioritize the succession in which patients were seen by doctors .
The first systematic triage model was introduced in a local hospital in Australia in the 1970s, and since then 4 triage models have become widespread: Australasian Triage Scale (ATS), Canadian Triage and Acuity Scale (CTAS), Manchester Triage System (MTS), and Emergency Severity Index (ESI) [2–5]. An overview of existing models is provided in Table 1. These models are widely used in their countries of origin, but they have also been implemented to varying degrees across the world, where local adaptations has been done [6–9]. In Scandinavia, Sweden was the first to focus on triage developing two different models: The Medical Emergency Triage and Treatment System and Adaptive Process Triage (ADAPT) . ADAPT is rather similar to CTAS and ATS and it focuses on vital signs and the patient’s presenting complaint.
Most triage models have been developed on the basis of expert opinion and they are not based on data from large prospective cohorts . The models have then been implemented and retrospectively validated [5, 16–18]. The validation has focused on the respective models’ inter-observer variability [15, 19] and ability to predict length of stay  and mortality [19, 21–23] but there are no prospective studies addressing if the models can prevent serious adverse events. Systematic triage takes time and prospective studies are needed to determine the future of ED triage .
Recently, data from ED visits have been collected over a period of 3 months at North Zealand Hospital giving a complete cohort of 6 000 patient ED visits . This study confirmed earlier studies’ conclusion that vital signs at admission are strong predictors of acute patient outcomes , and further demonstrated that a quick clinical assessment of patients by phlebotomists and medical students was superior in predicting 30-day mortality than formalized DEPT triage . Based on these findings, our hypothesis was that a simple model of vital signs could be constructed that would perform as well as DEPT when combined with a quick clinical assessment by the ED nurse.
The aim of this article is to describe the design of the CTA, how the algorithm was designed and how it will be tested in a randomized controlled trial.
The study is a prospective two-center, cluster-randomized, cross-over, non-inferiority trial. CTA is compared to the preexisting DEPT. The primary aim of the CTA is to assess if it improves patient outcome, secondarily to obtain a faster ED acuity stratification. The primary end-point is 30-day mortality and secondary end-points are length of stay (LOS), time to treatment, admission to intensive care unit (ICU), and readmission within 30 days. Follow-up information will be attained from central registries.
Setting and interventions
Two equally sized ED’s in the capital region of Copenhagen are recruited to perform the study; Herlev Hospital and Bispebjerg Hospital with 70.000 and 85.000 annual admissions, respectively [26, 27]. Both centers are 24-h acute care hospitals offering broad medical, surgical, neurological, level-2 trauma and ICU services. The centers are randomly assigned to perform either CTA or DEPT triage as primary evaluation of patients. Subsequently, both hospitals will cross-over to use the other model. The number of admissions with CTA and DEPT will be 1:1. The CTA will be implemented during 2 weeks before initiation of data collection.
In the study period, all patients admitted at any of the two centers will be included. Admission was defined as referral to a bed in the ED. The study design allows inclusion rate and adherence to the intervention to be close to 100 % as the two triage models will not be used at the same time and all acutely admitted patients are categorized using triage. However, patients ≤ 16 years gynecology and obstetric patients will not be included since they are admitted directly to the respective department. Patients where major trauma is suspected pre-hospital will be admitted to a tertiary center in the region.
Copenhagen Triage Algorithm
The CTA is based on vital signs and a clinical assessment by ED nurses.
The CTA classifies patients as red (resuscitation), orange (emergent), yellow (urgent), green (non-urgent) or blue (minor injuries and complaint) and this is done in two steps. A scoring chart based on vital signs is used to classify patients in an immediate category but a clinical assessment can alter the assigned category suggested by the score up to two classed up or one class down. The model is illustrated in Fig. 1. DEPT has a similar structure, but the classification depends on a more complex algorithm designed to classify patients based on their primary complaint (symptom) as well as vital signs . DEPT only allows the ED nurses to reclassify patients as more urgent, not less. There will be no reclassification for the blue triage category as it is defined in in the same way using CTA and DEPT for patients with minor injuries or complaints.
The cut-off points for vital signs (Fig. 1) of CTA were calculated using the results of the TRIAGE database . This was done by defining either the 10 % highest (e.g. heart rate) or the 10 % lowest (e.g. systolic blood pressure) as abnormal, and using univariate logistic regression to determine its ability to predict 30-day mortality. The significant factors were then combined in a multivariate logistic regression with backwards elimination to determine the independent variables and their odds ratio in predicting 30-day mortality. These odds ratios were rounded to their nearest integer and combined to form a score.
The significant factors were systolic blood pressure < 100 mmHg, heart rate > 110 bpm, respiratory rate > 22 min-1, arterial oxygen saturation < 94 %, and treatment with oxygen (Fig. 1). Final categories were defined so that green patients had a 30-day mortality below 2.5 %, yellow patients had a 30-day mortality between 2.5 and 7.5 %, orange patients had a 30-day mortality between 7.5 and 15 % and red patients had a 30-day mortality above 15 %.
Results of the primary regression analyses using these cutoffs are shown in Table 2. Receiver-operating characteristics (ROC) curves showed that CTA and a quick clinical assessment performed by phlebotomists and medical students were superior to DEPT in identifying death within 30 days (Fig. 2). Area under the curve (AUC) statistics for the two models are presented in Table 3, which show that the CTA score is significantly superior to DEPT in predicting the risk of 30-day mortality.
The trial is designed as a non-inferiority trial, i.e to show that 30-day mortality using CTA is not higher than using DEPT. The 30-day mortality in all admitted patients in the TRIAGE database was 4.2 %  and the 28-day mortality in the Acute Admission Database was 4.2 % . Hence, we estimated the 30-day mortality to be 4.2 % for this study. Due to the estimated low incidence of the primary end-point, the proportional difference between the CTA and DEPT group (non-inferiority margin (Δ)) is set at 0.5 %. The power to confirm non-inferiority is set at 80 % with a two-sided confidence interval of 95 %, which would require a sample size of 39.820. We chose to include a minimum of 40.000 patients. The combined percentage of admission to intensive or semi-intensive care unit in the TRIAGE database was 3.4 % , i.e sample size should be adequate to prove non-inferiority for this secondary end-point as well. Reported 30-day readmission rate is usually around 10 %  meaning sample size will likely be sufficient to prove non-inferiority. In calculating the primary end-point of 30-day mortality, patients readmitted more than 30 days after discharge will be considered as separate encounters.
Non-inferiority will be considered to have been confirmed if the lower bound of the 95 % two-sided confidence interval for the difference between the occurrence of the primary endpoint in the CTA and DEPT cohorts does not include -∆. Furthermore, CTA could show superiority over DEPT; this will be considered when the lower bound of the confidence interval mentioned above exceeds 0. This analysis will only be performed if non-inferiority is confirmed. The power to demonstrate that CTA is superior will be 0.72 with a sample size of 40.000, while there will be a 5 % chance that DEPT triage is better. LOS and time-to-treatment in the two models will be log-transformed and compared using parametric tests. The patient populations included with CTA and DEPT will be compared using standard parametric tests.
After a 1 week learning period for the staff, the study was initiated the 1st of March, 2015. Herlev Hospital was selected to begin with CTA, i.e. Bispebjerg Hospital continued their use of DEPT triage. This continued until the 17th of August 2015. Subsequently, the hospitals crossed-over. By the end of January 2016 the inclusion stopped as planned. A total of approximately 50,000 patient visits have been recorded.
Emergency department (ED) triage impacts most patients and it can be a valuable tool for managing a crowded and busy ED. However, existing models of triage are supported by limited evidence. The Copenhagen Triage Algorithm (CTA) aims to be a faster and better way to identify acutely ill patients as well as the less urgent patients in the ED. The CTA Study is a randomized trial comparing CTA to the standard Danish Emergency Process Triage (DEPT) in an unselected population. To the best of our knowledge, this is the first study to prospectively evaluate a triage model in a randomized study. If the hypothesis of non-inferiority in detecting mortality is confirmed CTA will provide less resource consuming method of triage in the ED while still identifying patients in need of urgent care.
The time and resources used on systematic triage is not without a price as crowding in the ED is a well-established risk that can compromise patient safety . Overcrowding in the ED happens when the patient load exceeds the available recourses. This situation leads to increased length of stay and mortality across patients both high and low risk [30, 31]. A retrospective study of visits to the Canberra Hospital ED  showed that patients presenting to the ED during “overcrowded shifts” had a 34 % higher risk of 10-day in hospital mortality than patients presenting during normal shits. This risk persisted even when accounting for level of triage (by Australasian Triage Scale) suggesting a level of under-triage during crowded shifts . A systematic review of crowding in the ED  found ED bottlenecks to be common in the literature often arising from inadequate staffing. As triage by definition is time and resource consuming, speeding up this process alone could help alleviate some of these problems.
Compared to other triage models CTA is a vastly simpler model comprised of vital signs (blood pressure, heart rate, arterial oxygen saturation, respiratory rate, and the need for oxygen treatment) combined with a clinical assessment by the ED nurse. Since vital signs are measured as part of any patient admission except for minor injuries, the only additional time consuming part of CTA is the clinical assessment which can be done in few minutes even by clinically uneducated staff . This is contrasted by most existing triage models such as ATS, MTS, DEPT and CTAS that use extensive lists of primary complaint or causes of contact [14, 21] aimed at identifying potentially urgent patients. These aim to find the patients primary symptom and triage based on prior consensus of the urgency of symptoms. These are mostly based on expert opinion and has been shown to lead to over-triage, increasing the triage level for about half the patients while lowering the sensitivity and specificity of the final triage .
Abnormal vital signs are strong predictors of mortality in patients admitted through ED’s . Though smaller studies have shown that vital signs alone are insufficient to detect the critically ill [32, 33], combining these with a clinical assessment by the ED nurse may significantly improve this without using extra resources . Which vital signs and cut-off points should be used is still a subject of debate. In most models, like the ATS, it is established by expert opinion  and a systematic review of the literature from 2011 by Farrohknia et al.  showed limited or insufficient evidence for any of the vital signs usually used in triage models (respiratory rate, arterial oxygen saturation, heart rate, and level of consciousness). Thus we decided to define new cut-off values based on the large cohort of patients we had gathered.
As the vital signs were meant to reflect acute illness, we chose not to include age as a factor in the score. Biomarkers were not a part of this study though several biomarkers have been shown to be strong predictors of mortality [35, 36]. In the future, a combined score of vital signs and biomarkers may be the most sensitive method of detecting the vast amount of non-urgent patients visiting the hospital every day [24, 37].
The primary end-point is 30-day mortality which is associated with multiple factors besides the triage model used at admission. Mortality has been used previously to assess the efficacy of triage models [19, 21–23]. If CTA has any impact on acute mortality (e.g. 8 h) it would also affect 30-day mortality given it is the only intervention performed. However, if 8-h mortality was chosen as primary end-point, it would favor a model ranking a majority of patients in acute category and not necessarily reflect the impact on less acute patients who might die during hospitalization or within the first month. Admission to ICU as secondary endpoint was chosen to reflect a more immediate impact of triage.
In the acute care setting, it is not feasible to randomize individual patients for different triage models for several reasons. The individual randomization would be a huge logistical challenge in a busy ED and it would be associated with delays and crowding, which would be unethical. Furthermore, it is likely that the staff would prefer the faster algorithm (CTA) and tend to use that in most patients once it is available in the department. To avoid this, cluster-randomization was chosen. Cluster-randomized design introduces dependence between individual units sampled (e.g. difference in patient population, skill of ED nurses/physicians). This is largely alleviated by cross-over in the study and relies on a similar patient inclusion during both parts of the study. This is ensured by determining the total study period through number of included patients instead of time. Furthermore, the number of clusters were very small but the cross-over design partly compensates for this.
Readmissions after 30 days are also included which means patients can be exposed to both DEPT and CTA triage during the study period. This means patients with diagnoses prone to readmission will be overrepresented in the study. Moreover, if the inclusion rate differs significantly between the two hospitals during the study period this might slightly favor the model used in most patients late in the study due to lead-time bias. It is possible for patients to be admitted in both hospitals during the study period though not likely. Patients are not systematically transferred between these two hospitals so systematic bias is unlikely in this regard. A final limitation of the study is that patients with suspected major trauma are admitted to a tertiary center in the region, meaning that few such patients will be included. However, the major aim of the CTA study is not to focus on seriously injured patients as they are managed according to specific algorithms anyway.
Adaptive Process Triage
Australasian Triage Scale
Area Under the Curve
Blood Sugar Level
Copenhagen Triage Algorithm
Canadian Triage and Acuity Scale
Danish Emergency Process Triage
Emergency Severity Index
Glascow Coma Scale
length of stay
Manchester Triage Scale
Blood Oxygen Saturation
Carter EJ, Pouch SM, Larson EL. The relationship between emergency department crowding and patient outcomes: a systematic review. J Nurs Sch. 2014;46(2):106–15.
FitzGerald G, Jelinek GA, Scott D, Gerdtz MF. Emergency department triage revisited. Emerg Med J. 2010;27(2):86–92.
Weyrich P, Christ M, Celebi N, Riessen R. Triage systems in the emergency department. Med Klin Intensivmed Notfallmed. 2012;107(1):67–78. quiz 9.
Wuerz RC, Milne LW, Eitel DR, Travers D, Gilboy N. Reliability and validity of a new five-level triage instrument. Acad Emerg Med. 2000;7(3):236–42.
Moll HA. Challenges in the validation of triage systems at emergency departments. J Clin Epidemiol. 2010;63(4):384–8.
Graff I, Goldschmidt B, Glien P, Bogdanow M, Fimmers R, Hoeft A, et al. The German Version of the Manchester Triage System and its quality criteria--first assessment of validity and reliability. PLoS One. 2014;9(2):e88995.
Bruijns SR, Wallis LA, Burch VC. A prospective evaluation of the Cape triage score in the emergency department of an urban public hospital in South Africa. Emerg Med J. 2008;25(7):398–402.
Jobe J, Ghuysen A, Gerard P, Hartstein G, D’Orio V. Reliability and validity of a new French-language triage algorithm: the ELISA scale. Emerg Med J. 2014;31(2):115–20.
Taboulet P, Moreira V, Haas L, Porcher R, Braganca A, Fontaine JP, et al. Triage with the French Emergency Nurses Classification in Hospital scale: reliability and validity. Eur J Emerg Med. 2009;16(2):61–7.
Farrokhnia N, Goransson KE. Swedish emergency department triage and interventions for improved patient flows: a national update. Scand J Trauma Resusc Emerg Med. 2011;19:72.
Skriver C, Lauritzen MM, Forberg JL, Gaardboe-Poulsen OB, Mogensen CB, Hansen CL, et al. Triage quickens the treatment of the most sick patients. Ugeskr Laeger. 2011;173(40):2490–3.
Iversen AK, Kristensen M, Ostervig R, Forberg JL, Schou M, Iversen K. [No evidence that formalized triage is superior to informally structured triage]. Ugeskr Laeger. 2015;177(30):2–6.
Johansen MB, Forberg JL. Nurses’ evaluation of a new formalized triage system in the emergency department - a qualitative study. Dan Med Bull. 2011;58(10):A4311.
Danish Emegency Process Triage, [cited 2016 14/6]. Available from: www.deptriage.dk. Accessed 14 June 2016.
Farrohknia N, Castren M, Ehrenberg A, Lind L, Oredsson S, Jonsson H, et al. Emergency department triage scales and their components: a systematic review of the scientific evidence. Scand J Trauma Resusc Emerg Med. 2011;19:42.
Cooke MW, Jinks S. Does the Manchester triage system detect the critically ill? J Accid Emerg Med. 1999;16(3):179–81.
JMurray M. The Canadian Triage and Acuity Scale: A Canadian perspective on emergency department triage. Emerg Med (Fremantle). 2003;15(1):6–10.
Hardern RD. Critical appraisal of papers describing triage systems. Acad Emerg Med. 1999;6(11):1166–71.
Eitel DR, Travers DA, Rosenau AM, Gilboy N, Wuerz RC. The emergency severity index triage algorithm version 2 is reliable and valid. Acad Emerg Med. 2003;10(10):1070–80.
Tanabe P, Gimbel R, Yarnold PR, Adams JG. The Emergency Severity Index (version 3) 5-level triage system scores predict ED resource consumption. J Emerg Nurs. 2004;30(1):22–9.
Barfod C, Lauritzen MM, Danker JK, Soletormos G, Forberg JL, Berlac PA, et al. Abnormal vital signs are strong predictors for intensive care unit admission and in-hospital mortality in adults triaged in the emergency department - a prospective cohort study. Scand J Trauma Resusc Emerg Med. 2012;20:28.
Doherty SR, Hore CT, Curran SW. Inpatient mortality as related to triage category in three New South Wales regional base hospitals. Emerg Med (Fremantle). 2003;15(4):334–40.
Martins HM, Cuna LM, Freitas P. Is Manchester (MTS) more than a triage system? A study of its association with mortality and admission to a large Portuguese hospital. Emerg Med J. 2009;26(3):183–6.
Plesner LL, Iversen AK, Langkjaer S, Nielsen TL, Ostervig R, Warming PE, et al. The formation and design of the TRIAGE study--baseline data on 6005 consecutive patients admitted to hospital from the emergency department. Scand J Trauma Resusc Emerg Med. 2015;23:106.
Iversen AK S, Forberg JL, Schou M, Rasmussen LS, Køber L, Iversen K. Comparison of systematic triage with clinical assessment in prediction of short-term mortality. Scand J Trauma Resusc Emerg Med. 2015;23(1):1.
The Capital Region of Denmark. Herlev Hospital Homepage [cited 2016 12/7]. Available from: https://www.herlevhospital.dk/. Accessed 14 June 2016.
The Capital Region of Denmark. Bispebjerg Hospital Homepage [cited 2016 12/7]. Available from: https://www.bispebjerghospital.dk/. Accessed 14 June 2016.
Barfod C, Lauritzen MM, Danker JK, Soletormos G, Berlac PA, Lippert F, et al. The formation and design of the ‘Acute Admission Database’- a database including a prospective, observational cohort of 6279 patients triaged in the emergency department in a larger Danish hospital. Scand J Trauma Resusc Emerg Med. 2012;20:29.
Blunt I, Bardsley M, Grove A, Clarke A. Classifying emergency 30-day readmissions in England using routine hospital data 2004-2010: what is the scope for reduction? Emerg Med J. 2015;32(1):44–50.
Hoot NR, Aronsky D. Systematic review of emergency department crowding: causes, effects, and solutions. Ann Emerg Med. 2008;52(2):126–36.
Richardson DB. Increase in patient mortality at 10 days associated with emergency department overcrowding. Med J Aust. 2006;184(5):213–6.
Christensen D, Jensen NM, Maaloe R, Rudolph SS, Belhage B, Perrild H. Nurse-administered early warning score system can be used for emergency department triage. Dan Med Bull. 2011;58(6):A4221.
Subbe CP, Slater A, Menon D, Gemmell L. Validation of physiological scoring systems in the accident and emergency department. Emerg Med J. 2006;23(11):841–5.
Considine J, LeVasseur SA, Villanueva E. The Australasian Triage Scale: examining emergency department nurses’ performance using computer and paper scenarios. Ann Emerg Med. 2004;44(5):516–23.
Iversen K, Gotze JP, Dalsgaard M, Nielsen H, Boesgaard S, Bay M, et al. Risk stratification in emergency patients by copeptin. BMC Med. 2014;12:80.
Lyngbaek S, Andersson C, Marott JL, Moller DV, Christiansen M, Iversen KK, et al. Soluble urokinase plasminogen activator receptor for risk prediction in patients admitted with acute chest pain. Clin Chem. 2013;59(11):1621–9.
Seymour CW, Cooke CR, Wang Z, Kerr KF, Yealy DM, Angus DC, et al. Improving risk classification of critical illness with biomarkers: A simulation study. J Crit Care. 2013;28(5):541–48.
The study is funded by TrygFonden. The trial is driven and initiated by the researchers and the foundation has no influence on study design, data analysis, interpretation or publication.
Availability of data and supporting material
When the study is completed, it will be located on a central server at Statistics Denmark in anonymized form. After analysis and publication of all outcomes the database will be available from the authors on reasonable request.
RBH, LP and KI drafted the manuscript. KI had the original idea for the study. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study protocol was approved by the local ethics committees (H-4-2014-FSP). The Danish Data Protection Agency (HEH-2014-118) and the Danish Health and Medicines Authority (3-3013-1119/2). The study is registered on clinicaltrials.gov (NCT02698319).