Accuracy and concordance of nurses in emergency department triage

In the emergency department (ED) Registered Nurses (RNs) often perform triage, i.e. the sorting and prioritizing of patients. The allocation of acuity ratings is commonly based on a triage scale. To date, three reliable 5-level triage scales exist, of which the Canadian Triage and Acuity Scale (CTAS) is one. In Sweden, few studies on ED triage have been conducted and the organization of triage has been found to vary considerably with no common triage scale. The aim of this study was to investigate the accuracy and concordance of emergency nurses acuity ratings of patient scenarios in the ED setting. Totally, 423 RNs from 48 (62%) Swedish EDs each triaged 18 patient scenarios using the CTAS. Of the 7,550 triage ratings, 57.6% were triaged in concordance with the expected outcome and no scenario was triaged into the same triage level by all RNs. Inter-rater agreement for all RNs was kappa = 0.46 (unweighted) and kappa = 0.71 (weighted). The fact that the kappa-values are only moderate to good and the low concordance between the RNs call for further studies, especially from a patient safety perspective.     

Impacts of the introduction of a triage system in Japan: A time series study

The aim of the present study was to measure and compare the effectiveness of nursing triage before and after introduction of the Japanese Triage and Acuity Scale (JTAS), the Japanese version of the Canadian Triage and Acuity Scale (CTAS), during emergency treatment. Surveys of triage nurses and emergency physicians were conducted before and after JTAS introduction. Respondents were triage nurses (before 112 cases, after 94 cases), emergency physicians (before 50, after 41), and triaged patients (before 1057, after 1025) from seven separate emergency medical facilities. The results showed that nursing triage using the JTAS shortened “time from registration to triage” by 3.8 min, “triage duration” by 1 min, “time from registration to physician” by 11.2 min, and “waiting time perceived by patients to see a physician” by 18.6 min (p < 0.001). The difference in assigned level of urgency between triage nurses and emergency physicians decreased from 34.2% to 12.2% (p < 0.001), over-triage decreased from 24.7% to 8.6% (p < 0.001), and under-triage decreased from 9.5% to 3.6% (p < 0.001). Furthermore, assessment agreement between triage nurses and emergency physicians increased significantly, from weighted κ = 0.486 to weighted κ = 0.820. These findings suggest that the introduction of the JTAS promoted more effective nursing triage and medical care.     

Reliability of a Computerized Version of the Pediatric Canadian Triage and Acuity Scale

Background: The use of a standardized triage tool allows better comparison of the patients; a computerized version could theoretically improve its reliability.
Objectives: To compare the interrater agreement of the Pediatric Canadian Triage and Acuity Scale (PedCTAS) and a computerized version (Staturg).
Methods: A two-phase experimental study was conducted to compare the interrater agreement between nurses assigning triage level to written case scenarios using either traditional PedCTAS or Staturg. Participants were nurses with at least one year of experience in pediatric emergency medicine and trained at triage. Each of the 54 scenarios was evaluated first by all nurses using either one of the strategies. Four weeks later, they evaluated the same scenarios using the other tool. The primary outcome was the interrater agreement measured using κ score.
Results: Eighteen of the 29 eligible nurses participated in the study. The computerized triage tool showed a better interrater agreement, with a Staturg κ score of 0.55 (95% confidence interval = 0.53 to 0.57) versus a PedCTAS κ score of 0.51 (95% confidence interval = 0.49 to 0.53). The computerized version was also associated with higher agreements for scenarios describing patients with the highest severity of triage (κ score of 0.72 vs. 0.55 for level 1; κ score of 0.70 vs. 0.51 for level 2).
Conclusions: A computerized version of the PedCTAS showed a statistically significant improvement in the interrater agreement for nurses evaluating the triage level of 54 clinical scenarios, but this difference has probably small clinical significance.     

Interrater Agreement between Nurses for the Pediatric Canadian Triage and Acuity Scale in a Tertiary Care Center

Objectives: The objective was to measure the interrater agreement between nurses assigning triage levels to children visiting a pediatric emergency departments (EDs) assisted by a computerized version of the Pediatric Canadian Triage and Acuity Scale (PedCTAS). Methods: This was a prospective cohort study evaluating children triaged from Level 2 (emergent) to Level 5 (nonurgent). A convenience sample of patients triaged during 38 shifts from April to September 2007 in a tertiary care pediatric ED was evaluated. All patients were initially triaged by regular triage nurses using a computerized version of the PedCTAS. Research nurses performed a second evaluation blinded to the first evaluation using the same triage tool. These research nurses were regular ED nurses performing extra hours for research purposes exclusively. The primary outcome measure was the interrater agreement between the two nurses as measured by the linear weighted kappa score. Secondary outcomes included the proportion of patient for which nurses did not apply the triage level suggested by Staturg (override) and agreement for these overrides. Results: A total of 499 patients were recruited. The overall interrater agreement was moderate (linear weighted kappa score of 0.55 [95% confidence interval {CI} = 0.48 to 0.61] and quadratic weighted kappa score of 0.61 [95% CI = 0.42 to 0.80]). There was a discrepancy of more than one level in only 10 patients (2% of the study population). Overrides occurred in 23.2 and 21.8% for regular and research triage nurses, respectively. These overrides were equally distributed between increase and decrease in triage level. Conclusions: Nurses using Staturg, which is a computerized version of the PedCTAS, demonstrated moderate interrater agreement for assignment of triage level to children presenting to a pediatric ED.     

改良澳大利亚拣伤评分系统在急诊科拣伤救治中的应用及效果评价

目的评价改良澳大利亚拣伤评分系统在急诊批量创伤患者评估分类中的应用效果。方法按时间先后顺序将178例批量创伤患者分为对照组87例和观察组91例。对照组按照传统方法拣伤分类,观察组应用改良澳大利亚拣伤评分系统评估分类。比较两组拣伤分类时间、分拣准确率、抢救成功率、护士对分类方法满意度和患者/家属对抢救工作满意度。结果观察组评估分类时间低于对照组(P0.01);分拣准确率、抢救成功率(P0.05)、护士对分类方法满意度和患者/家属对抢救工作满意度均高于对照组(P0.01)。结论改良澳大利亚拣伤评分系统能快速准确评估伤情,指导急诊抢救治疗工作,提高抢救效率和成功率,值得在急诊科推广应用。     

Paramedics and triage: Effect of one training session on triage in the emergency department

This 3-stage intervention study enrolled all adult patients referred to a universitybased emergency department (ED) during randomly assigned 1-week preeducation or posteducation periods. Triage decisions recorded by ED paramedics (n=8) both before and after an educational training session were compared to decisions made by emergency physicians (EPs). Triage decisions of paramedics and EPs in the preeducation phase showed poor consistency (κ =0.317, κ=0.388). Triage decisions in the posteducation phase increased slightly but were still found to be low. On the other hand, consistency between the triage assessments recorded by paramedics and EPs of the general appearance of patients increased from low in the preeducation phase to moderate in the posteducation phase (κ =0.327, κ=0.500, respectively). The training session was associated with a slight increase in the consistency of triage decisions recorded by paramedics and EPs.     

Current status of emergency department triage in mainland China: A narrative review of the literature

In this review, the current status of emergency department triage in mainland China is explored, with the purpose of generating a deeper understanding of the topic. Literature was identified through electronic databases, and was included for review if published between 2002 and 2012, included significant discussion of daily emergency department triage in mainland China, was peer reviewed, and published in English or Chinese. Thematic analysis was used to identify themes which emerged from the reviewed literature. This resulted in 21 articles included for review. Four themes emerged from the review: triage process, triage training, qualification of triage nurses, and quality of triage. The review demonstrates that there is currently not a unified approach to emergency department triage in mainland China. Additionally, there are limitations in triage training for nurses and confusion around the role of triage nurses. This review highlights that emergency department triage in mainland China is still in its infancy and that more research is needed to further develop the role of triage.     

Triage nurses validly and reliably estimate emergency department patient complexity

Objective: To access the validity and reliability of triage nurse estimates of ED patient complexity. Methods: Prospective, single‐blinded evaluation of triage nurse estimates of patient complexity, where a high‐complexity patient is defined as a patient requiring two or more procedures or investigations or consultations. Validity of complexity estimates was assessed by comparison with the number of actual procedures, investigations and consultations requested. Reliability of triage nurse estimates of complexity was assessed by comparison with assessment nurse estimates of complexity. Results: The specific proportion of agreement and spearman correlation coefficient of triage nurse estimates of complexity with actual procedure, investigations and consultation use were 0.83 (95% confidence interval [CI] 0.79–0.88) and 0.59 (95% CI 0.51–0.66), respectively. The specific proportion of agreement and kappa of triage nurse estimates of complexity with assessment nurse estimates were 0.80 (95% CI 0.73–0.87) and 0.59 (95% CI 0.47–0.71), respectively. Conclusions: Triage nurses make valid and reliable estimates of patient complexity. This information might be used to guide ED work flow and ED casemix system analysis.     

Measuring the effectiveness of the national Mental Health Triage Scale in an emergency department

ABSTRACT:   The mainstreaming process has significantly altered the means of access to mental health services in Australia. Increasingly people seeking mental health care present at general hospital emergency departments. The triage system, which has proven effective for prioritizing physical illness and injury, has proven problematic when applied to mental health-related problems. This paper presents the results of a study undertaken in the emergency department of a Victorian public hospital. The Mental Health Triage Scale was introduced and used independently by triage nurses and the psychiatric nurse consultants employed in the department. Following a 3-month period, the two sets of triage scores for psychiatric presentations ( n =  137) were compared. The findings suggest that triage nurses are rating clients experiencing mental health problems as in more urgent need of care than their psychiatric nursing counterparts. This suggests that the introduction of the guidelines alone is insufficient, and that education is required for more effective use of the tool.     

Emergency Department Triage: Do Experienced Nurses Agree on Triage Scores?

Background

The reproducibility of the Canadian Triage &; Acuity Scale (CTAS), designed and introduced in the late 1990s in all Canadian emergency departments (EDs), has been studied mostly using measures of interrater agreement. However, each of these studies shares a common limitation: the nurses had received fresh CTAS training, which is likely to have led to an overestimation of the reproducibility of CTAS.

Objectives

This study aims to assess the interrater reliability of the CTAS in current clinical practice, that is, as used by experienced ED nurses without recent certification or recertification.

Methods

A prospective sample of 100 patients arriving by ambulance was identified and yielded a set of 100 written scenarios. Five experienced ED nurses reviewed and blindly assigned a CTAS score to each scenario. The agreement among nurses was measured using the Kappa statistic calculated with quadratic weights. Kappa values were generated for each pair of nurses and a global Kappa coefficient was calculated to measure overall agreement.

Results

Overall interrater agreement was moderate, with a global Kappa of 0.44 (95% confidence interval 0.40–0.48). However, pairwise, Kappa values were heterogeneous (0.30 to 0.61, p = 0.0013).

Conclusions

The moderate interrater agreement observed in this study is disappointingly low and suggests that CTAS reliability may be lower than expected, and this warrants further research. Intra-observer reliability of CTAS should be ascertained more extensively among experienced nurses, and a future evaluation should involve several institutions.     

Optimizing triage consistency in Australian emergency departments: The Emergency Triage Education Kit

Objective: The Emergency Triage Education Kit was designed to optimize consistency of triage using the Australasian Triage Scale. The present study was conducted to determine the interrater reliability of a set of scenarios for inclusion in the programme. Methods: A postal survey of 237 paper‐based triage scenarios was utilized. A quota sample of triage nurses (n = 42) rated each scenario using the Australasian Triage Scale. The scenarios were analysed for concordance and agreement. The criterion for inclusion of the scenarios in the programme was κ ≥ 0.6. Results: Data were collected during 2 April to 14 May 2007. Agreement for the set was κ = 0.412 (95% CI 0.410–0.415). Of the initial set: 92/237 (38.8%, 95% CI 32.6–45.3) showed concordance ≥70% to the modal triage category (κ = 0.632, 95% CI 0.629–0.636) and 155/237 (65.4%, 95% CI 59.3–71.5) showed concordance ≥60% to the modal triage category (κ = 0.507, 95% CI 0.504–0.510). Scenarios involving mental health and pregnancy presentations showed lower levels of agreement (κ = 0.243, 95% CI 0.237–0.249; κ = 0.319, 95% CI 0.310–0.328). Conclusion: All scenarios that showed good levels of agreement have been included in the Emergency Triage Education Kit and are recommended for testing purposes; those that showed moderate agreement have been incorporated for teaching purposes. Both scenario sets are accompanied by explanatory notes that link the decision outcome to the Australasian College for Emergency Medicine Guidelines on the Implementation of the Australasian Triage Scale. Future analysis of the scenarios is required to identify how task‐related factors influence consistency of triage.     

Triage in emergency departments: national survey

Aim. This paper reports a study the aim of which was to describe how triage‐related work was organized and performed in Swedish emergency departments. Background. Hospitals in many developed countries use some kind of system to prioritize the patients attending emergency departments. Triage is a commonly used term to refer to the process of sorting and prioritizing patients for care. How the triage procedure is organized and which personnel perform this type of work vary considerably throughout the world. In Sweden, few studies have explored this important issue. Method. A national survey was conducted using telephone interviews, with nurse managers at each of the emergency departments. The sample represented 87% of emergency departments in Sweden. Results. The findings clearly illustrate the organization of emergency department triage, focusing on personnel who perform triage, as well as the facilities, resources and procedures available for triage. However, the results indicate that work associated with such triage in Sweden is not organized in any consistent matter. In 81% of the emergency departments a clerk, Licensed Practical Nurse or Registered Nurse were assigned to assess patients not arriving by ambulance. There was also diversity in other areas, including requirements for staff to have particular qualifications and clinical experience for being allocated to triage work, as well as facilities for triage personnel assessing and prioritizing patients. The use of triage scales and acuity ratings also lacked uniformity and disparities were observed in both the design and use of triage scales. A little less than half (46%) of the emergency departments did not use any kind of triage scale to document patient acuity ratings. Conclusion. In contrast to several other countries, this study shows that Swedish emergency departments do not adhere well to established standards and guidelines about triage in emergency care. Research on emergency department triage, especially in the areas of personnel performing triage, triage scales and standards and guidelines are recommended. Relevance to clinical practice. The diversity among several aspects of nursing triage (e.g. use of less qualified personnel performing triage, the use of different triage scales) presented in the study points to a safety risk for the patients. It also shows the need of further education for the personnel in clinical practice as well as further research on triage in order to gain national consensus about this nursing task.     

Deliberate self-harm: emergency department nurses' attitudes, triage and care intentions

Aim and objectives. This exploratory study investigates emergency department nurses’ attitudes towards patients who engage in deliberate self‐harm. It examines their attitudes towards, and triage and care decisions with, patients who self‐harm. Background. Emergency department nurses sometimes show unsympathetic attitudes towards patients who present with self‐harm and these can contribute to difficulties in assessing and providing appropriate care. Design. A modified version of the Suicide Opinion Questionnaire was used. A non‐probability sample of 43 emergency department nurses from a large Australian hospital participated in the study. Data were analysed using SPSS. Results. Most nurses had received no educational preparation to care for patients with self‐harm; over 20% claimed that the department either had no practice guidelines for deliberate self‐harm or they did not know of their existence and one‐third who knew of them had not read them. Overall, nurses had sympathetic attitudes towards patients who self‐harm, including both professional and lay conceptualizations of deliberate self‐harm. They did not discriminate against this group of patients in their triage and care decisions. Conclusions. The findings of this exploratory study are important because attitudes can affect care decisions. Recommendations are made for improving the educational preparation of emergency department nurses, for improving awareness and implementation of practice guidelines, and for improving attitudes towards patients with deliberate self‐harm. Further research is needed to confirm these results.     

Factors influencing consistency of triage using the Australasian Triage Scale: Implications for guideline development

Objective: To examine the influence of the nurse, the type of patient presentation and the level of hospital service on consistency of triage using the Australasian Triage Scale. Methods: A secondary analysis of survey data was conducted. The main study was undertaken to measure the reliability of 237 scenarios for inclusion in a national training programme. Nurses were recruited from a quota sample of Australian ED according to peer group. Analysis was performed to determine concordance: the percentage of responses in the modal triage category. Analysis of variance (anova ) and Pearson correlations were used to investigate associations between the explanatory variables and concordance. Results: A total of 42/50 (84%) participants returned questionnaires, providing 9946 scenario responses for analysis. Significant differences in concordance were observed by variables describing the type of patient presentation and level of urgency. Mean scores for the comparison group (adult pain; 70.7%) were higher than the groups involving a mental health or pregnancy presentations (61.4%; P≤ 0.001; 65.0%; P= 0.02). Modal responses at the extreme ends of the scale were higher than in the middle categories (P≤ 0.001). There was a significant main effect on concordance by type of service according to peer group (P= 0.03). Of the nine variables that described nurse characteristics, age was the only factor to influence the outcome (P= 0.05). Conclusion: We identified significant problems with the consistency of triage for mental health and pregnancy presentations. Further research is needed to improve the guidelines on the implementation of the Australasian Triage Scale for these populations.