Inter-rater reliability of the National Triage Scale over 11,500 simulated occasions of triage

Since its introduction in 1993, the National Triage Scale (NTS), a five-category scale based on the optimal time to medical intervention, has been introduced into most Australasian emergency departments as the basis of triage, clinical indicators and in some departments, casemix classification. The scale is a modification of the Ipswich Triage Scale (ITS), developed in 1989. This scale was shown in separate studies in Ipswich and Perth to be reliable and valid. The NTS however, although well validated, particularly with regard to resource use, workload and admission rates, has not been formally tested for inter-rater reliability. In this study the inter-rater reliability of the NTS was assessed in eight Western Australian hospital emergency departments, covering teaching, non-teaching, rural and private hospitals, using the same methodology and patient profiles as the original ITS study. One hundred and fifteen triage nurses in these hospitals triaged 100 written patient profiles using the NTS. Inter-rater reliability was acceptable. Of the 115 respondents, 95% were within one category of the modal response for all but four patient profiles and 86% were within one category for all patient profiles. Concurrence, or the percentage of responses in the modal category, was good. For 89% of the profiles, more than 50% of trieurs agreed with the modal response. The distribution of modal responses was not significantly affected by hospital type or triage nurse experience. The inter-rater reliability of the NTS overall was slightly better than for the ITS in 1989. Emergency physicians, hospital administrators and government authorities can be confident that this widely used scale is a reliable measure of urgency.     

Optimizing triage consistency in Australian emergency departments: The Emergency Triage Education Kit

Objective: The Emergency Triage Education Kit was designed to optimize consistency of triage using the Australasian Triage Scale. The present study was conducted to determine the interrater reliability of a set of scenarios for inclusion in the programme. Methods: A postal survey of 237 paper‐based triage scenarios was utilized. A quota sample of triage nurses (n = 42) rated each scenario using the Australasian Triage Scale. The scenarios were analysed for concordance and agreement. The criterion for inclusion of the scenarios in the programme was κ ≥ 0.6. Results: Data were collected during 2 April to 14 May 2007. Agreement for the set was κ = 0.412 (95% CI 0.410–0.415). Of the initial set: 92/237 (38.8%, 95% CI 32.6–45.3) showed concordance ≥70% to the modal triage category (κ = 0.632, 95% CI 0.629–0.636) and 155/237 (65.4%, 95% CI 59.3–71.5) showed concordance ≥60% to the modal triage category (κ = 0.507, 95% CI 0.504–0.510). Scenarios involving mental health and pregnancy presentations showed lower levels of agreement (κ = 0.243, 95% CI 0.237–0.249; κ = 0.319, 95% CI 0.310–0.328). Conclusion: All scenarios that showed good levels of agreement have been included in the Emergency Triage Education Kit and are recommended for testing purposes; those that showed moderate agreement have been incorporated for teaching purposes. Both scenario sets are accompanied by explanatory notes that link the decision outcome to the Australasian College for Emergency Medicine Guidelines on the Implementation of the Australasian Triage Scale. Future analysis of the scenarios is required to identify how task‐related factors influence consistency of triage.     

Which triage category patients die in hospital after being admitted through emergency departments? A study in one teaching hospital

Abstract Objectives: To quantify the number of deaths per triage category (scale 1–5, Australian National Triage Scale) occurring after admission to hospital via an emergency department and to examine the causes of death in each category. Setting: St Vincent's Hospital, Melbourne (Victoria, Australia) is an acute adult tertiary referral hospital. Methods: Electronic collection of all hospital admissions and their subsequent destination for the calendar year 1997, with chart and/or postmortem review to determine the cause of death. Results: The percentage of deaths per triage group decreased with urgency. Numerically, the largest group of all admissions and admissions followed by deaths consist of patients presenting in category 4 (semi-urgent). Conclusions: Triage categories may be a useful tool for prioritizing acute patients, but patients in low triage categories often have fatal illnesses. Performance measurements and workload assessments for emergency departments may need to involve category 4 patients to take account of this factor.     

Poor agreement in application of the Australasian Triage Scale to paediatric emergency department presentations

BACKGROUND: The Australasian Triage Scale (ATS) is used in Australian emergency departments (ED) to describe patient priority on arrival. This study aimed to determine the level of inter-rater consistency with which the scale is applied to paediatric presentations. Additionally, it sought to document the level of certainty with which nurses apply the scale. METHOD: An anonymous survey of emergency nurses responsible for paediatric triage decisions using written patient profiles. RESULTS: The level of agreement between nurses applying the ATS to paediatric presentations can be described as poor and appears lower than the consistency with which it is applied to adult presentations. CONCLUSION: Inconsistent allocation of ATS category implies variable patient waiting times, which may have detrimental effects on patient condition. Hence, efforts must be made to address the inconsistency that exists in paediatric triage decision-making.     

The Canadian Triage and Acuity Scale: A Canadian perspective on emergency department triage

The Canadian Triage and Acuity Scale has received widespread acceptance in Canada as a reliable and valid tool for emergency department triage. The importance of accurate triage becomes more apparent as emergency department volumes increase, and resources shrink. The need to ensure that those patients requiring more urgent care receive care first is the basis for all triage scales. Through the Canadian Triage and Acuity Scale National Working Group, the scale became the recommended triage tool for Canadian emergency departments. Work has been done on the interrater reliability of Canadian Triage and Acuity Scale among health care providers. There is a need to further assess the validity of the scale. This scale has now been applied in the out of hospital setting by paramedics and is being used in measurements of emergency physician workload. The future may see an electronic triage tool develop for emergency department use to reduce variability in its application. The Canadian Triage and Acuity Scale has become an integral component of Canadian emergency departments.     

Utility of the Emergency Severity Index by Accuracy of Interrater Agreement by Expert Triage Nurses in a Simulated Scenario in Japan: A Randomized Controlled Trial

ObjectiveThe Emergency Severity Index (ESI) is a highly reliable and valid triage scale that is widely used in emergency departments in not only English language regions but also other countries. The Japan Triage and Acuity Scale (JTAS) is frequently used for emergency patients, and the ESI has not been evaluated against the JTAS in Japan. This study aimed to examine the decision accuracy of the ESI for simulated clinical scenarios among nursing specialists in Japan compared with the JTAS.MethodA parallel group randomized trial was conducted. In total, 23 JTAS–trained triage nurses from 10 Japanese emergency departments were randomly assigned to the ESI or the JTAS group. Nurses independently assigned triage categories to 80 emergency cases for the assessment of interrater agreement.ResultsInterrater agreement between the expert and triage nurses was κ = 0.82 (excellent) in the ESI group and κ = 0.74 (substantial) in the JTAS group. In addition, interrater agreement by acuity was level 2 = 0.42 (moderate) in the ESI group and level 2 = 0.31 (fair) in the JTAS group. Interrater agreement for triage decisions was classified in a higher category in the ESI group than in the JTAS Scale group at level 2. Triage decisions based on the ESI in Japan maintained the same level of interrater agreement and sensitivity as those in other countries.ConclusionThese findings suggest that the ESI can be introduced in Japan, despite its different emergency medical background compared with other countries.     

Factors influencing consistency of triage using the Australasian Triage Scale: Implications for guideline development

Objective: To examine the influence of the nurse, the type of patient presentation and the level of hospital service on consistency of triage using the Australasian Triage Scale. Methods: A secondary analysis of survey data was conducted. The main study was undertaken to measure the reliability of 237 scenarios for inclusion in a national training programme. Nurses were recruited from a quota sample of Australian ED according to peer group. Analysis was performed to determine concordance: the percentage of responses in the modal triage category. Analysis of variance (anova ) and Pearson correlations were used to investigate associations between the explanatory variables and concordance. Results: A total of 42/50 (84%) participants returned questionnaires, providing 9946 scenario responses for analysis. Significant differences in concordance were observed by variables describing the type of patient presentation and level of urgency. Mean scores for the comparison group (adult pain; 70.7%) were higher than the groups involving a mental health or pregnancy presentations (61.4%; P≤ 0.001; 65.0%; P= 0.02). Modal responses at the extreme ends of the scale were higher than in the middle categories (P≤ 0.001). There was a significant main effect on concordance by type of service according to peer group (P= 0.03). Of the nine variables that described nurse characteristics, age was the only factor to influence the outcome (P= 0.05). Conclusion: We identified significant problems with the consistency of triage for mental health and pregnancy presentations. Further research is needed to improve the guidelines on the implementation of the Australasian Triage Scale for these populations.     

“SOAP”分诊法优化口腔急诊预检分诊管理实践

目的：通过运用“SOAP”分诊法,探讨口腔专科医院急诊科分诊模式与规范。方法：采用“SOAP”分诊法并结合澳大利亚预检系统、美国牙科协会（ADA）和美国口腔颌面外科协会（AAOMS）所定义的口腔急症进行分诊。结果：制定了口腔急诊预检分诊系统。结论：运用“S OA P”分诊法,提高了护士正确判断口腔急症的能力,为抢救赢得了时间,取得了患者和医生的满意,为完善口腔急诊患者服务开辟了一条新的途径,从而促进了口腔急诊护理水平的提高。     

Implementation and Refinement of the Emergency Severity Index

OBJECTIVES: To implement a new five-level emergency department (ED) triage algorithm, the Emergency Severity Index (ESI), into nursing practice, and validate the instrument with a population-based cohort using hospitalization and ED length of stay as outcome measures. METHODS: The five-level ESI algorithm was introduced to triage nurses at two university hospital EDs, and implemented into practice with reinforcement and change management strategies. Interrater reliability was assessed by a posttest and by a series of independent paired patient triage assignments, and a staff survey was performed. A cohort validation study of all adult patients registered during a one-month period immediately following implementation was performed. RESULTS: Eight thousand two hundred fifty-one ED patients were studied. Weighted kappa for reproducibility of triage assignments was 0.80 for the posttest (n = 62 nurses), and 0.73 for patient triages (n = 219). Hospitalization was 28% overall and was strongly associated with triage level, decreasing from 58/63 (92%) of patients in triage category 1, to 12/739 (2%) in triage category 5. Median lengths of stay were two hours shorter at either triage extreme (high and low acuity) than in intermediate categories. Outcomes followed a-priori predictions. Staff nurses rated the new program easier to use, and more useful as a triage instrument than previous three-level triage. They provided feedback, which resulted in significant revisions to the algorithm and educational materials. CONCLUSIONS: Triage nurses at these two hospitals successfully implemented the ESI algorithm and provided useful feedback for further refinement of the instrument. Emergency Severity Index triage reproducibly stratifies patients into five groups with distinct clinical outcomes.     

Clinical decisions using the National Triage Scale: how important is postgraduate education?

Triage is the formal nursing assessment of all patients who present to an Emergency Department (ED). The National Triage Scale (NTS) is used in most Australian EDs. Triage decision making involves the allocation of every patients presenting to an ED to one of the five NTS categories. The NTS directly relates a triage category to illness or injury severity and need for emergency care. Triage nurses' decisions not only have the potential to impact on the health outcomes of ED patients, they are also used, in part, to evaluate ED performance and allocate components of ED funding. This study was a correlational study that used survey methods. Triage decisions were classified as 'expected triage', 'overtriage' or 'undertriage' decisions. Participant's qualifications were allocated to five categories: 'nil'; 'emergency nursing'; 'critical care nursing'; 'midwifery'; and 'tertiary' qualifications. There was no correlation between triage decisions and length of experience in emergency nursing or triage. 'Expected triage' decisions were more common when the predicted triage category was Category 3 (P < 0.001) and 'overtriage' decisions were less common when the predicted triage category was Category 2 (P < 0.0010). The frequency of 'undertriage' decisions decreased significantly when the predicted triage category was Category 3 (P < 0.001) or Category 4 (P < 0.001). There was no correlation between triage decisions and qualifications in the 'nil', 'emergency nursing' or 'critical care nursing' categories. A midwifery qualification demonstrated a positive correlation with 'expected triage' decisions (P = 0.048) and a negative correlation with 'undertriage' decisions (P = 0.012). There was also a positive correlation between a tertiary qualification and 'expected triage' decisions (P = 0.012).     

Triage nurses’ decisions using the National Triage Scale for Australian emergency departments

The initiation of emergency care primarily depends on the decisions made by the triage nurse. Triage decisions can therefore have a profound effect on the health outcomes of patients who present for emergency care. If the National Triage Scale (NTS) was effective in providing a standardized approach to triage, a patient with a specific problem should be allocated to the same triage category, irrespective of the institution to which they present or the personnel performing the role of triage. This study examines triage nurses' level of agreement in their allocation of triage categories to patients with specific presenting problems using the NTS. Relationships between demographic characteristics of participants and triage decisions are examined and implications of any variation for triage practice and patient outcomes are explored.     

我国二级及以上医院急诊分诊依据现状调查

目的调查国内急诊分诊执行情况及分诊依据的现状。方法采用自制调查问卷,对国内113所医院的274名急诊科护士进行急诊分诊执行情况及分诊依据现状的调查。结果目前急诊分诊护士要求不统一,急诊分诊标准存在不足,急诊分诊护士现有培训不能满足临床需要。结论我国在急诊分诊护士培养和急诊分诊标准的建立等方面尚不完善,建立统一规范的分诊标准和专职分诊护士将成为急诊分诊发展的趋势。     

Inpatient mortality as related to triage category in three New South Wales regional base hospitals

Objective: To establish the incidence of death after admission via the ED for each of the five categories of the Australasian Triage Scale in three New South Wales base hospitals, and to compare this with published data from an adult tertiary referral hospital in Victoria. To examine the causes of death in each category. Methods: Information was collected from databases established as part of quality assurance projects at three New South Wales rural base hospitals from 1 January 2000 to 31 December 2000. Results: Overall mortality rates per ED presentation and per ED admission were significantly lower than for similar data from an adult tertiary referral hospital. There were significant differences in mortality per ED presentation for categories 2, 3 and 4 and significant differences in mortality per admission for Australasian Triage Scale categories 2 and 3. The commonest causes of death were acute cardiac/respiratory and malignancy related conditions. Triage category 3 had both the highest number of total admissions and the highest number of deaths post admission. This finding differs from published data from an adult tertiary referral hospital where category 4 represented the largest number of admissions and of in‐hospital deaths following admission. Conclusion: This study has established the mortality rates per ED presentation and admission for each of the five categories of the Australasian Triage Scale in three New South Wales rural base hospitals. Significant differences were found between these rates and the published rates for an adult tertiary referral hospital.     

Measuring the effectiveness of the national Mental Health Triage Scale in an emergency department

ABSTRACT:   The mainstreaming process has significantly altered the means of access to mental health services in Australia. Increasingly people seeking mental health care present at general hospital emergency departments. The triage system, which has proven effective for prioritizing physical illness and injury, has proven problematic when applied to mental health-related problems. This paper presents the results of a study undertaken in the emergency department of a Victorian public hospital. The Mental Health Triage Scale was introduced and used independently by triage nurses and the psychiatric nurse consultants employed in the department. Following a 3-month period, the two sets of triage scores for psychiatric presentations ( n =  137) were compared. The findings suggest that triage nurses are rating clients experiencing mental health problems as in more urgent need of care than their psychiatric nursing counterparts. This suggests that the introduction of the guidelines alone is insufficient, and that education is required for more effective use of the tool.     

Emergency nurses’ knowledge and experience with the triage process in Hunan Province,China

IntroductionTriage is implemented to facilitate timely and appropriate treatment of patients, and is typically conducted by senior nurses. Triage accuracy and consistency across emergency departments remain a problem in mainland China. This study aimed to investigate the current status of triage practice and knowledge among emergency nurses in Changsha, Hunan Province, China.MethodA sample of 300 emergency nurses was selected from 13 tertiary hospitals in Changsha and a total of 193 completed surveys were returned (response rate = 64.3%). Surveys were circulated to head nurses, who then distributed them to nurses who met the selection criteria. Nurses were asked to complete the surveys and return them via dedicated survey return boxes that were placed in discreet locations to ensure anonymity.ResultsJust over half (50.8%) of participants reported receiving dedicated triage training, which was provided by their employer (38.6%), an education organisation (30.7%) or at a conference (26.1%). Approximately half (53.2%) reported using formal triage scales, which were predominantly 4-tier (43%) or 5-tier (34%).ConclusionsThe findings highlight variability in triage practices and training of emergency nurses in Changsha. This has implications for the comparability of triage data and transferability of triage skills across hospitals.     

Effectiveness of a 6-week online course in the Canadian Triage and Acuity Scale for emergency nurses.

INTRODUCTION: There is increasing interest in 5-level triage systems in emergency departments; however, the adoption of a new system places heavy training demands on ED department nurses and physicians. One emerging training option is online learning. The purpose of this study was to explore the effectiveness of an online course in the 5-level Canadian Triage and Acuity Scale (CTAS) on the clinical practice of the triage nurse. METHODS: Interviews were held with 23 emergency nurses from across Canada. A chart audit of triage codes from 367 charts from 6 hospitals was conducted. RESULTS: The most consistent finding was that the majority of RN staff enjoyed the online course and believed it had improved their triage practice. Nurses believed that their patient assessments were more thorough, accurate, and consistent throughout the department. Improved communication between staff and with patients and families was identified. Nurses reported using what they learned to improve triage assessment. Triage accuracy was high; the overall agreement between CTAS graduates and the chart auditor/expert within one CTAS level was 99.7%. Nurses also identified a number of organizational barriers to CTAS implementation after the course. DISCUSSION: The online format appears to be an effective, efficient, and convenient way to educate large numbers of ED staff in CTAS. Further research is needed regarding the use of multimedia and computer online chat options to further enhance the online learning experience for nurses.     

Decision making by emergency nurses in triage assessments

Triage assessment of patients on arrival at emergency departments involves complex decision making, resulting in categories being assigned to prioritize patients' needs for attention. The actual process of triage decision making has received limited attention. The aims of this study were to describe aspects of the triage decision-making process used by both more and less experienced nurses (n = 20) and to test the effect of uncertainty in the triage situation on the use of probability judgements (heuristics). Six triage cases based on actual triage situations were simulated to subjects, and their verbal protocols were collected. Protocols were transcribed and analysed. Main findings were: in conditions of higher uncertainty in triage situations all nurses used more probability in their judgements (t-test -2.37, df = 17, P = 0.03) with the heuristic of representativeness being relied on the most. The triage categories finally assigned for each triage situation showed no agreement on a specific triage category for each triage case and past triage experiences were used in decision making. The more experienced group reported higher estimations of correctness regarding the final category assigned, used more single previously experienced cases from memory, collected less data and made more judgements than the less experienced group. Further examination of the decision-making process of triage assessment should occur with attention to the variable use of triage categories, the role of past triage experiences in making judgements and development of triage decision rules for skilling nurses for triage.