Hostname: page-component-76fb5796d-45l2p Total loading time: 0 Render date: 2024-04-25T21:06:08.768Z Has data issue: false hasContentIssue false

Reliability of the Canadian Triage and Acuity Scale: interrater and intrarater agreement from a community and an academic emergency department

Published online by Cambridge University Press:  04 March 2015

Christopher M.B. Fernandes*
Affiliation:
Division of Emergency Medicine, Schulich School of Medicine & Dentistry, Western University, and Department of Emergency Medicine, London Health Sciences Centre, London, ON
Shelley McLeod
Affiliation:
Division of Emergency Medicine, Schulich School of Medicine & Dentistry, Western University, and Department of Emergency Medicine, London Health Sciences Centre, London, ON
Joel Krause
Affiliation:
Division of Emergency Medicine, Schulich School of Medicine & Dentistry, Western University, and Department of Emergency Medicine, London Health Sciences Centre, London, ON
Amit Shah
Affiliation:
Division of Emergency Medicine, Schulich School of Medicine & Dentistry, Western University, and Department of Emergency Medicine, London Health Sciences Centre, London, ON Department of Emergency Medicine, St. Thomas Elgin General Hospital, St. Thomas, ON
Justine Jewell
Affiliation:
Division of Emergency Medicine, Schulich School of Medicine & Dentistry, Western University, and Department of Emergency Medicine, London Health Sciences Centre, London, ON
Barbara Smith
Affiliation:
Department of Emergency Medicine, St. Thomas Elgin General Hospital, St. Thomas, ON
Lorraine Rollins
Affiliation:
Department of Emergency Medicine, St. Thomas Elgin General Hospital, St. Thomas, ON
*
E1-120, Westminster Tower, 800 Commissioners Road East, London, ON N6A 5W9; christopher.fernandes@lhsc.on.ca

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.
Objectives:

The Canadian Triage and Acuity Scale (CTAS) is a five-level triage tool that is used to help prioritize the order in which emergency department (ED) patients should be seen. The objectives of this study were to determine the interrater and intrarater agreement of the 2008 CTAS guideline revisions by triage nurses and to compare agreement between triage nurses working in a small community ED and an academic ED.

Methods:

Seventy-eight triage nurses assigned CTAS scores and free-text presenting complaints for 10 paper-based case scenarios. For five scenarios, the CTAS score should have remained unchanged from previous guidelines, whereas the other five scenarios should have been triaged differently based on the 2008 CTAS first-order modifiers. Thirty-three participants repeated the questionnaire 90 days later, and intrarater agreement was measured.

Results:

There was a higher level of agreement (κ = 0.73; 95% CI 0.68–0.79) for the five case scenarios, which relied on the older 2004 guidelines compared to the scenarios where the 2008 guidelines would have suggested a different triage level (κ = 0.50; 95% CI 0.42–0.59). For the 10 case scenarios analyzed, the free-text presenting complaints matched the Canadian Emergency Department Information System (CEDIS) list 90.1% of the time (κ = 0.80; 95% CI 0.76–0.84).

Conclusion:

The reliability of CTAS scoring by academic and community ED nurses was relatively good; however, the application of the 2008 CTAS revisions appears less reliable than the 2004 CTAS guidelines. These results may be useful to develop educational materials to strengthen reliability and validity for triage scoring using the 2008 CTAS guideline revisions.

Type
Original Research • Recherche originale
Copyright
Copyright © Canadian Association of Emergency Physicians 2013

References

REFERENCES

1.Beveridge, R, Clarke, B, Janes, L, et al. Canadian Emergency Department Triage and Acuity Scale: implementation guidelines. CJEM 1999;1(3 Suppl):S1-24.Google Scholar
2.Asaro, P, Lewis, L. Effects of triage process conversion on the triage of high-risk presentations. Acad Emerg Med 2008;15: 916–22, doi:10.1111/j.1553-2712.2008.00236.x.Google Scholar
3.Elkum, N, Barrett, C, Al-Omran, H. Canadian Emergency Department Triage and Acuity Scale: implementation in a tertiary care center in Saudi Arabia. BMC Emerg Med 2011;11:3.Google Scholar
4.Jimenez, J, Murray, M, Beveridge, R, et al. Implementation of the Canadian Emergency Department Triage and Acuity Scale (CTAS) in the Principality of Andorra: can triage parameters serve as emergency department quality indicators? CJEM 2003;5:315–22.Google Scholar
5.Beveridge, R. The Canadian Triage and Acuity Scale: a new and critical element in health care reform. J Emerg Med 1998;16:507–11, doi:10.1016/S0736-4679(98)00031-6.Google Scholar
6.Murray, M, Bullard, M, Grafstein, E. Revisions to the Canadian Emergency Department Triage and Acuity Scale implementation guidelines. CJEM 2004;6:421–7.Google Scholar
7.Bullard, M, Unger, B, Spence, J, et al. Revisions to the Canadian Emergency Department Triage and Acuity Scale (CTAS) adult guidelines. CJEM 2008;10:136–42.CrossRefGoogle Scholar
8.Grafstein, E, Unger, B, Bullard, M, et al. Canadian Emergency Department Information System (CEDIS) presenting complaint list (version 1.0). CJEM 2003;5:2734.Google Scholar
9.Innes, G, Murray, M, Grafstein, E, et al. A consensus-based process to define standard national data elements for a Canadian emergency department information system. CJEM 2001;3:277–84.Google Scholar
10.Grafstein, E, Bullard, M, Warren, D, et al. Revision of the Canadian Emergency Department Information System (CEDIS) presenting complaint list version 1.1. CJEM 2008;10:151–61.Google Scholar
11.Landis, J, Koch, G. The measurement of observer agreement for categorical data. Biometrics 1977;33:159–74, doi:10.2307/2529310.Google Scholar
12.Beveridge, R, Ducharme, J, Janes, L, et al. Reliability of the Canadian Emergency Department Triage and Acuity Scale: interrater agreement. Ann Emerg Med 1999;34:155–9, doi:10.1016/S0196-0644(99)70223-4.CrossRefGoogle ScholarPubMed
13.Manos, D, Petrie, DA, Beveridge, RC, et al. Inter-observer agreement using the Canadian Emergency Department Triage and Acuity Scale. CJEM 2002;4:1622.Google Scholar
14.Worster, A, Gilboy, N, Fernandes, C, et al. Assessment of inter-observer reliability of two five-level triage and acuity scales: a randomized controlled trial. CJEM 2004;6:240–5.Google Scholar
15.Stenstrom, R, Grafstein, E, Innes, G, et al. Real-time predictive validitiy of the Canadian Triage and Acuity Scale (CTAS) [abstract]. Acad Emerg Med 2003;10:512, doi:10.1197/aemj.10.5.512.Google Scholar
16.Murray, MJ, Levis, G. Does triage level (Canadian Triage and Acuity Scale) correlate with resource utilization for emergency department visits? [abstract]. CJEM 2004;6:180.Google Scholar
17.Worster, A, Fernandes, CM, Eva, K, et al. Predictive validity comparison of two five-level triage acuity scales. Eur J Emerg Med 2007;14:188–92, doi:10.1097/MEJ.0b013e3280adc956.CrossRefGoogle ScholarPubMed
18.Fernandes, C, Tanabe, P, Gilboy, N, et al. Five-level triage: a report from the ACEP/ENA Five-Level Triage Task Force. J Emerg Nurs 2005;31:3950, doi:10.1016/j.jen.2004.11.002.Google Scholar
19.Fernandes, C, Wuerz, R, Clark, S, et al. How reliable is emergency department triage? Ann Emerg Med 1999;34:141–7, doi:10.1016/S0196-0644(99)70248-9.Google Scholar
20.Dong, S, Bullard, M, Meurer, D, et alThe effect of training on nurse agreement using an electronic triage system. CJEM 2007;9:260–6.Google Scholar
21.Worster, A, Sardo, A, Eva, K, et al. Triage tool inter-rater reliability: a comparison of live versus paper case scenarios. J Emerg Nurs 2007;33:319–23, doi:10.1016/j.jen.2006.12.016.Google Scholar