Situation awareness (SA) refers to the conscious awareness of the current situation in relation to one’s environment. In nursing, loss or failure to achieve high levels of SA is linked with adverse patient outcomes. The purpose of this integrative review is to examine various instruments and techniques used to measure SA among nurses across academic and clinical settings. Computerized database and ancestry search strategies resulted in 40 empirical research reports. Of the reports included in the review, 24 measured SA among teams that included nurses and 16 measured SA solely in nurses. Methods used to evaluate SA included direct and indirect methods. Direct methods included the Situation Awareness Global Assessment Technique and questionnaires. Indirect methods included observer rating instruments and performance outcome measures. To have a better understanding of how nurses’ make decisions in complex work environments, reliable and valid measures of SA is crucial.
AndelC.DavidowS. L.HollanderM.MorenoD. A. (2012). The economics of health care quality and medical errors. Journal of Health Care Finance, 39, 39-50.
3.
AroraS.CoxC.DaviesS.KassabE.MahoneyP.SharmaE.. . . SevdalisN. (2014). Towards, the next frontier for simulation-based training. Annals of Surgery, 260, 252-258. doi:10.1097/SLA.0000000000000305
4.
BallangrudR.PerseniusM.HedelinB.Hall-LordM. L. (2014). Exploring intensive care nurses’ team performance in a simulation-based emergency situation, - expert raters’ assessments versus self-assessments: An explorative study. BMC Nursing, 13(1), 47. doi:10.1186/s12912-014-0047-5
5.
BednyG.MeisterD. (1999). Theory of activity and situation awareness. International Journal of Cognitive Ergonomics, 3, 63-72. doi:10.1207/s15327566ijce0301_5
6.
BogossianF.CooperS.CantR.BeauchampA.PorterJ.KainV.. . . PhillipsN. (2014). Undergraduate nursing students’ performance in recognising and responding to sudden patient deterioration in high psychological fidelity environments: An Australian multi-centre study. Nurse Education Today, 34, 691-696. doi:10.1016/j.nedt.2013.09.015
7.
BriggsA.RajaA. S.JoyceM. F.YuleS. J.JiangW.LipsitzS. R.HavensJ. M. (2015). The role of nontechnical skills in simulated trauma resuscitation. Journal of Surgical Education, 72, 732-739. doi:10.1016/j.jsurg.2015.01.020
BurnsC. M.SkraaningG.JamiesonG. A.LauN.KwokJ.WelchR.AndresenG. (2008). Evaluation of ecological interface design for nuclear process control: Situation awareness effects. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50, 663-679. doi:10.1518/001872008X312305
10.
CatchpoleK.MishraA.HandaA.McCullochP. (2008). Teamwork and error in the operating room: Analysis of skills and roles. Annals of Surgery, 247, 699-706. doi:10.1097/SLA.0b013e3181642ec8
11.
ChassinM. R.LoebJ. M. (2013). High-reliability health care: Getting there from here. The Milbank Quarterly, 91, 459-490.
12.
CooperC. L. (2005). An overview of the integrative research review. Progress in Transplantation, 15, 8-13. doi:10.7182/prtr.15.1.0n13660r26g725kj
13.
CooperS.BulleB.BiroM. A.JonesJ.MilesM.GilmourC.. . . EndacottR. (2012). Managing women with acute physiological deterioration: Student midwives performance in a stimulated setting. Women and Birth, 25(3), e27-e36. doi:10.1016/j.wombi. 2011. 08.00
14.
CooperS.CantR.PorterJ.MissenK.SparkesL.McConnell-HenryT.EndacottR. (2013). Managing patient deterioration: Assessing teamwork and individual performance. Emergency Medicine Journal, 30, 377-381. doi:10.1136/emermed-2012-201312
15.
CooperS.KinsmanL.BuykxP.McConnell-HenryT.EndacottR.ScholesJ. (2010). Managing the deteriorating patient in a simulated environment: Nursing students’ knowledge, skill, and situation awareness. Journal of Clinical Nursing, 19, 2309-2318. doi:10.1111/j.1365-2702.2009.03164.x
16.
CooperS.McConnell-HenryT.CantR.PorterJ.MissenK.KinsmanL.. . . ScholesJ. (2011). Managing deteriorating patients: Registered nurses’ performance in a simulated setting. The Open Nursing Journal, 5, 120-126. doi:10.2174/18744346011050100120
17.
CooperS.PorterJ.PeachL. (2013). Measuring situation awareness in emergency settings: A systematic review of tools and outcomes. Open Access Emergency Medicine, 6, 1-7. doi:10.2147/OAEM.S53679
18.
CornellP.Townsend-GervisM.VardamanJ. M.YatesL. (2014). Improving situation awareness and patient outcomes through interdisciplinary rounding and structured communication. The Journal of Nursing Administration, 44, 164-169. doi:10.1097/NNA.0000000000000045
19.
CrozierM. S.TingH. Y.BooneD. C.O’ReganN. B.BandraukN.FureyA.. . . HoganM. P. (2015). Use of human patient simulation and validation of the Team Situation Awareness Global Assessment Technique (TSAGAT): A multidisciplinary team assessment tool in trauma education. Journal of Surgical Education, 72, 156-163. doi:10.1016/j.jsurg.2014.07.009
20.
DesboroughJ.ForrestL.ParkerR. (2011). Nurse-led primary healthcare walk-in centres: An integrative literature review. Journal of Advanced Nursing, 68, 245-263. doi:10.1111/j.1365-2648.2011.05798.x
21.
DursoF. T.HackworthC. A.TruittT. R.CrutchfieldJ.NikolicD.ManningC. A. (1998). Situation awareness as a predictor of performance for en route air traffic controllers. Air Traffic Control Quarterly, 6(1), 1-20. doi:10.1177/0018720814545515
22.
EbrightP. R.PattersonE. S.ChalkoB. A.RenderM. L. (2003). Understanding the complexity of registered nurse work in acute care settings. Journal of Nursing Administration, 33, 630-638. doi:10.1097/00005110-200312000-00004
23.
EndsleyM. R. (1995a). Measurement of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 65-84. doi:10.1518/001872095779049499
24.
EndsleyM. R. (1995b). Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 32-64. doi:10.1518/001872095779049543
25.
EndsleyM. R. (2000a). Direct measurement of situation awareness: Validity and use of SAGAT. In EndsleyM. R.GarlandD. J. (Eds.), Situation awareness analysis and measurement (pp. 147-173). Mahwah, NJ: Lawrence Erlbaum.
26.
EndsleyM. R. (2000b). Theoretical underpinnings of situation awareness: A critical review. In EndsleyM. R.GarlandD. J. (Eds.), Situation awareness analysis and measurement (pp. 3-32). Mahwah, NJ: Lawrence Erlbaum.
27.
EndsleyM. R. (2015). Situation awareness misconceptions and misunderstandings. Journal of Cognitive Engineering and Decision Making, 9(1), 4-32. doi:10.1177/1555343415572631
28.
EndsleyM. R.BolstadC. A. (1994). Individual differences in pilot situation awareness. International Journal of Aviation Psychology, 4, 241-264. doi:10.1207/s15327108ijap0403_3
29.
EndsleyM. R.JonesD. G. (2004). Designing for situation awareness: An approach to user-centered design (2nd ed.). Boca Raton, FL: CRRC Press.
30.
EndsleyM. R.KirisE. O. (1995). The out-of-the-loop performance problem and level of control in automation. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 381-394. doi:10.1518/001872095779064555
31.
EndsleyM. R.RobertsonM. M. (2000). Training for situation awareness in individuals and teams. In EndsleyM. R.GarlandD. J. (Eds.), Situation awareness analysis and measurement (pp. 349-366). Mahwah, NJ: Lawrence Erlbaum.
FedericoP. (1995). Expert and novice recognition of similar situations. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 105-122. doi:10.1518/001872095779049471
34.
FletcherG.McGeorgeP.FlinR.GlavinR.MaranN. (2002). The role of non-technical skills in anaesthesia: A review of current literature. British Journal of Anaesthesia, 88, 418-429. doi:10.1093/bja/88.3.418
35.
FlinR.MaranN. (2015). Basic concepts for crew resource management and non-technical skills. Best Practice & Research Clinical Anaesthesiology, 29, 27-39. doi:10.1016/j.bpa.2015.02.002
36.
FlinR.MartinL. (2001). Behavioral markers for crew resource management: A review of current practice. The International Journal of Aviation Psychology, 11, 95-118. doi:10.1207/S15327108IJAP1101_6
37.
ForeA. M.SculliG. L. (2013). A concept analysis of situational awareness in nursing. Journal of Advanced Nursing, 69, 2613-2621. doi:10.1111/jan.12130
38.
GuerlainS.AdamsR.TurrentineB.SkinT.GuoH.CollinsS. R.CallandJ. F. (2005). Assessing team performance in the operating room: Development and use of a “Black-Box” recorder and other tools for the intraoperative environment. Intraoperative Assessment Tools, 200(1), 29-37. doi:10.1016/j.jamcollsurg.2004.08.029
39.
GundrosenS.SolligardE.AadahlP. (2014). Team competence among nurses in an intensive care unit: The feasibility of in situ simulation and assessing non-technical skills. Intensive and Critical Care Nursing, 30, 312-317. doi:10.1016/j.iccn.2014.06.007
40.
HigginsJ. P. T.GreenS. (2011). Cochrane handbook for systematic reviews of interventions (Version 5.1.0). Available from http://handbook.cochrane.org
41.
HudsonK.TaylorL. A.KozachikS. L.ShaeferS. J.WilsonM. L. (2015). Second Life simulation as a strategy to enhance decision-making in diabetes care: A case study. Journal of Clinical Nursing, 24, 797-804. doi:10.1111/jocn.12709
42.
Institute of Medicine. (1999). To err is human: Building a safer health system. Washington, DC: National Academy of Sciences.
43.
JamesJ. T. (2013). A new, evidence-based estimate of patient harms associated with hospital care. Journal of Patient Safety, 9, 122-128. doi:10.1097/PTS.0b013e3182948a69
44.
JankouskasT. S.HaidetK. K.HupceyJ.KolanowskiA.MurrayW. B. (2011). Targeted crisis resource management training improves performance among randomized nursing and medical students. Simulation in Healthcare, 6, 316-326. doi:10.1097/SIH. 0b013e31822bc676
45.
KangE.MasseyD.GillespieB. M. (2015). Factors that influence the non-technical skills performance of scrub nurses: A prospective study. Journal of Advanced Nursing, 71, 2846-2857. doi:10.1111/jan.12743
46.
KemperP. F.de BruijneM.van DyckC.SoR. L.TangkauP.WagnerC. (2016). Crew resource management training in the intensive care unit: A multisite controlled before-after study. BMJ Quality & Safety, 25, 577-587. doi:10.1136/bmjqs-2015-003994
47.
KimJ.NeilipovitzD.CardinalP.ClinchJ. (2006). A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Critical Care Medicine, 34, 2167-2174. doi:10.1097/01.CCM.0000229877.45125.CC
48.
KimberlinC. L.WintersteinA. G. (2008). Validity and reliability of measurement instruments used in research. American Journal of Health-System Pharmacy, 65, 2276-2284. doi:10.2146/ajhp070364
49.
KochS. H.WeirC.WestenskowD.GondanM.AgutterJ.HaarM.. . . StaggersN. (2013). Evaluation of the effect of information integration in displays for ICU nurses on situation awareness and task completion time: A prospective randomized controlled study. International Journal of Medical Informatics, 82, 665-675. doi:10.1016/j. ijmedinf.2012.10.002
50.
KohR. Y. I.ParkT.WickensC. D. (2014). An investigation of differing levels of experience and indices of task management in relation to scrub nurses’ performance in the operating theatre: Analysis of video-taped caesarean section surgeries. International Journal of Nursing Studies, 51, 1230-1240. doi:10.1016/j.ijnurstu.2014.01.005
51.
LavoieP.CossetteS.PepinJ. (2016). Testing nursing students’ clinical judgment in a patient deterioration simulation scenario: Development of a situation awareness instrument. Nurse Education Today, 38, 61-67. doi:10.1016/j.nedt.2015.12.015
52.
MakaryM.DanielM. (2016). Medical error—The third leading cause of death in the US. British Medical Journal, 353, i2139. doi:10.1136/bmj.i2139
53.
McCarleyJ. S.WickensC. D.GohJ.HorreyW. J. (2002). A computational model of attention/situation awareness. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 46, 1669-1673. doi:10.1177/154193120204601730
54.
McCullochP.MishraA.HandaA.DaleT.HirstG.CatchpoleK. (2009). The effects of aviation-style nontechnical skills training on technical performance and outcome in the operating theatre. Quality & Safety in Health Care, 18, 109-115. doi:10.1136/qshc. 2008.032045
55.
MillerK.RileyW.DavisS. (2009). Identifying key nursing and team behaviours to achieve high reliability. Journal of Nursing Management, 17, 247-255. doi:10.1111/j.1365-2834.2009.00978.x
56.
MishraA.CatchpoleK.DaleT.McCullochP. (2008). The influence of non-technical performance on technical outcome in laparoscopic cholecystectomy. Surgical Endoscopy, 22, 68-73. doi:10.1007/s00464-007-9346-1
57.
MishraA.CatchpoleK.McCullochP. (2009). The Oxford NOTECHS System: Reliability and validity of a tool for measuring teamwork behaviour in the operating theatre. Quality & Safety in Health Care, 18, 104-108. doi:10.1136/qshc.2007.024760
58.
MitchellL.FlinR.YuleS.MitchellJ.CouttsK.YoungsonG. (2012). Evaluation of the scrub practitioner’s list of intraoperative non-technical skills (SPLINTS) system. International Journal of Nursing Studies, 49, 201-211. doi:10.1016/j.ijnurstu.2011.08.012
59.
MorganL.HadiM.PickeringS.RobertsonE.GriffinD.CollinsG.. . . NewS. (2015). The effect of teamwork training on team performance and clinical outcome in elective orthopaedic surgery: A controlled interrupted time series study. BMJ Open, 5(4), e006216. doi:10.1136/bmjopen-2014-006216
60.
MorganP. J.TregunnoD.BrydgesR.PittiniR.TarshisJ.KurrekM.. . . RyzynskiA. (2015). Using a situational awareness global assessment technique for interprofessional obstetrical team training with high fidelity simulation. Journal of Interprofessional Care, 29, 13-19. doi:10.3109/13561820.2014.936371
61.
MorganP. J.TregunnoD.PittiniR.TarshisJ.RegehrG.DesousaS.. . . MilneK. (2012). Determination of the psychometrics properties of a behavioural marking system for obstetrical team training using high-fidelity simulation. BMJ Quality and Safety, 21, 78-82. doi:10.1136/bmjqs-2011-000296
62.
MullanP.MaciasC. G.HsuD.AlamS.PatelB. (2015). A novel briefing checklist at shift handoff in an emergency department improves situation awareness and safety event identification. Pediatric Emergency Care, 31, 231-238. doi:10.1097/PEC. 0000000000000194
63.
MunroeB.CurtisK.MurphyM.StrachanL.ConsidineJ.HardyJ.. . . BuckleyT. (2016). A structured framework improves clinical patient assessment and nontechnical skills of early career emergency nurses: A pre-post study using full immersion simulation. Journal of Clinical Nursing, 25, 2262-2275. doi:10.1111/jocn.13284
64.
O’HareD. (1997). Cognitive ability determinants of elite pilot performance. Human Factors: The Journal of the Human Factors and Ergonomics Society, 39, 540-552. doi:10.1518/001872097778668004
65.
O’MearaP.MunroG.WilliamsB.CooperS.BogossianF.RossL.. . . McClounanM. (2015). Developing situation awareness amongst nursing and paramedicine students utilizing eye tracking technology and video debriefing techniques: A proof of concept paper. International Emergency Nursing, 23, 94-99. doi:10.1016/j.ienj.2014.11.001
66.
PattersonE. S.EbrightP. R.SaleemJ. J. (2011). Investigating stacking: How do registered nurses prioritize their activities in real-time?International Journal of Industrial Ergonomics, 41, 389-393. doi:10.1016/j.ergon.2011.01.012
67.
PattersonM. D.BlikeG. T.NadkarniV. M. (2008). In situ simulation: Challenges and results. In HenriksenK.BattlesJ. B.KeyesM. A.GradyM. L. (Eds.), New directions and alternative approaches (pp. 1-18). Rockville, MD: Agency for Healthcare Research and Quality.
68.
PhitayakornR.MinehartR. D.HemingwayM. W.Pian-SmithM. C.PetrusaE. (2015). The relationship between intraoperative teamwork and management skills in patient care. Surgery, 158, 1434-1440. doi:10.1016/j.surg.2015.03.031
69.
PotterP.WolfL.BoxermanS.GraysonD.SledgeJ.DunaganC.EvanoffB. (2005). Understanding the cognitive work of nursing in the acute care environment. Journal of Nursing Administration, 35, 327-335. doi:10.1097/00005110-200507000-00004
70.
RandelJ. M.PughH. L.ReedS. K. (1996). Differences in expert and novice situation awareness in naturalistic decision making. International Journal of Human-Computer Studies, 45, 579-597. doi:10.1006/ijhc.1996.0068
71.
ReaderT. W.FlinR.MearnsK.CuthbertsonB. (2011). Team situation awareness and the anticipation of patient progress during ICU rounds. BMJ Quality & Safety, 20, 1035-1042. doi:10.1136/bmjqs.2010.048561
72.
RobertsonE. R.HadiM.MorganL. J.PickeringS. P.CollinsG.NewS.. . . CatchpoleK. C. (2014). Oxford NOTECHS II: A modified theatre team non-technical skills scoring system. PLoS ONE, 9, e90320. doi:10.1371/journal.pone.0090320
73.
RothschildJ. M.HurleyA. C.LandriganC. P.CroninJ. W.Martell-WaldropK.FoskettC.. . . BatesD. W. (2006). Recovering from medical errors: The critical care nursing safety net. Joint Commission Journal on Quality and Patient Safety, 32(2), 63-72.
74.
RutherfordJ. S.FlinR.IrwinA.McFadyenA. K. (2015). Evaluation of the prototype anaesthetic non-technical skills for anaesthetic practitioner (ANTS-AP) system: A behavioral rating system to assess the non-technical skills used by staff assisting the anaesthetist. Anaesthesia, 70, 907-914. doi:10.1111/anae.13127
75.
RutherfordJ. S.FlinR.MitchellL. (2012). Non-technical skills of anaesthetic assistants in the perioperative period: A literature review. British Journal of Anaesthesia, 109, 27-31. doi:10.1093/bja/aes125
76.
SchmidA.HoffmanL.HappM. B.WolfG. A.DeVitaM. (2007). Failure to rescue: A literature review. Journal of Nursing Administration, 37, 188-198. doi:10.1097/01.NNA.0000266838.23814.65
77.
SchulzC. M.KrautheimV.HackemannA.KreuzerM.KochsE. F.WagnerK. J. (2016). Situation awareness errors in anesthesia and critical care in 200 cases of a critical incident reporting system. BMC Anesthesiology, 16, 4. doi:10.1186/s12871-016-0172-7
78.
SculliG. L.ForeA. M.NeilyJ.MillsP. D.SineD. M. (2011). The case for training Veterans Administration frontline nurses in crew resource management. Journal of Nursing Administration, 41, 524-530. doi:10.1097/NNA.0b013e3182378b93
79.
SevdalisN.DavisR.KoutantjiM.UndreS.DarziA.VincentC. A. (2008). Reliability of a revised NOTECHS scale for use in surgical teams. The American Journal of Surgery, 196, 184-190. doi:10.1016/j.amjsurg.2007.08.070
80.
SheverL. L. (2011). The impact of nursing surveillance on failure to rescue. Research and Theory for Nursing Practice: An International Journal, 25, 107-126. doi:10.1891/1541-6577.25.2.107
81.
ShresthaL. B.PrinceC.BakerD.SalasE. (1995). Understanding situation awareness: Concepts, methods, and training. In RouseW. B. (Ed.), Human/technology interactions in complex systems (pp. 45-85). Greenwich, CT: JAI Press.
82.
SitterdingM. C.BroomeM. E.EverettL. Q.EbrightP. (2012). Understanding situation awareness in nursing work: A hybrid concept analysis. Advances in Nursing Science, 35, 77-92. doi:10.1097/ans.0b013e3182450158
83.
SmithK.HancockP. A. (1995). Situation awareness is adaptive, externally directed consciousness. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 137-148. doi:10.1518/001872095779049444
84.
StantonN. A.ChambersP. R. G.PiggottJ. (2001). Situational awareness and safety. Safety Science, 39, 189-204. doi:10.1016/S0925-7535(01)00010-8
85.
SteinemannS.BergB.SkinnerA.DiTulioA.AnzelonK.TeradaK.. . . SpeckC. (2011). In situ, multidisciplinary, simulation-based teamwork training improves early trauma care. Journal of Surgical Education, 68, 472-477. doi:10.1016/j.jsurg.2011.05.009
86.
StubbingsL.ChaboyerW.McMurrayA. (2012). Nurses’ use of situation awareness in decision-making: An integrative review. Journal of Advanced Nursing, 68, 1443-1453. doi:10.1111/j.1365-2648.2012.05989.x
87.
SullivanG. M. (2011). A primer on the validity of assessment instruments. Journal of Graduate Medical Education, 3, 119-120. doi:10.4300/JGME-D-11-00075.1
88.
ThielenJ. (2014). Failure to rescue as the conceptual basis for nursing clinical peer review. Journal of Nursing Care Quality, 29, 155-163. doi:10.1097/NCQ.0b013e3182a8df96
89.
ThompsonC.DalgleishL.BucknallT.EstabrooksC.HutchinsonA. M.FraserK.. . . SaundersJ. (2008). The effects of time pressure and experience on nurses’ risk assessment decisions: A signal detection analysis. Nursing Research, 57, 302-311. doi:10.1097/01.NNR.0000338612.31210.ca
90.
UndreS.KoutantjiM.SevdalisN.GautamaS.SelvapattN.WilliamsS.. . . VincentC. (2007). Multidisciplinary crisis simulations: The way forward for training surgical teams. World Journal of Surgery, 31, 1843-1853. doi:10.1007/s00268-007-9128-x
91.
WhittemoreR.KnaflK. (2005). The integrative review: Updated methodology. Journal of Advanced Nursing, 52, 546-553. doi:10.1111/j.1365-2648.2005.03621.x
92.
WickensC. D. (2008). Situation awareness: Review of Mica Endsley’s 1995 articles on situation awareness theory and measurement. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50, 397-403. doi:10.1518/001872008x288420
93.
WrightM. C.TaekmanJ. M.EndsleyM. R. (2004). Objective measures of situation awareness in a simulated medical environment. Quality & Safety in Health Care, 13(Suppl. 1), i65-i71. doi:10.1136/qhc.13.suppl_1.i65
WunderL. L. (2016). Effect of a nontechnical skills intervention on first-year student registered nurse anesthetists’ skills during crisis simulation. AANA Journal, 84, 46-61.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
