Endovascular Observational Teamwork Assessment Tool Evaluated

June 22, 2016—A multistage, multimethod study that sought to modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery was published by Louise Hull, et al in the European Journal of Vascular and Endovascular Surgery (EJVES. 2016;52:11–20).

As summarized in EVJES, stage 1 of the study included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool.

Stage 2 included identification of additional exemplar behaviors contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams).

Stage 3 included content validation of exemplar behaviors using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. 

Stage 4 included final team expert review of exemplars.

The investigators reported that OTAS core team behaviors were maintained, including communication, coordination, cooperation, and leadership team monitoring.

Of the 114 OTAS behavioral exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviors were identified. Content validation of these 153 exemplar behaviors showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety.

After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviors. Some concerns were noted about the time required to conduct observations and provide performance feedback.

Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams; additionally, Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures, concluded the investigators in EJVES.