Understanding Coordination When Summarizing Surgical Videos: Ad-Hoc Strategies and Missing Protocols

People involved

Ignacio Avellino, Sorbonne Université
Sheida Nozari, Sorbonne Université
Geoffroy Canlorbe, Hôpital Pitié Salpêtrière & Sorbonne Université
Yvonne Jansen, Sorbonne Université


While surgical videos are valuable support material for activities around surgery, their summarization demands great amounts of time from surgeons, resulting in the production of very few videos. We study the practices involving surgical video to motivate and inform the future design of tools for their summarization. Through interviews and observations in a field study, we find that (1) video summaries provide an important support for surgery, being used for self-improvement, education, discussing cases, scientific research, patient communication and as legal resources; (2) video summarization follows a process hindered by the loss of knowledge that originates during recording; and, (3) surgeons develop ad-hoc coordination strategies which involve using the video itself for articulation work, making it both the field of work and coordination artifact. We discuss ways in which tools can facilitate capturing knowledge during live action using these strategies.


Project description

Surgeons record, summarize and use videos, a practice that remains understudied, perhaps because of its secondary purpose. Our goals are to gain understanding of the practices surrounding video and to understand the coordination strategies during the summarization process. Ultimately, we aim at proposing mechanisms for supporting articulation work when summarizing videos, increasing the efficiency of the process and realizing the potential of this practice by increasing the amount of produced video summaries.


Main Findings

1. The Importance of Video Summaries: Multifarious Uses

Summarized surgical videos have different uses.

  1. Personal: Self-Improvement
  2. Education: Teaching Residents
  3. Professional: Discussing Cases
  4. Scientific: Conferences and Studies
  5. Public: Information and Communication
  6. Legal: Litigation

The most notable uses are for personal, educational and scientific purposes. However, current video-editing tools are inefficient for summarizing surgical videos, and surgeons would increasing the use of summarized videos if they had more efficient and faster tools at their disposal.

2. The Summarization of Surgical Videos

Summarizing surgical videos is a complex multi-step process, it involves watching the video several times, and iteratively removing frames until obtaining a summary of the desired length. Although summarization strategies are personal, we observed that there were common strategies across participants.

  1. Overviewing
  2. Cleaning
  3. Coarse Sequencing
  4. Fine Sequencing
  5. Contracting


We find that digital tools impose a working paradigm, as participants adopted a strategy consisting of removing sequences and frames with the goal of keeping only what they consider most relevant, like in the next figure.

The summarization process is hindered by the fact that knowledge is lost from the live action to the summarization step. As a result, surgeons need to watch the entire video and recreate this information to identify the important moments. We identify that surgeons would like to record Key Moments during surgery for later use during summarization. These Key Moments can refer to 1) Surgical Steps, 2) Patient Anatomy, 3) Particular Surgical Gestures, and, 4) Unexpected or Critical Moments.

3. The Collaborative Nature of Summarization: Ad-Hoc Coordination

Surgeons perform video summarization with colleagues for efficiency reasons. To collaboratively summarize videos, surgeons do not rely on functionalities in video-editing tools, simply because these tools do not provide any, they are not designed to support collaboration. They developed instead ad-hoc strategies to reify information used as articulation work when handing off a partially-done summarization to another surgeon. We observe three strategies in particular.

  1. Strategy 1: Segmenting the Live Recording
  2. Strategy 2: Capturing Moments on External Media
  3. Strategy 3: Engraving Marks on a Partial Video Summary

There are two implications of the collaborative nature of summarization. First, coordination happens across two stages disjoint in their temporality and aim: a data-generation stage during a domain-specific activity, and later a data-processing stage during a non domain-specific activity (summarization). We are particularly focused here on supporting in the future the transferring of information that supports articulation work from one stage to the next as a component of this trajectory. Second, our study shows a particular case for the conceptualization of coordinating artifacts in CSCW where the coordination artifact is the common field object. This inseparability is a consequence of the lack of tools to deal with it, resulting in a protocol with implicit conventions and unprescribed procedures, contrary to the classic notion of coordination artifacts.