Autonomous Surgical Phase Detection from Video and Instrument Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer-assisted surgical systems lack the capability to autonomously identify and analyze phases of a surgical procedure based on video streams and instrument usage, limiting their ability to provide real-time surgical guidance and post-surgical analysis.

Innovation Solution

A system comprising processors and memory devices that analyze video streams and electrical energy data from surgical instruments to autonomously determine surgical phases and display usage charts, allowing for real-time interaction and playback of surgical procedures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If computer-assisted surgical systems use traditional manual tracking and recording methods, then system complexity is reduced, but the capability to autonomously identify and analyze surgical phases is lost

Engineering Contradiction:
Improveautonomous identification and analysis of surgical phasesVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system autonomously identifies and analyzes surgical phases without requiring manual intervention. The processor automatically processes video streams and instrument data to determine surgical phases, eliminating the need for manual tracking and recording by surgical personnel.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Traditional manual mechanical tracking methods are replaced with automated electronic processing. The system uses processors to analyze video streams and instrument data, substituting human manual operations with automated computational analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If the system processes and analyzes video streams and instrument data in real-time, then surgical guidance capability is improved, but computational energy consumption increases

Engineering Contradiction:
Improvesurgical guidance capabilityVSAvoidcomputational energy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary processing of video streams and instrument data during the surgical procedure. By continuously analyzing data in real-time and pre-identifying surgical phases, the system prepares surgical guidance information ahead of when it is needed, improving response time while managing computational load.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If the system provides detailed interactive reports with playback functionality, then post-surgical analysis capability is improved, but data processing requirements increase

Engineering Contradiction:
Improvepost-surgical analysis capabilityVSAvoiddata processing requirements
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system creates detailed copies of surgical procedure data including video streams, instrument data, and identified surgical phases. These copies are stored and made available for post-surgical analysis and playback, preserving complete surgical information without requiring the original surgical system to continuously process all data.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The surgical procedure data is segmented into distinct surgical phases that are automatically identified and labeled. This segmentation organizes large volumes of surgical data into manageable, meaningful segments that can be easily analyzed and reviewed during post-surgical evaluation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250143807A1Provision of surgical guidance based on audiovisual data and instrument data
Publication Date: 2025.05.08 COVIDIEN LP
  • US20250143807A1 patent drawing
  • US20250143807A1 patent drawing
  • US20250143807A1 patent drawing

AI summary

A system is provided that includes a memory device and one or more processors coupled with the memory device. The one or more processors are configured to determine, autonomously, one or more phases in a surgical procedure based on a video stream of the surgical procedure. The one or more processors are further configured to identify one or more usages of a surgical instrument used during the surgical procedure. The one or more processors are configured to display a chart of the one or more usages. The chart divides the one or more usages according to the one or more phases respectively, and a representation of each of the one or more usages indicates a duration of each usage.