Surgical Video Standardization via Temporal Warping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is no efficient method to combine and compare unedited videos of surgical techniques from different sources, such as YouTube, for learning or improving surgical skills, as each video is edited uniquely and lacks standardized formatting.

Innovation Solution

A system that includes an image sensor, computer system, and surgical video database, which allows users to search, standardize, and compare videos by warping temporal and spatial dimensions, generating a template for comparison, and highlighting deviations from typical techniques using machine learning logic and video warping engine.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If videos are uploaded to content aggregation sites for surgical technique sharing, then access to surgical videos is improved, but the ability to compare and standardize techniques across different videos deteriorates due to unique editing styles

Engineering Contradiction:
Improveaccess to surgical videosVSAvoidcomparison of surgical techniques
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a computer system as an intermediary that automatically processes, standardizes, and compares surgical videos. The system extracts key frames, generates templates, and aligns multiple videos with different editing styles, enabling surgeons to compare techniques without manually editing each video to match a standard format.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the parameters of video comparison by extracting and normalizing specific visual features (key frames, anatomical structures, surgical instruments) from different video sources. By transforming videos into standardized representations based on extracted parameters, the system enables objective comparison despite original videos having different editing styles and formats.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If multiple surgical videos with different editing styles are collected, then the quantity of surgical technique information is improved, but the time required to analyze and compare these videos increases

Engineering Contradiction:
Improvevolume of surgical technique informationVSAvoidtime to analyze and compare videos
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent segments each surgical video into discrete key frames and anatomical structures. By breaking down continuous video streams into standardized segments based on extracted features, the system enables parallel processing and efficient comparison of multiple videos simultaneously, dramatically reducing analysis time while maintaining comprehensive information coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates standardized templates and representations of surgical techniques by extracting key frames and generating normalized video segments. These copies serve as reference standards that can be rapidly compared against multiple source videos without requiring manual re-analysis of the original footage, thus reducing time investment while preserving technical information.

Inventive Principle:
Principle #26Copying

3Ease of manufacture

If videos are not standardized before comparison, then the ease of video collection is improved, but the precision of technique comparison deteriorates

Engineering Contradiction:
Improveease of video collectionVSAvoidprecision of technique comparison
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The computer system acts as an intermediary that receives unstandardized videos from multiple sources, processes them through automated extraction and normalization algorithms, and outputs standardized comparisons. This mediator approach preserves the ease of collecting diverse videos while achieving precise comparison through automated standardization of extracted features and generated templates.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12175756B2Method for comparing videos of surgical techniques
Publication Date: 2024.12.24 VERILY HEALTH INC
  • US12175756B2 patent drawing
  • US12175756B2 patent drawing
  • US12175756B2 patent drawing

AI summary

A method for comparing videos of a surgical procedure is disclosed. The method comprising selecting a plurality of videos from a surgical video database. Each of the plurality of videos including video data of a first surgical procedure comprising a plurality of surgical steps. The method further including identifying a first surgical step included in the plurality of surgical steps within a first video segment in each of the plurality of videos. The method also including warping the first video segment to standardize a dimension of the first video segment in each of the plurality of videos.