Reference Point Reliability Evaluation for Surgical Video Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for aligning surgical simulation images with real-time video during surgery are cumbersome due to the need for expensive sensors and limited space in operating rooms, and they either require complex calculations or do not accurately calculate reliability of movements within images.

Innovation Solution

A system that evaluates the movements of reference points within images by comparing sequential images to calculate a degree of reliability, allowing for accurate alignment of simulation data with real-time video without the need for expensive sensors, using imaging means, movement detecting means, and reliability calculating means.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If expensive sensors are used to detect movements of reference points for aligning simulation images with real-time video, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improvemeasurement precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces expensive mechanical sensors with a computational approach using image processing algorithms. The system detects movements of reference points by comparing sequential video frames through feature extraction and matching, eliminating the need for physical sensors while maintaining measurement precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a virtual model of the surgical field by extracting and tracking reference points from video images. This virtual representation is then aligned with simulation data through computational transformations, replacing the need for physical sensing devices.

Inventive Principle:
Principle #26Copying

2Measurement precision

If markers are provided on the target of surgery to enable movement detection, then measurement precision is improved, but the markers may obstruct surgical operations

Engineering Contradiction:
Improvemeasurement precisionVSAvoidobstruction of surgical operations
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent utilizes the natural visual features present in the surgical video footage itself as reference points. The system extracts distinctive features directly from the image content (such as anatomical landmarks or natural contrasts) without requiring any external markers, allowing the surgical field to serve its own measurement function.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If complex calculation methods are used to calculate reliability of movements, then reliability calculation accuracy is improved, but productivity decreases

Engineering Contradiction:
Improvereliability calculation accuracyVSAvoidproductivity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent calculates reliability selectively for each reference point based on local image characteristics and movement patterns, rather than performing exhaustive calculations on the entire surgical field. This partial approach maintains accuracy for critical points while reducing overall computational burden.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10242452B2Method, apparatus, and recording medium for evaluating reference points, and method, apparatus, and recording medium for positional alignment
Publication Date: 2019.03.26 FUJIFILM CORP
  • US10242452B2 patent drawing
  • US10242452B2 patent drawing
  • US10242452B2 patent drawing

AI summary

An initial position aligning unit performs initial positional alignment of a video and simulation data, and a position aligning unit performs positional alignment of the video and the simulation data. A first movement detecting unit detects movements of reference points which are set within a first image of the video, and a second movement detecting unit detects movement of a camera. A degree of reliability calculating unit compares the first and second movements to calculate a degree of reliability with respect to the movements of each of the reference points.