Surgical Camera Control via Predictive Scene Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In surgical environments, the view from medical image capture devices like endoscopes or microscopes often becomes obstructed by tools, hands, tissue deformations, or other dynamic elements, leading to delays in capturing critical visual information.

Innovation Solution

A system that acquires initial image data from a medical image capture device, predicts the future appearance of the surgical scene, and adjusts the device's image capture properties, such as zoom, focus, aperture, contrast, and brightness, to maintain optimal imaging conditions before obstructions occur.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the camera rotates to avoid obstruction based on predicted future obstructions, then the field of view is maintained, but the response time is delayed because the rotation occurs after the obstruction is predicted

Engineering Contradiction:
Improvefield of view maintenanceVSAvoidresponse time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by proactively adjusting camera parameters (zoom, focus, aperture, contrast, brightness) based on predicted future obstructions before the obstructions actually occur. This allows the camera to maintain optimal imaging conditions in advance, reducing the need for reactive rotations and minimizing response time delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes camera parameters (zoom level, focus distance, aperture size, contrast, brightness) proactively based on predicted obstructions. By adjusting these parameters, the system can maintain clear visualization of critical surgical elements without requiring physical camera rotation, thus resolving the contradiction between maintaining field of view and minimizing response time.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If multiple cameras are used to capture different views of the surgical scene, then the likelihood of maintaining an unobstructed view is improved, but the system complexity and data processing requirements increase

Engineering Contradiction:
Improveview availabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system makes a single camera multi-functional by enabling it to adaptively adjust multiple parameters (zoom, focus, aperture, contrast, brightness) based on predicted surgical scene changes. This allows one camera to perform the role of multiple fixed cameras, maintaining view availability while reducing system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adjusts camera parameters in real-time based on predicted obstructions and surgical scene changes. This dynamic adaptability allows a single camera to effectively capture multiple perspectives and maintain reliable visualization without requiring multiple physical cameras, thus reducing system complexity while maintaining view availability.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4051080B1Method, apparatus and system for controlling an image capture device during surgery
Publication Date: 2025.02.19 SONY GROUP CORP
  • EP4051080B1 patent drawingFigure 1
  • EP4051080B1 patent drawingFigure 2
  • EP4051080B1 patent drawingFigure 3

AI summary

A system for controlling a medical image capture device during surgery is provided, the system including circuitry configured to acquire first image data from the medical image capture device, the first image data being of an appearance of a surgical scene at a first instance of time; determine, based on a predicted appearance of the surgical scene based on the first image data at a second instance of time after the first instance of time, one or more desired image capture properties of the medical image capture device; and control the medical image capture device at a third instance of time, the third instance of time being between the first instance of time and the second instance of time, in accordance with the one or more desired image capture properties of the medical image capture device.