Distributed Surgical Image Processing for Low Latency

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current video processing techniques in surgical environments introduce latency due to complex image and data processing requirements, which can disrupt the surgeon's coordination and require significant computing power, leading to space and noise issues in the operating theater.

Innovation Solution

A distributed image processing system where surgical image frames are sent directly to an image receptor for display, with a processing unit outside the operating theater extracting correction parameters and applying them to subsequent frames, reducing latency and computing power needs within the theater.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If complex video, image and data processing techniques are used to provide corrections and adjustments, then image quality and coordination are improved, but latency is introduced

Engineering Contradiction:

Improveimage correction accuracyVSAvoidvideo stream latency

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The system segments the image processing pipeline into two independent paths: a direct transmission path for real-time display and a processing path for extracting correction parameters. This segmentation allows the heavy computational tasks to be performed on historical frames without blocking the real-time video stream, thus resolving the latency issue while maintaining correction accuracy.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs image processing and correction parameter extraction in advance on previously received frames. By preparing correction data beforehand and storing it for later application, the system avoids the need to process every frame in real-time, thereby eliminating latency while still providing accurate corrections when needed.

Inventive Principle:

Principle #10Preliminary action

2Productivity

If significant computing power is used to process digital video images in real time, then image processing capability is improved, but space and noise requirements increase in the operating theater

Engineering Contradiction:

Improvereal-time image processing capabilityVSAvoidtheater space occupation

Core Design Contradiction:

ProductivityVSArea of stationary object

Solution Approach 1:

The system extracts and removes the computationally intensive image processing functions from the operating theater environment. By using cloud-based or remote processing units, the heavy computing tasks are performed externally, leaving the theater space free and noise-free while maintaining real-time processing capability through networked communication.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The system introduces a network communication interface as an intermediary between the image pickup unit and the processing unit. This intermediary allows the system to leverage remote computing resources, eliminating the need for local high-power processors in the theater while maintaining real-time processing capability through efficient data transmission.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Power

If processors with large footprint are used in the operating theater, then processing capability is improved, but space availability and noise levels worsen

Engineering Contradiction:

Improveprocessing powerVSAvoidnoise and space occupation

Core Design Contradiction:

PowerVSObject-affected harmful factors

Solution Approach 1:

The system replaces the mechanical presence of high-power processors physically located in the theater with a networked computing architecture. By substituting local hardware with remote cloud computing resources, the system eliminates the harmful effects of noise and space occupation while maintaining the required processing power through virtualized computing resources.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11896195B2Distributed image processing system in operating theater

Publication Date: 2024.02.13 SONY GROUP CORP

AI summary

A processing system (100, 200) for processing surgical images. The system includes at least one image pickup unit (115) for obtaining surgical image frames and data, at least one image receptor (113) for receiving surgical image frames to be displayed, and a processing unit (153) connected with a network (103, 106, 107) to the image pickup unit (115) for receiving surgical image frames, the processing unit (153) being configured for processing the surgical image frames and for extracting at least one processing information thereof. The processing unit further is being connected to the at least one image receptor (113) for providing the at least one correction parameter to the at least one image receptor. The system further comprises a connection (102) between the at least one image pickup unit (115) and the image receptor (113), for sending the surgical image frames directly to the image receptor (113).