3D Endoscopic Image Parallax Adjustment for User Burden Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users experience discomfort and burden while viewing 3D endoscopic images due to parallax, especially when objects with active movement, like mist or smoke, appear in the depth direction, which can distract from the intended site during medical procedures.

Innovation Solution

An image processing method and system that adjusts the parallax amount of 3D endoscopic images based on user burden, using a parallax amount adjustment unit to reduce parallax when the electrical scalpel is in use, by shifting pixel values and interpolating missing pixels to minimize user discomfort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If 3D endoscopic images are displayed with normal parallax to provide depth information, then the user can perceive depth-direction information and guide procedure tools smoothly, but the user experiences discomfort and burden especially when moving objects like mist or smoke appear in the depth direction

Engineering Contradiction:
Improvedepth informationVSAvoiduser discomfort
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by making the parallax amount adjustable and changeable based on detection results. The system dynamically adjusts the parallax amount between left-eye and right-eye images according to whether moving objects are detected, transitioning between normal parallax (for depth perception) and reduced parallax (to minimize discomfort when moving objects are present).

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parallax parameter adaptively. When moving objects like mist or smoke are detected in the depth direction, the system reduces the parallax amount between left and right images. This parameter change resolves the contradiction by maintaining depth information when needed while minimizing user discomfort when moving objects are present.

Inventive Principle:
Principle #35Parameter changes

2Object-affected harmful factors

If the parallax amount is reduced to minimize user discomfort, then user burden is reduced, but the depth-direction information perception is diminished

Engineering Contradiction:
Improveuser discomfortVSAvoiddepth information
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The system dynamically adjusts parallax based on real-time detection of moving objects. When no moving objects are present, normal parallax is maintained for optimal depth perception. When moving objects are detected, parallax is reduced temporarily to minimize discomfort, then restored afterward. This dynamic adjustment resolves the contradiction by applying parallax reduction only when necessary.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The parallax parameter is changed adaptively based on detection results rather than being fixed. The system switches between two parallax states: normal parallax for depth perception and reduced parallax for comfort. This conditional parameter change ensures depth information is preserved when possible while minimizing discomfort when moving objects are present.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If the system automatically adjusts parallax based on detection of moving objects, then user burden is reduced without manual intervention, but the device complexity increases

Engineering Contradiction:
Improveautomatic adjustmentVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically detecting moving objects and adjusting parallax without user intervention. The detection unit identifies moving objects like mist or smoke, and the control unit automatically modifies the parallax amount accordingly. This automation improves ease of operation while the complexity is managed through efficient algorithms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback by using detection results to control parallax adjustment. The detection unit continuously monitors for moving objects, and based on this feedback, the control unit adjusts the parallax amount. This closed-loop feedback mechanism enables automatic adaptation while keeping the control logic relatively simple and manageable.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3247113B1Image processing device, image processing method, program, and endoscope system
Publication Date: 2022.04.06 SONY GROUP CORP
  • EP3247113B1 patent drawingFigure 1
  • EP3247113B1 patent drawingFigure 2
  • EP3247113B1 patent drawingFigure 3

AI summary

The present technology relates to an image processing device, an image processing method, a program, and an endoscope system that can reduce a burden on a user. A parallax amount adjustment unit adjusts the parallax amount of a three-dimensional (3D) biological image of an imaged living organism, depending on whether the parallax of the 3D biological image puts a burden on a user. The present technology can be applied to an endoscope system or the like that captures an image of a living organism with an endoscope, for example.