Image Processing Apparatus for Endoscope Object Superimposition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems for endoscope devices face challenges in accurately superimposing objects of interest onto subject images across multiple frames, as the spatial information of the object may not correctly align due to positional changes, leading to displacement issues.

Innovation Solution

An image processing apparatus that sequentially acquires and processes multiple subject images, detects the location of interest, generates spatial information for a superimposed object, and corrects this information using inter-image correspondence data to ensure accurate superposition on a target image, repeating the process until the spatial information is correctly aligned.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If spatial information of a superimposed object is generated from a detection target image and superimposed on a superimposition target image, then the object can be displayed on the observation screen, but positional displacement occurs between the superimposed object and the location of interest due to changes in the subject image

Engineering Contradiction:
Improveobject superimposition displayVSAvoidpositioning accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements a feedback mechanism that dynamically adjusts the spatial information of superimposed objects based on detected positional displacements. The system continuously monitors the position of locations of interest in newly acquired subject images and updates the spatial information accordingly, transforming the static superimposition process into a dynamic one that adapts to changes in the subject image, thereby resolving the positional displacement issue.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback by detecting the actual position of locations of interest in new subject images and using this information to correct the spatial information of previously superimposed objects. This closed-loop approach ensures that the superimposed objects remain accurately positioned even as the subject image changes, directly addressing the positioning accuracy problem.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If multiple subject images are processed to maintain accurate superimposition, then positioning accuracy improves, but processing time and computational complexity increase

Engineering Contradiction:
Improvesuperimposition accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary detection of locations of interest in advance, storing this information for later use in superimposition. By detecting and storing the positions of locations of interest beforehand, the system reduces the computational burden during the superimposition process itself, allowing for accurate multi-frame processing without excessive time loss.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The processing is divided into distinct segments: detection of locations of interest, generation of spatial information, and superimposition. This segmentation allows each step to be optimized independently and enables parallel processing where possible, reducing overall processing time while maintaining accuracy across multiple frames.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If the superimposition process is repeated for multiple frames to maintain accuracy, then positioning precision improves, but device complexity increases

Engineering Contradiction:
Improvepositioning precisionVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates a universal processing framework that handles detection, spatial information generation, and superimposition within a single integrated system. This multi-functional approach avoids the need for separate specialized components for each processing stage, reducing overall device complexity while maintaining the ability to repeatedly process multiple frames with high precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10561300B2Image processing apparatus, image processing method, and image processing program
Publication Date: 2020.02.18 OLYMPUS CORPORATION(JP)
  • US10561300B2 patent drawing
  • US10561300B2 patent drawing
  • US10561300B2 patent drawing

AI summary

An image processing apparatus includes a processor to: sequentially acquire plural subject images; select a detection target image from the plural subject images; detect the location of interest in the detection target image; generate spatial information of a superimposed object indicating the location of interest on one of the plural subject images; select a superimposition target image to be superimposed, from the plural subject images; generate inter-image correspondence information between the detection target image and the superimposition target image; correct the spatial information of the superimposed object, based on the inter-image correspondence information; and superimpose the superimposed object on the superimposition target image. The processor is configured to repeatedly execute the selecting the superimposition target image, the generating the inter-image correspondence information, the correcting the spatial information, and the superimposing the superimposed object, until the spatial information of the superimposed object is generated for the detection target image.