Endoscope Image Alignment for Multi-View Observation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscope systems face challenges in simultaneously observing both front-view and side-view directions effectively, particularly in complex body cavities like the large intestine, where lesions or instrument positions can be difficult to visualize due to limited field of view and instrument alignment issues.

Innovation Solution

An endoscope system with a wide-angle configuration that includes a rigid distal end, a bendable bending portion, and flexible tube, equipped with both front-view and side-view observation windows, along with an image processing section that aligns and adjusts the images of treatment instruments across both views to enhance visibility and operability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If multiple observation lenses are provided to observe both front-view and side-view directions, then the field of view is improved, but the device complexity increases

Engineering Contradiction:
Improvefield of viewVSAvoiddevice complexity
Core Design Contradiction:
Area of moving objectVSDevice complexity

Solution Approach 1:

The endoscope is divided into multiple observation units: a front-view observation unit with a front-view observation lens, and side-view observation units with side-view observation lenses positioned at different locations. Each observation unit independently captures images from its specific direction, enabling comprehensive multi-directional observation while maintaining modular system architecture

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from single-direction observation to multi-dimensional observation by positioning observation lenses in different spatial locations and orientations. The front-view observation lens observes along the longitudinal axis, while side-view observation lenses observe from lateral positions, creating a three-dimensional observation capability that comprehensively covers the target space

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of moving object

If images from multiple observation lenses are displayed separately, then the field of view is improved, but the ease of operation deteriorates due to difficulty in aligning instrument positions

Engineering Contradiction:
Improvefield of viewVSAvoidease of operation
Core Design Contradiction:
Area of moving objectVSEase of operation

Solution Approach 1:

The image processing section merges images from the front-view observation lens and side-view observation lenses into a single integrated composite image. The front-view image and side-view images are positioned and overlaid according to their spatial relationships, allowing the operator to simultaneously observe multiple directions with proper alignment of treatment instruments across different viewports

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The image processing section acts as an intermediary that receives raw images from multiple observation lenses, performs coordinate transformation and alignment based on stored position information, and generates a unified composite image. This intermediary processing resolves the misalignment issue between different observation views and presents a coherent multi-directional view to the operator

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If treatment instruments are inserted through the endoscope, then the productivity is improved, but the measurement precision deteriorates due to difficulty in visualizing instrument positions in complex body cavities

Engineering Contradiction:
ImproveproductivityVSAvoidmeasurement precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The composite image merges the front-view image showing treatment instrument insertion with side-view images showing instrument position in complex body cavities. By overlaying these views with proper spatial alignment, the operator can simultaneously monitor both the insertion progress and the final position of treatment instruments, improving visualization precision in difficult-to-reach areas

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses multi-dimensional observation to track treatment instruments through complex body cavities. The front-view observation provides longitudinal insertion information, while side-view observations provide lateral position information. By combining these dimensional views in a composite image, the system achieves precise three-dimensional localization of treatment instruments throughout the procedure

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10349814B2Endoscope system
Publication Date: 2019.07.16 OLYMPUS CORPORATION(JP)
  • US10349814B2 patent drawing
  • US10349814B2 patent drawing
  • US10349814B2 patent drawing

AI summary

An endoscope system has an insertion portion, a front-view observation window that acquires a first object image, a side-view observation window that is provided in the insertion portion, and acquires a second object image, a video processor that generates a signal of an image, a setting storage section that records information on a deviation amount concerning a deviation, and an image processing section that performs, for the image, processing of changing disposition of at least either the image of the object in the first object image or the image of the object in the second object image in accordance with the deviation amount, and aligning a position of the image of the object in the first object image, and a position of the image of the object in the second object image with each other.