Single Image Sensor for Capsule Endoscope 3D Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing structured light technologies for capturing 3D images in the gastrointestinal tract face challenges due to object movement and high power consumption, making it difficult to maintain frame rates and accuracy in capsule camera applications.

Innovation Solution

A method and apparatus that project and detect structured light with a shorter frame period than regular light, using multiple light sources and reduced dynamic range or spatial resolution, allowing for simultaneous capture of structured and non-structured light images to derive depth information without significantly reducing the frame rate or increasing power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If structured light is projected and detected for depth information capture, then depth or shape information can be derived, but power consumption increases significantly

Engineering Contradiction:
Improvedepth information accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent combines structured light projection and regular image capture into a single integrated imaging apparatus. The same light source projects both structured light patterns and provides regular illumination, and the same image sensor captures both structured light images and regular images. This merging eliminates the need for separate depth cameras and light sources, significantly reducing power consumption while maintaining depth measurement capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging apparatus is designed with multi-functionality where a single light source serves dual purposes: projecting structured light patterns for depth information and providing regular illumination for texture capture. The single image sensor also performs dual functions by capturing both structured light images and regular images, reducing the overall power requirements compared to dedicated separate systems

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If structured light images are captured separately from regular images, then depth information can be derived, but frame rate is reduced

Engineering Contradiction:
Improvedepth informationVSAvoidframe rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent merges structured light image capture and regular image capture into a single simultaneous operation using one image sensor. The sensor captures both types of images at the same time during a single exposure period, eliminating the need to alternate between capturing structured light images and regular images separately, thereby maintaining the original frame rate

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging system maintains continuous capture of both structured light and regular images without interruption or alternation. The single image sensor continuously records both image types simultaneously, ensuring that no frames are lost and the full frame rate is preserved while deriving depth information from the structured light patterns

Inventive Principle:
Principle #20Continuity of useful action

3Measurement precision

If multiple cameras are used for 3D imaging, then depth information can be captured from different view angles, but device complexity increases

Engineering Contradiction:
Improve3D imaging capabilityVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the functions of multiple cameras into a single imaging apparatus. Instead of using separate depth cameras and regular cameras, the system uses one integrated imaging device that captures both structured light images (for depth) and regular images (for texture) simultaneously, dramatically simplifying the device architecture

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The single imaging apparatus is designed with universal functionality to perform both depth measurement and regular imaging tasks. The light source and sensor are configured to handle multiple imaging modes, eliminating the need for multiple specialized cameras and reducing overall system complexity while maintaining 3D imaging capability

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and efficient capture of 3D images in the gastrointestinal tract with reduced power consumption and maintained frame rates, overcoming the limitations of traditional structured light approaches.

Implementation Method 1

Structured light from the imaging apparatus is projected into the body lumen. The structured light reflected from anatomical features in the body lumen is detected by the imaging apparatus.

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

Non-structured light is emitted from the imaging apparatus into the body lumen. The non-structured light reflected from the anatomical features in the body lumen is detected by the imaging apparatus.

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS10785428B2Single image sensor for capturing mixed structured-light images and regular images
Publication Date: 2020.09.22 CAPSOVISION INC
  • US10785428B2 patent drawing
  • US10785428B2 patent drawing
  • US10785428B2 patent drawing

AI summary

A method and apparatus for imaging a body lumen are disclosed. According to the method, an imaging apparatus is induced into the body lumen. Structured light from the imaging apparatus is projected into the body lumen. The structured light reflected from anatomical features in the body lumen is detected by the imaging apparatus. A first structured light image is generated from the detected structured light by the imaging apparatus. Non-structured light is emitted from the imaging apparatus into the body lumen. The non-structured light reflected from the anatomical features in the body lumen is detected by the imaging apparatus. A non-structured light image is generated from the detected non-structured light by the imaging apparatus. The frame period of the first structured light image is shorter than the frame period of the non-structured light image. In one embodiment, the imaging apparatus corresponds to a capsule endoscope.