Depth-Based Image Modification Using Structured Light

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging systems face challenges in modifying captured images effectively as a function of depth, particularly when only a portion of the image needs to be enhanced or when control elements are not available to improve overall image quality.

Innovation Solution

An imaging system that includes an image processor capable of determining depth using various methods such as structured light or stereo image matching, allowing for selective modification of captured images based on depth, brightness, and other image characteristics, enabling tailored processing and display of images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional autofocus or automatic exposure control is used to improve image quality, then overall image quality is improved, but the ability to selectively modify only specific portions of the image is lost

Engineering Contradiction:
Improveimage qualityVSAvoidselective modification capability
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies local quality by determining depth for different regions of the image and applying modifications selectively based on depth criteria. The image processor identifies regions meeting specific depth criteria and modifies only those regions, allowing different parts of the image to have different processing applied based on their depth characteristics.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the image into regions based on depth information. By determining depth for different portions of the image and applying modifications only to regions meeting specific depth criteria, the system divides the image processing task into selective segments rather than applying uniform processing to the entire image.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If control elements are adjusted to improve image quality, then image quality is improved, but complexity of the system increases

Engineering Contradiction:
Improveimage qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically determining depth information and applying appropriate modifications without requiring manual adjustment of control elements. The image processor autonomously identifies regions meeting depth criteria and applies modifications, eliminating the need for user intervention while maintaining improved image quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces mechanical control element adjustments with digital image processing operations. Instead of physically adjusting focus or exposure controls, the system uses computational methods to analyze depth information and apply digital modifications to image regions, reducing mechanical complexity while maintaining or improving image quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If depth-based selective modification is implemented, then adaptability and selective processing are improved, but device complexity increases

Engineering Contradiction:
Improveselective processing capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic processing by determining depth information and applying modifications based on real-time depth criteria evaluation. The system dynamically identifies regions meeting specific depth criteria and applies modifications only to those regions, allowing the processing to adapt to the specific depth characteristics of each image rather than using fixed processing rules.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise and adaptive image processing that enhances image quality by modifying images according to depth and other characteristics, improving clarity and visibility of objects within the image, particularly useful in applications like medical imaging where subtle tissue variations need to be distinguished.

Implementation Method 1

An imaging system that includes an image processor capable of determining depth using various methods such as structured light or stereo image matching

Methodology Applied
Scientific EffectStructured light:

Implementation Method 2

An imaging system that includes an image processor capable of determining depth using various methods such as structured light or stereo image matching

Methodology Applied
Scientific EffectStereo image matching: Parallax

Implementation Method 3

An imaging system, and method implemented therein, for modification of captured images as a function of depth

Methodology Applied
Scientific EffectImage processing:

Data Source

PatentUS11057602B2Depth based modification of captured images
Publication Date: 2021.07.06 INTUITIVE SURGICAL OPERATIONS INC
  • US11057602B2 patent drawing
  • US11057602B2 patent drawing
  • US11057602B2 patent drawing

AI summary

An imaging system processes images of a plurality of objects which have been captured by an image capture device for display. Normal processing of the images is modified as either a function of a depth corresponding to one or more of the plurality of objects appearing in the captured images relative to the image capture device or as a function of the depth and one or more image characteristics extracted from the captured images. A depth threshold may be used to avoid inadvertent modifications due to noise.