Stereo Camera Depth Detection with Reliability Screening

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Technologies using stereo cameras for motion detection in three-dimensional spaces face accuracy issues due to environmental factors like brightness and subject composition, leading to errors in position information derivation.

Innovation Solution

An information processor with a similarity data generation, result evaluation, and depth image generation system that treats reference blocks from stereo images, calculates similarity, and corrects for noise to accurately determine subject position in three-dimensional space, regardless of shooting environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If stereo camera parallax method is used to detect depth position, then three-dimensional position detection capability is improved, but measurement precision deteriorates due to environmental factors like brightness and subject composition

Engineering Contradiction:
Improvethree-dimensional position detection capabilityVSAvoidposition information accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary evaluation mechanism that assesses the reliability of parallax-based position detection results. When the evaluation indicates low reliability (due to environmental factors like brightness or subject composition), the system switches to using image recognition technology as an alternative method, thereby maintaining measurement precision across varying conditions

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically changes the detection method based on evaluated parameters. When environmental conditions make parallax detection unreliable, the system transitions to image recognition, effectively changing the detection parameter strategy to maintain accuracy

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If simple parallax calculation is used for speed, then processing complexity is reduced, but reliability of position information deteriorates due to wrong picture association

Engineering Contradiction:
Improveprocessing complexityVSAvoidposition information reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system performs preliminary evaluation of the reliability of parallax-based detection before finalizing position information. This preliminary action prevents wrong picture association from compromising reliability, as the evaluation step identifies and filters out unreliable detections before they affect the final result

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If picture association is performed without environmental consideration, then processing time is reduced, but measurement precision deteriorates due to wrong associations

Engineering Contradiction:
Improveprocessing timeVSAvoidposition information accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

An intermediary evaluation step is introduced between picture association and final position determination. This mediator quickly assesses whether the association is reliable based on environmental factors, allowing the system to maintain speed while preventing wrong associations from degrading precision

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides robust and accurate position information in various shooting environments, minimizing errors and undefined areas, thereby enhancing the precision of subsequent processes.

Implementation Method 1

detecting a position of a target in the depth direction with high accuracy. Among commercially available techniques adapted for detecting a position of a target in the depth direction are those using parallax between left and right images shot by a stereo camera

Methodology Applied
Scientific EffectParallax: Parallax

Data Source

PatentUS10063838B2Information processor, information processing method, and computer program
Publication Date: 2018.08.28 SONY GROUP CORP
  • US10063838B2 patent drawing
  • US10063838B2 patent drawing
  • US10063838B2 patent drawing

AI summary

An information processor includes: a similarity data generation portion generating similarity data that represents the calculated similarity to the image in the reference block in association with a position within the search range; a result evaluation portion detecting a position with a maximum similarity value for each piece of the similarity data and screening the detection result by making a given evaluation of the similarity; a depth image generation portion finding a parallax for each of the reference blocks using the detection result validated as a result of screening, calculating a position of a subject in a depth direction on a basis of the parallax, and generating a depth image by associating the position of the subject in the depth direction with an image plane; and an output information generation section performing given information processing on a basis of the subject position in a three-dimensional space using the depth image and outputting the result of information processing.