Stereo Camera Region-Based Interpolation for Far Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The accuracy of distance detection using pixels is low for objects far away from a stereo camera, and existing systems face high processing loads when mounted on vehicles moving at high speeds, making it challenging to detect distances with high accuracy while maintaining processing efficiency.

Innovation Solution

A stereo camera apparatus with a controller that uses region-based image processing, where different regions in the image are analyzed for near and far objects, employing pixel interpolation and stereo matching to enhance accuracy and reduce processing load by focusing on specific regions corresponding to the vehicle's direction and speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Length of stationary object

If pixel-based distance detection is used for far-away objects, then the detection range is extended, but the detection accuracy deteriorates because objects appear smaller in the image

Engineering Contradiction:
Improvedetection rangeVSAvoiddistance detection accuracy
Core Design Contradiction:
Length of stationary objectVSMeasurement precision

Solution Approach 1:

The image is divided into multiple regions (first region and second region) with different resolutions. The first region corresponds to a wider field of view and lower resolution, while the second region corresponds to a narrower field of view and higher resolution. This segmentation allows far-away objects to be detected in the first region while maintaining accuracy for closer objects in the second region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the image are assigned different quality levels (resolution). The first region has lower resolution suitable for detecting far-away objects, while the second region has higher resolution for accurate detection of closer objects. This local quality differentiation optimizes the trade-off between detection range and accuracy.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If high-resolution image processing is performed for all regions, then distance detection accuracy is improved, but the processing load increases making high-speed detection difficult

Engineering Contradiction:
Improvedistance detection accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The image processing is segmented into different regions with different processing intensities. The first region undergoes lower-resolution processing while the second region undergoes higher-resolution processing. This segmentation reduces the overall processing load while maintaining accuracy where needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

High-resolution processing is applied partially only to the second region where it is most needed, rather than excessively processing the entire image. This partial application of high-resolution processing maintains accuracy for critical close-range objects while reducing unnecessary processing for far-away objects.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3211368B1Stereo camera apparatus and vehicle provided with stereo camera apparatus
Publication Date: 2023.07.26 KYOCERA CORP
  • EP3211368B1 patent drawingFigure 1
  • EP3211368B1 patent drawingFigure 2~3
  • EP3211368B1 patent drawingFigure 4~5

AI summary

The stereo camera apparatus (30) includes a stereo camera and a first controller (31) configured to detect a target object to be detected based on at least one first region among a plurality of regions located at different positions in a predetermined direction in an image captured by the stereo camera, generate interpolation pixels by performing pixel interpolation based on at least original pixels that constitute an image of the detected object and detect distance from a reference position to a position of the detected object based on at least the interpolation pixels. As a result, a stereo camera apparatus capable of detecting an object located far away from a vehicle with a high accuracy while suppressing the processing load and a vehicle can be provided.