Vehicle Exterior Environment Recognition Using Monocular and Distance Image Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle exterior environment recognition systems face difficulties in early and stable detection of pedestrians due to their smaller size and unstable behavior, often resulting in delayed collision avoidance controls and potential abrupt actions.

Innovation Solution

A vehicle exterior environment recognition apparatus that utilizes monocular recognition based on luminance images to identify three-dimensional object regions, correlating them with distance images to determine specific parts like pedestrians, allowing for early and precise detection by combining luminance and distance information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If monocular recognition based on luminance images is used to detect pedestrians, then the detection range is extended, but the detection precision and stability deteriorate due to the small size and unstable behavior of pedestrians

Engineering Contradiction:
Improvedetection rangeVSAvoiddetection precision
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent combines luminance images from a luminance image capturing unit with distance images from a distance image capturing unit to create a composite image. This merging allows the system to leverage both the wide detection range of luminance images and the precise depth information from distance images, thereby maintaining detection precision while extending detection range.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces distance information as an additional dimension to the traditional luminance-based detection. By correlating luminance images with distance images, the system transforms two-dimensional luminance data into three-dimensional spatial understanding, enabling more accurate detection of pedestrians regardless of their size or behavior stability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If monocular recognition is used for pedestrian detection, then the system complexity is reduced, but the collision avoidance control stability deteriorates due to delayed and inaccurate detection

Engineering Contradiction:
Improvesystem complexityVSAvoidcontrol stability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent merges luminance image capturing and distance image capturing into a unified detection system. By processing both image types simultaneously and correlating them, the system achieves stable and accurate pedestrian detection without significantly increasing overall system complexity, as both image streams are integrated into a single detection pipeline.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a distance image as an intermediary element that bridges the gap between simple luminance detection and complex stereo vision. The distance image provides intermediate depth information that enhances detection stability without requiring full stereo processing, thus maintaining reasonable system complexity while improving control reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If only luminance images are used for object detection, then the image processing simplicity is maintained, but the position and speed identification precision deteriorates

Engineering Contradiction:
Improveprocessing simplicityVSAvoidposition identification precision
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent adds the distance dimension to traditional luminance image processing. By correlating luminance images with distance images, the system transforms simple two-dimensional image processing into three-dimensional spatial processing, significantly improving position identification precision while maintaining relatively simple processing through the use of distance correlation techniques.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10789489B2Vehicle exterior environment recognition apparatus
Publication Date: 2020.09.29 SUBARU CORP
  • US10789489B2 patent drawing
  • US10789489B2 patent drawing
  • US10789489B2 patent drawing

AI summary

A vehicle exterior environment recognition apparatus includes a three-dimensional object region identifier and a specific part identifier. The three-dimensional object region identifier identifies a three-dimensional object region by monocular recognition based on a luminance image. The three-dimensional object region includes a three-dimensional object. The luminance image is generated by an image capturing unit that captures an image of vehicle exterior environment. The specific part identifier correlates the three-dimensional object region with a distance image, to identify a specific part of the three-dimensional object region on the basis of distance information. The distance image is generated from the luminance image. The distance information is calculated on the basis of the distance image.