Object Recognition Apparatus Radar Image Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object recognition systems using radar devices struggle to accurately determine multiple objects as a single entity, particularly when vehicles are running parallel to each other at a distance, leading to erroneous grouping and potential failures in driving support systems like following travel control and collision avoidance.

Innovation Solution

An object recognition apparatus that combines radar-based and image-based target information to determine if multiple objects are detected as a single object, utilizing a reflection point acquiring unit and an object determining unit to correct erroneous groupings by integrating data from both radar and imaging devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the apparatus calculates variations of right- and left-end reflection points and representative point to determine estimated width of object, then the accuracy of object width measurement is improved, but the time required for object detection increases

Engineering Contradiction:
Improveobject width measurement accuracyVSAvoidobject detection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary grouping of reflection points based on basic distance and azimuth information before the vehicle catches up with parallel vehicles. This preliminary grouping is then corrected using image recognition data when the vehicle approaches, avoiding the need to recalculate all variations from scratch and reducing detection time while maintaining accuracy

Inventive Principle:
Principle #10Preliminary action

2Area of stationary object

If the radar device groups reflection points to detect objects, then the detection range is improved, but the accuracy of distinguishing multiple parallel vehicles deteriorates

Engineering Contradiction:
Improvedetection rangeVSAvoidobject distinction accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent merges radar detection data with image recognition data to correct grouping errors. When the vehicle catches up with parallel vehicles, the imaging device provides high-resolution visual information that distinguishes multiple vehicles, which is then used to correct the radar's grouped reflection points, maintaining both detection range and accuracy

Inventive Principle:
Principle #5Merging (Combining)

3Speed

If the apparatus uses only radar data for object detection, then the detection speed is improved, but the reliability of driving support control deteriorates

Engineering Contradiction:
Improvedetection speedVSAvoiddriving support control reliability
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent uses image recognition data as an intermediary to verify and correct radar detection results. The imaging device acts as a mediator that provides additional verification for radar-detected objects, especially in critical scenarios like following travel control and collision avoidance, thereby improving reliability without significantly impacting detection speed

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the accuracy and speed of determining multiple objects as a single entity, improving the reliability of driving support systems by accurately distinguishing between multiple vehicles and reducing the risk of erroneous object recognition.

Implementation Method 1

reflected waves received by a radar device, such as a millimeter wave radar or a laser radar

Methodology Applied
Scientific EffectRadar: Radar

Implementation Method 2

reflected waves received by a radar device

Methodology Applied
Scientific EffectElectromagnetic wave reflection: Reflection

Implementation Method 3

an image captured by an imaging device

Methodology Applied
Scientific EffectLight detection: Light

Data Source

PatentUS11467277B2Object recognition apparatus and object recognition method
Publication Date: 2022.10.11 DENSO CORP
  • US11467277B2 patent drawing
  • US11467277B2 patent drawing
  • US11467277B2 patent drawing

AI summary

An object recognition apparatus groups reflection points detected by a radar device, and recognizes an object around the own vehicle, based on a radar-based target detected using the grouped plurality of reflection points and an image-based target detected using an image captured by an image capturing device. The object recognition apparatus includes a reflection point acquiring unit that acquires reflection point information related to the grouped plurality of reflection points, and an object determining unit that determines that a plurality of objects have been detected as a single object by the radar device, based on the reflection point information acquired by the reflection point acquiring unit and the information on the image-based target, if the image-based target detected by the imaging device includes an image-only target not detected by the radar device.