3D Object Distance Measurement Using Multi-Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Advanced driver assistance systems in vehicles display information in a two-dimensional manner, making it difficult for drivers to accurately judge distances and depths of objects, leading to increased driver attention and risk of accidents, especially during parking.

Innovation Solution

A method that combines 3D information from at least two images obtained by on-vehicle sensors to generate a shared 3D space, allowing for the identification and determination of object distances, and adjusts the surround view image to highlight critical objects, thereby enhancing driver safety and comfort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If 2D image display is used in driver assistance systems, then device complexity is reduced, but measurement precision of object distances and depths deteriorates

Engineering Contradiction:
Improveobject distance measurement precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transforms 2D image data into a 3D shared space representation by combining multiple images from different sensors (camera, radar, lidar) and performing 3D data mapping. This dimensional transformation enables accurate depth and distance measurement while utilizing existing sensor hardware, thus improving measurement precision without proportionally increasing device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If driver pays high attention to interpret 2D image presentation, then measurement precision of object distances improves, but reliability of driving safety deteriorates due to increased risk of accidents

Engineering Contradiction:
Improveobject distance judgment accuracyVSAvoiddriving safety
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs automatic 3D object identification, distance measurement, and hazard detection without requiring driver intervention. The device independently processes multiple sensor inputs, generates a shared 3D space, identifies objects, determines their distances, and alerts the driver only when hazards are detected, thereby eliminating the need for driver attention to interpret 2D images while maintaining high measurement precision and improving safety reliability.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If multiple sensor devices are combined to generate 3D information, then measurement precision of object distances improves, but device complexity increases

Engineering Contradiction:
Improve3D object information accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes existing multi-functional vehicle sensors (camera, radar, lidar) work together for 3D object recognition. By performing data fusion and 3D mapping of objects detected by multiple sensors, the system achieves accurate 3D measurement precision while utilizing hardware already present in modern vehicles, thus minimizing the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10733464B2Method, system and device of obtaining 3D-information of objects
Publication Date: 2020.08.04 MOTHERSON INNOVATIONS CO LTD
  • US10733464B2 patent drawing
  • US10733464B2 patent drawing
  • US10733464B2 patent drawing

AI summary

A method for obtaining 3D information of objects shown in at least two images obtained by at least two on-vehicle sensors, a device for carrying out the respective steps of the method, a system including such a device, and a vehicle including such a device or such a system are described.