Binocular Stereo Braking Warning for Full Obstacle Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Autonomous Emergency Braking Systems (AEBS) are limited in detecting various obstacles due to the inadequacies of monocular cameras, millimeter-wave radar, single-line laser, laser radar, and ultrasonic radar, leading to imperfect braking and warning strategies.

Innovation Solution

A vehicle braking and warning method and system utilizing a binocular stereo camera in conjunction with a millimeter-wave radar to acquire and combine data, calculating collision times and outputting braking or warning instructions based on the sensed obstacle information to prevent collisions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a monocular camera is used for obstacle detection, then the system structure is simple, but the detection capability is limited to vehicles and pedestrians only

Engineering Contradiction:
Improvesystem structureVSAvoiddetection capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent combines binocular stereo camera with millimeter-wave radar to form a hybrid sensing system. The binocular camera detects vehicles and pedestrians with high precision, while the millimeter-wave radar detects other obstacles including black objects and objects in low visibility conditions, achieving comprehensive obstacle detection coverage

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system integrates multiple sensing functions into a unified detection framework. The binocular camera provides visual identification and distance measurement, while the millimeter-wave radar adds long-range detection and black object detection capabilities, making the system universally applicable to all obstacle types

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If millimeter-wave radar is used for obstacle detection, then the measurement distance is long and penetration capability is strong, but it cannot detect pedestrians and is easily interfered by metal objects

Engineering Contradiction:
Improvemeasurement distanceVSAvoidpedestrian detection capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system merges millimeter-wave radar with binocular stereo camera. The radar handles long-range detection and black object detection where its penetration capability is advantageous, while the camera complements it by detecting pedestrians and providing visual confirmation, reducing false detections from metal objects

Inventive Principle:
Principle #5Merging (Combining)

3Device complexity

If single-line laser is used for obstacle detection, then the device structure is simple, but the coverage range is small and cannot detect entire running trajectory

Engineering Contradiction:
Improvedevice structureVSAvoidcoverage range
Core Design Contradiction:
Device complexityVSArea of stationary object

Solution Approach 1:

The system transitions from single-line laser detection to binocular stereo vision, adding spatial dimensionality. The binocular camera captures wide-angle images and reconstructs three-dimensional spatial information, enabling detection of the entire running trajectory and providing comprehensive coverage of the vehicle's path

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Measurement precision

If laser radar is used for obstacle detection, then the device can provide distance information, but the penetration capability is insufficient and manufacture cost is high

Engineering Contradiction:
Improvedistance measurement capabilityVSAvoidmanufacture cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The system replaces expensive laser radar with more cost-effective binocular stereo camera and millimeter-wave radar. The camera provides sufficient distance measurement through stereo vision algorithms, and the radar offers complementary long-range detection, achieving comparable performance at lower manufacturing cost

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

5Device complexity

If ultrasonic radar is used for obstacle detection, then the device structure is simple, but the detection distance is short and it can only detect neighboring obstacles when vehicle is reversed

Engineering Contradiction:
Improvedevice structureVSAvoiddetection distance
Core Design Contradiction:
Device complexityVSLength of stationary object

Solution Approach 1:

The system integrates ultrasonic radar for close-range detection during reversing with binocular camera and millimeter-wave radar for forward detection. This multi-functional approach allows the simple ultrasonic sensors to contribute to overall safety without being limited to only reversing scenarios

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables real-time detection of obstacles within a vehicle's trajectory, reducing collision risks and severity by automatically prompting or braking, especially in scenarios where drivers are fatigued, distracted, or inattentive.

Implementation Method 1

acquiring first target information within a detection range of the binocular stereo camera

Methodology Applied
Scientific EffectBinocular stereo vision: Parallax

Implementation Method 2

second target information within a detection range of a millimeter-wave radar

Methodology Applied
Scientific EffectRadar: Radar

Data Source

PatentUS11738724B2Vehicle braking and warning method, system and device based on binocular stereo camera
Publication Date: 2023.08.29 BEIJING SMARTER EYE TECH CO LTD
  • US11738724B2 patent drawing
  • US11738724B2 patent drawing
  • US11738724B2 patent drawing

AI summary

A vehicle braking and warning method includes: acquiring first target information within a detection range of the binocular stereo camera, second target information within a detection range of a millimeter-wave radar, and current vehicle driving information; acquiring sensing result data about a target obstacle in accordance with the first target information and the second target information in conjunction with a predetermined weight; and outputting a braking instruction and/or a warning instruction in accordance with the sensing result data and the current vehicle driving information so as to enable a vehicle to adjust its driving state in accordance with the instructions.