Camera-Based Optical Flow for Vehicle Object Height Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Ultrasonic sensors in vehicles have limited ability to distinguish between objects that are close to each other, such as a curb and an object on the curb, which can hinder autonomous driving and parking operations.

Innovation Solution

Using one or more cameras to detect objects or object heights based on optical flow determinations, allowing the vehicle to differentiate between the heights of objects by analyzing differences in optical flows reflected in captured images, thereby distinguishing between a curb and an object on the curb.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If ultrasonic sensors are used for detecting object proximity, then the vehicle can detect objects in its surroundings, but the sensor cannot distinguish between objects that are close to each other (e.g., curb and object on curb)

Engineering Contradiction:
Improveobject distinction capabilityVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines ultrasonic sensors and cameras into a hybrid detection system. The ultrasonic sensor provides proximity detection while the camera provides visual differentiation capability. By merging these two sensing modalities, the system achieves both object detection and object distinction without relying on a single complex sensor type.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The camera acts as an intermediary sensor that receives light information and converts it into digital images for processing. This intermediary device enables the system to visually distinguish between objects based on their appearance and spatial relationships, complementing the ultrasonic sensor's proximity detection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If camera-based optical flow analysis is used to detect object heights, then the vehicle can distinguish between objects at different heights, but the system complexity increases

Engineering Contradiction:
Improveobject height detection accuracyVSAvoidimage processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical measurement systems with optical flow analysis based on image processing. Instead of using physical sensors to measure height, the system uses camera images and computational algorithms to determine object heights through optical flow calculations, substituting mechanical measurement with optical and computational methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the detection parameter from direct physical measurement to optical flow analysis. By analyzing the movement and position changes of objects across multiple camera frames, the system derives height information from temporal-spatial parameters rather than direct spatial measurement, enabling height detection through image sequence analysis.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate identification and differentiation of object heights, improving object detection and localization, especially during autonomous driving and parking operations, by supplementing ultrasonic sensor data with camera-based optical flow analysis.

Implementation Method 1

detect objects or object heights in proximity to a vehicle using optical flow determinations

Methodology Applied
Scientific EffectOptical flow:

Data Source

PatentUS10699136B2System and method for camera-based detection of object heights proximate to a vehicle
Publication Date: 2020.06.30 FARADAY&FUTURE INC
  • US10699136B2 patent drawing
  • US10699136B2 patent drawing
  • US10699136B2 patent drawing

AI summary

The present invention is generally directed to optical data processing or objects in proximity to an optical sensor or camera, such as a camera mounted on a vehicles. Image data is received from a camera mounted on a vehicle, the image data indicative of a motion of the camera with respect to a detected object within a proximity of the camera or the vehicle on which the camera may be mounted. An optical flow of the object in the image data is determined, and a height of the object is determined based on the determined optical flow.