Radar Optical Flow Estimation Using Radial Velocity Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional computer vision techniques for processing digital images lack effective utilization of radial velocity information, which is present in high-resolution imaging radar data, leading to suboptimal performance in motion estimation and object tracking.

Innovation Solution

Adapting computer vision techniques, such as segmentation and optical flow estimation, to incorporate radial velocity information from high-resolution imaging radar data, using this information as a constraint to improve image processing and analysis, particularly in systems like image processing systems operating in vehicles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional computer vision techniques are used for processing radar images, then the processing can be performed with standard algorithms, but the accuracy of motion estimation and optical flow is suboptimal due to lack of radial velocity information utilization

Engineering Contradiction:
Improveoptical flow estimation accuracyVSAvoidradial velocity information utilization
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent modifies conventional optical flow algorithms by incorporating radial velocity information as an additional constraint parameter. This changes the mathematical model from using only intensity constraints to using both intensity and velocity constraints, thereby improving measurement precision of motion estimation while utilizing previously unused radial velocity data from radar images

Inventive Principle:
Principle #35Parameter changes

2Reliability

If radial velocity information is incorporated as a constraint in optical flow estimation, then motion estimation accuracy is improved, but the computational complexity and processing requirements increase

Engineering Contradiction:
Improvemotion estimation reliabilityVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides the image processing into distinct segments: first processing intensity information to obtain initial optical flow estimates, then separately processing radial velocity information as a constraint, and finally combining both constraints. This segmentation allows the complex processing to be broken down into manageable stages, improving reliability without overwhelming computational complexity

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If conventional image segmentation techniques are used, then the segmentation can be performed with standard methods, but the segmentation accuracy is reduced due to inability to utilize radial velocity information for boundary detection

Engineering Contradiction:
Improvesegmentation accuracyVSAvoidsegmentation method adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent implements a dynamic segmentation approach where the segmentation process adapts by incorporating radial velocity information. The segmentation boundaries are dynamically adjusted based on velocity discontinuities detected in the radar images, allowing the system to achieve higher accuracy while maintaining adaptability to different scene conditions through the flexible integration of velocity constraints

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances the accuracy and stability of optical flow estimation and image segmentation, enabling better motion estimation and object tracking, and reduces the window size required for processing, resulting in more efficient image processing and analysis.

Implementation Method 1

Each pixel includes radial velocity information... generated by a radar... uses the Doppler effect to measure radial velocity information

Methodology Applied
Scientific EffectDoppler effect: Doppler Effect

Data Source

PatentUS10042047B2Doppler-based segmentation and optical flow in radar images
Publication Date: 2018.08.07 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US10042047B2 patent drawing
  • US10042047B2 patent drawing
  • US10042047B2 patent drawing

AI summary

In an embodiment, a method for processing a sequence of images is provided. The method receives a sequence of images generated by a radar. Each image includes a plurality of pixels. Each pixel includes radial velocity information. The method estimates optical flow for the pixels within an image in the sequence of images by using the radial velocity information for the pixels as a constraint.