Motion-Based Object Detection for Autonomous Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional object detection systems for autonomous vehicles are inadequate in detecting fast-moving objects and require extensive training, often failing to recognize blurred objects and are limited to stationary scenarios, leading to incomplete and impractical solutions.

Innovation Solution

The system employs motion-based object detection by analyzing sequential sensor data using optical flow analysis to identify feature tracks that violate path constraints, allowing for the identification of dynamic objects without prior knowledge, utilizing pixel-level computation and parallel processing for efficient detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If deep neural network approaches are used for object detection, then the system can recognize objects with prior training, but it requires large amounts of training data for every different type of hazard and cannot detect blurred objects quickly entering the pathway

Engineering Contradiction:
Improveobject detection accuracyVSAvoidtraining data requirements
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent changes the detection parameters from object classification (requiring training data) to motion analysis (requiring only geometric constraints). Instead of training DNNs on numerous object types, the system uses optical flow to detect motion patterns that violate geometric constraints, enabling detection without prior training while maintaining reliability for fast-moving objects

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the machine learning-based DNN system with a physics-based geometric constraint verification system. Instead of using neural networks that require extensive training, the system uses optical flow analysis combined with geometric constraint checking to detect objects, substituting a training-intensive approach with a constraint-based approach

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If conventional background segmentation approaches are used to detect moving objects, then the system can separate foreground movements from static background, but it relies on a stationary camera which is not possible when the sensor is attached to a dynamic or moving object

Engineering Contradiction:
Improvemoving object detectionVSAvoidcamera motion compatibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent transforms the static background segmentation approach into a dynamic motion analysis system. Instead of assuming a stationary camera and static background, the system uses optical flow to compute motion vectors that account for camera movement, enabling reliable detection of moving objects regardless of whether the camera is stationary or mounted on a dynamic platform

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent merges the camera motion estimation with the object detection process. By combining optical flow analysis with geometric constraint verification, the system simultaneously handles camera motion compensation and moving object detection, making the system adaptable to both stationary and dynamic camera scenarios

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If the system uses pixel level computation and parallel processing for motion-based detection, then the detection speed and efficiency are improved, but the computational complexity increases

Engineering Contradiction:
Improvedetection speedVSAvoidcomputational requirements
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the image processing into distinct stages: optical flow computation at pixel level, feature tracking, and geometric constraint verification. This segmentation allows parallel processing of independent operations while managing computational complexity by breaking down the overall task into manageable components that can be executed concurrently

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12159417B2Motion-based object detection for autonomous systems and applications
Publication Date: 2024.12.03 NVIDIA CORP
  • US12159417B2 patent drawing
  • US12159417B2 patent drawing
  • US12159417B2 patent drawing

AI summary

In various examples, an ego-machine may analyze sensor data to identify and track features in the sensor data using. Geometry of the tracked features may be used to analyze motion flow to determine whether the motion flow violates one or more geometrical constraints. As such, tracked features may be identified as dynamic features when the motion flow corresponding to the tracked features violates the one or more static constraints for static features. Tracked features that are determined to be dynamic features may be clustered together according to their location and feature track. Once features have been clustered together, the system may calculate a detection bounding shape for the clustered features. The bounding shape information may then be used by the ego-machine for path planning, control decisions, obstacle avoidance, and/or other operations.