Dynamic Object Behavior Prediction Using Categorical Interaction Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing approaches for predicting dynamic object behavior in autonomous vehicles face challenges in encoding interactions between dynamic objects in complex environments, leading to scalability issues and significant information loss, especially in environments with a large number of dynamic objects.

Innovation Solution

The method involves categorizing dynamic and static objects based on shared characteristics into predefined categories, encoding interactions between these categories using a categorical representation, and generating a unified interaction representation to predict future behavior, which is computationally efficient and scalable.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If individual object interaction encoding is used to model dynamic object behavior, then prediction accuracy for individual objects is improved, but scalability to environments with large numbers of dynamic objects deteriorates

Engineering Contradiction:
Improveprediction accuracyVSAvoidscalability
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the environment into discrete cells and groups dynamic objects into categories based on their properties and behaviors. This segmentation allows the system to process interactions at a categorical level rather than tracking every individual object, thereby maintaining prediction accuracy while improving scalability to environments with large numbers of dynamic objects.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the representation of dynamic objects from individual object tracking to categorical encoding based on key parameters such as object type, motion patterns, and interaction characteristics. This parameter change enables the system to generalize across multiple objects within the same category, reducing computational complexity while preserving essential interaction information for accurate behavior prediction.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If embedding is used to create fixed size representations of interactions, then processing efficiency is improved, but information loss increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidinteraction information loss
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent introduces a categorical dimension to represent interactions, where objects are grouped into categories based on shared characteristics rather than being represented by fixed-size embeddings. This dimensional change allows the system to preserve rich interaction information by maintaining categorical distinctions while achieving fixed-size representations through category aggregation, thus balancing processing efficiency with information retention.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Device complexity

If categorical encoding is used to encode interactions between object categories, then scalability to complex environments is improved, but computation time increases

Engineering Contradiction:
ImprovescalabilityVSAvoidcomputation time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent performs preliminary categorization of dynamic objects into predefined categories based on their properties and behaviors before processing interactions. This preliminary action organizes the data structure in advance, allowing the system to efficiently query and process categorical interactions without requiring complex real-time computations, thereby improving scalability while controlling computation time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12118461B2Methods and systems for predicting dynamic object behavior
Publication Date: 2024.10.15 HUAWEI TECH CO LTD
  • US12118461B2 patent drawing
  • US12118461B2 patent drawing
  • US12118461B2 patent drawing

AI summary

Methods and systems for predicting behavior of a dynamic object of interest in an environment of a vehicle are described. Time series feature data are received, representing features of objects in the environment, including a dynamic object of interest. The feature data are categorized into one of a plurality of defined object categories. Each categorized set of data is encoded into a respective categorical representation that represents temporal change of features within the respective defined object category. The categorical representations are combined into a single shared representation. A categorical interaction representation is generated based on the single shared representation that represents contributions of temporal change in each defined object category to a final time step of the shared representation. The categorical interaction representation together with data representing dynamics of the objects in the environment and data representing a state of the vehicle are used to generate predicted data representing a predicted future behavior of the dynamic object of interest.