2D Trajectory Channels for Low-Compute Agent Behavior Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current autonomous vehicle systems face challenges in accurately predicting the behavior of target agents, such as pedestrians or other vehicles, which hinders their ability to make fully-autonomous or partly-autonomous driving decisions efficiently and safely.

Innovation Solution

A system that uses a convolutional neural network to process historical data representing the trajectory of target agents as a collection of two-dimensional channels, allowing for the generation of behavior prediction data that characterizes future trajectories and driving decisions, thereby enabling more accurate and resource-efficient decision-making.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional methods are used to process trajectory data for behavior prediction, then measurement precision may be adequate, but computational resource consumption increases and processing efficiency decreases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidcomputational resource consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent transforms 3D trajectory data (x, y, z coordinates over time) into 2D channel representations where spatial information is mapped to 2D arrays. This dimensionality reduction allows convolutional neural networks to process the data more efficiently while preserving essential motion patterns, thereby improving processing efficiency and reducing computational resource consumption.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The trajectory data is segmented into multiple channels, each representing different aspects of motion (e.g., position, velocity, acceleration). This segmentation allows the system to process different motion characteristics independently and in parallel, improving overall processing efficiency while reducing the computational burden on any single processing unit.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If complex processing methods are used to improve behavior prediction accuracy, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improvebehavior prediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex traditional trajectory processing algorithms with a convolutional neural network that operates on simplified 2D channel representations. This substitution maintains high prediction accuracy by leveraging the pattern recognition capabilities of CNNs while reducing the overall system complexity through more efficient data representation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If detailed trajectory data is processed to improve prediction accuracy, then measurement precision improves, but loss of time increases due to longer processing duration

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

By converting 3D trajectory data into 2D channel representations, the system reduces the computational complexity of processing detailed trajectory information. This allows the convolutional neural network to analyze comprehensive motion data quickly, maintaining high prediction accuracy while significantly reducing processing time.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11003189B2Trajectory representation in behavior prediction systems
Publication Date: 2021.05.11 WAYMO LLC
  • US11003189B2 patent drawing
  • US11003189B2 patent drawing
  • US11003189B2 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a representation of a trajectory of a target agent in an environment. In one aspect, the representation of the trajectory of the target agent in the environment is a concatenation of a plurality of channels, where each channel is represented as a two-dimensional array of data values. Each position in each channel corresponds to a respective spatial position in the environment, and corresponding positions in different channels correspond to the same spatial position in the environment. The channels include a time channel and a respective motion channel corresponding to each motion parameter in a predetermined set of motion parameters.