Conditional Trajectory Prediction for Interactive Driving Agents

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing autonomous vehicle systems face challenges in accurately predicting the future trajectories of other agents in interactive driving scenarios, such as lane changes and merges, due to the complexity of modeling reactions from various agents like vehicles, cyclists, and pedestrians.

Innovation Solution

A conditional trajectory prediction system that uses neural networks to generate probability distributions over future trajectories of target agents based on a query agent's planned trajectory, allowing for the calculation of interactivity scores to prioritize computational resources on relevant agents, thereby improving the accuracy of motion planning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-fidelity trajectory predictions are generated for all target agents, then prediction accuracy is improved, but computational resources and processing time increase significantly

Engineering Contradiction:
Improvetrajectory prediction accuracyVSAvoidcomputational efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system applies different prediction fidelities to different target agents based on their interactivity scores. High-fidelity predictions are generated only for agents with high interactivity scores (those likely to respond to the query agent's actions), while low-fidelity predictions are used for agents with low interactivity scores. This selective approach maintains prediction accuracy for relevant agents while reducing overall computational resources and processing time.

Inventive Principle:
Principle #3Local quality

2Reliability

If comprehensive trajectory predictions are made for all possible agent interactions, then prediction reliability is improved, but system complexity increases

Engineering Contradiction:
Improveinteraction prediction reliabilityVSAvoidprediction system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The prediction system is segmented into multiple components: an interactivity scoring module that evaluates potential interactions, and a trajectory prediction module that generates predictions only for agents exceeding an interactivity threshold. This segmentation allows the system to maintain reliable predictions for relevant interactions while avoiding the complexity of modeling all possible agent interactions comprehensively.

Inventive Principle:
Principle #1Segmentation

3Loss of information

If marginal probability distributions are calculated for all target agents, then prediction completeness is improved, but computational resources are wasted on irrelevant agents

Engineering Contradiction:
Improveprediction completenessVSAvoidcomputational resource consumption
Core Design Contradiction:
Loss of informationVSLoss of energy

Solution Approach 1:

The system performs partial trajectory predictions by calculating marginal probability distributions only for target agents with high interactivity scores rather than for all agents. This partial action approach ensures that sufficient prediction information is obtained for relevant agents while avoiding the excessive computational resource consumption that would result from predicting distributions for all target agents regardless of their relevance.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11926347B2Conditional agent trajectory prediction
Publication Date: 2024.03.12 WAYMO LLC
  • US11926347B2 patent drawing
  • US11926347B2 patent drawing
  • US11926347B2 patent drawing

AI summary

Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing a conditional behavior prediction for one or more agents. The system obtains context data characterizing an environment. The context data includes data characterizing a plurality of agents, including a query agent and one or more target agents, in the environment at a current time point. The system further obtains data identifying a planned future trajectory for the query agent after the current time point, and for each target agent in the set, processes the context data and the data identifying the planned future trajectory using a first neural network to generate a conditional trajectory prediction output that defines a conditional probability distribution over possible future trajectories of the target agent after the current time point given that the query agent follows the planned future trajectory for the query agent after the current time point.