Multi-Agent Trajectory Prediction Using Interaction Points

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current autonomous vehicle systems face challenges in accurately predicting future trajectories of multiple agents in a scene due to the complexity of multi-agent interactions, which can lead to inconsistent and inaccurate predictions.

Innovation Solution

A multi-stage prediction model is implemented that explicitly accounts for multi-agent interactions by dividing complex scenarios into smaller pieces, factoring out multi-modality into spatial-temporal interaction points, allowing for accurate and consistent trajectory predictions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multi-agent interactions are explicitly modeled using a multi-stage prediction model, then trajectory prediction accuracy and consistency are improved, but computational complexity and model structure complexity increase

Engineering Contradiction:
Improvetrajectory prediction accuracyVSAvoidmodel structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the complex multi-agent trajectory prediction task into multiple sequential stages: (1) interaction point prediction between agent pairs, (2) trajectory prediction conditioned on interaction points, and (3) consistency enforcement across multiple modalities. This segmentation allows the model to handle complexity in manageable steps while maintaining high prediction accuracy through explicit interaction modeling.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces interaction points as intermediary elements that mediate between agents and their trajectories. These interaction points serve as explicit representations of where and when agents will interact, acting as a bridge that connects agent states to predicted trajectories while capturing multi-modal interaction possibilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If interaction points are explicitly predicted for each agent pair, then interaction pattern identification and explainability are improved, but computational resources and processing time increase

Engineering Contradiction:
Improveinteraction pattern explainabilityVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs interaction point prediction as a preliminary step before generating final trajectories. By first identifying where and when interactions will occur between agent pairs, the model prepares structured information that guides subsequent trajectory prediction, reducing the computational burden of directly predicting complex multi-agent interactions from scratch.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If the model accounts for multiple space-time interaction points, then multi-modality in interactions is captured, but the difficulty of detecting and measuring interaction scenarios increases

Engineering Contradiction:
Improvemulti-modality captureVSAvoidinteraction scenario detection
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies local quality by treating each agent pair's interaction separately with its own predicted interaction points, rather than attempting to model all interactions globally at once. This allows the model to capture multi-modality in a localized, manageable way for each pair while maintaining overall system consistency through the sequential prediction stages.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12049221B2Multi-modal multi-agent trajectory prediction
Publication Date: 2024.07.30 WAYMO LLC
  • US12049221B2 patent drawing
  • US12049221B2 patent drawing
  • US12049221B2 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using temporal-spatial interaction predictions.