Goal-Based Motion Forecasting With GNN Intent and Trajectory Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current autonomous systems face challenges in accurately predicting the motion of dynamic objects in traffic scenes, leading to inefficiencies in motion planning and decision-making for autonomous platforms.

Innovation Solution

A machine-learned forecasting model, specifically a graph neural network, is trained to predict the future behavior of actors in a traffic scene by processing state and map data, generating discrete intent and continuous motion outputs, including goal probabilities, interaction probabilities, and trajectories, to improve motion planning accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional motion prediction methods are used, then the system complexity is low, but the prediction accuracy and reliability are insufficient

Engineering Contradiction:
Improveprediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical prediction methods with a machine-learned graph neural network model. The GNN processes actor observations and map geometry to generate discrete intent and continuous motion outputs, achieving superior prediction accuracy while managing system complexity through neural network architecture.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a graph neural network as an intermediary between raw sensor data and motion planning decisions. The GNN transforms actor observations and map geometry into meaningful predictions of future actor positions and interactions, serving as a bridge that enhances prediction reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If complex machine-learned models are deployed, then the forecasting accuracy improves, but the computational speed and efficiency decrease

Engineering Contradiction:
Improveforecasting accuracyVSAvoidcomputational speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the motion forecasting task into discrete components: the GNN generates separate outputs for discrete intent (goal probability, interaction probability) and continuous motion (trajectory). This segmentation allows parallel processing and optimization of different prediction aspects, improving overall computational efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary processing by generating discrete intent predictions (goal probability, interaction probability) before final trajectory generation. This preliminary classification of actor intentions allows the system to focus computational resources on relevant prediction aspects, improving speed without sacrificing accuracy.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If more actor observations and map geometry data are processed, then the prediction reliability improves, but the data processing time increases

Engineering Contradiction:
Improveprediction reliabilityVSAvoiddata processing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent creates a universal GNN model that simultaneously processes multiple data types (actor observations, map geometry) and generates multiple prediction outputs (discrete intent, continuous motion) in a single unified framework. This multi-functionality reduces redundant processing and improves efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent transforms raw actor observations and map geometry into standardized feature representations suitable for GNN processing. By changing the parameter representation of input data into appropriate formats, the model can efficiently process diverse information without excessive computation time.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240217558A1Goal-based Motion Forecasting
Publication Date: 2024.07.04 AURORA OPERATIONS INC
  • US20240217558A1 patent drawing
  • US20240217558A1 patent drawing
  • US20240217558A1 patent drawing

AI summary

Example aspects of the present disclosure relate to an example computer-implemented method for predicting the intent of actors within an environment. The example method includes obtaining state data associated with a plurality of actors within the environment and map data indicating a plurality of lanes of the environment. The method includes determining a plurality of potential goals each actor based on the state data and the map data. The method includes processing the state data, the map data, and the plurality of potential goals with a machine-learned forecasting model to determine (i) a forecasted goal for a respective actor of the plurality of actors, (ii) a forecasted interaction between the respective actor and a different actor of the plurality of actors based on the forecasted goal, and (iii) a continuous trajectory for the respective actor based on the forecasted goal.