Mobile Agent Prediction Model Using Context Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for predicting the future positions of mobile agents in environments with multiple interacting entities, such as vehicles and pedestrians, often fail to accurately capture interactions between agents, leading to unrealistic behavior predictions.

Innovation Solution

A computer-implemented method that uses a machine-learned prediction model to forecast future states of mobile agents by incorporating current shared context data, including maps and traffic lights, and adapting intermediate values based on predicted destinations, employing techniques like multi-class classification and dot-product attention mechanisms to enhance prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing prediction methods are used, then the prediction process is simple, but the prediction accuracy and realism of mobile agent behavior is poor

Engineering Contradiction:
Improveprediction accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The prediction model is segmented into multiple specialized components: a shared context encoder that processes map and traffic light information, individual agent encoders that process each agent's state, and a trajectory predictor that generates future positions. This segmentation allows each component to specialize in specific aspects of the prediction task, improving overall accuracy while managing complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The model employs nested encoding structures where the shared context encoder's output is nested within the agent state encoding, which in turn is nested within the trajectory prediction process. This nested architecture allows hierarchical processing of information at different levels of abstraction, capturing both global contextual factors and individual agent characteristics simultaneously.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Reliability

If interaction between mobile agents is captured, then prediction realism improves, but computational complexity increases

Engineering Contradiction:
Improvebehavior realismVSAvoidinteraction modeling complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The model merges the encoding of shared context (map and traffic lights) with the encoding of individual agent states into a unified representation. This combined encoding allows interaction effects to emerge naturally from the joint processing of contextual and agent-specific information, capturing realistic behaviors without requiring explicit interaction terms for every agent pair.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The shared context encoder serves multiple functions: it processes map information, processes traffic light information, and provides contextual conditioning for all agent predictions simultaneously. This multi-functional design allows the model to capture interaction effects efficiently through a single shared representation rather than requiring separate processing paths for each interaction type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP4296898A1Prediction method and system, computer program, computer-readable medium
Publication Date: 2023.12.27 TOYOTA JIDOSHA KK
  • EP4296898A1 patent drawingFigure 1
  • EP4296898A1 patent drawingFigure 2
  • EP4296898A1 patent drawingFigure 3

AI summary

Method for predicting a future state (st+1) at a future time step (t+1) of mobile agents, the state (st) of a mobile agent comprising a pose and an attribute (u) of the agent. The method comprises: S100) obtaining a current shared context (M,C) comprising at least a map (M); S200) obtaining a current state (st) of the mobile agents (st); S300) passing the current state (st) of the mobile agents through a prediction model (SE,PM) taking into account the current shared context (M,C), thereby obtaining successive encoded intermediate values (es1-es7), and calculating said future state (st+1) based on of the last intermediate value (es7). Step S300 comprises: S360) determining predicted destinations (PLj) for at least part of the mobile agents (MAi); and at step S300, an encoded value used to calculate at least said future state (st+1) is calculated based on the predicted destinations (g).