Lane-Attention Trajectory Prediction for Autonomous Collision Avoidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in accurately predicting the movement of moving obstacles due to the difficulty in estimating a driver's intention, which is influenced by the surrounding static environment, such as road shapes and lane structures.

Innovation Solution

The use of attention mechanisms and Long Short-Term Memory (LSTM) networks to learn the relationship between a driver's intention and a moving obstacle's position relative to road infrastructures, forming a spatiotemporal graph to predict the intended movement of obstacles using Graph Neural Networks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional prediction methods are used to estimate moving obstacle trajectories, then the system complexity remains low, but the prediction accuracy deteriorates due to inability to capture driver intention and environmental influences

Engineering Contradiction:
Improvetrajectory prediction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The prediction system is segmented into multiple specialized modules: LSTM network for temporal sequence modeling, Graph Neural Network for spatial relationship modeling, and attention mechanism for feature weighting. Each module handles specific aspects of trajectory prediction, allowing complex processing to be distributed across modular components that can be independently optimized and trained.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An attention mechanism serves as an intermediary between the LSTM extracted features and the final trajectory prediction. This attention layer weights and selects the most relevant features from the LSTM output, enabling the system to focus on critical patterns while filtering noise, thus improving prediction accuracy without proportionally increasing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If simple prediction models are used, then the computational resources required are low, but the ability to capture spatial and temporal relationships with road infrastructure deteriorates

Engineering Contradiction:
Improvedriver intention estimation accuracyVSAvoidcomputational energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The LSTM network performs preliminary processing of temporal sequences to extract meaningful features before the final prediction stage. By pre-processing and encoding temporal patterns in advance, the system reduces the computational burden on subsequent layers, as the complex temporal dynamics are already captured and condensed into informative feature representations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The problem is transformed from traditional Euclidean space to a graph-structured space where road infrastructure and moving obstacles are represented as nodes and edges. This non-Euclidean representation allows the Graph Neural Network to naturally capture spatial relationships and topological structures, improving accuracy while maintaining computational efficiency through localized message passing operations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If comprehensive environmental factors are considered in prediction, then the prediction accuracy improves, but the processing time and system complexity increase

Engineering Contradiction:
Improvecollision avoidance reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The LSTM network continuously processes temporal sequences of obstacle positions and environmental factors, maintaining a running understanding of the scene without requiring re-processing of historical data. This continuous processing allows the system to incorporate new information in real-time while leveraging accumulated temporal context, improving reliability without linearly increasing processing time.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The Graph Neural Network applies different processing strategies to different parts of the graph structure based on local characteristics. Nodes representing critical infrastructure elements or high-risk obstacles receive more detailed processing, while less critical elements use simplified processing. This local differentiation allows comprehensive environmental modeling while optimizing computational resources for high-impact factors.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11860634B2Lane-attention: predicting vehicles' moving trajectories by learning their attention over lanes
Publication Date: 2024.01.02 BAIDU USA LLC
  • US11860634B2 patent drawing
  • US11860634B2 patent drawing
  • US11860634B2 patent drawing

AI summary

An obstacle state evolution of a spatial position of a moving obstacle over a period of time is determined. A lane-obstacle relation evolution of the moving obstacle with each of one or more lanes near the moving obstacle over the period of time is further determined. An intended movement of the moving obstacle is predicted based on the obstacle state evolution and the lane-obstacle evolution. Thereafter, a trajectory of the ADV is planned to control the ADV to avoid a collision with the moving obstacle based on the predicted intended movement of the moving obstacle. The above process is iteratively performed for each of the moving obstacles detected within a predetermined proximity of the ADV.