Trajectory Prediction Using Temporal Logic and Tree Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in navigating through environments with third-party objects whose behavior is unknown or uncontrolled, leading to difficulties in route planning and increased risk of accidents due to the complexity of obstacles and behaviors encountered.

Innovation Solution

The use of temporal logic and tree search algorithms to predict the behavior of third-party objects, incorporating machine learning and sensor data to generate accurate trajectories for the autonomous vehicle, while optimizing performance and safety.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional route planning methods are used to navigate through environments with third-party objects, then the autonomous vehicle can operate with simple control systems, but the accuracy of trajectory prediction and safety are reduced due to inability to handle unknown or uncontrolled behaviors of third-party objects

Engineering Contradiction:
ImprovesafetyVSAvoidcontrol system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the trajectory prediction problem into multiple candidate trajectories generated through tree search, where each trajectory represents a possible future state. This segmentation allows the system to evaluate multiple potential outcomes independently and select the safest option, resolving the contradiction between safety and system complexity by breaking down the complex prediction task into manageable discrete candidates.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary generation of multiple candidate trajectories using tree search before final decision-making. By pre-computing possible future states and evaluating them against safety criteria, the system prepares multiple contingency plans in advance, enabling safer navigation without requiring complex real-time control during execution.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If comprehensive sensor data and machine learning are used to predict third-party object behavior, then the accuracy of trajectory prediction is improved, but the computational load increases

Engineering Contradiction:
Improvetrajectory prediction accuracyVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by generating a limited set of candidate trajectories (e.g., top-k candidates) rather than exhaustively exploring all possible trajectories. This partial exploration maintains sufficient prediction accuracy for safety-critical decisions while significantly reducing computational load compared to complete enumeration of all possible future states.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system dynamically adjusts parameters such as the number of candidate trajectories to evaluate, the depth of tree search, and the level of detail in sensor data processing. By changing these parameters based on situational context, the system optimizes the balance between prediction accuracy and computational energy consumption.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If multiple candidate trajectories are generated and evaluated using temporal logic, then the safety and accuracy of navigation are improved, but the complexity of the planning algorithm increases

Engineering Contradiction:
Improvetrajectory planning accuracyVSAvoidplanning algorithm complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex continuous trajectory optimization with discrete tree search and temporal logic evaluation. Instead of using continuous mathematical optimization methods, the system uses discrete candidate generation followed by logical evaluation, which simplifies the planning algorithm structure while maintaining high accuracy through systematic exploration of possible futures.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces temporal logic formulas as an intermediary layer between candidate trajectory generation and final selection. These formulas serve as mediators that systematically evaluate whether candidate trajectories satisfy safety and task requirements, providing a structured approach to complex multi-constraint evaluation without requiring direct complex optimization.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Reliability

If the system evaluates all possible trajectories of third-party objects, then the completeness of behavior prediction is improved, but the processing time and computational resources are excessively consumed

Engineering Contradiction:
Improveprediction completenessVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs partial evaluation by focusing computational resources on the most promising candidate trajectories rather than exhaustively evaluating all possible trajectories. By using heuristics and temporal logic to prioritize and prune the search space, the system achieves sufficient prediction completeness for safety-critical decisions within acceptable processing time constraints.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent implements skipping by pruning branches in the tree search that are unlikely to lead to optimal or safe trajectories. By skipping evaluation of improbable or dominated candidate trajectories, the system rapidly processes the essential subset of possibilities without sacrificing the reliability of the final prediction.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentUS10671076B1Trajectory prediction of third-party objects using temporal logic and tree search
Publication Date: 2020.06.02 ZOOX INC
  • US10671076B1 patent drawing
  • US10671076B1 patent drawing
  • US10671076B1 patent drawing

AI summary

Techniques for generating trajectories for autonomous vehicles and for predicting trajectories for third-party objects using temporal logic and tree search are described herein. Perception data about an environment can be captured to determine static objects and dynamic objects. For a particular dynamic object, which can represent a third-party vehicle, predictive trajectories can be generated to represent possible trajectories based on available options and rules of the road. Operations can include determining probabilities that a third-party vehicle will execute a predictive trajectory and updating the probabilities over time as motion data is captured. Predictive trajectories can be provided to the autonomous vehicle and commands for the autonomous vehicle can be based on the predictive trajectories. Further, determining a trajectory can include utilizing a Monte Carlo Tree Search (MCTS) to search for possible trajectories, while using Linear Temporal Logic (LTL) formulas to validate or reject the possible trajectories.