Spatiotemporal Costmap Inference for Interpretable Autonomous Driving

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous driving systems face challenges in replicating natural and interpretable driver behavior, leading to unusual vehicle navigation in various driving scenarios, which can impact safety and efficiency.

Innovation Solution

A computer-implemented method and system for spatiotemporal costmap inference using neural networks to determine observations and goal information from dynamic and environment-based data, training a neural network to output spatiotemporal costmaps, and controlling an ego agent to autonomously operate based on these costmaps, mimicking human driving behaviors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional autonomous driving control methods are used, then the system can operate autonomously, but the driving behavior appears unusual and difficult to interpret for other traffic participants

Engineering Contradiction:
ImproveInterpretability of driving behaviorVSAvoidSafety in traffic environment
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces an intermediary representation layer (costmap) that translates complex autonomous driving decisions into intuitive spatial cost representations that other traffic participants can understand. This costmap serves as a mediator between the autonomous system's internal state and external communication, making behavior interpretable while maintaining safety through structured decision-making frameworks.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system copies human-like driving behavior patterns by learning from human demonstration data. Instead of relying on rigid rule-based systems, the autonomous vehicle replicates natural human driving decisions through learned policies, producing behavior that appears natural and interpretable to other traffic participants while maintaining safety through systematic optimization.

Inventive Principle:
Principle #26Copying

2Ease of operation

If complex objective functions are formulated to balance safety, efficiency, and smoothness, then driving behavior becomes more natural, but formulating such objectives becomes non-trivial and difficult

Engineering Contradiction:
ImproveNatural driving behaviorVSAvoidComplexity of objective formulation
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical formulation of objective functions with learning-based approaches. Instead of manually designing and tuning multiple objective functions for safety, efficiency, and smoothness, the system learns optimal driving policies from data, automatically capturing these competing objectives without requiring explicit mathematical formulation by engineers.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the parameter representation from explicit objective function weights to learned policy parameters. By transforming the problem from optimizing weighted sums of hand-crafted objectives to learning parameters that directly encode natural driving behavior, the complexity of objective formulation is significantly reduced while maintaining natural behavior.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If autonomous driving systems prioritize safety and interpretability, then behavior becomes more natural, but navigation efficiency may be impacted in various driving scenes

Engineering Contradiction:
ImproveNatural and interpretable behaviorVSAvoidNavigation efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent introduces dynamic adaptation of driving behavior through learned policies that can adjust between safety-oriented and efficiency-oriented modes based on contextual factors. The system dynamically selects and combines different behavioral strategies rather than adhering to fixed rules, allowing it to maintain natural and interpretable behavior while optimizing navigation efficiency for various driving scenes.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20230071810A1System and method for providing spatiotemporal costmap inference for model predictive control
Publication Date: 2023.03.09 HONDA MOTOR CO LTD
  • US20230071810A1 patent drawing
  • US20230071810A1 patent drawing
  • US20230071810A1 patent drawing

AI summary

A system and method for providing spatiotemporal costmap inference for model predictive control that includes receiving dynamic based data and environment based data to determine observations and goal information associated with an ego agent and a traffic environment. The system and method also include training a neural network with the observations and goal information and determining an optimal path of the ego agent based on at least one spatiotemporal costmap. The system and method further include controlling the ego agent to autonomously operate based on the optimal path of the ego agent.