Deterministic Agents for Autonomous Vehicle Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Simulating agent behavior in autonomous vehicle systems is challenging due to the inherent randomness in rules-based agents, leading to inconsistent outcomes and difficulties in evaluating vehicle safety and reliability.

Innovation Solution

Implementing deterministic agents whose actions are predictable and repeatable, determined by parameter values and initial conditions, allowing for consistent simulation results and reduced variability in agent behavior.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If rules-based agents with inherent randomness are used, then agent behavior can adapt to various situations, but simulation results become inconsistent and unreliable for evaluating vehicle safety

Engineering Contradiction:
Improveagent behavior adaptabilityVSAvoidsimulation result consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The agent's decision-making process is segmented into multiple discrete rules that are evaluated in a specific sequence. Each rule represents a distinct behavioral condition, and the agent systematically evaluates rules in order until one matches the current situation, eliminating randomness by structuring adaptability through ordered rule segments rather than probabilistic choices

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The rule priority ordering is made dynamic and configurable, allowing the sequence of rule evaluation to be adjusted based on different simulation scenarios and safety requirements. This dynamic configuration enables the same agent framework to adapt to various situations while maintaining deterministic, repeatable behavior for identical inputs

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If rules-based agents make binary decisions based on conflicting rules, then specific traffic rules can be followed, but the complexity of managing rule priorities and conflicts increases

Engineering Contradiction:
Improvetraffic rule complianceVSAvoidrule management complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

Traffic rules are segmented into discrete, independently evaluable conditions with explicit priority levels. Instead of managing complex rule interactions, the system divides behavior into separate rule segments that are evaluated sequentially, making rule management more systematic and less complex

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Rules are pre-configured with priority orderings and evaluation sequences before simulation execution. The system performs preliminary setup of the rule hierarchy, so during simulation the agent simply follows the predetermined evaluation order without needing to resolve conflicts in real-time, reducing operational complexity

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If random behavior is introduced in agents, then simulation can model real-world variability, but it becomes difficult to verify fixes and understand ego vehicle behavior

Engineering Contradiction:
Improvereal-world variability modelingVSAvoidbehavior verification accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system creates deterministic copies of agent behavior that replicate real-world patterns without introducing randomness. By copying observed behavioral patterns into fixed rule sequences, the simulation maintains realism while ensuring that identical inputs always produce identical outputs, enabling precise verification and debugging

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11775706B2Deterministic agents for simulation
Publication Date: 2023.10.03 TOYOTA JIDOSHA KK
  • US11775706B2 patent drawing
  • US11775706B2 patent drawing
  • US11775706B2 patent drawing

AI summary

Systems and methods simulation of an ego vehicle using deterministic agents may include obtaining a set of deterministic agents for the simulation of the ego vehicle; executing the simulation of the ego vehicle using deterministic agents of the set of deterministic agents to provide simulated traffic in the simulation; determining and outputting a current state of the simulation; determining an agent action based on the determined current state; and requesting an update of a deterministic agent of the set of deterministic agents based on the determined agent action.