Autonomous Vehicle Simulation Playback for Algorithm Debugging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional sensor data playback systems for autonomous vehicles lack the ability to selectively replay data from specific time periods, do not allow customization of playback speed, and fail to demonstrate the impact of revised algorithms on overall vehicle performance, making it difficult to diagnose software bugs effectively.

Innovation Solution

A vehicle simulation computer with a graphical user interface that allows users to play back and analyze sensor data from autonomous vehicles, enabling simulation of driving behavior based on real-world data, and allowing for the comparison of revised algorithms with previous versions to assess their impact on system performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional sensor data playback systems replay all sensor data continuously, then complete data coverage is achieved, but the ability to selectively analyze specific time periods or compare algorithm revisions is lost

Engineering Contradiction:
Improveselective data playback capabilityVSAvoidalgorithm performance comparison capability
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent segments sensor data by associating timestamps with each data point and organizing data into discrete time periods. This allows users to selectively playback and analyze specific time segments rather than continuously replaying all data, enabling focused debugging and algorithm comparison while maintaining complete data coverage in the segmented structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary organization of sensor data with timestamps and algorithm version identifiers before playback. This pre-processing structures the data so that selective time-period playback and algorithm comparison are efficiently enabled during actual use, without requiring complex filtering during playback itself.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If sensor data from all time periods is played back, then comprehensive analysis is possible, but the time required to diagnose specific issues increases

Engineering Contradiction:
Improvedebugging accuracyVSAvoiddiagnosis time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The playback system dynamically adjusts to user needs by allowing selection of specific time periods and algorithm versions for analysis. Rather than statically replaying all data, the system enables dynamic filtering and focused playback of relevant segments, improving debugging accuracy while reducing the time required to identify specific issues.

Inventive Principle:
Principle #15Dynamics

3Reliability

If the system stores and processes all sensor data without selection, then complete scenario reconstruction is achieved, but system complexity and resource requirements increase

Engineering Contradiction:
Improvescenario reconstruction accuracyVSAvoiddata processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system extracts and stores essential metadata (timestamps, algorithm version identifiers, sensor identifiers) alongside sensor data. This extraction enables selective reconstruction of scenarios by pulling out only the necessary data elements for specific analysis needs, maintaining scenario reconstruction accuracy while reducing overall system complexity and resource requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11820373B2Autonomous vehicle simulation system
Publication Date: 2023.11.21 CREATEAI INC
  • US11820373B2 patent drawing
  • US11820373B2 patent drawing
  • US11820373B2 patent drawing

AI summary

Techniques for analysis of autonomous vehicle operations are described. As an example, a method of autonomous vehicle operation includes storing sensor data from one or more sensors located on the autonomous vehicle into a storage medium, performing, based on at least some of the sensor data, a simulated execution of one or more programs associated with the operations of the autonomous vehicle, generating, based on the simulated execution of the one or more programs and as part of a simulation, one or more control signal values that control a simulated driving behavior of a simulated vehicle, and providing a visual feedback of the simulated driving behavior of the simulated vehicle on a simulated road.