3D Virtual Road Scene Modeling for Autonomous Driving Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for training autonomous driving systems require extensive real-world testing, which is resource-intensive, time-consuming, and carries risks such as accidents and damage, limiting scalability and efficiency.

Innovation Solution

A computer-implemented method and system for creating a simulated realistic virtual model of a geographical area, incorporating geographic map data, visual imagery, and dynamic objects, which generates synthetic 3D imaging feeds to train autonomous driving systems, allowing for automated and concurrent training across various scenarios without real-world vehicle movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If real-world testing is used to train autonomous driving systems, then training data authenticity is improved, but resource consumption and time requirements increase significantly

Engineering Contradiction:
Improvetraining data authenticityVSAvoidtraining efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent creates virtual copies of real-world geographical areas, objects, and environments through 3D modeling and rendering. These virtual replicas serve as synthetic training data that mimics real-world conditions without requiring physical testing, thereby maintaining data authenticity while dramatically improving training efficiency and reducing resource consumption.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces physical mechanical testing systems with virtual simulation systems. Instead of moving real vehicles through real geographical areas to collect training data, the system uses computer-generated virtual environments to provide the same training function, eliminating the need for physical resource deployment while maintaining training effectiveness.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If real-world testing is conducted for autonomous driving system training, then scenario diversity is improved, but risk of accidents and damage increases

Engineering Contradiction:
Improvescenario diversityVSAvoidaccident risk
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent creates virtual copies of diverse real-world scenarios including different geographical areas, weather conditions, traffic patterns, and edge cases. These virtual scenarios provide comprehensive scenario diversity for training while eliminating physical risk, as failures in the virtual environment do not result in real-world accidents or damage.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent allows extensive testing and validation of autonomous driving systems in virtual environments before real-world deployment. This beforehand cushioning approach enables the system to fail safely in simulation, learn from errors, and be thoroughly validated against diverse scenarios including rare edge cases, thereby reducing risk when transitioning to real-world operation.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

3Reliability

If extensive real-world testing is performed, then system reliability is improved, but time consumption and resource requirements worsen

Engineering Contradiction:
Improvesystem reliabilityVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent enables continuous virtual training operations without the interruptions inherent in real-world testing. Virtual simulations can run continuously across multiple systems simultaneously, weather conditions, and geographical locations without safety constraints, maximizing the accumulation of training data and improving system reliability more efficiently than sequential real-world testing.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent merges multiple training functions into a unified virtual simulation platform that can simultaneously test diverse scenarios, collect training data, validate system performance, and stress-test edge cases. This consolidation achieves comprehensive reliability validation faster than separate real-world testing programs by parallelizing training operations across virtual environments.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11417057B2Realistic 3D virtual world creation and simulation for training automated driving systems
Publication Date: 2022.08.16 COGNATA LTD
  • US11417057B2 patent drawing
  • US11417057B2 patent drawing
  • US11417057B2 patent drawing

AI summary

A computer implemented method of creating a simulated realistic virtual model of a geographical area for training an autonomous driving system, comprising obtaining geographic map data of a geographical area, obtaining visual imagery data of the geographical area, classifying static objects identified in the visual imagery data to corresponding labels to designate labeled objects, superimposing the labeled objects over the geographic map data, generating a virtual 3D realistic model emulating the geographical area by synthesizing a corresponding visual texture for each of the labeled objects and injecting synthetic 3D imaging feed of the realistic model to imaging sensor(s) input(s) of the autonomous driving system controlling movement of an emulated vehicle in the realistic model where the synthetic 3D imaging feed is generated to depict the realistic model from a point of view of emulated imaging sensor(s) mounted on the emulated vehicle.