Virtual Augmented Support for Autonomous Vehicle Safety

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicle systems face challenges in navigating situations outside their operational design domain, such as road environments or vehicle component failures, without human intervention, necessitating a remote support system to provide safe and efficient navigation.

Innovation Solution

A virtual augmented support environment is created by a remote support system, which receives sensor data from the vehicle, instantiates a virtual support element in a simulated environment, and generates navigation controls to guide the vehicle through the physical environment, allowing the vehicle to follow a safe path and avoid hazards.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a remote support system is implemented to handle situations outside operational design domain, then safety and reliability are improved, but system complexity and cost increase

Engineering Contradiction:
ImprovesafetyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

A virtual augmented support environment is introduced as an intermediary between the autonomous vehicle system and remote human operators. This virtual environment receives sensor data from the vehicle, generates a simulated representation of the physical environment, and allows remote operators to interact with and guide the vehicle through challenging situations without requiring direct physical presence or complex communication protocols

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a virtual copy or replica of the physical environment by processing sensor data and generating a simulated environment that mirrors the real-world conditions. This virtual copy allows remote operators to see and interact with the same environment the vehicle experiences, enabling effective guidance without requiring complex direct control interfaces

Inventive Principle:
Principle #26Copying

2Productivity

If remote support is provided without human presence in every vehicle, then operational efficiency is improved, but the ability to address complex situations may be reduced

Engineering Contradiction:
Improveoperational efficiencyVSAvoidability to address complex situations
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The virtual augmented support environment serves as an intermediary that bridges the gap between remote operators and the vehicle's autonomous system. It translates complex sensor data and environmental conditions into a comprehensible virtual representation that remote operators can effectively use to guide the vehicle through diverse and challenging situations

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system adds a virtual dimension to the physical environment by creating a simulated representation that overlays or complements the real-world scene. This additional virtual layer provides remote operators with enhanced situational awareness and guidance capabilities, allowing them to effectively manage complex situations from a remote location

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11249474B2Safety of autonomous vehicles using a virtual augmented support environment
Publication Date: 2022.02.15 SERVE OPERATING CO
  • US11249474B2 patent drawing
  • US11249474B2 patent drawing
  • US11249474B2 patent drawing

AI summary

A virtual support element may be activated when it is beneficial to assist an autonomous drive system of the vehicle through a physical environment having one or more hazards. A remote support system generates the virtual support element (e.g., a virtual vehicle) that can be controlled through a simulated environment that corresponds to a physical environment of a vehicle. The autonomous drive system of the vehicle follows a path through the physical environment corresponding to the path of the virtual support element through the simulated environment corresponding to the physical environment.