Autonomous Vehicle AR Overlay for Removing Obstructing Traffic Views

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in providing users with a stress-free experience due to the presence of other vehicles and objects in the real-world environment, which can obstruct scenic views and contribute to physiological stress during traffic or other conditions.

Innovation Solution

The method involves using vehicle-to-vehicle communication to collect data from surrounding vehicles, generating augmented reality images that depict the real-world environment without obstructing objects, and displaying these images on an augmented reality display to overlay and eliminate the appearance of other vehicles and objects from the user's view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous vehicles operate in self-driving mode with users as passengers, then user convenience and automation level are improved, but users experience physiological stress and helplessness due to observing traffic conditions

Engineering Contradiction:
Improveautonomous driving levelVSAvoidphysiological stress
Core Design Contradiction:
Extent of automationVSObject-affected harmful factors

Solution Approach 1:

The patent extracts and removes harmful visual elements (other vehicles and objects causing stress) from the user's field of view by generating augmented reality images that overlay and eliminate these objects, allowing users to benefit from autonomous driving while avoiding the harmful effect of observing traffic conditions

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary augmented reality display system that mediates between the real-world traffic environment and the user's perception, transforming the stressful visual input into a filtered, stress-free view by computationally removing other vehicles and objects

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If users view the real-world environment through autonomous vehicles, then situational awareness is improved, but scenic views are obstructed by other vehicles and objects

Engineering Contradiction:
Improvesituational awarenessVSAvoidscenic view area
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The patent creates a copied and modified version of the real-world environment through augmented reality images that replicate the scene without obstructing objects, allowing users to view scenic areas while the system maintains awareness of actual traffic conditions through sensor data

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11948227B1Eliminating the appearance of vehicles and/or other objects when operating an autonomous vehicle
Publication Date: 2024.04.02 TOYOTA MOTOR ENG & MFG NORTH AMERICA INC
  • US11948227B1 patent drawing
  • US11948227B1 patent drawing
  • US11948227B1 patent drawing

AI summary

Certain embodiments of the present disclosure provide techniques for eliminating an appearance of one or more objects in an environment surrounding a vehicle during operation of the vehicle. A method generally includes detecting the one or more objects in first sensor data collected from first sensors onboard the vehicle, wherein the first sensor data is representative of the environment surrounding the vehicle; receiving, from other vehicles, second sensor data collected from second sensors onboard the other vehicles, wherein the second sensor data is representative of the environment surrounding each of the one or more other vehicles; generating one or more augmented reality images depicting portions of the environment obstructed by the one or more objects in the first sensor data; displaying the one or more augmented reality images in an augmented reality display such that the augmented reality images are positioned to overlay the one or more objects.