AR Window Notifications for Autonomous Vehicle Intent Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles lack effective means to communicate with passengers, delivery recipients, and other stakeholders, as they do not have a human driver to provide verbal information or directions, posing challenges in conveying messages and information during operations.

Innovation Solution

An augmented reality notification system for autonomous vehicles that detects events such as current or impending states and intentions, generates images with text and graphics information, and displays them on vehicle windows to convey information to users outside the vehicle, utilizing a display control system, onboard computer, and sensor suite to project or display images on windows.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous vehicles operate without a human driver, then automation level increases, but communication capability with users deteriorates

Engineering Contradiction:
Improveautomation levelVSAvoidcommunication capability
Core Design Contradiction:
Extent of automationVSLoss of information

Solution Approach 1:

The patent introduces an augmented reality display system as an intermediary between the autonomous vehicle's control system and external users. This mediator translates vehicle states and intentions into visual communications on windows, bridging the information gap created by removing the human driver.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical/verbal communication system (human driver speaking) with an optical/electronic system (augmented reality display on windows). This substitution maintains communication functionality while preserving the automation achieved by removing the driver.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If augmented reality display system is added to autonomous vehicle, then communication capability improves, but device complexity increases

Engineering Contradiction:
Improvecommunication capabilityVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent designs the augmented reality display system to serve multiple functions simultaneously: displaying vehicle state information, communicating intentions to pedestrians and other drivers, providing navigation feedback, and enhancing safety. This multi-functionality justifies the added complexity by delivering substantial communication benefits across various operational scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11760370B2Augmented reality notification system
Publication Date: 2023.09.19 GM CRUISE HOLDINGS LLC
  • US11760370B2 patent drawing
  • US11760370B2 patent drawing
  • US11760370B2 patent drawing

AI summary

The present disclosure provides a method comprising detecting an event in connection with an autonomous vehicle, wherein the detected event comprises at least one of a current state of the autonomous vehicle, an impending state of the autonomous vehicle, and an intent of the autonomous vehicle; generating an image in connection with the detected event, wherein the image comprises at least one of text information and graphics information; and displaying the generated image on at least one window of the autonomous vehicle for conveying information about the detected event to at least one user located outside the autonomous vehicle.