Head-Mounted Display Overlay for Vehicle Interior Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In autonomously driving motor vehicles, users wearing head-mounted display devices for immersive entertainment lose awareness of their surroundings, particularly in ride-hailing situations, leading to discomfort and safety concerns due to inability to perceive the driver or other passengers without removing the device.

Innovation Solution

A method that superimposes real-time images or video feeds of the vehicle's interior onto the head-mounted display, allowing users to remain aware of their environment while immersed in virtual or augmented reality, using a controller to receive sensor data and generate superposition signals for display, ensuring awareness without disrupting the immersive experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the head-mounted display device completely shields the user's eyes against light to provide immersive virtual reality, then the virtual reality experience is improved, but the user loses awareness of the surrounding environment including the driver and other passengers

Engineering Contradiction:
Improvevirtual reality experience qualityVSAvoidawareness of vehicle interior
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent combines virtual reality content with real-world camera feeds into a single integrated display output. The head-mounted display simultaneously presents both the virtual entertainment content and the captured images of the vehicle interior, allowing users to experience immersive VR while maintaining awareness of their physical surroundings including the driver and other passengers.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If earphones are used to provide sound for virtual reality entertainment, then the immersive experience is improved, but the user cannot acoustically perceive the driver or other passengers

Engineering Contradiction:
Improvesound experience qualityVSAvoidacoustic awareness of vehicle interior
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent uses visual information from cameras as an intermediary to convey audio-related awareness. Since earphones block acoustic perception, the system captures images of the vehicle interior including the driver's mouth movements and facial expressions, allowing users to visually perceive when the driver is speaking without removing the head-mounted display or earphones.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If the head-mounted display device is used for immersive entertainment, then entertainment quality is improved, but the user feels less safe and comfortable due to lack of awareness of the driver's actions

Engineering Contradiction:
Improveentertainment experience qualityVSAvoiduser safety and comfort
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent implements preliminary action by continuously capturing and displaying images of the vehicle interior before any potential safety issues arise. The camera system is always active, providing real-time visual feedback about the driver's actions and other passengers, allowing users to maintain awareness and take preventive action if needed, rather than waiting for a problem to occur.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11922585B2Method for operating a head-mounted display apparatus in a motor vehicle, control device, and head-mounted display apparatus
Publication Date: 2024.03.05 AUDI AG
  • US11922585B2 patent drawing

AI summary

A control device in a motor vehicle receives a signal from a sensor device which includes at least one image of the current interior situation. The control device generates a superimposition signal containing the at least one image of the current interior situation and transmits the superimposition signal to a display element of a display apparatus. The display apparatus superimposes the at least one image of the current interior situation onto predefined output content output to a user.