Head-Mounted Display Interior Overlay for In-Vehicle VR Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of head-mounted display devices in motor vehicles, such as VR or AR glasses, face safety concerns when immersed in virtual reality as they cannot monitor the vehicle's interior, leading to potential unpleasant interactions with unfamiliar drivers or passengers without visual or auditory cues.

Innovation Solution

A method that integrates a control device to overlay images or video feeds of the vehicle's interior onto the display, allowing users to maintain awareness of their surroundings while immersed in virtual reality, triggered by speech detection or approaching destinations, ensuring safety and comfort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If headphones are used for sound output in virtual reality, then immersive audio experience is improved, but user awareness of vehicle interior and driver interactions deteriorates

Engineering Contradiction:
Improveimmersive audio experienceVSAvoidawareness of vehicle interior
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The audio output is segmented into two channels: immersive audio through headphones for entertainment content, and ambient audio through speakers for vehicle interior sounds. This segmentation allows simultaneous immersive experience and awareness of surroundings.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A control device acts as an intermediary between the sensor device and display device, processing sensor signals and coordinating the output of multiple devices to achieve both immersion and awareness.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If head-mounted display device is worn for virtual reality entertainment, then entertainment immersion is improved, but overview of vehicle interior situation deteriorates

Engineering Contradiction:
Improveentertainment immersionVSAvoidoverview of vehicle interior
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

Visual information is segmented into two streams: virtual reality content through the head-mounted display device and real vehicle interior images through the display device. This allows simultaneous immersion and awareness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The solution adds a new dimension by overlaying or alternating between virtual reality content and real vehicle interior images, creating a multi-layered visual experience that provides both immersion and situational awareness.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If driver touches user on shoulder to get attention, then communication is achieved, but user comfort and safety deteriorates due to unexpected contact

Engineering Contradiction:
Improvedriver communicationVSAvoidunexpected physical contact
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary action by displaying vehicle interior images and providing audio feedback before the driver physically contacts the user, allowing the user to anticipate and prepare for the interaction.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides feedback to the user through the display device and speakers about driver actions and vehicle interior conditions, enabling the user to respond appropriately before physical contact occurs.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP4028819B1Method for operating a head-mounted display apparatus in a motor vehicle, control device, and head-mounted display apparatus
Publication Date: 2023.10.11 AUDI AG
  • EP4028819B1 patent drawing

AI summary

The invention relates to a method for operating a head-mounted display apparatus (14) in a motor vehicle (10) interior. A control device (12) receives a sensor signal from a sensor device (18), wherein the received sensor signal describes (S1) at least one image of the current interior situation of the motor vehicle (10). The sensor device (18) generates a superimposition signal (S2) which describes a superimposition of the at least one image of the current interior situation (S4) while the predefined output content is being output, and transmits the generated superimposition signal to a display element of the display apparatus (14, S3) and thereby causes the display apparatus (14) to superimpose (S4) the at least one image of the current interior situation while the predefined output content is being output.