Context-Aware HMD Transparency for Environmental Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wearable computing devices, such as head-mounted displays, hinder user interaction with the environment due to obstructed vision, leading to socially awkward situations and reduced usability.

Innovation Solution

A context-aware display system that analyzes data from cameras and sensors to determine if objects, like approaching people, are of interest, allowing the device to adjust transparency and display representations or indicators within the interface, enabling users to interact without removing the device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a head-mounted display interface covers the user's eyes to provide immersive virtual or augmented reality experience, then the user experience and entertainment capabilities are improved, but the user's ability to interact with people and objects in the environment is inhibited

Engineering Contradiction:
Improveuser experienceVSAvoidinteraction with environment
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The interface is configured with different transparency characteristics in different regions. A first region has a first transparency value while a second region has a second transparency value that is greater than the first, creating localized transparency variations that allow environmental interaction while maintaining immersive display quality in other areas

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The transparency values of different regions are dynamically adjusted based on detected environmental factors. When motion is detected in the environment, the system modifies transparency values to allow users to see and interact with approaching objects or people, and restores original transparency values when no environmental activity is detected

Inventive Principle:
Principle #15Dynamics

2Duration of action of stationary object

If the HMD interface maintains full coverage to provide continuous immersive experience, then the virtual reality experience is maintained, but the user cannot see approaching people or objects without removing the device

Engineering Contradiction:
Improveimmersive experience continuityVSAvoidenvironmental awareness
Core Design Contradiction:
Duration of action of stationary objectVSLoss of information

Solution Approach 1:

Motion detection sensors continuously monitor the environment in advance to detect approaching objects or people before they reach the user. When motion is detected, the system proactively adjusts transparency values in relevant regions to alert the user, maintaining environmental awareness while preserving immersive experience continuity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses sensors to detect environmental conditions and provides feedback by adjusting transparency values accordingly. This closed-loop feedback mechanism ensures the user remains aware of important environmental events while maintaining the immersive experience

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10503996B2Context-aware display of objects in mixed environments
Publication Date: 2019.12.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10503996B2 patent drawing
  • US10503996B2 patent drawing
  • US10503996B2 patent drawing

AI summary

Concepts and technologies are described herein for providing a context-aware display of objects in mixed environments. The computing device displays an image on an interface. Data associated with at least one object is obtained from one or more resources, such as a camera, sensor and/or an external device. The obtained data is analyzed to determine if the object is of interest. Any number of factors, including a context associated with the object, may be used to determine if an object is of interest. The computing device modifies a display property, such as a transparency parameter, of a selected portion of the image, depending on obtained data and/or contextual data. Depending on the obtained data and/or contextual data, the computing device may display a visual indicator representing the object, an image of the object within the selected portion of the image, and/or any other object or indicator.