HMD Display Segmentation for Immersion and Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mountable display (HMD) systems often either obscure the user's view of the real world or require complex optical arrangements to provide both virtual and real-world views simultaneously, lacking in seamless integration of immersion and environmental awareness.

Innovation Solution

The HMD system incorporates a frame with display elements positioned in front of the eyes, using optical components to generate a virtual image at a relaxed viewing distance, and optionally includes a camera and motion sensors to track head movements, allowing for partial transparency or projection of the real environment, and audio processing to simulate immersive audio experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If display elements are positioned directly in front of the user's eyes to provide full immersion, then virtual reality experience is improved, but the user's ability to see the real world is blocked

Engineering Contradiction:
Improveimmersion capabilityVSAvoidreal-world view
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The display system is segmented into multiple independent display elements (first and second display elements) that can be independently controlled. This allows different regions of the display to show different content - virtual reality content in some areas and real-world camera feed in other areas - enabling both immersion and environmental awareness simultaneously

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from a single-dimension display mode (either VR or real world) to a multi-dimensional display mode where virtual and real-world images are composited together in different spatial regions of the field of view, allowing users to access both virtual immersion and real-world awareness in different directional dimensions

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If optical components are used to deflect displayed image for optical see-through HMD, then real-world view is maintained, but device complexity increases

Engineering Contradiction:
Improvereal-world viewVSAvoidoptical arrangement
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The display elements serve multiple functions: they can display virtual reality content, display real-world camera feed, or display both simultaneously in a composited view. This multi-functionality eliminates the need for separate optical paths and components for different display modes, reducing overall device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system replaces complex optical-mechanical deflection arrangements (mirrors, waveguides) with a computational approach where images are composited digitally and displayed directly on planar display elements, simplifying the optical system while maintaining the ability to provide both virtual and real-world views

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a seamless 'full immersion' experience while allowing users to remain aware of their surroundings, with adjustable virtual image size and distance for comfort, and effective audio simulation, enhancing usability in gaming and virtual/augmented reality applications.

Implementation Method 1

a waveguide arrangement employing total internal reflection is used to convey a displayed image from a display device disposed to the side of the user's head

Methodology Applied
Scientific EffectTotal internal reflection: Total Internal Reflection

Implementation Method 2

using appropriate lenses or other optical components which place a virtual displayed image at a suitable distance

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS10095032B2Handling different input signals
Publication Date: 2018.10.09 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10095032B2 patent drawing
  • US10095032B2 patent drawing
  • US10095032B2 patent drawing

AI summary

A head mountable display (HMD) system in which the size and/or distance from the viewer of a virtual screen for display of video material depends upon one or more of the following:whether the video material is in a 2-D or a 3-D format;the image resolution of the video material;the compression quality and/or data rate of the video material;the aspect ratio of the video material;the origin of the video material; andmetadata associated with the video material.