HMD Head Orientation Tracking for Mixed Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current head-mountable display (HMD) systems either obscure the user's view of the real world or require complex optical arrangements for see-through functionality, lacking in seamless integration of virtual and real-world environments for immersive experiences.

Innovation Solution

The HMD system incorporates a frame with display elements positioned in front of the eyes, using optical components to create a virtual image at a relaxed viewing distance, and optionally includes a camera for capturing real-world views, allowing for partial transparency or projection of external environments, along with motion sensing and image processing to track head movements and adjust the displayed viewpoint accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If display devices are positioned directly in front of the user's eyes to provide virtual reality content, then immersion in virtual environment is improved, but user's view of the real world is obscured

Engineering Contradiction:
Improveimmersion in virtual environmentVSAvoidview of real world
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The display system is segmented into multiple display devices (e.g., left and right eye displays) that can be independently controlled. This allows different content to be presented to each eye, enabling selective presentation of virtual reality content while maintaining the ability to switch to real-world viewing when needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The HMD system dynamically switches between displaying virtual reality content and allowing real-world view based on detected head movements or user interaction. The display elements can be selectively activated or deactivated, creating a dynamic viewing experience that adapts to user needs and resolves the contradiction between immersion and real-world awareness.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If optical components are used to create virtual image at relaxed viewing distance, then viewing comfort is improved, but device complexity increases

Engineering Contradiction:
Improveviewing comfortVSAvoidoptical components
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

Instead of using complex optical components to create virtual images at distance, the system uses display elements that directly present images at comfortable viewing distances. The optical complexity is replaced by computational methods and direct-display technology, maintaining viewing comfort while reducing mechanical complexity.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces traditional mechanical optical systems (lenses, mirrors, waveguides) with electronically controlled display elements. This substitution reduces mechanical complexity while maintaining or improving viewing comfort through electronic adjustment of display parameters.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If display devices are positioned away from user's eyes to allow real-world view, then real-world awareness is improved, but immersion in virtual content deteriorates

Engineering Contradiction:
Improvereal-world awarenessVSAvoidimmersion in virtual content
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The system dynamically adjusts the position and activation state of display elements based on user behavior and context. When virtual immersion is needed, displays activate and position themselves optimally; when real-world awareness is needed, displays deactivate or reduce intensity, allowing seamless transition between immersion modes and real-world viewing.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The same display elements serve multiple functions: they can provide immersive virtual reality content when activated, and allow real-world view when deactivated or dimmed. This multi-functionality resolves the contradiction by making a single system capable of both immersion and awareness rather than requiring separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Adaptability or versatility

If motion sensing and image processing are implemented to track head movements, then seamless integration of virtual and real environments is improved, but device complexity increases

Engineering Contradiction:
Improveintegration of virtual and real environmentsVSAvoidmotion sensing and image processing
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system implements feedback loops where motion sensors detect head movements, the control system processes this information, and the display elements adjust accordingly in real-time. This feedback mechanism enables seamless integration of virtual and real environments by continuously adapting the displayed content to match user head position and orientation, creating a cohesive immersive experience.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a more immersive experience by seamlessly integrating virtual and real-world environments, allowing users to focus on virtual content while maintaining awareness of their surroundings, with improved comfort and reduced bulkiness through efficient placement of display components and motion tracking.

Implementation Method 1

a display element providing a virtual image of a video display

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

a partially reflective mirror placed in front of the user's eyes so as to allow the user to see through the mirror but also to see a reflection of the output of the display devices

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 3

a waveguide arrangement employing total internal reflection is used to convey a displayed image from a display device disposed to the side of the user's head

Methodology Applied
Scientific EffectTotal internal reflection: Total Internal Reflection

Data Source

PatentUS11507201B2Virtual reality
Publication Date: 2022.11.22 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11507201B2 patent drawing
  • US11507201B2 patent drawing
  • US11507201B2 patent drawing

AI summary

A virtual reality apparatus includes a head mountable display (HMD); a detector to detect a deviation of a current orientation of the HMD from a base orientation of the HMD; and a generator to generate content for presentation to the wearer of the HMD to prompt the wearer of the HMD to turn his head so as to change the orientation of the HMD towards the base orientation.