Head-Mountable Display With Motion Tracking And Segmented Optics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mountable display (HMD) systems either obscure the user's view of the surrounding environment or require complex optical arrangements to provide both virtual and real-world views, lacking in seamless integration of motion tracking and user-specific motion data utilization for enhanced immersion and interaction.

Innovation Solution

The HMD system incorporates a frame with display elements positioned in front of the eyes, using optical components to create a virtual image at a relaxed viewing distance, and includes motion sensing capabilities through cameras or hardware detectors to track head movements, allowing for dynamic adjustment of the displayed viewpoint and incorporating user-specific motion data for tailored interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If display devices are positioned directly in front of the user's eyes with lenses to create a virtual image, then the user can focus on virtual content at a relaxed distance, but the real-world view is obscured

Engineering Contradiction:
Improvevirtual image positioning accuracyVSAvoidreal-world view obstruction
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The display system is divided into multiple independent display regions within the field of view, with each region corresponding to a specific display device. This allows different portions of the visual field to serve different functions - some areas display virtual content while others maintain transparency to the real world, resolving the contradiction between virtual image focus and real-world visibility

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the display system have different optical properties - some areas use opaque display elements for virtual content while other areas use transparent or translucent elements for real-world viewing. This local differentiation allows the system to provide both virtual image focus and real-world visibility simultaneously in different spatial locations

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If partially reflective mirrors are used to deflect displayed images while allowing real-world view, then both virtual and real-world views are provided, but the optical arrangement becomes complex

Engineering Contradiction:
Improvedual view capabilityVSAvoidoptical arrangement complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the optical deflection function from complex mirror-based systems and replaces it with a simplified display element arrangement that directly presents images to the eyes. By removing the intermediate optical deflection components, the system achieves dual view capability with significantly reduced optical complexity while maintaining adaptability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical optical system (mirrors, lenses, complex arrangements) with a more direct presentation system where display elements are positioned to naturally direct light to the eyes. This substitution eliminates complex optical components while preserving the ability to provide both virtual and real-world views

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If motion sensing capabilities are added to track head movements, then dynamic viewpoint adjustment is enabled for enhanced immersion, but the device complexity increases

Engineering Contradiction:
Improvedynamic viewpoint adjustmentVSAvoidmotion sensing system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display system automatically adjusts the viewpoint based on detected head motion without requiring complex external control systems. The motion sensing capabilities are integrated directly into the display apparatus, allowing it to self-regulate and adapt to user movements, thereby reducing overall system complexity while maintaining high adaptability for dynamic viewpoint adjustment

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration provides a seamless and immersive experience by allowing users to focus on virtual content while optionally seeing the real world, with dynamic viewpoint adjustment and personalized interaction based on user motion data, enhancing usability and comfort.

Implementation Method 1

using optical components to create a virtual image at a relaxed viewing distance

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

motion sensing capabilities through cameras or hardware detectors to track head movements

Methodology Applied
Scientific EffectMotion detection:

Data Source

PatentEP3008548B1Head-mountable apparatus and systems
Publication Date: 2020.05.06 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3008548B1 patent drawingFigure 1~2
  • EP3008548B1 patent drawingFigure 3
  • EP3008548B1 patent drawingFigure 4~5

AI summary

A head mountable display (HMD) is provided that has a head motion detection function and one or more operations that depend upon detected head motion. Detected head motion is stored as motion data in memory. The way in which detected head motion is applied to a current operation depends upon the stored motion data. In one embodiment, the HMD includes a gaze detector configured to detect eye orientation of a user of the user so as to detect image regions at which the user is looking, and a detector configured to detect item data indicative of items represented by the detected image regions.