Head Mounted Display Subject Position Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted display apparatuses face challenges in accurately aligning augmented reality information with moving objects in the real world, leading to misregistration and display delays, and require improvements in user convenience, detection accuracy, downsizing, cost reduction, and manufacturing efficiency.

Innovation Solution

The apparatus includes a superimposition image display control part that estimates the relative position of a subject based on view range and subject movement information, using sensors like RGB and depth sensors, and adjusts the display position accordingly, ensuring accurate alignment of augmented reality information with moving or still objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the display unit displays augmented information in real-time, then the user can see augmented reality information, but misregistration occurs between the subject and augmented information due to display delay

Engineering Contradiction:
Improvealignment accuracyVSAvoiddisplay delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by detecting subject movement in advance and pre-calculating the display position where augmented information should be shown. By anticipating the user's head movement and subject motion, the system prepares the corrected display position before the actual display occurs, thereby compensating for the inherent display delay and preventing misregistration between the subject and augmented information.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the system compensates for head motion only, then display delay for head movement is solved, but misregistration with moving objects remains unresolved

Engineering Contradiction:
Improvedisplay accuracy for head motionVSAvoidhandling of moving objects
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system transitions from a static compensation approach (head motion only) to a dynamic approach that adapts to different scenarios. By detecting whether the subject is moving or stationary and determining the type of motion, the system dynamically adjusts its compensation strategy. This enables the system to handle both head motion compensation and moving object tracking, making it versatile and adaptable to various real-world scenarios.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If multiple sensors and processing functions are added to solve misregistration, then detection accuracy improves, but device complexity increases

Engineering Contradiction:
Improvemotion detection accuracyVSAvoidapparatus configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system employs a camera and sensor suite that serves multiple functions: capturing subject images, detecting subject movement, determining whether the subject is moving or stationary, and providing input for display position calculation. By making these components multi-functional, the system achieves high measurement precision without proportionally increasing device complexity, as the same hardware resources are leveraged across multiple processing tasks.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10529133B2Head mounted display apparatus and control method therefor, and computer program
Publication Date: 2020.01.07 SEIKO EPSON CORP
  • US10529133B2 patent drawing
  • US10529133B2 patent drawing
  • US10529133B2 patent drawing

AI summary

A head mounted display apparatus includes a display unit by which an outside world can be transmissively visually recognized, including: a superimposition image display control part that allows the display unit to display predetermined images in correspondence with positions of subjects in the outside world transmissively visually recognized, a view range movement information acquisition part that acquires view range movement information representing a motion of the display unit, and a subject movement information acquisition part that acquires subject movement information representing a relative motion of the subject to the display unit. When the acquired view range movement and acquired subject movement information are substantially not matched, the superimposition image display control part estimates a relative position of the subject to the display unit after a predetermined time based on at least the subject movement information, and determines a display position of the predetermined image based on the estimated relative position.