Head Mount Display Head Motion Tracking and AR Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image display technologies fail to effectively present first-person viewpoint images captured by external cameras, such as those on mobile apparatuses, with realistic immersion and dynamic alignment with the user's head motion, especially for wide-angle and panoramic views.

Innovation Solution

An image display apparatus with a display unit mounted on the user's head, incorporating a posture detecting unit and a display control unit that adjusts the image display based on head posture, including clipping, convergence point adjustment, and AR image superimposition, to provide a realistic and immersive viewing experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a head mount display is designed to completely block the outside world when mounted on the head of a user, then the sense of immersion during the viewing is increased, but the user cannot perceive the real-world environment

Engineering Contradiction:
Improvesense of immersionVSAvoidisolation from real-world environment
Core Design Contradiction:
Ease of manufactureVSObject-affected harmful factors

Solution Approach 1:

The patent merges the virtual image display function with the real-world viewing function by positioning the display unit to overlay virtual images on the user's field of view rather than completely blocking it. This allows simultaneous perception of both virtual content and real environment, resolving the contradiction between immersion and environmental awareness.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary mechanism where the display unit acts as a semi-transparent overlay that mediates between the virtual image source and the real-world view. This intermediary approach allows the user to perceive both layers simultaneously, achieving immersion without complete isolation from the environment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of moving object

If a wide-angle image is displayed to follow head motion, then the viewing coverage is increased, but the image quality and focus may deteriorate

Engineering Contradiction:
Improveviewing coverageVSAvoidimage quality
Core Design Contradiction:
Area of moving objectVSManufacturing precision

Solution Approach 1:

The patent segments the wide-angle image into multiple display regions corresponding to different head positions and orientations. By dividing the overall wide-angle view into manageable segments that can be selectively displayed based on detected head motion, the system maintains image quality within each segment while providing extensive overall coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic image rendering where the displayed image content and parameters continuously adapt to the user's head motion. The system dynamically adjusts which portion of the wide-angle image is displayed and how it is focused, maintaining optimal image quality throughout the range of motion rather than using a static wide-angle display.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If different images are displayed for the right and left eyes to present a 3D image, then the three-dimensional effect is improved, but the device complexity increases

Engineering Contradiction:
Improvethree-dimensional effectVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent implements a universal display approach where a single display unit serves both eyes simultaneously by projecting images that naturally diverge to each eye's retina. This multi-functional approach achieves 3D effect without requiring separate display units for each eye, thereby reducing device complexity while maintaining the three-dimensional effect.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10108018B2Image display apparatus for displaying an image captured by a mobile apparatus
Publication Date: 2018.10.23 SONY GROUP CORP
  • US10108018B2 patent drawing
  • US10108018B2 patent drawing
  • US10108018B2 patent drawing

AI summary

A first-person viewpoint image captured by a camera mounted on a radio-controlled model is displayed on a head mount display and is enjoyed. When a whole-sky image captured by a camera unit that is mounted on a model apparatus is reproduced and displayed with a head mount display, a CPU moves the display field so as to offset the motion of the head of a user detected by a posture/location detecting unit. In this manner, an image that follows the motion of the head of the user is displayed. Meanwhile, on the side of the head mount display, a combined image generated by superimposing an AR image as virtual image information on the actual image in the display field is displayed.