HMD Image Blending via Eye-Tracking and Resolution Profiles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In Head Mounted Displays (HMDs), blending high-resolution images with lower resolution images to create a combined image is challenging due to pupil movement, which causes discontinuities and shearing, and differing effective focal lengths, leading to misalignment and degraded user experience.

Innovation Solution

The use of intensity and resolution profiles to smoothly blend images, combined with eye-tracking to adjust image positions and focal lengths, ensuring seamless integration of high-resolution images within lower resolution images, reducing discontinuities and shearing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If high-resolution images are inset into lower resolution images in HMDs, then image quality in the central field of view is improved, but discontinuities and shearing occur due to pupil movement

Engineering Contradiction:
Improveimage qualityVSAvoidimage alignment
Core Design Contradiction:
Manufacturing precisionVSStability of the object's composition

Solution Approach 1:

The patent implements dynamic adjustment of image parameters based on real-time pupil position tracking. The system continuously monitors pupil movement and adjusts the positioning and blending of high-resolution and low-resolution images accordingly, transforming a static image display system into a dynamic one that adapts to changing viewing conditions, thereby eliminating discontinuities and shearing effects caused by pupil movement

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms by using eye-tracking technology to monitor pupil position and using this information to adjust image presentation parameters. The pupil position data feeds back into the image processing pipeline, enabling real-time compensation for pupil movement and maintaining proper alignment between high-resolution and low-resolution image regions

Inventive Principle:
Principle #23Feedback

2Stability of the object's composition

If images are blended together to create a combined image, then visual continuity is improved, but misalignment occurs due to differing effective focal lengths

Engineering Contradiction:
Improvevisual continuityVSAvoidimage alignment
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent applies different quality characteristics to different regions of the combined image. The high-resolution image is presented in the central field of view where the user's attention is focused, while the lower-resolution image fills the peripheral regions. This local differentiation allows the system to optimize for both visual continuity across the entire field of view and high image quality in the critical central region

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically changes image parameters including resolution, position, and blending ratios based on pupil position and viewing conditions. By adjusting these parameters in real-time, the system maintains proper alignment between images with different effective focal lengths and ensures visual continuity across the combined image while preserving high resolution in the central region

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10692186B1Blending inset images
Publication Date: 2020.06.23 META PLATFORMS TECHNOLOGIES LLC
  • US10692186B1 patent drawing
  • US10692186B1 patent drawing
  • US10692186B1 patent drawing

AI summary

A first image and a second image are presented to a user of a head mounted display (HMD) so that the first image and the second image are perceived as a combined image. The first image is inset into the second image and the first image may be a higher resolution image than the second image. The first image and the second image may be presented at different focal lengths and various techniques are utilized to gracefully blend the first image and the second image.