Head Tracker Integrated Display Substrate for VR Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional virtual reality display systems cause user dizziness due to image rendering delays, which result in a latency of at least 16.6 milliseconds when the user's gaze changes, leading to an unsatisfactory experience.

Innovation Solution

A display apparatus with a head tracker and driving controller integrated on a display substrate, generating a temporary image based on user movement information to reduce latency by selectively displaying either the input image or the temporary image until new input data is received, thereby minimizing the delay in image rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image data is generated by reflecting user's gaze changes in conventional display systems, then the image reflects the user's gaze accurately, but a delay of at least 16.6 milliseconds occurs due to rendering time

Engineering Contradiction:
Improvegaze tracking accuracyVSAvoidimage rendering delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by generating a temporary image in advance using previous frame data and user movement information before the new input image is ready. This temporary image is displayed during the rendering delay period to maintain visual continuity and reduce perceived latency, while the accurate gaze-tracking input image is prepared simultaneously in the background.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a temporary image as an intermediary between the user's actual gaze and the newly rendered input image. This intermediary image, generated from movement data and previous frames, bridges the time gap caused by rendering delays, providing continuous visual feedback without waiting for the complete input image to be ready.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a gaze detecting sensor and processing units are used to generate accurate image data reflecting user's gaze, then the image alignment with user's gaze is improved, but the system complexity increases

Engineering Contradiction:
Improvegaze detection accuracyVSAvoidsystem structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image generation process into two independent paths: one path handles accurate gaze-tracking input images through sensors and processing units, while the other path generates temporary images using movement information and previous frame data. This segmentation allows the system to maintain high gaze detection accuracy while reducing overall complexity by distributing processing tasks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a copy of the previous frame data and modifies it based on movement information to generate temporary images. This copying approach avoids the need for complex real-time rendering for every display update, as the temporary image is a derived copy rather than a completely new rendering, thereby reducing system complexity while maintaining acceptable visual fidelity.

Inventive Principle:
Principle #26Copying

3Illumination intensity

If the display device operates at 60 Hz to provide smooth image refresh, then the display quality is improved, but the delay due to one frame rendering time increases to at least 16.6 milliseconds

Engineering Contradiction:
Improvedisplay refresh qualityVSAvoidframe rendering delay
Core Design Contradiction:
Illumination intensityVSLoss of time

Solution Approach 1:

The patent ensures continuity of useful action by continuously generating and displaying temporary images based on movement information and previous frames, even when the new input image is not yet ready. This continuous display of intermediate content maintains the smooth 60 Hz refresh quality while eliminating idle delay periods that would otherwise occur during image rendering transitions.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11521580B2Display apparatus and virtual reality display system for generating a temporary image based on head tracking information
Publication Date: 2022.12.06 SAMSUNG DISPLAY CO LTD
  • US11521580B2 patent drawing
  • US11521580B2 patent drawing
  • US11521580B2 patent drawing

AI summary

The present disclosure provides a display apparatus including a head tracker obtaining information of movement of a user and formed on a display substrate and generating a temporary image using the information of the movement of the user. The head tracker is configured to output information of movement of a user to the driving controller. The driving controller is configured to generate a temporary image based on the information of the movement of the user. The display panel is configured to selectively display an input image and the temporary image.