3D Display Eye Tracking Latency Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In eye-tracking three-dimensional (3D) displays, latency issues cause a difference between actual and intended eye positions, leading to image quality degradation due to crosstalk, especially when the user moves, as the system takes time to acquire camera images, calculate eye positions, and render pixel values.

Innovation Solution

An operating method that calculates the user's movement range based on eye movement information and adjusts the stereoscopic depth of the 3D image by reducing the disparity between left and right eye images, and switches to a 2D image rendering scheme when the movement exceeds a preset threshold to prevent image quality degradation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If eye tracking is used to provide 3D images with separate left and right eye images, then image quality and 3D effect are improved, but latency occurs due to system processing time, causing a difference between actual and intended eye positions

Engineering Contradiction:
Improveeye position rendering precisionVSAvoidsystem latency
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by predicting future eye positions based on current and past eye movement information before the actual eye tracking data is fully processed. This allows the system to pre-calculate rendering positions, compensating for the inherent processing latency and ensuring that the displayed 3D image corresponds to where the user's eyes will be, rather than where they were when the frame was captured.

Inventive Principle:
Principle #10Preliminary action

2Speed

If the system processes eye movement information in real time, then responsiveness is improved, but image quality degrades due to crosstalk when users move

Engineering Contradiction:
Improveeye tracking responsivenessVSAvoidimage quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The patent implements feedback by continuously monitoring eye movement information and using this data to adjust the rendering process. The system feeds back the detected eye position and movement data to the image generation process, allowing real-time adjustment of the 3D rendering to match actual eye positions and reduce crosstalk artifacts.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary calculations of eye positions and rendering parameters based on predicted eye movements before the actual rendering occurs. This advance preparation allows the system to maintain high responsiveness while ensuring accurate image quality by pre-computing the necessary adjustments for upcoming eye positions.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If disparity between left and right eye images is increased for better 3D depth effect, then stereoscopic depth is improved, but image quality degrades due to crosstalk when eye positions differ from intended positions

Engineering Contradiction:
Improvestereoscopic depthVSAvoidcrosstalk
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by making the disparity between left and right eye images adaptive rather than fixed. The system dynamically adjusts the disparity based on detected eye movement information and predicted eye positions, increasing disparity when eye positions are stable and reducing it when movement is detected, thereby maintaining optimal 3D depth effect while minimizing crosstalk artifacts.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10185145B2Display apparatus and operating method of display apparatus
Publication Date: 2019.01.22 SAMSUNG ELECTRONICS CO LTD
  • US10185145B2 patent drawing
  • US10185145B2 patent drawing
  • US10185145B2 patent drawing

AI summary

An operating method of a display apparatus includes calculating a range of a movement of a user based on eye movement information indicating movements of eyes of the user; and adjusting a stereoscopic depth of a three-dimensional (3D) image based on the range of the movement.