3D Display Eye Position Prediction for Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional display devices experience a time lag between eye position detection and image display, leading to discomfort when eye positions change during use, as the displayed image may not accurately reflect the current eye positions.

Innovation Solution

A three-dimensional display system that includes a detection device for continuously acquiring eye position data and a controller that uses prediction functions to anticipate future eye positions, allowing for timely adjustment of image display on a display panel with a parallax barrier, ensuring accurate and comfortable three-dimensional image viewing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If eye position detection and image display are performed sequentially without prediction, then the system structure is simple, but the time lag causes discomfort when eye positions change

Engineering Contradiction:
Improveaccuracy of displayed image matching current eye positionVSAvoidcomplexity of prediction function and processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary action by calculating prediction functions based on previously detected eye positions before the actual display occurs. The controller uses these prediction functions to estimate future eye positions at the time of image display, thereby compensating for the inherent time lag in the detection-display process without requiring complex real-time prediction mechanisms

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If eye position detection frequency is increased to reduce time lag, then the accuracy of eye position tracking improves, but the processing load and system complexity increase

Engineering Contradiction:
Improveaccuracy of eye position detectionVSAvoidprocessing load and system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system creates a computational copy of the eye position detection process by calculating prediction functions that model eye position changes. Instead of increasing detection frequency, the system uses these prediction function copies to estimate future eye positions based on historical detection data, thereby maintaining measurement precision while avoiding the processing load of high-frequency detection

Inventive Principle:
Principle #26Copying

3Speed

If real-time eye position tracking is implemented without prediction, then the response time is fast, but the displayed image does not accurately reflect current eye positions due to processing delay

Engineering Contradiction:
Improveresponse speed of eye position trackingVSAvoidaccuracy of eye position matching displayed image
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system implements feedback by continuously detecting eye positions and using this information to update prediction functions. The controllers use these updated prediction functions to estimate future eye positions, creating a closed-loop system where past detection results feed into future predictions, thereby maintaining both fast response speed and high accuracy in matching displayed images to current eye positions

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3840374B1Three-dimensional display device, three-dimensional display system, head-up display, and mobile body
Publication Date: 2023.07.19 KYOCERA CORP
  • EP3840374B1 patent drawingFigure 1
  • EP3840374B1 patent drawingFigure 2
  • EP3840374B1 patent drawingFigure 3

AI summary

A three-dimensional display device includes a display panel, a parallax barrier, an acquisition section, a memory, and a controller. The display panel is configured to display a parallax image and emit image light corresponding to the parallax image. The parallax barrier includes a surface configured to define a direction of image light. The acquisition section is configured to acquire positional data indicating eye positions from a detection device which is configured to detect eye positions based on photographed images which are acquired from a camera which is configured to image user's eyes. The memory is configured to store the positional data which are acquired by the acquisition section. The controller is configured to output predicted eye positions based on the positional data stored in the memory, and cause the display panel to display the parallax image, based on the predicted eye positions. The controller is configured to generate a left-eye image and a right-eye image based on a first predicted eye position, and combine the left-eye image and the right-eye image into a parallax image based on a second predicted eye position, which is different from the first predicted eye position.