3D Integral Image Rendering via Eye Position Ray-Tracing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional technologies for displaying three-dimensional images do not consider the viewer's eye position, leading to suboptimal viewing experiences.

Innovation Solution

A method and display system that use a multi-optical element module with lens units to render three-dimensional image data adapted to the viewer's eye position, employing ray-tracing to determine the region of visibility and generate elemental images that form an integral image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional three-dimensional image display technologies are used, then the display can be implemented with existing methods, but the viewing experience is suboptimal because the viewer's eye position is not considered

Engineering Contradiction:
Improveviewing experience qualityVSAvoidadaptability to different eye positions
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic adaptation of the integral image based on detected eye position. The image processing unit dynamically adjusts the rendering of elemental images according to the real-time eye position information, transforming a static display system into one that adapts to varying viewer positions to maintain optimal viewing experience

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates eye position detection as a feedback mechanism. The detector captures eye position information, which is then fed back to the image processing unit to adjust the integral image rendering, creating a closed-loop system that continuously optimizes the three-dimensional image display based on actual viewer position

Inventive Principle:
Principle #23Feedback

2Reliability

If the display system adjusts the three-dimensional image data according to eye position, then the viewing experience is improved, but the device complexity increases due to additional detection and processing requirements

Engineering Contradiction:
Improveviewing experience qualityVSAvoidcomplexity of detection and processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The image processing unit performs multiple functions: it processes the original three-dimensional image data, detects eye position information, calculates the appropriate adjustments to the integral image, and outputs the adjusted image. By consolidating these functions into a single processing unit, the system reduces overall device complexity while maintaining the ability to adapt to different eye positions

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary calculation process that translates eye position information into adjustments for the integral image. Rather than directly modifying the display based on raw eye position data, the system uses an intermediate representation (the adjusted integral image) that bridges the detection mechanism and the final display, simplifying the overall system architecture

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If ray-tracing is used to determine the region of visibility and generate elemental images, then the three-dimensional image is optimized for the viewer's position, but the computational complexity and processing time increase

Engineering Contradiction:
Improveprecision of three-dimensional image renderingVSAvoidimage processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary calculations of the region of visibility and elemental image generation based on detected eye position. By pre-calculating which portions of the three-dimensional image data are visible from the detected eye position and preparing the corresponding elemental images in advance, the system reduces real-time processing requirements while maintaining high rendering precision

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the three-dimensional image into multiple elemental images, each corresponding to a specific lens unit in the multi-optical element module. This segmentation allows the system to process and render only the relevant elemental images needed for the detected eye position, rather than processing the entire three-dimensional image data set, thereby reducing computational complexity and processing time

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the display of high-quality three-dimensional images that are optimized for the viewer's position, providing an improved viewing experience by ensuring the image is correctly rendered and visible without the need for special glasses.

Implementation Method 1

The three-dimensional image is shown when the integral image is projected to a space through the multi-optical element module

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

a region of visibility (RoV) is formed according to ray-tracing information between the eye position and each of the lens units of the multi-optical element module

Methodology Applied
Scientific EffectRay-tracing:

Data Source

PatentUS12219123B2Method for rendering data of three-dimensional image adapted to eye position and display system
Publication Date: 2025.02.04 LIXEL INC
  • US12219123B2 patent drawing
  • US12219123B2 patent drawing
  • US12219123B2 patent drawing

AI summary

A method for rendering data of a three-dimensional image adapted to an eye position and a display system are provided. The method is used to render the three-dimensional image to be displayed in a three-dimensional space. In the method, a three-dimensional image data used to describe the three-dimensional image is obtained. The eye position of a user is detected. The ray-tracing information between the eye position and each lens unit of a multi-optical element module forms a region of visibility (RoV) that may cover a portion of the three-dimensional image in the three-dimensional space. When coordinating the physical characteristics of a display panel and the multi-optical element module, a plurality of elemental images can be obtained. The elemental images form an integral image that records the three-dimensional image data adapted to the eye position, and the integral image is used to reconstruct the three-dimensional image.