3D Image Rendering for HUDs via Catadioptric Optical Transformations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D image rendering technologies face challenges in accurately rendering three-dimensional images for heads-up displays (HUDs) due to errors caused by approximations in refractive index calculations, leading to artifacts and reduced image quality, especially when using parallax barriers or lenticular lenses.

Innovation Solution

A method and apparatus for a 3D image rendering system that utilizes a catadioptric system, including a concave or convex mirror, to determine the direction of rays and assign pixel values based on precise optical transformations, considering the refractive indices of media between the display panel and optical layers, thereby improving image accuracy and reducing artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If approximations in refractive index calculations are used for 3D image rendering, then calculation complexity is reduced, but image accuracy deteriorates causing artifacts

Engineering Contradiction:
Improvecalculation complexityVSAvoidimage accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent changes the calculation parameters from using approximated refractive indices to using precise optical transformation parameters that account for the actual optical paths through the catadioptric system. This involves calculating ray directions based on accurate refraction and reflection models rather than simplified approximations, thereby improving image accuracy while managing computational complexity through efficient rendering algorithms.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the traditional mechanical/optical approximation methods with a computational approach that uses precise optical transformation calculations. Instead of relying on simplified physical models, the system uses computer-based ray tracing and optical path calculations that accurately model the catadioptric system's behavior, substituting physical approximation with computational precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If precise optical transformations are applied considering refractive indices, then image accuracy is improved, but calculation complexity increases

Engineering Contradiction:
Improveimage accuracyVSAvoidcalculation complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary optical transformation calculations to determine the mapping between display panel pixels and optical images before actual image rendering. By pre-calculating ray directions and optical paths based on the catadioptric system's optical characteristics, the system establishes accurate correspondence relationships in advance, which then guides the rendering process and reduces real-time computational complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a computational model (optical transformation model) that copies and simulates the physical optical paths through the catadioptric system. This virtual model allows the system to calculate ray directions and pixel mappings without performing complex physical measurements during rendering, replacing physical complexity with computational efficiency while maintaining accuracy.

Inventive Principle:
Principle #26Copying

3Ease of operation

If optical systems (mirror or lens) are used to change light direction for glasses-free 3D, then user convenience is improved, but rendering complexity increases due to light direction changes

Engineering Contradiction:
Improveuser convenienceVSAvoidrendering complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary computational layer (optical transformation model) that mediates between the display content and the optical system. This intermediary model captures the light direction changes caused by the catadioptric system and translates them into appropriate pixel mappings, allowing the rendering system to account for optical complexity without directly managing the physical light paths, thus reducing rendering complexity while maintaining user convenience.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The proposed solution enhances the accuracy of 3D image rendering by directly determining viewpoint positions and assigning pixel values based on the actual optical images and ray directions, reducing errors and artifacts, and improving the overall 3D image quality for HUDs.

Implementation Method 1

a catadioptric system configured to magnify an image output by the 3D display apparatus and to transfer the image to a user

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

The direction of the ray may be determined based on a first refractive index of a medium disposed between the display panel and an optical layer in the 3D display apparatus and a second refractive index of a medium disposed outside the 3D display apparatus and the optical layer

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS11457194B2Three-dimensional (3D) image rendering method and apparatus
Publication Date: 2022.09.27 SAMSUNG ELECTRONICS CO LTD
  • US11457194B2 patent drawing
  • US11457194B2 patent drawing
  • US11457194B2 patent drawing

AI summary

A three-dimensional (3D) image rendering method for a heads-up display (HUD) system including a 3D display apparatus and a catadioptric system is provided. The 3D image rendering method includes determining optical images corresponding to both eyes of a user by applying, to each of the positions of the eyes, an optical transformation that is based on an optical characteristic of the catadioptric system, and rendering an image to be displayed on a display panel included in the 3D display apparatus, based on a position relationship between the optical images and the display panel.