3D Image Rendering via Virtual Viewpoint Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for providing three-dimensional (3D) images, particularly in augmented reality, face challenges in accurately rendering depth perception without the need for glasses, as they often rely on optical systems that require complex calculations and can result in artifacts due to approximations in refractive index differences.

Innovation Solution

A method that calculates virtual viewpoints based on eye position information and optical system characteristics, generating stereo images within a graphic space coordinate system, and rendering 3D images using these viewpoints through an optical system, which includes determining frustum information and object poses to create a seamless depth perception experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If optical systems (mirror or lens) are used to provide 3D images, then depth perception is enabled, but the direction of light must be changed which complicates rendering calculations

Engineering Contradiction:
Improvedepth perception accuracyVSAvoidrendering calculation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent creates virtual viewpoints that represent the optical transformation of real viewpoints through the optical system. Instead of performing complex ray-tracing calculations for each pixel, the system pre-calculates and stores virtual viewpoint positions that already account for the optical system's light direction changes. This copying approach replaces complex computational processes with pre-computed reference data.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary calculation of virtual viewpoints based on the optical system's characteristics before actual 3D image rendering. By pre-computing the transformed viewpoint positions that account for mirror or lens light direction changes, the system prepares rendering parameters in advance, avoiding complex real-time calculations during the rendering process.

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If approximations in refractive index differences are used in optical systems, then device complexity is reduced, but artifacts appear in the rendered 3D image

Engineering Contradiction:
Improveoptical calculation simplicityVSAvoidimage rendering accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent creates accurate virtual viewpoints that copy the precise optical transformation effects without using approximations. By calculating virtual viewpoint positions that exactly represent how light passes through the optical system, the system avoids artifacts while maintaining computational feasibility through pre-computed reference data rather than real-time complex physics calculations.

Inventive Principle:
Principle #26Copying

3Measurement precision

If physical control of optical elements is implemented, then optical precision is improved, but device complexity and control requirements increase

Engineering Contradiction:
Improveoptical element precisionVSAvoidcontrol system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces physical control of optical elements with computational control through virtual viewpoints. Instead of mechanically adjusting mirrors or lenses to achieve precise light direction, the system uses software-based virtual viewpoint calculations that represent the desired optical transformation, eliminating complex mechanical control systems while maintaining optical precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the accurate and efficient rendering of 3D images, reducing artifacts and eliminating the need for physical control of optical elements, thereby providing a more intuitive and realistic augmented reality experience without the requirement for glasses.

Implementation Method 1

A 3D image is provided through an optical system such as a mirror or a lens. In this example, a direction of light is changed by the optical system.

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS11711502B2Method of outputting three-dimensional image and electronic device performing the method
Publication Date: 2023.07.25 SAMSUNG ELECTRONICS CO LTD
  • US11711502B2 patent drawing
  • US11711502B2 patent drawing
  • US11711502B2 patent drawing

AI summary

A method and apparatus for outputting a three-dimensional (3D) image are provided. To output a 3D image, a stereo image is generated based on viewpoints of a user and rendered into a 3D image. Since the stereo image is generated based on the viewpoints of the user, the user views a different side of an object appearing in the 3D image depending on a viewpoint of the user.