View-dependent color compression for 3D rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional computer graphics struggle to render photorealistic scenes from arbitrary viewpoints, especially with complex material and lighting phenomena, requiring extreme computation and failing to provide immersive viewing experiences in virtual and augmented reality applications.

Innovation Solution

The implementation of view-dependent color compression and decompression systems using special-purpose machines that access and process sets of view maps to generate and represent surface light fields, allowing for efficient data compression and rendering of 3D objects from any viewpoint.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional computer graphics methods are used to render scenes from arbitrary viewpoints, then photorealistic quality can be achieved, but extreme computation is required

Engineering Contradiction:
Improvephotorealistic qualityVSAvoidcomputation
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent pre-computes and stores view maps for multiple viewpoints during an encoding phase. These view maps capture color information from different directions and are stored for later retrieval. During rendering, the system simply retrieves and blends pre-computed view maps based on the current viewpoint, avoiding the need for real-time photorealistic rendering calculations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates simplified copies of the visual scene in the form of view maps that represent color information from multiple viewpoints. Instead of storing or processing the full complex scene data, the system uses these compressed view map copies to reconstruct the visual appearance from arbitrary viewpoints through blending operations.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If view maps for multiple viewpoints are stored and processed, then free-viewpoint navigation is enabled, but data complexity increases

Engineering Contradiction:
Improvefree-viewpoint navigationVSAvoiddata structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the view map data into discrete samples at multiple viewpoints around the scene. Each viewpoint has its own view map with color information, and these segmented viewpoint data are stored independently. During rendering, the system selects and blends appropriate segments based on the desired viewpoint, enabling flexible navigation without handling a single complex continuous data structure.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If high-quality surface light field representation is maintained, then rendering accuracy is improved, but communication bandwidth requirements increase

Engineering Contradiction:
Improverendering accuracyVSAvoiddata volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent represents view maps using spherical coordinates (azimuth and elevation angles) rather than Cartesian coordinates. This parameter transformation allows for more efficient data organization and compression of directional color information. The view maps are stored as functions of viewing direction in spherical space, reducing redundancy and enabling more compact representation of the same visual information.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10262451B1View-dependent color compression
Publication Date: 2019.04.16 8I LTD
  • US10262451B1 patent drawing
  • US10262451B1 patent drawing
  • US10262451B1 patent drawing

AI summary

A machine accesses view maps that each corresponds to a different point on a surface of a three-dimensional object. The machine generates vectors of coefficients by calculating a corresponding transform of each view map. The vectors specify a corresponding coefficient for each basis function among a group of basis functions. For each basis function in the group, the machine generates a spatial representation of coefficients specified for that basis function across all of the accessed view maps, and then quantizes the spatial representation of coefficients for that basis function. The quantized spatial representation forms part of a group of quantized spatial representations of coefficients that corresponds to the accessed view maps. The machine then provides the group of quantized spatial representations of coefficients as a compressed version of the view maps. A decoder device can then approximate the view maps based on the group of quantized spatial representations.