Probe Data Decoding via Domain Conversion for 3D Shading
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for simulating shading effects in rendering processes, particularly in device-cloud synergy scenarios, face challenges in optimizing bit rates and rendering delays while maintaining or improving image quality, especially in transitioning from direct to indirect illumination simulations.
Innovation Solution
A decoding method that involves data form conversion, including domain conversion, dequantization, and rearrangement, to convert intermediate data into probe data, optimizing bit rates and rendering efficiency by reducing the bitstream size and enhancing rendering quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If probe data is directly compressed and transmitted without data form conversion, then the transmission process is simple, but the bit rate is high and rendering quality is insufficient
Solution Approach 1:
The patent applies parameter changes by converting probe data between different domains (e.g., spatial domain to frequency domain using spherical harmonics transformation). This domain conversion transforms the data representation form, enabling more efficient compression while preserving rendering quality. The encoder converts original probe data to transformed domain coefficients, which can be compressed with fewer bits while maintaining the ability to reconstruct high-quality shading effects.
2Quantity of substance
If probe data is compressed to reduce bit rate, then transmission efficiency improves, but rendering quality and accuracy of illumination representation deteriorate
Solution Approach 1:
The patent resolves this contradiction by changing the parameter representation domain. Instead of compressing raw probe data directly, the system transforms the data into a different domain (e.g., spherical harmonics coefficients) where the energy is more concentrated and can be efficiently compressed using techniques like truncated spherical harmonics. This allows significant bit rate reduction while preserving the most important illumination information for rendering quality.
Solution Approach 2:
The patent extracts and transmits only the most important components of the probe data. By using truncated spherical harmonics or selecting only significant coefficients after domain transformation, the system removes redundant or less important data elements. This extraction approach reduces the bit rate substantially while maintaining rendering quality, as only the essential illumination characteristics are transmitted.
3Productivity
If conventional compression methods are used on probe data, then the compression process is simple, but rendering delays are long and compression efficiency is low
Solution Approach 1:
The patent applies preliminary action by performing domain transformation and data preparation at the encoding end before compression. The probe data is pre-processed through transformations like spherical harmonics expansion, and the transformed coefficients are organized and quantized in advance. This preliminary processing at the encoder enables faster decoding and rendering at the client side, reducing rendering delays while improving overall compression efficiency.
Data Source
AI summary
Embodiments of this application provide a decoding method and an electronic device. The method includes: obtaining a bitstream that includes intermediate data encoded by a second device; decoding the bitstream to obtain the intermediate data; and performing data form conversion, including domain conversion, on the intermediate data to obtain probe data. The probe data corresponds to one or more probes in a three-dimensional scene and is for determining a shading effect of an object in the three-dimensional scene in a rendering process.