Normal Map Compression Using Dynamic Resolution Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current texture compression methods, such as S3TC and DXT5, are inadequate for compressing normal maps, leading to quality issues like block artifacts and insufficient detail representation, especially for smooth surfaces, as they are designed for photographic images and do not effectively handle data with specific properties like normal maps.
Innovation Solution
The technology involves dynamic selection of resolution for encoding and decoding image blocks based on the distribution of feature vector components, using multiple codewords to represent minimum and maximum values of X and Y components, and employing an auxiliary compression/decompression mode to handle image blocks with poor quality issues in default modes, allowing for bit-efficient compression and decompression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If S3TC/DXT1 is used to compress normal maps, then memory bandwidth usage is reduced, but block artifacts appear and quality deteriorates
Solution Approach 1:
The patent applies different compression resolutions to different regions of the normal map based on their importance. High-resolution compression is applied to regions with significant normal variations (object surfaces), while lower resolution is applied to uniform regions (sky, ground). This local adaptation prevents block artifacts in critical areas while maintaining bandwidth efficiency overall.
Solution Approach 2:
The patent dynamically adjusts the compression resolution based on the content characteristics of each image block. The encoder analyzes the normal map data and automatically selects appropriate resolution levels for different regions, allowing the compression parameters to adapt rather than being fixed. This dynamic approach eliminates block artifacts by matching compression strength to local detail requirements.
2Productivity
If only X and Y components are compressed with DXT5, then compression efficiency is improved, but quality for smooth surfaces remains insufficient
Solution Approach 1:
The patent changes the compression parameters dynamically based on the image block characteristics. For blocks representing smooth surfaces, the system uses higher resolution parameter sets that capture subtle normal variations. For blocks with sharp features, appropriate resolution is selected to maintain edge sharpness. This parameter adaptation enables both efficient compression and high quality representation of smooth surfaces.
Solution Approach 2:
The compression resolution is made dynamic rather than static. The system analyzes each image block and automatically selects the optimal compression parameters for that specific block, allowing higher detail representation where needed (smooth surfaces) while maintaining efficiency where possible. This dynamic parameter selection resolves the contradiction between compression efficiency and detail representation.
3Device complexity
If fixed compression resolution is used for all image blocks, then processing complexity is reduced, but quality varies insufficiently for different surface types
Solution Approach 1:
The patent implements dynamic resolution selection where the compression parameters are automatically adjusted based on the content of each image block. The encoder analyzes normal variations and selects appropriate resolution levels without requiring manual intervention or complex user input. This dynamic approach increases quality adaptation while keeping the processing complexity manageable through automated decision-making.
Solution Approach 2:
The system automatically changes compression parameters based on detected image characteristics. When smooth surfaces are detected, higher resolution parameters are applied; when sharp features are detected, appropriate resolution is selected. This automated parameter change allows quality adaptation without requiring complex processing, as the system makes intelligent decisions about compression strength based on the data itself.
Data Source
AI summary
First and second codewords are determined, based on first feature vector components of the image elements in an image block, as representations of a first and second component value. Third and fourth codewords are determined, based on second vector components, as representations of a third and fourth component value. First N1 and second N2 resolution numbers are selected based on the relation of a distribution of the first vector components and a distribution of the second vector components. N1 additional component values are generated based on the first and second component values and N2 additional component values are generated based on the third and fourth component values. Component indices indicative of the generated component values are then provided for the different image elements.