Dynamic Texture Sampling for High-Resolution Image Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image generating systems face challenges in achieving a balance between responsiveness and image quality, particularly when displaying high-resolution texture images, as they often suffer from aliasing issues due to excessive sampling in small regions, and preparing MIP maps introduces latency when the texture image varies over time.

Innovation Solution

The system implements a texture mapping technique that dynamically adjusts the number and distribution of sampling points based on the size and angle of the mapping target surface, using linear approximation and partial differential calculations to determine pixel values, allowing for high-quality image rendering without the need for pre-prepared MIP maps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If MIP maps are prepared beforehand to improve image quality, then aliasing is reduced, but latency increases when texture images vary over time

Engineering Contradiction:
Improveimage qualityVSAvoidlatency
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements dynamic texture mapping that adjusts sampling parameters in real-time based on the current frame's characteristics, replacing static pre-prepared MIP maps. This allows the system to adapt to varying texture images (such as videos) without the latency of pre-processing, while maintaining image quality through on-the-fly optimization of sampling strategies.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes sampling parameters dynamically during rendering based on detected aliasing conditions and texture characteristics. By adjusting sampling rate, sampling pattern, and other parameters in real-time, the system achieves high image quality without the time cost of pre-preparing MIP maps for all possible scenarios.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If direct sampling of high-resolution texture images is performed without MIP maps, then responsiveness is improved, but aliasing occurs due to excessive sampling in small regions

Engineering Contradiction:
ImproveresponsivenessVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies different sampling strategies to different regions of the texture image based on local characteristics. Regions prone to aliasing receive enhanced sampling, while other regions use standard sampling. This localized approach maintains image quality without uniformly increasing sampling overhead, thus preserving responsiveness.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system incorporates feedback mechanisms that detect aliasing artifacts during rendering and dynamically adjust sampling parameters in response. This closed-loop approach allows the system to maintain high image quality by applying additional sampling only when and where needed, rather than uniformly across all regions, thereby preserving overall responsiveness.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3379494B1Image processing device, information processing device, and image processing method
Publication Date: 2023.08.23 SONY INTERACTIVE ENTERTAINMENT LLC

AI summary

Regions 150 and 152 on a texture image plane 140 that correspond individually to pixels 146 and 148 representing an image on a texture image mapping target surface 144 in a screen plane 142 on which to define a display image are determined using predetermined transformation equations. The number of sampling points and their distribution are determined for the determined region in accordance with its shape and its size. Texel values in the determined region are then sampled. An average of the sampled values is acquired as the value of each of the original pixels 146 and 148.