High-Resolution Image Capture via Frequency Spectrum Interpolation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for capturing high-resolution images, such as tiling approaches and hotsampling, often result in visual artifacts like blurring, missing texture details, and compatibility issues with anti-aliasing, and are limited by hardware capabilities, leading to inefficient storage and quality concerns.

Innovation Solution

A system that processes high-resolution images by determining intermediate and corresponding tiles from source and low-resolution images, interpolating frequency spectrum data, and converting it to final tiles, allowing for efficient image capture and storage while minimizing artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If tiling approaches are used to capture high-resolution images, then the image resolution can be increased, but visual artifacts such as blurring and missing texture details occur

Engineering Contradiction:

Improveimage resolutionVSAvoidimage quality

Core Design Contradiction:

Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent divides the high-resolution image capture process into multiple tiles that are captured separately and then recombined. This segmentation allows the system to handle very high resolutions (like 61,440×34,560 pixels) by breaking them into manageable portions while maintaining overall image quality through frequency spectrum recombination across the tiles

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent uses frequency spectrum data as an intermediary to combine information from low-resolution and high-resolution tiles. By determining frequency spectrum data sets for each tile and interpolating them, the system resolves the contradiction between resolution and quality, producing final tiles that maintain both high resolution and visual fidelity

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If hotsampling is used to capture high-resolution images, then hardware resource usage is reduced, but undersampling issues occur in effects that assume a specific display size

Engineering Contradiction:

Improvecapture efficiencyVSAvoidsampling accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies hotsampling to capture tiles at a reduced sampling rate (partial action) but then compensates by determining frequency spectrum data sets and interpolating them to recover the missing high-frequency information. This allows efficient capture without undersampling artifacts in the final high-resolution image

Inventive Principle:

Principle #16Partial or excessive action

3Manufacturing precision

If sub-pixel offset capture is used, then texture details can be enhanced, but the method is not compatible with anti-aliasing and hardware texture LOD blurring occurs

Engineering Contradiction:

Improvetexture detailVSAvoidcompatibility with anti-aliasing

Core Design Contradiction:

Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies different processing methods to different parts of the image data. Intermediate tiles are processed with frequency spectrum analysis and interpolation to preserve texture details, while the system maintains compatibility with anti-aliasing by properly handling the frequency domain data. This local quality approach resolves the contradiction between texture enhancement and anti-aliasing compatibility

Inventive Principle:

Principle #3Local quality

4Manufacturing precision

If high-resolution image capture is performed, then image quality is improved, but the size of the stored file increases significantly

Engineering Contradiction:

Improveimage qualityVSAvoidstorage size

Core Design Contradiction:

Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent segments the high-resolution image into multiple tiles that can be processed and stored individually. This segmentation reduces the memory and storage requirements compared to handling a single full-resolution image, while still maintaining the ability to produce high-quality final images through frequency spectrum recombination

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system captures tiles at a lower sampling rate during the intermediate processing stage (partial action), reducing the amount of data that needs to be stored and processed, while still achieving full high-resolution quality in the final output through frequency domain interpolation

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS11544818B2Enhancing high-resolution images with data from low-resolution images

Publication Date: 2023.01.03 NVIDIA CORP

AI summary

Users often desire to capture certain images from an application. Existing methods of capturing images can result in low-resolution images due to limitations of the display device providing the images. This disclosure provides a method of capturing higher resolution images from source images. Techniques are also disclosed to reduce the storage size associated with the higher resolution images. Through capturing low-resolution versions of the same source images, image effects can be captured and applied to the higher resolution images where those image effects may be altered or missing. Frequency spectrum combination can be used to combine the low-resolution image data and the higher resolution image data. The higher resolution images can be processed using a segmentation scheme, such as tiling, without reducing or limiting the image effects.