GPU Warping Texture Lens Distortion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera lenses introduce various types of distortion, such as geometric and chromatic distortion, which are challenging to correct, especially in less expensive camera systems like mobile phone cameras, and existing methods often require complex hardware or post-processing that is not universally effective.

Innovation Solution

A system and method that determines the distortion introduced by a lens, stores this information, and uses a graphics processing unit (GPU) with a texturing engine to process captured images, applying distortion correction by generating a warping texture to produce a corrected image, allowing for effective distortion reduction in images captured with simple lens systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If combinations of lenses are used in sequence to reduce distortion, then image quality is improved, but device complexity and cost increase

Engineering Contradiction:
Improveimage qualityVSAvoidlens system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical/optical solution of using multiple lens elements with a computational approach. A distortion correction map is generated and applied through image processing algorithms, substituting the need for complex multi-element lens assemblies while achieving similar distortion correction results.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a distortion correction map in advance that characterizes the lens distortion. This pre-computed map is then applied during image capture or post-processing, allowing the system to correct distortion without requiring complex hardware modifications.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If digital post-processing is used to correct distortion, then distortion is eliminated, but processing time and computational resources increase

Engineering Contradiction:
Improvedistortion correction accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The distortion correction map is generated in advance through calibration processes. This pre-computed lookup table allows for rapid correction during actual image capture by simply applying the pre-determined transformation, significantly reducing real-time processing requirements.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses a pre-computed distortion correction map that serves as a template or copy of the distortion characteristics. This map is applied to correct images without requiring complex real-time calculations, effectively copying the correction pattern across multiple images.

Inventive Principle:
Principle #26Copying

3Ease of manufacture

If integrated solutions with minimal hardware are used, then cost is reduced, but inherent distortion correction capability is limited

Engineering Contradiction:
Improvecamera system costVSAvoiddistortion correction capability
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent substitutes computational processing for additional optical hardware. By using a single lens element combined with software-based distortion correction through lookup tables and image processing algorithms, the system achieves effective distortion correction without the cost and complexity of multi-element lens assemblies.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the approach from modifying optical parameters (adding lens elements) to modifying digital image parameters. By applying transformation algorithms and distortion correction maps to the digital image data, the system achieves correction capability that would otherwise require more expensive hardware modifications.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9177368B2Image distortion correction
Publication Date: 2015.11.03 NVIDIA CORP
  • US9177368B2 patent drawing
  • US9177368B2 patent drawing
  • US9177368B2 patent drawing

AI summary

Methods and systems for reducing or eliminating distortion in an image are described. The approach generally involves determining the distortion introduced by a lens, and modifying a captured image to reduce that distortion. In one embodiment, the distortion information associated with a lens is determined. The distortion information is stored. A captured image taken by that lens is processed, with reference to the distortion information.