Image Processing Geometric Distortion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for processing image data from wide-angle lenses, such as fisheye lenses, are inefficient in correcting geometric distortion, leading to high resource usage and low throughput, which is problematic for applications requiring high frame rates and accurate spatial information, like autonomous vehicles and surveillance systems.

Innovation Solution

A method and apparatus that stream input image data into temporary storage, process it in an ordered manner to adjust geometric distortion, and generate output image data, using transformations like panoramic or stereographic projections, while optimizing memory and processing resources by overwriting older data with new input data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If image data is processed using traditional methods to correct geometric distortion, then distortion correction is achieved, but processing throughput is low and resource usage is high

Engineering Contradiction:
Improveprocessing throughputVSAvoidprocessing resource usage
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent divides the image processing into distinct stages: capturing raw image data, streaming to temporary storage, applying geometric transformation, and outputting corrected data. This segmentation allows each stage to be optimized independently and enables parallel processing where possible, improving overall throughput while reducing resource contention.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies geometric transformation parameters in advance to determine the mapping between input and output image coordinates before actual pixel processing occurs. This preliminary calculation of transformation relationships enables efficient memory access patterns and reduces processing time during the actual image correction stage.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If memory is allocated to store complete input image data for processing, then processing accuracy is maintained, but memory requirements increase

Engineering Contradiction:
Improveprocessing accuracyVSAvoidmemory requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential raw image data needed for processing and streams it to temporary storage, rather than loading entire images or redundant data into memory. This selective extraction maintains processing accuracy by preserving necessary pixel information while minimizing memory consumption through efficient data selection and immediate processing.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If geometric distortion is corrected using traditional processing methods, then image accuracy is improved, but processing time increases

Engineering Contradiction:
Improveimage accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces traditional mechanical image processing methods with streamlined computational approaches, using efficient geometric transformation algorithms that calculate output pixel positions directly from input coordinates. This substitution eliminates time-consuming iterative processing while maintaining high image accuracy through precise mathematical transformations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements continuous streaming processing where image data flows continuously through the transformation pipeline without interruption or batch processing delays. The geometric correction is applied in real-time as data streams through, maintaining continuous useful action that reduces total processing time while preserving image accuracy through consistent transformation application.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11244431B2Image processing
Publication Date: 2022.02.08 ARM LTD
  • US11244431B2 patent drawing
  • US11244431B2 patent drawing
  • US11244431B2 patent drawing

AI summary

A method including streaming input image data representing an input frame of a video into temporary storage. Transformation data representing at least one transformation for application to the input image data is obtained. Ordering data indicating a variable order in which portions of output image data are to be generated is obtained, the ordering data being based on at least one characteristic of the input frame. The transformation data is used to identify portions of input image data to be processed to generate corresponding portions of output image data. The identified portions of input image data are processed to generate the corresponding portions of output image data in the order indicated by the ordering data.