Image Distortion Correction with Resolution Continuity

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing devices struggle to maintain continuous resolution across boundaries between divided regions during distortion correction, leading to uneven image quality due to varying scaling ratios and sizes of division regions.

Innovation Solution

An image processing device that successively extracts partial region images, performs distortion correction, and combines them while calculating and applying pixel gains to adjust high-frequency components, ensuring consistent resolution across the entire image by using a reference image generation, distortion correction, image combination, high-frequency component generation, scaling ratio calculation, pixel specification, pixel gain calculation, adjustment, and addition processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the distortion correction target region is divided into division regions and distortion correction is performed for each division region, then the processing complexity is reduced and processing speed is improved, but the sense of resolution varies from division region to division region and continuity of the sense of resolution cannot be achieved especially at boundaries between division regions

Engineering Contradiction:

Improveprocessing speedVSAvoidsense of resolution continuity

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The distortion correction target region is divided into multiple division regions to reduce processing complexity and improve processing speed. Each division region is processed independently through distortion correction, allowing parallel processing and reducing the computational burden on the processing device.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different edge enhancement coefficients are applied to different division regions based on their specific characteristics and scaling ratios. The edge enhancement processing is adapted locally to each division region to compensate for resolution variations, ensuring continuous sense of resolution across boundaries while maintaining processing efficiency.

Inventive Principle:

Principle #3Local quality

2Manufacturing precision

If edge enhancement processing is applied to compensate for resolution decrease, then the sense of resolution is improved, but the image quality becomes uneven when division regions have different scaling ratios

Engineering Contradiction:

Improvesense of resolutionVSAvoidimage quality uniformity

Core Design Contradiction:

Manufacturing precisionVSReliability

Solution Approach 1:

The edge enhancement coefficient is determined based on the scaling ratio of each specific division region, allowing localized optimization. Each division region receives edge enhancement processing tailored to its scaling characteristics, which compensates for resolution decreases while maintaining image quality uniformity across the entire corrected image.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The edge enhancement coefficient is dynamically adjusted according to the scaling ratio of each division region. By changing this parameter based on the specific characteristics of each region, the system compensates for resolution variations and ensures uniform image quality across the distorted correction target region.

Inventive Principle:

Principle #35Parameter changes

3Quantity of substance

If the line buffer capacity is reduced to decrease memory usage, then the memory requirement is reduced, but the processing delay increases due to slower access to vicinal pixel values

Engineering Contradiction:

Improveline buffer capacityVSAvoidprocessing delay

Core Design Contradiction:

Quantity of substanceVSLoss of time

Solution Approach 1:

The distortion correction target region is divided into multiple division regions, allowing the line buffer to be divided into smaller buffers for each region. This segmentation reduces the capacity requirement for each individual buffer while maintaining fast access to vicinal pixel values within each region, thereby reducing processing delay.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Instead of using a single large line buffer for the entire distortion correction target region, the system uses multiple smaller line buffers for each division region. This partial action approach reduces the buffer capacity requirement for each buffer while maintaining efficient pixel value access, reducing processing delay.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS10255665B2Image processing device and method, image capturing device, program, and record medium

Publication Date: 2019.04.09 MITSUBISHI ELECTRIC CORP

AI summary

When distortion correction is performed by dividing a distortion correction target region (Atc), a distortion-corrected division region image (D3) is generated by performing the distortion correction on each division region of the distortion correction target region and a distortion-corrected image (D4) is generated by combining a plurality of distortion-corrected division region images (D3). Regarding each pixel of the distortion-corrected image (D4), a gain (Gp) is determined according to scaling ratios (MR) of a division region including the pixel and one or more division regions around the division region, high-frequency components (D6) of the pixel are multiplied by the gain (Gp), and the product is added to a pixel value of the pixel of the distortion-corrected image (D4). This makes it possible to lessen the difference in the sense of resolution among the division regions of the distortion-corrected image (D4) and obtain an image having an excellent sense of resolution.