Image Processing Device Pixel Position Inversion for Buffer Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing devices face challenges in correcting distortion aberration and chromatic aberration, leading to increased design and manufacturing costs, as well as device size issues due to the need for large numbers of lenses and expensive SRAM line buffers.

Innovation Solution

An image processing device with a first and second calculating circuit to convert pixel positions and a pixel interpolating circuit for interpolation, allowing for efficient correction of distortion without the need for extensive line buffers, enabling output of corrected pixels without delay.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional electric correction method is used with raster scan order output, then image distortion can be corrected, but significant deviation between outputted and inputted pixel positions requires large line buffers

Engineering Contradiction:
Improveimage distortion correctionVSAvoidline buffer capacity
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

Instead of calculating input pixel positions from output pixel positions (conventional method), the patent inverts the approach by calculating output pixel positions from input pixel positions. This allows the line buffer to only store pixels from the current and previous scan lines, dramatically reducing buffer capacity requirements while maintaining correction accuracy

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent performs preliminary calculation of output pixel positions using the inverted formula before actual pixel data is needed. By pre-calculating where input pixels will map to in the output image, the system can process pixels in raster scan order without requiring large buffers to hold intermediate results

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If large line buffers are prepared to hold inputted pixels for significant pixel position deviation, then distortion correction can be maintained, but device size increases

Engineering Contradiction:
Improvedistortion correction accuracyVSAvoiddevice size
Core Design Contradiction:
Manufacturing precisionVSVolume of stationary object

Solution Approach 1:

The patent inverts the pixel position calculation approach, computing output positions from input positions rather than the reverse. This inversion enables processing with minimal buffer storage, reducing device volume while preserving correction accuracy through the mathematical equivalence of the inverted formula

Inventive Principle:
Principle #13The other way round (Inversion)

3Manufacturing precision

If general line buffers formed of SRAM are used to handle pixel position deviation, then correction can be performed, but manufacturing cost increases

Engineering Contradiction:
Improvepixel position correctionVSAvoidmanufacturing cost
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

By inverting the pixel position calculation formula to compute output positions from input positions, the patent reduces the buffer capacity requirement from millions of pixels to just a few scan lines. This eliminates the need for expensive SRAM and allows use of cheaper memory technologies, significantly reducing manufacturing cost while maintaining correction precision

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent replaces expensive SRAM with lower-cost memory solutions by reducing the required buffer capacity to minimal levels. The inverted calculation method allows use of inexpensive memory that can be cleared and reused each frame, achieving the same correction function at lower cost

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

4Ease of operation

If corrected pixels are output in raster scan order with conventional calculation method, then processing is simplified, but delays occur in image processing and display

Engineering Contradiction:
Improveprocessing simplicityVSAvoidimage processing delay
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent performs preliminary calculation of output pixel positions using the inverted formula during the input pixel reading phase. By pre-determining where each input pixel will be placed in the output image, the system eliminates processing delays and enables continuous raster scan output without waiting for complex position calculations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The inverted calculation approach allows output position determination to be performed forward from input positions, enabling real-time calculation during the natural raster scan flow. This maintains processing simplicity while eliminating the time delays that would occur with conventional reverse calculation methods

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS10659746B2Image processing device and image processing method
Publication Date: 2020.05.19 KK TOSHIBA
  • US10659746B2 patent drawing
  • US10659746B2 patent drawing
  • US10659746B2 patent drawing

AI summary

The image processing device of an embodiment, to which multiple inputted pixels forming an inputted image are inputted in a raster scan order, includes a written pixel position calculating circuit configured to convert the position of each of the inputted pixels to a first pixel position in an outputted image, a read-out pixel position calculating circuit configured to convert the position of an outputted pixel near the first pixel position in the outputted image to a second pixel position in the inputted image, and a pixel interpolating circuit configured to calculate the pixel value of the second pixel position through interpolation with surrounding pixels in the inputted image.