Image Signal Processor Lens Distortion Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image sensing devices face challenges in producing high-quality images due to distortions caused by lens modules, which degrade both color and depth image quality, necessitating effective noise removal processes.

Innovation Solution

An image signal processor is developed with a calibration interpolation unit and depth data correction unit to generate interpolation calibration information and correct target depth data, using stored calibration information to minimize lens distortion effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If lens module is used to secure wider field of view, then field of view is improved, but image quality deteriorates due to distortion

Engineering Contradiction:
Improvefield of viewVSAvoidimage quality
Core Design Contradiction:
Area of moving objectVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing calibration information for grid pixels before actual image processing. The calibration data is prepared in advance to compensate for lens distortion, allowing the image signal processor to quickly reference and apply correction factors during image processing without real-time computation overhead.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces calibration information as an intermediary element between the distorted image data and the final corrected output. This calibration data acts as a mediator that translates the relationship between grid pixels and target pixels, enabling distortion correction through interpolation without directly modifying the optical path or lens structure.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If calibration information is stored for all pixels, then correction precision is improved, but memory usage increases

Engineering Contradiction:
Improvecorrection precisionVSAvoidmemory usage
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent segments the pixel array into a grid structure where only specific grid pixels store calibration information. This segmentation allows the system to divide the image processing task into regions, with calibration data stored only at grid points rather than every pixel location, significantly reducing memory requirements while maintaining correction capability through interpolation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses interpolation to generate calibration information for non-grid target pixels by copying and combining data from adjacent grid pixels. Instead of storing unique calibration data for every pixel, the system creates virtual calibration values for target pixels by interpolating from the stored grid pixel calibration information, reducing storage needs while preserving precision.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240242364A1Image signal processor
Publication Date: 2024.07.18 SK HYNIX INC
  • US20240242364A1 patent drawing
  • US20240242364A1 patent drawing
  • US20240242364A1 patent drawing

AI summary

An image signal processor includes a calibration interpolation unit configured to generate interpolation calibration information for a target pixel using calibration information of at least one grid pixel adjacent to the target pixel. The image signal processor also includes a depth data correction unit configured to generate corrected depth data by correcting target depth data of the target pixel based on the interpolation calibration information.