Saturated Pixel Restoration for Light Field Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When pixel values are saturated in images from multiple visual points, existing image processing technologies struggle to perform appropriate image processing, leading to suboptimal results.

Innovation Solution

An image processing apparatus and method that includes a saturated pixel restoration section to restore pixel values of saturated pixels, allowing for effective image processing of images from multiple visual points by converting them into higher dynamic range images, which are then used for further processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If images of multiple visual points are processed using conventional methods, then processing speed is maintained, but image processing accuracy deteriorates when saturated pixels are present

Engineering Contradiction:
Improveimage processing accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by restoring saturated pixel values before performing image processing operations. The saturated pixel restoration section identifies and corrects saturated pixels in the light field images before these images are used for refocusing or other processing, ensuring that subsequent operations work with accurate data and achieve better processing accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary component - the saturated pixel restoration section - that acts as a mediator between image acquisition and image processing. This restoration section processes the raw images to correct saturated pixels, providing cleaned input data to subsequent processing stages without requiring changes to the core processing algorithms.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Illumination intensity

If exposure time is increased to capture more light, then image brightness is improved, but pixel saturation occurs more frequently

Engineering Contradiction:
Improveimage brightnessVSAvoidpixel value reliability
Core Design Contradiction:
Illumination intensityVSReliability

Solution Approach 1:

The patent converts the harmful effect of pixel saturation into a benefit by developing a restoration mechanism. Instead of discarding saturated pixels or avoiding saturation by using shorter exposure times, the system embraces saturation as acceptable and then applies algorithms to restore the original pixel values, thereby maintaining both high brightness and data reliability.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The patent applies parameter changes by transforming saturated pixel values back to their original unsaturated states through restoration algorithms. The system detects saturated pixels and applies mathematical transformations to recover their true values, effectively changing the parameter state from saturated to restored without requiring re-capture of the image.

Inventive Principle:
Principle #35Parameter changes

3Ease of manufacture

If saturated pixels are not restored, then processing simplicity is maintained, but image quality and processing appropriateness deteriorate

Engineering Contradiction:
Improveprocessing simplicityVSAvoidimage processing quality
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The restoration of saturated pixels is performed as a preliminary step before main image processing operations. This preliminary action ensures that the data entering the processing pipeline is clean and accurate, preventing quality degradation without complicating the subsequent processing steps.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10529057B2Image processing apparatus and image processing method
Publication Date: 2020.01.07 SONY GROUP CORP
  • US10529057B2 patent drawing
  • US10529057B2 patent drawing
  • US10529057B2 patent drawing

AI summary

There is provided an image processing apparatus and an image processing method that make it possible to appropriately perform an image process of images of a plurality of visual points. A saturated pixel restoration section restores a pixel value of each saturated pixel whose pixel value is saturated from among pixels of images of a plurality of visual points picked up in a predetermined exposure time period, and a processing section performs an image process of the images of the plurality of visual points with regard to which the pixel value of each saturated pixel is restored. The present technology can be applied to an image process of images of a plurality of visual points such as a light field technology for reconstructing, for example, images picked up using various optical lenses from images of a plurality of visual points or a like technology.