Cyclic Noise Estimation in Image Processing Apparatus

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods require extensive processing and hardware components to correct flicker noise in images captured under different exposure periods, making them inefficient and complex.

Innovation Solution

An image processing apparatus that estimates cyclic noise components, such as flicker, by utilizing the mutual relationship between noise components under different exposure conditions, using techniques like Fourier series expansion and eigenvector calculation to simplify the correction process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing image processing methods are applied to correct flicker noise in images captured under different exposure periods, then flicker correction is achieved, but hardware components increase and processing period increases

Engineering Contradiction:
Improveflicker correctionVSAvoidhardware components
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the flicker correction process into the existing image processing pipeline by reusing the same hardware components that process multiple exposure images for HDR generation. The flicker correction is performed as an additional processing step within the existing processor, eliminating the need for separate dedicated hardware and reducing overall device complexity while maintaining effective flicker correction.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If existing image processing methods are applied to correct flicker noise in images captured under different exposure periods, then flicker correction is achieved, but processing period increases

Engineering Contradiction:
Improveflicker correctionVSAvoidprocessing period
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary action by calculating the flicker correction coefficient once from the integrated image data, and then reusing this coefficient for correcting all individual exposure images. This approach avoids the time-consuming process of calculating separate correction coefficients for each image, significantly reducing the total processing period while ensuring consistent flicker correction across all images.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If flicker correction processing is executed individually for each of the plurality of images picked up in different exposure periods, then accurate flicker correction is achieved, but processing complexity and time increase

Engineering Contradiction:
Improveflicker correction accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent creates a universal flicker correction coefficient that can be applied to all images captured under different exposure periods. This single coefficient serves multiple functions by correcting flicker noise across the entire sequence of images, maintaining correction accuracy while dramatically improving processing efficiency by avoiding redundant calculations for each individual image.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9979896B2Image processing apparatus, image processing method, electronic equipment and program
Publication Date: 2018.05.22 SONY SEMICON SOLUTIONS CORP
  • US9979896B2 patent drawing
  • US9979896B2 patent drawing
  • US9979896B2 patent drawing

AI summary

The present technology relates to an image processing apparatus, an image processing method, electronic equipment and a program which can remove cyclic noise from an image including the cyclic noise.An estimating unit configured to estimate cyclic noise components included in each image picked up under different exposure conditions for each image is included. The estimating unit estimates the cyclic noise components for each image through operation utilizing mutual relationship between the noise components under the exposure conditions. For example, the cyclic noise is flicker. The mutual relationship between the noise components may be expressed with a shutter function of the exposure conditions in frequency space. The present technology may be applied to an imaging apparatus.