Imaging Pixel Block Sensitivity Calibration Without External Equipment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for acquiring polarization information require calibration to measure sensitivity differences between polarization and non-polarization pixels, which is inconvenient and may introduce noise due to the presence of polarizers.

Innovation Solution

An imaging apparatus with a first pixel block containing polarization pixels with two different polarization directions and a non-polarization pixel, and a second pixel block with multiple polarization directions, including a different polarization direction, allows for the calculation of a correction coefficient for sensitivity differences without calibration, using pixel values from both blocks to generate accurate polarization information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If calibration is performed to measure sensitivity difference between polarization pixel and non-polarization pixel, then measurement precision of polarization information is improved, but device complexity and manufacturing process are worsened due to requiring additional calibration steps

Engineering Contradiction:
Improvemeasurement precision of polarization informationVSAvoidcomplexity of calibration process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-configuring specific pixel blocks with known polarization characteristics (first pixel block with two polarization directions and second pixel block with multiple polarization directions) to enable automatic sensitivity difference calculation without requiring external calibration equipment or procedures. The pixel arrangement itself performs the calibration function.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The imaging device performs self-calibration by using its own pixel blocks to calculate the sensitivity difference between polarization and non-polarization pixels. The system uses captured images from different pixel blocks to automatically determine correction coefficients without external intervention, making the calibration process self-contained.

Inventive Principle:
Principle #25Self-service

2Loss of information

If polarizer is disposed in front of imaging unit to acquire polarization image, then polarization information is improved, but noise increases due to decrease in quantity of light entering imaging unit

Engineering Contradiction:
Improvepolarization informationVSAvoidnoise in image
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent segments the imaging device into different pixel blocks with different polarization configurations. The first pixel block has polarization pixels with two different polarization directions and non-polarization pixels, while the second pixel block has polarization pixels with multiple polarization directions. This segmentation allows simultaneous capture of polarization information and sufficient light quantity across different regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the image sensor have different local qualities - some regions (first pixel block) are optimized for polarization measurement with two directions, while other regions (second pixel block) have multiple polarization directions for sensitivity calibration. Non-polarization pixels are strategically placed to provide reference measurements without polarization filtering, reducing noise in those specific locations.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If non-polarization pixels without polarizer are provided to acquire accurate polarization information, then polarization information quality is improved, but sensitivity difference between non-polarization pixel and polarization pixel must be measured through calibration

Engineering Contradiction:
Improvequality of polarization informationVSAvoidease of manufacturing process
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent applies preliminary action by pre-configuring specific pixel blocks with known polarization characteristics (first pixel block with two polarization directions and second pixel block with multiple polarization directions) to enable automatic sensitivity difference calculation without requiring external calibration equipment or procedures. The pixel arrangement itself performs the calibration function.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The imaging device performs self-calibration by using its own pixel blocks to calculate the sensitivity difference between polarization and non-polarization pixels. The system uses captured images from different pixel blocks to automatically determine correction coefficients without external intervention, making the calibration process self-contained.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the acquisition of accurate polarization information without calibration, reducing noise and sensitivity differences, and simplifying the manufacturing process by eliminating the need for pre-calibration, while maintaining high image quality.

Implementation Method 1

an imaging unit 11 having a first pixel block 1101 and a second pixel block 1102 in a pixel region, the first pixel block including polarization pixels with two different polarization directions

Methodology Applied
Scientific EffectPolarization: Polarisation

Data Source

PatentUS11997398B2Imaging apparatus, image processing apparatus, and image processing method
Publication Date: 2024.05.28 SONY GROUP CORP
  • US11997398B2 patent drawing
  • US11997398B2 patent drawing
  • US11997398B2 patent drawing

AI summary

An imaging apparatus (10) includes an imaging unit (11) that has a first pixel block and a second pixel block provided in a pixel region, the first pixel block including polarization pixels with two different polarization directions and a non-polarization pixel, the second pixel block including polarization pixels with a plurality of polarization directions including a different polarization direction from the first pixel block. An image processing apparatus (20) acquires a captured image generated by the imaging apparatus (10), and a correction coefficient calculation unit (40) calculates a correction coefficient that absorbs a sensitivity difference between polarization pixels and non-polarization pixels, on the basis of an image of the second pixel block. A polarization information generation unit (50) generates polarization information indicating the polarization characteristics of the object included in the captured image, using a non-polarization image and polarization component images generated by a demosaicing unit (30) and the correction coefficient calculated by the correction coefficient calculation unit (40). The correction coefficient of the sensitivity difference between the polarization pixels and the non-polarization pixels can be acquired without any calibration.