Polarized Image Processing Unit for High Sensitivity Polarization Characteristic Determination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in determining polarization characteristics of photographic objects with high sensitivity, as strong reflected light can lead to saturated signals and reduced image quality due to noise and rounding errors, especially when fitting intensity to a cosine curve model.

Innovation Solution

An image processing device and method that calculates high-sensitivity polarization characteristics by combining low-sensitivity and high-sensitivity images, using a polarized image processing unit to determine non-polarization and polarization components based on the ratio of luminance values and phase information across multiple polarization directions, even in saturated conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the quantity of incident light is limited or exposure time is reduced to avoid saturation, then signal saturation is prevented, but luminance for each polarization component decreases resulting in low sensitivity and reduced non-polarization component level

Engineering Contradiction:
Improvesignal saturation preventionVSAvoidpolarization characteristic sensitivity
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent combines low-sensitivity polarized images (where no saturation occurs) with high-sensitivity images (where saturation is avoided through exposure control) to create a high-sensitivity polarization characteristic model. This merging allows the system to leverage the advantages of both image types: the accurate polarization information from low-sensitivity images and the high luminance from high-sensitivity images.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a polarization characteristic model as an intermediary that bridges low-sensitivity and high-sensitivity images. The model is calculated using luminance values from both image types, allowing the system to transfer polarization characteristics from low-sensitivity images to enhance the high-sensitivity images without direct saturation issues.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If exposure time is increased to improve sensitivity, then luminance for each polarization component increases, but strong reflected light causes saturated signals from the image sensor

Engineering Contradiction:
Improvepolarization characteristic sensitivityVSAvoidsignal saturation
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent uses partial action by capturing images at multiple exposure times, where some exposures are intentionally overexposed (excessive) to capture high luminance information, while others are underexposed (partial) to avoid saturation. The system then selectively combines these partial results to achieve the optimal balance.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent changes the exposure time parameter to capture images at different sensitivity levels. By varying this parameter, the system obtains both low-sensitivity images (shorter exposure, no saturation) and high-sensitivity images (longer exposure, higher luminance), which are then combined to resolve the contradiction.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If low-sensitivity polarized images are used to avoid saturation, then signal saturation is prevented, but image quality deteriorates due to noise and rounding errors

Engineering Contradiction:
Improvesignal saturation preventionVSAvoidimage quality
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent merges low-sensitivity polarized images with high-sensitivity images to combine the benefits of both: the saturation-free polarization information from low-sensitivity images and the high quality, low-noise characteristics from high-sensitivity images. This produces a final polarization characteristic model with both accuracy and high image quality.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10523873B2Image processing device and image processing method
Publication Date: 2019.12.31 SONY GROUP CORP
  • US10523873B2 patent drawing
  • US10523873B2 patent drawing
  • US10523873B2 patent drawing

AI summary

The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image. Furthermore, the high-sensitivity component acquisition unit 33-1 acquires the amplitude of the high-sensitivity polarization characteristic model as the polarization component of a photographic object, and acquires the minimum value of the high-sensitivity polarization characteristic model as the non-polarization component of the photographic object. It is possible to determine polarization characteristics of a photographic object with high sensitivity from an image.