Image Capturing Device 4x4 Polarization Pixel Array

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image capturing devices with polarization filters only in G pixels fail to acquire red and blue reflection components effectively, leading to reduced sensitivity and resolution of non-polarization pixels, especially when polarizers are arranged in a stripe-like pattern.

Innovation Solution

An image capturing device with a 4×4-pixel area where at least one pixel of each color component is a polarization pixel of the same direction, and the majority are non-polarization pixels, using pixel signals from both types to calculate unpolarized and diffuse reflection components, and adjusting these components to generate high-resolution non-polarization images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If polarizers are provided only in G pixels, then sensitivity at each pixel is improved, but red and blue reflection components cannot be acquired

Engineering Contradiction:
ImprovesensitivityVSAvoidreflection components
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent applies local quality by differentiating pixel functions within the 4×4 array: polarization pixels (including at least one of each color component) are dedicated to capturing polarization information, while non-polarization pixels (constituting the majority) capture general light intensity. This localized functional differentiation allows simultaneous acquisition of polarization data for color analysis and full-color reflection components without compromising sensitivity at any pixel type.

Inventive Principle:
Principle #3Local quality

2Device complexity

If polarizers are formed in a stripe-like pattern, then device complexity is reduced, but resolution of non-polarization pixels in the orthogonal direction deteriorates

Engineering Contradiction:
Improvepolarizer arrangementVSAvoidresolution
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the pixel array into distinct 4×4 blocks, each containing a specific configuration of polarization and non-polarization pixels. Within each block, at least one pixel of every color component is designated as a polarization pixel, while the majority are non-polarization pixels. This segmentation approach maintains relatively simple polarizer formation while preserving resolution by ensuring sufficient polarization sampling across different spatial locations and color channels.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the acquisition of non-polarization images with high resolution and sensitivity, along with reflection components for each color component, by effectively utilizing pixel signals from polarization and non-polarization pixels.

Implementation Method 1

pixels including at least one pixel of every color component of a plurality of color components are polarization pixels of the same polarization direction

Methodology Applied
Scientific EffectPolarisation: Polarisation

Data Source

PatentUS11108951B2Image capturing device and imaging element, and image processing method
Publication Date: 2021.08.31 SONY GROUP CORP
  • US11108951B2 patent drawing
  • US11108951B2 patent drawing
  • US11108951B2 patent drawing

AI summary

In an image capturing unit 20, an imaging element has a 4×4-pixel area in which: pixels including at least one pixel of every color component of a plurality of color components are polarization pixels of the same polarization direction; and pixels which are not the polarization pixels constitute a majority of the 4×4-pixel area, and are non-polarization pixels. The unpolarized component calculating unit 31 of the image processing unit 30 calculates unpolarized components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20. The diffuse reflection component calculating unit 32 calculates diffuse reflection components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20.