Lensless Polarization Imaging Device with Binary Mask

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing polarization imaging devices require a lens-based optical system, leading to increased size and potential deterioration in image quality, making it difficult to achieve downsizing while maintaining image quality.

Innovation Solution

A polarization imaging device with an image sensor divided into sub-sensor regions and a binary mask with different polarization directions superimposed on each region, allowing for efficient light control and reconstruction of images without a lens, using a URA mask pattern to maintain constant side lobes and improve image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a lens-based optical system is used for polarization imaging, then image quality can be maintained, but the device size increases

Engineering Contradiction:
Improveimage qualityVSAvoiddevice size
Core Design Contradiction:
Measurement precisionVSVolume of moving object

Solution Approach 1:

The patent extracts and removes the lens component from the polarization imaging system, replacing it with a lensless architecture that uses a mask directly coupled to the image sensor. This eliminates the need for bulky optical components while maintaining polarization measurement capability through the mask-sensor integration.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transitions from a traditional 3D optical path approach to a 2D planar mask pattern approach. By encoding polarization information in the spatial arrangement of transparent and opaque regions in the mask plane, the system achieves polarization imaging without requiring the depth and volume of lens-based optical paths.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Volume of moving object

If a lensless camera approach is used, then device size is reduced, but image quality may deteriorate

Engineering Contradiction:
Improvedevice sizeVSAvoidimage quality
Core Design Contradiction:
Volume of moving objectVSMeasurement precision

Solution Approach 1:

The patent applies preliminary encoding of polarization information through a specifically designed mask pattern before light reaches the sensor. The mask pre-processes the light by modulating it with polarization-dependent transmission characteristics, enabling accurate polarization measurement and image reconstruction without requiring post-capture optical processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates multiple virtual images through the mask pattern that encode different polarization states. By capturing these encoded patterns and reconstructing the original scene through computational algorithms, the system replicates the functionality of lens-based polarization imaging while using a compact lensless architecture.

Inventive Principle:
Principle #26Copying

3Measurement precision

If polarization filters are disposed in a two-dimensional pattern in front of the image sensor, then image quality can be maintained, but data processing requirements increase

Engineering Contradiction:
Improveimage qualityVSAvoiddata processing requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image sensor into multiple sub-sensor regions, each corresponding to a specific polarization channel defined by the mask pattern. This segmentation allows parallel processing of polarization information from different regions, reducing the computational burden compared to processing entire frames with complex polarization decoding algorithms.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent assigns different polarization measurement characteristics to different regions of the mask and corresponding sensor areas. Each sub-sensor region is optimized for capturing specific polarization components, enabling localized processing strategies that reduce overall data processing requirements while maintaining global image quality.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables downsizing of the polarization imaging device while maintaining high image quality and memory efficiency, allowing for robust reconstruction of captured images with reduced data processing requirements.

Implementation Method 1

a binary mask including a first sub-mask region having a first polarization direction, a second sub-mask region having a second polarization direction, a third sub-mask region having a third polarization direction, and a fourth sub-mask region having a fourth polarization direction

Methodology Applied
Scientific EffectPolarization: Polarisation

Data Source

PatentUS20230367053A1Polarization imaging device, binary mask, image processing system, and image processing method
Publication Date: 2023.11.16 SONY GROUP CORP
  • US20230367053A1 patent drawing
  • US20230367053A1 patent drawing
  • US20230367053A1 patent drawing

AI summary

Provided is a polarization imaging device (100) that can be downsized while suppressing deterioration in image quality. A polarization imaging device (100) includes an image sensor (50) having a first sub-sensor region, a second sub-sensor region, a third sub-sensor region, and a fourth sub-sensor region that are evenly divided and are adjacent to each other, and a binary mask (10) evenly superimposed on the first sub-sensor region, the second sub-sensor region, the third sub-sensor region, and the fourth sub-sensor region, the binary mask including a first sub-mask region having a first polarization direction, a second sub-mask region having a second polarization direction, a third sub-mask region having a third polarization direction, and a fourth sub-mask region having a fourth polarization direction, wherein each of the first sub-mask region, the second sub-mask region, the third sub-mask region, and the fourth sub-mask region is disposed so as to be evenly superimposed on the first sub-sensor region, the second sub-sensor region, the third sub-sensor region, and the fourth sub-sensor region.