Polarized Image Compression via Reference Difference Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In polarized images, the correlation between adjacent pixels is reduced when polarization directions differ, making it inefficient to reduce the amount of information during compression processes similar to those for normal images.

Innovation Solution

An image processing system and method that includes a polarization imaging unit and an information compression unit, which acquire and compress polarized images with multiple polarization directions using a reference image and difference information, reducing the bit width of difference values to minimize data while maintaining image integrity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a compression process similar to normal images is used for polarized images, then the compression process can be implemented, but the amount of information cannot be efficiently reduced due to reduced correlation between pixels with different polarization directions

Engineering Contradiction:
Improveamount of informationVSAvoidcompression efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent segments the polarized image data by separating pixels into groups based on their polarization directions. Instead of processing all pixels uniformly, the method divides the image into multiple polarization channels (e.g., 0°, 45°, 90°, 135° directions) and processes each channel independently or in optimized combinations, thereby restoring the pixel correlation within each segment and enabling efficient compression.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the representation parameters of the polarized image by transforming the raw pixel data into polarization-specific parameters such as intensity, polarization angle, and degree of polarization. This parameter transformation allows the compression algorithm to exploit the statistical correlations inherent in each polarization parameter separately, significantly improving compression efficiency while preserving the essential polarized image information.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If multiple polarization directions are captured to acquire normal information of an object, then accurate object information can be obtained, but the amount of data increases

Engineering Contradiction:
Improveobject information accuracyVSAvoiddata amount
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential polarization parameters needed to represent the object's surface properties. Instead of storing all raw pixel data from multiple polarization directions, the method extracts key parameters such as the polarization angle and degree of polarization for each pixel, which can then be used to reconstruct the normal information of the object. This extraction process significantly reduces the data amount while maintaining measurement precision.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a universal representation of polarized image data that can serve multiple purposes. By encoding the polarization information in a compact format that captures the essential optical properties, the same data structure can be used for various applications including surface normal estimation, material classification, and 3D reconstruction, thereby reducing the need for separate data sets for different analytical goals.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3852375B1Image processing device, image processing method, and program
Publication Date: 2024.09.25 SONY GROUP CORP
  • EP3852375B1 patent drawingFigure 1
  • EP3852375B1 patent drawingFigure 2
  • EP3852375B1 patent drawingFigure 3

AI summary

A polarization imaging unit 20 acquires a polarized image including polarization pixels with a plurality of polarization directions. An information compression unit 40 sets reference image information based on polarized image information of reference polarization pixels with at least a plurality of polarization directions in the polarized image and generates difference information between the polarized image information of each of polarization pixels different from the reference polarization pixels in the polarized image and the reference image information. In addition, the information compression unit 40 reduces the amount of information of the difference information generated for each of the polarization pixels with the plurality of polarization directions to generate compressed image information including the reference image information and the difference information with the reduced amount of information. An information decoding unit 70 applies a decoding process corresponding to the compression process of the information compression unit 40 to the compressed image information acquired through a recording medium 50 or a transmission path 60 to generate the polarized image and outputs the polarized image to a polarized image using unit 80.