RAW Image Error Concealing via Reconstruction Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods of transmitting and processing RAW images, especially when divided by color, lead to a reduction in subjective image quality due to improper error concealing, as they use adjacent images with different color components for error correction.

Innovation Solution

An information processing device and method that generates and transmits reconstruction information corresponding to a reconstructed RAW image, allowing for accurate error concealment based on the identified parameter values, ensuring proper color components are used for image reconstruction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a RAW image is divided into images for respective colors and transmitted, then encoding efficiency is improved, but error concealing using adjacent images with different color components reduces subjective image quality

Engineering Contradiction:
Improveencoding efficiencyVSAvoidsubjective image quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The RAW image is divided into separate color component images (R, G, B) for independent encoding and transmission. Each color component is transmitted as a separate image unit, allowing targeted error concealing for each color without mixing with other colors, thus maintaining encoding efficiency while improving image quality through color-specific error correction

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A color conversion matrix is introduced as an intermediary to transform color space during error concealing operations. Instead of directly using adjacent images with different colors for error concealing, the system converts color components through the matrix to achieve proper color matching, thereby preventing color distortion and maintaining subjective image quality

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If conventional error concealing is applied to divided color images, then transmission errors are concealed, but color component mismatch reduces image quality

Engineering Contradiction:
Improveerror concealment capabilityVSAvoidcolor accuracy
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The system changes the parameter of color space representation by introducing a color conversion matrix. During error concealing, instead of directly copying pixel values from adjacent images, the system transforms color components using the matrix to maintain proper color relationships, thereby achieving both reliable error concealment and color accuracy

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240284058A1Information processing device and method
Publication Date: 2024.08.22 SONY SEMICON SOLUTIONS CORP
  • US20240284058A1 patent drawing
  • US20240284058A1 patent drawing
  • US20240284058A1 patent drawing

AI summary

The present disclosure relates to an information processing device and method that can suppress a loss of subjective image quality when the loss is caused by error concealing.Reconstruction information is generated, and the generated reconstruction information is transmitted. The reconstruction information corresponds to a reconstructed image obtained by reconstructing a RAW image by using a predetermined parameter and identifies the value of the parameter, the RAW image being outputted from a sensor for detecting incident light in each pixel of a pixel array. The reconstruction information is received, and a transmission error of the reconstructed image is concealed on the basis of the received reconstruction information. The present disclosure can be applied to, for example, an information processing device, an encoding device, a decoding device, an electronic device, an information processing method, or a program.