RAW Data Synthesis for Imaging Signal Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging systems that use two imaging apparatuses to capture wide visual field and high-resolution images face high processing costs and power consumption due to extensive demosaic processing and large amounts of color information per pixel.

Innovation Solution

A signal processing apparatus and imaging apparatus that synthesize RAW data from two or more imaging devices with different angles of view before demosaic processing, using a positioner to generate positioning data and a synthesizer to combine the data, reducing the amount of color information and necessary calculations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If demosaic processing is performed in each imaging apparatus before synthesis, then color information completeness is improved, but processing cost and power consumption increase

Engineering Contradiction:
Improvecolor information completenessVSAvoidpower consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by performing synthesis on RAW data before demosaic processing. The positioner aligns RAW data from multiple imaging apparatuses at the mosaic stage, and the synthesizer combines them, so that demosaic processing is performed only once on the synthesized data rather than separately on each apparatus's data, reducing total processing load and power consumption

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges the synthesis operation with the demosaic processing operation. Instead of performing demosaic processing separately on each apparatus's output and then synthesizing, the system combines the alignment (positioning) and synthesis functions to operate directly on RAW data, consolidating processing steps and reducing redundant calculations

Inventive Principle:
Principle #5Merging (Combining)

2Loss of information

If demosaic processing is performed in each imaging apparatus before synthesis, then color information completeness is improved, but processing cost increases

Engineering Contradiction:
Improvecolor information completenessVSAvoidprocessing cost
Core Design Contradiction:
Loss of informationVSEase of manufacture

Solution Approach 1:

The patent applies preliminary action by performing synthesis on RAW data before demosaic processing. The positioner aligns RAW data from multiple imaging apparatuses at the mosaic stage, and the synthesizer combines them, so that demosaic processing is performed only once on the synthesized data rather than separately on each apparatus's data, reducing total processing load and power consumption

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges the synthesis operation with the demosaic processing operation. Instead of performing demosaic processing separately on each apparatus's output and then synthesizing, the system combines the alignment (positioning) and synthesis functions to operate directly on RAW data, consolidating processing steps and reducing redundant calculations

Inventive Principle:
Principle #5Merging (Combining)

3Loss of information

If synthesis is performed on image data after demosaic processing, then color information completeness is improved, but calculation amount increases

Engineering Contradiction:
Improvecolor information completenessVSAvoidcalculation amount
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing synthesis on RAW data before demosaic processing. The positioner aligns RAW data from multiple imaging apparatuses at the mosaic stage, and the synthesizer combines them, so that demosaic processing is performed only once on the synthesized data rather than separately on each apparatus's data, reducing total processing load and power consumption

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts the synthesis operation from the post-demosaic processing stage and moves it to the pre-demosaic RAW data stage. By separating the synthesis step from the color interpolation step and performing alignment and combination on the simpler mosaic data, the system reduces the computational complexity of the synthesis operation

Inventive Principle:
Principle #2Taking out (Extraction)

4Manufacturing precision

If two imaging apparatuses are used to capture wide visual field and high resolution images, then image quality is improved, but processing complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing synthesis on RAW data before demosaic processing. The positioner aligns RAW data from multiple imaging apparatuses at the mosaic stage, and the synthesizer combines them, so that demosaic processing is performed only once on the synthesized data rather than separately on each apparatus's data, reducing total processing load and power consumption

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces RAW data as an intermediary format that simplifies the synthesis process. By performing alignment and combination operations on the compact mosaic data structure before converting to full-color image data, the system reduces processing complexity while maintaining the ability to produce high-quality images from multiple apparatuses

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11275296B2Signal processing apparatus and imaging apparatus
Publication Date: 2022.03.15 SONY GROUP CORP
  • US11275296B2 patent drawing
  • US11275296B2 patent drawing
  • US11275296B2 patent drawing

AI summary

A signal processing apparatus according to an embodiment of the present disclosure includes a positioner and a synthesizer. The positioner generates, on the basis of two pieces of RAW data different in angle of view from each other, positioning data of the two pieces of RAW data. The synthesizer synthesizes the two pieces of RAW data with each other on the basis of the positioning data generated by the positioner.