Image Processing System Demosaicing RAW Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face a dilemma where the accuracy of image processing is compromised due to loss of original information during imaging, and improving image quality leads to increased processing load and delay, affecting responsiveness.

Innovation Solution

An image processing system that includes an imaging apparatus and a host terminal, where the imaging apparatus performs demosaicing and correction processes on RAW images, and the host terminal receives and processes the images, utilizing process information to generate high-quality display images while reducing the overall processing load by parallelizing demosaicing processes and transmitting only necessary data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image quality is improved by performing demosaicing and correction processes in the camera, then manufacturing precision is improved, but productivity deteriorates due to increased processing load and transfer time

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing responsiveness
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent divides the image processing workflow into two segments: the camera performs demosaicing and correction processes to generate high-quality colored images, while the host terminal performs compression coding and transmission. This segmentation allows each device to specialize in specific processing tasks, improving overall system efficiency and responsiveness while maintaining image quality.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If original information is preserved by transmitting non-processed RAW images, then measurement precision is improved, but device complexity increases due to additional processing requirements at the host terminal

Engineering Contradiction:
Improveinformation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by having the camera perform demosaicing and correction processes before transmission. This preliminary processing converts RAW images into colored images with complete color information, reducing the processing complexity at the host terminal while preserving the necessary image quality and information accuracy for subsequent operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10055815B2Image processing apparatus, image processing system, imaging apparatus and image processing method
Publication Date: 2018.08.21 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10055815B2 patent drawing
  • US10055815B2 patent drawing
  • US10055815B2 patent drawing

AI summary

An imaging apparatus 12 acquires RAW images 202a and 202b by left and right cameras and performs a demosaicing process for and stepwise reduction of the RAW images 202a and 202b to generate and correct colored image groups 204a and 204b which represent picked up images with a plurality of resolutions (S10 and S12). Image process parameters 206 acquired in the course of the demosaicing process and the correction process are transmitted to a host terminal 20 together with part of colored images and data of a partial image 208 of the RAW image 202a. The host terminal 20 utilizes the image process parameters 206 transmitted from the imaging apparatus 12 to perform a demosaicing process for the partial image 208 to generate and correct a colored image 212 (S16). The host terminal 20 utilizes the colored image transmitted from the imaging apparatus 12 and the colored image 212 generated therein to generate an image 214 to be displayed (S18 and S20).