Split Raw Image Processing With Blending Regions Across Dual ISPs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
When multiple image signal processors (ISPs) process image signals with different setting values, consistency among generated images decreases, leading to unnatural boundaries and reduced image quality.
Innovation Solution
A method is employed where a split circuit transmits portions of a raw image signal to multiple ISPs, determining a blending region based on register value differences and pixel value discrepancies, merging them to create a cohesive image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple ISPs process image signals with different setting values, then processing capacity and real-time performance are improved, but consistency among generated images decreases
Solution Approach 1:
The image signal is divided into multiple partial image signals that are processed by different ISPs simultaneously. The split circuit separates the original image signal into first and second partial image signals, enabling parallel processing while maintaining overall system consistency through controlled overlap regions.
Solution Approach 2:
Different processing strategies are applied to different regions of the image signal. The overlap region is specifically identified and handled with special blending processing, while other regions undergo standard ISP processing. This allows local optimization of consistency in critical areas while maintaining high processing capacity overall.
2Speed
If multiple ISPs process image signals with different setting values, then processing speed is improved, but image quality and naturalness decrease
Solution Approach 1:
The split circuit preliminarily identifies and marks the overlap region before the ISPs process the partial image signals. By pre-determining which regions will be blended, the system prepares for quality preservation in advance, ensuring that critical boundary areas receive appropriate processing attention while maintaining overall processing speed.
Solution Approach 2:
The overlap region acts as an intermediary zone between regions processed by different ISPs. This intermediate region undergoes special blending processing that mediates between the different processing results, smoothing transitions and eliminating unnatural boundaries while preserving the speed benefits of parallel processing.
3Reliability
If a blending region is defined to harmonize images from different ISPs, then image consistency is improved, but processing complexity increases
Solution Approach 1:
The overlap region is extracted and separated from the rest of the image signal for specialized processing. The split circuit identifies this region and handles it differently from other regions, applying specific blending operations only where needed. This extraction approach maintains consistency without requiring complex processing across the entire image.
Solution Approach 2:
Instead of applying complex blending processing to the entire image, the system applies it only to the partial overlap region where it is actually needed. This partial action approach maintains image consistency in critical areas while avoiding unnecessary processing complexity in regions that don't require blending.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
A method, performed by an image processing device, of processing an image signal is provided. The method includes receiving, by a split circuit, a first raw image signal, which is at least a portion of an image signal captured by an image sensor of a first camera, determining, by the split circuit, a blending region for the first raw image signal, transmitting, from the split circuit, a first partial raw image signal of the first raw image signal corresponding to a first region including the blending region to a first image signal processor (ISP), and transmitting, from the split circuit, a second partial raw image signal of the first raw image signal corresponding to a second region including the blending region to a second ISP. The first partial raw image signal is processed by the first ISP, and the second partial raw image signal is processed by the second ISP.