Encoder Blending Overlapping Image Areas
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manual processing of pixels in overlapping regions for multi-sensor camera images is computationally expensive and requires special hardware, such as Field-Programmable Gate Arrays (FPGAs), due to the need for large weight masks and high resolution images.
Innovation Solution
A method and apparatus that control the encoding of images by using different sets of quantization parameter (QP) values for macroblocks in overlapping areas, which are added to the headers of the encoded frames, allowing for blending of overlapping areas without additional hardware support by modifying pixel values differently compared to non-overlapping areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual processing of pixels in overlapping regions is performed to achieve blending, then blending quality is improved, but computational cost increases and special hardware is required
Solution Approach 1:
The patent replaces manual pixel processing (mechanical/computational system) with an encoder-based QP value modification system. Instead of using FPGAs or specialized hardware to manually blend pixels, the invention uses standard video encoders to modify QP values in macroblock headers, allowing blending to occur during the encoding process itself without requiring additional computational resources or special hardware.
Solution Approach 2:
The encoder performs blending operations as part of its normal encoding function. By modifying QP values for macroblocks in overlapping regions, the encoder automatically adjusts the compression and quality characteristics of these regions, enabling blending to occur as a byproduct of the encoding process rather than requiring a separate processing stage.
2Measurement precision
If high resolution images are processed in overlapping areas, then image quality is improved, but computational cost increases
Solution Approach 1:
The patent applies different QP values to different regions of the image, specifically targeting overlapping areas. By modifying QP values locally in macroblock headers for overlapping regions while leaving non-overlapping regions unchanged, the system maintains high image quality where needed while reducing computational overhead by not processing all pixels uniformly.
Solution Approach 2:
The invention changes the QP parameter for macroblocks in overlapping regions to control the blending process. By adjusting this encoding parameter, the system achieves smooth transitions and maintains image quality in overlapping areas without requiring computationally expensive pixel-level processing algorithms.
3Manufacturing precision
If large weight masks are used for blending, then blending accuracy is improved, but device complexity and memory requirements increase
Solution Approach 1:
The patent performs blending-related operations during the encoding process itself, before the video is stored or transmitted. By modifying QP values in macroblock headers during encoding, the blending characteristics are predetermined and embedded in the encoded stream, eliminating the need for complex weight mask calculations and large memory buffers that would be required for real-time or post-processing blending operations.
Data Source
Figure 2
Figure 3
Figure 4
AI summary
A controller and method therein for controlling encoding of a set of images to enable blending of an overlapping area, where a first image and a second image overlap each other are disclosed. The controller encodes macroblocks of the non-overlapping area in the first image using a set of base quantization parameter values, QP-values, and adds the same set of base QP-values to a header of each macroblock. The controller encodes macroblocks of the overlapping area in the first image using a set of first QP values, and adds a modified set of the first QP-values to a header of each macroblock. The controller encodes macroblocks of the overlapping area in the second image using a set of second QP values, and adds a modified set of the second QP-values to a header of each macroblock.