Regional Compositing Z-Order Map for Video Graphics Blending
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compositing technologies face limitations in handling flexible models with multiple graphics and video surfaces, leading to increased bandwidth, performance, and complexity issues, especially when dealing with different graphics resolutions and color formats.
Innovation Solution
The implementation of regional compositing, which determines the Z-order of video and graphics planes according to rectangular regions associated with a single graphics frame buffer, allowing for flexible blending without requiring per-pixel alpha modification or increased memory allocation, and enabling independent updating of graphics and video planes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple graphics and video surfaces are blended with flexible ordering, then compositing flexibility and adaptability are improved, but bandwidth consumption and device complexity increase
Solution Approach 1:
The display area is divided into multiple rectangular regions, each with its own Z-order configuration. This segmentation allows different blending orders to be applied to different regions independently, providing compositing flexibility without requiring the system to handle all possible global ordering permutations, thus controlling complexity.
Solution Approach 2:
Different Z-order arrangements are applied to different rectangular regions based on local requirements. Each region can have its own customized blending order (e.g., video-over-graphics in some regions, graphics-over-video in others), allowing local optimization without global complexity.
2Adaptability or versatility
If per-pixel alpha modification is performed to achieve flexible blending, then compositing adaptability is improved, but processing complexity and bandwidth increase
Solution Approach 1:
Instead of modifying alpha values on a per-pixel basis across the entire frame, the solution segments the problem into rectangular regions where Z-order is defined at the region level. This reduces processing complexity by avoiding pixel-level operations while maintaining blending flexibility through region-level control.
Solution Approach 2:
The patent extracts the blending order information into a separate Z-order map structure, independent of the pixel data. This separation allows flexible compositing to be achieved through coordinate and ordering transformations rather than modifying the actual pixel alpha values, reducing processing complexity and bandwidth requirements.
3Adaptability or versatility
If multiple graphics planes are used to support flexible compositing, then adaptability is improved, but memory allocation and bandwidth increase
Solution Approach 1:
Multiple graphics planes are merged into a single composite graphics frame buffer. The Z-order relationships between what would have been separate planes are encoded in the Z-order map, allowing multiple logical planes to coexist in a single physical buffer, thus reducing memory allocation while maintaining the ability to represent multiple surfaces.
Solution Approach 2:
Instead of allocating separate memory for each graphics plane, the patent creates a logical representation of multiple planes through the Z-order map structure that references regions within a single frame buffer. This virtual copying approach maintains the appearance of multiple planes without the actual memory overhead.
4Reliability
If synchronization between graphics and video planes is implemented, then compositing reliability is improved, but processing time and complexity increase
Solution Approach 1:
The Z-order map is pre-computed based on the rectangular region definitions and Z-order configurations before the actual compositing operation. This preliminary setup establishes the blending order in advance, eliminating the need for complex runtime synchronization logic and reducing processing time during actual frame composition.
Data Source
AI summary
A method for regional compositing includes compositing a plurality of video planes and at least one graphics plane. Graphics elements of the at least one graphics plane may be stored into a single graphics plane. A rectangle may be associated to one or more graphics elements of the single graphics plane. A Z-order of the plurality of video planes and the at least one graphics plane may be determined according to rectangular regions defined by rectangles associated with graphics elements of the single graphics plane. A pixel-by-pixel Z-order may be performed based on the determined Z-order of the plurality of video planes and the at least one graphics plane.