Layer ROI Composition for Per-Region Display Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display processing technologies struggle to support image or color processing on a per-region basis within a single display layer, particularly for multiple sub-layer regions of interest (ROIs), leading to limitations in performance and flexibility.
Innovation Solution
The proposed solution involves a display processing unit (DPU) that can process layers and adjust pixels on a per-region basis, allowing for image or color processing at multiple sub-layer levels within a single display layer, enhancing support for complex content layouts and improving performance and flexibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional display processing is used, then processing is performed at the layer level, but image or color processing cannot be done on a per-region basis within sub-layers
Solution Approach 1:
The display layer is segmented into multiple sub-layers, and each sub-layer is further divided into regions of interest (ROIs). This segmentation enables independent processing of different regions, allowing image or color processing on a per-region basis while maintaining the overall layer structure. The composition component assigns specific sub-layers or ROIs to different processing pipelines based on their content requirements.
Solution Approach 2:
Different regions or sub-layers within the display are assigned different processing characteristics. The composition component enables selective processing where certain ROIs receive image processing while others receive color processing, based on local content requirements. This allows each region to be processed according to its specific needs rather than applying uniform processing across the entire display.
2Adaptability or versatility
If per-region processing is implemented, then processing flexibility is improved, but the complexity of assigning and managing multiple processing pipelines increases
Solution Approach 1:
The composition component serves as a universal manager that handles multiple processing pipelines and assigns them to different sub-layers or ROIs. This single component performs multiple functions including layer composition, pipeline assignment, and region management, thereby reducing the overall system complexity despite the increased processing flexibility.
Solution Approach 2:
The composition component acts as an intermediary between the display layers and the processing pipelines. It receives layers from the graphics processing unit, assigns them to appropriate pipelines based on region requirements, and coordinates the processing operations. This intermediary role simplifies the interaction between multiple processing components and reduces management complexity.
3Productivity
If multiple sub-layer ROIs are processed, then display processing performance is enhanced, but resource allocation and composition operations become more complex
Solution Approach 1:
The display is segmented into sub-layers and regions of interest, allowing parallel processing of different regions by different pipelines. This segmentation enables improved processing performance through concurrent operations while maintaining manageable complexity through structured organization of processing units.
Solution Approach 2:
The composition component performs preliminary assignment of sub-layers and ROIs to processing pipelines before actual processing begins. By pre-establishing the mapping between regions and pipelines, the system avoids complex runtime allocation decisions during processing, thereby improving performance while reducing operational complexity.
Data Source
AI summary
Aspects presented herein relate to methods and devices for display processing including an apparatus, e.g., a DPU. The apparatus may obtain a plurality of layers associated with at least one frame, wherein each layer of the plurality of layers includes a set of layer regions, where each of the set of layer regions includes a plurality of pixels. The apparatus may also assign each of the set of layer regions to a corresponding component in a set of components in a DPU pipeline. Further, the apparatus may adjust a portion of the plurality of pixels in at least one layer region of the set of layer regions with the corresponding component in the set of components in the DPU pipeline. The apparatus may also compose the set of layer regions including the at least one layer region with the adjusted portion of the plurality of pixels.