Regional Image Processing for Under-Display Device Visual Quality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern computing devices face challenges in displaying graphical content on screens with regions of different pixel densities, particularly when integrating under-display devices like cameras or fingerprint readers, which require regions with lower pixel densities.
Innovation Solution
A method and apparatus for regional image processing, where a display processor identifies subsections of frame layers corresponding to lower pixel density regions, blends pixel data to generate second pixel data, populates a buffer layer, and blends pixel data from frame layers and the buffer layer to create a blended image for presentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the display processor processes all pixel data for the entire display, then the visual quality can be maintained, but the processing load on the display processor increases significantly
Solution Approach 1:
The display area is segmented into multiple regions with different pixel densities. The display processor identifies and processes only the subsection corresponding to the lower pixel density region, while other regions are handled by the GPU. This segmentation allows the display processor to focus computational resources on critical areas, maintaining visual quality where needed while reducing overall processing load.
Solution Approach 2:
Different regions of the display are assigned different processing qualities based on their pixel density characteristics. The lower pixel density region receives enhanced processing from the display processor to compensate for its lower resolution, while higher pixel density regions rely on standard GPU processing. This local quality approach ensures that computational resources are allocated efficiently according to the specific needs of each display region.
2Area of stationary object
If the display uses regions with lower pixel density to accommodate under-display devices, then the screen-to-body ratio increases, but the visual quality in those regions deteriorates
Solution Approach 1:
The system applies different processing strategies to different regions of the display. Regions with lower pixel density that contain under-display devices receive specialized processing from the display processor, including selective blending of frame layers and pixel data manipulation. This ensures that visual quality is optimized locally in these regions without compromising the overall screen-to-body ratio achieved through the under-display device integration.
Solution Approach 2:
The display processor performs preliminary processing of pixel data for lower pixel density regions before the final display output. By pre-identifying subsections corresponding to these regions and pre-blending frame layers, the system prepares optimized pixel data in advance, compensating for the inherent lower quality of these regions and ensuring acceptable visual output despite the reduced pixel density.
3Manufacturing precision
If the display processor handles regional processing for lower pixel density regions, then the visual quality improves, but the device complexity increases
Solution Approach 1:
The processing responsibilities are segmented between the display processor and the GPU. The display processor handles only the identification and processing of subsections corresponding to lower pixel density regions, while the GPU manages the remaining display areas. This segmentation of processing tasks reduces the complexity burden on any single processor and allows each component to operate within its optimized functional scope.
Solution Approach 2:
The display processor acts as an intermediary between the frame layers and the final display output for specific regions. It receives frame layer data, performs selective blending and processing operations on subsections corresponding to lower pixel density regions, and then passes the processed data to the display. This intermediary role allows the system to maintain visual quality in challenging regions without requiring complete redesign of the entire graphics pipeline.
Data Source
AI summary
The present disclosure relates to methods and apparatus for display processing. For example, disclosed techniques facilitate regional processing of images for under-display device displays. Aspects of the present disclosure can identify a subsection of a set of frame layers, the identified subsection corresponding to a lower pixel density region, relative to at least one other region, of a display. Aspects of the present disclosure can also blend first pixel data for each frame layer corresponding to the identified subsection to generate second pixel data. Further, aspects of the present disclosure can populate a buffer layer based on the second pixel data. Additionally, aspects of the present disclosure can blend pixel data from the set of frame layers and the buffer layers to generate a blended image. Aspects of the present disclosure can also transmit the blended image for presentment via the display.