Screen Projection Dirty Region Rendering GPU Load Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing screen projection methods between mobile devices and large-screen devices often lead to delayed display and suspended operations due to the heavy load on the graphics processing unit (GPU) caused by maintaining the same frame rate for multiple windows, resulting in inefficient resource utilization and performance issues.
Innovation Solution
The proposed method involves identifying 'dirty regions' in the screen projection image frames where changes occur and only updating those areas, allowing the GPU to reuse rendered images for unchanged regions, thereby reducing the workload and improving performance by sending only the necessary data for rendering and display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the mobile phone maintains the same frame rate for multiple screen projection windows, then the display quality is improved, but the GPU workload increases causing delayed display and suspended operation
Solution Approach 1:
The patent divides the screen projection surface into multiple independent projection surfaces, each corresponding to a specific window. This allows the system to render only the regions that have changed in each window independently, rather than rendering the entire screen at full frame rate for all windows simultaneously. The segmentation enables selective rendering of dirty regions (changed areas) only, reducing overall GPU workload while maintaining display quality for each individual window.
Solution Approach 2:
Instead of rendering the entire screen projection surface at full frame rate for all windows, the patent applies partial action by rendering only the necessary portions (dirty regions) of each window. The system identifies changed regions and renders only those specific areas, rather than performing excessive full-screen rendering for every window, thus reducing GPU workload while maintaining visual quality where changes occur.
2Duration of action of moving object
If the GPU renders all screen projection surfaces at full frame rate, then the display smoothness is improved, but the resource utilization efficiency deteriorates
Solution Approach 1:
The patent implements dynamic rendering by adjusting the frame rate and rendering frequency based on the actual content changes in each window. When a window's content remains unchanged, the system reduces or skips rendering for that window, dynamically adapting resource allocation. This dynamic approach maintains smooth display for windows with changes while conserving resources for windows without changes, optimizing overall resource utilization efficiency.
Solution Approach 2:
The patent changes the rendering parameter from a fixed full frame rate for all windows to a variable frame rate based on content changes. By detecting dirty regions and adjusting the rendering frequency accordingly, the system modifies the frame rate parameter dynamically - rendering at full frame rate only when necessary (when changes occur) and reducing frame rate when content is static, thus improving resource utilization efficiency while maintaining display smoothness where needed.
3Manufacturing precision
If the system updates all screen projection windows every frame, then the display accuracy is improved, but the processing time increases causing intermittent stops
Solution Approach 1:
The patent applies preliminary action by identifying dirty regions (changed areas) in each window before performing rendering. The system pre-processes the screen projection data to detect which regions have changed, and only schedules rendering for those specific regions. This preliminary detection prevents unnecessary rendering of unchanged areas, reducing processing time and eliminating intermittent stops while maintaining display accuracy for the regions that actually changed.
Solution Approach 2:
The patent extracts only the necessary rendering data from the full screen projection surface by identifying and isolating dirty regions. Instead of processing the entire screen projection surface every frame, the system extracts and processes only the changed portions (dirty regions) of each window. This extraction approach maintains display accuracy for updated areas while significantly reducing processing time by eliminating redundant processing of unchanged areas.
Data Source
AI summary
This application discloses screen projection methods and systems and related apparatuses. In an example method, a first electronic device may send first display data corresponding to a first screen projection window on a second electronic device and second display data corresponding to a second screen projection window on the second electronic device to the second electronic device. The first electronic device may further send third display data and fourth display data to the second electronic device. In response to determining that the third display data is different from the first display data and that the fourth display data is the same as the second display data, the second electronic device may render and display a third screen projection page in the first screen projection window based on the third display data and display a buffered second screen projection page in the second screen projection window.