Graphics Accelerator Offloads GPU Composition Workload
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional graphics processing units (GPUs) face challenges in maintaining rendering performance due to resource-intensive composition operations, leading to dropped frames during time-constrained graphics events in mobile devices.
Innovation Solution
A graphics accelerator device with dedicated hardware for image composition and rendering, operating in modes such as composition, rendering, and virtual reality, offloads GPU workload by performing image composition and time-warping operations with minimal memory access, allowing for efficient graphics processing and frame rate maintenance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the GPU performs both image production and composition operations, then the system can maintain a unified graphics processing architecture, but the GPU workload increases leading to dropped frames during time-constrained graphics events
Solution Approach 1:
The patent divides the graphics processing functions into two separate hardware components: a GPU dedicated to image production (rendering) and a display processor dedicated to image composition. This segmentation allows each component to specialize in its specific task, preventing the GPU from being overloaded by composition operations and thereby eliminating frame drops during time-constrained graphics events.
Solution Approach 2:
The patent extracts the image composition function from the GPU and places it in a separate display processor. By taking out the composition operations from the GPU, the GPU's workload is reduced to only image production tasks, ensuring that the GPU can maintain high rendering performance without being delayed by composition requirements.
2Ease of operation
If the GPU performs image composition operations, then the composition can be integrated with rendering pipeline, but the GPU resources are consumed away from image producing tasks
Solution Approach 1:
The patent extracts the image composition operations from the GPU and assigns them to a separate display processor. This extraction ensures that GPU computational resources are dedicated solely to image production tasks, preventing resource consumption for composition operations while maintaining efficient graphics processing through the specialized display processor.
3Reliability
If a heavily-loaded GPU is used to meet display refreshing frequency requirements, then the system can maintain high graphics capabilities, but frame drops occur when the GPU cannot keep up with the refreshing speed
Solution Approach 1:
The patent segments the graphics processing workload between a GPU for rendering and a display processor for composition and timing management. The display processor handles the time-constrained composition operations and ensures frames are prepared for display at the required refreshing frequency, relieving the GPU of these time-critical tasks and preventing frame drops even under heavy loading conditions.
Solution Approach 2:
The display processor acts as an intermediary between the GPU and the display device. It receives rendered frames from the GPU, performs composition operations, and manages the timing to ensure frames are displayed at the correct refreshing frequency. This intermediary role ensures reliable frame rate consistency without requiring the GPU to directly manage display timing and composition.
Data Source
AI summary
A graphics accelerator device offloads the workload of a graphics processing unit (GPU) by performing image composition and other specialized functions. The graphics accelerator device includes a rasterization module to rasterize a set of primitives to a set of pixels and generate information of the set of pixels. The graphics accelerator device also includes intra-process module to retrieve pixel values from a memory according to the information received from the rasterization module, perform mathematical calculations on the pixel values, and generate one or more processed image layers. The graphics accelerator device further includes an inter-process module to composite the one or more processed image layers received from the intra-process module with other image layers retrieved from the memory, and output a composited image to a display.