Graphics Accelerator Direct Memoryless Display Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional graphics processing units (GPUs) face challenges in efficiently rendering and composing graphical images, particularly in scenarios like video games or virtual reality, where they may struggle to maintain frame rates due to resource-intensive composition operations, leading to dropped frames.

Innovation Solution

A graphics accelerator device with dedicated hardware for image composition and rendering, featuring a rasterization module, intra-process module for mathematical calculations, and inter-process module for direct pixel output to the display, reducing memory access and enhancing performance by offloading tasks from the GPU.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the GPU performs both image production and composition operations, then the system can maintain a unified graphics processing architecture, but the GPU workload increases and frame rate may drop

Engineering Contradiction:
Improvegraphics processing architectureVSAvoidframe rendering speed
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent divides the graphics processing system into separate functional units: a GPU dedicated to image production (rendering) and a Display Controller dedicated to image composition. This segmentation allows each component to specialize in its specific task, preventing the GPU from being overloaded with composition operations and thereby maintaining high frame rates while preserving architectural clarity through defined interfaces.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If the GPU performs composition operations, then image composition can be integrated with rendering, but composition operations consume significant GPU resources and may cause frames to be dropped

Engineering Contradiction:
Improvegraphics operation integrationVSAvoidframe display timing
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent extracts the image composition function from the GPU and relocates it to the Display Controller. This extraction removes the composition workload from the GPU, ensuring that the GPU can focus exclusively on rendering operations and meet frame timing requirements, while the Display Controller handles composition without impacting rendering performance.

Inventive Principle:
Principle #2Taking out (Extraction)

3Device complexity

If pixel data is processed through memory for composition, then the system can use a simple memory-based composition approach, but memory access increases processing time and reduces rendering performance

Engineering Contradiction:
Improvecomposition processing pathVSAvoidpixel output speed
Core Design Contradiction:
Device complexityVSSpeed

Solution Approach 1:

The patent introduces a specialized composition engine within the Display Controller that acts as an intermediary between the GPU and display output. This composition engine can perform composition operations using alternative methods that reduce or eliminate memory access bottlenecks, such as direct pixel manipulation or optimized composition algorithms, thereby increasing pixel output speed while maintaining a manageable processing architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3214599B1A graphics accelerator with direct memoryless interface to the display
Publication Date: 2018.12.19 MEDIATEK INC
  • EP3214599B1 patent drawingFigure 1
  • EP3214599B1 patent drawingFigure 2
  • EP3214599B1 patent drawingFigure 3

AI summary

A graphics accelerator device offloads the workload of a graphics processing unit (GPU) by performing image composition and other specialized functions. The graphics accelerator device includes a rasterization module to rasterize a set of primitives to a set of pixels and generate information of the set of pixels. The graphics accelerator device also includes intra-process module to retrieve pixel values from a memory according to the information received from the rasterization module, perform mathematical calculations on the pixel values, and generate one or more processed image layers. The graphics accelerator device further includes an inter-process module to composite the one or more processed image layers received from the intra-process module with other image layers retrieved from the memory, and output a composited image to a display.