Synthesizer Offloading GPU Rendering for Frame Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern electronic devices face challenges in achieving smooth image display and reducing power consumption due to the high GPU load from rendering tasks, which can result in degraded user experience and increased power usage.

Innovation Solution

A method and apparatus that utilize a synthesizer to offload GPU rendering tasks, where the GPU generates initial frames and metadata, and the synthesizer synthesizes subsequent frames using previous frame information and metadata, reducing the load on the GPU and enhancing overall device performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If GPU performs full rendering to achieve smooth image display, then frame rate is improved, but power consumption increases

Engineering Contradiction:
Improveframe rateVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The rendering process is segmented into two parts: full rendering by GPU for the first frame, and synthesized rendering by the synthesizer for subsequent frames. This segmentation allows the system to maintain high frame rates while reducing the continuous power consumption burden on the GPU.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A synthesizer component is introduced as an intermediary between the GPU and display panel. The synthesizer receives metadata and previous frame information from the GPU, then generates intermediate frames without requiring full GPU rendering, thereby reducing power consumption while maintaining visual quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If GPU performs full rendering to achieve high frame rate, then display performance is improved, but GPU load increases

Engineering Contradiction:
Improveframe rateVSAvoidGPU load
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts the frame generation task from the GPU and transfers it to the synthesizer. The GPU only needs to generate metadata and the first frame, while the synthesizer handles subsequent frame generation, significantly reducing GPU load and complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The synthesizer creates copies of frames by synthesizing intermediate frames based on metadata and previous frame information, rather than requiring the GPU to generate every frame from scratch. This copying approach reduces the computational burden on the GPU.

Inventive Principle:
Principle #26Copying

3Loss of energy

If synthesizer is added to offload GPU rendering, then device complexity increases, but power consumption reduces

Engineering Contradiction:
Improvepower consumptionVSAvoiddevice architecture
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The synthesizer is designed with multi-functionality, handling both frame synthesis and metadata processing tasks. This universal component can perform multiple functions that would otherwise require separate dedicated hardware, minimizing the increase in device complexity while achieving power consumption reduction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11200636B2Method and apparatus for generating a series of frames with aid of synthesizer to offload graphics processing unit rendering in electronic device
Publication Date: 2021.12.14 MEDIATEK INC
  • US11200636B2 patent drawing
  • US11200636B2 patent drawing
  • US11200636B2 patent drawing

AI summary

A method and apparatus for generating a series of frames with aid of a synthesizer to offload graphics processing unit (GPU) rendering within an electronic device are provided. The method may include: utilizing a GPU to perform full-rendering to generate a first frame in a color buffer, for being output to a display panel and displayed on the display panel; utilizing the GPU to generate a set of metadata of at least one subsequent frame in a metadata buffer; and utilizing the synthesizer to synthesize said at least one subsequent frame according to previous frame information and the set of metadata of said at least one subsequent frame, to generate said at least one subsequent frame in the color buffer, for being output to the display panel and displayed on the display panel.