Adaptive Display Frame Scheduler for Rendering Bottlenecks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Continuous adaptive synchronization methods can lead to a reduced display refresh rate, causing applications or games to not align with the newly extended VSYNC boundary, which defeats the purpose of having a high refresh rate display panel by limiting the application or game play experience.

Innovation Solution

An adaptive display frame scheduler temporarily reduces and adjusts the display refresh rate, and an adaptive game rendering model decreases rendering resolution in small steps based on extended VSYNC duration until it reaches a minimum level, allowing the GPU rendering rate to catch up, then increases the refresh rate to prevent continuous decrease.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If continuous adaptive synchronization is used to extend VSYNC boundary to accommodate GPU rendering delays, then the rendering time constraint is improved, but the display refresh rate is reduced

Engineering Contradiction:
Improverendering time constraintVSAvoiddisplay refresh rate
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The system uses periodic VSYNC signals to synchronize rendering with display refresh. When rendering delays occur, the system temporarily extends the VSYNC boundary in a periodic manner rather than continuously, allowing the display refresh rate to be restored once the GPU catches up. This periodic extension approach maintains reliability during delays while preserving the high refresh rate capability for normal operation.

Inventive Principle:
Principle #19Periodic action

2Manufacturing precision

If the display refresh rate is reduced to allow GPU to catch up, then the rendering quality is improved, but the gaming experience is limited

Engineering Contradiction:
Improverendering qualityVSAvoidgaming experience
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system dynamically adjusts the display refresh rate based on real-time GPU rendering performance. When the GPU is behind schedule, the refresh rate is temporarily reduced to allow catching up; when the GPU is ahead or on schedule, the refresh rate is increased to provide smooth gaming experience. This dynamic adjustment ensures rendering quality is maintained while minimizing impact on user experience.

Inventive Principle:
Principle #15Dynamics

3Reliability

If the VSYNC boundary is continuously extended to accommodate rendering delays, then the frame completion is ensured, but the application alignment is lost

Engineering Contradiction:
Improveframe completionVSAvoidapplication alignment
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system continuously monitors GPU rendering performance and uses this feedback to adjust VSYNC boundary extension. When rendering delays are detected, the system extends the VSYNC boundary; when the GPU catches up, the extension is reduced or removed. This feedback-based control ensures frame completion is maintained while preserving application alignment with the display refresh rate.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20210358079A1Methods and apparatus for adaptive rendering
Publication Date: 2021.11.18 QUALCOMM INC
  • US20210358079A1 patent drawing
  • US20210358079A1 patent drawing
  • US20210358079A1 patent drawing

AI summary

The present disclosure relates to methods and apparatus for display processing. The apparatus can monitor a rendering time for each of a plurality of layers in a display frame. The apparatus can also determine whether a rendering time of one or more layers is greater than a maximum rendering time threshold. The apparatus can also adjust a rendering resolution of the one or more layers when the rendering time of the one or more layers is greater than the maximum rendering time threshold. Moreover, the apparatus can reduce the rendering resolution of the one or more layers when the rendering time of the one or more layers is greater than the maximum rendering time threshold. Also, the apparatus can increase the rendering resolution of the one or more layers when the rendering time of the one or more layers is less than a minimum rendering time threshold.