Variable Refresh Rate Display for Cloud Gaming Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display and server technologies for cloud gaming services face limitations due to factors like internet speed, network quality, and processing delays, which affect the ability to provide high-quality, low-latency content across various devices.

Innovation Solution

The implementation of a display apparatus and server apparatus that utilize variable refresh rate (VRR) technology, where the display apparatus transmits available refresh rate information to the server, and the server renders variable frequency images based on this information and network bandwidth, allowing for dynamic adjustment of frame rates to optimize content delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a fixed high frame rate is used for content streaming, then content quality is improved, but network bandwidth consumption increases and transmission delay worsens

Engineering Contradiction:
Improvecontent qualityVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The patent implements variable refresh rate (VRR) technology that dynamically adjusts the frame rate of displayed content based on real-time detection of user eye movement characteristics. When the user is actively tracking moving objects, the system maintains high frame rates to preserve content quality. When the user's gaze is stable or not actively tracking, the system reduces frame rates to conserve network bandwidth. This dynamic adjustment resolves the contradiction by making frame rate adaptive rather than fixed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the temporal parameter (frame rate) of content delivery based on detected user viewing behavior. By monitoring eye movement patterns and determining when users are actively engaged with moving objects versus when their gaze is stable, the system adjusts the frame rate parameter accordingly. This parameter change strategy allows the system to maintain high content quality only when necessary, reducing overall network bandwidth consumption while preserving user experience during critical viewing moments.

Inventive Principle:
Principle #35Parameter changes

2Stability of the object's composition

If a high fixed refresh rate is maintained, then display smoothness is improved, but power consumption increases and device heat generation worsens

Engineering Contradiction:
Improvedisplay smoothnessVSAvoidpower consumption
Core Design Contradiction:
Stability of the object's compositionVSUse of energy by moving object

Solution Approach 1:

The display apparatus dynamically adjusts its refresh rate based on detected user eye movement characteristics rather than maintaining a fixed high refresh rate. When users are actively tracking moving objects, the display maintains high refresh rates to ensure smoothness. When user gaze is stable or not actively tracking, the display reduces refresh rates to lower power consumption and heat generation. This dynamic adaptation resolves the contradiction between display smoothness and energy efficiency.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the temporal parameter (refresh rate) of the display based on real-time detection of user viewing behavior patterns. By monitoring whether users are actively engaged with moving objects or have stable gaze, the system adjusts the refresh rate parameter dynamically. This allows the display to maintain smooth visual output only when users actually need it, significantly reducing power consumption and heat generation during periods when high smoothness is not required for user experience.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If variable refresh rate technology is implemented, then network bandwidth efficiency is improved, but system complexity increases

Engineering Contradiction:
Improvenetwork bandwidth efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service by automatically detecting user eye movement characteristics and autonomously determining optimal frame rates without requiring manual user input or complex external control systems. The display apparatus and server work together to automatically monitor viewing behavior, analyze eye movement patterns, and adjust content delivery parameters in real-time. This self-service approach achieves high network bandwidth efficiency while avoiding the complexity that would arise from manual configuration or complex external control systems.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system employs feedback mechanisms where the display apparatus detects user eye movement characteristics and feeds this information back to the server, which then adjusts the frame rate of transmitted content accordingly. This closed-loop feedback system enables automatic optimization of network bandwidth usage based on actual user engagement with the content. The feedback mechanism achieves high bandwidth efficiency while keeping system complexity manageable by using straightforward detection and adjustment logic rather than complex algorithms.

Inventive Principle:
Principle #23Feedback

4Use of energy by moving object

If frame rate is dynamically adjusted based on user engagement, then power efficiency is improved, but detection precision requirements increase

Engineering Contradiction:
Improvepower efficiencyVSAvoideye movement detection precision
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The system changes detection parameters based on content characteristics and user behavior patterns. Rather than requiring uniformly high detection precision at all times, the system adjusts detection sensitivity and sampling rates according to the current viewing context. When users are actively tracking moving objects, the system uses higher precision detection. When gaze is stable or content is less dynamic, detection precision requirements are reduced. This parameter adjustment in detection itself resolves the contradiction between power efficiency and measurement precision.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system applies different detection precision levels to different regions of interest within the content and different time periods based on user engagement patterns. Rather than uniformly high precision detection across the entire field of view and all time periods, the system focuses detection resources on relevant regions where users are actively engaged with moving objects. This local quality approach achieves adequate detection precision where needed while reducing overall power consumption, resolving the contradiction between detection accuracy and energy efficiency.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240181340A1Display apparatus, server apparatus and control method thereof
Publication Date: 2024.06.06 SAMSUNG ELECTRONICS CO LTD
  • US20240181340A1 patent drawing
  • US20240181340A1 patent drawing
  • US20240181340A1 patent drawing

AI summary

Provided is a display apparatus configured to display a variable frequency image. The display apparatus includes: a communication interface; a display; a memory; and at least one processor. The display apparatus is configured to: transmit, through the communication interface, available range information to an external server, the available range information comprising a minimum refresh rate and a maximum refresh rate of a variable refresh rate (VRR), receive content from the external server, through the communication interface, the content comprising a variable frequency image rendered based on the available range information, network bandwidth information, and variable frame rate information that corresponds to the variable frequency image, and control, based on the received content, the display to display the variable frequency image based on the variable frame rate information.