Gameplay Video Encoding Using Game Data for Low-Latency Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video game streaming technologies face challenges in achieving low latency and high visual quality due to the inefficiencies in real-time video encoding, particularly when relying on complexity analysis of generated content, which adds significant latency.
Innovation Solution
A method utilizing game data, such as metadata and information from intermediate rendering buffers, to estimate spatial and temporal complexity of video frames, allowing for real-time encoding parameter selection without additional latency, using predefined algorithms or machine learning models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If real-time video encoding is performed using complexity analysis of generated content, then visual quality can be maintained, but latency increases significantly
Solution Approach 1:
The patent applies preliminary action by pre-defining encoding parameters for different complexity levels before video encoding occurs. Complexity analysis is performed in advance on game data or intermediate rendering buffers, and encoding parameters are selected and prepared beforehand, eliminating the need for real-time complexity analysis during video encoding and thus reducing latency while maintaining quality.
Solution Approach 2:
The patent uses copying by creating a simplified model or representation of video frame complexity using game data or intermediate rendering buffers instead of actually analyzing the full video frames in real-time. This copy approach allows complexity estimation without the computational burden of real-time video analysis, reducing processing time and latency.
2Manufacturing precision
If encoding parameters are selected based on real-time complexity analysis, then visual quality is optimized, but processing time and latency increase
Solution Approach 1:
The patent performs complexity analysis and encoding parameter selection in advance using game data or intermediate rendering buffers that are already available in the rendering pipeline. This preliminary action eliminates the need for real-time complexity analysis during video encoding, significantly improving encoding speed while maintaining optimized quality through pre-calculated parameters.
Solution Approach 2:
The patent replaces the mechanical system of real-time video frame complexity analysis with a computational model that uses game data or intermediate rendering buffers to predict complexity. This substitution uses predefined algorithms or machine learning models that process available data much faster than real-time video analysis, improving encoding throughput without sacrificing quality optimization.
3Manufacturing precision
If high visual quality is maintained in streamed gameplay video, then user experience improves, but bandwidth requirements increase
Solution Approach 1:
The patent applies parameter changes by dynamically adjusting encoding parameters such as bitrate, resolution, and frame rate based on estimated video complexity. When complexity is low, the system uses lower bitrate and reduced resolution parameters to save bandwidth. When complexity is high, the system automatically increases parameters to maintain visual quality, thus optimizing the balance between quality and bandwidth usage in real-time.
Solution Approach 2:
The patent implements dynamics by making encoding parameters adaptive and variable rather than fixed. The system continuously monitors game data or intermediate rendering buffers to estimate complexity and dynamically adjusts encoding parameters accordingly. This dynamic adaptation allows the system to maintain high visual quality when needed while significantly reducing bandwidth consumption during low-complexity periods.
Data Source
AI summary
A system comprising a game execution unit configured to execute a game, wherein executing the game comprises rendering a plurality of image frames for display to a player of the game, a game information obtaining unit configured to obtain information about the execution of the game, including obtaining information, corresponding to an image frame currently being rendered, a complexity estimation unit configured to estimate a spatial and/or temporal complexity of the image frame being rendered in dependence upon the obtained information, a parameter selection unit configured to select one or more encoding parameters in dependence upon the estimated spatial and/or temporal complexity, and an encoding unit configured to encode the video of the game being executed using the selected encoding parameters, the encoded video comprising the plurality of image frames for display to the player.