Server-Side Video Rendering for Online Gaming Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Online applications, such as online gaming systems, experience noticeable delays due to network conditions and the complexity of rendering video images on servers, and existing solutions that render images on user devices require high-performance graphics, increasing costs.

Innovation Solution

Implementing server-side rendering where the server identifies future user actions and renders video images representing these actions, limiting them to the most likely outcomes, and transmitting these images to user devices for display, with optional compression based on network conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If video images are rendered on the server, then centralized control and consistency are improved, but network delay and rendering latency increase

Engineering Contradiction:
Improvecentralized controlVSAvoidrendering latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The server pre-renders video images for multiple possible future user actions before the user actually performs them. When a user is in a particular state, the server identifies possible future actions and renders corresponding video images in advance, storing them for quick retrieval. This eliminates real-time rendering delay while maintaining centralized control.

Inventive Principle:
Principle #10Preliminary action

2Speed

If video images are rendered on the user device, then response time is improved, but device cost and graphics performance requirements increase

Engineering Contradiction:
Improveresponse timeVSAvoidgraphics system
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The rendering function is extracted from the user device and transferred to the server. The user device only needs to send user actions to the server and display received video images, eliminating the need for high-performance local graphics processing while maintaining fast response times.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If all possible future user actions are rendered, then completeness of content is improved, but data transmission volume and processing complexity increase

Engineering Contradiction:
Improvecontent completenessVSAvoiddata transmission volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

Instead of rendering all possible future user actions, the server renders only a subset of video images corresponding to identified possible future actions. This partial rendering approach provides sufficient content adaptability while significantly reducing data transmission volume and processing complexity.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8429269B2Server-side rendering
Publication Date: 2013.04.23 SONY INTERACTIVE ENTERTAINMENT LLC
  • US8429269B2 patent drawing
  • US8429269B2 patent drawing
  • US8429269B2 patent drawing

AI summary

A solution for server-side rendering includes, at a server configured to store a video images representing states of users in a computer application, identifying future user actions based at least in part on a state of a user in the computer application. The solution also includes, responsive to the identifying, rendering video images for sending to a user device associated with the user. At the user device, a state of the user in a computer application is sent to the server. Responsive to the sending, video images are stored, each of the video images representing a future state of the user after the user performs a future action. Responsive to a user action, one of the video images is selected for display on a user display of the user device. According to one aspect, the future user actions identified by the server are limited to less than a possible number of user actions for users having the state.