Cloud Gaming Video Streaming Bandwidth Reduction via Server Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video streaming technologies are limited by the end user's internet connection, making it difficult for users with limited bandwidth to stream video content, and cloud gaming suffers from latency issues, which restricts its adoption for real-time applications.

Innovation Solution

A system and method that combines video streaming with cloud gaming virtualization, where only game positional data is streamed from the client to a cloud server, which renders the game footage and integrates webcam footage, minimizing bandwidth usage and flipping the traditional cloud gaming model to offload rendering from the client.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If cloud gaming virtualization is used to stream video content, then bandwidth efficiency is improved, but latency increases

Engineering Contradiction:
Improvebandwidth usageVSAvoidlatency
Core Design Contradiction:
Loss of energyVSLoss of time

Solution Approach 1:

The system segments the video streaming process into two distinct paths: (1) game positional data is transmitted from client to cloud server with minimal processing, and (2) rendered game footage is streamed back to the client. This segmentation allows bandwidth-intensive rendering to occur on the server while keeping client-side latency low by transmitting only essential positional data.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The cloud server performs preliminary rendering of game footage based on received positional data before streaming it to the client. This preliminary action offloads the computationally intensive rendering task from the client device, reducing the client's bandwidth requirements while maintaining video quality.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If traditional video streaming is used, then ease of operation is improved, but bandwidth requirements increase

Engineering Contradiction:
Improvestreaming accessibilityVSAvoidbandwidth consumption
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The system inverts the traditional cloud gaming architecture by having the cloud server perform rendering instead of the client device. In traditional cloud gaming, the client sends input data and receives rendered video; in this inversion, the client sends game positional data and receives rendered video that matches its local game state, effectively swapping the computational roles between client and server.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The cloud server creates a copy of the game rendering process by receiving game positional data from the client and generating corresponding video footage. This copying approach allows the server to produce video content that accurately reflects the client's game state without requiring the client to perform the rendering itself, thereby reducing bandwidth requirements for streaming.

Inventive Principle:
Principle #26Copying

3Productivity

If cloud gaming is used for real-time applications, then video streaming capability is improved, but latency sensitivity worsens

Engineering Contradiction:
Improvestreaming capabilityVSAvoidcommunications lag
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system extracts the rendering computation from the client-device loop and relocates it to the cloud server. By taking out the rendering task from the real-time client processing cycle and performing it on the server based on transmitted positional data, the system reduces communications lag while maintaining real-time streaming capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10525343B2Method of using cloud infrastructure and virtualization for bandwidth-efficient remote video streaming of software application operation by executing computer-executable instructions stored on a non-transitory computer-readable medium
Publication Date: 2020.01.07 AAA INTERNET PUBLISHING
  • US10525343B2 patent drawing
  • US10525343B2 patent drawing
  • US10525343B2 patent drawing

AI summary

A method of using cloud infrastructure and virtualization for bandwidth-efficient remote video streaming of software application operation allows end users to stream their interaction with a software application on their computer, video gaming software applications in particular, to viewers while requiring minimal bandwidth to do so. User input and relevant application data is sent from the client computer to a remote server, which uses a thin client to mirror the software and produce a rendered video from the received data. The remote server then sends the rendered application video to viewers.