Cloud Gaming Image Segmentation for Display Clarity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud gaming systems often result in blurry video and images due to video encoding, compression, and network latency, making it difficult for users to perform tasks such as targeting in games.

Innovation Solution

A data processing method and apparatus that obtains display data from cloud devices, including game picture frames and target object positions, allowing for local drawing of target objects on the client side with higher definition, improving display clarity and detail.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If video streaming is used to transmit game pictures from cloud servers to terminals, then network transmission is enabled, but the displayed game pictures become blurry due to encoding and compression

Engineering Contradiction:
Improvenetwork transmission capabilityVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent segments the game picture into a background region (transmitted via video streaming) and a target object region (transmitted as independent image data). This segmentation allows the background to benefit from efficient video compression while the target object maintains high quality through dedicated image transmission, resolving the contradiction between transmission efficiency and image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different transmission quality levels to different regions of the game picture. The target object region receives high-quality image data for clear display, while the background region uses compressed video streaming. This local quality differentiation ensures that critical elements are displayed clearly without compromising overall transmission efficiency.

Inventive Principle:
Principle #3Local quality

2Quantity of substance

If video encoding and compression are applied to transmit game pictures, then bandwidth consumption is reduced, but the display definition and resolution deteriorate

Engineering Contradiction:
Improvebandwidth consumptionVSAvoiddisplay definition
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent divides the image data into background (video stream) and target object (independent image) segments. The background uses compressed video to reduce bandwidth, while the target object uses uncompressed or minimally compressed image data to maintain high display definition, thus resolving the bandwidth versus quality contradiction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different quality levels are applied locally: the background region uses high compression for bandwidth efficiency, while the target object region uses low or no compression for maximum display definition. This local differentiation optimizes both bandwidth consumption and display quality according to their respective requirements.

Inventive Principle:
Principle #3Local quality

3Reliability

If network bandwidth is constrained for cloud gaming transmission, then transmission stability is improved, but the clarity and detail of displayed images deteriorate

Engineering Contradiction:
Improvetransmission stabilityVSAvoidimage clarity
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent segments transmission into two channels: stable video streaming for the background and dedicated image data transmission for target objects. This segmentation allows the system to maintain transmission stability for the majority of content while ensuring high clarity for critical target objects, resolving the stability versus clarity contradiction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements local quality enhancement for target objects by transmitting their image data separately with higher fidelity than the background. This ensures that despite overall bandwidth constraints, critical elements maintain high clarity and detail for reliable gameplay.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240189713A1Cloud Gaming Image Processing and Streaming Methods and Systems
Publication Date: 2024.06.13 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US20240189713A1 patent drawing
  • US20240189713A1 patent drawing
  • US20240189713A1 patent drawing

AI summary

Data processing methods and systems for cloud gaming, an electronic device, a computer-readable storage medium, and a computer program product, which can be applied to the field of data processing technologies, are described herein. The method includes: obtaining, in a game process of cloud gaming, display data transmitted by a cloud device of the cloud gaming, the display data including a to-be-displayed game picture frame and a first position of a target object in the game picture frame; displaying the game picture frame, and displaying a target control of the target object on the displayed game picture frame; and drawing the target object on the displayed game picture frame in response to a trigger operation for the target control. This application can also be applied to various scenarios such as cloud computing, artificial intelligence, intelligent transportation, assistant driving, and smart household appliances.