Cloud Gaming Transmission Apparatus Referent Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In cloud gaming services, due to server or network overload or unstable connections, terminals may fail to receive image data, leading to wasted transmission of image data that requires referents and increased network load from transmitting large I-frames without referents.

Innovation Solution

A transmission apparatus that includes an acquisition unit for frame images, an encoding unit for generating image data, a transmission unit for sending data, a failure probability estimator, and a referent determiner. The referent determiner uses estimated transmission failure probabilities to select appropriate referents for encoding units, optimizing data transmission by reducing network load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image data that needs no referent (I-frames) is always transmitted to prevent decoding failures, then decoding reliability is improved, but network load increases due to larger data size

Engineering Contradiction:
Improvedecoding reliabilityVSAvoidnetwork load
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent dynamically adjusts the type of image data transmitted (I-frame vs. P-frame) based on real-time transmission failure probability estimates. When transmission failure probability is low, P-frames with referents are used for efficiency; when probability is high, I-frames without referents are used for reliability. This dynamic adaptation resolves the contradiction by making the system flexible rather than static.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of referent inclusion in image data based on transmission conditions. By estimating transmission failure probability and adjusting whether to include referents (changing the state from always including to conditionally including), the system optimizes the balance between decoding reliability and network load.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If image data that needs a referent (P-frames) is transmitted to reduce network load, then network load decreases, but decoding reliability worsens when the referent is not successfully received

Engineering Contradiction:
Improvenetwork loadVSAvoiddecoding reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent performs preliminary estimation of transmission failure probability before transmitting image data. Based on this preliminary assessment, the system proactively selects the appropriate image data type (I-frame or P-frame) to prevent potential decoding failures, rather than reacting after transmission occurs.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a feedback mechanism where transmission outcomes (successes and failures) are monitored and used to update transmission failure probability estimates. This feedback loop allows the system to continuously improve its predictions and adjust transmission strategies accordingly, resolving the reliability issue through learned experience.

Inventive Principle:
Principle #23Feedback

3Reliability

If referents are always included in image data to ensure decodability, then decoding reliability is improved, but data size increases leading to higher network load

Engineering Contradiction:
ImprovedecodabilityVSAvoiddata size
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies different qualities of image data (with or without referents) to different transmission contexts based on local conditions. Rather than uniformly including referents in all image data, the system selectively includes referents only when transmission failure probability is high, optimizing the local quality of each transmission based on specific conditions.

Inventive Principle:
Principle #3Local quality

4Quantity of substance

If referents are excluded from image data to reduce data size, then network load decreases, but the terminal cannot decode the data when referents are not received

Engineering Contradiction:
Improvedata sizeVSAvoidtransmission effectiveness
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The system uses feedback from transmission outcomes to update transmission failure probability estimates, which in turn guide future decisions about whether to include referents. This closed-loop control ensures that the system learns from past experiences and optimizes its strategy to balance data size and transmission effectiveness.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12225209B2Transmission apparatus, transmission method, and program
Publication Date: 2025.02.11 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12225209B2 patent drawing
  • US12225209B2 patent drawing
  • US12225209B2 patent drawing

AI summary

Provided are a transmission apparatus, a transmission method, and a program that achieve transmission of image data having an appropriate referent with a small network load. An acquisition unit (26) sequentially acquires frame images drawn in a frame buffer. An encoding processing unit (28) sequentially encodes encoding units each corresponding to part or whole of one of the frame images and generates image data. A data transmitting unit (30) sequentially transmits the image data. A transmission failure probability estimating unit (38) estimates, after the transmission of the image data, a transmission failure probability that is a probability of failure of the transmission of the image data. A referent determining unit (42) determines, in reference to the transmission failure probability of the image data, one or a plurality of referents that serve as a referent of a given encoding unit from the encoding units related to the image data transmitted. The encoding processing unit (28) encodes the given encoding unit by referring to the one or the plurality of referents, thereby generating the image data.