Modem Processor Link Prediction for Cloud Gaming Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud-based interactive services, such as cloud gaming, face significant viewer display latencies and packet loss due to delayed video frame transmission and network quality issues, degrading the user experience.

Innovation Solution

A communication apparatus equipped with a radio transceiver, application processor, and modem processor that evaluates future communication link conditions and sends indications to adapt codecs for multimedia processing, predicting and mitigating communication interrupts and enhancing network conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video encoding is performed completely before transmission, then video frame quality is improved, but transmission latency increases

Engineering Contradiction:
Improvevideo frame qualityVSAvoidtransmission latency
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing video encoding in advance and storing encoded video frames in a buffer before transmission is needed. This allows the encoding process to be completed beforehand, reducing the latency during actual transmission while maintaining video frame quality through complete encoding.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the video transmission process into multiple independent video frames that can be transmitted separately. By dividing the video stream into discrete frames, the system can transmit individual frames as they are ready without waiting for complete video sequences, thereby reducing overall transmission latency while maintaining quality through selective transmission of critical frames.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If network transmission bandwidth is increased, then video transmission quality is improved, but network resource consumption increases

Engineering Contradiction:
Improvevideo transmission qualityVSAvoidnetwork resource consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The patent dynamically changes transmission parameters such as video frame rate, resolution, and encoding bitrate based on available network bandwidth conditions. When bandwidth is limited, the system adjusts parameters to maintain acceptable transmission quality while reducing network resource consumption. When bandwidth is abundant, higher quality settings are applied without excessive resource usage.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies partial action by transmitting only the most critical video frames or key information when network resources are constrained, rather than transmitting complete high-quality video streams. This selective transmission approach maintains essential video transmission quality while significantly reducing network resource consumption during bandwidth-limited periods.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of time

If video encoding is delayed until transmission is needed, then transmission latency is reduced, but video frame quality deteriorates

Engineering Contradiction:
Improvetransmission latencyVSAvoidvideo frame quality
Core Design Contradiction:
Loss of timeVSManufacturing precision

Solution Approach 1:

The patent performs video encoding in advance and stores the encoded frames in a buffer, applying preliminary action to eliminate the need for real-time encoding during transmission. This approach reduces transmission latency significantly while maintaining video frame quality since the encoding is performed under optimal conditions before transmission begins.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements beforehand cushioning by pre-buffering multiple encoded video frames before transmission is initiated. This cushion of pre-prepared frames provides a buffer that allows immediate transmission without encoding delays, reducing latency while ensuring high video frame quality through advance encoding with sufficient computational resources available.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

4Reliability

If network connection quality is maintained at high levels, then transmission reliability is improved, but network resource requirements increase

Engineering Contradiction:
Improvetransmission reliabilityVSAvoidnetwork resource requirements
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent dynamically adjusts video transmission parameters such as bitrate, resolution, and frame rate based on real-time network connection quality. When network conditions are excellent, higher quality parameters are applied to maximize transmission reliability. When network conditions deteriorate, parameters are reduced to maintain acceptable reliability while minimizing network resource requirements, preventing complete transmission failure.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements dynamic adaptation of video transmission characteristics in response to changing network conditions. The system continuously monitors network quality and adjusts encoding parameters, buffer sizes, and transmission rates dynamically, allowing transmission reliability to be maintained across varying network conditions without requiring consistently high network resource allocation.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20220407618A1Communication apparatus and methods for multimedia adaptation in a communication apparatus communicating with a network device in a wireless network via a communication link
Publication Date: 2022.12.22 MEDIATEK INC
  • US20220407618A1 patent drawing
  • US20220407618A1 patent drawing
  • US20220407618A1 patent drawing

AI summary

A communication apparatus includes a radio transceiver, an application processor and a modem processor. The radio transceiver transmits or receives wireless signals to or from a network device in a wireless network to communicate with the network device via a communication link. The application processor is configured to run one or more application programs. The modem processor is coupled to the radio transceiver and the application processor and configured to perform operations including: evaluating a future condition of the communication link according to at least one communication parameter or at least one communication event to obtain an evaluation result; and sending a first indication to the application processor to inform the application processor of the evaluation result. Responsive to reception of the first indication, the application processor is further configured to perform operation including: adapting a codec for multimedia processing of data received from the network device.