Receiver-Enabled Super Resolution Media Streaming

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The increasing demand for high-resolution video streaming in real-time communication applications leads to bandwidth and computing resource burdens, as existing technologies struggle to efficiently manage resolution and bitrate based on receiver capabilities and network conditions.

Innovation Solution

A modified network protocol that supports receiver-enabled resolution by allowing media servers to dynamically adjust the resolution and bitrate of media streams based on the receiver's super resolution capability, using protocols like RTP/RTCP and SDP to negotiate and adapt stream selection, thereby optimizing bandwidth usage and resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If video is transmitted at higher resolutions to meet user demand, then video quality is improved, but bandwidth consumption and computing costs increase

Engineering Contradiction:

Improvevideo resolutionVSAvoidbandwidth consumption

Core Design Contradiction:

Measurement precisionVSLoss of energy

Solution Approach 1:

The system dynamically changes the resolution parameter of video streams based on receiver capabilities and network conditions. Media servers transmit video at different resolutions (e.g., 4K, 1080p, 720p) and rely on receiver-enabled super resolution technology to upscale to the desired quality, thereby adapting the transmission parameter to minimize bandwidth usage while maintaining perceived video quality.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The receiver performs super resolution processing locally using its own computing resources and machine learning models. This self-service approach allows the receiver to enhance video quality without requiring the sender to transmit higher resolution data, effectively shifting the computational burden from the network to the endpoint device.

Inventive Principle:

Principle #25Self-service

2Measurement precision

If video is transmitted at higher resolutions, then video quality is improved, but computing costs for encoding and transmission increase

Engineering Contradiction:

Improvevideo resolutionVSAvoidserver computing cost

Core Design Contradiction:

Measurement precisionVSUse of energy by stationary object

Solution Approach 1:

The receiver independently performs super resolution enhancement using its own processing power, eliminating the need for the media server to encode and transmit multiple high-resolution versions of the video. This shifts the computational workload from the server to the receiver, reducing server energy consumption while maintaining video quality.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The super resolution enhancement function is extracted from the media server and implemented at the receiver end. This separation allows the server to focus only on encoding and transmitting base resolution video, while the receiver handles the computationally intensive upscaling operation locally.

Inventive Principle:

Principle #2Taking out (Extraction)

3Loss of energy

If video super resolution is used to reduce bandwidth, then bandwidth efficiency is improved, but receiver computing power requirements increase

Engineering Contradiction:

Improvebandwidth efficiencyVSAvoidreceiver computing power

Core Design Contradiction:

Loss of energyVSPower

Solution Approach 1:

The receiver pre-loads and caches machine learning models and super resolution algorithms into its memory before video playback. This preliminary preparation ensures that when video enhancement is needed, the receiver can quickly access pre-computed models without real-time computational delays, balancing bandwidth efficiency with acceptable processing power requirements.

Inventive Principle:

Principle #10Preliminary action

4Adaptability or versatility

If multiple resolutions are transmitted simultaneously, then adaptability to different receivers is improved, but bandwidth consumption increases

Engineering Contradiction:

Improveresolution adaptabilityVSAvoidbandwidth consumption

Core Design Contradiction:

Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The system implements feedback mechanisms where receivers communicate their capabilities (including super resolution support) and current network conditions back to the media server. Based on this feedback, the server dynamically selects the appropriate transmission resolution, achieving adaptability without the need to simultaneously transmit multiple resolution versions of the same video content.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11463757B2Media streaming for receiver-enabled resolution

Publication Date: 2022.10.04 INTEL CORP

AI summary

A sender transmits media streams at receiver-enabled resolutions. The sender, a media server that has multiple resolutions of media available to stream, is made aware of the capability of the receiver to process lower resolution media streams, including a super-resolution capability to enhance the lower resolution media stream using temporal and/or spatial information contained in the lower resolution media stream. The media server sends lower resolution streams to the receiver, thereby freeing up bandwidth on the communication channel for other uses. The receiver can notify the sender of events that affect the status of the super-resolution capability on the receiver, and the sender can adjust the resolution and bitrate of the media stream accordingly to optimize use of the communication channels and resources by encoding and transmitting high resolution video frames only when needed.