Layered Video Coding Bandwidth Truncation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud-based gaming platforms face challenges in transmitting high-quality, high-frame-rate video streams efficiently due to the need for large network bandwidth, often resulting in unnecessary bandwidth underutilization with strict low-latency constant bitrate control schemes.
Innovation Solution
A wavelet-driven encoding technique that decomposes frames into a base layer and an enhancement layer, encodes them separately, and truncates the enhancement layer to maintain visually important details, reducing the overall bandwidth required for transmission while maintaining video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If a strict low-latency constant bitrate control scheme is used, then video transmission latency is reduced and bandwidth utilization is controlled, but the bitstream unnecessarily undershoots its target bitrate, under-utilizing the available bandwidth
Solution Approach 1:
The patent applies dynamics by transitioning from a static constant bitrate control scheme to a dynamic rate control mechanism that adapts to available bandwidth and video content characteristics. The system dynamically adjusts the target bitrate and allocation between layers based on network conditions and scene complexity, allowing the encoder to utilize available bandwidth more effectively while maintaining quality.
Solution Approach 2:
The patent implements parameter changes by modifying the bitrate allocation parameters between base and enhancement layers. The system changes the target bitrate parameters dynamically based on available bandwidth, allowing the enhancement layer to receive more bits when bandwidth is abundant and the base layer to maintain priority when bandwidth is constrained, thereby optimizing overall bandwidth utilization.
2Manufacturing precision
If high-resolution high-frame-rate video is transmitted, then video quality is improved, but the required network bandwidth increases significantly
Solution Approach 1:
The patent applies segmentation by dividing the video stream into multiple layers with different quality levels. The base layer provides essential video information at lower quality, while enhancement layers add progressive refinements. This segmentation allows the system to transmit high-quality video when bandwidth is available while ensuring acceptable quality even when bandwidth is limited, as the base layer can be decoded independently.
Solution Approach 2:
The patent introduces another dimension by adding temporal and quality layers to the video encoding structure. Instead of transmitting a single high-quality stream that requires abundant bandwidth, the system creates a multi-dimensional structure where base and enhancement layers can be selectively transmitted based on network conditions, effectively adding a quality-bandwidth dimension to the transmission.
3Manufacturing precision
If the enhancement layer is fully encoded and transmitted, then video quality is maximized, but the overall bandwidth requirement increases
Solution Approach 1:
The patent applies partial action by transmitting only the necessary portion of the enhancement layer based on available bandwidth. Rather than always transmitting the complete enhancement layer at full quality, the system transmits a partial version when bandwidth is constrained, providing sufficient quality improvement without fully utilizing the enhancement layer's potential, thereby optimizing the trade-off between quality and bandwidth consumption.
Data Source
AI summary
An encoding operation is implemented to encode one or more frames, for example, gaming frames into a gaming stream. The encoding operation includes decomposing a current frame into a base layer and an enhancement layer. The resulting base layer and enhancement layer are then each encoded to produce an encoded base layer and an encoded enhancement layer. The encoded enhancement layer is truncated, for example, according to a comparison of the sum of the size of the encoded base layer and encoded enhancement layer to a threshold value. In an example embodiment, a multiplexer combines the encoded base layer and truncated enhancement layer to produce the encoded frame. The encoded frame may then be transmitted as part of a stream to a client device.