Bandwidth-Adaptive Video Recombination Using Sprite Plane Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current scalable video coding technologies reduce video quality significantly at lower bandwidth rates, leading to an unacceptable viewing experience for sports game viewers.
Innovation Solution
A method that recognizes target and non-target shots in video content, separates background and foreground objects, and transforms frames into sprite planes to recombine video units based on selected bandwidth levels, allowing for high-quality video streaming at lower bandwidths by adjusting bit-stream size through sprite plane reuse and strategic content merging.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If scalable video coding reduces video resolution, frame rate, or quality to achieve lower bandwidth rate, then bandwidth rate is reduced, but video quality is seriously decreased to an unacceptable point
Solution Approach 1:
The video content is segmented into multiple layers including base layer and enhancement layers. Each layer contains different levels of detail and quality information. The base layer provides essential video content that can be decoded independently, while enhancement layers add incremental quality improvements. This allows the system to transmit only the necessary base layer at low bandwidth rates, maintaining acceptable video quality without requiring full high-definition content.
Solution Approach 2:
Different regions of the video frame are assigned different quality levels based on their importance. Critical regions such as foreground objects, key actions, and areas with motion are encoded with higher quality, while background regions are encoded with lower quality. This selective quality allocation ensures that the most important visual information is preserved even when overall bandwidth is limited.
2Loss of energy
If scalable video coding reduces the number of video frames or resolution to achieve lower bandwidth rate, then bandwidth rate is reduced, but watching quality is seriously decreased
Solution Approach 1:
The video content is pre-processed and analyzed to identify key frames, important objects, and critical moments before transmission. This preliminary analysis allows the system to prioritize which content elements deserve higher quality encoding and which can be compressed more aggressively. By preparing the content structure in advance, the system can dynamically adjust quality allocation based on available bandwidth while maintaining reliability of the most important visual information.
3Loss of energy
If conventional video compression is used to reduce bit-stream size for lower bandwidth, then bandwidth rate is reduced, but video quality and viewer enjoyment are seriously decreased
Solution Approach 1:
The video streaming system dynamically adjusts the composition and quality of different video layers based on real-time bandwidth conditions and viewer preferences. Rather than using a static compression approach, the system can flexibly allocate bandwidth resources to different video layers, transitioning between quality levels without requiring full re-encoding. This dynamic adaptation maintains viewer enjoyment by ensuring that the most important visual content is always delivered at the highest possible quality within available bandwidth constraints.
Data Source
AI summary
A method for scaling video content based on bandwidth rate is disclosed. Wherein, a plurality of target shots and non-target shots are recognized from shots of a video. A background and at least one foreground object are separated from the video frame of the target shot. The present invention method provides a plurality of bandwidth levels, and one among them is selected in advance. At least one foreground object is selected and pasted on the background based on the selected bandwidth level, so as to obtain at least one recombined target shot. The recombined target shot, the non-target shot or other recombined target shot can be merged to form a recombined video unit based on the selected bandwidth level. Therefore, the present invention proposes video content of scalability based on bandwidth rate to provide the different video bit-stream size, so that viewer can get the high quality video under the lower bandwidth rate.