ROI Enhancement Layers for Lower-Bitrate Video Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video streaming techniques result in enhancement layers that include unnecessary data, leading to increased bitrates, network bandwidth consumption, decoder delays, and power consumption, especially in endpoint devices with limited hardware capabilities.
Innovation Solution
Generating video data with a base layer and a region of interest enhancement layer that provides enhancements to specific portions of the base layer, allowing for smaller enhancement layer sizes, thereby reducing bitrates and decoder load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If enhancement layers include full frame size data to provide enhancements to all portions of video frames, then frame rate and resolution are improved, but bitrate and network bandwidth consumption increase unnecessarily
Solution Approach 1:
The enhancement layer is segmented into multiple regions of interest (ROIs) instead of providing full frame data. Each ROI contains enhancement data for a specific portion of the video frame, allowing selective transmission of enhancement information only where needed, thereby reducing overall bitrate while maintaining improved frame rate and resolution in those regions.
Solution Approach 2:
Different regions of the video frame are provided with different quality enhancement levels. The enhancement layer applies local quality improvement by providing enhancement data only for specific regions of interest rather than uniformly across the entire frame, optimizing the balance between quality improvement and bitrate efficiency.
2Measurement precision
If enhancement layers include full frame size data, then frame rate and resolution are improved, but decoder load and processing time increase
Solution Approach 1:
The enhancement layer is divided into multiple smaller region-of-interest blocks that can be processed independently. This segmentation reduces the processing burden on the decoder by breaking down the enhancement data into manageable chunks, thereby reducing decoder delays and processing time while still achieving improved frame rate and resolution.
3Measurement precision
If enhancement layers include full frame size data, then frame rate and resolution are improved, but power consumption increases
Solution Approach 1:
The enhancement layer is segmented into multiple region-of-interest blocks, reducing the total amount of data that needs to be processed. This segmentation decreases the computational load on the decoder and processor, thereby reducing power consumption while still providing improved frame rate and resolution for the regions that receive enhancement.
Solution Approach 2:
Power consumption is optimized by applying enhancement only to specific regions of interest rather than the entire frame. This local quality approach reduces the total processing workload and associated power consumption while maintaining improved frame rate and resolution in the enhanced regions.
Data Source
AI summary
In various embodiments, a computer-implemented method for generating enhanced frames of media data includes decoding a first video frame included in video data associated with a media title, decoding a first portion included in the video data, wherein the first portion includes less data than the first video frame, extracting first position data corresponding to the first portion from header information included in the video data, combining the first video frame and the first portion based on the first position data to generate a first enhanced video frame.