Video Coding Bitrate Allocation for Annotation Overlays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern video coding applications experience coding losses due to bandwidth compression, leading to errors in video data transmission that can be noticeable to viewers, reducing video coding session satisfaction.
Innovation Solution
A video coding system that independently codes source video sequences without annotations and overlays graphical elements at the receiving device, adjusts bitrate budgets and coding modes based on annotation presence, content, and location, and modifies error resiliency coding strength to optimize coding efficiency and quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If bandwidth compression is applied to video data, then transmission efficiency is improved, but coding losses increase causing noticeable errors
Solution Approach 1:
The patent applies different coding parameters and bitrate budgets to different regions of the video frame based on annotation presence. Regions with annotations receive lower bitrate budgets and different coding modes compared to regions without annotations, optimizing overall quality while maintaining bandwidth efficiency.
Solution Approach 2:
The patent dynamically adjusts coding parameters, bitrate budgets, and error resiliency settings based on the presence, content, and location of annotations. The system adapts coding strength and error protection levels in real-time according to annotation characteristics, rather than using static coding parameters throughout the video.
2Productivity
If bitrate budget is reduced for annotated regions, then overall coding efficiency is improved, but local quality may deteriorate
Solution Approach 1:
The patent converts the potential harm of reduced quality in annotated regions into a benefit by reallocating the saved bitrate budget to non-annotated regions. The annotation regions serve as acceptable quality sacrifice zones that enable improved quality elsewhere, turning a local disadvantage into a global advantage.
Solution Approach 2:
The patent changes coding parameters such as quantization step size, transform block size, and prediction mode selection based on annotation presence. These parameter adjustments optimize the balance between bitrate consumption and perceived quality, ensuring that quality reductions occur only in visually less important annotated regions.
3Reliability
If error resiliency coding strength is increased, then reliability is improved, but bitrate consumption increases
Solution Approach 1:
The patent applies different error resiliency coding strengths to different regions based on annotation presence. Non-annotated regions receive higher error resiliency coding to protect important visual information, while annotated regions receive reduced error protection since their quality is already compromised by the annotation overlay.
Solution Approach 2:
The patent dynamically adjusts error resiliency parameters such as intra-refresh frequency, redundancy picture insertion, and error concealment strength based on annotation characteristics. These parameter changes enable adaptive error protection that matches the visual importance of different regions.
Data Source
AI summary
Systems and methods for coding a video to be overlaid by annotations are devised. A motion compensated predictive coding is employed, wherein coding parameters of video pixel blocks are determined based on the pixel blocks' relation to the annotations. A decoder decodes the video and annotates it based on metadata, obtained from the coder or other sources, describing the annotations' appearance and rendering mode.