Sub-Picture Video Processing for Tearing in Unstable Wireless Channels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In wireless video transmission, the instability of channel bandwidth due to environmental factors leads to loss of base or enhancement layers of sub-pictures, causing picture tearing and quality issues, which degrade the user's video watching experience.
Innovation Solution
A method and apparatus that determine the occurrence of picture tearing or blurring based on sub-picture conditions, such as lost base layers or scene switching, and adjust coding parameters or display timing to prevent these issues by displaying alternative pictures or storing sub-pictures in a buffer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If sub-frame-level picture processing mode is used to reduce system delay, then display timeliness is improved, but picture quality stability deteriorates due to channel bandwidth instability causing base layer loss
Solution Approach 1:
The encoder determines in advance whether picture tearing may occur based on the base layer of the first sub-picture, and sends indication information to the decoder before the tearing actually manifests. This allows the decoder to prepare and display the second picture in time, preventing the tearing effect while maintaining sub-frame-level processing speed.
Solution Approach 2:
Indication information acts as an intermediary signal between encoder and decoder, carrying the prediction result about picture tearing. This intermediary mechanism enables coordinated action between encoder and decoder to prevent tearing without requiring complex real-time communication or sacrificing processing speed.
2Manufacturing precision
If base layer or enhancement layer is transmitted over unstable wireless channel, then picture quality can be improved when bandwidth is sufficient, but picture tearing occurs when bandwidth is low or channel interruption happens
Solution Approach 1:
The encoder performs preliminary assessment by examining the base layer of the first sub-picture to predict whether picture tearing will occur. Based on this prediction, it proactively sends indication information to trigger display of the second picture, counteracting the potential harmful effect of channel instability before it degrades picture quality.
Solution Approach 2:
The system implements a feedback mechanism where the encoder's assessment of base layer quality informs the decoder's display decision. The indication information carries feedback about the predicted picture tearing condition, enabling the decoder to adjust its display behavior accordingly to maintain picture quality despite channel variations.
3Manufacturing precision
If indication information is sent to predict picture tearing, then picture quality can be maintained by displaying alternative pictures, but transmission overhead increases
Solution Approach 1:
The system extracts only the essential information needed for picture tearing prediction from the encoded data - specifically, the base layer of the first sub-picture. By focusing only on this critical component, the indication information remains compact while still providing sufficient basis for accurate tearing prediction and prevention.
Data Source
AI summary
In a picture processing method, when receiving a first picture in a video stream, a decoder side determines, based on a base layer of the 1st sub-picture of the first picture, whether the first picture meets a first preset condition; and the decoder side sends a second picture within a display time period of the first picture for displaying if the first picture meets the first preset condition, where the second picture is a picture that is in the video stream and that is sent within a first display time period for displaying.