Slice-Based Gradual Decoding Refresh for Video Error Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems face challenges in efficiently managing decoder refresh points, particularly in multipoint conferences, where new participants join or transmission errors occur, leading to inefficiencies in decoding and resource utilization.
Innovation Solution
Implementing a gradual decoding refresh (GDR) mechanism that allows for a slice-based decoding refresh, where only a clean area of the picture is relabeled as an intra-coded random access point, and the modified information on picture width and height is included in the bitstream, along with scaling window offsets and network abstraction layer unit type values being rewritten to indicate instantaneous decoding refresh.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a full picture refresh is performed using intra-coded random access point pictures, then decoding reliability is improved for new participants or error recovery, but decoding complexity and computational overhead increase significantly
Solution Approach 1:
The picture is divided into multiple slices, and only the necessary slices (first set of slices containing clean area) are relabeled as intra-coded random access point pictures, while other slices (second set of slices) maintain their original coding type. This segmentation allows selective refresh of only the required picture regions, reducing computational overhead while maintaining decoding reliability for the clean area.
2Loss of information
If the entire picture area is included in the modified bitstream with updated dimensions, then completeness of decoding information is improved, but transmission overhead and processing time increase
Solution Approach 1:
The method extracts and includes only the necessary first set of slices containing the clean area in the modified bitstream, while excluding the second set of slices. The picture width and height parameters are modified to reflect only the included area. This extraction approach ensures that the modified bitstream contains complete decoding information for the clean area while reducing processing time and transmission overhead by omitting unnecessary picture regions.
Data Source
AI summary
The embodiments relate to a method comprising receiving an encoded video comprising a GDR picture and recovering pictures following the GDR picture in decoding order; decoding information that a slice-based GDR is in use, wherein each of the GDR picture and the recovering pictures comprises a first set of slices comprising a clean area and a second set of slices comprising rest of the picture; relabeling the GDR picture as an intra-coded random access point picture in a modified bitstream; including only the first set of slices of the GDR picture and the recovering pictures into the modified bitstream; decoding information on a picture width and height of each of the GDR picture and the recovering pictures; modifying the picture width and height to exclude the second set of slices; and including the modified information on the picture width and height to the modified bitstream.