Video Encoding for Flash Picture Scene Changes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding technologies fail to efficiently handle the challenges of existing technologies are not effective in addressing the challenges of encoding video encoding technologies have difficulty in effectively handling the challenges of encoding video encoding technologies have difficulty in effectively handling scene changes, leading to inefficient compression and increased bandwidth and storage requirements.
Innovation Solution
The proposed solution involves determining flash pictures based on scene changes exceeding a threshold, applying a temporal filter process exclusion, adjusting attributes, performing cost estimation, and enabling/disabling specific encoding processes such as bi-direction optical flow and decoder side motion vector refinement to optimize encoding for scene changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If temporal filtering is applied to all pictures, then compression efficiency is improved, but encoding complexity increases due to flash picture detection and reference picture management
Solution Approach 1:
The patent applies different encoding treatments to different types of pictures based on their characteristics. Flash pictures are identified and excluded from temporal filtering, while non-flash pictures continue to receive temporal filtering. This localized differentiation maintains compression efficiency for normal pictures while avoiding the complexity of processing flash pictures with temporal filtering.
Solution Approach 2:
The patent segments the video stream into flash pictures and non-flash pictures by detecting scene changes and identifying flash events. This segmentation allows the encoder to apply appropriate processing to each segment, maintaining overall compression efficiency while managing the complexity of flash picture handling separately.
2Measurement precision
If scene change detection is performed to identify flash pictures, then encoding accuracy is improved, but processing time increases
Solution Approach 1:
The patent performs scene change detection and flash picture identification in advance during the encoding process. By detecting scene changes and identifying flash pictures before applying encoding operations, the system prepares the necessary information upfront, avoiding repeated processing and reducing overall encoding time.
Solution Approach 2:
The patent replaces complex mechanical scene analysis with simplified metrics such as sum of absolute differences (SAD) between consecutive pictures. This substitution provides accurate scene change detection while significantly reducing processing time compared to more sophisticated analysis methods.
3Measurement precision
If reference pictures are updated frequently, then prediction accuracy is improved, but memory usage and processing overhead increase
Solution Approach 1:
The patent maintains different reference picture sets for flash and non-flash pictures. Non-flash pictures use a larger reference picture set for high prediction accuracy, while flash pictures use a simplified reference picture approach. This localized differentiation optimizes memory usage by avoiding the need to maintain large reference sets for all pictures.
Solution Approach 2:
The patent discards reference pictures that are determined to be flash pictures from the temporal filtering reference picture set. This prevents the use of potentially corrupt reference data while maintaining the integrity of the reference picture buffer for non-flash pictures, balancing memory usage with prediction accuracy.
Data Source
AI summary
In a method of video encoding, whether a picture of a sequence of pictures is a flash picture that is associated with a scene change between (i) a first scene of the picture of the sequence of pictures and (ii) a second scene of a prior picture and a subsequent picture of the picture in the sequence of pictures, the scene change being determined based on a content change between the first scene and the second scene being larger than a threshold is determined. An encoding process is performed on the picture in the sequence of pictures based on whether the picture is determined as the flash picture. A configuration of a coding tool in the encoding process is adjusted when the picture is determined as the flash picture.