Encode Validator for Parallel Video Encoding Error Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Parallel encoding processes in video encoding introduce synchronization errors due to the complexity of assembling encoded chunks, making it difficult to ensure the quality of encoded videos, especially since conventional verification techniques are limited by the unavailability of source video after chunking.
Innovation Solution
A computer-implemented method that uses frame difference data to verify encoded data without access to the source data, employing phase correlation operations and error identification engines to detect and classify errors in aggregate encoded videos, thereby guiding debugging and triage in parallel encoding systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If parallel encoding is used to decrease encoding time, then productivity is improved, but synchronization errors are introduced degrading video quality
Solution Approach 1:
The patent applies preliminary action by creating frame difference data from the source video before the parallel encoding process begins. This pre-computed reference data is then used during and after encoding to verify the correctness of encoded chunks and detect synchronization errors, allowing the system to maintain high encoding speeds while ensuring video quality through pre-prepared verification materials.
Solution Approach 2:
The patent implements feedback by using the encode validator to compare frame difference data from encoded video against reference frame difference data, automatically detecting synchronization errors and providing feedback about encoding quality. This closed-loop verification system enables the parallel encoding process to maintain reliability without sacrificing productivity.
2Productivity
If source video is split into chunks for parallel processing, then encoding efficiency is improved, but conventional verification techniques become inapplicable
Solution Approach 1:
The patent introduces frame difference data as an intermediary element that bridges the gap between split video chunks and verification requirements. Instead of needing to access and compare original source video segments, the system uses this intermediate representation that can be generated once and reused for verifying multiple encoded chunks, simplifying the verification process while maintaining encoding efficiency.
Solution Approach 2:
The patent creates a copy of the frame difference characteristics from the source video and uses this copy for verification purposes. Rather than requiring access to the actual source video segments during verification, the system works with this copied representation, enabling efficient verification of parallel-encoded chunks without the complexity of managing and accessing original source segments.
3Quantity of substance
If lossy compression is used to increase compression rates, then encoded size is reduced, but reconstruction accuracy deteriorates
Solution Approach 1:
The patent applies preliminary action by pre-computing frame difference data that captures the essential visual information and relationships in the source video before compression. This pre-extracted information serves as a reference for verifying that the lossy compression process has preserved critical visual characteristics, allowing the system to achieve high compression rates while monitoring and ensuring reconstruction accuracy.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In one embodiment of the present invention, an encode validator identifies and classifies errors introduced during the parallel chunk-based translation of a source to a corresponding aggregate encode. In operation, upon receiving a source for encoding, a frame difference generator creates a frame difference file for the source. A parallel encoder then distributes per-chunk encoding operations across machines and creates an aggregate encode. The encode validator decodes the aggregate encode and creates a corresponding frame difference file. Subsequently, the encode validator performs phase correlation operations between the two frame difference files to detect errors generated by encoding process faults (i.e., dropping a frame, etc.) while suppressing discrepancies inherent in encoding, such as those attributable to low bit-rate encoding. Advantageously, since the encode validator leverages frame difference files, this indirect verification technique enables efficient debugging of parallel encoding processes in which the complete source is unavailable for post-encode analysis.