Video Frame Merging via Skip Block Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for reducing the bit rate of monitoring digital video sequence data require significant processing power for playback, and existing solutions are complex and memory-intensive, failing to efficiently merge high-quality frames while maintaining low data amounts.
Innovation Solution
A method that merges two digital video sequences depicting the same scene by using skip blocks in one sequence to replace irrelevant information from the other, ensuring high detail in relevant areas while reducing bit rate, utilizing video compression algorithms like ITU-H.26X or ISO-MPEG, and filtering to improve frame quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If two digital video sequences are decoded and merged to reduce bit rate, then the bit rate of monitoring data is reduced, but the processing power required for playback increases significantly
Solution Approach 1:
The video frame is segmented into multiple blocks, and the merge operation is performed block-by-block rather than processing the entire frame at once. This divides the complex merge operation into smaller, more manageable units that can be processed more efficiently
Solution Approach 2:
The invention extracts and utilizes skip block information from the first video sequence, which indicates regions where no processing is needed. By taking out these skip block positions, the system avoids unnecessary processing in those regions, thereby reducing the overall processing power requirement while maintaining the bit rate reduction benefit
2Manufacturing precision
If high-resolution image sensors are used to capture digital video sequences, then the image quality is improved, but the amount of data to be transmitted and stored increases
Solution Approach 1:
The invention merges two video sequences that depict the same scene, where the first sequence is encoded with skip blocks and the second sequence provides complementary information. By merging these sequences and utilizing skip block positions, the system maintains high image quality from the high-resolution sensor while reducing the total data amount through intelligent compression and merging operations
Solution Approach 2:
The system discards redundant information in regions marked as skip blocks during the merge operation, while recovering and preserving important information from the second video sequence in non-skip block regions. This selective discarding and recovering process maintains quality in critical areas while reducing overall data quantity
3Loss of substance
If video compression techniques are applied to reduce bit rate, then the data transmission and storage requirements are reduced, but the complexity of the encoding process increases
Solution Approach 1:
The first video sequence is pre-encoded with skip block information before the merge operation. This preliminary encoding action marks regions that don't require processing, so that during the subsequent merge operation, the system can skip these pre-identified regions, thereby reducing the complexity of the encoding process while achieving bit rate reduction
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
The present invention relates to a method and a video processing device for producing a frame of a merged digital video sequence, wherein a first and a second digital video sequence depicting the same scene are provided, the first digital video sequence having a higher pixel density than the second digital video sequence, and wherein at least the first digital video sequence is encoded using a video compression algorithm. The second digital video sequence is scaled such that an up-scaled version of the second digital video sequence having the same pixel density as the first video sequence is obtained. While decoding the encoded frame of the first digital video sequence, a skip block identifier identifies a position for at least one skip block and a position for at least one non-skip block in the frame of the first digital video sequence. A block extractor is arranged to extract, based on the identified position for the at least one skip block, at least one corresponding block of pixels from the frame of the second digital video sequence, and to extract, based on the identified position for the at least one non-skip block in the frame of the first digital video sequence, at least one corresponding block of pixels from the frame of the first digital video sequence. The extracted blocks of pixels are then merged such that the frame of the merged video sequence is produced.