Real-Time Data Transmission Deduplication and Re-Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In high-speed real-time data transmission scenarios, existing methods fail to optimize data compression efficiently, leading to suboptimal network traffic usage and real-time performance, particularly in applications like live video broadcasts where efficient data transmission is critical.
Innovation Solution
A method involving deduplication processing on first encoded data using a first encoding algorithm, followed by re-encoding with a second encoding algorithm (such as VP9) that has a higher compression ratio, to achieve greater data reduction and enhance real-time transmission performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If a first encoding algorithm is used for data transmission, then the transmission process is simple and compatible, but the compression ratio is insufficient leading to high network traffic
Solution Approach 1:
The patent performs deduplication processing on the encoded data before re-encoding, which is a preliminary action that removes redundant information in advance. This preliminary processing reduces the amount of data that needs to be compressed in the second encoding stage, thereby reducing overall network traffic while maintaining compatibility
Solution Approach 2:
The patent changes the encoding parameters by switching from a first encoding algorithm to a second encoding algorithm with a higher compression ratio. This parameter change allows the system to achieve better compression efficiency and reduce network traffic while maintaining acceptable compatibility through the deduplication step
2Productivity
If data is re-encoded with a higher compression ratio algorithm, then network traffic is reduced, but processing time and computational complexity increase
Solution Approach 1:
The deduplication processing is performed as a preliminary action before re-encoding, which reduces the amount of data that needs to be processed in the second encoding stage. This preliminary reduction in data volume decreases the computational burden and processing time required for the high-compression encoding, thereby improving overall transmission efficiency without significant time penalty
Solution Approach 2:
The patent extracts and removes redundant information through deduplication processing before the re-encoding step. By taking out the redundant parts in advance, the subsequent re-encoding process operates on a smaller, cleaner data set, which reduces processing time and computational complexity while achieving higher compression ratios
Data Source
AI summary
A high-speed real-time data transmission method includes performing deduplication processing on first encoded data from a transmission device to obtain target data. The first encoded data is obtained by encoding corresponding data using a first encoding algorithm. The method further includes encoding the target data using a second encoding algorithm to obtain second encoded data, and sending the second encoded data to a receiving device. A compression ratio of the second encoding algorithm is greater than a compression ratio of the first encoding algorithm.