Live Stream Packet Deduplication for Reconnection Rollback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In online live streaming, especially in outdoor or mobile scenarios with unsteady networks, data duplication occurs due to link disconnections and reconnections, leading to audio/video rollback and a degraded user experience.
Innovation Solution
A data deduplication method that uniquely marks each audio/video packet with an identifier, allowing the stream pulling device to identify and discard duplicated packets based on their identifiers, ensuring only unduplicated data is sent to the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the live streaming server uses a quick-start mode to send cached data after reconnection, then the data transmission speed is improved, but data duplication occurs causing audio/video rollback
Solution Approach 1:
The stream pulling device performs preliminary actions by maintaining a record of already received audio/video packet identifiers before reconnection. When data arrives after reconnection, the device checks these identifiers in advance to detect and discard duplicated packets, preventing audio/video rollback while allowing the server to quickly send cached data
Solution Approach 2:
The system implements a feedback mechanism where the stream pulling device continuously monitors incoming audio/video packets, compares their identifiers against recorded identifiers, and provides feedback by discarding duplicated packets. This feedback loop ensures that even though the server sends data quickly after reconnection, the client can identify and remove duplicates to maintain playback continuity
2Loss of information
If the stream pulling device receives and processes all incoming data packets, then data loss is prevented, but processing overhead increases due to duplicate packets
Solution Approach 1:
The stream pulling device performs preliminary recording of audio/video packet identifiers before processing data packets in detail. This preliminary action creates a reference set that enables quick identification of duplicates, reducing the processing overhead while ensuring no valid data is lost
Solution Approach 2:
The system extracts only the essential identifier information from incoming audio/video packets for comparison purposes, rather than processing the entire packet content. This extraction approach reduces processing complexity by focusing only on the unique identifying characteristics needed to detect duplicates
Data Source
AI summary
A data deduplication method includes: acquiring a live streaming data stream to be processed, wherein the data stream includes at least one audio/video packet; and executing following operations on one audio/video packet, each audio/video packet carrying an identifier, and the identifier being determined according to the order of the audio/video packet in the live streaming data stream; determining, according to the identifier of the audio/video packet, whether the audio/video packet is a repeatedly acquired audio/video packet, and if so, discarding the audio/video packet. Accordingly, it is ensured that no unduplicated data is sent to a user, and the problem that in a live streaming process, due to the fact that an intermediate link is reconnected, a user acquired part of duplicated data, and the audio/video rollback phenomenon caused by the duplicated data being played is solved.