Live Stream Comment Synchronization via Mask Frame Timestamp Offset
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In live broadcast scenarios, mask information, video information, and live comment information often fail to be synchronized, leading to poor user experience due to overlapping comments covering the main content.
Innovation Solution
A method and system that process information flow by identifying a main area in frame images to generate mask frame data with a timestamp offset, synchronizing this data with video information, and displaying live comments in an area outside the mask frame to prevent overlap.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If live comments are displayed scrolling across the content, then user interaction is enabled, but the video content is covered by comments affecting normal watching
Solution Approach 1:
The patent divides the display area into two segments: a mask area where comments are displayed and a non-mask area where video content is shown. This segmentation allows comments to be displayed without covering the main video content, resolving the contradiction between enabling user interaction and preventing content coverage.
Solution Approach 2:
The patent introduces a spatial dimension by displaying comments in a separate mask area rather than overlaying them on the video content. This dimensional separation allows both comments and video to coexist without interference, maintaining both user interaction capability and content visibility.
2Loss of information
If live comments are set to display on top, then comments are visible, but when there are too many comments they become irrelevant to the live broadcast content
Solution Approach 1:
The patent applies local quality by making the mask area transparent or semi-transparent, allowing comments to be visible while maintaining the underlying video content's visibility. This local transparency ensures comments remain relevant to the broadcast context rather than becoming isolated from the content.
Solution Approach 2:
The mask area acts as an intermediary layer between the comments and the video content. It allows comments to be displayed without completely obscuring the video, maintaining the contextual relationship between comments and broadcast content even when many comments are present.
3Quantity of substance
If mask information, video information, and live comment information are displayed together, then comprehensive information is provided, but synchronization between them is difficult to achieve
Solution Approach 1:
The patent applies preliminary action by pre-calculating and pre-positioning the mask area based on the video stream's timestamp information. This allows the mask, video, and comments to be synchronized from the beginning, eliminating timing mismatches and ensuring all three information streams remain aligned throughout the broadcast.
Solution Approach 2:
The patent uses feedback mechanisms where the mask area's display timing is adjusted based on real-time synchronization with the video stream's timestamps. This feedback loop ensures that mask information, video information, and comments remain synchronized even as the broadcast progresses.
Data Source
AI summary
The present disclosure describes techniques of processing information flow and synchronously displaying image s, mask frames and comment information. According to the present disclosure, a system processes a first information stream uploaded by a stream pushing terminal to obtain a frame image and mask frame data, the mask frame data corresponding to the frame image and identifying a timestamp offset indicative of a time difference between the mask frame data and a playing timestamp of the frame image. The system synthesizes the frame image and the mask frame data to generate a second information stream; and output the second information stream to a client for synchronously displaying the image frame, a corresponding mask frame, and the comment information.