Video Frame Comment Masking for Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video technologies struggle with synchronizing comments with played videos, leading to a poor user experience, especially when players become stuck or do not support mask comment functions.

Innovation Solution

A video generating method that acquires a target video frame and a corresponding comment file, determines a mask file to identify areas where comments should not be rendered, and then integrates the comments into the video frame according to the mask file, ensuring seamless synchronization and efficient rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If comments are displayed in the video field to provide real-time interaction, then user participation and watching interest are improved, but the comments may block the video content and deteriorate viewing quality

Engineering Contradiction:
Improveuser participationVSAvoidscreen blocking
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by making different regions of the video frame have different properties - the mask area (containing important video content) has the property of being blocked from comments, while non-mask areas allow comment display. This resolves the contradiction by allowing comments in safe zones while protecting critical video regions from being obscured.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The video frame is segmented into two distinct regions: a mask area (where comments should not be displayed) and a non-mask area (where comments can be displayed). This segmentation allows the system to simultaneously achieve both goals - displaying comments for user engagement while preventing them from blocking important video content in the mask area.

Inventive Principle:
Principle #1Segmentation

2Object-affected harmful factors

If mask comments are used to avoid blocking video content, then viewing quality is improved, but synchronization between mask comments and played video deteriorates when players become stuck

Engineering Contradiction:
Improveviewing qualityVSAvoidsynchronization
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The patent applies preliminary action by pre-processing the video and comments to generate a comment video where comments are already positioned according to the mask area before playback. This pre-positioning ensures that comments will always appear in non-blocking areas regardless of player synchronization issues, as the spatial relationship is baked into the video itself rather than relying on runtime synchronization.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges the video, mask area definition, and comments into a single integrated comment video. By combining these elements beforehand, the system eliminates the need for separate synchronization of multiple components during playback, thereby improving reliability while maintaining viewing quality through the mask-based positioning.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If conventional players are used to play videos with comments, then device compatibility is maintained, but performance requirements increase and not all players can support mask comment functions

Engineering Contradiction:
Improvedevice compatibilityVSAvoidperformance requirements
Core Design Contradiction:
Adaptability or versatilityVSPower

Solution Approach 1:

The patent creates a copy of the video with comments pre-integrated into the video frames themselves rather than relying on separate comment rendering. This approach allows any standard video player to display the comments without requiring special mask comment functionality, as the comments are embedded as part of the video content rather than as an overlay requiring additional processing.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12299033B2Video generating method and device
Publication Date: 2025.05.13 SHANGHAI BILIBILI TECH CO LTD
  • US12299033B2 patent drawing
  • US12299033B2 patent drawing
  • US12299033B2 patent drawing

AI summary

The present disclosure describes techniques of generating videos. The techniques comprise acquiring a target video frame among a plurality of frames of a target video; acquiring at least one comment file corresponding to the target video frame, wherein the at least one comment file comprises a plurality of pieces of comment data; determining a mask file corresponding to the target video frame; determining a display coordinate of each of the plurality of pieces of comment data in the target video frame; determining each of the plurality of pieces of comment data is hidden or rendered into the target video frame based on the mask file and the display coordinate of each piece of comment data; and generating a new frame corresponding to the target frame, wherein the new frame comprises at least one subset of the plurality of pieces of comment data embedded in the target frame.