Video Annotating Method with Dynamic Bullet Screen Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video annotation technologies lack the ability to annotate target objects in real-time and ensure that annotations follow the object across subsequent video frames, limiting user interaction and engagement.

Innovation Solution

A video annotating method and system that allows users to create annotating bullet screens for target objects in a video frame, determining and displaying the target display position of the annotating bullet screen relative to the target object in both the current and subsequent video frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional bullet screen annotation is used, then users can comment on videos, but the annotations cannot follow target objects across video frames

Engineering Contradiction:
Improveannotation following capabilityVSAvoidannotation consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The annotation system transitions from static positioning to dynamic tracking. The server determines target display positions in subsequent video frames based on target object positions, enabling the annotation to dynamically follow the target object across frames while maintaining consistent relative positioning

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements a feedback loop where the server receives annotation creation operations, determines target object positions in subsequent frames, calculates appropriate display positions, and returns these positions to the client for rendering. This closed-loop feedback ensures annotations consistently follow targets

Inventive Principle:
Principle #23Feedback

2Reliability

If annotation position is fixed in one video frame, then the annotation is simple to implement, but it cannot be displayed consistently in subsequent video frames

Engineering Contradiction:
Improveannotation display consistencyVSAvoidposition calculation system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The server acts as an intermediary between the client and video frames. It receives the initial annotation operation, calculates target positions in subsequent frames by comparing target object positions, and returns the computed display positions to the client, simplifying the client's implementation while ensuring consistency

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The server pre-calculates and returns target display positions for subsequent video frames before the client needs to render them. This preliminary action enables the client to simply display annotations at the provided positions without performing complex position calculations

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12211270B2Video annotating method, client, server, and system
Publication Date: 2025.01.28 SHANGHAI BILIBILI TECH CO LTD
  • US12211270B2 patent drawing
  • US12211270B2 patent drawing
  • US12211270B2 patent drawing

AI summary

The present disclosure describes techniques for annotating a video. The techniques comprises receiving an operation of creating a bullet screen of annotating a target object in a first frame; determining a display position of the bullet screen in the first frame; displaying the bullet screen at the display position in the first frame; determining an offset of the display position of the bullet screen relative to a position of the target object in the first frame; and displaying the bullet screen at a target display position in a second frame of the video, wherein the target display position in the second frame is determined based at least in part on the offset of the display position of the bullet screen relative to the position of the target object in the first frame, the second frame is played subsequent to the first frame, and the second frame comprises the target object.