Live Streaming Video Bullet Screen Occlusion Mask

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Live streaming video technologies often result in bullet screens occluding target objects, disrupting the viewing experience, as existing solutions that disable bullet screens sacrifice interaction and engagement.

Innovation Solution

A method and device that generate and play live streaming video data by identifying target objects, calculating anti-occlusion areas, and adding this data to video frames to create a bullet screen mask, ensuring bullet screens do not obscure key objects by transparently displaying overlapping parts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If bullet screens are displayed during live streaming video playback, then user interaction and viewing pleasure are enhanced, but target objects in the video are occluded

Engineering Contradiction:
Improveuser interactionVSAvoidocclusion of target objects
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by making different regions of the video frame have different properties. Specifically, the video frame is divided into occlusion areas (where bullet screens are blocked) and non-occlusion areas (where bullet screens can display). This is achieved by generating an occlusion mask that identifies target objects and prevents bullet screen display in those regions, while allowing bullet screens in other regions. This resolves the contradiction by allowing bullet screens to enhance user interaction in non-occlusion areas while preventing occlusion of target objects in occlusion areas.

Inventive Principle:
Principle #3Local quality

2Object-affected harmful factors

If bullet screens are turned off to avoid occlusion, then target objects remain visible, but user interaction and viewing pleasure are lost

Engineering Contradiction:
Improvevisibility of target objectsVSAvoiduser interaction
Core Design Contradiction:
Object-affected harmful factorsVSAdaptability or versatility

Solution Approach 1:

The patent applies segmentation by dividing the video frame into distinct regions: occlusion areas where target objects are located and non-occlusion areas where bullet screens can be displayed. The occlusion mask segments the frame based on detected target objects, allowing the system to selectively enable or disable bullet screen display in different regions. This resolves the contradiction by maintaining target object visibility in occlusion areas while preserving user interaction capabilities in non-occlusion areas.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11863801B2Method and device for generating live streaming video data and method and device for playing live streaming video
Publication Date: 2024.01.02 SHANGHAI BILIBILI TECH CO LTD
  • US11863801B2 patent drawing
  • US11863801B2 patent drawing
  • US11863801B2 patent drawing

AI summary

The present disclosure describes techniques for generating live streaming video data and playing live streaming video. The techniques comprise obtaining live broadcasting video data; identifying a target object in a video frame; determining a target area based on the target object in the video frame; encoding data indicative of the target area based on a predetermined format for supplementary enhancement information to obtain encoded target area data; and adding the encoded target area data to a data packet corresponding to the video frame, wherein the data packet is encoded based on a predetermined video data format, and wherein the predetermined video data format and the predetermined format for supplementary enhancement information are mutually compatible data encoding formats.