Video Bullet Screen Playback via Server Preprocessing and Multi-Decoder Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video playback technologies face challenges in providing a smooth and interactive experience for video bullet screens due to performance bottlenecks in software and hardware, leading to issues like jamming, jitter, and black screens when scrolling video content.
Innovation Solution
A network device preprocesses video bullet screens into segments that continuously translate in space with time, using multiple decoders to decode and play the main video and video stream segments, allowing for smooth horizontal playback and reducing computational overhead by performing preprocessing at the server level.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If video bullet screen is scrolled using conventional playback technology, then interactive experience is provided, but performance bottlenecks cause jamming, jitter, and black screens
Solution Approach 1:
The video bullet screen is segmented into multiple picture units horizontally, with each unit processed by dedicated decoders. This segmentation distributes the processing load across multiple independent decoding channels, preventing the performance bottlenecks that cause jamming and jitter while maintaining reliable continuous playback.
Solution Approach 2:
The server performs preliminary preprocessing of the video bullet screen before transmission, including horizontal segmentation and generation of corresponding video stream segments. This advance preparation reduces the real-time processing burden on the playback device, ensuring smooth and reliable interactive experience without performance bottlenecks.
2Reliability
If multiple decoders are used to decode video stream segments, then playback smoothness is improved, but device complexity increases
Solution Approach 1:
The solution moves the complex segmentation and decoder assignment logic to the server dimension, where preprocessing creates picture unit assignments beforehand. The playback device simply follows pre-determined assignments, reducing its operational complexity while maintaining multiple parallel decoding channels for smooth playback.
Solution Approach 2:
The server acts as an intermediary that performs the complex preprocessing work, including segmenting the video bullet screen and determining picture unit assignments. This intermediary handles the complexity of multi-decoder coordination, allowing the playback device to achieve smooth playback without bearing the full complexity burden.
3Use of energy by moving object
If preprocessing is performed at the server level, then resource consumption at client device is reduced, but server computational load increases
Solution Approach 1:
The computationally intensive preprocessing operations are extracted from the client device and transferred to the server. The server performs horizontal segmentation, video stream segment generation, and picture unit assignment beforehand, extracting the heavy computational burden from the resource-constrained client device while enabling efficient playback at the edge.
Data Source
AI summary
Network device, system, method and computer readable medium for video content processing. The network device includes a memory having instructions stored thereon, and a processor configured to execute the instructions to cause the network device: to acquire a main video and a plurality of video stream segments, wherein the plurality of video stream segments are generated by preprocessing a video bullet screen by a server, and the preprocessing comprises jointly dividing the video bullet screen in time and space so that the plurality of video stream segments continuously translate in space by frame with time, the area of the screen used for playing the plurality of video stream segments is divided into continuous N picture units in the horizontal direction, each picture unit is used for playing the corresponding video stream segments, and the time from the left edge of the first frame of the corresponding video stream segment entering the picture unit from the right side of the picture unit to the left edge of the kth frame leaving the picture unit from the left side of the picture unit is T; decoding the main video by a main decoder of the network device; decoding video stream segments corresponding to odd-numbered picture units by a first sub-decoder of the network device, and decoding video stream segments corresponding to even-numbered picture units by a second sub-decoder of the network device; and playing the main video and the plurality of video stream segments.