Live Broadcast Data Processing via Material Attribute Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Live broadcast systems face challenges in achieving optimal video playback due to differences in device configurations between the host and viewer terminals, leading to suboptimal video processing and display experiences.
Innovation Solution
A data processing method and apparatus that acquires material attribute information from a video image, generates a transmission stream including the raw video image and material attributes, and sends it to secondary terminals, allowing them to determine and draw corresponding materials using computer graphics, thereby reducing processing burden and enhancing user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the host uses a premium configuration electronic device to achieve normal live broadcast operation, then the live broadcast functionality is maintained, but viewers with lower configuration devices cannot achieve ideal watching effect due to failure to effectively process live broadcast information and data
Solution Approach 1:
The patent segments the video processing tasks by separating the complex algorithm analysis and material rendering operations from the client device and concentrating them on the server side. The transmission stream is divided into base video data and material attribute information, allowing clients to receive and display video content without performing complex local processing, thus enabling compatibility across devices with different configurations.
Solution Approach 2:
The patent introduces a server as an intermediary between the host and viewers. The server receives the live broadcast signal, performs all complex processing including algorithm analysis and material rendering, then transmits the processed transmission stream to client devices. This intermediary approach allows the host to maintain premium functionality while viewers can access the processed content on various device configurations without needing to perform complex local processing.
2Measurement precision
If complex algorithm analysis is performed locally on client devices to process video images, then accurate material recognition is achieved, but the processing burden and configuration requirements increase significantly
Solution Approach 1:
The patent extracts the complex algorithm analysis and material recognition functions from the client devices and relocates them to the server. The server performs all intensive computational tasks including video frame analysis, material identification, and rendering, then sends only the results in the transmission stream to clients. This extraction eliminates the need for complex local processing on client devices while maintaining high recognition accuracy.
Solution Approach 2:
The patent creates a processed copy of the video content with embedded material attribute information on the server side. Instead of requiring clients to perform original algorithm analysis, the server generates a transmission stream that contains pre-processed video data with material characteristics already extracted and encoded. Clients can then display this copied content with accurate material representation without needing to perform the complex analysis themselves.
3Manufacturing precision
If all video processing and material rendering is performed on the client device, then the video image quality is maintained, but the configuration requirements and processing burden on the terminal increase
Solution Approach 1:
The patent inverts the traditional processing model by having the server perform all rendering and processing operations, then transmit the fully processed transmission stream to clients. Instead of clients rendering materials and processing video locally (which requires high configuration), the server completes all processing beforehand and sends the final rendered content to clients for simple display, effectively reversing who performs the heavy computational work.
Data Source
AI summary
The embodiments of the present disclosure disclose a data processing method, apparatus and electronic device, the method including: acquiring material attribute information of a first material in a video image played on a first device terminal, wherein the video image includes a raw video image and the first material drawn on the raw video image using computer graphics; generating a transmission stream according to the raw video image and the material attribute information; and sending the transmission stream to at least one second device terminal.