Cloud Streaming Server MSE Media Transcoding and Stream Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In cloud streaming systems, the playback of Media Source Extension (MSE) media leads to inefficient resource consumption and reduced supportable user sessions due to duplicated playback processing at both the cloud streaming server and user device.
Innovation Solution
The cloud streaming server separates MSE media playback from other content components, transcoding MSE media into a suitable format for user device processing and transmitting it as a distinct stream, while encoding and capturing the remaining content for overlay processing at the user device, thereby preventing duplicated playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the cloud streaming server embeds an MSE media player and plays MSE media, then the content playback is controlled, but the system resources are consumed excessively and the session number of simultaneously supportable user devices is reduced
Solution Approach 1:
The patent extracts the MSE media playback function from the cloud streaming server and relocates it to the user device. The server only transcodes MSE media files into suitable formats and transmits them as separate streams, while the user device performs the actual playback. This extraction eliminates unnecessary duplicated playback processing at the server, reducing system resource consumption while maintaining playback control capability.
2Productivity
If the cloud streaming server captures and encodes the entire browser screen including MSE media playback, then the content is streamed to user devices, but duplicated playback occurs at both server and user device
Solution Approach 1:
The patent segments the content stream into two separate streams: one for MSE media and another for the remaining content components. The server transcodes MSE media into a suitable format and transmits it as a distinct stream, while simultaneously capturing and encoding the browser screen excluding the MSE media playback area. This segmentation prevents duplicated playback processing while ensuring both streams are properly synchronized and combined at the user device.
3Extent of automation
If MSE media is played back at the cloud streaming server, then the playback can be controlled centrally, but the number of simultaneously supportable user sessions decreases
Solution Approach 1:
The patent introduces a transcoding mechanism as an intermediary between the MSE media file and the user device playback. The server performs format transcoding to ensure compatibility and transmits the transcoded stream, maintaining centralized control over the media format and quality. However, the actual playback is executed at the user device, which eliminates the heavy resource consumption associated with server-side playback and enables support for a larger number of simultaneous user sessions.
Data Source
AI summary
A method and apparatus are provided for a cloud streaming service. A cloud streaming server receives first data corresponding to media source extension (MSE) media from a media source server when a request for content is received from a user device. Then the cloud streaming server creates a first stream by transcoding the first data to a suitable format for processing at the user device, and transmits the created first stream to the user device. Further, the cloud streaming server receives second data corresponding to remaining data except the first data in the content, outputs an execution screen of the content by executing the second data, captures the outputted execution screen, and creates a second stream by encoding the captured screen.