Adaptive Media Streaming Format Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Professional media editing tools are resource-intensive and incompatible with limited-resource environments like mobile devices, leading to unresponsive user experiences due to computational and memory constraints, especially when editing temporal media like video, which requires significant network bandwidth and latency.
Innovation Solution
Adaptive media streaming system that determines the optimal format for streaming media based on user interaction, selecting performance-optimized formats for minimal changes and bandwidth-optimized formats for significant changes, using techniques such as encoding and decoding to balance computational resources and network bandwidth.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If professional media editing tools are used on resource-constrained client systems, then editing functionality is provided, but computational resources and memory are excessively consumed
Solution Approach 1:
A server acts as an intermediary between the client system and media editing operations. The server receives media data and editing parameters from the resource-constrained client, performs the computationally intensive media editing operations, and returns the edited media to the client. This mediator approach allows professional editing functionality to be accessed on mobile devices without consuming their limited computational resources.
2Use of energy by moving object
If media editing is offloaded to a server system, then computational load on client is reduced, but network bandwidth and latency increase
Solution Approach 1:
The patent extracts only the essential editing parameters and minimal media data needed for editing operations, transmitting only these extracted elements over the network to the server. Full media files are not continuously transmitted back and forth. This extraction approach significantly reduces network bandwidth consumption while maintaining the ability to perform comprehensive media editing operations on the server.
3Adaptability or versatility
If video editing is performed on resource-constrained devices, then editing capability is provided, but responsiveness deteriorates due to computational constraints
Solution Approach 1:
The server acts as a mediator that handles all computationally intensive video editing operations, allowing the resource-constrained client device to maintain full video editing capability without experiencing computational delays. The client sends editing commands to the server and receives processed results, achieving professional video editing responsiveness despite limited local processing power.
4Use of energy by moving object
If server-offload paradigm is used for temporal media editing, then computational problem is lessened, but network throughput requirement increases
Solution Approach 1:
The system extracts and transmits only essential editing parameters and selectively transmitted frame data rather than complete video streams. This extraction strategy significantly reduces the network throughput requirements for server-offloaded temporal media editing while maintaining the ability to perform comprehensive editing operations on video and audio content.
Data Source
AI summary
Techniques are described for adapting the format of streaming media based on received interactions with the media. In an embodiment, a client computer system receives from media streaming service an initial version of media in an initial media format. After the media is presented, a request to interact with the initial version of the media may be received. Such a request may cause the client system to generate a change request data for the initial version of media. Based at least in part on the change request data for the initial version of the media, the new format for streaming the media to the client computer system is determined. The client computer system receives the media streamed in the new format.