Composite Media Streaming via Unified Manifest Structure
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing streaming media technologies face challenges in seamlessly integrating and playing back composite media streams from different sources, requiring re-encoding or re-packaging of content for features like smooth streaming, fast forward, and rewind, which is inefficient for quick turnaround of highlights or live events.
Innovation Solution
A streaming composition system that allows content producers to create composite media assets by identifying and combining clips from existing media, using a composite manifest structure to enable seamless playback across clip boundaries, including advanced playback support, and leveraging existing smooth streaming assets for efficient delivery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If content is re-encoded or re-packaged for smooth streaming features, then playback quality and control features (fast forward, rewind) are improved, but processing time and complexity increase
Solution Approach 1:
The media content is divided into discrete chunks that can be independently addressed and requested. Each chunk contains metadata and media content, allowing the system to process and deliver individual segments without re-encoding the entire content, thus reducing processing time while maintaining playback quality.
Solution Approach 2:
The media content is pre-segmented into chunks and metadata is prepared in advance. This preliminary action allows the system to quickly assemble and deliver composite media streams without requiring real-time re-encoding, enabling fast turnaround for highlights and live events.
2Adaptability or versatility
If multiple existing media assets are combined into composite streams, then content versatility and user experience are improved, but system complexity increases
Solution Approach 1:
The system provides a unified interface and control mechanism that works across multiple different media sources and formats. The smooth streaming client can request and play back chunks from various sources (live events, on-demand content, highlights) using the same protocol and controls, simplifying the user experience despite the complexity of combining multiple assets.
Solution Approach 2:
The system introduces a composition layer that acts as an intermediary between existing media assets and the playback client. This composition layer handles the complexity of combining multiple assets by managing chunk requests, timing, and synchronization, while presenting a simple unified interface to the end user.
3Reliability
If tight coupling between server and client is used, then stateful connection tracking is improved, but server scalability is limited
Solution Approach 1:
The connection and media delivery are segmented into independent, stateless chunk requests. Instead of maintaining a single stateful connection, the system breaks down media delivery into discrete chunk requests that can be handled independently, allowing multiple clients to be served simultaneously without increasing server overhead, thus improving scalability while maintaining reliable delivery.
Solution Approach 2:
The system uses manifest files that describe chunks and their locations, allowing clients to independently request and cache chunks without continuous server state tracking. The manifest acts as a copy of the delivery plan that clients can use autonomously, reducing the need for stateful server-client connections while maintaining reliable media delivery.
Data Source
AI summary
A streaming composition system is described herein that provides easy workflow and playback capabilities for content producers to create composite media assets from existing and on-going media content and for streaming clients to seamlessly playback composite multimedia streams provided from different sources. These assets provide broadcasters an option to quickly turn around highlights for an on-going event. The streaming composition system allows a producer to identify clips within existing media assets and compose the clips into a new unified streaming presentation. For producers that already have smooth streaming media assets, the system leverages these assets to provide seamless playback across clip boundaries including advanced playback support for advertisement insertion, fast forward, rewind, and so on.