Media File Tracks for Web Content Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in synchronizing the presentation of web content with media data, such as video and audio, particularly in file formats like ISO Base Media File Format (ISO BMFF), where interactive web elements need to be time-aligned with video frames, and current methods like DASH events or HTML-5 often require additional processing or specific browser modifications.
Innovation Solution
The proposed solution involves embedding web content, formatted in HTML, within media files, along with synchronization data, allowing client devices to retrieve and present both media and web content in a time-synchronized manner using HTML-5 processors, Web Socket APIs, and HTTP server caches, without requiring specific modifications to the browser or additional code for file handling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If web content is embedded within media files with synchronization data, then synchronized playback of interactive web content with media data is enabled, but device complexity increases due to the need to process both media data and web content from a single file
Solution Approach 1:
The patent combines media data and web content into a single unified file structure, allowing both types of content to be retrieved together and presented in a synchronized manner. This merging eliminates the need for separate file handling and improves compatibility across different devices and client types.
Solution Approach 2:
The file structure is designed to be universal, supporting both media playback and web content rendering within the same container. This multi-functional approach allows a single file to serve multiple purposes across different platforms without requiring device-specific modifications.
2Manufacturing precision
If web content is synchronized with media data using time-stamps and synchronization data, then precise time-alignment is achieved, but data volume increases due to additional synchronization information
Solution Approach 1:
Time-stamps and synchronization data are embedded within the media file during the encoding and packaging process, rather than being added during playback. This preliminary action ensures precise synchronization is built into the file structure itself, eliminating the need for complex runtime synchronization logic.
3Productivity
If a single file contains both media data and web content, then retrieval efficiency is improved by fetching everything in one request, but file size increases compared to separate files
Solution Approach 1:
Media data and web content are merged into a single file, enabling both to be retrieved in one network request. This reduces network overhead and improves retrieval efficiency, despite the increased file size compared to separate files.
Data Source
AI summary
In one example, a device for retrieving media data includes a memory configured to store media data, and one or more processors implemented in circuitry and configured to retrieve a file including the media data, web content formatted according to hypertext markup language (HTML), and data indicating how to synchronize the web content with the media data, and present the media data and the web content, wherein to present the media data and the web content, the one or more processors are configured to synchronize presentation of the web content with presentation of the media data according to the data indicating how to synchronize the web content with the media data.