Web Media Source Object for Synchronized Video Audio Playback

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current multimedia technologies face challenges in synchronously playing video and audio files within web browsers, leading to asynchronous playback issues.

Innovation Solution

A method and device for synchronously playing media files involve creating a media source object, adding different tracks to a shared source buffer object, and transmitting a virtual address to a media element to parse and decode the tracks, ensuring video and audio synchronization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If different tracks are added to separate source buffer objects, then the playback can be initiated quickly, but the video and audio become asynchronous

Engineering Contradiction:

ImprovePlayback initiation speedVSAvoidVideo-audio synchronization

Core Design Contradiction:

SpeedVSReliability

Solution Approach 1:

The patent merges multiple tracks (video, audio, subtitle) into a single source buffer object instead of using separate buffer objects for each track. This allows the media element to read and decode all tracks from the same buffer, ensuring they remain synchronized while still enabling quick playback initiation.

Inventive Principle:

Principle #5Merging (Combining)

2Adaptability or versatility

If non-streaming media files are played in webpages, then the playback can be achieved in browser environment, but the files must be completely downloaded before playing

Engineering Contradiction:

ImproveBrowser playback capabilityVSAvoidDownload time before playback

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the non-streaming media file into multiple tracks (video track, audio track, subtitle track) that can be independently processed. The media element reads tracks from the source buffer object as needed, enabling progressive playback without requiring complete file download, thus reducing the loss of time while maintaining browser playback capability.

Inventive Principle:

Principle #1Segmentation

3Reliability

If fragmented media files are pre-stored on server, then the playback can be smooth, but the storage space requirement increases significantly

Engineering Contradiction:

ImprovePlayback smoothnessVSAvoidStorage space

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent introduces a source buffer object as an intermediary between the fragmented media file and the media element. This buffer object manages the fragmented tracks in memory, allowing smooth playback through controlled reading and decoding without requiring permanent pre-storage of all fragmented files on the server, thus reducing storage space requirements while maintaining playback smoothness.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10978109B2Synchronously playing method and device of media file, and storage medium

Publication Date: 2021.04.13 DOUYIN VISION CO LTD

AI summary

The disclosure relates to a synchronously playing method and device of a media file, and a storage medium, the method includes: creating a media source object corresponding to a playing window in a webpage through a player embedded into the webpage; adding different tracks in the fragmented media file into the same source buffer object in the media source object; transmitting a virtual address taking the media source object as a data source to a media element of the webpage; calling the media element to parse the media source object associated with the virtual address, and reading the tracks in the source buffer object of the associated media source object, and decoding and playing the tracks.