Low Latency Live Video via Browser-Based H.264 WebM Packaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video streaming techniques in customer support contexts face significant latency issues, making it unsuitable for real-time video transmission without requiring additional software installations or browser compatibility checks, which is impractical for universal browser support.
Innovation Solution
Implementing a video processing JavaScript that encodes video into H.26x format and packages it into WebM or FMP4 format, using a video relay service to transmit low latency live video without the need for additional plugins or software installations, and utilizing WebM deboxers and H.26x decoders within the browser to ensure universal compatibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If commonly used video formats are used that can be decoded natively by browsers, then ease of operation is improved, but latency increases excessively
Solution Approach 1:
The patent changes the video format parameters by using H.264 encoded video packaged in WebM or FMP4 containers, which are natively supported by modern browsers. This parameter change enables both low latency and universal browser compatibility without requiring plugins or extensions.
2Reliability
If video formats requiring additional plugins or applications are used, then video quality is improved, but device complexity increases
Solution Approach 1:
The patent makes the video solution universal by using H.264 encoding with WebM or FMP4 packaging, which can be decoded by all commonly used browsers without requiring additional plugins, applications, or browser extensions. This multi-functional approach ensures compatibility across different browser types and platforms.
3Reliability
If video latency is reduced to synchronize with audio, then reliability of communication is improved, but ease of operation worsens due to browser compatibility constraints
Solution Approach 1:
The patent achieves audio-video synchronization by changing the video format parameters to H.264 encoding with WebM or FMP4 packaging, which enables low latency playback in all commonly used browsers without requiring plugins or extensions, thus maintaining both reliability and ease of operation.
Data Source
AI summary
A video sender loads sender video processing JavaScript into a browser, the sender video processing JavaScript being configured to receive video from a source connected to the first computer, encode images of the video into a H.26x encoded video format, package the encoded video into WebM or FMP4 format, and output the packaged/encoded video on the communication network. A video receiver loads receiver video JavaScript in its browser, the receiver video JavaScript comprising a video format detector, a WebM deboxer, a FMP4 deboxer, a H.26x video decoder, and a rendering engine. The video format detector determines whether received video is packaged using WebM or FMP4 and sends the video to the respective deboxer. The deboxed video is then decoded using the H.26x decoder and the images are rendered by the rendering engine. Timestamps and byte counts are inserted into the video packages, and acknowledgments are used to determine excess latency.