Browser audio and video decoding and playing method based on webassembly

An audio and video decoding and playback method technology, applied in the field of browser audio and video decoding and playback based on webassembly, can solve problems such as poor performance of CPU-intensive decoding operations, limitation of the running speed of js interpreted language, and no support for H265, etc. Avoid compatibility issues and limitations of decoding types, reduce rendering burden, and simplify the effect of calling process

Active Publication Date: 2019-09-03
INSPUR SOFTWARE CO LTD
View PDF9 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] (1) The disadvantage of using the flash plug-in is that it does not support H265, and the second is that mainstream browsers are no longer updated and gradually cancel their support
[0004] (2) Using ActiveX plug-ins or NPAPI plug-ins, based on security considerations, mainstream browsers are not supporting
[0005] (3) Using the video tag of html5, its disadvantage is that the decoding type is limited, for example, it does not support H265
[0006] (4) Native js is directly decoded on the browser side. Its disadvantage is that it is limited by the running speed of the js interpretive language, and it does not perform well for cpu-intensive decoding operations.
[0007] (5) Server-side decoding, its disadvantage is that the amount of decoded data is too large, occupying a lot of bandwidth resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Browser audio and video decoding and playing method based on webassembly

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer, the present invention will be described in detail below in conjunction with the embodiments. It should be noted that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0051] In this webassembly-based browser audio and video decoding and playback method, the user customizes the c-version decoding library according to the audio and video encoding type, and then compiles the custom c-version decoding library into webassembly code through Emscripten for the browser to call. Decoding is performed by enabling multi-threading through webassembly, and audio and video are played without delay.

[0052] The webassembly-based browser audio and video decoding and playing method includes the following steps:

[0053] (1) Generate webassembly decoding module

[0054] Encapsulate...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention particularly relates to a browser audio and video decoding and playing method based on webassembly. The browser audio and video decoding and playing method based on webassembly comprisesthe following steps that a user customizes a c-version decoding library according to the coding type of the audio and video, compiles the customized c-version decoding library into webcast codes forthe browser to call through the Emscripten, decodes the webassembly codes at the browser end through webassembly in a multi-thread mode, and audio and video are played in a delay-free mode. Accordingto the browser audio and video decoding and playing method based on webassembly, multi-thread decoding is adopted, the decoding efficiency is high, delay-free and plug-in-free playing can be achieved,and playing of audio and video streams of various coding formats is supported.

Description

technical field [0001] The invention relates to the technical field of decoding and playing audio and video streams, in particular to a method for decoding and playing audio and video in a browser based on webassembly. Background technique [0002] At present, the current solutions for playing audio and video on the browser side include the following: [0003] (1) The disadvantage of using the flash plug-in is that it does not support H265, and the second is that mainstream browsers are no longer updated and gradually cancel their support. [0004] (2) Using ActiveX plug-ins or NPAPI plug-ins, based on security considerations, mainstream browsers are not supporting [0005] (3) Using the video tag of html5 has the disadvantage of limited decoding types, such as not supporting H265. [0006] (4) Native js is directly decoded on the browser side. The disadvantage is that it is limited by the running speed of the js interpreted language, and it does not perform well for CPU-i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/443H04N21/426
CPCH04N21/426H04N21/443
Inventor 杨凯高美容尹萍安晓博张新法
Owner INSPUR SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products