A browser audio and video decoding and playing method based on webassembly

Abstract

The invention particularly relates to a browser audio and video decoding and playing method based on webassembly. In this webassembly-based browser audio and video decoding and playback method, users customize the c-version decoding library according to the audio and video encoding type, and then use Emscripten to compile the custom c-version decoding library into webassembly code for the browser to call. Decoding is performed by enabling multi-threading through webassembly, and audio and video are played without delay. The browser audio and video decoding and playing method based on webassembly adopts multi-thread decoding and has high decoding efficiency. It can not only achieve no delay and no plug-in playback, but also supports playback of audio and video streams in multiple encoding formats.

Description

technical field [0001] The invention relates to the technical field of decoding and playing audio and video streams, in particular to a method for decoding and playing audio and video in a browser based on webassembly. Background technique [0002] At present, the current solutions for playing audio and video on the browser side include the following: [0003] (1) The disadvantage of using the flash plug-in is that it does not support H265, and the second is that mainstream browsers are no longer updated and gradually cancel their support. [0004] (2) Using ActiveX plug-ins or NPAPI plug-ins, based on security considerations, mainstream browsers are not supporting [0005] (3) Using the video tag of html5 has the disadvantage of limited decoding types, such as not supporting H265. [0006] (4) Native js is directly decoded on the browser side. The disadvantage is that it is limited by the running speed of the js interpreted language, and it does not perform well for CPU-i...

AI Technical Summary

Problems solved by technology

[0003] (1) The disadvantage of using the flash plug-in is that it does not support H265, and the second is that mainstream browsers are no longer updated and gradually cancel their support

[0004] (2) Using ActiveX plug-ins or NPAPI plug-ins, based on security considerations, mainstream browsers are not supporting

[0005] (3) Using the video tag of html5, its disadvantage is that the decoding type is limited, for example, it does not support H265

[0006] (4) Native js is directly decoded on the browser side. Its disadvantage is that it is limited by the running speed of the js interpretive language, and it does not perform well for cpu-intensive decoding operations.

[0007] (5) Server-side decoding, its disadvantage is that the amount of decoded data is too large, occupying a lot of bandwidth resources

Images