A Web video live broadcast method and system based on hybrid architecture
By employing a hybrid architecture for web video live streaming, and utilizing WebSockets and JSON data formats to optimize latency, the latency and compatibility issues of web video live streaming have been resolved. This approach achieves rapid response and transparent compatibility, thereby improving user experience and system integration.
Patent Information
- Application Number
- CN202111650855.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-30
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-12-30
AI Technical Summary
Existing web video live streaming technologies suffer from high latency and inconvenient protocol extension, resulting in poor user experience and poor system compatibility.
A hybrid architecture-based Web video live streaming method is adopted, which obtains basic information through WebSocket connection, and uses audio and video acquisition module, signaling communication module, media access module and audio and video forwarding module. The interaction protocol is designed in combination with XML or JSON data format, which supports fast response and expansion, optimizes latency and improves system integration and compatibility.
The system optimized web live streaming latency, improved user experience, resolved inconsistencies in audio and video encoding methods, achieved rapid response and transparent compatibility, and enhanced system integration and compatibility.
Smart Images

Figure CN114390034B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of websocket communication, and specifically relates to a Web video live broadcast method and system based on a hybrid architecture. Background Art
[0002] Due to technical limitations, early Web service applications could not support online preview of video information. In the field of security monitoring systems, they were all designed based on the C / S architecture. With the iteration and update of technology and the continuous development of communication technology, HTML5 technology has begun to support the application of audio and video, which has brought great vitality to Web live broadcasting. People have widely used live broadcasting technology in the fields of online medical care, online education, team collaboration, entertainment live broadcasting, etc. At the same time, the security monitoring field can also make great use of the B / S architecture. The following are the most widely used and mature video communication technologies:
[0003] The first method is to embed the OCX component into the browser to achieve decoding and playback of audio and video streams. Currently, this technology is only supported in IE browsers, and other browsers do not support it.
[0004] The second is HLS, HTTP Live Streaming (abbreviated as HLS) is an HTTP-based streaming network transmission protocol proposed by Apple and is part of Apple's QuickTime X and iPhone software systems. It works by dividing the entire stream into small HTTP-based files for download, downloading only some at a time. When the media stream is playing, the client can choose to download the same resource from many different backup sources at different rates, allowing the streaming session to adapt to different data rates, but the disadvantage is large latency.
[0005] The third is RTMP, which refers to Adobe's RTMP (Realtime Message Protocol), which is widely used in low-latency live broadcasts and is also the actual standard protocol for connecting encoders and servers. The disadvantage is that it requires flash support;
[0006] The fourth is WebRTC, WebRTC (full name: WebReal-Time Communication), web instant communication, is an API that supports web browsers for real-time voice or video conversations. It was open sourced on June 1, 2011 and included in the W3C recommended standard of the World Wide Web Consortium with the support of Google, Mozilla, and Opera. Its advantages are: good real-time performance, low latency, and based on the UDP protocol. Its disadvantages are: lack of mature open source transit server solutions, involving many technical complexities.
[0007] In view of this, it is very meaningful to propose a Web video live broadcast method and system based on a hybrid architecture.
[0008] Application Contents
[0009] In order to solve the problems of large live broadcast delay and inconvenient protocol expansion in the prior art, the present application provides a Web video live broadcast method and system based on a hybrid architecture to solve the technical defects in the prior art.
[0010] This application proposes a Web video live broadcast method based on a hybrid architecture, which includes the following steps:
[0011] S1. Obtain basic information of the web front end, load the basic information on the web interface and establish a websocket connection with the audio and video player;
[0012] S2, the web interface sends a request media stream signaling to the web backend, the web backend returns a unique identifier of the first request for the media stream to the web interface, and the web backend sequentially notifies the signaling service and the audio and video acquisition module of the web front end after receiving the request media signaling;
[0013] S3, after receiving the signaling requesting the media stream, the audio and video acquisition module of the web front end sends the acquired audio and video to the media access module, and the media access module pushes the audio and video to the forwarding module; and
[0014] S4, the web interface synchronously sends the parameters of the media stream signaling request and the unique identifier to the audio and video player, and the audio and video player interacts with the forwarding module to pull the media stream to the audio and video player and decode and play it. The above solution can optimize the problem of web live broadcast delay, thereby improving the user experience, and at the same time solve the problem of uneven audio and video encoding methods for the entire segment, and can conveniently expand the interactive protocol to ensure that the system's needs for live broadcast can be quickly met, thereby improving the integration and compatibility of the web live broadcast system.
[0015] Preferably, in S1, the web interface and the audio and video player interaction protocol are based on websocket as the communication medium, and the interaction scheme is designed by carrying the xml or json data format. The design of the interaction scheme carried by the xml or json data format can quickly respond to the needs of different web video live broadcasts, can quickly support the web live broadcast of the existing system, and is transparently compatible with previous needs, which is convenient and fast.
[0016] Further preferably, the interactive protocol is designed to be carried out in json data format.
[0017] Further preferably, the design of the interaction protocol includes:
[0018] a. Message header, which mainly contains the following information: protocol version, protocol type, signaling type, request time, format type, session ID, coordinate message, window display width, window display height, display style and extension field;
[0019] b. Message body: includes SDP information for requesting audio and video streaming media, media channel with unique identification information, and data information related to the service such as manufacturer type, making the extension of the protocol more convenient.
[0020] Further preferably, the signaling type includes control of self-expansion of display, such as starting display and closing display.
[0021] Further preferably, the design of the audio and video player also includes:
[0022] A. Display interface: The display of the audio and video player interface is customized according to the configuration of the web backend;
[0023] B. Decoding and playback library: The decoding and playback library of the audio and video player loads the corresponding decoding and playback library according to the manufacturer type actually requested, and unloads the decoding and playback library according to the actual usage. In actual applications, there is privatization of audio and video encoding and a variety of encoding protocols. Therefore, it is necessary to encapsulate unique decoding and playback libraries for devices of different manufacturers, and unload or load the decoding and playback library according to the actual usage. In this way, system resources can be reasonably used according to the actual situation, avoiding invalid occupation of resources, improving the scalability of web video live broadcast, and meeting the complex needs of different users.
[0024] In the second aspect, the present application proposes a Web video live broadcast system based on a hybrid architecture, comprising:
[0025] Audio and video acquisition module: configured to collect various audio and video information;
[0026] Signaling communication module: configured for signaling communication between modules;
[0027] Media access module: configured to access the required audio and video media information;
[0028] Audio and video forwarding module: configured to forward the required audio and video information;
[0029] Web service module: configured for communication service between the web front end and the web back end;
[0030] Audio and video player: Configuration used to load or unload the decoding and playback library, and decode and play media streams.
[0031] In a third aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by one or more processors, the one or more processors implement a method as described in any implementation method in the first aspect.
[0032] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described in any implementation manner in the first aspect.
[0033] Compared with the prior art, the beneficial results of this application are:
[0034] (1) The above solution can optimize the problem of web live broadcast delay, thereby improving the user experience. At the same time, it can solve the problem of uneven audio and video encoding methods for the entire segment, and can conveniently expand the interactive protocol to ensure that the system's needs for live broadcast can be quickly met, thereby improving the integration and compatibility of the web live broadcast system.
[0035] (2) The design of an interactive solution carried in XML or JSON data format can quickly respond to different web video live broadcast requirements, quickly support web live broadcast of existing systems, and be transparently compatible with previous requirements, which is convenient and fast. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] The accompanying drawings are included to provide a further understanding of the embodiments and are incorporated into and constitute a part of this specification. The accompanying drawings illustrate the embodiments and are used together with the description to explain the principles of the present application. It will be easy to recognize other embodiments and many expected advantages of the embodiments because they become better understood by reference to the following detailed description. The elements of the drawings are not necessarily to scale with each other. The same reference numerals refer to corresponding similar parts.
[0037] Figure 1 is an exemplary device architecture diagram to which an embodiment of the present application may be applied;
[0038] Figure 2 A schematic diagram of a flow chart of a Web video live broadcast method based on a hybrid architecture according to an embodiment of the present application;
[0039] Figure 3 An interaction diagram of the entire hybrid architecture system in the hybrid architecture-based Web video live broadcast method of an embodiment of the present application;
[0040] Figure 4A schematic diagram of a process flow between a web browser, an audio and video player, and media forwarding in a Web video live broadcast method based on a hybrid architecture according to an embodiment of the present application;
[0041] Figure 5 A schematic diagram of loading or unloading components of an audio and video player in a Web video live broadcast method based on a hybrid architecture according to an embodiment of the present application;
[0042] Figure 6 A flowchart of the operation of an audio and video player in a Web video live broadcast method based on a hybrid architecture according to an embodiment of the present application;
[0043] Figure 7 It is a schematic diagram of the structure of a computer device suitable for implementing the electronic device of the embodiment of the present application. DETAILED DESCRIPTION
[0044] In the following detailed description, reference is made to the accompanying drawings, which form a part of the detailed description and are shown by illustrative specific embodiments in which the present application can be practiced. To this end, directional terms, such as "top", "bottom", "left", "right", "up", "down", etc., are used with reference to the orientation of the figures described. Because the components of the embodiments can be positioned in several different orientations, directional terms are used for the purpose of illustration and are by no means limiting. It should be understood that other embodiments may be utilized or logical changes may be made without departing from the scope of the present application. Therefore, the following detailed description should not be adopted in a limiting sense, and the scope of the present application is defined by the appended claims.
[0045] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.
[0046] Figure 1 An exemplary system architecture 100 is shown to which the method for processing information or the apparatus for processing information according to the embodiments of the present application can be applied.
[0047] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.
[0048] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc.
[0049] The terminal devices 101 , 102 , and 103 may be various electronic devices with communication functions, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.
[0050] The server 105 may be a server that provides various services, such as a background information processing server that processes the verification request information sent by the terminal devices 101, 102, and 103. The background information processing server may analyze the received verification request information and obtain a processing result (such as verification success information that indicates that the verification request is a legitimate request).
[0051] It should be noted that the method for processing information provided in the embodiment of the present application is generally executed by the server 105, and accordingly, the device for processing information is generally set in the server 105. In addition, the method for sending information provided in the embodiment of the present application is generally executed by the terminal devices 101, 102, 103, and accordingly, the device for sending information is generally set in the terminal devices 101, 102, 103.
[0052] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, used to provide distributed services), or it can be implemented as a single software or multiple software modules. No specific limitation is made here.
[0053] Figure 2 It is shown that the embodiment of the present application discloses a Web video live broadcast method based on a hybrid architecture, such as Figure 2 As shown, the method comprises the following steps:
[0054] S1. Obtain basic information of the web front end, load the basic information on the web interface and establish a websocket connection with the audio and video player;
[0055] Specifically, refer to Figure 2 and Figure 3 In the embodiment, the interaction protocol between the web interface and the audio and video player is based on websocket as the communication medium, and the interaction solution is designed by carrying the XML or JSON data format.
[0056] In this embodiment, the interactive protocol adopts the json data format for carrying design. The design of the interactive protocol includes:
[0057] a. Message header, which mainly contains the following information: protocol version, protocol type, signaling type, request time, format type, session ID, coordinate message, window display width, window display height, display style and extension field;
[0058] b. Message body: includes the SDP information for requesting audio and video streaming media, the media channel with unique identification information, and data information associated with the service such as the manufacturer type.
[0059] The signaling type includes control of self-expansion of the display, such as starting the display and closing the display.
[0060] The specific protocol format is as follows:
[0061]
[0062]
[0063] Among them, the business agreement is mainly transmitted in the message body, and there are mainly manufacturer types, as shown below:
[0064]
[0065]
[0066] S2, the web interface sends a request media stream signaling to the web backend, the web backend returns the unique identifier of the first media stream request to the web interface, and after receiving the request media signaling, the web backend notifies the signaling service and the audio and video acquisition module of the web front end in turn; Figure 4 As shown, in this embodiment, the unique identifier can be understood as a room ID.
[0067] S3. After receiving the signaling requesting the media stream, the audio and video acquisition module of the web front end sends the acquired audio and video to the media access module, and the media access module pushes the audio and video to the forwarding module; and
[0068] The above steps load the front-end basic information through the web interface and establish a websocket connection with the video player. When the web interface needs to request a media stream, it first sends the signaling to the web backend, which then returns the unique identifier of the current first request for this video to the web interface, which is the room ID. After receiving the signaling, the backend notifies the signaling service in turn, and then gives it to the audio and video acquisition module of the front end. This step completes the sending of the request signaling from the web interface to the front-end device.
[0069] S4. The web interface synchronously sends the parameters and unique identifier of the media stream signaling request to the audio and video player. The audio and video player interacts with the forwarding module, pulls the media stream to the audio and video player, and decodes and plays it.
[0070] After receiving the signaling requesting the media stream, the front-end audio and video acquisition module will send the collected audio and video to the media access module, which will then push it to the forwarding module through the media access. Then, when the web interface sends the media request signaling, the web interface will simultaneously send the request message parameters and the request unique identifier, i.e., the room ID, to the audio and video player. The audio and video player interacts with the forwarding module to pull the media stream back, and then decode and play it.
[0071] Specific as Figure 5 and Figure 6 As shown, in this embodiment, the audio and video player design mainly consists of two parts: a display interface and a decoding and playback library. The decoding and playback library is designed based on a componentized approach, and is dynamically expanded by encapsulating the decoding and playback library in a componentized manner. It should be noted that the reason for encapsulating the decoding and playback library is that in actual applications, there are privatizations of audio and video encoding and various encoding protocols, so it is necessary to encapsulate a unique decoding and playback library for devices of different manufacturers.
[0072] Specifically, it includes the interface display part: the interface display can be customized according to the backend configuration; the decoding and playback library is componentized: the decoding and playback library loads the corresponding decoding and playback library according to the actual requested manufacturer type, and sets the corresponding strategy for uninstallation. For example, if the decoding and playback library has no news for a long time measured by the time dimension, the uninstallation operation can be performed. This can make reasonable use of system resources according to the actual situation and avoid invalid occupation of resources.
[0073] The above solution can optimize the problem of web live broadcast delay, thereby improving the user experience. At the same time, it can solve the problem of uneven audio and video encoding methods for the entire segment. Cameras with specific audio and video encoding methods have problems that cannot be played, such as panoramic dome cameras, which can be well solved by the above solution. At the same time, the above solution supports multiple streaming methods and can easily expand the interactive protocol, ensuring that the system's needs for live broadcast can be quickly met, thereby improving the integration and compatibility of the web live broadcast system.
[0074] In the second aspect, the present application also proposes a Web video live broadcast system based on a hybrid architecture, including:
[0075] Audio and video acquisition module: configured to collect various audio and video information;
[0076] Signaling communication module: configured for signaling communication between modules;
[0077] Media access module: configured to access the required audio and video media information;
[0078] Audio and video forwarding module: configured to forward the required audio and video information;
[0079] Web service module: configures the communication service between the web front end and the web back end;
[0080] Audio and video player: Configuration used to load or unload the decoding and playback library, and decode and play media streams.
[0081] Reference below Figure 7 , which shows an electronic device (eg Figure 1 A schematic diagram of the structure of a computer device 600 (a server or terminal device as shown). Figure 7 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0082] like Figure 7 As shown, the computer device 600 includes a central processing unit (CPU) 601 and a graphics processing unit (GPU) 602, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 603 or the program loaded from the storage part 609 to the random access memory (RAM) 606. In the RAM 604, various programs and data required for the operation of the device 600 are also stored. The CPU 601, GPU 602, ROM 603 and RAM 604 are connected to each other through a bus 605. An input / output (I / O) interface 606 is also connected to the bus 605.
[0083] The following components are connected to the I / O interface 606: an input section 607 including a keyboard, a mouse, etc.; an output section 608 including a display such as a liquid crystal display (LCD), etc. and a speaker, etc.; a storage section 609 including a hard disk, etc.; and a communication section 610 including a network interface card such as a LAN card, a modem, etc. The communication section 610 performs communication processing via a network such as the Internet. A drive 611 may also be connected to the I / O interface 606 as needed. A removable medium 612, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 611 as needed so that a computer program read therefrom is installed into the storage section 609 as needed.
[0084] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part 610, and / or installed from a removable medium 612. When the computer program is executed by a central processing unit (CPU) 601 and a graphics processing unit (GPU) 602, the above-mentioned functions defined in the method of the present application are executed.
[0085] It should be noted that the computer-readable medium described in the present application may be a computer-readable signal medium or a computer-readable medium or any combination of the above two. The computer-readable medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor device, device or component, or any combination of the above. More specific examples of computer-readable media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution device, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable medium that can send, propagate or transmit a program for use by or in conjunction with an instruction execution device, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
[0086] Computer program code for performing the operations of the present application may be written in one or more programming languages or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0087] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the device, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based device that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0088] The modules involved in the embodiments described in this application may be implemented by software or hardware, and the modules described may also be set in a processor.
[0089] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the electronic device, the electronic device executes the method described above.
[0090] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.
Claims
1. A Web video live broadcast method based on a hybrid architecture, characterized in that: The method comprises the following steps: S1. Obtain basic information of the Web front end, load the basic information on the Web interface and establish a websocket connection with the audio and video player; S2, the Web interface sends a request media stream signaling to the Web backend, the Web backend returns a unique identifier of the first media stream request to the Web interface, and the Web backend sequentially notifies the signaling service and the audio and video acquisition module of the Web front end after receiving the request media signaling; S3, after receiving the signaling requesting the media stream, the audio and video acquisition module of the Web front end sends the acquired audio and video to the media access module, and the media access module pushes the audio and video to the forwarding module; as well as S4, the Web interface synchronously sends the parameters of the request media stream signaling and the unique identifier to the audio and video player, and the audio and video player interacts with the forwarding module to pull the media stream to the audio and video player and decode and play it; Among them, the interaction protocol between the Web interface and the audio and video player uses websocket as the communication medium, and carries the interaction design scheme through xml or json data format. The design of the interaction protocol includes: a. message header, which mainly contains the following information: protocol version, protocol type, signaling type, request time, format type, session ID, coordinate message, window display width, window display height, display style and extension field; b. message body: including SDP information of requesting audio and video streaming media, media channel of unique identification information and manufacturer type in data information associated with the service; also includes the design of the audio and video player, specifically including: A. display interface: the display of the audio and video player interface is customized according to the configuration of the Web backend; B. decoding and playback library: the decoding and playback library of the audio and video player loads the corresponding decoding and playback library according to the manufacturer type actually requested, and unloads the decoding and playback library according to actual usage.
2. The Web video live broadcast method based on hybrid architecture according to claim 1, characterized in that: The signaling type includes control of self-expansion of display, including starting display and closing display.
3. A Web video live broadcast system based on a hybrid architecture, characterized in that: include: Audio and video acquisition module: configured to collect various audio and video information, and after receiving the signaling requesting the media stream, send the collected audio and video to the media access module; Signaling communication module: configured for signaling communication between modules. The Web interface sends a media stream request signaling to the Web backend, and the Web backend returns the unique identifier of the first media stream request to the Web interface. After receiving the media request signaling, the Web backend notifies the signaling service and the audio and video acquisition module of the Web front end in sequence; Media access module: configured to access the required audio and video media information, receive the audio and video collected by the audio and video collection module, and push the audio and video to the audio and video forwarding module; Audio and video forwarding module: configured to forward the required audio and video information to the audio and video player; Web service module: configures the communication service between the Web front end and the Web back end, obtains the basic information of the Web front end, loads the basic information on the Web interface and establishes a websocket connection with the audio and video player; Audio and video player: configured to load or unload the decoding and playing library, decode the media stream and play it, receive the parameters of the media stream request signaling and the unique identifier sent synchronously by the Web interface, pull the media stream to the audio and video player and decode and play it; Among them, the interaction protocol between the Web interface and the audio and video player uses websocket as the communication medium, and carries the interaction design scheme through xml or json data format. The design of the interaction protocol includes: a. message header, which mainly contains the following information: protocol version, protocol type, signaling type, request time, format type, session ID, coordinate message, window display width, window display height, display style and extension field; b. message body: including SDP information of requesting audio and video streaming media, media channel of unique identification information and manufacturer type in data information associated with the service; also includes the design of the audio and video player, specifically including: A. display interface: the display of the audio and video player interface is customized according to the configuration of the Web backend; B. decoding and playback library: the decoding and playback library of the audio and video player loads the corresponding decoding and playback library according to the manufacturer type actually requested, and unloads the decoding and playback library according to actual usage.
4. An electronic device comprising: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1-2.
5. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 2 is implemented.
