Web live broadcast high-quality stream pushing system

Abstract

The invention provides a web live broadcast high-quality stream pushing system. The system comprises a video acquisition module; the video coding module uses H.264 + coding, and the video coding module is connected with the video acquisition module; the front end is connected with the rear end streaming media server through the video stream pushing module; the back-end streaming media server is connected with the content distribution network, and the back-end streaming media server distributes the processed video stream to the content distribution network; the video playing module is connected with the front end so as to play a video; and the interactive function module is integrated with a WebSocket. A low-delay and high-reliability real-time interaction function is realized on the basis of WebSocket; by using a WebSocket two-way communication function, the occupation consumption of network bandwidth in a live broadcast process is reduced; and an H.264 + coding algorithm is adopted, so that higher compression efficiency and better image quality are realized.

Description

Technical Field

[0001] The present invention relates to the field of live broadcasting, and in particular to a system for high-quality streaming of web live broadcasting. Background Art

[0002] With the rapid development and popularization of Internet technology, live streaming has become an important part of the Internet economy and has been widely used in online education, e-commerce, entertainment, conferences and other fields.

[0003] The existing technical solution is generally to use HTML5 <video>and <canvas>Elements are used for video acquisition, WebRTC technology is used to achieve real-time audio and video communication, H.264 encoding algorithm is used, and video encoding is performed through open source libraries (such as FFmpeg) to ensure the balance between video quality and transmission efficiency, SSL / TLS encryption is used to protect data transmission, and authentication and permission management mechanisms are used to ensure data security. Automated deployment tools and monitoring systems are used to ensure high availability of the system.

[0004] In the above-mentioned prior art, although the encoding algorithm is very mature, there are still problems of video quality degradation or freezing in scenarios with high resolution and low bandwidth. The penetration problem and transmission delay problem of WebRTC in complex network environments have not been completely solved. Although data encryption is effective, it adds additional computing overhead. There are delays in the implementation of existing interactive functions (such as chatting and rewarding), and the user experience is not good. In high concurrency situations, the stability and response speed of interactive functions are difficult to guarantee. Summary of the invention

[0005] The present invention provides a system for high-quality streaming of web live broadcast in order to solve the technical problems of high delay, insufficient reliability and large network bandwidth consumption.

[0006] The present invention solves the above technical problems through the following technical solutions:

[0007] The present invention provides a system for high-quality streaming of web live broadcast, which comprises a video acquisition module; a video encoding module, which uses H.264+ encoding and is connected to the video acquisition module to encode the video acquired by the video acquisition module; a video streaming module, through which a front end is connected to a back-end streaming media server; a content distribution network, wherein the back-end streaming media server is connected to a content distribution network, and the back-end streaming media server distributes the processed video stream to the content distribution network, and the content distribution network selects an optimal node for video transmission according to the geographical location of a user terminal; a video playing module, wherein the video playing module is connected to a front end to play a video; and an interactive function module, wherein the interactive function module integrates WebSocket.

[0008] In this technical solution, WebSocket is used to achieve low-latency, high-reliability real-time interactive functions; and the H.264+ encoding algorithm is used to improve compression efficiency and better image quality.

[0009] Preferably, the video acquisition module is implemented through HTML5 <video>and <canvas>Elements for video capture.

[0010] In this technical solution, the user opens the live page in the browser and uses HTML5 <video>and <canvas>Elements for video capture.

[0011] Preferably, the video encoding module uses an open source library to perform video encoding.

[0012] In this technical solution, video encoding is performed through an open source library and the H.264+ encoding algorithm.

[0013] Preferably, it also includes a real-time transmission module, which integrates WebRTC and is configured with a TURN server and a STUN server.

[0014] In this technical solution, WebRTC is used to achieve end-to-end real-time video transmission; TURN server and STUN server are configured to solve the NAT penetration problem.

[0015] Preferably, the real-time transmission module uses the SRTP protocol to encrypt data.

[0016] In this technical solution, the SRTP protocol is used to encrypt data.

[0017] Preferably, it also includes an automated operation and maintenance module, which deploys the Prometheus tool to monitor the system; the automated operation and maintenance module is also configured with a Grafana dashboard for data visualization and alarm.

[0018] In this technical solution, the Prometheus tool and Grafana dashboard are used to ensure high availability and fast response of the system.

[0019] Preferably, it also includes a real-time data analysis module, which integrates the Apache Kafka tool to build a data stream pipeline; the real-time data analysis module has an Apache Spark tool to perform data processing and analysis.

[0020] In this technical solution, real-time processing and analysis of large amounts of data can be achieved.

[0021] Preferably, the real-time data analysis module has data retrieval and visualization tools.

[0022] In this technical solution, data can be stored and retrieved, and data can be displayed and visualized.

[0023] Preferably, the content distribution network is connected to an automatic geographic location reporting module.

[0024] In this technical solution, the geographic location automatic reporting module is used to automatically report the geographic location of the user terminal.

[0025] Preferably, the interactive function module has a real-time chat submodule and a gift reward submodule.

[0026] In this technical solution, the real-time chat submodule and the gift reward submodule are used for chat and reward interaction.

[0027] On the basis of being in accordance with the common sense in the art, the above-mentioned preferred conditions can be arbitrarily combined to obtain the preferred embodiments of the present invention.

[0028] The positive and progressive effects of the present invention are:

[0029] The above-mentioned web live broadcast high-quality streaming system realizes low-latency, high-reliability real-time interactive functions based on WebSocket, enhancing user participation; through the use of WebSocket two-way communication function, it solves the problem of reducing the consumption of network bandwidth during the live broadcast process; and adopts the more advanced H.264+ encoding algorithm to achieve higher compression efficiency and better image quality; and integrates adaptive bit rate adjustment to dynamically adjust the video bit rate according to network conditions to ensure smoothness and image quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is a schematic diagram of the working principle of the present invention.

[0031] Description of Reference Numerals

[0032] 1. High-quality live streaming system;

[0033] 2. Video acquisition module;

[0034] 3. Video encoding module;

[0035] 4. Video streaming module;

[0036] 5. Content distribution network;

[0037] 6. Front end;

[0038] 7. Backend streaming media server;

[0039] 8. Video playback module;

[0040] 9. Interactive function module; 901. Chat submodule; 902. Gift reward submodule;

[0041] 10. Real-time transmission module;

[0042] 11. Automated operation and maintenance module;

[0043] 12. Real-time data analysis module;

[0044] 13. Automatic reporting module of geographic location;

[0045] 14. User end. DETAILED DESCRIPTION

[0046] The present invention is further described below by way of examples, but the present invention is not limited to the scope of the examples.

[0047] like Figure 1 As shown, a system for high-quality streaming of web live broadcast, the high-quality streaming system 1 includes a video acquisition module 2; it also includes: a video encoding module 3, the video encoding module 3 uses H.264+ encoding, and the video encoding module 3 is connected to the video acquisition module 2 to encode the video acquired by the video acquisition module 2; a video streaming module 4, the front end 6 is connected to the back-end streaming media server 7 through the video streaming module 4; a content distribution network 5, the back-end streaming media server 7 is connected to the content distribution network 5, the back-end streaming media server 7 distributes the processed video stream to the content distribution network 5, and the content distribution network 5 selects the optimal node for video transmission according to the geographical location of the user terminal 14; a video playback module 8, the video playback module 8 is connected to the front end 6 to play the video; an interactive function module 9, the interactive function module 9 integrates WebSocket.

[0048] The video acquisition module 2 is implemented by HTML5 <video>and <canvas>Elements for video capture.

[0049] The content distribution network 5 is connected to a geographic location automatic reporting module 13 .

[0050] Video capture and encoding: Users open the live page in a browser or mobile terminal and <video>and <canvas>The element performs video acquisition, and WebRTC provides a real-time communication protocol to transmit the video stream from the user device to the server. The video acquisition module 2 and the video encoding module 3 have JavaScript to control the acquisition, H.264+ encoding and transmission parameters (such as resolution and frame rate) of the video stream.

[0051] Video streaming: The front end 6 pushes the encoded video stream to the back-end streaming server 7 (such as Nginx) through RTMP (Real-time Messaging Protocol) or WebRTC. The server processes and transcodes the video stream to adapt to different network conditions and device requirements.

[0052] Video transmission and distribution: The backend streaming server 7 distributes the processed video stream to the content distribution network 5 (CDN) through the HLS (HTTP Live Streaming) protocol. The CDN will select the optimal node for video transmission based on the user's geographical location to ensure low latency and high reliability.

[0053] Video playback: Users access the live page through a browser or mobile application, and the front end uses HTML5 <video>Elements or specific JavaScript libraries (such as Video.js) are used to play videos. During playback, the front end 6 will automatically adjust the playback quality according to the network conditions to ensure smooth viewing.

[0054] HTML5 and JavaScript are used to build live broadcast pages and implement the control logic of video acquisition, encoding, streaming and playback. HTML5 provides a multimedia processing interface, and JavaScript frameworks (such as React and Vue.js) are used to create highly interactive user interfaces.

[0055] The streaming media server (Nginx) is used to receive, process and transcode the video stream pushed by the front end 6 to ensure the stable transmission and distribution of the video stream.

[0056] Content Distribution Network 5 (CDN) is used to optimize the transmission path of video streams, reduce latency, and improve transmission reliability.

[0057] Among them, this system adopts cloud computing platforms (such as Tencent Cloud and Alibaba Cloud) to provide elastic computing resources and storage to ensure the high availability and scalability of the system.

[0058] The video encoding module 3 uses H.264+ encoding, and the video encoding module 3 adopts an open source library to perform video encoding.

[0059] For video encoding, H.264+ encoding is used, and open source libraries such as FFmpeg are used for video encoding. Adaptive bitrate adjustment (ABR) is implemented to dynamically adjust the video bitrate. The encoding parameters are tested and optimized, and the best configuration is found through experiments. The video quality and bandwidth consumption can be balanced. The adaptive bitrate adjustment technology is used in the above to dynamically adjust the bitrate according to the network conditions.

[0060] The system also includes a real-time transmission module 10, which integrates WebRTC and is configured with a TURN server and a STUN server; the real-time transmission module 10 uses the SRTP protocol to encrypt data.

[0061] WebRTC is used to achieve end-to-end real-time video transmission, and the SRTP protocol is used to encrypt data.

[0062] The specific steps are as follows:

[0063] Integrate WebRTC for video transmission.

[0064] Configuring TURN server and STUN server solves the NAT penetration problem. Implementing SRTP encryption ensures transmission security.

[0065] In the above, low latency and data security are achieved by using WebRTC and SRTP protocols.

[0066] It also includes an automated operation and maintenance module 11, which deploys a Prometheus tool to monitor the system; the automated operation and maintenance module 11 is also configured with a Grafana dashboard to visualize data and issue alarms.

[0067] WebRTC is used to implement real-time audio and video communications, supports direct data transmission between browsers, and has the characteristics of low latency and high quality.

[0068] Prometheus is deployed for system monitoring, and Grafana dashboard is configured for data visualization and alarm. Fault drills are performed regularly to ensure rapid recovery capabilities.

[0069] In the above, by adopting automated deployment and configuration management tools and setting up a comprehensive monitoring and alarm system, it ensures high availability and rapid response of the system.

[0070] It also includes a real-time data analysis module 12, which integrates the Apache Kafka tool to build a data flow pipeline; the real-time data analysis module 12 has an Apache Spark tool to perform data processing and analysis; the real-time data analysis module 12 has a data retrieval and visualization tool.

[0071] Build data streaming pipelines by using Apache Kafka and perform data processing and analysis using Apache Spark.

[0072] Specifically, Apache Kafka is integrated to collect user behavior and system log data. Apache Spark is used for data processing and analysis. Elasticsearch is used to store and retrieve data, and Kibana is used to display and visualize data.

[0073] In the above, efficient data stream processing tools (Kafka and Spark) and powerful data retrieval and visualization tools (Elasticsearch and Kibana) are used to achieve real-time processing and analysis of large amounts of data.

[0074] The interactive function module 9 integrates WebSocket and has a real-time chat submodule 901 and a gift reward submodule 902 .

[0075] It realizes real-time two-way communication based on WebSocket. Specifically, by integrating WebSocket, it develops real-time chat and gift reward functions. It ensures the stability and low latency of WebSocket connection. It realizes user permission and security management.

[0076] In the above, WebSocket is used for low-latency communication to ensure the stability of the system under high concurrency conditions.

[0077] Through the above, the high quality, high performance and high reliability of the system can be ensured to meet the actual needs of users.

[0078] For ease of understanding, the names are explained below:

[0079] h.264: H.264, also the tenth part of MPEG-4, is a highly compressed digital video codec standard proposed by the Joint Video Team (JVT) jointly composed of the ITU-T Video Coding Experts Group (VCEG) and the ISO / IEC Moving Picture Experts Group (MPEG).

[0080] H.264+: A new video coding standard developed by ITU-TVCEG after H.264. H.265 is mainly based on the existing video coding standard H.264. In addition to retaining some of the original technologies, it adds technologies that can improve the relationship between bit rate, encoding quality, delay and algorithm complexity. H.265 aims to transmit higher quality network video under limited bandwidth, and only half the bandwidth of H.264 is needed to play the same quality video.

[0081] API: Application Programming Interface (API), also known as application programming interface, is the agreement for connecting different components of a software system.

[0082] HTTP: HyperText Transfer Protocol (HTTP) is a simple request-response protocol that usually runs on top of TCP.

[0083] WebSocket: WebSocket is a protocol for full-duplex communication over a single TCP connection. The WebSocket communication protocol was standardized by IETF as RFC 6455 in 2011 and supplemented by RFC7936. The WebSocket API was also standardized by W3C.

[0084] The present invention is not limited to the above-mentioned embodiments. Any changes in shape or structure are within the protection scope of the present invention. The protection scope of the present invention is defined by the attached claims. Those skilled in the art can make various changes or modifications to these embodiments without departing from the principle and essence of the present invention, but these changes and modifications are within the protection scope of the present invention.< / video> < / canvas> < / video> < / canvas> < / video> < / canvas> < / video> < / canvas> < / video> < / canvas> < / video>

Claims

1. A system for high-quality web live streaming, the system (1) comprising a video acquisition module (2); characterized in that: Also includes: A video encoding module (3), wherein the video encoding module (3) uses H.264+ encoding, and the video encoding module (3) is connected to the video acquisition module (2) to encode the video acquired by the video acquisition module (2); A video streaming module (4), the front end (6) is connected to a back end streaming media server (7) via the video streaming module (4); A content distribution network (5), wherein the back-end streaming media server (7) is connected to the content distribution network (5), wherein the back-end streaming media server (7) distributes the processed video stream to the content distribution network (5), and the content distribution network (5) selects an optimal node for video transmission according to the geographical location of the user terminal (14); A video playing module (8), the video playing module (8) is connected to the front end (6) to play the video; An interactive function module (9), wherein the interactive function module (9) integrates WebSocket.

2. The system for high-quality web live streaming as claimed in claim 1, characterized in that: The video acquisition module (2) is implemented by HTML5 <video>and <canvas> Elements for video capture.< / canvas> < / video> 3. The system for high-quality web live streaming as claimed in claim 1, characterized in that: The video encoding module (3) uses an open source library to perform video encoding.

4. The system for high-quality web live streaming as claimed in claim 1, characterized in that: It also includes a real-time transmission module (10), wherein the real-time transmission module (10) integrates WebRTC and is configured with a TURN server and a STUN server.

5. The system for high-quality web live streaming as claimed in claim 4, characterized in that: The real-time transmission module (10) uses the SRTP protocol to encrypt data.

6. The system for high-quality web live streaming as claimed in claim 1, characterized in that: The system also includes an automated operation and maintenance module (11), wherein the automated operation and maintenance module (11) deploys a Prometheus tool for system monitoring; the automated operation and maintenance module (11) is also configured with a Grafana dashboard for data visualization and alarm.

7. The system for high-quality web live streaming as claimed in claim 1, characterized in that: The invention also comprises a real-time data analysis module (12), wherein the real-time data analysis module (12) integrates an Apache Kafka tool to construct a data stream pipeline; the real-time data analysis module (12) has an Apache Spark tool to perform data processing and analysis.

8. The system for high-quality web live streaming as claimed in claim 7, characterized in that: The real-time data analysis module (12) has data retrieval and visualization tools.

9. The system for high-quality web live streaming as claimed in claim 1, characterized in that: The content distribution network (5) is connected to a geographic location automatic reporting module (13).

10. The system for high-quality web live streaming as claimed in claim 1, characterized in that: The interactive function module (9) comprises a real-time chat submodule (901) and a gift reward submodule (902).

Images