Fast stream pulling method and system for high-concurrency streaming media data

Abstract

The invention provides a fast stream pulling method and system for high-concurrency streaming media data. The method comprises the steps that S1, video streaming equipment sends traffic to a three-layer switch through an elastic IP; s2, receiving the flow by the three-layer switch, and distributing the flow to each physical server of a streaming media pool according to a rule on the hardware level of the switch; and S3, converging a plurality of physical ports into a logic port by the streaming media pool in the cluster through a link aggregation technology, distributing the received flow to each copy of cluster service according to a rule, and carrying out load sharing in the streaming media pool to realize load balancing. According to the method, technologies such as the elastic IP, the high-availability cluster, the link aggregation, the load balancing and the cloud native are comprehensively applied, and a comprehensive streaming media data processing solution is formed, so that rapid stream pulling of the high-concurrency streaming media data is realized.

Description

Technical Field

[0001] The present invention relates to the technical field of streaming media transmission, and in particular to a method and system for quickly pulling high-concurrency streaming media data based on streaming media pool technology. Background Art

[0002] Streaming media refers to media formats that use streaming transmission technology to play continuously and in real time on the Internet, such as audio, video or multimedia files. Streaming media technology is also called streaming media technology. The so-called streaming media technology is a network transmission technology that compresses continuous image and sound information and puts it on the website server. The video server transmits each compressed package to the user's computer sequentially or in real time, allowing users to watch and listen while downloading, without having to wait for the entire compressed file to be downloaded to their computer before watching.

[0003] With the continuous development of cloud computing and big data technology, the demand for streaming media data processing is growing. There are already some streaming media processing solutions on the market, but they often face stability and efficiency challenges under high concurrency and large traffic. Streaming media pool technology generally refers to a technical solution that integrates multiple streaming media resources for unified management and distribution. This technology can improve the transmission efficiency of streaming media content, reduce costs, and enhance user experience. However, the development of current streaming media pool technology is still in its early stages and has the following disadvantages: The streaming media processing solution still relies on a single load balancer for traffic distribution. When processing high concurrency and large traffic, the single-point load balancer may become a performance bottleneck. Once the load balancer fails, the entire service may be interrupted. It is difficult to achieve seamless switching of services when the server fails, and there is a lack of effective disaster recovery mechanism to ensure the continuous availability of services. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a method and system for quickly pulling high-concurrency streaming media data to adapt to the transmission scenario of high-concurrency and large-flow streaming media data.

[0005] In a first aspect, the present invention provides a method for quickly pulling streams of high-concurrency data based on a streaming media pool technology, comprising: S1, the video streaming device sends traffic to the Layer 3 switch through the elastic IP; The elastic IP is virtually set up through a private cloud service and serves as the only traffic entrance to the streaming pool; The streaming media pool is a cluster consisting of multiple physical servers; S2, the three-layer switch receives the traffic and distributes the traffic to each physical server in the streaming media pool according to the rules at the switch hardware level; S3, the streaming media pool inside the cluster, aggregates multiple physical ports into logical ports through link aggregation technology, distributes the received traffic to each copy of the cluster service according to the rules, and performs load sharing within the streaming media pool to achieve load balancing.

[0006] In a second aspect, the present invention provides a high-concurrency data fast streaming system based on streaming media pool technology, comprising a video streaming device, a three-layer switch and a streaming media pool; the elastic IP is virtually set through a private cloud service and serves as the only traffic entrance of the streaming media pool; the streaming media pool is a cluster composed of multiple physical servers; The video streaming device sends traffic to the layer 3 switch via an elastic IP; The three-layer switch receives the traffic and distributes the traffic to each of the physical servers in the streaming media pool according to the rules at the switch hardware level; The streaming media pool inside the cluster aggregates multiple physical ports into logical ports through link aggregation technology, distributes the received traffic to each copy of the cluster service according to the rules, and performs load sharing within the streaming media pool to achieve load balancing.

[0007] The fast streaming method of the present invention is based on the streaming media pool technology, which combines advanced technologies such as private cloud services, elastic IP, high-availability clusters, link aggregation, load balancing and cloud native to form a comprehensive solution. Therefore, it has at least the following technical effects or advantages: 1. Use elastic IP as the only traffic entrance for cluster services to ensure that all external traffic interacts through elastic IP, which can efficiently manage and distribute large-scale traffic; implement traffic sharing at the switch hardware level, improve the elasticity of link transmission through link aggregation technology, and distribute the traffic received by elastic IP to the 10G optical port of each physical server according to rules; combine elastic IP with traffic sharing to adapt to the transmission scenarios of high-concurrency and high-traffic streaming media data.

[0008] 2. Load balancing technology is used within the cluster. Through link aggregation technology, the streaming media pool can aggregate multiple physical ports into one logical port to achieve load balancing of inbound / outbound traffic throughput, which not only increases the bandwidth of the link, but also improves the elasticity of link transmission, allowing the network to handle large amounts of data traffic more efficiently and ensure fast streaming within the cluster.

[0009] 3. Through high-availability cluster technology, when the services of M servers are interrupted, they can automatically jump to N disaster recovery nodes to ensure that the streaming service is not interrupted, making the transmission of streaming media data more efficient, stable and secure.

[0010] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The present invention will be further described below in conjunction with embodiments with reference to the accompanying drawings.

[0012] Figure 1 It is a schematic diagram of the framework of the system of the present invention; Figure 2 This is a flow chart of the method in Embodiment 1 of the present invention. DETAILED DESCRIPTION

[0013] The embodiments of the present application provide a method and system for quickly pulling high-concurrency streaming media data to adapt to the transmission scenario of high-concurrency and high-flow streaming media data.

[0014] The technical solution in the embodiment of the present application has the following general idea: the elastic IP, high-availability cluster, link aggregation, load balancing and cloud native technologies are used in a comprehensive manner to form a comprehensive streaming media data processing solution. Specifically, the elastic IP is virtually set through the private cloud service, and the elastic IP is used as the only traffic entrance of the cluster service to ensure that all external traffic is interacted through the elastic IP, so that large-scale traffic can be efficiently managed and distributed; traffic sharing is realized at the switch hardware level, and the traffic received by the elastic IP is distributed to the 10 Gigabit optical port of each physical server according to the rules; the combination of elastic IP and traffic sharing is applied to adapt to the transmission scenario of high concurrency and large-volume streaming media data. After the traffic reaches the cluster of the streaming media pool, load balancing technology is used to aggregate multiple physical ports into one logical port through link aggregation technology, which not only increases the bandwidth of the link, but also improves the elasticity of link transmission, realizes load balancing of outbound / inbound traffic throughput, enables the network to process a large amount of data traffic more efficiently, and ensures that the cluster can quickly pull the stream. Through the automatic jump and disaster recovery mechanism of the high-availability cluster technology, the pull stream service is ensured to be uninterrupted, making the transmission of streaming media data more efficient, stable and secure.

[0015] Before introducing the specific embodiments, the system framework corresponding to the method of the embodiment of the present application is first introduced. Figure 1 As shown, the system is roughly divided into three parts: Video streaming equipment, including front-end points, networking platforms and networking equipment, accessing the streaming media pool through elastic IP; Layer 3 switch, used to forward traffic from video streaming devices to the streaming pool; The streaming pool is a cluster consisting of multiple physical servers, which load shares the received traffic within the streaming pool to achieve load balancing. Embodiment 1

[0016] like Figure 2 As shown, this embodiment provides a method for quickly pulling high-concurrency streaming media data, including: S1, the video streaming device accesses the streaming pool through the elastic IP and sends traffic to the Layer 3 switch; The elastic IP is virtually set up through a private cloud service and serves as the only traffic entrance to the streaming pool; The streaming media pool is a cluster consisting of multiple physical servers; S2, the three-layer switch receives the traffic of the video streaming device, and distributes the traffic to each physical server of the streaming media pool according to the rules at the switch hardware level; S3, the streaming media pool inside the cluster, aggregates multiple physical ports into logical ports through link aggregation technology, distributes the received traffic to each copy of the cluster service according to the rules, and performs load sharing within the streaming media pool to achieve load balancing.

[0017] The multiple physical servers of the streaming media pool constitute an M+N mode high-availability cluster, where the M active nodes are nodes in the cluster that operate normally and process business requests, and the N backup nodes are nodes in a standby state, which do not process business requests under normal circumstances but are ready to take over the work of the active nodes at any time; In the process of fast streaming, when the service of any active node is interrupted, the traffic of the active node can automatically jump to the backup node without interrupting the service. Seamless switching in the event of server failure is achieved, ensuring the continuous availability of the service. The problem of traditional view retrieval being unable to be retrieved after the server service is interrupted is broken, and the video, picture and other data are always online and continuously streamed.

[0018] Among them, the video streaming device includes a front-end point, a networking platform and a networking device, and the networking device includes at least one of a bayonet gun camera, a snapshot gun camera, a pan-tilt camera and an NVR device. Embodiment 2

[0019] Based on the same inventive concept, the present application also provides a device corresponding to the method in Example 1, see Example 2 for details.

[0020] like Figure 1 As shown, in this embodiment, a fast streaming system for high-concurrency streaming media data is provided, including a video streaming device, a three-layer switch and a streaming media pool; the elastic IP is virtually set through a private cloud service and serves as the only traffic entrance of the streaming media pool; the streaming media pool is a cluster composed of multiple physical servers; The video streaming device accesses the streaming media pool through the elastic IP and sends traffic to the layer 3 switch; The three-layer switch receives the traffic of the video streaming device and distributes the traffic to each of the physical servers in the streaming media pool according to the rules at the switch hardware level; The streaming media pool inside the cluster aggregates multiple physical ports into logical ports through link aggregation technology, distributes the received traffic to each copy of the cluster service according to the rules, and performs load sharing within the streaming media pool to achieve load balancing.

[0021] The multiple physical servers of the streaming media pool constitute an M+N mode high-availability cluster, where the M active nodes are nodes in the cluster that operate normally and process business requests, and the N backup nodes are nodes in a standby state, which do not process business requests under normal circumstances but are ready to take over the work of the active nodes at any time; During the fast streaming process, when the service of any active node is interrupted, the traffic of the active node can automatically jump to the backup node without interrupting the service.

[0022] Among them, the video streaming device includes a front-end point, a networking platform and a networking device, and the networking device includes at least one of a bayonet gun camera, a snapshot gun camera, a pan-tilt camera and an NVR device.

[0023] Since the device introduced in the second embodiment of the present invention is a device used to implement the method of the first embodiment of the present invention, those skilled in the art can understand the specific structure and deformation of the device based on the method introduced in the first embodiment of the present invention, so it is not described here in detail. All devices used in the method of the first embodiment of the present invention belong to the scope of protection of the present invention.

[0024] Although the specific implementation modes of the present invention are described above, those skilled in the art should understand that the specific implementation modes described are only illustrative and are not intended to limit the scope of the present invention. Equivalent modifications and changes made by those skilled in the art in accordance with the spirit of the present invention should be included in the scope of protection of the claims of the present invention.

Claims

1. A fast streaming method for high-concurrency streaming media data, characterized in that: include: S1, the video streaming device sends traffic to the Layer 3 switch through the elastic IP; The elastic IP is virtually set up through a private cloud service and serves as the only traffic entrance to the streaming pool; The streaming media pool is a cluster consisting of multiple physical servers; S2, the three-layer switch receives the traffic and distributes the traffic to each physical server in the streaming media pool according to the rules at the switch hardware level; S3, the streaming media pool inside the cluster, aggregates multiple physical ports into logical ports through link aggregation technology, distributes the received traffic to each copy of the cluster service according to the rules, and performs load sharing within the streaming media pool to achieve load balancing.

2. According to claim 1, a fast streaming method for high-concurrency streaming media data is characterized in that: The multiple physical servers of the streaming media pool constitute an M+N mode high-availability cluster, where the M active nodes are nodes in the cluster that operate normally and process business requests, and the N backup nodes are nodes in a standby state, which do not process business requests under normal circumstances but are ready to take over the work of the active nodes at any time; During the fast streaming process, when the service of any active node is interrupted, the traffic of the active node can automatically jump to the backup node without interrupting the service.

3. According to claim 1, a fast streaming method for high-concurrency streaming media data is characterized in that: The video streaming device includes a front-end point, a networking platform and a networking device, and the networking device includes at least one of a bayonet gun camera, a snapshot gun camera, a pan-tilt camera and an NVR device.

4. A fast streaming system for high-concurrency streaming media data, characterized by: It includes a video streaming device, a three-layer switch and a streaming pool; the elastic IP is virtually set through a private cloud service and serves as the only traffic entrance of the streaming pool; the streaming pool is a cluster composed of multiple physical servers; The video streaming device sends traffic to the layer 3 switch via an elastic IP; The three-layer switch receives the traffic and distributes the traffic to each of the physical servers in the streaming media pool according to the rules at the switch hardware level; The streaming media pool inside the cluster aggregates multiple physical ports into logical ports through link aggregation technology, distributes the received traffic to each copy of the cluster service according to the rules, and performs load sharing within the streaming media pool to achieve load balancing.

5. According to claim 4, a fast streaming system for high-concurrency streaming media data is characterized in that: The multiple physical servers of the streaming media pool constitute an M+N mode high-availability cluster, where the M active nodes are nodes in the cluster that operate normally and process business requests, and the N backup nodes are nodes in a standby state, which do not process business requests under normal circumstances but are ready to take over the work of the active nodes at any time; During the fast streaming process, when the service of any active node is interrupted, the traffic of the active node can automatically jump to the backup node without interrupting the service.

6. A fast streaming system for high-concurrency streaming media data according to claim 4, characterized in that: The video streaming device includes a front-end point, a networking platform and a networking device, and the networking device includes at least one of a bayonet gun camera, a snapshot gun camera, a pan-tilt camera and an NVR device.

Images