Cross-level flow taking method, device, equipment and medium

Abstract

The invention relates to the technical field of media stream transmission, and discloses a cross-level stream taking method, device and equipment and a medium, which are applied to a dispatching center, and the dispatching center is in communication connection with a signaling server and a signaling client. According to the invention, the corresponding optimal subordinate response end can be determined according to the cross-level stream taking request of the superior request end, direct media stream transmission is established between the superior request end and the optimal subordinate response end, and the superior request end and the optimal subordinate response end can directly transmit the media stream through the media stream transmission channel. And the media stream does not need to be transmitted through a signaling server, a dispatching center and a signaling client, so that the cross-level stream taking of the superior request end to the optimal subordinate response end is realized, the communication delay in the cross-level stream taking process is effectively reduced, and the network transmission efficiency is improved.

Description

Technical Field

[0001] This invention relates to the field of media streaming technology, and in particular to a cross-level streaming method, apparatus, device, and medium. Background Technology

[0002] With the deepening of smart city construction and engineering projects, video surveillance systems have evolved from traditional localized, isolated applications into massive Internet of Things (IoT) networks covering the entire country and interconnected across the entire network. The massive number of cameras connected to the network generates video data not only for real-time monitoring and video playback, but also as a core data source for artificial intelligence analysis, big data assessment, and refined urban management.

[0003] As a general standard for video surveillance, the GB / T 28181 protocol has become the "common language" in the domestic video surveillance field. It specifies the signaling interaction and media transmission protocols between devices and platforms within a networked system, ensuring that different systems can work together in complex network environments and solving the problem of interconnection and interoperability between devices and platforms from different manufacturers.

[0004] However, in the standard GB / T 28181 protocol, the transmission path of the media stream strictly follows the signaling negotiation path. The transmission of the media stream needs to pass through each platform node, and each platform node is equivalent to a media stream relay station, which may result in high communication latency and low network transmission efficiency. Summary of the Invention

[0005] This invention provides a cross-level streaming method, apparatus, device, and medium to address the shortcomings of high media stream transmission latency and low network transmission efficiency in related technologies. It enables the upper-level requesting end to access the optimal lower-level responding end across levels, effectively reducing communication latency and improving network transmission efficiency.

[0006] In a first aspect, the present invention provides a cross-level flow extraction method, wherein the scheduling center communicates with a signaling server and a signaling client; the method includes: The cross-level stream retrieval request sent by the upper-level requesting end through the signaling server is parsed to obtain the source device code and the receiving address of the upper-level requesting end; Based on the source device code, a plurality of lower-level response terminals corresponding to the source device code are determined; Based on the network quality data between the scheduling center and each of the lower-level response terminals, the optimal lower-level response terminal is determined. The signaling client sends the receiving address to the optimal lower-level response terminal, so that the optimal lower-level response terminal returns the sending address of the optimal lower-level response terminal to the scheduling center. The signaling server returns the streaming address to the upper-level requesting end, so that the upper-level requesting end can obtain the media stream sent by the optimal lower-level responding end based on the streaming address.

[0007] Optionally, the upper-level requesting end includes an upper-level signaling client and an upper-level media stream receiving end, and the receiving address of the upper-level requesting end is the network address of the upper-level media stream receiving end; The lower-level response end includes a lower-level signaling server and a lower-level media stream sender. The stream sending address of the optimal lower-level response end is the network address of the lower-level media stream sender in the optimal lower-level response end.

[0008] Optionally, the step of parsing the cross-level streaming request sent by the upper-level requesting end through the signaling server to obtain the source device code and the receiving address of the upper-level requesting end includes: The cross-level stream retrieval request sent by the superior signaling client through the signaling server is parsed to obtain the source device code and the network address of the superior media stream receiver; The step of determining multiple lower-level response endpoints corresponding to the source device code based on the source device code includes: Based on the source device encoding, search for multiple media stream node identifiers corresponding to the source device encoding in the created global media resource information database; Each media stream node identifier is uniquely associated with a corresponding lower-level media stream sender. For any given lower-level media stream sender, determine the lower-level signaling server corresponding to the lower-level media stream sender, and use the lower-level media stream sender and the corresponding lower-level signaling server as the lower-level response server corresponding to the source device code.

[0009] Optionally, determining the optimal lower-level response terminal based on the network quality data between the scheduling center and each of the lower-level response terminals includes: Detect the network quality data between the scheduling center and each of the lower-level media stream senders; Determine the optimal network quality data from each of the aforementioned network quality data; The lower-level media stream sender corresponding to the optimal network quality data is determined as the optimal lower-level media stream sender; The optimal lower-level media stream sender and the corresponding lower-level signaling server are designated as the optimal lower-level response end.

[0010] Optionally, the step of sending the receiving address to the optimal lower-level response terminal via the signaling client, so that the optimal lower-level response terminal returns the sending address of the optimal lower-level response terminal to the scheduling center, includes: The signaling client sends the network address of the upper-level media stream receiver to the lower-level signaling server in the optimal lower-level response terminal, so that the lower-level signaling server in the optimal lower-level response terminal returns the network address of the optimal lower-level media stream sender to the scheduling center.

[0011] Optionally, the step of returning the streaming address to the upstream requesting end through the signaling server, so that the upstream requesting end can obtain the media stream sent by the optimal downstream responding end based on the streaming address, includes: The signaling server and the upper-level signaling client return the network address of the optimal lower-level media stream sender to the upper-level media stream receiver, so that the upper-level media stream receiver can: construct a media stream transmission channel with the optimal lower-level media stream sender based on the network address of the optimal lower-level media stream sender, and obtain the media stream sent by the optimal lower-level media stream sender through the media stream transmission channel.

[0012] Optionally, the network quality data may include at least one of latency, bandwidth, packet loss rate, throughput, jitter, and reliability.

[0013] Secondly, the present invention provides a cross-level flow extraction device applied in a scheduling center, wherein the scheduling center is communicatively connected to a signaling server and a signaling client; the device includes: The parsing unit is used to parse the cross-level stream retrieval request sent by the upper-level requesting end through the signaling server, and obtain the source device code and the receiving address of the upper-level requesting end; The first determining unit is configured to determine multiple lower-level response terminals corresponding to the source device code based on the source device code; The second determining unit is used to determine the optimal lower-level response terminal based on the network quality data between the scheduling center and each of the lower-level response terminals. The sending unit is used to send the receiving address to the optimal lower-level response terminal through the signaling client, so that the optimal lower-level response terminal returns the sending address of the optimal lower-level response terminal to the scheduling center; The return unit is used to return the streaming address to the upper-level requesting end through the signaling server, so that the upper-level requesting end can obtain the media stream sent by the optimal lower-level responding end according to the streaming address.

[0014] Thirdly, the present invention provides a computer device, comprising: a memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the computer instructions to perform the cross-level flow fetching method of the first aspect or any corresponding embodiment described above.

[0015] Fourthly, the present invention provides a computer-readable storage medium storing computer instructions for causing a computer to perform the cross-level flow fetching method of the first aspect or any corresponding embodiment thereof.

[0016] The cross-level streaming method, apparatus, device, and medium provided by this invention can be applied to a dispatch center, which communicates with a signaling server and a signaling client. The dispatch center parses the cross-level streaming request sent by the superior requesting end through the signaling server, obtaining the source device code and the superior requesting end's receiving address. Based on the source device code, multiple subordinate responding ends corresponding to the source device code are determined. The optimal subordinate responding end is determined based on the network quality data between the dispatch center and each subordinate responding end. The receiving address is sent to the optimal subordinate responding end through the signaling client, causing the optimal subordinate responding end to return its sending address to the dispatch center. The sending address is returned to the superior requesting end through the signaling server, enabling the superior requesting end to obtain the media stream sent by the optimal subordinate responding end based on the sending address. This invention can determine the corresponding optimal lower-level responder based on the cross-level streaming request from the upper-level requester, and establish a direct media stream transmission channel between the upper-level requester and the optimal lower-level responder. The upper-level requester and the optimal lower-level responder can directly transmit the media stream through the media stream transmission channel without going through the signaling server, scheduling center and signaling client to transmit the media stream. This enables the upper-level requester to retrieve the media stream from the optimal lower-level responder, effectively reducing communication latency and improving network transmission efficiency during the cross-level streaming process. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in this invention or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 A flowchart of the first cross-level flow extraction method provided in the embodiments of the present invention; Figure 2 A flowchart of the second cross-level flow extraction method provided in this embodiment of the invention; Figure 3 A flowchart of the third cross-level flow extraction method provided in the embodiments of the present invention; Figure 4 A flowchart of the fourth cross-level flow extraction method provided in the embodiments of the present invention; Figure 5 This is a schematic diagram of the structure of a cross-stage current-taking device provided in an embodiment of the present invention; Figure 6This is a schematic diagram of the structure of a computer device provided in an embodiment of the present invention. Detailed Implementation

[0019] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0020] The following is combined Figures 1-4 The present invention describes the cross-level flow extraction method.

[0021] like Figure 1 As shown, this embodiment proposes a first cross-level flow retrieval method, applied to a scheduling center, where the scheduling center communicates with the signaling server and the signaling client. This method may include the following steps: S101. Parse the cross-level stream retrieval request sent by the upper-level requesting end through the signaling server to obtain the source device code and the receiving address of the upper-level requesting end.

[0022] Specifically, the upstream requesting end sends a cross-level flow retrieval request to the scheduling center through the signaling server. The scheduling center parses the cross-level flow retrieval request to obtain the source device code and the receiving address of the upstream requesting end carried in the cross-level flow retrieval request.

[0023] S102. Based on the source device code, determine multiple lower-level response terminals corresponding to the source device code.

[0024] Specifically, the dispatch center can pre-create a global media resource information database, which records the lower-level response endpoints corresponding to different source devices. The dispatch center can then search for the corresponding lower-level response endpoint in the global media resource information database based on the source device code in the cross-level streaming request.

[0025] S103. Determine the optimal lower-level response terminal based on the network quality data between the dispatch center and each lower-level response terminal.

[0026] Among them, network quality data can be used to evaluate the signaling transmission quality between the dispatch center and the lower-level response terminals.

[0027] Optionally, network quality data may include at least one of latency, bandwidth, packet loss rate, throughput, jitter, and reliability.

[0028] Specifically, the dispatch center can first detect the network quality data between itself and each lower-level response terminal, and then determine the optimal network quality data among the detected network quality data, and determine the lower-level response terminal corresponding to the optimal network quality data as the optimal lower-level response terminal.

[0029] S104. Send the receiving address to the optimal lower-level responder through the signaling client, so that the optimal lower-level responder returns the sending address of the optimal lower-level responder to the scheduling center.

[0030] Specifically, the dispatch center can send the receiving address of the superior requesting end to the optimal subordinate responding end through the signaling client, so that the optimal subordinate responding end can return the sending address of the optimal subordinate responding end to the dispatch center.

[0031] S105. The signaling server returns the streaming address to the superior requesting end so that the superior requesting end can obtain the media stream sent by the optimal subordinate response end based on the streaming address.

[0032] The dispatch center can return the sending address of the optimal lower-level responder to the upper-level requesting end through the signaling service terminal, so that the upper-level requesting end can establish a media stream transmission channel with the optimal lower-level responder based on the sending address. The optimal lower-level responder can confirm the establishment of the media stream transmission channel based on the receiving address of the upper-level requesting end.

[0033] Specifically, after the upper-level requesting end and the optimal lower-level responding end establish a media stream transmission channel, they can directly transmit the media stream through the media stream transmission channel. The upper-level requesting end can directly obtain the media stream sent by the optimal lower-level responding end through the media stream transmission channel, without having to go through the signaling server, scheduling center, and signaling client to transmit the media stream.

[0034] The cross-level streaming method proposed in this embodiment is applied to a scheduling center, which communicates with a signaling server and a signaling client. The scheduling center parses the cross-level streaming request sent by the upper-level requesting end through the signaling server, obtaining the source device code and the receiving address of the upper-level requesting end. Based on the source device code, multiple lower-level responding ends corresponding to the source device code are determined. The optimal lower-level responding end is determined based on the network quality data between the scheduling center and each lower-level responding end. The receiving address is sent to the optimal lower-level responding end through the signaling client, causing the optimal lower-level responding end to return its sending address to the scheduling center. The sending address is returned to the upper-level requesting end through the signaling server, enabling the upper-level requesting end to obtain the media stream sent by the optimal lower-level responding end based on the sending address. This embodiment can determine the corresponding optimal lower-level responder based on the cross-level streaming request from the upper-level requester, and establish a direct media stream transmission channel between the upper-level requester and the optimal lower-level responder. The upper-level requester and the optimal lower-level responder can directly transmit the media stream through the media stream transmission channel without going through the signaling server, scheduling center and signaling client to transmit the media stream. This realizes cross-level streaming from the upper-level requester to the optimal lower-level responder, effectively reducing communication latency and improving network transmission efficiency during the cross-level streaming process.

[0035] based on Figure 1 This embodiment proposes a second cross-level streaming method. In this method, the upper-level requesting end includes an upper-level signaling client and an upper-level media stream receiver, and the receiving address of the upper-level requesting end is the network address of the upper-level media stream receiver. The lower-level responding end includes a lower-level signaling server and a lower-level media stream sender, and the sending address of the optimal lower-level responding end is the network address of the lower-level media stream sender in the optimal lower-level responding end.

[0036] At this time, step S101 includes: Parse the cross-level streaming request sent by the superior signaling client through the signaling server to obtain the source device code and the network address of the superior media stream receiver.

[0037] Specifically, the superior signaling client can send a cross-level streaming request to the dispatch center through the signaling server. The dispatch center parses the cross-level streaming request to obtain the source device code and the network address of the superior media stream receiver carried in the request.

[0038] Step S102 includes: Based on the source device encoding, search for multiple media stream node identifiers corresponding to the source device encoding in the created global media resource information database; Each media stream node identifier is uniquely assigned to a corresponding lower-level media stream sender. For any given lower-level media stream sender, determine the corresponding lower-level signaling server and use the lower-level media stream sender and the corresponding lower-level signaling server as the lower-level response server corresponding to the source device code.

[0039] Among them, the media stream node identifier is the device identifier of the lower-level media stream sender, which is used to uniquely identify the lower-level media stream sender.

[0040] Specifically, each lower-level media stream sender has a unique corresponding lower-level signaling server.

[0041] Optionally, step S103 includes: The network quality data between the monitoring and dispatch center and each lower-level media stream sender is monitored. Determine the optimal network quality data within each set of network quality data; The downstream media stream sender corresponding to the optimal network quality data is determined as the optimal downstream media stream sender; The optimal lower-level media stream sender and the corresponding lower-level signaling server are designated as the optimal lower-level response end.

[0042] Optionally, step S104 includes: The signaling client sends the network address of the upper-level media stream receiver to the lower-level signaling server in the optimal lower-level response terminal, so that the lower-level signaling server in the optimal lower-level response terminal returns the network address of the optimal lower-level media stream sender to the scheduling center.

[0043] Specifically, the dispatch center can use a signaling client to send the network address of the upper-level media stream receiver to the lower-level signaling server in the optimal lower-level response terminal, so that the lower-level signaling server can obtain the network address of the optimal lower-level media stream sender and return it to the dispatch center.

[0044] Optionally, step S105 includes: The signaling server and the superior signaling client return the network address of the optimal subordinate media stream sender to the superior media stream receiver, so that the superior media stream receiver can: construct a media stream transmission channel with the optimal subordinate media stream sender based on the network address of the optimal subordinate media stream sender, and obtain the media stream sent by the optimal subordinate media stream sender through the media stream transmission channel.

[0045] Specifically, the dispatch center can sequentially return the network address of the optimal lower-level media stream sender to the upper-level media stream receiver via the signaling server and the upper-level signaling client. The upper-level media stream receiver can then request to establish a media stream transmission channel with the optimal lower-level media stream sender based on the latter's network address. This request carries the network address of the upper-level media stream receiver. The optimal lower-level media stream receiver can verify whether the received network address matches the one carried in the request. If they match, the request to establish a media stream transmission channel is approved; otherwise, it is rejected.

[0046] Specifically, after the upper-level media stream receiver establishes a media stream transmission channel with the optimal lower-level media stream sender, the upper-level media stream receiver can directly obtain the media stream sent by the optimal lower-level media stream sender through this media stream transmission channel.

[0047] The cross-level streaming method proposed in this embodiment allows the upper-level media stream receiver to establish a media stream transmission channel with the optimal lower-level media stream sender through an upper-level signaling client, signaling server, scheduling center, and lower-level signaling server. The upper-level media stream receiver can directly transmit media streams with the optimal lower-level media stream sender through this media stream transmission channel. The upper-level media stream receiver does not need to go through an upper-level signaling client, signaling server, scheduling center, and lower-level signaling server to transmit media streams with the optimal lower-level media stream sender. This enables the upper-level media stream receiver to obtain media streams from the optimal lower-level responder, effectively reducing communication latency and improving network transmission efficiency during the cross-level streaming process.

[0048] The GB / T 28181 standard protocol suffers from a rigid path problem, where signaling and media streams are coupled. The transmission path of the media stream strictly follows the signaling negotiation path. This rigid cascading forwarding mode forces the media stream to pass through all intermediate platform nodes. Each platform level acts as a media stream relay station, introducing not only additional processing latency but also making the end-to-end transmission path lengthy.

[0049] Secondly, the related technologies also suffer from low network transmission efficiency and resource waste. Long transmission paths mean that data packets need to traverse more network hops, and each additional hop increases the risk of network jitter and packet loss. Simultaneously, the same video data is repeatedly transmitted on uplink and downlink between different platforms, consuming a significant amount of valuable cross-domain and cross-carrier core network bandwidth, resulting in a huge waste of network resources.

[0050] Furthermore, the related technologies also suffer from high latency and high packet loss risks. Latency primarily stems from processing latency (the time each platform takes to parse and encapsulate the media stream) and network transmission latency (the time it takes for data packets to travel long distances over physical links). Packet loss risks manifest as follows: any network congestion or processing performance bottleneck at any platform level becomes a single point of failure, leading to data loss across all subsequent links, resulting in video stuttering and display issues. For monitoring applications with extremely high real-time requirements, such as emergency command and real-time tracking, end-to-end high latency is unacceptable.

[0051] The cross-level streaming solutions of related technologies, due to their rigid architecture of coupling signaling and media streams, result in large transmission delays, low network efficiency, and high risk of data loss, making it difficult to meet the urgent needs of modern large-scale video surveillance networking applications for real-time performance and network efficiency.

[0052] like Figure 2 As shown, in the third cross-level flow retrieval method proposed in this embodiment, the scheduling center can be a Media Routing and Scheduling Center (MRSC). The MRSC includes a Resource Management Module (RMM), a Network Probing Module (NPM), a Routing Decision Module (RDM), and a Stream Control Module (SCM).

[0053] There can be multiple signaling servers (SS) and signaling clients (SC). Specifically, the SS is mainly responsible for receiving and processing Session Initiation Protocol (SIP) signaling requests sent by the superior signaling client. The SC is mainly responsible for sending SIP signaling requests to the subordinate signaling servers. The MRSC is mainly responsible for the management of media resources, network awareness, routing decisions, and flow control within the video system. It communicates and cooperates with the SS and SC, but independently handles the media stream transmission path.

[0054] Specifically, the upper-level signaling client can determine the corresponding SS (Streaming Service) and send a cross-level stream retrieval request to the MRSC (Media Streaming Center). The MRSC, based on this request, determines the optimal lower-level media stream sender, the lower-level signaling server, and the SC. Then, the MRSC sends the network address of the upper-level media stream receiver to the optimal lower-level media stream sender through the SC and the lower-level signaling server. The lower-level signaling server then sends the network address of the optimal lower-level media stream sender to the upper-level media stream receiver through the SC, MRSC, SS, and the upper-level signaling client. The upper-level media stream receiver and the optimal lower-level media stream sender establish a media stream transmission channel and directly transmit the media stream through this channel.

[0055] The upper-level signaling client, SS, MRSC, SC and the lower-level signaling server interact via SIP signaling.

[0056] Specifically, in MRSC, RMM establishes and maintains a global media resource information database, recording the real media stream access addresses (IP, port, etc.) of all network-reachable source devices and their respective platforms. This database can be dynamically updated, recording the real-time accessible addresses of all available video sources within the video system. NPM actively or passively probes and collects real-time network quality data between nodes (platforms at all levels, source devices) within the video system, including latency, bandwidth, packet loss rate, and jitter, forming a dynamic "network quality map." RDM is the intelligent core of MRSC. When a streaming request is received, this module queries the resource database for the source address and platform address of the source device based on its encoding. Combining this with the network quality map and based on preset strategies (lowest latency, maximum bandwidth, load balancing), it calculates the optimal transmission path from the upstream client to the optimal media source node using a dynamic decision-making algorithm. Based on the decision results of RDM, SCM is responsible for constructing the Session Description Protocol (SDP) content for the INVITE signaling request to the lower-level server for use by SC and the SDP content for the 200 OK signaling response to the upper-level client for use by SS, thereby enabling the function of modifying the media stream transmission channel.

[0057] like Figure 3 As shown, the working principle of MRSC begins with its continuous preparation. Before operation, RMM needs to collect and maintain information from all source devices and their platforms within the video system. Simultaneously, NPM proactively and continuously probes the communication quality between nodes in the network, measuring key indicators such as latency, bandwidth, and packet loss rate, thereby constructing and updating a dynamic network quality topology map in real time. This preparatory phase ensures that MRSC always possesses the latest resource media source node information and network status map, laying a solid data foundation for intelligent decision-making.

[0058] When a video request arrives, the MRSC enters the proactive response phase. After receiving an INVITE request from the superior signaling client, the SS consults the MRSC regarding media stream processing strategies. The MRSC then parses the request, and the RMM accurately queries a list of accessible nodes for a media stream from the target video source based on the source device encoding. This list is then sent to the RDM module for decision-making. Upon receiving the list of accessible nodes for the target video source, the RDM requests network data for the node list from the NPM, runs its built-in optimization algorithm, and calculates the optimal path among all possible media stream paths for the target video source under preset strategies (lowest latency, maximum bandwidth, load balancing). This selects the optimal media source node and sends it to the SCM. Based on the RDM's decision, the SCM sends an INVITE request to the signaling server of the optimal media stream node. The receiving address in the INVITE request body remains the same as the receiving address in the superior signaling client's INVITE request, and the sending address from the subordinate signaling server's 200 OK response is written into the response body sent to the superior signaling client. Finally, the upper-level media stream receiver will establish a media stream connection with the optimal lower-level media stream sender based on the network address of the optimal lower-level media stream sender in the 200 OK response, thereby forming a highly efficient data transmission channel that is completely independent of the traditional signaling layer path.

[0059] like Figure 4 As shown, the workflow of the entire national standard video surveillance cross-level streaming system is as follows: Figure 3 As shown, the specific steps include: When the system receives an INVITE request, the SS parses the request, obtains the device code, and sends it to the RMM. The RMM queries the list of accessible nodes for the device's media stream based on the device code and sends it to the RDM. The RDM queries the NPM for network data based on the accessible media stream list. The RDM determines the optimal media source node based on the network data and sends it to the SCM. The SCM constructs the requested SDP content based on the optimal media source node and sends it to the SC. The SC sends an INVITE request to its subordinate based on the requested SDP content. The SC receives a 200 OK response from its subordinate and sends it to the SCM. The SCM constructs a response SDP based on the 200 OK response from its subordinate and sends it to the SS. The SS sends a 200 OK response to its superior.

[0060] This embodiment aims to address the problems of high image latency, low network bandwidth utilization efficiency, poor data transmission reliability, and high risk of media stream loss in cross-level video surveillance networking systems due to the inherent mechanism of strong coupling between signaling and media stream transmission paths. This embodiment overcomes the systemic defects of high latency, low network efficiency, and poor transmission reliability caused by the strong binding of signaling and media stream in the GB / T 28181 protocol, providing a high-efficiency, low-latency, and highly reliable cross-level video stream transmission solution without compromising protocol compatibility.

[0061] The technical effects that can be achieved by this embodiment include: (1) Significantly reduces cross-level streaming latency and improves real-time performance: This embodiment separates the media stream from the signaling path, bypassing unnecessary cascading forwarding nodes, enabling the media stream to be transmitted along the shortest possible path. This significantly reduces the processing latency and network transmission latency caused by forwarding at each platform level, resulting in a significant reduction in end-to-end video latency and greatly improving the real-time performance of video surveillance, providing reliable technical support for critical services such as emergency command and real-time analysis.

[0062] (2) Significantly improves network bandwidth utilization efficiency and saves costs: This embodiment avoids the repeated transmission of the same video data on transmission links at various levels of platforms. Through "nearest stream retrieval" and intelligent routing, the video stream no longer needs to be uploaded and received layer by layer, greatly reducing the bandwidth pressure on the core backbone network. This not only optimizes the network traffic structure, but also saves operators a lot of cross-domain and cross-carrier bandwidth leasing costs, which has direct economic benefits.

[0063] (3) Effectively reduce the risk of data loss and enhance transmission reliability: In the cascading forwarding mode of related technologies, network congestion or failure at any level of the platform will lead to the loss of data in all subsequent links. This embodiment shortens the media stream transmission path through intelligent optimization strategies, thereby effectively avoiding single points of failure, greatly improving the stability and reliability of video transmission, and reducing the risk of loss of critical video data.

[0064] (4) Improve overall system scalability and load capacity: Platforms at all levels of related technologies need to handle signaling and high-throughput media streams simultaneously, resulting in significant performance bottlenecks. This embodiment removes the processing pressure of massive media streams from the core signaling platform and assigns it to a dedicated, distributed media routing and scheduling center. This allows the signaling platform to focus more on connection management and service control, easily supporting larger-scale device access and concurrent access, thus significantly improving the overall system scalability.

[0065] (5) Maintaining full protocol compatibility and easy deployment: A key advantage of this embodiment is its respect for existing standards. All optimizations are completed under the premise of full compatibility with the national standard 28181 signaling standard. Signaling interaction fully complies with the national standard without modification, ensuring 100% compatibility with countless existing devices and platforms. All optimizations are completed only at the media stream level. For countless existing front-end devices, platforms and clients, no protocol-level modifications or upgrades are required to integrate into the new system, protecting users' existing investments and enabling the solution to be smoothly deployed, with strong practicality and operability.

[0066] (6) Laying the foundation for intelligent video network management: The media routing and scheduling center in this embodiment aggregates media source node information and network quality data within the video system, effectively constructing a "media network brain". This provides a solid data foundation and control capabilities for realizing more intelligent functions in the future, such as global load balancing, intelligent traffic scheduling, network quality early warning and self-healing, and makes it possible for video surveillance networks to evolve from "connectivity" to "intelligence".

[0067] like Figure 5 As shown, this embodiment proposes a cross-level flow extraction device applied in a dispatch center, which communicates with a signaling server and a signaling client. The device includes: The parsing unit 501 is used to parse the cross-level stream retrieval request sent by the upper-level requesting end through the signaling server, and obtain the source device code and the receiving address of the upper-level requesting end; The first determining unit 502 is used to determine multiple lower-level response terminals corresponding to the source device code based on the source device code; The second determining unit 503 is used to determine the optimal lower-level response terminal based on the network quality data between the scheduling center and each lower-level response terminal. The sending unit 504 is used to send the receiving address to the optimal lower-level response end through the signaling client, so that the optimal lower-level response end returns the sending address of the optimal lower-level response end to the scheduling center; The return unit 505 is used to return the streaming address to the superior requesting end through the signaling server, so that the superior requesting end can obtain the media stream sent by the optimal subordinate responding end based on the streaming address.

[0068] It should be noted that the processing procedures of the parsing unit 501, the first determining unit 502, the second determining unit 503, the sending unit 504, and the return unit 505, and their beneficial effects, can be referred to respectively. Figure 1 Steps S101 to S105 are not described in detail here.

[0069] Optionally, the upper-level requesting end includes an upper-level signaling client and an upper-level media stream receiving end, and the receiving address of the upper-level requesting end is the network address of the upper-level media stream receiving end; The lower-level response end includes the lower-level signaling server end and the lower-level media stream sender end. The stream sending address of the optimal lower-level response end is the network address of the lower-level media stream sender end in the optimal lower-level response end.

[0070] Optionally, parsing unit 501 is also used for: Parse the cross-level streaming request sent by the superior signaling client through the signaling server to obtain the source device code and the network address of the superior media stream receiver; Optionally, the first determining unit 502 is also used for: Based on the source device encoding, search for multiple media stream node identifiers corresponding to the source device encoding in the created global media resource information database; Each media stream node identifier is uniquely assigned to a corresponding lower-level media stream sender. For any given lower-level media stream sender, determine the corresponding lower-level signaling server and use the lower-level media stream sender and the corresponding lower-level signaling server as the lower-level response server corresponding to the source device code.

[0071] Optionally, the second determining unit 503 is also used for: The network quality data between the monitoring and dispatch center and each lower-level media stream sender is monitored. Determine the optimal network quality data within each set of network quality data; The downstream media stream sender corresponding to the optimal network quality data is determined as the optimal downstream media stream sender; The optimal lower-level media stream sender and the corresponding lower-level signaling server are designated as the optimal lower-level response end.

[0072] Optionally, the transmitting unit 504 is also used for: The signaling client sends the network address of the upper-level media stream receiver to the lower-level signaling server in the optimal lower-level response terminal, so that the lower-level signaling server in the optimal lower-level response terminal returns the network address of the optimal lower-level media stream sender to the scheduling center.

[0073] Optionally, return unit 505 is also used for: The signaling server and the superior signaling client return the network address of the optimal subordinate media stream sender to the superior media stream receiver, so that the superior media stream receiver can: construct a media stream transmission channel with the optimal subordinate media stream sender based on the network address of the optimal subordinate media stream sender, and obtain the media stream sent by the optimal subordinate media stream sender through the media stream transmission channel.

[0074] Optionally, network quality data may include at least one of latency, bandwidth, packet loss rate, throughput, jitter, and reliability.

[0075] The cross-level streaming device proposed in this embodiment can be applied to a dispatch center, which communicates with a signaling server and a signaling client. The dispatch center parses the cross-level streaming request sent by the upper-level requesting end through the signaling server, obtaining the source device code and the receiving address of the upper-level requesting end. Based on the source device code, multiple lower-level responding ends corresponding to the source device code are determined. The optimal lower-level responding end is determined based on the network quality data between the dispatch center and each lower-level responding end. The receiving address is sent to the optimal lower-level responding end through the signaling client, causing the optimal lower-level responding end to return its sending address to the dispatch center. The sending address is returned to the upper-level requesting end through the signaling server, enabling the upper-level requesting end to obtain the media stream sent by the optimal lower-level responding end based on the sending address. This invention can determine the corresponding optimal lower-level responder based on the cross-level streaming request from the upper-level requester, and establish a direct media stream transmission channel between the upper-level requester and the optimal lower-level responder. The upper-level requester and the optimal lower-level responder can directly transmit the media stream through the media stream transmission channel without going through the signaling server, scheduling center and signaling client to transmit the media stream. This enables the upper-level requester to retrieve the media stream from the optimal lower-level responder, effectively reducing communication latency and improving network transmission efficiency during the cross-level streaming process.

[0076] In this embodiment, the cross-level current-taking device is presented in the form of a functional unit. Here, a unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.

[0077] This invention also provides a computer device having the above-described features. Figure 5 The cross-stage flow collection device shown.

[0078] Please see Figure 6The present invention provides a schematic diagram of the structure of a computer device according to an optional embodiment. The computer device includes one or more processors 10, a memory 20, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected via different buses and can be mounted on a common motherboard or otherwise installed as needed. The processors can process instructions executed within the computer device, including instructions stored in or on memory to display graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, multiple processors and / or multiple buses can be used with multiple memories, if desired. Similarly, multiple computer devices can be connected, each providing some of the necessary operations (e.g., as a server array, a group of blade servers, or a multiprocessor system). Figure 6 Take a processor 10 as an example.

[0079] Processor 10 may be a central processing unit, a network processor, or a combination thereof. Processor 10 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The programmable logic device may be a complex programmable logic device (CAMP), a field-programmable gate array (FPGA), a general-purpose array logic (GDA), or any combination thereof.

[0080] The memory 20 stores instructions executable by at least one processor 10 to cause at least one processor 10 to perform the method shown in the above embodiments.

[0081] The memory 20 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function. The data storage area may store data created based on the use of the computer device. Furthermore, the memory 20 may include high-speed random access memory and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some alternative embodiments, the memory 20 may optionally include memory remotely located relative to the processor 10, which can be connected to the computer device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0082] Memory 20 may include volatile memory, such as random access memory. Memory may also include non-volatile memory, such as flash memory, hard disk, or solid-state drive. Memory 20 may also include combinations of the above types of memory.

[0083] The computer device also includes a communication interface 30 for communicating with other devices or communication networks.

[0084] This invention also provides a computer-readable storage medium. The methods described above according to embodiments of the invention can be implemented in hardware or firmware, or implemented as computer code that can be recorded on a storage medium, or implemented as computer code downloaded via a network and originally stored on a remote storage medium or a non-transitory machine-readable storage medium and then stored on a local storage medium. Thus, the methods described herein can be processed by software stored on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. The storage medium can be a magnetic disk, optical disk, read-only memory, random access memory, flash memory, hard disk, or solid-state drive, etc.; further, the storage medium can also include combinations of the above types of memory. It is understood that computers, processors, microprocessor controllers, or programmable hardware include storage components capable of storing or receiving software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the methods shown in the above embodiments.

[0085] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for cross-level flow extraction, characterized in that, The method is applied to a dispatch center, wherein the dispatch center communicates with a signaling server and a signaling client; the method includes: The cross-level stream retrieval request sent by the upper-level requesting end through the signaling server is parsed to obtain the source device code and the receiving address of the upper-level requesting end; Based on the source device code, a plurality of lower-level response terminals corresponding to the source device code are determined; Based on the network quality data between the scheduling center and each of the lower-level response terminals, the optimal lower-level response terminal is determined. The signaling client sends the receiving address to the optimal lower-level response terminal, so that the optimal lower-level response terminal returns the sending address of the optimal lower-level response terminal to the scheduling center. The signaling server returns the streaming address to the upper-level requesting end, so that the upper-level requesting end can obtain the media stream sent by the optimal lower-level responding end based on the streaming address.

2. The method according to claim 1, characterized in that, The upper-level requesting end includes an upper-level signaling client and an upper-level media stream receiving end, and the receiving address of the upper-level requesting end is the network address of the upper-level media stream receiving end; The lower-level response end includes a lower-level signaling server and a lower-level media stream sender. The stream sending address of the optimal lower-level response end is the network address of the lower-level media stream sender in the optimal lower-level response end.

3. The method according to claim 2, characterized in that, The parsing of the cross-level streaming request sent by the upper-level requesting end through the signaling server obtains the source device code and the receiving address of the upper-level requesting end, including: The cross-level stream retrieval request sent by the superior signaling client through the signaling server is parsed to obtain the source device code and the network address of the superior media stream receiver; The step of determining multiple lower-level response endpoints corresponding to the source device code based on the source device code includes: Based on the source device encoding, search for multiple media stream node identifiers corresponding to the source device encoding in the created global media resource information database; Each media stream node identifier is uniquely associated with a corresponding lower-level media stream sender. For any given lower-level media stream sender, determine the lower-level signaling server corresponding to the lower-level media stream sender, and use the lower-level media stream sender and the corresponding lower-level signaling server as the lower-level response server corresponding to the source device code.

4. The method according to claim 3, characterized in that, The step of determining the optimal lower-level response terminal based on the network quality data between the scheduling center and each of the lower-level response terminals includes: Detect the network quality data between the scheduling center and each of the lower-level media stream senders; Determine the optimal network quality data from each of the aforementioned network quality data; The lower-level media stream sender corresponding to the optimal network quality data is determined as the optimal lower-level media stream sender; The optimal lower-level media stream sender and the corresponding lower-level signaling server are designated as the optimal lower-level response end.

5. The method according to claim 4, characterized in that, The step of sending the receiving address to the optimal lower-level response terminal via the signaling client, so that the optimal lower-level response terminal returns the sending address of the optimal lower-level response terminal to the scheduling center, includes: The signaling client sends the network address of the upper-level media stream receiver to the lower-level signaling server in the optimal lower-level response terminal, so that the lower-level signaling server in the optimal lower-level response terminal returns the network address of the optimal lower-level media stream sender to the scheduling center.

6. The method according to claim 4, characterized in that, The step of returning the streaming address to the upstream requesting end through the signaling server, so that the upstream requesting end can obtain the media stream sent by the optimal downstream responding end based on the streaming address, includes: The signaling server and the upper-level signaling client return the network address of the optimal lower-level media stream sender to the upper-level media stream receiver, so that the upper-level media stream receiver can: construct a media stream transmission channel with the optimal lower-level media stream sender based on the network address of the optimal lower-level media stream sender, and obtain the media stream sent by the optimal lower-level media stream sender through the media stream transmission channel.

7. The method according to any one of claims 1 to 6, characterized in that, The network quality data includes at least one of latency, bandwidth, packet loss rate, throughput, jitter, and reliability.

8. A cross-stage current collection device, characterized in that, The device is applied to a dispatch center, which communicates with a signaling server and a signaling client; the device includes: The parsing unit is used to parse the cross-level stream retrieval request sent by the upper-level requesting end through the signaling server, and obtain the source device code and the receiving address of the upper-level requesting end; The first determining unit is configured to determine multiple lower-level response terminals corresponding to the source device code based on the source device code; The second determining unit is used to determine the optimal lower-level response terminal based on the network quality data between the scheduling center and each of the lower-level response terminals. The sending unit is used to send the receiving address to the optimal lower-level response terminal through the signaling client, so that the optimal lower-level response terminal returns the sending address of the optimal lower-level response terminal to the scheduling center; The return unit is used to return the streaming address to the upper-level requesting end through the signaling server, so that the upper-level requesting end can obtain the media stream sent by the optimal lower-level responding end according to the streaming address.

9. A computer device, characterized in that, include: A memory and a processor are communicatively connected, the memory stores computer instructions, and the processor executes the cross-level flow fetching method according to any one of claims 1 to 7 by executing the computer instructions.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing the computer to perform the cross-level flow extraction method according to any one of claims 1 to 7.

Images