Communication method and terminal equipment in converged network environment

Abstract

The invention discloses a communication method and terminal equipment in a converged network environment, and the method comprises the steps: receiving an interaction request from target electronic equipment by target terminal equipment; the interaction request is an SIP packet generated based on an SIP protocol; and the target terminal device sends the to-be-transmitted data indicated by the interaction request to the target electronic device through a data transmission path between the target terminal device and the target electronic device. The interaction request is sent to the target terminal equipment by the target electronic equipment in the following manner: sending the interaction request to a server of a video private network through the target electronic equipment; forwarding the interaction request to a server at a private network boundary through a first service deployed by a server of a video private network; forwarding the interaction request to a server of a closed private network through a server of a private network boundary; and forwarding the interaction request to the target terminal device through a second service deployed by the server of the closed private network. The protocol compatibility in the converged network environment is improved, and the transmission stability and the transmission performance are improved.

Description

Technical Field

[0001] This application relates to the field of streaming media transmission technology, and in particular to a communication method and terminal device in a converged network environment. Background Technology

[0002] Current streaming media technologies have achieved high transmission stability and protocol compatibility in standardized network architectures (such as a single public network or a homogeneous local area network).

[0003] However, in an increasing number of heterogeneous hybrid network architectures (such as the integration of public and private networks, or scenarios with multiple layers of security policies), the existence of private network boundaries may prevent effective data transmission between the networks at both ends of the private network boundary, resulting in a significant decrease in transmission efficiency. This is mainly manifested in problems such as security policy conflicts, protocol incompatibility, and lack of stability in cross-domain transmission. Summary of the Invention

[0004] The exemplary embodiments of this application provide a communication method and terminal device in a converged network environment, which can improve the protocol compatibility of data transmission in a converged network environment and enhance transmission stability and performance.

[0005] According to a first aspect of an exemplary embodiment, a communication method in a converged network environment is provided, the method comprising:

[0006] The target terminal device receives an interaction request from a target electronic device; wherein the interaction request is a SIP packet generated based on the SIP protocol; wherein the target electronic device is any one of at least one electronic device; and the target terminal device is the terminal device indicated by the interaction request.

[0007] The target terminal device sends the data to be transmitted, as indicated by the interaction request, to the target electronic device through the data transmission path between the target terminal device and the target electronic device;

[0008] The interaction request is sent from the target electronic device to the target terminal device in the following manner:

[0009] The interaction request is sent to the server of the video private network through the target electronic device;

[0010] The first service deployed on the server of the video private network forwards the interaction request to the server at the boundary of the private network;

[0011] The server at the boundary of the private network forwards the interaction request to the server in the closed private network.

[0012] The second service, deployed through a server on a closed private network, forwards the interaction request to the target terminal device.

[0013] In this embodiment of the application, multiple transmission protocols may be involved in a converged network environment, potentially leading to protocol compatibility issues. Furthermore, to enhance transmission security, a private network boundary is deployed between the closed private network and the video private network. While this boundary achieves physical isolation between the closed private network and the video private network, it can degrade data transmission performance between them. Therefore, when the target electronic device generates an interaction request, it can be transmitted from the video private network through the private network boundary to the closed private network via a first service deployed on the video private network server and a second service deployed on the closed private network server, and then to the target terminal device. Since this interaction request is a SIP packet generated based on the SIP protocol, and considering the video private network's ability to parse SIP packets, this design overcomes the network isolation issues caused by the private network boundary. The target terminal device can respond to the interaction request and transmit the data to be transmitted as indicated by the request through the data transmission path between the target terminal device and the target electronic device. Therefore, this improves protocol compatibility of data transmission in a converged network environment, enhancing transmission stability and performance.

[0014] In an optional implementation, if the interaction request is an audio / video call request, the first service is a WebRTC service, the second service is a WebRTC service, and the method further includes:

[0015] The WebRTC service deployed on a closed private network server records the first registration information of at least one terminal device, and the WebRTC service deployed on a private video network server records the second registration information of at least one electronic device; wherein, the first registration information includes the device identifier and IP address of each of the at least one terminal device; and the second registration information includes the device identifier and IP address of each of the at least one electronic device.

[0016] In the above embodiments, in the context of audio and video calls, the first service is a WebRTC service, and the second service is a WebRTC service, implemented through cascading WebRTC services. This design allows the closed private network to store the device identifier and IP address of at least one terminal device, as well as the device identifier and IP address of at least one electronic device, facilitating the subsequent location of the electronic or terminal device during communication.

[0017] In one alternative implementation, sending an interaction request to a server on the video private network via the target electronic device includes:

[0018] The target electronic device sends audio and video call requests to the server of the video private network via the SIP protocol.

[0019] In the above embodiments, considering the characteristic that video private networks can parse SIP packets, in audio and video call scenarios, the corresponding audio and video call requests are transmitted through the SIP protocol.

[0020] In one alternative implementation, the method further includes:

[0021] The server on the closed private network sends the first feedback message of the audio / video call request to the server at the boundary of the private network; wherein, the first feedback message is in the form of SIP signaling.

[0022] By parsing audio and video call requests through servers at the private network boundary, the IP address and media port of the WebRTC service deployed on the video private network server are obtained; and by parsing the first feedback message from the closed private network, the IP address and media port of the WebRTC service deployed on the closed private network server are obtained.

[0023] A data transmission path is established between the target terminal device and the target electronic device by using the IP address and media port of the WebRTC service deployed on the server based on the video private network, and the IP address and media port of the WebRTC service deployed on the server of the closed private network.

[0024] In the above embodiments, in the audio and video call scenario, the server at the private network boundary parses the audio and video call request and the first feedback message, respectively, to obtain the IP address and media port of the WebRTC service deployed on the video private network server, and the IP address and media port of the WebRTC service deployed on the closed private network server. This allows the boundary private network to construct a data transmission path between the target terminal device and the target electronic device based on these two sets of IP addresses and media ports. The data transmission path constructed in this way has high stability.

[0025] In one optional implementation, if the interaction request is a monitoring viewing request, the first service is the nginx service and the second service is the SIP service;

[0026] Sending interaction requests to the video private network server via the target electronic device includes:

[0027] The target electronic device sends the monitoring request to the nginx service on the video private network;

[0028] The first service deployed on the server through the video private network forwards interaction requests to the server at the private network boundary, including:

[0029] The nginx service deployed on the server via the video private network will send monitoring requests to the server at the boundary of the private network.

[0030] In the above embodiments, during the scenario of viewing monitoring requests, network isolation at the private network boundary prevents the normal execution of commands from electronic devices and the playback of RTMP streams from terminal devices. In this embodiment, based on the characteristic that the private network boundary supports the TCP protocol, an nginx proxy is considered to solve this problem. Therefore, the target electronic device can send the monitoring viewing request to the nginx service on the video private network, and the server on the video private network will then forward the monitoring viewing request to the server at the private network boundary via the nginx service. This design provides a foundation for data transmission in this scenario.

[0031] In one alternative implementation, the interaction request is forwarded from the server at the private network boundary to the server on the closed private network, including:

[0032] The server at the private network boundary sends the monitoring request to the server in the closed private network according to the pre-configured port mapping rules.

[0033] In the above embodiments, in the scenario of viewing monitoring requests, the port mapping rule refers to the list of ports that can be forwarded to servers in the closed private network by the server at the private network boundary. Therefore, the private network boundary can send the viewing monitoring request to the server in the closed private network based on the port mapping rule, thus achieving stable data transmission.

[0034] In one optional implementation, a second service deployed via a server on a closed private network forwards the interaction request to the target terminal device, including:

[0035] The monitoring request is parsed and sent to the target terminal device via a SIP service deployed on a server in a closed private network.

[0036] In the above embodiments, considering the compatibility of SIP services with other protocols, SIP services can be used to parse and view monitoring requests in scenarios where monitoring requests are viewed, thus avoiding conflicts between different protocols.

[0037] In one optional implementation, the target terminal device sends the data to be transmitted indicated by the interaction request to the target electronic device through the data transmission path between the target terminal device and the target electronic device, including:

[0038] The target terminal device sends the RTMP stream indicating the monitoring request to the streaming media service deployed on the server in the closed private network. The server in the closed private network then forwards the RTMP stream through the server at the private network boundary to the server in the video private network. The server in the video private network then deploys the nginx service to send the RTMP stream control to the target electronic device.

[0039] In the above embodiments, in the scenario of viewing monitoring requests, the nginx service, as a high-performance open-source web service, utilizes its lightweight, efficient, and stable characteristics. Therefore, deploying the nginx service on a video private network server to enable the target electronic device to play RTMP streams can improve the smoothness and stability of RTMP stream transmission.

[0040] In one optional implementation, if the interaction request is a walkie-talkie request, the first service is a WebRTC service, the second service is a WebRTC service, and the walkie-talkie request is an HTTP request;

[0041] The method also includes:

[0042] The WebRTC service deployed on a server in a closed private network confirms that the target electronic device has successfully intercepted the call and generates a second feedback message; the second feedback message is an HTTP event notification corresponding to the HTTP request.

[0043] The second feedback message is converted into a SIP notification by a server on a closed private network, and the SIP notification is sent to the target terminal device. The second feedback message is then forwarded to the server on the video private network through a server at the private network boundary.

[0044] The second feedback message is converted into a SIP notification by the server of the video private network, and the SIP notification is sent to the target electronic device.

[0045] In the above embodiments, in a two-way communication scenario, after confirming that the target device has successfully intercepted the call, a corresponding HTTP event notification can be generated. For the target terminal device and the dedicated video network, the notification is converted into a SIP notification within a closed private network; for the private network boundary, the HTTP event notification can be transmitted directly. This design combines the characteristics of servers under different networks, providing targeted processing and improving system stability.

[0046] According to a second aspect of an exemplary embodiment, a terminal device is provided; the terminal device envelope includes a data transmission unit and a processor;

[0047] The data transmission unit is configured to perform:

[0048] Receive an interaction request from a target electronic device; wherein the interaction request is a SIP packet generated based on the SIP protocol; wherein the target electronic device is any one of at least one electronic device; wherein the terminal device is the terminal device indicated by the interaction request;

[0049] The processor is configured to execute:

[0050] The data to be transmitted as indicated by the interactive request is transmitted through the data transmission path between the target terminal device and the target electronic device;

[0051] The interaction request is sent from the target electronic device to the terminal device in the following manner:

[0052] The interaction request is sent to the server of the video private network through the target electronic device;

[0053] The first service deployed on the server of the video private network forwards the interaction request to the server at the boundary of the private network;

[0054] The server at the boundary of the private network forwards the interaction request to the server in the closed private network.

[0055] The second service, deployed through a server on a closed private network, forwards the interaction request to the target terminal device.

[0056] According to a third aspect of an exemplary embodiment, a communication device in a converged network environment is provided, the device including a data transceiver unit and a data processing unit.

[0057] A data transceiver unit is configured to: receive an interaction request from a target electronic device; wherein the interaction request is a SIP packet generated based on the SIP protocol; wherein the target electronic device is any one of at least one electronic device; wherein the terminal device is the terminal device indicated by the interaction request;

[0058] The data processing unit is used to: transmit the data to be transmitted as indicated by the interactive request through the data transmission path between the target terminal device and the target electronic device;

[0059] The interaction request is sent from the target electronic device to the terminal device in the following manner:

[0060] The interaction request is sent to the server of the video private network through the target electronic device;

[0061] The first service deployed on the server of the video private network forwards the interaction request to the server at the boundary of the private network;

[0062] The server at the boundary of the private network forwards the interaction request to the server in the closed private network.

[0063] The second service, deployed through a server on a closed private network, forwards the interaction request to the target terminal device.

[0064] According to a fourth aspect of an exemplary embodiment, a computer storage medium is provided, which stores computer program instructions that, when executed on a computer, cause the computer to perform a communication method in a converged network environment as described in the first aspect. Attached Figure Description

[0065] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0066] Figure 1a This illustration provides a schematic diagram of a technical framework for implementing streaming media functionality under a standardized network architecture, as provided in an embodiment of this application.

[0067] Figure 1b An exemplary diagram of an architecture of a converged network system provided in an embodiment of this application is shown;

[0068] Figure 2 An exemplary flowchart illustrates a communication method in a converged network environment provided by an embodiment of this application;

[0069] Figure 3 An exemplary flowchart illustrates a method for sending an interactive request from a target electronic device to a target terminal device, according to an embodiment of this application.

[0070] Figure 4 An exemplary flowchart illustrates a complete communication method in a converged network environment provided by an embodiment of this application;

[0071] Figure 5 An interactive diagram illustrating a communication process in an audio / video call scenario provided in an embodiment of this application is shown as an example.

[0072] Figure 6 An exemplary flowchart illustrates a communication method in an audio / video call scenario provided by an embodiment of this application;

[0073] Figure 7 An example diagram illustrates an interactive representation of a communication process in a monitoring scenario, provided by an embodiment of this application.

[0074] Figure 8 An exemplary flowchart illustrates a communication method for viewing a monitoring scenario provided in an embodiment of this application;

[0075] Figure 9 An interactive diagram illustrating a communication process in a walkie-talkie scenario provided by an embodiment of this application is shown as an example;

[0076] Figure 10 An exemplary flowchart illustrates a communication method for viewing a monitoring scenario provided in an embodiment of this application;

[0077] Figure 11An exemplary block diagram of a converged network system provided in an embodiment of this application is shown;

[0078] Figure 12 An exemplary schematic diagram of a communication device in a converged network environment provided in an embodiment of this application is shown;

[0079] Figure 13 An exemplary schematic diagram of a terminal device provided in an embodiment of this application is shown. Detailed Implementation

[0080] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0081] For ease of understanding, the terms used in the embodiments of this application are explained below:

[0082] (1) Transmission Control Protocol (TCP) is the core transport layer protocol in the Internet protocol suite, responsible for providing reliable, connection-oriented byte stream data transmission services in the network. It is widely used in scenarios requiring high reliability, such as web browsing, email, and file transfer.

[0083] (2) User Datagram Protocol (UDP) is another core transport layer protocol in the Internet protocol suite. Unlike TCP, it provides connectionless and unreliable data transmission services. UDP is designed to achieve high efficiency and low latency, making it suitable for scenarios with high real-time requirements and where a small amount of data loss is acceptable, such as video streaming, real-time games, and Domain Name System (DNS) queries.

[0084] (3) Real-Time Transport Protocol (RTP) is a network transmission protocol designed for real-time data (such as audio, video, and real-time messages). It is widely used in scenarios such as video conferencing, live streaming, and VoIP. It aims to solve problems such as latency, jitter, and synchronization in real-time data transmission and ensure that data is transmitted efficiently and orderly in the network.

[0085] (4) Real-Time Messaging Protocol (RTMP) is an application layer protocol designed specifically for real-time streaming media data transmission. It is widely used in scenarios such as live streaming, video chat, and online education. Based on the TCP protocol, it features low latency and high reliability and was once one of the mainstream protocols for internet streaming media transmission.

[0086] (5) Web Real-Time Communication (WebRTC) is a browser-based real-time communication technology that allows web pages to conduct audio and video calls or data transmission directly without the need for additional plugins. It is widely used in scenarios such as video conferencing, online education, real-time collaboration, and live streaming.

[0087] (6) Nginx is a lightweight, high-performance open-source web server, reverse proxy server and email proxy server.

[0088] (7) Session Initiation Protocol (SIP) is a signaling protocol used to establish, modify and terminate multimedia sessions (such as voice and video calls). It is one of the core protocols of VoIP and real-time communication systems and is widely used in scenarios such as video conferencing, instant messaging, and online games.

[0089] (8) HyperText Markup Language (HTML) is the foundational technology for building web pages. It defines page structure and content through tags, enabling browsers to correctly render elements such as text, images, links, and forms. It is not a programming language, but a markup language.

[0090] (9) Hypertext Transfer Protocol (HTTP) is the fundamental communication protocol of the Internet, used to transfer hypertext (such as HTML pages and JSON data) between web browsers (clients) and web servers. It is based on a request-response model, is stateless (each request is independent), and is the core driving force of modern web applications.

[0091] (10) Network Address Translation (NAT) is a technology that translates internal private network addresses (such as LAN IPs) into public IP addresses to solve the problem of insufficient public IPv4 addresses. It is widely used in network devices such as routers and firewalls. NAT Traversal, on the other hand, refers to a technology that enables direct communication between two hosts located in different private networks in a network environment with NAT devices. Its core objective is to overcome the limitations of NAT devices on end-to-end connections, allowing devices belonging to different LANs to directly establish communication links.

[0092] (11) A private network is a network that is not directly connected to the public Internet and is used only by a specific organization or within a local area to ensure data security and isolate the network environment. Devices in a private network communicate through private IP addresses, which are not routed on the public Internet and therefore cannot be directly accessed by the Internet, thereby reducing the risk of exposure.

[0093] (12) A private network is an independent communication network specifically built for a particular institution, organization, or business scenario. It is characterized by exclusivity, high security, and high reliability. It is usually not directly interconnected with the public Internet and serves only specific users or business needs. The core objective of a private network is to ensure the confidentiality, integrity, and availability of data transmission. It is commonly found in fields such as government, military, power, transportation, and finance, where network security and stability requirements are extremely high.

[0094] (13) A network boundary refers to the dividing point between network areas with different security levels. It is usually used to isolate network environments with different security policies (such as trusted internal networks and untrusted external networks, highly sensitive areas and ordinary areas). Its core objective is to control the inflow and outflow of traffic through technical means to prevent unauthorized access, data leakage or malicious attacks. It is the first line of defense in a network security protection system. In the embodiments of this application, the private network boundary is used to isolate private networks and video private networks.

[0095] While traditional streaming media technology has high transmission feasibility in basic network architectures, its media data transmission performance often faces severe challenges in environments with high security requirements and heterogeneous hybrid network architectures already deployed by customers. Specifically, these challenges include security policy conflicts, insufficient protocol compatibility, and lack of stability in cross-domain transmission.

[0096] Current streaming media transmission technology has formed a protocol system with RTMP and WebRTC as the core. The popularization of 5G networks and the introduction of edge computing technology have further improved the service capabilities of low latency and high throughput scenarios (such as 4K / 8K live streaming and VR real-time interaction).

[0097] Current streaming media technology has achieved high transmission stability and protocol compatibility (typical protocols such as RTMP and WebRTC) in standardized network architectures (such as a single public network or homogeneous local area network). However, in heterogeneous hybrid network architectures deployed by customers (such as public network-private network convergence and multi-level security policy overlay scenarios), its transmission performance is significantly reduced. Specifically, it requires in-depth protocol optimization and topology adaptation for scenarios such as NAT traversal, dynamic routing adaptation, and cross-security domain protocol conversion. Figure 1a This is a schematic diagram of the technical framework for implementing streaming media functionality under a standardized network architecture, where the dashed line represents a specific media stream transmission process.

[0098] To address this, this application provides a communication method in a converged network environment. By deploying different services on servers in a closed private network and a dedicated video network, and through dynamic protocol adaptation, intelligent routing selection, and end-to-end encrypted transmission mechanisms, it achieves efficient, secure, and low-latency transmission of streaming media data in complex network architectures, effectively solving the problem of transmission performance degradation in traditional solutions in cross-network domain and multi-security-level scenarios.

[0099] After introducing the design concept of the embodiments of this application, the following is a brief introduction to the application scenarios to which the technical solutions of the embodiments of this application can be applied. It should be noted that the application scenarios described below are only for illustrating the embodiments of this application and are not intended to limit the scope. In specific implementation, the technical solutions provided by the embodiments of this application can be flexibly applied according to actual needs.

[0100] refer to Figure 1b This paper illustrates an architecture diagram of a converged network system, which includes at least one terminal device connected to the Internet, a server connected to a closed private network, a server at the boundary of a private network, a server connected to a video private network, and at least one electronic device. In this embodiment, the terminal device may be a law enforcement recorder, and the electronic device may be a computer.

[0101] Figure 1b In this example, four 5G law enforcement recorders are used as terminal devices. The servers in the closed private network can include business servers and 5G private network servers, and also include firewalls, private network switches, etc. The servers at the private network boundary include one-way import boundary servers, and also include one-way optical shields, front-end optical shields, network gateways, etc. The servers in the video private network include business servers and 5G private network servers, and also include private network switches, etc. Additionally, the video private network includes an electronic device for communication with the terminal devices.

[0102] In practical applications, the video private network and the public security network can also include a public security network boundary, which includes one-way inbound boundary devices, one-way outbound boundary devices, and related boundary servers. Outside of this, the closed private network, the private network boundary, and the video private network can be located in the same computer room, different computer rooms, or other locations with network capabilities; this is not limited here.

[0103] See also Figure 1bThe law enforcement recorder operates on the internet, and its operational commands are routed through an internet firewall into a closed private network, providing the first line of data protection. One-way inbound and one-way outbound boundary devices enable TCP / UDP protocol data transmission between the closed private network and the dedicated video network. The dedicated network boundary supports TCP / UDP protocols, SIP packet parsing, and dynamically opening media RTP ports. Dispatchers on the computer side of the dedicated video network can conduct audio and video calls with the law enforcement recorder, monitor real-time video, perform real-time intercoms, and execute other related business functions.

[0104] It should be noted that, Figure 1b It is merely an indication and does not constitute a specific limitation.

[0105] To further illustrate the technical solutions provided in the embodiments of this application, a detailed description is provided below in conjunction with the accompanying drawings and specific implementation methods. Although the embodiments of this application provide method operation steps as shown in the following embodiments or drawings, the method may include more or fewer operation steps based on conventional or non-inventive methods. In steps where there is no logically necessary causal relationship, the execution order of these steps is not limited to the execution order provided in the embodiments of this application.

[0106] The following is combined with Figure 1b The application scenarios shown are for reference. Figure 2 The flowchart shown illustrates a communication method in a converged network environment, and explains the technical solution provided in the embodiments of this application.

[0107] S201: The target terminal device receives an interaction request from the target electronic device.

[0108] The interaction request is a SIP packet generated based on the SIP protocol, the target electronic device is any one of at least one electronic device, and the target terminal device is the terminal device indicated by the interaction request.

[0109] S202: The target terminal device sends the data to be transmitted as indicated by the interaction request to the target electronic device through the data transmission path between the target terminal device and the target electronic device.

[0110] In one possible implementation, Figure 3 This application provides a flowchart of a method for sending an interaction request from a target electronic device to a target terminal device, as illustrated in an embodiment of the present application. Figure 3 It should include at least the following steps:

[0111] S301: Send the interaction request to the server of the video private network through the target electronic device;

[0112] S302: The first service deployed on the server through the video private network forwards the interaction request to the server at the private network boundary.

[0113] S303: The server at the private network boundary forwards the interaction request to the server in the closed private network.

[0114] S304: A second service deployed on a server in a closed private network forwards the interaction request to the target terminal device.

[0115] The first service and the second service are used to receive and forward interaction requests, respectively.

[0116] In this embodiment of the application, multiple transmission protocols may be involved in a converged network environment, potentially leading to protocol compatibility issues. Furthermore, to enhance transmission security, a private network boundary is deployed between the closed private network and the video private network. While this boundary achieves physical isolation between the closed private network and the video private network, it can degrade data transmission performance between them. Therefore, when the target electronic device generates an interaction request, it can be transmitted from the video private network through the private network boundary to the closed private network via a first service deployed on the video private network server and a second service deployed on the closed private network server, and then to the target terminal device. Since this interaction request is a SIP packet generated based on the SIP protocol, and considering the video private network's ability to parse SIP packets, this design overcomes the network isolation issues caused by the private network boundary. The target terminal device can respond to the interaction request and transmit the data to be transmitted as indicated by the request through the data transmission path between the target terminal device and the target electronic device. Therefore, this improves protocol compatibility of data transmission in a converged network environment, enhancing transmission stability and performance.

[0117] Figure 4 A flowchart illustrating a complete communication method in a converged network environment is provided as an embodiment of this application. Figure 4 It should include at least the following steps:

[0118] S401: The target electronic device sends an interaction request to the server of the video private network.

[0119] S402: The server of the video private network forwards the interaction request to the server at the private network boundary through the first deployed service.

[0120] S403: The server at the private network boundary forwards the interaction request to the server in the closed private network.

[0121] S404: The server in the closed private network forwards the interaction request to the target terminal device through a second service deployed therein.

[0122] S405: The target terminal device transmits the data to be transmitted as indicated by the interaction request through the data transmission path between the target terminal device and the target electronic device.

[0123] In this embodiment, the ability of a private network boundary to parse SIP packets is utilized to overcome the network isolation problem caused by the private network boundary by using a first service deployed on a server in a video private network and a second service deployed on a server in a closed private network.

[0124] In practical applications, scenarios typically include audio and video calls, monitoring, and intercoms. The following will use these three scenarios as examples to illustrate the embodiments of this application. Figures 2-4 The communication process in the converged network environment is illustrated.

[0125] The first scenario is an audio / video call.

[0126] In this scenario, due to the network isolation created by the private network boundary between the closed private network and the dedicated video network, the two cannot locate each other during audio and video calls. Considering the ability of the dedicated network boundary to parse SIP packets, this application proposes a scheme using two cascaded WebRTC services to implement audio and video calls. Figure 5 An interactive diagram illustrating the communication process in an audio / video call scenario provided in an embodiment of this application.

[0127] Optionally, the server in the closed private network deploys the WebRTC service, the server in the video private network deploys the WebRTC service, and the interaction requests between electronic devices and terminal devices are audio and video call requests. Figure 6 This is a flowchart illustrating a communication method in an audio / video call scenario provided in an embodiment of this application. Figure 6 It should include at least the following steps:

[0128] S600: A WebRTC service deployed via a server on a closed private network records the first registration information of at least one terminal device; a WebRTC service deployed via a server on a video private network records the second registration information of at least one electronic device.

[0129] The first registration information includes the device identifier and IP address of at least one terminal device; the second registration information includes the device identifier and IP address of at least one electronic device.

[0130] In this design, the closed private network stores the device identifier and IP address of at least one terminal device, as well as the device identifier and IP address of at least one electronic device, so as to locate the electronic device or terminal device during subsequent communication.

[0131] S601: Sends audio / video call requests to the server of the video private network via the SIP protocol through the target electronic device.

[0132] Since there may be more than one electronic device, we will use one as an example here, and refer to this one electronic device as the target electronic device. In this way, when the target electronic device initiates a voice request to the target terminal device, it can establish a call connection with the WebRTC service of the video private network through SIP interaction.

[0133] S602: The WebRTC service deployed on the server of the video private network forwards audio and video call requests to the server at the boundary of the private network.

[0134] S603: The server at the boundary of the private network forwards audio and video call requests to the server in the closed private network.

[0135] S604: By parsing audio and video call requests through the server at the private network boundary, the IP address and media port of the WebRTC service deployed on the video private network server are obtained.

[0136] The audio and video call requests are in the form of SIP packets. The private network boundary parses these SIP packets to obtain the IP address and media port of the WebRTC service deployed on the video private network server. Here, the media port refers to the media RTC port.

[0137] S605: A server on a closed private network forwards audio and video call requests to the target terminal device via a deployed WebRTC service.

[0138] The target terminal device is the terminal device that receives the audio / video call request.

[0139] S606: The first feedback message of the audio / video call request is sent to the server at the boundary of the private network through the server on the closed private network.

[0140] The first feedback message is in the form of SIP signaling.

[0141] S607: By resolving the first feedback message from the closed private network through the private network boundary, the IP address and media port of the WebRTC service deployed on the server of the closed private network are obtained.

[0142] S608: The IP address and media port of the WebRTC service deployed on the server based on the video private network, and the IP address and media port of the WebRTC service deployed on the server of the closed private network, to build a data transmission path between the target terminal device and the target electronic device.

[0143] S609: The data to be transmitted in the audio / video call request indication is sent to the target electronic device through the data transmission path between the target terminal device and the target electronic device.

[0144] Optionally, once the call is complete, the media RTP packet will begin transmission over the private network boundary, that is, through the data transmission path between the target terminal device and the target electronic device, thereby enabling smooth audio and video calls.

[0145] It should be noted that, in this embodiment, the example of an electronic device initiating an audio / video call request is used. In actual applications, the terminal device can also initiate the audio / video call request. When a terminal device initiates an audio / video call request, please refer to... Figure 6 The process is not detailed here.

[0146] This design effectively solves the addressing problem caused by network isolation, ensuring smooth and uninterrupted communication across private networks.

[0147] The second scenario involves viewing surveillance footage.

[0148] In this scenario, due to network isolation at the private network boundary, the issuance of commands by electronic devices and the playback of RTMP streams by terminal devices cannot be achieved normally. In this embodiment, based on the characteristic that the private network boundary supports the TCP protocol, an nginx proxy is considered for building on the video private network to solve this problem. Figure 7 This is an interactive diagram for viewing the communication process in a monitoring scenario, provided as an embodiment of this application.

[0149] Optionally, the first service is the nginx service, the second service is the SIP service, and the interaction request is a monitoring request. Figure 8 This application provides a flowchart of a communication method for viewing a monitoring scenario. Figure 8 It should include at least the following steps:

[0150] S801: Sends the viewing monitoring request to the nginx service of the video private network through the target electronic device.

[0151] S802: The server on the video private network sends the monitoring request to the server at the private network boundary via the nginx service.

[0152] S803: The server at the private network boundary sends the monitoring request to the server in the closed private network according to the pre-configured port mapping rules.

[0153] Among them, port mapping rules refer to the list of ports that are pre-configured by the server at the private network boundary and can be forwarded to the server in the closed private network.

[0154] S804: The server on the closed private network resolves the monitoring request through the deployed SIP service and sends the monitoring request to the target terminal device.

[0155] The monitoring request can identify the target terminal device's terminal identifier and IP address, allowing the server on the closed private network to send the monitoring request to the target terminal device.

[0156] S805: A streaming media service that sends an RTMP stream of a viewing monitoring request instruction to a server deployed on a closed private network via a target terminal device.

[0157] S806: The server on the closed private network forwards the RTMP stream through the server at the private network boundary to the server on the video private network via the deployed streaming media service, and then deploys the nginx service on the server on the video private network to send the RTMP stream control to the target electronic device.

[0158] Among them, the server in the closed private network forwards the RTMP stream through the private network boundary to the nginx service of the video private network through the deployed streaming media service, and allows electronic devices to play the video through the nginx layer 7 proxy.

[0159] It should be noted that in the embodiments of this application, it is usually the electronic device that initiates the request to view the monitoring, and generally it is not the terminal device that initiates the request to view the monitoring.

[0160] The third scenario is a walkie-talkie situation.

[0161] In this scenario, the intercom function functions similarly to audio / video calls. Users dial into a meeting that is initially muted, and then compete to speak. For complex network environments, WebRTC cascading technology can be used to allow terminals and computers to join the same intercom group. Figure 9 An interactive diagram illustrating the communication process in a walkie-talkie scenario provided in this application embodiment.

[0162] Optionally, the first service is a WebRTC service, the second service is a WebRTC service, the interaction request is a walkie-talkie request, and the walkie-talkie request is in the form of an HTTP request. Figure 10 This is a flowchart illustrating a communication method for viewing and monitoring scenarios, as provided in an embodiment of this application.

[0163] S1001: Sends an intercom request to the server of the video private network via the target electronic device.

[0164] In this process, the target electronic device initiates a talk request and establishes a voice call connection with the WebRTC service deployed on the server of the video private network.

[0165] S1002: The server on the video private network forwards the intercom request to the server at the private network boundary through the deployed WebRTC service.

[0166] S1003: The server at the private network boundary forwards the intercom request to the server in the closed private network.

[0167] S1004: The server on the closed private network forwards the intercom request to the target terminal device through the deployed WebRTC service.

[0168] S1005: The server on the closed private network confirms that the target electronic device has successfully intercepted the call through the deployed WebRTC service, and generates a second feedback message.

[0169] The closed private network's servers pre-store call-blocking rules, which set the call-blocking priority for terminal devices and electronic devices with call-blocking permissions. When at least two devices call simultaneously, the closed private network needs to allocate call rights according to the call-blocking rules; when only one device calls, no call rights allocation is required.

[0170] Once a device (such as the target electronic device) successfully obtains the right to speak, the WebRTC service deployed on the closed private network server will return a second feedback message (an HTTP event notification corresponding to the HTTP request) to the WebRTC service deployed on the video private network server.

[0171] S1006: The second feedback message is converted into a SIP notification by the server of the closed private network, and the SIP notification is sent to the target terminal device. The second feedback message is then forwarded to the server of the video private network through the server at the private network boundary.

[0172] S1007: The second feedback message is converted into a SIP notification through the server of the video private network, and the SIP notification is sent to the target electronic device.

[0173] S1008: The data to be transmitted in the intercom request indication is sent to the target electronic device through the data transmission path between the target terminal device and the target electronic device via the target terminal device.

[0174] There is no obvious sequential relationship between S1004 and S1005 to S1007. They are just examples and do not constitute specific limitations.

[0175] When requesting a conversation, one is seizing the right to speak. If it is to release the right to speak, then step S1005 is a successful release of the right to speak, and a new round of seizing the right to speak can then begin.

[0176] This design makes the management of speaking rights during the entire intercom process efficient and orderly.

[0177] In summary, the communication method proposed in this application can be applied to dual-network, dual-platform network environments. This streaming media transmission optimization scheme can be applied not only to the three scenarios mentioned above, but also to other scenarios, and also to banking or other fields. These are just examples and do not constitute specific limitations.

[0178] Figure 11 This application provides a structural block diagram of a converged network system, which includes at least one terminal device on the Internet, a server on a closed private network, a server at the boundary of a private network, a server on a video private network, and at least one electronic device; the converged network system is used to execute the communication method in the converged network environment of the above embodiments.

[0179] like Figure 12 As shown, based on the same inventive concept, this application provides a communication device in a converged network environment, the device including a data transceiver unit 121 and a data processing unit 122;

[0180] The data transceiver unit 121 is configured to: receive an interaction request from a target electronic device; wherein the interaction request is a SIP packet generated based on the SIP protocol; wherein the target electronic device is any one of at least one electronic device; wherein the terminal device is the terminal device indicated by the interaction request;

[0181] Data processing unit 122 is used to: transmit the data to be transmitted indicated by the interaction request through the data transmission path between the target terminal device and the target electronic device;

[0182] The interaction request is sent from the target electronic device to the terminal device in the following manner:

[0183] The interaction request is sent to the server of the video private network through the target electronic device;

[0184] The first service deployed on the server of the video private network forwards the interaction request to the server at the boundary of the private network;

[0185] The server at the boundary of the private network forwards the interaction request to the server in the closed private network.

[0186] A second service deployed on a server within a closed private network forwards interaction requests to the target terminal device.

[0187] Since this device is the same as the device in the method of this application embodiment, and the principle of the device in solving the problem is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described again.

[0188] like Figure 13As shown, based on the same inventive concept, this application provides a terminal device, the terminal device envelope including a data transmission unit 131 and a processor 132;

[0189] Data transmission unit 131 is configured to perform:

[0190] Receive an interaction request from a target electronic device; wherein the interaction request is a SIP packet generated based on the SIP protocol; wherein the target electronic device is any one of at least one electronic device; wherein the terminal device is the terminal device indicated by the interaction request;

[0191] Processor 132 is configured to execute:

[0192] The data to be transmitted as indicated by the interactive request is transmitted through the data transmission path between the target terminal device and the target electronic device;

[0193] The interaction request is sent from the target electronic device to the terminal device in the following manner:

[0194] The interaction request is sent to the server of the video private network through the target electronic device;

[0195] The first service deployed on the server of the video private network forwards the interaction request to the server at the boundary of the private network;

[0196] The server at the boundary of the private network forwards the interaction request to the server in the closed private network.

[0197] A second service deployed on a server within a closed private network forwards interaction requests to the target terminal device.

[0198] This application also provides a computer storage medium storing computer program instructions. When the instructions are executed on a computer, the computer performs the steps of the communication method described above in a converged network environment.

[0199] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0200] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0201] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.

[0202] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0203] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A communication method in a converged network environment, characterized in that, The method includes: a target terminal device receiving an interaction request from a target electronic device; wherein the interaction request is a SIP packet generated based on the SIP protocol; the target electronic device is any one of at least one electronic device; and the target terminal device is a terminal device indicated by the interaction request. The target terminal device sends the data to be transmitted indicated by the interaction request to the target electronic device through the data transmission path between the target terminal device and the target electronic device; The interaction request is sent from the target electronic device to the target terminal device in the following manner: The target electronic device sends the interaction request to the server of the video private network; The first service deployed on the server of the video private network forwards the interaction request to the server at the boundary of the private network. The interaction request is forwarded to the server in the closed private network through the server at the boundary of the private network. The second service deployed on a server in a closed private network forwards the interaction request to the target terminal device; the first service and the second service are respectively used to receive and forward the interaction request.

2. The method according to claim 1, characterized in that, If the interaction request is an audio / video call request, the first service is a WebRTC service, the second service is a WebRTC service, and the method further includes: The first registration information of the at least one terminal device is recorded through the WebRTC service deployed on the server of the closed private network, and the second registration information of the at least one electronic device is recorded through the WebRTC service deployed on the server of the video private network; wherein, the first registration information includes the device identifier and IP address of each of the at least one terminal device; and the second registration information includes the device identifier and IP address of each of the at least one electronic device.

3. The method according to claim 2, characterized in that, Sending an interaction request to the server of the video private network via the target electronic device includes: The target electronic device sends the audio / video call request to the server of the video private network via the SIP protocol.

4. The method according to claim 2, characterized in that, The method further includes: The server in the closed private network sends the first feedback message of the audio / video call request to the server at the boundary of the private network; wherein the first feedback message is in the form of SIP signaling. The server at the boundary of the private network parses the audio and video call request to obtain the IP address and media port of the WebRTC service deployed on the server of the video private network; and parses the first feedback message from the closed private network to obtain the IP address and media port of the WebRTC service deployed on the server of the closed private network. Based on the IP address and media port of the WebRTC service deployed on the server of the video private network, and the IP address and media port of the WebRTC service deployed on the server of the closed private network, a data transmission path is constructed between the target terminal device and the target electronic device.

5. The method according to claim 1, characterized in that, If the interaction request is a monitoring request, the first service is the nginx service and the second service is the SIP service; Sending an interaction request to the server of the video private network via the target electronic device includes: The target electronic device sends the monitoring request to the nginx service of the video private network; The first service deployed on the server of the video private network forwards the interaction request to the server at the boundary of the private network, including: The nginx service deployed on the server of the video private network sends the monitoring request to the server at the boundary of the private network.

6. The method according to claim 5, characterized in that, The step of forwarding the interaction request from the server at the boundary of the private network to the server in the closed private network includes: The server at the boundary of the private network sends the monitoring request to the server in the closed private network according to the pre-configured port mapping rules.

7. The method according to claim 5, characterized in that, The second service deployed on the server through the closed private network forwards the interaction request to the target terminal device, including: The monitoring request is parsed by the SIP service deployed on the server of the closed private network, and then sent to the target terminal device.

8. The method according to claim 5, characterized in that, The target terminal device sends the data to be transmitted indicated by the interaction request to the target electronic device through the data transmission path between the target terminal device and the target electronic device, including: The target terminal device sends the RTMP stream indicated by the viewing monitoring request to the streaming media service deployed on the server of the closed private network, so that the server of the closed private network forwards the RTMP stream through the server at the boundary of the private network to the server of the video private network through the deployed streaming media service, and sends the RTMP stream control to the target electronic device through the nginx service deployed on the server of the video private network.

9. The method according to claim 1, characterized in that, If the interaction request is a walkie-talkie request, the first service is a WebRTC service, and the second service is a WebRTC service; if the walkie-talkie request is an HTTP request; The method further includes: The WebRTC service deployed on the server of the closed private network confirms that the target electronic device has successfully intercepted the call and generates a second feedback message; wherein, the second feedback message is an HTTP event notification corresponding to the HTTP request; The server of the closed private network converts the second feedback message into a SIP notification and sends the SIP notification to the target terminal device. The second feedback message is then forwarded to the server of the video private network through the server at the boundary of the private network. The server of the video private network converts the second feedback message into a SIP notification and sends the SIP notification to the target electronic device.

10. A terminal device, characterized in that, The terminal device includes a data transmission unit and a processor; The data transmission unit is configured to perform: Receive an interaction request from a target electronic device; wherein the interaction request is a SIP packet generated based on the SIP protocol; wherein the target electronic device is any one of at least one electronic device; wherein the terminal device is the terminal device indicated by the interaction request; The processor is configured to execute: The data to be transmitted as indicated by the interaction request is transmitted through the data transmission path between the target terminal device and the target electronic device; The interaction request is sent from the target electronic device to the terminal device in the following manner: The target electronic device sends the interaction request to the server of the video private network; The first service deployed on the server of the video private network forwards the interaction request to the server at the boundary of the private network. The server at the boundary of the private network forwards the interaction request to the server in the closed private network. The second service deployed on the server of the closed private network forwards the interaction request to the target terminal device.

Images