An information interaction method, system, storage medium and device of a WebRTC client

Abstract

The application discloses a kind of information interaction method, system, storage medium and equipment of WebRTC client, method includes: traffic access layer Nginx carries token Token and interaction information of the connection request of first client and is forwarded to first signaling service node in signaling service cluster;First signaling service node according to token Token, check whether the connection session of second client is contained in local cache, and second client is the target client for information interaction with first client;If it contains, directly through first signaling service node, interaction information is forwarded to second client;If it does not contain, token Token and interaction information are broadcasted in signaling service cluster, find the second signaling service node of the connection session of second client contained in local cache, and interaction information is forwarded to second client by second signaling service node.The application reduces system complexity, reduces cost and improves efficiency, improves signaling service throughput, meets high concurrency, high scalability, high performance standard.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to a method, system, storage medium, and device for information interaction with a WebRTC client. Background Technology

[0002] Using signaling services to exchange SDP information with WebRTC clients is fundamental to achieving real-time audio and video streaming in WebRTC. Therefore, establishing a reliable and highly scalable signaling service cluster is essential for improving system throughput. In the industry, WebSockets are commonly used as the communication protocol for signaling services. Each signaling service is responsible for maintaining long-lived client connections. The design must consider how clients connected to different signaling services forward SDP messages. Industry practice typically uses middleware such as Redis or ZooKeeper to store client routing information (information about the signaling service where the client session resides, including the signaling service IP and communication port). Before forwarding client SDP information between different signaling services, the client routing information must be obtained from the middleware before point-to-point forwarding between signaling services. Introducing middleware inevitably increases system complexity and stability challenges, such as the stability of the middleware itself, high message forwarding process costs, and high maintenance costs. Summary of the Invention

[0003] Based on this, it is necessary to propose a WebRTC client information interaction method, system, storage medium, and device to address the above problems.

[0004] This invention discloses a method for information interaction in a WebRTC client, the method comprising:

[0005] The traffic access layer Nginx forwards the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster;

[0006] The first signaling service node checks whether the local cache contains a connection session of the second client based on the token, where the second client is the target client that interacts with the first client.

[0007] If the local cache of the first signaling service node contains the connection session of the second client, the interaction information is directly forwarded to the second client through the first signaling service node.

[0008] If the local cache of the first signaling service node does not contain the connection session of the second client, the token and interaction information are broadcast in the signaling service cluster to find the second signaling service node that contains the connection session of the second client in its local cache, and the interaction information is forwarded to the second client through the second signaling service node.

[0009] Furthermore, before Nginx in the traffic access layer forwards the connection request and interaction information carrying the token from the first client to the corresponding first signaling service node in the signaling service cluster, it also includes:

[0010] The first and second clients carry the same token and send access requests to the signaling service nodes in the signaling service cluster through the traffic access layer Nginx.

[0011] The signaling service node verifies the validity of the token and, based on the verification result, caches the token and the corresponding connection sessions of the first and second clients in its local cache.

[0012] Furthermore, the traffic access layer Nginx forwards the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster, specifically including:

[0013] The traffic access layer Nginx is configured with a four-layer load balancer, and according to the load balancer, the connection request and interaction information of the first client carrying the token are forwarded to the first signaling service node in the signaling service cluster.

[0014] Furthermore, the traffic access layer Nginx includes: a primary traffic access layer Nginx and a backup traffic access layer Nginx;

[0015] The method further includes:

[0016] When the primary traffic access layer Nginx fails, it automatically switches to the backup traffic access layer Nginx to work.

[0017] Furthermore, the traffic access layer Nginx maps virtual IPs to the public network for external clients to connect and access.

[0018] Furthermore, the traffic access layer Nginx and the signaling service cluster are located in the same local area network environment.

[0019] Furthermore, the method also includes:

[0020] Add a new signaling service node to the signaling service cluster;

[0021] Adding a new signaling service node to the signaling service cluster specifically includes:

[0022] The IP address of the new signaling service node is set within the local area network environment where the signaling service cluster is located, and the new signaling service node is included in the load balancer of the Nginx traffic access layer.

[0023] On the other hand, the present invention also discloses an information interaction system for a WebRTC client, the system comprising:

[0024] The request and information forwarding module is used by the traffic access layer Nginx to forward the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster.

[0025] The session checking module is used by the first signaling service node to check whether the local cache contains a connection session of the second client based on the token, wherein the second client is the target client that interacts with the first client.

[0026] The information direct forwarding module is used to directly forward the interaction information to the second client through the first signaling service node when the session inspection module determines that the local cache of the first signaling service node contains the connection session of the second client.

[0027] The information broadcasting and forwarding module is used to broadcast the token and interaction information in the signaling service cluster when the session checking module determines that the local cache of the first signaling service node does not contain the connection session of the second client, to find the second signaling service node that contains the connection session of the second client in its local cache, and to forward the interaction information to the second client through the second signaling service node.

[0028] On the other hand, the present invention also discloses a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the following steps:

[0029] The traffic access layer Nginx forwards the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster;

[0030] The first signaling service node checks whether the local cache contains a connection session of the second client based on the token, where the second client is the target client that interacts with the first client.

[0031] If the local cache of the first signaling service node contains the connection session of the second client, the interaction information is directly forwarded to the second client through the first signaling service node.

[0032] If the local cache of the first signaling service node does not contain the connection session of the second client, the token and interaction information are broadcast in the signaling service cluster to find the second signaling service node that contains the connection session of the second client in its local cache, and the interaction information is forwarded to the second client through the second signaling service node.

[0033] On the other hand, the present invention also discloses a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to perform the following steps:

[0034] The traffic access layer Nginx forwards the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster;

[0035] The first signaling service node checks whether the local cache contains a connection session of the second client based on the token, where the second client is the target client that interacts with the first client.

[0036] If the local cache of the first signaling service node contains the connection session of the second client, the interaction information is directly forwarded to the second client through the first signaling service node.

[0037] If the local cache of the first signaling service node does not contain the connection session of the second client, the token and interaction information are broadcast in the signaling service cluster to find the second signaling service node that contains the connection session of the second client in its local cache, and the interaction information is forwarded to the second client through the second signaling service node.

[0038] The present invention has the following beneficial effects:

[0039] This invention enables the forwarding of interactive information between clients connected to different signaling service nodes without the need for middleware. This effectively reduces the complexity of the overall system, avoids the problems of cumbersome information forwarding processes and high maintenance costs caused by the introduction of middleware, and can effectively improve the throughput of signaling services in the system, thus achieving cost reduction and efficiency improvement, while meeting the standards of high concurrency, high scalability, and high performance. Attached Figure Description

[0040] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0041] in:

[0042] Figure 1 This is an application environment diagram of a WebRTC client information interaction method in one embodiment;

[0043] Figure 2 This is a flowchart of a WebRTC client information interaction method in one embodiment;

[0044] Figure 3 This is a block diagram of a WebRTC client information interaction system in one embodiment;

[0045] Figure 4 This is a structural block diagram of a computer device in one embodiment.

[0046] Explanation of reference numerals in the attached diagram: Request and message forwarding module 100, session inspection module 200, direct message forwarding module 210, and message broadcast forwarding module 220. Detailed Implementation

[0047] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0048] Figure 1 This is a diagram illustrating the application environment of a WebRTC client information interaction method in one embodiment. (Refer to...) Figure 1 This WebRTC client information interaction method is applied to an audio and video streaming system, which includes multiple clients, an Nginx traffic access layer, and a signaling service cluster. The signaling service cluster includes multiple signaling service nodes, each corresponding to a different client connection. The clients, Nginx traffic access layer, and signaling service nodes are connected via network communication. The clients interact with other clients to achieve real-time audio and video streaming using WebRTC; the Nginx traffic access layer acts as a proxy for accessing the signaling service nodes, receiving client requests and forwarding them to the signaling service nodes; and the signaling service nodes forward interactive information to enable information exchange between clients.

[0049] Typically, the information exchanged between WebRTC clients in an audio / video streaming system is SDP information. SDP stands for Session Description Protocol, which contains all the information required for an RTP media session, such as media type (audio, video, data), encoder used (Opus, G711, etc.), various parameters used for the encoder, bandwidth information, candidate addresses (for ICE hole punching), and SRTP key material.

[0050] like Figure 2 As shown, in one embodiment, a method for information interaction using a WebRTC client is provided. This method is applied to the aforementioned audio and video streaming system and specifically includes the following steps:

[0051] S100, the traffic access layer Nginx forwards the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster;

[0052] S200: The first signaling service node checks its local cache for a connection session of the second client based on the token. The second client is the target client that interacts with the first client.

[0053] S210. If the local cache of the first signaling service node contains the connection session of the second client, the interaction information is directly forwarded to the second client through the first signaling service node.

[0054] S220. If the local cache of the first signaling service node does not contain the connection session of the second client, the token and interaction information are broadcast in the signaling service cluster to find the second signaling service node that contains the connection session of the second client in its local cache, and the interaction information is forwarded to the second client through the second signaling service node.

[0055] In this embodiment, for the forwarding of interactive information between clients connected to different signaling service nodes, there is no need to pre-configure middleware to store client routing information, nor is it necessary to repeatedly obtain routing information from the middleware before each information forwarding at the signaling service node. Instead, Nginx is only needed to forward the client's request and interactive information carrying a token to the signaling service node. Based on the token, the signaling service node actively checks whether its local cache contains the target client's connection session. If so, it directly forwards the information through its own signaling service node. If not, it broadcasts the token and interactive information in the signaling service cluster within the same network segment to find a signaling service node that contains the target client's connection session in its local cache, and then forwards the information through the newly found signaling service node.

[0056] This embodiment avoids the introduction of middleware for caching client routing information, effectively reducing the complexity of the overall system. At the same time, it avoids the problems of cumbersome information forwarding process and high operation and maintenance costs caused by the introduction of middleware, thereby effectively improving the network processing capacity and signaling service throughput in the real-time audio and video streaming system, achieving the effect of cost reduction and efficiency improvement.

[0057] Furthermore, in one embodiment, before step S100, the method further includes:

[0058] The first and second clients carry the same token and send access requests to the signaling service nodes in the signaling service cluster through the traffic access layer Nginx.

[0059] The signaling service node verifies the validity of the token and, based on the verification result, caches the token and the corresponding connection sessions of the first and second clients in its local cache.

[0060] A token can be understood as an encrypted string generated by the server, serving as a "token" for client requests. It acts as an authentication tool, protecting access to server resources. A client can only access the server if it carries a pre-approved token. After verifying the token's validity, the server caches the token and the client's connection session locally, effectively ensuring the security of information flow within the system.

[0061] Furthermore, in one embodiment, step S100 specifically includes:

[0062] The traffic access layer Nginx is configured with a four-layer load balancer, and according to the load balancer, the connection request and interaction information of the first client carrying the token are forwarded to the first signaling service node in the signaling service cluster.

[0063] In this embodiment, the Nginx traffic access layer is configured with load balancing. According to the load balancing algorithm, client requests and information are forwarded to the signaling service nodes. This effectively and rationally allocates load and traffic based on the actual system operation, alleviating system concurrency pressure, reducing resource pressure on individual devices, enhancing network processing capabilities, improving overall service performance, and increasing signaling service throughput. More specifically, in this embodiment, the load balancing is a four-layer load balancing architecture, which is simple in design and does not require parsing specific message content, further improving network throughput and processing capabilities, and meeting the system's high concurrency and high performance standards.

[0064] Furthermore, in one embodiment, the traffic access layer Nginx includes: a primary traffic access layer Nginx and a backup traffic access layer Nginx;

[0065] The method further includes:

[0066] When the primary traffic access layer Nginx fails, it automatically switches to the backup traffic access layer Nginx to work.

[0067] Furthermore, in one embodiment, the traffic access layer Nginx maps virtual IPs to the public network for external clients to connect and access.

[0068] In one embodiment, the traffic access layer Nginx may include a primary traffic access layer Nginx and a backup traffic access layer Nginx. When the primary traffic access layer Nginx fails, it automatically switches to the backup traffic access layer Nginx to work, thereby enabling Nginx to provide uninterrupted service and improving the stability and high availability of the overall system traffic access layer service.

[0069] Meanwhile, the Nginx traffic access layer maps virtual IPs to the public network for external clients to access, further ensuring the stability of the Nginx traffic access layer through virtual IP address mapping.

[0070] Furthermore, in one embodiment, the traffic access layer Nginx and the signaling service cluster are located in the same local area network environment.

[0071] Since in this interaction method, the traffic access layer Nginx needs to forward the client's connection request and interaction information to the signaling service node in the signaling service cluster, it is necessary to ensure the network connectivity between the traffic access layer Nginx and its upstream signaling service cluster, that is, to ensure that the traffic access layer Nginx and the signaling service cluster are located in the same local area network environment.

[0072] Furthermore, in one embodiment, the method further includes:

[0073] Add a new signaling service node to the signaling service cluster;

[0074] Adding a new signaling service node to the signaling service cluster specifically includes:

[0075] Set the IP address of the new signaling service node within the local area network environment where the signaling service cluster is located, and include the new signaling service node in the load balancer of Nginx at the traffic access layer.

[0076] In this embodiment, a new signaling service node can also be added to the signaling service cluster. Simply set the IP of the new signaling service node within the local area network environment where the signaling service cluster is located, and include the new signaling service node in the load balancer of the traffic access layer Nginx. This solves the problem of horizontal scaling of the signaling service. The process is simple and convenient, effectively further improving the throughput of the signaling service and meeting the high scalability standard.

[0077] On the other hand, such as Figure 3 As shown, in one embodiment, a WebRTC client information interaction system is also provided, the system comprising:

[0078] The request and information forwarding module 100 is used by the traffic access layer Nginx to forward the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster.

[0079] The session checking module 200 is used by the first signaling service node to check whether the local cache contains a connection session of the second client based on the token. The second client is the target client that interacts with the first client.

[0080] The information direct forwarding module 210 is used to directly forward the interaction information to the second client through the first signaling service node when the session inspection module determines that the local cache of the first signaling service node contains the connection session of the second client.

[0081] The information broadcasting and forwarding module 220 is used to broadcast the token and interaction information in the signaling service cluster when the session checking module determines that the local cache of the first signaling service node does not contain the connection session of the second client, to find the second signaling service node that contains the connection session of the second client in its local cache, and to forward the interaction information to the second client through the second signaling service node.

[0082] Figure 4 An internal structural diagram of a computer device in one embodiment is shown. This computer device can specifically be a terminal or a server. Figure 4 As shown, the computer device includes a processor, memory, and network interface connected via a system bus. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and may also store a computer program. When executed by the processor, this computer program enables the processor to implement a WebRTC client-side information interaction method. The internal memory may also store a computer program, which, when executed by the processor, enables the processor to implement a WebRTC client-side information interaction method. Those skilled in the art will understand that... Figure 4The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0083] In one embodiment, a computer device is provided, including a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the following steps:

[0084] The traffic access layer Nginx forwards the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster;

[0085] The first signaling service node checks its local cache for a connection session of the second client based on the token. The second client is the target client that interacts with the first client.

[0086] If the local cache of the first signaling service node contains the connection session of the second client, the interaction information is directly forwarded to the second client through the first signaling service node.

[0087] If the local cache of the first signaling service node does not contain the connection session of the second client, the token and interaction information are broadcast in the signaling service cluster to find the second signaling service node that contains the connection session of the second client in its local cache, and the interaction information is forwarded to the second client through the second signaling service node.

[0088] In one embodiment, a computer-readable storage medium is provided storing a computer program that, when executed by a processor, causes the processor to perform the following steps:

[0089] The traffic access layer Nginx forwards the connection request and interaction information carrying the token from the first client to the first signaling service node in the signaling service cluster;

[0090] The first signaling service node checks its local cache for a connection session of the second client based on the token. The second client is the target client that interacts with the first client.

[0091] If the local cache of the first signaling service node contains the connection session of the second client, the interaction information is directly forwarded to the second client through the first signaling service node.

[0092] If the local cache of the first signaling service node does not contain the connection session of the second client, the token and interaction information are broadcast in the signaling service cluster to find the second signaling service node that contains the connection session of the second client in its local cache, and the interaction information is forwarded to the second client through the second signaling service node.

[0093] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0094] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0095] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A method for information interaction of a WebRTC client, characterized in that The method comprises: Before the traffic access layer Nginx forwards the connection request and interaction information carrying the token Token from the first client to the corresponding first signaling service node in the signaling service cluster, it further comprises: The first client and the second client carry the same token Token and initiate an access request to the signaling service node in the signaling service cluster through the traffic access layer Nginx; The signaling service node verifies the validity of the token Token, and according to the verification result, caches the token Token and the connection session of the corresponding first client and second client in the local cache; The traffic access layer Nginx forwards the connection request and interaction information carrying the token Token from the first client to the first signaling service node in the signaling service cluster; The first signaling service node checks whether the local cache contains the connection session of the second client according to the token Token, and the second client is the target client for information interaction with the first client; If the local cache of the first signaling service node contains the connection session of the second client, the interaction information is directly forwarded to the second client through the first signaling service node; If the local cache of the first signaling service node does not contain the connection session of the second client, the token Token and the interaction information are broadcasted in the signaling service cluster to find a second signaling service node whose local cache contains the connection session of the second client, and the interaction information is forwarded to the second client through the second signaling service node. 2.The information interaction method of a WebRTC client according to claim 1, characterized in that The traffic access layer Nginx forwards the connection request and interaction information carrying the token Token from the first client to the first signaling service node in the signaling service cluster, specifically comprising: The traffic access layer Nginx configures four-layer load balancing, and forwards the connection request and interaction information carrying the token Token from the first client to the first signaling service node in the signaling service cluster according to the load balancing. 3.The information interaction method of a WebRTC client according to claim 1, characterized in that The traffic access layer Nginx comprises a master traffic access layer Nginx and a standby traffic access layer Nginx. The method further comprises: When the master traffic access layer Nginx fails, automatically switch to the standby traffic access layer Nginx for work.

4. The information interaction method of a WebRTC client according to claim 1, characterized in that The traffic access layer Nginx maps a virtual IP to a public network for connection access by external clients.

5. The information interaction method of a WebRTC client according to claim 1, characterized in that The traffic access layer Nginx and the signaling service cluster are located in the same local area network environment.

6. The information interaction method of a WebRTC client according to claim 2, characterized in that The method further comprises: Adding a new signaling service node to the signaling service cluster; Adding a new signaling service node to the signaling service cluster, specifically comprising: Setting the IP of the new signaling service node in the local area network environment where the signaling service cluster is located, and including the new signaling service node in the load balancing of the traffic access layer Nginx.

7. An information interaction system of a WebRTC client, characterized in that The system comprises: The session establishment and cache module is configured to, before the request and information forwarding module works, verify validity of the token in response to an access request initiated by the first client and the second client carrying the same token, and cache the token and connection sessions of the corresponding first client and second client in a local cache; The request and information forwarding module is configured to forward a connection request and interaction information of the first client carrying the token to a first signaling service node in a signaling service cluster by a traffic access layer Nginx; The session checking module is configured to check, by the first signaling service node, whether the local cache contains a connection session of a second client according to the token, the second client being a target client for information interaction with the first client; The information direct forwarding module is configured to, when the session checking module determines that the local cache of the first signaling service node contains the connection session of the second client, directly forward the interaction information to the second client through the first signaling service node; The information broadcast forwarding module is configured to, when the session checking module determines that the local cache of the first signaling service node does not contain the connection session of the second client, broadcast the token and the interaction information in the signaling service cluster, find a second signaling service node in the local cache containing the connection session of the second client, and forward the interaction information to the second client through the second signaling service node.

8. A computer readable storage medium storing a computer program, characterized in that The computer program is executed by the processor, and the processor executes the steps of the method in any one of claims 1 to 6. 9.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is characterized in that The computer program is executed by the processor, and the processor executes the steps of the method in any one of claims 1 to 6.

Images