Terminal interaction method, system, computer device and storage medium

Abstract

The application belongs to the technical field of computer communication, and discloses a terminal interaction method, a terminal interaction system, a computer device and a storage medium, wherein the terminal interaction method comprises the following steps: a first media server receives conference signaling forwarded by a signaling server to a first terminal, and establishes a communication connection with the first terminal based on the conference signaling; a negotiation signaling is sent to a second media server corresponding to a second terminal, and the first communication port information is carried in the negotiation signaling; after the second media server receives the negotiation signaling, a second virtual member participating in the conference is generated; a feedback signaling based on the negotiation signaling is received, and the second communication port information is carried in the feedback signaling; and a communication connection with the second media server is established based on the second communication port information. The first terminal and the first media server are in the same area, the communication signal is stable, and the phenomenon of lag in the conference process caused by the connection of the terminal and the media server across areas is reduced or eliminated.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of computer communication, in particular to a terminal interaction method and system, a computer device and a storage medium. BACKGROUND

[0002] In a multi-terminal conference, terminals need to enter a virtual conference room through a media server, and then distribute media data through the media server. The inventor found that when all terminals are connected to the same media server, the communication signal between the terminal and the media server is unstable when there is a cross-region connection between the terminal and the media server, resulting in a phenomenon such as freezing in the virtual conference.

[0003] Therefore, how to improve the communication signal stability of terminal interaction is a problem to be solved. SUMMARY

[0004] The present application provides a terminal interaction method, system, computer device and storage medium, aiming to solve the technical problem of poor communication signal stability of terminal interaction.

[0005] In order to achieve the above-mentioned application purpose, the first aspect of the present application provides a terminal interaction method, comprising:

[0006] The first media server receives the conference signaling forwarded by the signaling server to the first terminal, and establishes a communication connection with the first terminal based on the conference signaling; wherein the conference signaling is a signaling sent by the first terminal to the signaling server, and carries conference information and regional information of the region where the first terminal is located; the first media server is a media server selected by the signaling server in the region of the first terminal;

[0007] Create a first virtual member participating in the conference based on the conference signaling, and determine a second terminal participating in the conference;

[0008] Send a negotiation signaling to the second media server corresponding to the second terminal, wherein the negotiation signaling carries first communication port information corresponding to the first media server; wherein the second media server receives the negotiation signaling and generates a second virtual member participating in the conference;

[0009] Receive the feedback signaling of the second media server based on the negotiation signaling, wherein the feedback signaling carries second communication port information corresponding to the second media server;

[0010] Based on the second communication port information, establish a communication connection with the second media server, realize media data interaction between the first terminal and the second terminal through the first virtual member and the second virtual member.

[0011] Further, the step of the first media server receiving the conference signaling forwarded by the signaling server to the first terminal comprises:

[0012] Obtaining the region information of the region where the first terminal is located through a domain name server;

[0013] Generating, by the first terminal, conference signaling carrying conference information and the region information of the region where the first terminal is located.

[0014] Further, the first media server is the media server with the least number of users in the region of the first terminal.

[0015] Further, the step of the first media server interacting with the media data of the second virtual member after the first virtual member and the second virtual member comprises:

[0016] Receiving the media conference data of the second virtual member;

[0017] Distinguishing the media conference data based on the SSRC and source IP of RTP, and storing the media conference data in the corresponding cache area;

[0018] Distributing the data in the cache area through a conference thread.

[0019] The second aspect of the application provides a terminal interaction system, comprising:

[0020] A signaling server, configured to receive conference signaling sent by a first terminal and carrying conference information and region information of the region where the first terminal is located, and select a first media server adapted based on the region where the first terminal is located;

[0021] A first media server, configured to receive conference signaling forwarded by the signaling server to the first terminal, create a first virtual member participating in a conference based on the conference signaling, and determine a second terminal participating in the conference; and send negotiation signaling to a second media server corresponding to the second terminal, wherein the negotiation signaling carries first communication port information corresponding to the first media server;

[0022] A second media server, configured to receive negotiation signaling and first communication port information corresponding to the first media server sent by the first media server, and generate feedback signaling and a second virtual member participating in the conference after receiving the negotiation signaling; and feed back the feedback signaling to the first media server, wherein the feedback signaling carries second communication port information corresponding to the second media server;

[0023] The first media server and the second media server establish a communication connection based on the first communication port information and the second communication port information, so as to realize media data interaction between the first terminal and the second terminal through the first virtual member and the second virtual member.

[0024] Further, the terminal interaction system further comprises a domain name server configured to obtain the region information of the region where the first terminal is located.

[0025] Further, the signaling server selects a media server with the least number of users in the region of the first terminal as the first media server.

[0026] Further, the signaling server selects a media server with the least number of users in the region of the first terminal as the first media server, comprising:

[0027] The signaling server parses the conference signaling to obtain the region information of the region where the first terminal is located;

[0028] Based on the region information of the region where the first terminal is located, the signaling server searches a local media server in the region where the first terminal is located from a preset media server database;

[0029] The signaling server obtains the current number of users of the local media server, and selects a local media server with the least number of users as the first media server.

[0030] The third aspect of the application provides a computer device, comprising a memory and a processor, the memory stores a computer program, and the processor realizes the steps of the method according to any one of the preceding aspects when executing the computer program.

[0031] The fourth aspect of the application provides a computer readable storage medium, which stores a computer program, and the computer program realizes the steps of the method according to any one of the preceding aspects when executed by a processor.

[0032] Beneficial effects:

[0033] The terminal interaction method, system, computer device and storage medium of the present application, the conference signaling sent by the first terminal carries the area information of the area where it is located, and the signaling server forwards the conference signaling to the first media server in the area where the first terminal is located according to the area information, so that the first terminal and the first media server are in the same area, and the communication signal is stable; then the negotiation instruction carrying the corresponding first communication port information of the first terminal is sent to the corresponding second media server of the second terminal participating in the conference, the second media server determines the communication protocol, data transmission protocol, etc. between the first media server and the second media server based on the negotiation instruction, and feeds back the feedback signaling carrying the second communication port information corresponding to the second media server to the first media server, so that the communication protocol, communication port, etc. between the first media server and the second media server are known to each other, so that the communication connection between the first media server and the second media server can be realized, thereby realizing the communication connection between the first terminal and the second terminal through the first media server and the second media server, and further completing the conference exchange, and the communication signal is smooth, and the phenomenon of conference process jam caused by terminal cross-area connection media server is reduced or eliminated. BRIEF DESCRIPTION OF DRAWINGS

[0034] Figure 1 The flowchart of the terminal interaction method of an embodiment of the present application;

[0035] Figure 2 The generation flowchart of the conference signaling of an embodiment of the present application;

[0036] Figure 3 The flowchart of the terminal interaction method of an embodiment of the present application;

[0037] Figure 4 The signal interaction schematic diagram of the terminal interaction system of an embodiment of the present application;

[0038] Figure 5 The structural schematic block diagram of the computer device of an embodiment of the present application.

[0039] The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings. DETAILED DESCRIPTION

[0040] In order to make the purpose, technical scheme and advantages of the present application more clear, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

[0041] It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. It is further understood that the terms "comprise" and "comprising" and the like, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, components, and / or groups, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. It is further understood that when an element or layer is referred to as being "on" or "connected to" another element or layer, it can be directly on or connected to the other element or layer or intervening elements or layers can be present. In addition, the term "connected" or "coupled" as used herein refers to any connection or coupling, either direct or indirect, between otherwise isolated components. Also, the use of "a" or "an" or "the" preceding an element does not, unless the context clearly indicates otherwise, exclude the presence of

[0042] It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. It is further understood that the terms "comprise" and "comprising" and the like, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, components, and / or groups, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. It is further understood that when an element or layer is referred to as being "on" or "connected to" another element or layer, it can be directly on or connected to the other element or layer or intervening elements or layers can be present. In addition, the term "connected" or "coupled" as used herein refers to any connection or coupling, either direct or indirect, between otherwise isolated components. Also, the use of "a" or "an" or "the" preceding an element does not, unless the context clearly indicates otherwise, exclude the presence of

[0043] Reference Figure 1 The embodiment of the present application provides a terminal interaction method, comprising the following steps:

[0044] S1: a first media server receives conference signaling forwarded by a signaling server to a first terminal, and establishes a communication connection with the first terminal based on the conference signaling; wherein the conference signaling is sent by the first terminal to the signaling server and carries conference information and area information of an area where the first terminal is located; the first media server is a media server selected by the signaling server in the area where the first terminal is located.

[0045] The above-mentioned first media server is a server for forwarding media data and having corresponding computing capability, which is used for connecting with a terminal, receiving, forwarding and processing data sent by the terminal and data sent by other servers.

[0046] The above-mentioned signaling server is a server for receiving, analyzing and forwarding signaling. In the present application, the area information of an area where the first terminal is located in the conference signaling is analyzed to select a suitable first media server in the area.

[0047] The first terminal is a terminal initiating a conference, which can be a mobile phone, a computer device, etc. After the signaling server selects the first media server, the first terminal establishes a communication connection with the first media server, so that the first terminal and the first media server can transmit and interact media conference data.

[0048] S2: creating a first virtual member participating in the conference based on the conference signaling, and determining a second terminal participating in the conference.

[0049] After the first media server receives the conference signaling, the conference signaling is parsed. The conference signaling can carry conference time, conference type, and information of other participants, etc. Then, a conference of a corresponding type is created based on the parsed conference content, and a first virtual member participating in the conference is formed. When the other participants are determined, the first virtual member does not directly connect with the other participants, but determines a second media server corresponding to a second terminal participating in the conference. The second media server is in the same region as the second terminal. The second media server can be multiple, and the second terminal can also be multiple. For example, when multiple second terminals are located in region A, a media server in region A is selected as the second media server to connect the second terminals in region A. When there are also multiple second terminals located in region B, a media server in region B is also selected as the second media server to connect the second terminals in region B. That is, one media server can connect multiple terminals, and the media server and the terminal are in the same region. In this way, the terminals in each region are connected with the media server in the region, the communication signal is stable, the smoothness of the subsequent conference is improved, and the lag is reduced or eliminated.

[0050] S3: sending a negotiation signaling to a second media server corresponding to the second terminal, wherein the negotiation signaling carries first communication port information corresponding to the first media server; wherein the second media server receives the negotiation signaling and generates a second virtual member participating in the conference.

[0051] Because the media server and the media server do not directly connect, but need to negotiate and determine how to correctly connect, a negotiation signaling needs to be sent. The negotiation signaling is a signaling for negotiation between the first media server and the second media server, including a communication protocol and a media conference data format that can be normally used by both the first media server and the second media server, so that the first media server and the second media server can be successfully connected.

[0052] Further, the first media server and the second media server can only negotiate the communication protocol, the media conference data format, etc. and cannot be directly connected, and the communication port information of each other also needs to be known, so the first media server sends the negotiation signaling to the second media server, and also carries the first communication port information corresponding to the first media server.

[0053] The second media server generates the second virtual member participating in the conference after receiving the negotiation signaling.

[0054] S4: receiving the feedback signaling of the second media server based on the negotiation signaling, wherein the second communication port information corresponding to the second media server is carried in the feedback signaling.

[0055] When the second media server determines the communication protocol, the media conference data format, etc. based on the negotiation signaling, the second media server feeds back the negotiation result and carries the second communication port information corresponding to the second media server, so that the first media server and the second media server know the communication interface information of each other. In other embodiments, the second media servers can also know the communication interface information of each other with the assistance of the first media server, so as to establish the communication connection between the second media servers.

[0056] S5: based on the second communication port information, establishing the communication connection with the second media server, and realizing the media data interaction between the first terminal and the second terminal through the first virtual member and the second virtual member.

[0057] When the communication protocol, the media conference data format, etc. are determined between the media servers (the first media server and the second media server), and the communication port information of each other is known, the media data interaction between the first virtual member and the second virtual member can be realized. The media data sent by the first virtual member comes from the first terminal corresponding to the first virtual member, and the media data sent by the second virtual member comes from the second terminal corresponding to the second virtual member.

[0058] The above-mentioned conference creation and the establishment of the first virtual member and the second virtual member can use any one of the existing technologies, as long as the purpose of the multi-terminal interaction of the present application can be realized.

[0059] In the embodiment of the present application, the conference signaling sent by the first terminal carries the area information of the area where the first terminal is located, and the signaling server forwards the conference signaling to the first media server in the area where the first terminal is located according to the area information. In this way, the first terminal and the first media server are in the same area, and the communication signal is stable. Then, the first media server sends a negotiation instruction carrying the corresponding first communication port information of the first terminal to the second media server corresponding to the second terminal participating in the conference. The second media server determines the communication protocol and data transmission protocol between the first media server and the second media server based on the negotiation instruction, and feeds back a feedback signaling carrying the second communication port information corresponding to the second media server to the first media server. In this way, the communication protocol and communication port between the first media server and the second media server are known to each other, so that the first media server and the second media server can be connected in communication, thereby realizing the communication connection between the first terminal and the second terminal through the first media server and the second media server, and further completing the conference communication, and the communication signal is smooth, and the phenomenon of conference process jam caused by the connection of the media server by the terminal across the area is reduced or eliminated.

[0060] With reference to Figure 2 In one embodiment, before the step S1 of receiving the conference signaling sent by the signaling server to the first terminal, the first media server comprises the following steps:

[0061] S101: obtaining the area information of the area where the first terminal is located through a domain name server.

[0062] The domain name server (DNS, Domain Name Server) is a server for converting domain names and corresponding IP addresses. The DNS stores a table of domain names and corresponding IP addresses to parse the domain name of a message. The domain name server can parse the IP address of the first terminal according to the information uploaded by the first terminal, so as to determine the area information of the area where the first terminal is located.

[0063] S102: generating conference signaling carrying conference information and area information of the area where the first terminal is located through the first terminal.

[0064] After receiving the area information fed back by the domain name server, the first terminal generates conference signaling carrying the conference information set by the first terminal according to the conference demand of the user and the area information of the area where the first terminal is located, and then sends the conference signaling to the signaling server to find the first media server in the same area.

[0065] In one embodiment, the first media server is the media server with the least number of users in the area of the first terminal.

[0066] As mentioned above, the first media server is the media server with the least number of users in the first terminal area, so more computing resources can be allocated to the conference initiated by the first terminal, improving the smoothness of the conference, etc.

[0067] Referring to Figure 3 In one embodiment, after the media data interaction S5 between the first virtual member and the second virtual member, the method comprises:

[0068] S6: receiving media conference data of the second virtual member;

[0069] S7: performing data differentiation on the media conference data based on the SSRC and source IP of RTP, and storing the media conference data into the corresponding cache area;

[0070] S8: distributing the data in the cache area through the conference thread.

[0071] As described in steps S6 to S8 above, the media conference data is the media data sent by each second terminal user to the corresponding second media server, including one or more of voice data, video data, picture data, etc. RTP (Real-time Transport Protocol) is a network transmission protocol. SSRC (Synchronization source) is the source of the RTP packet stream, which is identified by the 32-bit SSRC identifier in the RTP header, making it independent of the network address. Usually, changes in microphones, audio interfaces, cameras, and video interfaces will cause changes in SSRC, and two synchronization sources participating in the same video conference cannot be the same. The source IP address is automatically added to the IP packet header by the IP layer when performing IP routing, or manually specified by the client executing the bind function. In this application, the first media server performs data differentiation on the media conference data based on the SSRC and source IP of RTP, and stores the media conference data into the corresponding cache area, which means that the media conference data sent by different second clients is stored in different cache areas, preventing the media conference data of different terminals from being mixed and confused in the same cache area. By storing the media conference data of different terminals in different storage areas and then distributing the data in the cache area through the conference thread, the orderly progress of the conference can be ensured, and situations such as mixed sound can be prevented.

[0072] It should be noted that other second media servers in the conference also locally receive the media conference data of the first virtual member and the media conference data of the second virtual member corresponding to the other second media servers; then distinguish the media conference data based on the SSRC and source IP of RTP, and store the media conference data into the corresponding cache area; finally, the data in the cache area is distributed through the conference thread.

[0073] With reference to Figure 4 The embodiment of the application further provides a terminal interaction system, comprising:

[0074] a signaling server, configured to receive conference signaling sent by a first terminal, the conference signaling carrying conference information and area information of an area where the first terminal is located, and select a first media server adapted based on the area where the first terminal is located;

[0075] the first media server, configured to receive conference signaling forwarded by the signaling server to the first terminal, create a first virtual member participating in a conference based on the conference signaling, and determine a second terminal participating in the conference; and send negotiation signaling to a second media server corresponding to the second terminal, wherein the negotiation signaling carries first communication port information corresponding to the first media server;

[0076] the second media server, configured to receive negotiation signaling sent by the first media server, and generate feedback signaling and a second virtual member participating in the conference after receiving the negotiation signaling; and feed back the feedback signaling to the first media server, wherein the feedback signaling carries second communication port information corresponding to the second media server;

[0077] The first media server and the second media server establish a communication connection based on the first communication port information and the second communication port information, so as to realize media data interaction between the first terminal and the second terminal through the first virtual member and the second virtual member.

[0078] The terminal interaction system is a system for implementing the terminal interaction method, and is composed of a signaling server, a first media server, a second media server, and the like, wherein the first media server and the second media server are configured to connect corresponding terminals participating in the conference.

[0079] In the embodiment, the conference signaling sent by the first terminal carries the area information of the area where the first terminal is located, and the signaling server forwards the conference signaling to the first media server in the area where the first terminal is located according to the area information. In this way, the first terminal and the first media server are in the same area, and the communication signal is stable. Then, the first media server sends a negotiation instruction carrying the corresponding first communication port information of the first terminal to the second media server corresponding to the second terminal participating in the conference. The second media server determines the communication protocol and data transmission protocol between the first media server and the second media server based on the negotiation instruction, and feeds back a feedback signaling carrying the second communication port information corresponding to the second media server to the first media server. In this way, the communication protocol and communication port between the first media server and the second media server are known to each other, so that the first media server and the second media server can be connected in communication, thereby realizing the communication connection between the first terminal and the second terminal through the first media server and the second media server, and further completing the conference communication, and the communication signal is smooth, and the phenomenon of conference process jam caused by the connection of the terminal to the media server across areas is reduced or eliminated.

[0080] In one embodiment, the terminal interaction system further comprises a domain name server for obtaining the area information of the area where the first terminal is located. The above-mentioned domain name server (DNS, Domain Name Server) is a server for converting domain names and corresponding IP addresses. The DNS stores a table of domain names and corresponding IP addresses to parse the domain name of a message. The domain name server can parse the IP address of the first terminal according to the area request information uploaded by the first terminal, so as to determine the area information of the area where the first terminal is located. After receiving the area information fed back by the domain name server, the first terminal generates conference signaling according to the conference information set by the user of the first terminal and the area information of the area where the first terminal is located, and then sends the conference signaling to the signaling server to find the first media server in the same area.

[0081] Further, the signaling server selects the media server with the least number of users in the area of the first terminal as the first media server. Specifically:

[0082] The signaling server parses the conference signaling to obtain the area information of the area where the first terminal is located;

[0083] Based on the area information of the area where the first terminal is located, the local media server in the area where the first terminal is located is searched in a preset media server database;

[0084] The current user quantity of the local media server is acquired, and the local media server with the least user quantity is selected as the first media server.

[0085] As described above, the list corresponding to the media server and the area information is set in the signaling server, when the area information of the first terminal is acquired, all the media servers corresponding to the area can be found, and then the local media server with the least user quantity is selected as the first media server from the media servers. The method for judging which local media server is the local media server with the least user quantity can use any method for judging the user quantity of the server in the prior art, such as acquiring the feedback of each local media server through the inquiry mode to acquire the user quantity of each local media server. The first media server is the media server with the least user quantity in the area of the first terminal, and therefore more computing resources can be allocated to the conference initiated by the first terminal to improve the fluency of the conference and the like.

[0086] With reference to Figure 5 The computer device can have an internal structure as shown in Figure 5The computer device includes a processor, a memory, a network interface and a database connected through a system bus. The processor of the computer device is designed to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores operating devices, computer programs and databases. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database of the computer device is used to store conference data and the like. The network interface of the computer device is used to communicate with external terminals through network connection. Further, the above-mentioned computer device can also be provided with input devices and display screens and the like. The above-mentioned computer program is executed by the processor to realize a terminal interaction method, which includes: a first media server receiving a conference signaling forwarded by a signaling server to a first terminal, and establishing a communication connection with the first terminal based on the conference signaling; wherein the conference signaling is a signaling sent by the first terminal to the signaling server and carrying conference information and regional information of the region where the first terminal is located; the first media server is a media server selected by the signaling server in the region of the first terminal; creating a first virtual member participating in a conference based on the conference signaling, and determining a second terminal participating in the conference; sending a negotiation signaling to a second media server corresponding to the second terminal, wherein the negotiation signaling carries first communication port information corresponding to the first media server; wherein the second media server generates a second virtual member participating in the conference after receiving the negotiation signaling; receiving feedback signaling of the second media server based on the negotiation signaling, wherein the feedback signaling carries second communication port information corresponding to the second media server; based on the second communication port information, establishing a communication connection with the second media server, realizing media data interaction between the first terminal and the second terminal through the first virtual member and the second virtual member.

[0087] In one embodiment, before the step of the first media server receiving the conference signaling forwarded by the signaling server to the first terminal, the method further includes: obtaining regional information of the region where the first terminal is located through a domain name server; and generating a conference signaling carrying conference information and regional information of the region where the first terminal is located through the first terminal.

[0088] In one embodiment, the first media server is a media server with the least number of users in the region of the first terminal.

[0089] In one embodiment, after the media data interaction through the first virtual member and the second virtual member, the method further comprises: receiving media conference data of the second virtual member; distinguishing the media conference data based on an RTP SSRC and a source IP, and storing the media conference data into a corresponding cache area; and distributing the data in the cache area through a conference thread.

[0090] Those skilled in the art can understand that, Figure 5 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied.

[0091] An embodiment of the present application further provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement a terminal interaction method, comprising: a first media server receiving conference signaling forwarded by a signaling server to a first terminal, and establishing a communication connection with the first terminal based on the conference signaling; wherein the conference signaling is signaling sent by the first terminal to the signaling server and carrying conference information and area information of an area where the first terminal is located; the first media server is a media server selected by the signaling server in the area of the first terminal; a first virtual member participating in a conference is created based on the conference signaling, and a second terminal participating in the conference is determined; a negotiation signaling is sent to a second media server corresponding to the second terminal, wherein the negotiation signaling carries first communication port information corresponding to the first media server; wherein the second media server generates a second virtual member participating in the conference after receiving the negotiation signaling; a feedback signaling based on the negotiation signaling is received, wherein the feedback signaling carries second communication port information corresponding to the second media server; and a communication connection with the second media server is established based on the second communication port information, so that the first terminal and the second terminal implement media data interaction through the first virtual member and the second virtual member.

[0092] In one embodiment, before the step of the first media server receiving conference signaling forwarded by a signaling server to a first terminal, the method further comprises: obtaining area information of an area where the first terminal is located through a domain name server; and generating conference signaling carrying conference information and the area information of the area where the first terminal is located through the first terminal.

[0093] In one embodiment, the first media server is a media server with the least number of users in the area of the first terminal.

[0094] In one embodiment, after the media data interaction through the first virtual member and the second virtual member, the method comprises: receiving media conference data of the second virtual member; performing data distinction on the media conference data based on an RTP SSRC and a source IP, and storing the media conference data into a corresponding cache area; and distributing data in the cache area through a conference thread.

[0095] It can be understood that the computer readable storage medium in the embodiment can be a volatile readable storage medium or a non-volatile readable storage medium.

[0096] It can be understood by those skilled in the art that all or part of the processes in the above-mentioned embodiments can be completed by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the computer program can include the processes of the above-mentioned embodiments. Any reference to memory, storage, databases, or other media in this application and in embodiments refers to both non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration but not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (SSRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0097] It should be noted that in this document, the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusions, so that processes, devices, articles, or methods that include a series of elements not only include those elements, but also include other elements not explicitly listed, or inherent to such processes, devices, articles, or methods. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of other identical elements in the process, device, article, or method that includes the element.

[0098] The above merely describes preferred embodiments of the present application, and is not intended to limit the patent scope of the present application, and any equivalent structure or equivalent process conversion made by using the content of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A terminal interaction method, characterized in that, include: The first media server receives conference signaling forwarded to the first terminal by the signaling server, and establishes a communication connection with the first terminal based on the conference signaling; wherein, the conference signaling is sent by the first terminal to the signaling server, and carries conference information and area information of the area where the first terminal is located; the first media server is the media server selected by the signaling server in the area of ​​the first terminal. A meeting is created based on the conference signaling, and a first virtual member representing the first terminal is generated to participate in the meeting, and other participating second terminals are determined; A negotiation signaling message is sent to the second media server corresponding to the second terminal. The negotiation signaling message carries the first communication port information corresponding to the first media server and negotiates the communication protocol and media conference data format between the first media server and the second media server. After receiving the negotiation signaling message, the second media server generates a second virtual member to participate in the conference. Receive feedback signaling from the second media server based on negotiation signaling, wherein the feedback signaling carries the second communication port information corresponding to the second media server; Based on the second communication port information, a communication connection with the second media server is established, enabling the first terminal and the second terminal to interact with each other through the first virtual member and the second virtual member.

2. The terminal interaction method according to claim 1, characterized in that, Before the first media server receives the conference signaling forwarded to the first terminal by the signaling server, the following steps are included: Obtain the region information of the area where the first terminal is located through the domain name server; The first terminal generates a conference signaling message carrying conference information and regional information about the area where the first terminal is located.

3. The terminal interaction method according to claim 1, characterized in that, The first media server is the media server with the fewest users in the first terminal area.

4. The terminal interaction method according to claim 1, characterized in that, After the media data interaction through the first virtual member and the second virtual member, the following is included: Receive media conference data from the second virtual member; Based on RTP-based SSRC and source IP, the media conference data is distinguished and stored in the corresponding cache area; The data in the cache is distributed through a conference thread.

5. A terminal interaction system, characterized in that, include: The signaling server is used to receive conference signaling sent by the first terminal, which carries conference information and regional information of the region where the first terminal is located, and to select an appropriate first media server based on the region where the first terminal is located. The first media server is used to receive conference signals forwarded to the first terminal by the signaling server; Based on the conference signaling, a conference is created and a first virtual member is selected to participate in the conference, as well as other participating second terminals are identified; A negotiation signaling message is sent to the second media server corresponding to the second terminal, wherein the negotiation signaling message carries the first communication port information corresponding to the first media server; The second media server is configured to receive the negotiation signaling sent by the first media server and the first communication port information corresponding to the first media server, and after receiving the negotiation signaling, generate feedback signaling and the second virtual member participating in the meeting; and send the feedback signaling back to the first media server, wherein the feedback signaling carries the second communication port information corresponding to the second media server; The first media server and the second media server establish a communication connection based on the first communication port information and the second communication port information, so as to realize the media data interaction between the first terminal and the second terminal through the first virtual member and the second virtual member.

6. The terminal interaction system according to claim 5, characterized in that, It also includes a domain name server, used to obtain the regional information of the area where the first terminal is located.

7. The terminal interaction system according to claim 5, characterized in that, The signaling server selects the media server with the fewest users in the first terminal area as the first media server.

8. The terminal interaction system according to claim 7, characterized in that, The signaling server selects the media server with the fewest users in the first terminal area as the first media server, including: The signaling server parses the conference signaling to obtain the area information of the region where the first terminal is located; Based on the area information of the area where the first terminal is located, search the preset media server database for the local media server in the area where the first terminal is located. Obtain the current number of users on the local media server, and select the local media server with the fewest users as the first media server.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 4.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 4.

Images