A method, device and equipment for transmitting information in a multimedia conference

Abstract

The present application discloses a method, device and equipment for information transmission in a multimedia conference, the method comprising: the client first obtains the amount of conference participant information and a preset switching threshold of the multimedia conference at the current moment, then determines the size relationship between the amount of conference participant information and the preset switching threshold, and obtains a judgment result. Then, according to the judgment result, different connection methods with the server can be selected to accurately obtain the conference participant information. In this way, the client switches the different connection methods with the server in a timely manner according to the size relationship between the amount of conference participant information at the current moment and the preset switching threshold, that is, switches the acquisition method of short connection request and long connection push in a timely manner, thereby avoiding performance problems and improving the real-time perception of conference information, thereby improving the user's conference experience.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device and equipment for transmitting information in a multimedia conference. Background Art

[0002] With the continuous breakthroughs in artificial intelligence (AI) technology and the increasing popularity of various terminal devices, users are increasingly using the various functions of terminal devices to make work and life more convenient. For example, users can start a network multimedia conference with other users online through terminal devices. Specifically, a network multimedia conference refers to a conference in which users located in two or more locations transmit active images, voices, and application data (electronic whiteboards, images) in real time through terminal devices and networks. Existing multimedia conference control systems usually include multiple terminal devices and servers that manage and control these multiple terminal devices. After establishing a multimedia conference, multiple terminal devices will connect to the server and obtain relevant media data (such as audio, video, text, etc.) information of the multimedia conference from the server.

[0003] At present, there are usually two ways for the participating client to obtain conference information from the server: one is to obtain incremental changes in conference information through long-term push. Although this method has a low network latency, for large-scale conferences, there are many participants and a large amount of conference information. There will be a large number of long-term messages that need to be pushed, which may cause performance problems such as freezes and white screens after the client receives them in a short period of time; the other is to obtain incremental changes in conference information through short-term requests. Although this method is that the client obtains incremental changes in conference information from the server at a certain pull frequency through a timed active short-term request, it can control the frequency of obtaining information and avoid performance problems. However, the use of the timed pull information method may cause the client to perceive the conference information in a timely manner, resulting in a poor experience for the corresponding user of the client. Summary of the invention

[0004] The main purpose of the embodiments of the present application is to provide a method, device and equipment for information transmission in a multimedia conference, so that the client of the participating user can switch the method of obtaining data information from the server in a timely manner according to a preset switching threshold, thereby avoiding performance problems such as freezing and white screen, while improving the real-time perception of conference information by the client, thereby improving the conference experience of the corresponding participating users.

[0005] The present application provides a method for transmitting information in a multimedia conference, including:

[0006] The client obtains the current number of participants in the multimedia conference and the preset switching threshold;

[0007] The client determines the relationship between the amount of conference information at the current moment and the preset switching threshold, and obtains a determination result;

[0008] The client selects different connection modes with the server according to the judgment result to accurately obtain the conference participation information.

[0009] In a possible implementation, the client selects different connection modes with the server according to the judgment result to accurately obtain the conference information, including:

[0010] When the judgment result is that the amount of conference participant information at the current moment is less than the preset switching threshold, the client continues to obtain the change amount of the conference participant information of the multimedia conference from the server through the long connection push method, and when the cumulative sum of the acquired conference participant information is not less than the preset switching threshold, switches to the short connection request method to continue to obtain the change amount of the conference participant information of the multimedia conference from the server;

[0011] Alternatively, when the judgment result is that the amount of participant information at the current moment is not less than the preset switching threshold, the client continues to periodically obtain the change in the participant information of the multimedia conference from the server through short connection requests, and when the cumulative sum of the obtained participant information is less than the preset switching threshold, switches to long connection push to continue obtaining the change in the participant information of the multimedia conference from the server.

[0012] In a possible implementation, the client obtains the amount of participant information of the multimedia conference at the current moment and a preset switching threshold, including:

[0013] If the client joins the multimedia conference for the first time, the client calls the full interface of the server by using a short connection request to obtain all the participant information and the preset switching threshold of the multimedia conference at the current moment from the server;

[0014] The full interface is a short connection interface provided by the server and includes all the participant information in the multimedia conference.

[0015] In a possible implementation, before the client continues to obtain the change amount of the participant information of the multimedia conference from the server by means of a long connection push, the method further includes:

[0016] The client establishes an information push link with the server in advance based on the websocket protocol;

[0017] The client continues to obtain the change amount of the participant information of the multimedia conference from the server by means of a long connection push, including:

[0018] The client continues to receive the change amount of the participant information of the multimedia conference pushed by the server through the information push link.

[0019] In a possible implementation, the client continues to periodically obtain the change in the participant information of the multimedia conference from the server by means of a short connection request, including:

[0020] The client continues to call the incremental interface of the server periodically according to the preset pulling frequency through the hypertext transfer protocol (http), sends a request to obtain the participant information of the multimedia conference to the server, and receives the change amount of the participant information of the multimedia conference returned by the server in response to the request;

[0021] The incremental interface is a short connection interface provided by the server and includes the change amount of the participant information in the multimedia conference.

[0022] In a possible implementation, when the cumulative sum of the acquired participant information is not less than the preset switching threshold, switching to a short connection request mode to continue acquiring the change amount of the participant information of the multimedia conference from the server includes:

[0023] When the accumulated sum of the acquired conference participant information is not less than the preset switching threshold, the full amount interface of the server is called by a short connection request to obtain all the conference participant information of the multimedia conference at this time from the server;

[0024] It is determined whether the amount of all the participant information of the multimedia conference is not less than the preset switching threshold at this time. If so, a change amount of the participant information of the multimedia conference is continuously obtained from the server by means of a short connection request.

[0025] In a possible implementation, when the accumulated sum of the acquired participant information is less than the preset switching threshold, switching to the long connection push mode to continue acquiring the change amount of the participant information of the multimedia conference from the server includes:

[0026] When the accumulated sum of the acquired conference participant information is less than the preset switching threshold, the full amount interface of the server is called by a short connection request to obtain all the conference participant information of the multimedia conference at this time from the server;

[0027] It is determined whether the amount of all the participant information of the multimedia conference is less than the preset switching threshold at this time. If so, the change amount of the participant information of the multimedia conference is continuously obtained from the server by using the long connection push method.

[0028] In a possible implementation, the preset switching threshold is a threshold of the number of participating users, a threshold of the number of participating devices, or a threshold of conference setting information predetermined by the server according to the participating information of the multimedia conference.

[0029] The embodiment of the present application also provides an information transmission device in a multimedia conference, the device comprising:

[0030] An acquisition unit, used to acquire the amount of participant information of the multimedia conference at the current moment and a preset switching threshold;

[0031] A judgment unit, used to judge the magnitude relationship between the current amount of conference participant information and the preset switching threshold, and obtain a judgment result;

[0032] The selection unit is used to select different connection modes with the server according to the judgment result to accurately obtain the conference participation information.

[0033] In a possible implementation, the selection unit includes:

[0034] A first acquisition subunit is used for, when the judgment result is that the amount of conference participant information at the current moment is less than the preset switching threshold, continuing to obtain the change amount of the conference participant information of the multimedia conference from the server through a long connection push method, and when the cumulative sum of the acquired conference participant information is not less than the preset switching threshold, switching to a short connection request method to continue to obtain the change amount of the conference participant information of the multimedia conference from the server;

[0035] The second acquisition sub-unit is used to continue to periodically obtain the change in the participant information of the multimedia conference from the server through short connection requests when the judgment result is that the amount of participant information at the current moment is not less than the preset switching threshold, and switch to the long connection push method to continue to obtain the change in the participant information of the multimedia conference from the server when the cumulative sum of the obtained amount of participant information is less than the preset switching threshold.

[0036] In a possible implementation, the acquiring unit is specifically configured to:

[0037] When the client first joins the multimedia conference, the client calls the full interface of the server by using a short connection request to obtain all the participant information and the preset switching threshold of the multimedia conference at the current moment from the server;

[0038] The full interface is a short connection interface provided by the server and includes all the participant information in the multimedia conference.

[0039] In a possible implementation manner, the device further includes:

[0040] An establishing unit, configured to establish an information push link with the server based on a websocket protocol before continuing to obtain the change amount of the participant information of the multimedia conference from the server through a long connection push mode;

[0041] The first acquisition subunit is specifically used for:

[0042] The change amount of the participant information of the multimedia conference pushed by the server continues to be received through the information push link.

[0043] In a possible implementation, the second obtaining subunit is specifically configured to:

[0044] Through the hypertext transfer protocol (http), continue to periodically call the incremental interface of the server according to the preset pull frequency, send a request for obtaining the participant information of the multimedia conference to the server, and receive the change amount of the participant information of the multimedia conference returned by the server in response to the request;

[0045] The incremental interface is a short connection interface provided by the server and includes the change amount of the participant information in the multimedia conference.

[0046] In a possible implementation, the first acquiring subunit includes:

[0047] The first calling subunit is used to call the full interface of the server by means of a short connection request when the accumulated sum of the acquired participant information is not less than the preset switching threshold, and obtain all the participant information of the multimedia conference at this time from the server;

[0048] The first judgment subunit is used to judge whether the amount of all the participant information of the multimedia conference is not less than the preset switching threshold at this time. If so, continue to obtain the change amount of the participant information of the multimedia conference from the server by using a short connection request.

[0049] In a possible implementation manner, the second obtaining subunit includes:

[0050] The second calling subunit is used to call the full amount interface of the server by means of a short connection request when the accumulated sum of the acquired amount of participant information is less than the preset switching threshold, and obtain all the participant information of the multimedia conference at this time from the server;

[0051] The second judgment subunit is used to judge whether the amount of all the participant information of the multimedia conference is less than the preset switching threshold at this time. If so, continue to obtain the change amount of the participant information of the multimedia conference from the server by using the long connection push method.

[0052] In a possible implementation, the preset switching threshold is a threshold of the number of participating users, a threshold of the number of participating devices, or a threshold of conference setting information predetermined by the server according to the participating information of the multimedia conference.

[0053] The embodiment of the present application also provides an information transmission device in a multimedia conference, including: a processor, a memory, and a system bus;

[0054] The processor and the memory are connected via the system bus;

[0055] The memory is used to store one or more programs, and the one or more programs include instructions. When the instructions are executed by the processor, the processor executes any one of the implementations of the information transmission method in the multimedia conference.

[0056] The embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device executes any one of the implementation methods of the above-mentioned information transmission method in a multimedia conference.

[0057] In the information transmission method, device and equipment in a multimedia conference provided by the embodiment of the present application, the client first obtains the amount of participant information and the preset switching threshold of the multimedia conference at the current moment; then judges the size relationship between the amount of participant information at the current moment and the preset switching threshold, and obtains a judgment result. Then, according to the judgment result, different connection methods with the server can be selected to accurately obtain the participant information. It can be seen that since the client of the participating user in the embodiment of the present application switches the different connection methods with the server in a timely manner (i.e., switching the short connection request and the long connection push method) according to the size relationship between the amount of participant information at the current moment and the preset switching threshold, and obtains data information from the server, it can avoid the performance problems such as freeze and white screen that may occur when only the long connection push information acquisition method is used, and also avoids the problem that the client may perceive the conference information untimely when only the short connection request information acquisition method is used, thereby improving the participating experience of the client corresponding to the participating user. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0059] Figure 1 A flowchart of an information transmission method in a multimedia conference provided in an embodiment of the present application;

[0060] Figure 2 An overall schematic diagram of the information transmission method in a multimedia conference provided in an embodiment of the present application;

[0061] Figure 3 A schematic diagram of the composition of an information transmission device in a multimedia conference provided in an embodiment of the present application. DETAILED DESCRIPTION

[0062] With the development of the Internet, users are increasingly using the functions of terminal devices to make work and life more convenient. For example, users can start video conferences with other users online through terminal devices (such as mobile phones or tablets). Through online multimedia conferences, users can interact with each other over long distances, and can also start conferences without having to gather in one place. For example, video conferences largely avoid the limitations of traditional face-to-face meetings on location and venue.

[0063] Currently, there are usually two ways for the participating client to obtain conference information from the server: one is to obtain incremental changes in conference information through long-connection push; the other is to obtain incremental changes in conference information through short-connection requests. For the first method, if it is a large conference with a large number of participants and a large amount of conference information, there will be a large number of long-connection messages that need to be pushed, resulting in performance problems after the client receives them in a short period of time. For the second method, since the client needs to obtain information through its own scheduled active short-connection request, although the frequency of obtaining information is controlled and performance problems are avoided, there will be no performance problems for some small meetings with small data volumes. If the method of regularly pulling information is adopted, the client will not perceive the conference information in a timely manner, resulting in a poor conference experience for the corresponding users of the client.

[0064] In order to solve the above defects, the present application provides a method, device and equipment for information transmission in a multimedia conference. The client first obtains the amount of participant information and the preset switching threshold of the multimedia conference at the current moment; then judges the size relationship between the amount of participant information at the current moment and the preset switching threshold, and obtains a judgment result. Then, according to the judgment result, different connection methods with the server can be selected to accurately obtain the participant information. It can be seen that since the client of the participating user in the embodiment of the present application switches the different connection methods with the server in a timely manner (i.e., switching the short connection request and the long connection push method) according to the size relationship between the amount of participant information at the current moment and the preset switching threshold, and obtains data information from the server, it can avoid the performance problems such as freeze and white screen that may occur when only the long connection push information acquisition method is used, and also avoids the problem that the client may perceive the conference information untimely when only the short connection request information acquisition method is used, thereby improving the participating experience of the client corresponding to the participating user.

[0065] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0066] First embodiment

[0067] See also Figure 1 , is a flow chart of an information transmission method in a multimedia conference provided in this embodiment, the method comprising the following steps:

[0068] S101: The client obtains the amount of participants in the multimedia conference at the current moment and a preset switching threshold;.

[0069] In this embodiment, in order to avoid performance issues such as lag and white screen, and to improve the real-time perception of conference information by the client, so as to improve the conference experience of the corresponding participating users, the client first needs to obtain the current amount of conference information of the multimedia conference (defined here as W) and the preset switching threshold (defined here as Y) from the server to execute the subsequent step S102.

[0070] Among them, the amount of information about the participants of the multimedia conference at the current moment may refer to the amount of data of all relevant information of the multimedia conference at the current moment, including but not limited to the amount of information about all participating users in the multimedia conference (for example, the number of participating users), the amount of information about participating devices (for example, the number of participating devices) and the amount of conference setting information. Among them, the participating device may be a device for display, calculation, network transmission and specific operations in the multimedia conference, for example, it can be understood as a client used by the participating users. It is understandable that in a large conference, when receiving and processing a large amount of conference information, some clients may have various performance problems due to their own performance limitations, such as the fifth generation Internet hypertext markup language (Hypertext expression language, HTML) page on the mobile phone application (Application, APP) due to the limitations of the programming language JavaScript (JS) itself, it cannot take up too much central processing unit (CPU) space, when the amount of information processing is too large, it is easy to cause problems such as mobile phone freeze, heating, white screen, etc. The participating user may be the operator of the multimedia conference device, or the user who uses the multimedia conference device to join the multimedia conference. The conference setting information refers to the setting item information of the multimedia conference, for example, it may be an instruction sent by the server to the client to mute all conference participants or an instruction to turn off the cameras of all conference participants.

[0071] In a possible implementation of an embodiment of the present application, the preset switching threshold may be a threshold for the number of participating users, a threshold for the number of participating devices, or a threshold for conference setting information predetermined by the server based on the participating information of the multimedia conference. For example, the preset switching threshold may be that the number of participating users reaches 50, or the number of participating devices reaches 70, etc. Among them, the server is used to receive and process the short connection request from the client, and then give the client a corresponding content response, and is used to actively push the change in conference content to the client through a long connection push based on the change in conference information.

[0072] An optional implementation method is that the implementation method of this step S101 may specifically include: if the client joins the multimedia conference for the first time, use a short connection request to call the full interface of the server to obtain all the participant information and preset switching threshold of the multimedia conference at the current moment from the server.

[0073] It should be noted that, since the amount of multimedia conference information determines the level of the client's performance bottleneck, in this implementation, if the client joins the multimedia conference for the first time, that is, when the client joins the conference, it is necessary to use a short connection request to immediately call the full interface provided by the server to obtain all the participating information W and the preset switching threshold Y of the multimedia conference at the current moment from the server, such as Figure 2 shown.

[0074] Among them, the full interface refers to the short connection interface provided by the server that includes all the participant information in the multimedia conference (such as all participating users, participating devices, and all conference settings, etc.). The short connection request refers to the information acquisition request sent by the client to the server through the Hyper Text Transfer Protocol (http). Furthermore, the mechanism of using short connection requests to obtain conference information is defined as a pull model.

[0075] S102: The client determines the relationship between the amount of conference participant information at the current moment and a preset switching threshold, and obtains a determination result.

[0076] It should be noted that since the amount of multimedia conference information determines the level of the client's performance bottleneck, in this embodiment, after the client obtains the amount of participant information W and the preset switching threshold Y of the multimedia conference at the current moment through step S101, it can further determine the size relationship between the amount of all participant information W at the current moment and the preset switching threshold Y, and obtain a judgment result to execute the subsequent step S103.

[0077] The judgment result may include that the current amount of conference information W is less than the preset switching threshold Y, or that the current amount of conference information W is not less than the preset switching threshold Y.

[0078] S103: The client selects different connection modes with the server according to the determination result to accurately obtain the conference participant information.

[0079] In this embodiment, after the client determines the relationship between the amount of participant information W of the multimedia conference at the current moment and the preset switching threshold Y through step S102, and obtains the judgment result, it can further reasonably select different connection methods with the server based on the relationship between the amount of participant information W of the multimedia conference at the current moment and the preset switching threshold Y as shown by the judgment result, that is, timely switch the acquisition method of short connection request and long connection push, so as to be able to more accurately obtain the participant information while avoiding performance problems, improve the real-time perception of conference information, and thereby improve the user's conference experience.

[0080] Specifically, when the judgment result is that the amount of participating information W at the current moment is less than the preset switching threshold Y, it means that the client has not reached the performance bottleneck. At this time, the client can continue to obtain information from the server by using the long connection push method; on the contrary, if the judgment result is that the amount of participating information W at the current moment is not less than the preset switching threshold Y, it means that if the client continues to obtain information from the server by using the long connection push method at this time, various performance problems (such as freeze, white screen, etc.) may occur. At this time, the client can continue to obtain information from the server regularly according to the preset pull frequency by using the short connection request method (ie, the pull model), where the specific value of the preset pull frequency can be determined according to the client's own performance, and this application does not limit this.

[0081] In a possible implementation of the embodiment of the present application, when the judgment result is that the amount of conference participant information W at the current moment is less than the preset switching threshold Y, the client can further continue to obtain the change amount of the conference participant information of the multimedia conference from the server through a long connection push method (i.e., a push model), such as Figure 2 During this period, the client will use the continuously received changes in the participant information to update the value of the participant information W of the multimedia conference it has obtained, until the cumulative sum of the obtained participant information W is not less than the preset switching threshold Y, and then switch to the short connection request mode (i.e., the pull model) to continue to obtain the changes in the participant information of the multimedia conference from the server (such as changes in conference setting information, changes in the number of participating users, etc.), so as to ensure the normal transmission of information in the multimedia conference and avoid performance problems such as freezes and white screens on the client.

[0082] It should be noted that in order to obtain data information from the server through long-term push, the client also needs to establish an information push link with the server in advance based on the websocket protocol, and then continue to receive the changes in the multimedia conference participant information pushed by the server through the information push link.

[0083] Among them, the websocket protocol is a protocol for full-duplex communication on a single TCP connection, which can make data exchange between the client and the server simpler, allowing the server to actively push data to the client. And in the webSocket API, the browser and the server only need to complete a handshake, and a persistent connection can be directly created between the two, and two-way data transmission can be carried out. Therefore, the long connection push in this application refers to the client receiving the information on the change in the amount of participant information of the multimedia conference actively pushed by the server in real time through the information push link pre-established based on the websocket protocol. Furthermore, the mechanism of using long connection push to obtain conference information is defined as a push model.

[0084] On this basis, in order to further ensure the accuracy of conference information transmission, the specific implementation process of "when the cumulative sum of the acquired conference information amount W is not less than the preset switching threshold Y, switching to the short connection request mode (i.e., pull model) to continue to obtain the change amount of the multimedia conference conference information from the server" in the above implementation method may include the following steps A1-A2:

[0085] Step A1: When the accumulated sum of the acquired conference participant information is not less than the preset switching threshold, the full volume interface of the server is called by means of a short connection request to obtain all the conference participant information of the multimedia conference from the server.

[0086] Specifically, the client uses the continuously received change in the amount of participant information to update the value of the amount of participant information W of the multimedia conference obtained by itself, until the cumulative sum of the updated amount of participant information (i.e., the updated W) is not less than the preset switching threshold Y. Further, in order to further verify the accuracy of the amount of information obtained, before switching the information acquisition method, the client can first use the short connection request method to call the full amount interface of the server to obtain all the participant information of the multimedia conference at this time from the server (i.e., Figure 2 The new W in is used to perform the subsequent step A2.

[0087] Step A2: determine whether the amount of all the participant information of the multimedia conference is not less than the preset switching threshold. If so, continue to obtain the change amount of the participant information of the multimedia conference from the server by means of a short connection request.

[0088] After calling the full interface of the server in step A1 and obtaining all the participant information of the multimedia conference at this time from the server, it is further possible to determine the total participant information of the multimedia conference at this time (i.e. Figure 2 Is the new W in the switching threshold not less than the preset switching threshold? If the amount of all the new multimedia conference participant information obtained at this time (i.e. Figure 2 If the new W in the message is indeed not less than the preset switching threshold, it means that the change in the multimedia conference participant information that the client has continuously received through the long connection push method is accurate, that is, the cumulative sum of the participant information obtained by the client at this time has reached the preset switching threshold. In order to avoid performance problems such as freezing and white screen on the client, it is necessary to switch the information acquisition method and continue to obtain the change in the multimedia conference participant information from the server using the short connection request method. That is, the client can periodically poll the incremental interface according to the preset pull frequency to obtain the change in conference information from the server, such as Figure 2 shown.

[0089] Among them, the pull frequency refers to the frequency of the client requesting the incremental interface, and the unit is times / second. The specific value can be dynamically adjusted by the client according to its own performance or the number of meeting participants. This application does not limit it here. For example, the pull frequency can be set to once / 5 seconds, etc.

[0090] The incremental interface refers to a short connection interface provided by the server that includes the change in the participant information in the multimedia conference (such as a participant user or a participant device has left the conference, a participant user has changed the microphone status, the conference has changed a certain setting, etc.). In actual applications, the incremental interface is a short connection interface that includes the change in the participant information after a cursor (such as offset) in the multimedia conference. In this way, each time the client calls the incremental interface, it can feed back to the client the change in the participant information of all multimedia conferences after the value of offset provided by the client when the incremental interface was last called, and update the value of offset. For example, suppose that when the client calls the incremental interface this time, it provides the value of offset of 10 when it last called the incremental interface, and during this period, there are updates to the participant information of 20 dimensions. At this time, the change in the participant information of 20 dimensions can be fed back to the client, and the value of offset can be updated to 30.

[0091] In another possible implementation of the embodiment of the present application, when the judgment result is that the amount of conference participant information W at the current moment is not less than the preset switching threshold Y, in order to avoid performance problems such as white screen and freeze on the client, the client can further continue to obtain the change amount of the conference participant information of the multimedia conference from the server at a regular interval by means of a short connection request (i.e., a pull model), such as Figure 2 During this period, the client will also use the continuously received changes in the participant information to update the value of the amount of participant information W of the multimedia conference obtained by itself, until the cumulative sum of the obtained participant information (i.e., the updated W) is less than the preset switching threshold Y, and then switch to the long connection push mode (i.e., the push model) to continue to obtain the changes in the participant information of the multimedia conference from the server (such as changes in conference setting information, changes in the number of participating users, etc.), so as to ensure the normal transmission of information in the multimedia conference and avoid the problem of the client not perceiving the conference information in a timely manner.

[0092] Among them, the specific implementation process of the client continuing to periodically obtain the change in the multimedia conference participant information from the server through a short connection request (i.e., a pull model) may include: the client continues to periodically call the server's incremental interface according to a preset pull frequency through the hypertext transfer protocol http, sends a request for obtaining the multimedia conference participant information to the server, and receives the change in the multimedia conference participant information returned by the server in response to the request.

[0093] On this basis, in order to further ensure the accuracy of conference information transmission, the specific implementation process of "when the cumulative sum of the acquired conference information (i.e., updated W) is less than the preset switching threshold Y, switching to the long connection push mode (i.e., push model) to continue to obtain the change amount of the multimedia conference conference information from the server" in the above implementation method may include the following steps B1-B2:

[0094] Step B1: When the accumulated sum of the acquired conference participant information is less than the preset switching threshold, the full volume interface of the server is called by means of a short connection request to obtain all the conference participant information of the multimedia conference from the server.

[0095] Specifically, the client uses the continuously received change in the amount of participant information to update the value of the amount of participant information W of the multimedia conference obtained by itself, until the cumulative sum of the updated amount of participant information (i.e., the updated W) is less than the preset switching threshold Y. Furthermore, in order to further verify the accuracy of the amount of information obtained, before switching the information acquisition method, the client can first use the short connection request method to call the full amount interface of the server to obtain all the participant information of the multimedia conference at this time from the server (i.e., Figure 2 The new W in is used to execute the subsequent step B2.

[0096] Step B2: determining whether the amount of all the participant information of the multimedia conference is less than the preset switching threshold at this time, and if so, continuing to obtain the change amount of the participant information of the multimedia conference from the server by using the long connection push method.

[0097] After calling the full interface of the server in step B1 and obtaining all the participant information of the multimedia conference at this time from the server, it is further possible to determine the total participant information of the multimedia conference at this time (i.e. Figure 2 Is the new W in the switching threshold less than the preset switching threshold? If the amount of all the new multimedia conference participant information obtained at this time (i.e. Figure 2 If the new W in the message is indeed less than the preset switching threshold, it means that the change in the amount of multimedia conference participant information that the client has previously received regularly and continuously through short connection requests is accurate, that is, the cumulative sum of the amount of participant information obtained by the client at this time is already less than the preset switching threshold, and there will be no performance issues such as white screen and freeze. At this time, in order to improve the real-time perception of conference information by the client, it is necessary to switch the information acquisition method and continue to obtain the change in the multimedia conference participant information from the server through the long connection push method. That is, the client can update the value of the conference information volume W stored in itself through the long connection push of the server, which serves as the basis for subsequent judgment on whether to switch the information acquisition method, such as Figure 2 shown.

[0098] In summary, in the information transmission method in a multimedia conference provided by this embodiment, the client first obtains all the information volume and the preset switching threshold of the multimedia conference at the current moment; then judges the size relationship between the amount of conference information at the current moment and the preset switching threshold, and obtains a judgment result. Then, according to the judgment result, different connection methods with the server can be selected to accurately obtain the conference information. It can be seen that since the client of the participating user in the embodiment of the present application switches the different connection methods with the server in a timely manner (i.e., switching the short connection request and the long connection push method) according to the size relationship between the amount of conference information at the current moment and the preset switching threshold, and obtains data information from the server, it can avoid the performance problems such as freeze and white screen that may occur when only the long connection push information acquisition method is used, and also avoids the problem that the client may perceive the conference information untimely when only the short connection request information acquisition method is used, thereby improving the conference experience of the corresponding participating user of the client.

[0099] Second embodiment

[0100] This embodiment will introduce an information transmission device in a multimedia conference. For related content, please refer to the above method embodiment.

[0101] See also Figure 3 , is a schematic diagram of the composition of an information transmission device in a multimedia conference provided in this embodiment, the device 300 includes:

[0102] The acquisition unit 301 is used to acquire the amount of participant information of the multimedia conference at the current moment and the preset switching threshold;

[0103] The judgment unit 302 is used to judge the relationship between the amount of conference participant information at the current moment and the preset switching threshold, and obtain a judgment result;

[0104] The selection unit 303 is used to select different connection modes with the server according to the judgment result to accurately obtain the conference participation information.

[0105] In an implementation of this embodiment, the selection unit 303 includes:

[0106] A first acquisition subunit is used for, when the judgment result is that the amount of conference participant information at the current moment is less than the preset switching threshold, continuing to obtain the change amount of the conference participant information of the multimedia conference from the server through a long connection push method, and when the cumulative sum of the acquired conference participant information is not less than the preset switching threshold, switching to a short connection request method to continue to obtain the change amount of the conference participant information of the multimedia conference from the server;

[0107] The second acquisition sub-unit is used to continue to periodically obtain the change in the participant information of the multimedia conference from the server through short connection requests when the judgment result is that the amount of participant information at the current moment is not less than the preset switching threshold, and switch to the long connection push method to continue to obtain the change in the participant information of the multimedia conference from the server when the cumulative sum of the obtained amount of participant information is less than the preset switching threshold.

[0108] In an implementation of this embodiment, the acquiring unit 301 is specifically configured to:

[0109] If the client joins the multimedia conference for the first time, the client calls the full interface of the server by using a short connection request to obtain all the participant information and the preset switching threshold of the multimedia conference at the current moment from the server;

[0110] The full interface is a short connection interface provided by the server and includes all the participant information in the multimedia conference.

[0111] In an implementation of this embodiment, the device further includes:

[0112] An establishing unit, configured to establish an information push link with the server based on a websocket protocol before continuing to obtain the change amount of the participant information of the multimedia conference from the server through a long connection push mode;

[0113] The first acquisition subunit is specifically used for:

[0114] The change amount of the participant information of the multimedia conference pushed by the server continues to be received through the information push link.

[0115] In an implementation of this embodiment, the second obtaining subunit is specifically configured to:

[0116] Through the hypertext transfer protocol (http), continue to periodically call the incremental interface of the server according to the preset pull frequency, send a request for obtaining the participant information of the multimedia conference to the server, and receive the change amount of the participant information of the multimedia conference returned by the server in response to the request;

[0117] The incremental interface is a short connection interface provided by the server and includes the change amount of the participant information in the multimedia conference.

[0118] In an implementation of this embodiment, the first acquiring subunit includes:

[0119] The first calling subunit is used to call the full interface of the server by means of a short connection request when the accumulated sum of the acquired participant information is not less than the preset switching threshold, and obtain all the participant information of the multimedia conference at this time from the server;

[0120] The first judgment subunit is used to judge whether the amount of all the participant information of the multimedia conference is not less than the preset switching threshold at this time. If so, continue to obtain the change amount of the participant information of the multimedia conference from the server by using a short connection request.

[0121] In an implementation of this embodiment, the second obtaining subunit includes:

[0122] The second calling subunit is used to call the full amount interface of the server by means of a short connection request when the accumulated sum of the acquired amount of participant information is less than the preset switching threshold, and obtain all the participant information of the multimedia conference at this time from the server;

[0123] The second judgment subunit is used to judge whether the amount of all the participant information of the multimedia conference is less than the preset switching threshold at this time. If so, continue to obtain the change amount of the participant information of the multimedia conference from the server by using the long connection push method.

[0124] In an implementation of this embodiment, the preset switching threshold is a threshold of the number of participating users, a threshold of the number of participating devices, or a threshold of conference setting information predetermined by the server according to the participating information of the multimedia conference.

[0125] Furthermore, the embodiment of the present application also provides an information transmission device in a multimedia conference, comprising: a processor, a memory, and a system bus;

[0126] The processor and the memory are connected via the system bus;

[0127] The memory is used to store one or more programs, and the one or more programs include instructions. When the instructions are executed by the processor, the processor executes any one of the implementation methods of the above-mentioned information transmission method in the multimedia conference.

[0128] Furthermore, an embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device executes any one of the implementation methods of the above-mentioned information transmission method in a multimedia conference.

[0129] It can be known from the description of the above implementation mode that those skilled in the art can clearly understand that all or part of the steps in the above-mentioned embodiment method can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., including several instructions for enabling a computer device (which can be a personal computer, a server, or a network communication device such as a media gateway, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0130] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description.

[0131] It should also be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0132] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for transmitting information in a multimedia conference, characterized in that: The method comprises: The client obtains the current number of participants in the multimedia conference and the preset switching threshold; The client determines the relationship between the amount of conference information at the current moment and the preset switching threshold, and obtains a determination result; The client selects different connection modes with the server according to the judgment result to obtain the conference information; The client selects different connection modes with the server according to the judgment result to obtain the conference information, including: When the judgment result is that the amount of conference participant information at the current moment is less than the preset switching threshold, the client continues to obtain the change amount of the conference participant information of the multimedia conference from the server through the long connection push method, and when the cumulative sum of the acquired conference participant information is not less than the preset switching threshold, switches to the short connection request method to continue to obtain the change amount of the conference participant information of the multimedia conference from the server; Alternatively, when the judgment result is that the amount of participant information at the current moment is not less than the preset switching threshold, the client continues to periodically obtain the change in the participant information of the multimedia conference from the server through short connection requests, and when the cumulative sum of the obtained participant information is less than the preset switching threshold, switches to long connection push to continue obtaining the change in the participant information of the multimedia conference from the server.

2. The method according to claim 1, characterized in that The client obtains the amount of participant information of the multimedia conference at the current moment and a preset switching threshold, including: If the client joins the multimedia conference for the first time, the client calls the full interface of the server by using a short connection request to obtain all the participant information and the preset switching threshold of the multimedia conference at the current moment from the server; The full interface is a short connection interface provided by the server and includes all the participant information in the multimedia conference.

3. The method according to claim 1, characterized in that Before the client continues to obtain the change amount of the participant information of the multimedia conference from the server by long connection push, the method further includes: The client establishes an information push link with the server in advance based on the websocket protocol; The client continues to obtain the change amount of the participant information of the multimedia conference from the server by means of a long connection push, including: The client continues to receive the change amount of the participant information of the multimedia conference pushed by the server through the information push link.

4. The method according to claim 1, characterized in that The client continues to periodically obtain the change amount of the participant information of the multimedia conference from the server by means of a short connection request, including: The client continues to call the incremental interface of the server periodically according to a preset pull frequency through the hypertext transfer protocol (http), sends a request to obtain the participant information of the multimedia conference to the server, and receives the change in the participant information of the multimedia conference returned by the server in response to the request; The incremental interface is a short connection interface provided by the server and includes the change amount of the participant information in the multimedia conference.

5. The method according to claim 1, characterized in that When the accumulated sum of the acquired conference participant information is not less than the preset switching threshold, switching to a short connection request mode to continue acquiring the change amount of the conference participant information of the multimedia conference from the server includes: When the accumulated sum of the acquired conference participant information is not less than the preset switching threshold, the full amount interface of the server is called by a short connection request to obtain all the conference participant information of the multimedia conference at this time from the server; It is determined whether the amount of all the participant information of the multimedia conference is not less than the preset switching threshold at this time. If so, a change amount of the participant information of the multimedia conference is continuously obtained from the server by means of a short connection request.

6. The method according to claim 1, characterized in that When the accumulated sum of the acquired conference participant information is less than the preset switching threshold, switching to the long connection push mode to continue acquiring the change amount of the conference participant information of the multimedia conference from the server includes: When the accumulated sum of the acquired conference participant information is less than the preset switching threshold, the full amount interface of the server is called by a short connection request to obtain all the conference participant information of the multimedia conference at this time from the server; It is determined whether the amount of all the participant information of the multimedia conference is less than the preset switching threshold at this time. If so, the change amount of the participant information of the multimedia conference is continuously obtained from the server by using the long connection push method.

7. The method according to any one of claims 1 to 6, characterized in that: The preset switching threshold is a threshold of the number of participating users, a threshold of the number of participating devices, or a threshold of conference setting information pre-determined by the server according to the participating information of the multimedia conference.

8. An information transmission device in a multimedia conference, characterized in that: The device comprises: An acquisition unit, used to acquire the amount of participant information of the multimedia conference at the current moment and a preset switching threshold; A judgment unit, used to judge the magnitude relationship between the current amount of conference participant information and the preset switching threshold, and obtain a judgment result; A selection unit, configured to select different connection modes with the server according to the judgment result to obtain conference information; The selection unit is specifically used to, when the judgment result is that the amount of participant information at the current moment is less than the preset switching threshold, continue to obtain the change in the participant information of the multimedia conference from the server through the long connection push method, and when the cumulative sum of the obtained participant information is not less than the preset switching threshold, switch to the short connection request method to continue to obtain the change in the participant information of the multimedia conference from the server; when the judgment result is that the amount of participant information at the current moment is not less than the preset switching threshold, continue to periodically obtain the change in the participant information of the multimedia conference from the server through the short connection request method, and when the cumulative sum of the obtained participant information is less than the preset switching threshold, switch to the long connection push method to continue to obtain the change in the participant information of the multimedia conference from the server.

9. An information transmission device in a multimedia conference, characterized in that: include: Processor, memory, system bus; The processor and the memory are connected via the system bus; The memory is used to store one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by the processor, the processor executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed on a terminal device, the terminal device executes the method according to any one of claims 1 to 7.

Images