Online conference fusion method, device and computer storage medium

Abstract

The embodiment of the present application provides an online conference fusion method, device and computer storage medium, wherein the target server receives the target conference reservation request sent by the conference initiator through the target client, opens the target conference room according to the conference reservation request, and generates a target conference number for entering the target conference room; according to the server identifier, obtains the first transmission channel between the server and the receiving server, sends the first conference reservation request to the receiving server through the first transmission channel, and receives the first conference number of the first conference room opened by the receiving server according to the first conference reservation request, the target server sends the target conference information of the target conference to the target client, and the target server transmits the conference video and / or conference audio between the server and the receiving server through the first transmission channel. Thus, different conference service systems can be used to join the same conference, which improves the convenience of users participating in the conference and improves the user experience.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of online conference technology, and in particular, to an online conference fusion method, device and computer storage medium. Background Art

[0002] A video conferencing system refers to a system in which the terminals of individuals or groups (i.e., participants) located in two or more different geographical locations transmit the audio, video, and shared data (such as screen sharing data) of the participants to the terminals of other participants through a communication network. Through the video conferencing system, geographically dispersed participants can exchange various data. At present, video conferencing systems are mainly divided into three types: hardware network video conferencing, software network video conferencing, and web video conferencing. Among them, different types of video conferencing systems include different video conferencing services provided by different video conferencing providers. For example, software network video conferencing includes Tencent Conference, Zoom, V2 Conference, Instant Messenger, WeChat, QQ, etc.

[0003] Therefore, there are many types of conference service systems in the prior art, and it is basically difficult for each conference service system to communicate directly. In order to conduct online meetings with multiple users who have installed different conference service systems, users need to install multiple video conferencing clients and apply for multiple accounts, which brings a lot of inconvenience to users. Summary of the invention

[0004] The embodiments of the present application provide an online conference fusion method, device and computer storage medium to solve the problem in the prior art that there are many types of conference service systems and it is basically difficult for each conference service system to communicate directly with each other. In order to conduct online conferences with multiple users who have installed different conference service systems, users need to install multiple video conferencing clients and apply for multiple accounts, which brings a lot of inconvenience to users.

[0005] In a first aspect, an embodiment of the present application provides an online conference fusion method, including:

[0006] The target server receives a target conference reservation request sent by the conference initiator through the target client, the target conference reservation request includes a server identifier of the receiving server and a conference time, the receiving server is used to manage a receiving client of the conference receiver, and the receiving client is of a different type from the target client;

[0007] The target server opens a target conference room according to the conference reservation request and generates a target conference number for entering the target conference room;

[0008] The target server acquires a first transmission channel with the receiving server according to the server identifier;

[0009] The target server sends a first conference reservation request to the receiving server through the first transmission channel, and receives a first conference number of a first conference room opened by the receiving server according to the first conference reservation request, wherein the first conference reservation request includes the conference time;

[0010] The target server sends target conference information of the target conference to the target client, where the target conference information includes the target conference number, the first conference number, and the conference time;

[0011] The target server transmits conference video and / or conference audio to the receiving server via the first transmission channel.

[0012] Optionally, before the target server acquires the first transmission channel with the receiving server according to the server identifier, the method further includes:

[0013] The target server receives a configuration request, where the configuration request is used to configure an interface of the receiving server in the target server, wherein the configuration request includes the server identifier and interface information of the receiving server;

[0014] The target server configures the interface of the receiving server in the target server according to the configuration request and establishes the first transmission channel.

[0015] Optionally, there are multiple receiving servers, and the types of receiving clients managed by each receiving server are different;

[0016] The target server transmits conference video and / or conference audio to the receiving server through the first transmission channel, including:

[0017] The target server obtains the conference video and / or conference audio of any receiving server in real time;

[0018] The target server sends the video and / or conference audio from any of the recipient servers to other recipient servers.

[0019] Optionally, after the target server sends the target conference information of the target conference to the target client, the method further includes:

[0020] The target server receives a conference joining request sent by the target client, wherein the conference joining request includes the target conference number;

[0021] The target server sends the conference video and / or the conference audio to the target client.

[0022] Optionally, the target server sends the conference video to the target client, including:

[0023] The target server receives broadband data between the target client and the target server sent by the target client;

[0024] The target server selects a video encoding algorithm corresponding to the broadband data according to the broadband data;

[0025] The target server decodes the received conference video and re-encodes the decoded conference video according to the video encoding algorithm;

[0026] The target server sends the re-encoded conference video to the target client.

[0027] Optionally, the target server sends the audio and video to the target client, including:

[0028] The target server decodes the received conference audio and re-encodes the decoded conference audio according to the preset audio encoding algorithm;

[0029] The target server sends the re-encoded conference audio to the target client.

[0030] Optionally, the target server sends the conference video and / or the conference audio to the target client, including:

[0031] The target server obtains the conference participation method of the target client, wherein the conference participation method of the target client includes at least one of the following: video conference participation, audio conference participation

[0032] The target server sends the conference video and / or the conference audio corresponding to the conference participation method to the target client according to the conference participation method of the target client.

[0033] In a second aspect, an embodiment of the present application provides an online conference fusion device, including:

[0034] The sending and receiving module is used for the target server to receive the target conference reservation request sent by the conference initiator through the target client, the target conference reservation request includes the server identifier of the receiving server and the conference time, the receiving server is used to manage the receiving client of the conference receiver, and the receiving client is of a different type from the target client;

[0035] A processing module, used for the target server to open a target conference room according to the conference reservation request and generate a target conference number for entering the target conference room;

[0036] An acquisition module, configured for the target server to acquire a first transmission channel with the receiving server according to the server identifier;

[0037] The transmission module is further configured to cause the target server to send a first conference reservation request to the receiving server through the first transmission channel, and receive a first conference number of a first conference room opened by the receiving server according to the first conference reservation request, wherein the first conference reservation request includes the conference time;

[0038] The sending and receiving module is further used for the target server to send the target conference information of the target conference to the target client, wherein the target conference information includes the target conference number, the first conference number, and the conference time;

[0039] The transmission module is also used for transmitting conference video and / or conference audio between the target server and the receiving server through the first transmission channel.

[0040] Optionally, before the target server acquires the first transmission channel with the receiving server through the acquisition module according to the server identifier, the sending and receiving module is further used to:

[0041] The target server receives a configuration request, where the configuration request is used to configure an interface of the receiving server in the target server, wherein the configuration request includes the server identifier and interface information of the receiving server;

[0042] The processing module is also used for the target server to configure the interface of the receiving server in the target server according to the configuration request and establish the first transmission channel.

[0043] Optionally, there are multiple receiving servers, and the types of receiving clients managed by each receiving server are different;

[0044] When the target server transmits the conference video and / or conference audio to the receiving server through the first transmission channel, the transmission module is specifically used to:

[0045] The target server obtains the conference video and / or conference audio of any receiving server in real time;

[0046] The target server sends the video and / or conference audio from any of the recipient servers to other recipient servers.

[0047] Optionally, after the target server sends the target conference information of the target conference to the target client, the sending and receiving module is further used to:

[0048] The target server receives a conference joining request sent by the target client, wherein the conference joining request includes the target conference number;

[0049] The transmission module is also used for the target server to send the conference video and / or the conference audio to the target client.

[0050] Optionally, when the target server sends the conference video to the target client, the transmission module is specifically used to:

[0051] The target server receives broadband data between the target client and the target server sent by the target client;

[0052] The target server selects a video encoding algorithm corresponding to the broadband data according to the broadband data;

[0053] The target server decodes the received conference video and re-encodes the decoded conference video according to the video encoding algorithm;

[0054] The target server sends the re-encoded conference video to the target client.

[0055] Optionally, when the target server sends the audio and video to the target client, the transmission module is specifically used to:

[0056] The target server decodes the received conference audio and re-encodes the decoded conference audio according to the preset audio encoding algorithm;

[0057] The target server sends the re-encoded conference audio to the target client.

[0058] Optionally, when the target server sends the conference video and / or the conference audio to the target client, the transmission module is specifically used to:

[0059] The target server obtains the conference participation method of the target client, wherein the conference participation method of the target client includes at least one of the following: video conference participation and audio conference participation;

[0060] The target server sends the conference video and / or the conference audio corresponding to the conference participation method to the target client according to the conference participation method of the target client.

[0061] In a third aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory;

[0062] Memory stores computer-executable instructions;

[0063] The processor executes the computer execution instructions stored in the memory, so that the processor executes the online conference integration method as described in any one of the first aspects.

[0064] In a fourth aspect, an embodiment of the present application provides a readable storage medium, including a program or an instruction. When the program or the instruction runs on a computer, an online conference integration method such as any one of the above-mentioned first aspects is executed.

[0065] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the online conference fusion method as described in any one of the first aspects.

[0066] In a sixth aspect, an embodiment of the present application provides a chip system, the chip system comprising: a processor and a memory;

[0067] Memory stores computer-executable instructions;

[0068] The processor executes the computer execution instructions stored in the memory, so that the processor executes the online conference integration method as described in any one of the first aspects.

[0069] The embodiment of the present application provides an online conference fusion method, device and computer storage medium, wherein the target server receives the target conference reservation request sent by the conference initiator through the target client, opens the target conference room according to the conference reservation request, and generates a target conference number for entering the target conference room; according to the server identifier, obtains the first transmission channel between the target server and the receiving server, sends the first conference reservation request to the receiving server through the first transmission channel, and receives the first conference number of the first conference room opened by the receiving server according to the first conference reservation request, then, the target server sends the target conference information of the target conference to the target client, and the target server transmits the conference video and / or conference audio between the target server and the receiving server through the first transmission channel. The fusion between the conference service system composed of the target server and the target client and the conference service system composed of the receiving server and the receiving client is realized, so that the two parties of the conference can use different conference service systems, and for either party, the conference service system used by the other party can be installed without installing it, reducing the number of installed conference service systems, and there is no need to apply for multiple conference service system accounts, thereby improving the convenience of users participating in online conferences and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0071] Figure 1 A schematic diagram of an application scenario provided by an embodiment of the present application;

[0072] Figure 2 A flowchart of an online conference integration method provided in one embodiment of the present application;

[0073] Figure 3 A schematic diagram of the structure of an online conference fusion device provided in one embodiment of the present application;

[0074] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0075] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0076] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0077] Video conferencing systems enable high-quality, high-security remote conferences between two or more locations. With the rapid development of the Internet, bandwidth resources are becoming increasingly abundant, making video conferencing systems more widely used in corporate conference rooms and offices, providing high-quality and rich services for remote communication and local collaboration, improving office efficiency, and becoming an indispensable office equipment for enterprises. Among them, video conferencing systems are currently divided into the following three categories:

[0078] (1) Hardware network video conferencing: Relying on dedicated hardware equipment, mainly using multi-point control units (MCU) and video conferencing terminals, cameras, remote controls, omnidirectional microphones, networks, etc., to achieve audio and video processing, network communications and various conference functions. Among them, MCU serves as a hardware conference server. The construction cost of MCU equipment and terminal equipment of the hardware conference system is very high, and it also requires the support of dedicated network lines, so the subsequent operating costs are also very high.

[0079] (2) Software network video conferencing: It is mainly based on the Internet, supports global collaborative work, generally adopts a client / server model, relies mainly on the CPU to process video and audio encoding and decoding, has good openness, and is easy to integrate. Although the software network system has advantages in terms of functions (electronic whiteboard, file transfer, program sharing, etc.), it relies on the audio and video encoding and decoding of the CPU / GPU in terms of audio and video effects, which may result in problems such as being unable to support multiple participants and audio and video transmission delays.

[0080] (3) Web video conferencing: This is a pure web solution based on flash technology. It does not require the installation of hardware equipment, nor does it require the download and installation of any client or plug-in. Instant messaging and video conferencing can be achieved entirely on the web. The web video conferencing system is deployed in the provider's cloud server. The privacy and security of the meeting cannot be guaranteed, the system cannot be self-controlled, and the scalability and extension are very poor. Web video conferencing is not capable of audio and video transmission, especially in the video conferencing industry where real-time requirements are very high, and the sound and video delays are large.

[0081] Among them, various types of video conferencing systems include different video conferencing services provided by different video conferencing system suppliers. For example, software network video conferencing includes Tencent Conference, Zoom, V2 Conference, Instant Messenger, WeChat, QQ, etc. Since each video conferencing service is provided by a different video conferencing supplier, even if the audio and video signal standards used by the video conferencing services are consistent, there is no good integration between the video conferencing services.

[0082] At the same time, since there are a large number of video conferencing services, different users use different video conferencing services. When it is necessary to conduct an online meeting with users who use other video conferencing services, it is necessary to install the video conferencing service used by the user. For users, it is necessary to install multiple video conferencing clients and apply for multiple accounts, which brings a lot of inconvenience to users.

[0083] Therefore, in order to solve the problems existing in the prior art, the present application proposes an online conference fusion method, device and computer storage medium, by pre-configuring the interfaces of other receiving server terminals on the initiator server terminal, and establishing a transmission channel between the initiator server terminal and other receiving server terminals, so that the conference initiator can select at least one receiving client managed by the receiving server terminal from other receiving server terminals on the target client managed by the initiator server terminal to join the conference, so that users using the target client and users using the receiving client can participate in the same conference, and during the conference, the initiator server terminal and the receiving server terminal transmit the conference video and / or conference audio through the transmission channel, that is, the initiator server terminal is regarded as a client of the receiving server terminal, and the fusion between different conference service systems is realized, wherein the conference service system is the general term for the server terminal and the client terminal. In this way, when there are users who use the target client among the users participating in the conference, other users participating in the conference can use different receiving clients, and users do not need to unify the conference service system, reducing the number of installed video conferencing clients and applying for multiple accounts, making it easier for users to hold conferences and improving user experience.

[0084] Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of the present application. Figure 1 As shown, when conducting an online meeting, a user using the target client logs in to the target client through the user terminal 100, a user using the first receiving client logs in to the first receiving client through the user terminal 200, and a user using the second receiving client logs in to the second receiving client through the user terminal 300, wherein the first receiving client and the second receiving client are of different types. Among them, the initiator server 110 is used to manage the target client, the first receiving server 210 is used to manage the first receiving client, and the second receiving server 310 is used to manage the second receiving client. The conference service system composed of the first receiving server 210 and the first receiving client, and the conference service system composed of the second receiving server 310 and the second receiving client can be provided by different suppliers.

[0085] Among them, Figure 1As shown, the initiator server 110 establishes transmission channels with the first receiver server 210 and the second receiver server 310 respectively. When conducting an online meeting, for example, the first receiver client receives the conference audio and conference video collected by the user terminal 200 and sends them to the first receiver server 210. The initiator server 110 obtains the conference audio and conference video on the first receiver server 210 through the transmission channel between the initiator server 110 and the first receiver server 210. Then, the initiator server 110, as a client, transmits the received conference audio and conference video of the user terminal 200 to the second receiver server 310 through the transmission channel between the initiator server 110 and the second receiver server 310, and sends the conference audio and conference video of the user terminal 200 to the target client at the same time, so that the user terminal 100 and the user terminal 300 can receive the conference audio and conference video of the user terminal 200, so that users using different conference service systems can participate in the same online meeting.

[0086] Figure 2 This is a flow chart of an online conference integration method provided in an embodiment of the present application. The execution subject of the method provided in this embodiment may be Figure 1 The initiator server 110 in the embodiment of the present invention can be installed on a server. Figure 2 As shown, the method provided in this embodiment includes:

[0087] S201: A target server receives a target conference reservation request sent by a conference initiator via a target client.

[0088] The target conference reservation request includes a server identifier of a receiving server and a conference time. The receiving server is used to manage a receiving client of the conference receiver. The receiving client is of a different type from the target client.

[0089] Specifically, the target client can be a user terminal, or it can be, for example, an application installed on a mobile phone, or a small program, or computer software installed on a computer. This application does not impose any restrictions on this. The target client is used for users to log in to the conference service system composed of the initiator server and the target client.

[0090] The conference reservation request is usually made by the conference initiator, who operates the target client according to the needs of the conference, and the target client generates a corresponding conference reservation request and transmits the conference reservation request to the initiator's server.

[0091] For example, the meeting initiator logs in to the target client installed on the mobile phone. On the interface after login, icons of other types of clients for joining the meeting will be displayed, such as the names of receiving clients corresponding to various other conference service systems, for example, Tencent Conference, Huawei Conference, Zhumu, etc. The meeting initiator checks the name of the corresponding conference service system on the interface based on the name of the conference service system used by other users participating in the meeting, that is, the conference receiver, which is known in advance. At the same time, the meeting initiator selects information such as the meeting start time, meeting duration, and meeting end time. The target client obtains a meeting appointment request based on the operation received from the meeting initiator, and sends the meeting appointment request to the initiator's server.

[0092] Among them, the meeting reservation request includes the meeting start time, meeting duration, meeting end time and server identification of the receiving client of this online meeting. Among them, the receiving client and the target client are of different types. Therefore, the conference service system composed of the receiving server and the receiving client is of a different type from the conference service system composed of the initiator server and the target client, that is, they are provided by two suppliers.

[0093] S202: The target server opens a target conference room according to the conference reservation request and generates a target conference number for entering the target conference room.

[0094] Specifically, the target server opens the target conference room according to the meeting start time, meeting duration, meeting end time and other information in the meeting reservation request, and generates a target conference number for entering the target conference room, wherein the target conference number is displayed on the interface of the target client software of the meeting initiator, and the meeting initiator can copy and save the target conference number so as to use the target conference number to log in to the target conference room before the meeting start time arrives. Optionally, a QR code can also be displayed on the interface of the client software, and the user can scan the QR code through the target client software to enter the target conference room.

[0095] S203: The target server obtains a first transmission channel with the receiving server according to the server identifier.

[0096] Specifically, the server identifier can uniquely identify the corresponding receiving server. Therefore, the target server can determine the corresponding receiving server according to the server identifier, thereby obtaining the pre-established first transmission channel between the target server and the receiving server.

[0097] In one possible implementation, a method for establishing a first transmission channel between a target server and a receiving server includes:

[0098] S2031. The target server receives a configuration request.

[0099] The configuration request is used to configure the interface of the receiving server in the target server, and the configuration request includes the server identifier and the interface information of the receiving server.

[0100] Specifically, when building or updating the target server, the target server administrator incorporates the server identifier and the interface information of the receiving server into the code corresponding to the target server, thereby configuring the interface of the receiving server on the target server and establishing an association between the interface of the receiving server and the server identifier.

[0101] For example, for software video conferencing systems such as Tencent Conference, Huawei Conference, Zhumu, and ZOOM, the corresponding SDK or API is configured in the target server.

[0102] For different conference services of the hardware video conferencing system, the corresponding MCU information is configured in the target server, for example, the IP address.

[0103] For the configuration methods of different conference services of the web video conferencing system on the target server, please refer to the software video conferencing system, which will not be repeated here.

[0104] Optionally, when building or updating the target server, the target server administrator may also configure the maximum number of conference users supported according to the hardware and network configuration of the server where the target server is located.

[0105] S2032: The target server configures the interface of the receiving server in the target server according to the configuration request, and establishes a first transmission channel.

[0106] Specifically, the target server administrator includes the interface information of the receiving server in the code corresponding to the target server, that is, configures the interface of the receiving server in the target server, and calls the first transmission channel of the interface of the receiving server. The management server and the first server use the IETF XMPP protocol for communication and transmission of conference audio and conference video.

[0107] S204: The target server sends a first conference reservation request to the receiving server through the first transmission channel, and receives a first conference number of a first conference room opened by the receiving server according to the first conference reservation request.

[0108] The first conference reservation request includes the conference time.

[0109] Specifically, the target server generates a first conference reservation request according to the conference reservation request, and sends the first conference reservation request to the receiving server through the first transmission channel, wherein the first conference reservation request includes information such as conference start time, conference duration, and conference end time.

[0110] Among them, the first conference reservation request is consistent with the conference reservation request received by the receiving server from the receiving client managed by it. In this way, after the receiving server receives the first conference reservation request, it performs the next step according to the conference reservation request sent by the receiving client managed by it, that is, opens the first conference room, generates the first conference number, and sends the first conference number to the target server.

[0111] For example, when the target server sends a first conference reservation request to the Tencent Conference server, the first conference reservation request is consistent with the conference reservation request sent by the user to the Tencent Conference server through the Tencent Conference APP. In this way, after receiving the first conference reservation request, the Tencent Conference server creates a conference room and generates a conference number in the same way as after receiving the conference reservation request sent by the Tencent Conference APP. That is, the Tencent Conference server regards the target server as a Tencent Conference APP.

[0112] S205. The target server sends target conference information of the target conference to the target client.

[0113] The target meeting information includes the target meeting number, the first meeting number, and the meeting time.

[0114] Specifically, the target server sends the target conference information of the target conference to the target client, so that the target conference information is displayed on the target client. The conference initiator sends the first conference number and meeting time to the conference recipient via text message or other means. The conference recipient logs in to the recipient client via the first conference number before the meeting start time, enters the first conference room, and holds an online meeting with the conference initiator.

[0115] S206: The target server transmits conference video and / or conference audio to the receiving server via the first transmission channel.

[0116] Specifically, the conference initiator enters the conference initiator's conference room through the target conference number, and the conference recipient enters the first conference room through the first conference number, so that the conference initiator and the conference recipient conduct an online conference.

[0117] During the online conference, the conference video and / or conference audio of the conference initiator is sent to the target server through the target client, and the target server transmits the conference video and / or conference audio of the conference initiator to the first server through the first transmission channel. Correspondingly, the conference video and / or conference audio of the conference receiver is sent to the receiver server through the receiver client, and the receiver server transmits the conference video and / or conference audio of the conference receiver to the target server through the first transmission channel, thereby realizing the online conference between the conference initiator and the conference receiver.

[0118] Among them, when multiple users using the receiving client participate in the meeting through the receiving client, the meeting audio and / or meeting video of one user using the receiving client is also forwarded to other users using the receiving client through the target server.

[0119] It should be noted that the conference initiator and the conference recipient are not necessarily the participants of the conference.

[0120] In this embodiment, the target server receives the target conference reservation request sent by the conference initiator through the target client, opens the target conference room according to the conference reservation request, and generates a target conference number for entering the target conference room; according to the server identifier, obtains the first transmission channel between the target server and the receiving server, sends the first conference reservation request to the receiving server through the first transmission channel, and receives the first conference number of the first conference room opened by the receiving server according to the first conference reservation request, then the target server sends the target conference information of the target conference to the target client, and the target server transmits the conference video and / or conference audio to the receiving server through the first transmission channel. The integration between the conference service system composed of the target server and the target client and the conference service system composed of the receiving server and the receiving client is realized, so that the two parties of the conference can use different conference service systems. For either party, it is not necessary to install the conference service system used by the other party, reducing the number of installed conference service systems, and there is no need to apply for multiple conference service system accounts, thereby improving the convenience of users participating in online meetings and improving user experience.

[0121] In some online meetings, there are multiple participants. When there are more than three participants in an online meeting, it is possible that the conference service systems used by the multiple participants are different. Therefore, in a possible embodiment, there are multiple receiving server terminals, and the types of receiving client terminals managed by each receiving server terminal are different. For example, the receiving client terminals managed by each receiving server terminal are Tencent Conference, Huawei Conference, Zhumu, etc.

[0122] Therefore, S206 includes S2061 and S2062:

[0123] S2061. The target server obtains the conference video and / or conference audio of any receiving server in real time.

[0124] Specifically, the target server captures the conference video and / or conference audio of the corresponding receiving server in real time through the transmission channel between the target server and any receiving server.

[0125] For example, the target server captures the user's conference video and / or conference audio collected by the Tencent Conference software on the mobile phone through the transmission channel between the target server and the Tencent Conference server in real time. At the same time, the target server captures the user's conference video and / or conference audio collected by the Huawei Conference software on the mobile phone through the transmission channel between the target server and the Huawei Conference server in real time. When the user using Tencent Conference or the user using Huawei Conference has voice and / or video, the target server obtains the conference audio and / or conference video.

[0126] S2062. The target server sends the conference video and / or conference audio from any receiving server to other receiving servers.

[0127] Specifically, the target server forwards the captured conference video and / or conference audio of the recipient server to other recipient servers, so that the recipient clients corresponding to the other recipient servers output the conference video and / or conference audio.

[0128] In this embodiment, at least two receiving server ends are indirectly connected through the target server end, so that users using a variety of different conference service systems can conduct online conferences.

[0129] In a possible embodiment, after the target server sends the target conference information of the target conference to the target client, the conference initiator may send the target conference information to multiple users using the target client. Therefore, the method further includes:

[0130] S301: The target server receives a conference joining request sent by the target client.

[0131] The conference joining request includes the target conference number.

[0132] Specifically, multiple users using the target client enter the target conference room using the target conference number on their respective devices on which the target client is installed.

[0133] S302: The target server sends the conference video and / or conference audio to the target client.

[0134] Specifically, the target server sends the received conference video and / or conference audio of the user using the target client to other users using the target client and the receiving server. In addition, the target server sends the captured conference video and / or conference audio of any receiving server to the user using the target client and other receiving servers.

[0135] In this embodiment, the target server can not only connect with the receiving server to achieve integration between different conference service systems, but also support multiple users to use their own target clients to conduct video through the target server.

[0136] During an online meeting, the fluency of audio and video will be affected by the network speed, and the higher the quality of the conference audio and video, the more bandwidth is occupied in the transmission. Thus, when the bandwidth is reduced, the audio and video in the video will be discontinuous. Therefore, in a possible embodiment, S302 includes S3021-S3024:

[0137] S3021. The target server receives broadband data between the target client and the target server sent by the target client.

[0138] Specifically, the target client detects broadband data between the device where the target client is installed and the server where the target server is installed, and sends the broadband data to the target server. For example, the client can send broadband data to the target server in the form of a message, wherein the message adopts the IETF XMPP protocol and the message includes the identifier of the target client.

[0139] Optionally, the target client detects the broadband data between the device where the target client is installed and the server where the target server is installed in real time, or periodically detects the broadband data between the device where the target client is installed and the server where the target server is installed.

[0140] S3022: The target server selects a video encoding algorithm corresponding to the broadband data according to the broadband data.

[0141] S3023. The target server decodes the received conference video and re-encodes the decoded conference video according to a video encoding algorithm.

[0142] Specifically, the target server is configured with multiple algorithms for decoding and encoding videos, and a matching relationship with broadband data is pre-established for the video encoding algorithm. When the target server receives the broadband data, the video encoding algorithm corresponding to the broadband data is selected according to the matching relationship, and the decoded conference video is re-encoded, for example, the resolution and frame rate of the video are adjusted to adapt to different broadband data.

[0143] For example, when the broadband data is reduced to a set range, the H.264 algorithm is used to re-encode the conference video. The H.264 algorithm has a high encoding efficiency and can save about 50% of the bit rate compared to H.263 at the same reconstructed image quality. The H.264 code stream structure has strong network adaptability, increased error recovery capabilities, and can adapt well to the application of IP and wireless networks, reducing the bandwidth occupied by the encoded conference video, so that the encoded conference video can be smoothly transmitted from the target server to the target client. Among them, the encoded conference video can include the client's logo.

[0144] S3024. The target server sends the re-encoded conference video to the target client.

[0145] Specifically, the target server sends the re-encoded conference video to the corresponding target client according to the identifier of the target client included in the conference video, and at the same time sends the conference audio signal to each target client, so that the video and audio displayed on each target client are coherent.

[0146] In a possible embodiment, the requirement for conference audio clarity is relatively high, and the conference audio needs to be encoded twice. Therefore, S302 includes S401 and S402:

[0147] S401: The target server decodes the received conference audio, and re-encodes the decoded conference audio according to a preset audio encoding algorithm.

[0148] S402: The target server sends the re-encoded conference audio to the target client.

[0149] Specifically, when encoding the conference audio, the target server can use an audio encoding algorithm to re-encode the received conference audio to solve the voice delay and echo problems, bring perfect sound quality, and provide a voice call effect that is clearer than a telephone.

[0150] For example, GIPS technology is used for secondary encoding, and GIPS technology can automatically adjust the encoding bit rate according to the bandwidth conditions to provide low bit rate and high-quality audio. GIPS's core technologies, such as network adaptive algorithms, packet loss compensation algorithms and echo cancellation algorithms.

[0151] In a possible embodiment, the user may only need to participate in the meeting through audio or video. For example, in order to improve the clarity of the audio and not watching the video will not affect the conference content heard, the user can choose to participate in the meeting only through audio. Therefore, the method of the present application also includes S501 and S502:

[0152] S501. The target server obtains the conference participation method of the target client.

[0153] Among them, the target client's participation method includes at least one of the following: video participation and audio participation.

[0154] Specifically, users who enter the target conference room through the target conference number sent by the initiator of the conference can select the conference participation method on the interface when logging into the target client or entering the online meeting, thereby sending the user's conference participation method to the target server.

[0155] When the conference initiator also enters the target conference room through the target conference number and logs in to the target client or enters the online meeting, he or she can also select the conference participation method on the interface to send the user's conference participation method to the target server.

[0156] For example, when the target client's conference participation method includes video participation, the user chooses to turn off the speaker on the interface so that the user can participate in the conference only through video.

[0157] For example, when the target client's conference participation method includes audio participation, the user chooses to turn off the camera on the interface so that the user can participate in the conference only through audio.

[0158] For example, when the target client's conference participation methods include video participation and audio participation, the user chooses to turn on the camera and speaker on the interface to participate in the conference via video and audio.

[0159] S502: The target server sends the conference video and / or conference audio corresponding to the conference participation method to the target client according to the conference participation method of the target client.

[0160] Specifically, after receiving the user's conference participation method, the target server sends only the conference video, or only the conference audio, or both the conference video and the conference audio to the corresponding target client according to the user's conference participation method to meet the needs of different users.

[0161] Figure 3 A schematic diagram of the structure of an online conference fusion device provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the online conference fusion device includes: a sending and receiving module 31, a processing module 32, an acquisition module 33 and a transmission module 34.

[0162] Among them, the sending and receiving module 31 is used for the target server to receive the target conference reservation request sent by the conference initiator through the target client, the target conference reservation request includes the server identifier and conference time of the receiving server, the receiving server is used to manage the receiving client of the conference receiver, and the receiving client is of a different type from the target client;

[0163] Processing module 32, used for the target server to open the target conference room according to the conference reservation request and generate a target conference number for entering the target conference room;

[0164] An acquisition module 33 is used for the target server to acquire the first transmission channel between the target server and the receiving server according to the server identifier;

[0165] The transmission module 34 is further configured to send a first conference reservation request from the target server to the receiving server through the first transmission channel, and receive a first conference number of a first conference room opened by the receiving server according to the first conference reservation request, wherein the first conference reservation request includes a conference time;

[0166] The sending and receiving module 31 is also used for the target server to send the target conference information of the target conference to the target client, and the target conference information includes the target conference number, the first conference number, and the conference time;

[0167] The transmission module 34 is also used for the target server to transmit the conference video and / or conference audio to the receiving server through the first transmission channel.

[0168] Optionally, before the target server obtains the first transmission channel with the receiving server through the obtaining module 33 according to the server identifier, the sending and receiving module 31 is further used to:

[0169] The target server receives a configuration request, where the configuration request is used to configure an interface of the receiving server in the target server, wherein the configuration request includes a server identifier and interface information of the receiving server;

[0170] The processing module 32 is also used for the target server to configure the interface of the receiving server in the target server according to the configuration request and establish a first transmission channel.

[0171] Optionally, there are multiple receiving servers, and the types of receiving clients managed by each receiving server are different;

[0172] When the target server transmits the conference video and / or conference audio to the receiving server through the first transmission channel, the transmission module 34 is specifically used to:

[0173] The target server obtains the conference video and / or conference audio of any receiving server in real time;

[0174] The target server sends the video and / or conference audio from any of the recipient servers to other recipient servers.

[0175] Optionally, after the target server sends the target conference information of the target conference to the target client, the sending and receiving module 31 is further used to:

[0176] The target server receives a conference joining request sent by the target client, where the conference joining request includes a target conference number;

[0177] The transmission module 34 is also used for the target server to send the conference video and / or conference audio to the target client.

[0178] Optionally, when the target server sends the conference video to the target client, the transmission module 34 is specifically used to:

[0179] The target server receives broadband data between the target client and the target server sent by the target client;

[0180] The target server selects a video encoding algorithm corresponding to the broadband data according to the broadband data;

[0181] The target server decodes the received conference video and re-encodes the decoded conference video according to the video encoding algorithm;

[0182] The target server sends the re-encoded conference video to the target client.

[0183] Optionally, when the target server sends the audio and video to the target client, the transmission module 34 is specifically used to:

[0184] The target server decodes the received conference audio and re-encodes the decoded conference audio according to a preset audio encoding algorithm;

[0185] The target server sends the re-encoded conference audio to the target client.

[0186] Optionally, when the target server sends the conference video and / or conference audio to the target client, the transmission module 34 is specifically used to:

[0187] The target server obtains a conference participation method of the target client, wherein the conference participation method of the target client includes at least one of the following: video conference participation and audio conference participation;

[0188] The target server sends the conference video and / or conference audio corresponding to the conference participation method to the target client according to the conference participation method of the target client.

[0189] The online conference fusion device provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0190] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, and the electronic device may be a server. Figure 4 As shown, the electronic device includes: a processor 41 and a memory 42 , wherein the processor 41 and the memory 42 are connected via a bus 43 .

[0191] In the specific implementation process, the processor 41 executes the computer execution instructions stored in the memory 42, so that the processor 41 executes the above online conference integration method.

[0192] The specific implementation process of the processor 41 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.

[0193] In the above Figure 4 In the illustrated embodiment, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps of the method disclosed in the application may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0194] The memory may include high-speed RAM memory and may also include non-volatile storage NVM, such as disk storage.

[0195] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0196] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above-mentioned online conference fusion method is implemented.

[0197] The computer-readable storage medium mentioned above can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0198] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.

[0199] An embodiment of the present application provides a chip system, including: a processor and a memory, the memory stores computer execution instructions, and the processor executes the computer execution instructions stored in the memory, so that the processor executes the online conference integration method of the above project.

[0200] The division of units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0201] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0202] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0203] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program codes.

[0204] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0205] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. An online conference fusion method, characterized in that: include: The target server receives a target conference reservation request sent by the conference initiator through the target client, the target conference reservation request includes a server identifier of the receiving server and a conference time, the receiving server is used to manage a receiving client of the conference receiver, and the receiving client is of a different type from the target client; The target server opens a target conference room according to the target conference reservation request and generates a target conference number for entering the target conference room; The target server acquires a first transmission channel with the receiving server according to the server identifier; The target server sends a first conference reservation request to the receiving server through the first transmission channel, and receives a first conference number of a first conference room opened by the receiving server according to the first conference reservation request, wherein the first conference reservation request includes the conference time; The target server sends target conference information of the target conference to the target client, where the target conference information includes the target conference number, the first conference number, and the conference time; The target server transmits conference video and / or conference audio to the receiving server through the first transmission channel; Before the target server acquires the first transmission channel with the receiving server according to the server identifier, the method further includes: The target server receives a configuration request, where the configuration request is used to configure an interface of the receiving server in the target server, wherein the configuration request includes the server identifier and interface information of the receiving server; The target server configures the interface of the receiving server in the target server according to the configuration request and establishes the first transmission channel.

2. The online conference fusion method according to claim 1, characterized in that: There are multiple receiving servers, and the types of receiving clients managed by each receiving server are different; The target server transmits conference video and / or conference audio to the receiving server through the first transmission channel, including: The target server obtains the conference video and / or conference audio of any receiving server in real time; The target server sends the conference video and / or conference audio from any of the recipient servers to other recipient servers.

3. The online conference fusion method according to claim 1 or 2, characterized in that: After the target server sends the target conference information of the target conference to the target client, the method further includes: The target server receives a conference joining request sent by the target client, wherein the conference joining request includes the target conference number; The target server sends the conference video and / or the conference audio to the target client.

4. The online conference fusion method according to claim 3 is characterized in that: The target server sends the conference video to the target client, including: The target server receives broadband data between the target client and the target server sent by the target client; The target server selects a video encoding algorithm corresponding to the broadband data according to the broadband data; The target server decodes the received conference video and re-encodes the decoded conference video according to the video encoding algorithm; The target server sends the re-encoded conference video to the target client.

5. The online conference fusion method according to claim 3 is characterized in that: The target server sends the conference audio to the target client, including: The target server decodes the received conference audio and re-encodes the decoded conference audio according to a preset audio encoding algorithm; The target server sends the re-encoded conference audio to the target client.

6. The online conference fusion method according to claim 3, characterized in that: The target server sends the conference video and / or the conference audio to the target client, including: The target server obtains the conference participation method of the target client, wherein the conference participation method of the target client includes at least one of the following: video conference participation and audio conference participation; The target server sends the conference video and / or the conference audio corresponding to the conference participation method to the target client according to the conference participation method of the target client.

7. An online conference fusion device, characterized in that: include: The sending and receiving module is used for the target server to receive the target conference reservation request sent by the conference initiator through the target client, the target conference reservation request includes the server identifier of the receiving server and the conference time, the receiving server is used to manage the receiving client of the conference receiver, and the receiving client is of a different type from the target client; A processing module, used for the target server to open a target conference room according to the target conference reservation request and generate a target conference number for entering the target conference room; An acquisition module, configured for the target server to acquire a first transmission channel with the receiving server according to the server identifier; The transmission module is further configured to cause the target server to send a first conference reservation request to the receiving server through the first transmission channel, and receive a first conference number of a first conference room opened by the receiving server according to the first conference reservation request, wherein the first conference reservation request includes the conference time; The sending and receiving module is further used for the target server to send the target conference information of the target conference to the target client, wherein the target conference information includes the target conference number, the first conference number, and the conference time; The transmission module is also used for transmitting the conference video and / or conference audio between the target server and the receiving server through the first transmission channel; Wherein, before the target server obtains the first transmission channel with the receiving server through the obtaining module according to the server identifier, the sending and receiving module is further used to: The target server receives a configuration request, where the configuration request is used to configure an interface of the receiving server in the target server, wherein the configuration request includes the server identifier and interface information of the receiving server; The processing module is also used for the target server to configure the interface of the receiving server in the target server according to the configuration request and establish the first transmission channel.

8. An electronic device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the online conference integration method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the online conference fusion method as described in any one of claims 1 to 6 is implemented.

Images