Online conference implementation method, device, equipment and readable storage medium

Abstract

The present application provides an online conference implementation method, apparatus, device and readable storage medium. When the conference mode is in lecturer mode, after the server receives the first voice stream from the first terminal device of the audience in lecturer mode, it determines the signal-to-noise ratio of the first voice stream and processes the first voice stream according to the signal-to-noise ratio. With this solution, the server processes the first voice stream from the audience and the second voice stream from the lecturer in different ways, avoiding the first voice stream from the audience frequently interfering with the lecturer, thereby achieving the purpose of improving the quality of the online conference.

Description

Technical Field

[0001] The present application relates to the field of Internet technology, and specifically to an online conference implementation method, device, equipment and readable storage medium. Background Art

[0002] With the rapid development of Internet technology, online audio and video conferencing has become a common form of meeting in people's daily work. Users can initiate online meetings through applications with online meeting functions and invite other users to participate in the online meetings.

[0003] During an online meeting, the host has management authority. The host can control whether participants can speak by clicking buttons such as "Mute All" and "Unmute All" on the user interface of the electronic device. At the same time, the host can also set whether to allow participants to unmute themselves. When the host allows participants to unmute themselves and the host asks a participant to speak, the participant unmutes on his or her electronic device and speaks.

[0004] During the above meeting, when the host is speaking, if a participant accidentally unmutes himself, the electronic devices of the participants will collect the sounds in the environment, causing the voice quality of the supporter to be frequently affected. Summary of the invention

[0005] The embodiments of the present application disclose an online conference implementation method, apparatus, device and readable storage medium, which achieves the purpose of improving the quality of online conferences by defining the attributes of conference participants and processing the voices of conference participants according to the attributes.

[0006] In a first aspect, an embodiment of the present application provides an online conference implementation method, which is applied to a server, wherein the server establishes a communication connection with at least two terminal devices, and the method includes:

[0007] In the lecturer mode, a first voice stream is received from a first terminal device among the at least two terminal devices, wherein the voice stream of the lecturer and the voice stream of the audience in the lecturer mode correspond to different processing modes, and in the lecturer mode, the audience uses the first terminal device to participate in the conference, and the lecturer uses the second terminal device among the at least two terminals to participate in the conference;

[0008] determining a signal-to-noise ratio of the first voice stream;

[0009] The first voice stream is processed according to the signal-to-noise ratio.

[0010] In a second aspect, an embodiment of the present application provides a method for implementing an online conference, which is applied to a terminal device, and the method includes:

[0011] Sending a first request message to the server, where the first request message is used to request setting a conference mode;

[0012] receiving a first response message from the server, wherein the first response message carries a data stream for presenting a conference mode setting interface;

[0013] Generate and display a conference mode setting interface according to the data stream;

[0014] An instruction message is sent to the server, where the instruction message is used to instruct the user to select the lecturer mode in the conference mode setting interface.

[0015] In a third aspect, an embodiment of the present application provides an online conference implementation device, including:

[0016] A transceiver module, configured to receive a first voice stream from a first terminal device among at least two terminal devices in a lecturer mode, wherein the lecturer's voice stream and the audience's voice stream in the lecturer mode correspond to different processing methods, and the audience uses the first terminal device to participate in the conference in the lecturer mode, and the lecturer uses the second terminal device among the at least two terminals to participate in the conference;

[0017] A determination module, configured to determine a signal-to-noise ratio of the first voice stream;

[0018] A processing module is used to process the first voice stream according to the signal-to-noise ratio.

[0019] In a fourth aspect, an embodiment of the present application provides an online conference implementation device, including:

[0020] A sending module, used for sending a first request message to the server, where the first request message is used for requesting to set a conference mode;

[0021] A receiving module, configured to receive a first response message from the server, wherein the first response message carries a data stream for presenting a conference mode setting interface;

[0022] A processing module, used for generating a conference mode setting interface according to the data stream;

[0023] A display module, used to display the conference mode setting interface;

[0024] The sending module is further used to send an instruction message to the server, where the instruction message is used to instruct the user to select the lecturer mode in the conference mode setting interface.

[0025] The online conference implementation method, apparatus, device, and readable storage medium provided by the embodiment of the present application, when the conference mode is in lecturer mode, after the server receives the first voice stream from the first terminal device of the audience in lecturer mode, it determines the signal-to-noise ratio of the first voice stream and processes the first voice stream according to the signal-to-noise ratio. With this solution, the server processes the first voice stream from the audience and the second voice stream from the lecturer in different ways, avoiding the first voice stream from the audience frequently interfering with the lecturer, thereby achieving the purpose of improving the quality of online conferences. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 It is a schematic diagram of the implementation environment of the online conference implementation method provided in the embodiment of the present application;

[0028] Figure 2 is a flow chart of the online conference implementation method provided by the embodiment of the present application;

[0029] Figure 3 It is a schematic diagram of the process of setting the conference mode in the online conference implementation method provided in the embodiment of the present application;

[0030] Figure 4 is another flow chart of the online conference implementation method provided by the embodiment of the present application;

[0031] Figure 5 It is a flowchart of a method for implementing an online conference provided in an embodiment of the present application;

[0032] Figure 6 A schematic diagram of the structure of an online conference implementation device provided in an embodiment of the present application;

[0033] Figure 7 A schematic diagram of the structure of another online conference implementation device provided in an embodiment of the present application;

[0034] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0036] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0037] In the prior art, in order to ensure that the speaker's voice is not disturbed, the host mutes other participants except the speaker through methods such as "one-click mute" and "all mute". The speaker is also called the lecturer. In this way, even if the non-speaker among the participants makes a sound, the sound will not be transmitted to the server and then forwarded to other participants. In addition to setting the mute for all, the host can also allow participants to unmute themselves so that they can speak.

[0038] However, when the speaker is speaking, if other participants turn on their microphones due to accidental touch or other reasons, the electronic devices will collect the ambient sound and send it to the server. The server will send the host's speech and ambient sound to other electronic devices, causing the sounds played by other electronic devices to include the host's speech and ambient sound, which is noisy and seriously affects the quality of online meetings.

[0039] Based on this, an embodiment of the present application provides an online conference implementation method, which processes the lecturer's voice stream and the audience's voice stream in different ways to achieve the purpose of improving the quality of online conferences.

[0040] Figure 1 This is a schematic diagram of the implementation environment of the online conference implementation method provided in the embodiment of the present application. Figure 1 The implementation environment is a conference system, including a terminal device 11 and a server 12, and the terminal device 11 and the server 12 can communicate through a network.

[0041] The number of terminal devices 11 can be multiple, and the terminal device 11 can be a mobile device such as a mobile phone, a tablet computer, a smart speaker, a wearable device, or a non-mobile device such as a personal computer (PC), a smart TV, a smart screen, but is not limited to this. Online conference software can be installed and run in the terminal device 11, such as a client of an application with an online conference function. In the embodiment of the present application, the type of the application is not limited, such as it can be an application dedicated to realizing the online conference function, or it can be an application integrated with online conference functions and other functions, such as a social application, an instant messaging application, etc.

[0042] In the embodiments of the present application, an online conference is also referred to as an online conference, a network conference, a multimedia conference, etc. It is a multi-person real-time online conference based on multimedia technology, such as a voice conference, a video conference, an audio and video conference, etc. It enables multiple users in different places to achieve real-time, visual, and interactive multimedia communication through a certain transmission medium (such as a network), and distributes a variety of information such as user images, voices, texts, and pictures to the terminals of each user participating in the conference, so that geographically dispersed users can gather together and exchange information through images, sounds, and other methods, thereby increasing the understanding of the content by all users, and making people feel as if they were actually attending a meeting in the same venue.

[0043] The server 12 is used to provide online conference services. For example, the server 12 can be the background server of the above-mentioned application with online conference function, which is used to provide background services for the client, such as realizing the processing and transfer of audio and video signals. The server 12 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms.

[0044] Optionally, the above-mentioned online conference system can be implemented based on cloud technology, thereby providing users with cloud conference (such as cloud video conference) functions. Cloud conference is an efficient, convenient and low-cost conference format based on cloud computing technology. Participants only need to use the Internet interface to perform simple and easy-to-use operations to quickly and efficiently share voice, data files and videos with teams and customers around the world, while the complex technologies such as data transmission and processing in the conference are operated by cloud conference service providers to help users. At present, domestic cloud conferences are mainly concentrated in service content based on the Software as a Service (SaaS) model, including telephone, network, video and other service forms. Video conferences based on cloud computing are called cloud conferences. In the era of cloud conferences, data transmission, processing and storage are all handled by the computer resources of video conference manufacturers. Users no longer need to purchase expensive hardware and install cumbersome software. They only need to open the application or browser and log in to the corresponding interface to conduct efficient remote conferences.

[0045] Figure 1 In the implementation environment shown, the host can initiate a conference creation request through a terminal device 11, and the server 12 responds to the creation request to create a conference. At the same time, the server 12 generates a conference code. Afterwards, other terminal devices 11 can join the conference through the conference code or the like. Alternatively, when the host creates a conference, he sends a conference creation request carrying a participant ID to the server, and the server sends an invitation to the participant's terminal device based on the participant ID to invite other participants to join the conference.

[0046] In the embodiment of the present application, the terminal device 11 is divided into a first terminal device and a second terminal device, the first terminal device is a terminal device of the audience, and the second terminal device is a terminal device of the speaker. Usually, there is one speaker, that is, one second terminal device. For example, in a remote teaching scenario, the lecturer is the teacher, and the other students are the audience. In addition, in some scenarios, there are two second terminal devices and multiple audiences. For example, in a defense scenario, the terminal devices of the tutor and the respondent are both second terminal devices, and the terminal devices of the other audiences are first terminal devices.

[0047] In the embodiment of the present application, the second terminal device can be the terminal device of the host who created the meeting, or it can be the terminal device of other participants, and the embodiment of the present application is not limited. The user sets the lecturer and the audience through the conference mode setting interface of any terminal device. The server determines the first terminal device and the second terminal device from the multiple terminal devices 11 according to the user's settings, and adopts different processing methods for the voice stream from the first terminal device and the voice stream from the second terminal device.

[0048] Below, based on Figure 1The implementation environment shown is used to describe in detail the online conference implementation method provided by the embodiment of the present application. For example, please refer to Figure 2 .

[0049] Figure 2 This is a flow chart of the online conference implementation method provided by the embodiment of the present application. This embodiment is described from the perspective of the interaction between the terminal device and the server, and this embodiment is explained from the perspective of how to set the conference mode. This embodiment includes:

[0050] 201. The terminal device sends a first request message to the server.

[0051] Correspondingly, the server receives the first request message from the terminal device.

[0052] The first request message is used to request setting of a conference mode.

[0053] Exemplarily, the terminal device may be a terminal device for a user to create a conference, or may be another terminal device. The user logs into the conference and sends a first request message to the server by touch, voice, etc. For example, the user speaks to the microphone of the terminal device: "Please set the conference mode", and the terminal device collects the voice and sends it to the server.

[0054] For another example, the user operates on the display screen of the terminal device, clicks a setting button, etc. to enter the conference mode setting interface.

[0055] 202. The server sends a first response message to the terminal device.

[0056] Correspondingly, the terminal device receives a first response message from the server, where the first response message carries a data stream for presenting a conference mode setting interface.

[0057] 203. The terminal device displays the conference mode setting interface according to the data stream.

[0058] Exemplarily, the terminal device performs operations such as decoding on the received data stream, and displays a conference setting interface according to the decoded data stream.

[0059] 204. The terminal device sends an indication message to the server.

[0060] Correspondingly, the server receives an instruction message from the terminal device, where the instruction message is used to instruct the user to select the lecturer mode in the conference mode setting interface.

[0061] Exemplarily, the display screen of the terminal device displays a conference mode setting interface, in which the user selects the lecturer mode through voice, touch and other operations and sends an instruction message to the server.

[0062] Below, the above conference mode setting process is described in detail by taking the user setting the conference mode by touch as an example. Figure 3 .

[0063] Figure 3 This is a schematic diagram of the process of setting the conference mode in the online conference implementation method provided in the embodiment of the present application. Figure 3 , after the terminal device enters the meeting, click the "More" button to enter the "More" interface. Click the "Settings" button in the "More" interface to enter the "Settings" interface. This setting interface is the above-mentioned conference mode setting interface. The user selects "Lecturer Mode" in the conference mode setting interface to enter the lecturer mode.

[0064] When the conference mode is lecturer mode, the server enhances the lecturer's voice stream and processes the audience's voice stream in combination with the signal-to-noise ratio.

[0065] When the conference mode is normal mode, the server processes the voice stream of each speaker in the same way, such as enhancement.

[0066] In the online conference implementation method provided by the embodiment of the present application, the terminal device sends a first request message to the server requesting to set the conference mode, and the server responds to the first request message and sends a data stream for presenting the conference mode setting interface to the terminal device. The terminal device displays the conference mode setting interface according to the data stream, and the user selects the lecturer mode in the conference mode setting interface to enter the lecturer mode. In the lecturer mode, the server enhances the lecturer's voice stream and processes the audience's voice stream in combination with the signal-to-noise ratio, thereby achieving the purpose of improving the quality of online conferences.

[0067] Optionally, in the above embodiment, after the terminal device displays the conference mode setting interface according to the data stream, it also identifies the lecturer information entered by the user in the conference setting interface. Afterwards, the terminal device sends a second request message carrying the lecturer information to the server, so that the server sets the terminal device corresponding to the lecturer information as the second terminal device.

[0068] In lecturer mode, the server needs to distinguish between the lecturer's second terminal device and the audience's first terminal device. In order to enable the server to identify whether the terminal device is the first terminal device or the second terminal device, during the lecturer mode conference, the user can also enter the lecturer information in the conference mode setting interface and send it to the server. For example, please refer to Figure 3 .

[0069] After receiving the lecturer information, the server uses the terminal device corresponding to the lecturer information as the second terminal device. For example, if the lecturer information is "Zhang San", then each time a terminal device joins the meeting, the server identifies whether the user name of the terminal device is "Zhang San". If the user name of the terminal device is "Zhang San", the server uses the terminal device as the second terminal. For another example, if the lecturer information is "Zhang San", and the server finds that the user name of the terminal device that sent the lecturer information is "Zhang San", the server uses the terminal device as the second terminal. In other words, the terminal device can indicate to the server that it or other terminal devices are the second terminal devices.

[0070] With this solution, the terminal device sends lecturer information to the server, so that the server can determine the lecturer's second terminal device and the audience's first terminal device, and then process the lecturer's voice stream and the audience's voice stream in different ways, thereby achieving the purpose of improving the quality of online meetings.

[0071] In the above embodiment, the terminal device sends the lecturer information to the server, so that the server determines which terminal device is the first terminal device and which terminal device is the second terminal device according to the lecturer information. However, the embodiment of the present application is not limited, and in other feasible implementations, the server can also use the terminal device that sends the lecturer information as the second terminal device and default other terminal devices as the first terminal device.

[0072] Figure 4 This is another flow chart of the online conference implementation method provided by the embodiment of the present application. This embodiment is described from the perspective of the server, and the server establishes a communication connection with at least two terminal devices. This embodiment is described from the perspective of how to process the audio stream. This embodiment includes:

[0073] 401. Receive a first voice stream from a first terminal device among the at least two terminal devices in a lecturer mode.

[0074] In the lecturer mode, the lecturer's voice stream and the audience's voice stream correspond to different processing methods. In the lecturer mode, the audience uses the first terminal device to participate in the meeting, and the lecturer uses the second terminal device of the at least two terminal devices to participate in the meeting.

[0075] In the embodiment of the present application, after the meeting is created, the server will distinguish which participants are lecturers and which are audiences according to the lecturer information. Correspondingly, the terminal device used by the lecturer is the second terminal device, and the terminal device used by the audience is the first terminal device. For example, a terminal device table is stored on the server, and the corresponding relationship between the user name and the attribute of each participant is stored in the terminal device table, wherein the attribute is lecturer or audience.

[0076] When the server receives a voice stream, it searches the terminal device table according to the user name corresponding to the voice stream, thereby determining whether the terminal device sending the voice stream is the first terminal device or the second terminal device. When the voice stream is sent from the first terminal device, the voice stream is regarded as the first voice stream, and when the voice stream is sent from the second terminal device, the voice stream is regarded as the second voice stream.

[0077] 402. Determine a signal-to-noise ratio of the first voice stream.

[0078] For the first voice stream, ie, the voice stream from the first terminal device of the listener, the server determines the signal-to-noise ratio of the first voice stream.

[0079] 403. Process the first voice stream according to the signal-to-noise ratio.

[0080] After determining the signal-to-noise ratio, the server determines a method for processing the first voice stream according to the signal-to-noise ratio and processes the first voice stream.

[0081] In the online conference implementation method provided by the embodiment of the present application, when the conference mode is in the lecturer mode, after the server receives the first voice stream from the first terminal device of the audience in the lecturer mode, it determines the signal-to-noise ratio of the first voice stream and processes the first voice stream according to the signal-to-noise ratio. With this solution, the server processes the first voice stream from the audience and the second voice stream from the lecturer in different ways, thereby avoiding the first voice stream from the audience frequently interfering with the lecturer, and achieving the purpose of improving the quality of the online conference.

[0082] Optionally, in the above embodiment, when the server processes the first voice stream according to the signal-to-noise ratio, when the signal-to-noise ratio is less than a preset signal-to-noise ratio, the first voice stream is discarded, and a prompt message is sent to the first terminal device to prompt the listener using the first terminal device to speak closer to the microphone; when the signal-to-noise ratio is greater than or equal to the preset signal-to-noise ratio, the first voice stream is sent to the second terminal device and other first terminal devices, the listeners are at least two, different listeners use different first terminal devices to participate in the meeting, and the other first terminal devices are terminal devices other than the first terminal device that sends the first voice stream.

[0083] Exemplarily, the signal-to-noise ratio refers to the ratio of the strength of the normal sound signal to the strength of the noise signal when the terminal device (the first terminal device or the second terminal device) plays the voice stream. When the signal-to-noise ratio is relatively low, the noise is relatively large. When the terminal device plays the voice stream, the sound heard by the user is turbid and unclear, which seriously affects the sound quality. The server calculates the signal-to-noise ratio based on the power of the normal sound signal and the power of the noise signal. Alternatively, the server calculates the signal-to-noise ratio based on the voltage of the normal sound signal and the voltage of the noise signal.

[0084] After determining the signal-to-noise ratio, the server compares the signal-to-noise ratio with the preset signal-to-noise ratio. When the signal-to-noise ratio is less than the preset signal-to-noise ratio, it means that the noise is relatively large, and it is very likely that the listener accidentally touches the "Unmute" button on the touch screen of the first terminal device, causing the first terminal device to collect the sound in the surrounding environment to obtain the first voice stream and report it to the server. Alternatively, there is another possibility: the listener touches the "Unmute" button and speaks, but the listener is far away from the microphone of the first terminal device, resulting in a relatively small signal-to-noise ratio for the first voice stream collected by the first terminal device. In this case, the server can also send a prompt message to the first terminal device, thereby prompting the listener to speak closer to the microphone of the first terminal device.

[0085] When the signal-to-noise ratio is greater than or equal to the preset signal, it means that the listener is speaking and is relatively close to the microphone of the first terminal device. At this time, the server sends the first voice stream to the second terminal device of the speaker and other listeners other than the speaker, so that the second terminal device and the first terminal devices of other listeners play the first voice stream.

[0086] With this solution, the server processes the first voice stream according to the signal-to-noise ratio. When the signal-to-noise ratio is small, the first voice stream is discarded. When the signal-to-noise ratio is relatively large, the first voice stream is sent to the second terminal device of the speaker or the first terminal device of other listeners, so that the first terminal device or the second terminal device plays the first voice stream, thereby achieving the purpose of accurately processing the first voice stream.

[0087] Optionally, in the above embodiment, before the server receives the first voice stream from the first terminal device among the at least two terminal devices in lecturer mode, it also receives a first request message from a target terminal device among the at least two terminal devices, the first request message being used to request setting of a conference mode, the target terminal device being any one of the at least two terminal devices. Afterwards, the server sends a first response message to the target terminal device, the first response message carrying a data stream for presenting a conference mode setting interface. When the user selects a conference mode, such as lecturer mode, on the conference mode setting interface displayed on the display screen of the target terminal device, an indication message is sent to the server. The server receives an indication message from the target terminal device, the indication message being used to indicate that the user has selected the lecturer mode on the conference mode setting interface.

[0088] In the application embodiment, when creating a meeting, the user can set the meeting mode through any terminal device that enters the meeting (hereinafter referred to as the target terminal device). After the meeting mode is set to lecturer mode, the lecturer is designated by the target terminal device. After the lecturer is designated, the lecturer's terminal device is the second terminal device, and the other terminal devices are the first terminal devices. In addition, it is also possible to default a certain terminal device as the lecturer's second terminal device and other terminal devices as the audience's first terminal devices, and turn on the lecturer mode on the first terminal device or the second terminal device. For the specific lecturer mode setting process, please refer to Figure 2 The embodiments are not described in detail here.

[0089] This solution is adopted to achieve the purpose of flexibly setting the lecturer mode.

[0090] Optionally, in the above embodiment, after receiving the instruction message from the target terminal device, the server also receives a second request message from the target terminal device, the second request message carrying the lecturer information input by the user in the conference mode setting interface. Afterwards, the server determines the second terminal device according to the lecturer information.

[0091] Exemplarily, after setting up the lecturer mode, the user can send the lecturer information to the server through the target terminal device. After receiving the lecturer information, the server searches for the terminal device corresponding to the lecturer information from the connected terminal devices. If there is no terminal device corresponding to the lecturer information among the connected terminal devices, then each time a new terminal device joins the meeting, it is determined whether the new terminal device is the lecturer's terminal device. After determining the lecturer's terminal device, that is, the second terminal device, the remaining terminal devices that have joined the meeting are regarded as the first terminal device and are set to a mute state. Afterwards, if there are more terminal devices joining the meeting, the newly added terminal device is regarded as the first terminal device and is set to a mute state.

[0092] It should be noted that, although the above embodiment uses the same target device to set the conference mode and specify the lecturer as an example to explain the embodiment of the present application in detail. However, the embodiment of the present application is not limited to this. In other feasible implementations, the terminal device for setting the conference mode and the terminal device for specifying the lecturer can be different terminal devices, and the terminal device for setting the conference mode can be a terminal device for creating a conference or a terminal device for not creating a conference. Similarly, the terminal device for specifying the lecturer can be a terminal device for creating a conference or a terminal device for not creating a conference.

[0093] This solution is adopted to achieve the purpose of flexibly assigning lecturers.

[0094] Optionally, in the above embodiment, in the lecturer mode, when the server receives the second voice stream from the second terminal device, it enhances the second voice stream and sends the enhanced second voice stream to the first terminal device.

[0095] For example, in lecturer mode, the server assumes that the lecturer's second voice stream is the voice stream that needs to be sent to the first terminal devices of all listeners and played. Therefore, after receiving the second voice stream, the server performs enhanced amplification processing on the second voice stream to ensure that each first terminal device receives the enhanced second voice stream and plays it, so that the audience can clearly hear the speaker's speech.

[0096] By adopting this solution, the lecturer's second voice stream is enhanced and amplified and sent to each first terminal device, ensuring that the audience can clearly hear the speaker's speech, thereby achieving the purpose of improving the quality of online meetings.

[0097] Optionally, in the above embodiment, when the server enhances the second voice stream, the server separates noise data from the second voice stream. Afterwards, the server determines a noise spectrum of the noise data; and performs noise reduction processing on the second voice stream according to the noise spectrum.

[0098] Exemplarily, after receiving the second voice stream, the server performs separation processing on the second voice stream to obtain noise data in the second voice stream. Afterwards, the server performs spectrum characteristic estimation processing on the noise data to obtain a noise spectrum, and the noise spectrum is used to characterize noise distribution characteristics. Finally, the server performs noise reduction processing on the audio data information according to a preset noise reduction algorithm and the noise spectrum to obtain an enhanced second voice stream. The noise component in the enhanced second voice stream is significantly reduced.

[0099] This solution is used to enhance and amplify the speaker's second voice stream, thereby improving the quality of online meetings.

[0100] Figure 5 This is a flowchart of a method for implementing an online conference provided in an embodiment of the present application. This embodiment includes:

[0101] 501. Set the conference mode to lecturer mode.

[0102] Exemplarily, the server and the terminal device interact to set the conference mode to lecturer mode.

[0103] 502. Determine a lecturer from among multiple meeting participants.

[0104] 503. Determine the audience from among multiple meeting participants.

[0105] Exemplarily, the server divides the conference participants into two categories: lecturers and audiences, and also divides the terminal devices into two categories: first terminal devices of the audiences and second terminal devices of the lecturers.

[0106] 504. When the audience enters the conference, the first terminal device of the audience is muted.

[0107] 505. Turn on the microphone of the first terminal device.

[0108] For example, the user accidentally touches an “unmute” button on the display screen of the first terminal device, thereby turning on the microphone of the first terminal device.

[0109] 506. Determine whether the signal-to-noise ratio of the first voice stream is less than a preset signal-to-noise ratio. When the signal-to-noise ratio of the first voice stream is greater than or equal to the preset signal-to-noise ratio, execute step 507; when the signal-to-noise ratio of the first voice stream is less than the preset signal-to-noise ratio, execute step 508.

[0110] Exemplarily, after the microphone of the first terminal device is turned on, the first terminal device collects the first voice stream and reports it to the server. The server determines the signal-to-noise ratio of the first voice stream and compares it with a preset signal-to-noise ratio.

[0111] 507. Play the first voice stream.

[0112] Exemplarily, the server sends the first voice stream to the second terminal device of the speaker and the first terminal devices of other listeners, so that the second terminal device and the other first terminal devices play the first voice stream.

[0113] 508. Discard the first voice stream and prompt the listener to speak closer to the microphone of the first terminal device.

[0114] Exemplarily, the server mutes the first voice stream and sends a prompt message to the first terminal device to prompt the user of the first terminal device to speak closer to the microphone. After receiving the prompt message, the first terminal device plays or displays the prompt message. When the user hears or sees the prompt message, if the user is indeed speaking, the user speaks closer to the microphone to improve the signal-to-noise ratio; if the user accidentally touches the first terminal device and unmutes it, the user turns off the microphone in time. In this process, the server interacts with the first terminal device of the listener, thereby achieving the purpose of timely reminding the listener.

[0115] 509. Enhance and amplify the second voice stream.

[0116] Exemplarily, the microphone of the second terminal device is in a state, and the second terminal device collects the second voice stream of the lecturer and reports it to the server. The server enhances and amplifies the second voice stream and sends the enhanced and amplified second voice stream to each first terminal device.

[0117] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0118] Figure 6 The schematic diagram of the structure of an online conference implementation device provided in an embodiment of the present application is as follows: The online conference implementation device 600 is arranged on a server, and the online conference implementation device 600 comprises: a transceiver module 61 , a determination module 62 and a processing module 63 .

[0119] The transceiver module 61 is used to receive a first voice stream from a first terminal device among at least two terminal devices in a lecturer mode, wherein the lecturer's voice stream and the audience's voice stream in the lecturer mode correspond to different processing methods, and the audience uses the first terminal device to participate in the conference in the lecturer mode, and the lecturer uses the second terminal device among the at least two terminals to participate in the conference;

[0120] A determination module 62, configured to determine a signal-to-noise ratio of the first voice stream;

[0121] The processing module 63 is configured to process the first voice stream according to the signal-to-noise ratio.

[0122] In a feasible implementation, the processing module 63 is used to discard the first voice stream when the signal-to-noise ratio is less than a preset signal-to-noise ratio, and the transceiver module 61 is further used to send a prompt message to the first terminal device to prompt the listener using the first terminal device to speak closer to the microphone;

[0123] When the determination module 62 determines that the signal-to-noise ratio is greater than or equal to a preset signal-to-noise ratio, the transceiver module 61 is further used to send the first voice stream to the second terminal device and other first terminal devices, the number of listeners is at least two, and different listeners use different first terminal devices to participate in the meeting, and the other first terminal devices are terminal devices other than the first terminal device that sends the first voice stream.

[0124] In a feasible implementation, the transceiver module 61, before receiving the first voice stream from the first terminal device among the at least two terminal devices in the lecturer mode, is also used to receive a first request message from a target terminal device among the at least two terminal devices, the first request message being used to request setting a conference mode, the target terminal device being any one of the at least two terminal devices; sending a first response message to the target terminal device, the first response message carrying a data stream for presenting a conference mode setting interface; and receiving an indication message from the target terminal device, the indication message being used to instruct a user to select the lecturer mode in the conference mode setting interface.

[0125] In a feasible implementation, after receiving the instruction message from the target terminal device, the transceiver module 61 is further used to receive a second request message from the target terminal device, where the second request message carries the lecturer information input by the user in the conference mode setting interface;

[0126] The processing module 63 is further configured to determine the first terminal device and the second terminal device from the at least two terminal devices according to the lecturer information.

[0127] In a feasible implementation, the transceiver module 61 is further configured to receive a second voice stream from the second terminal device in the lecturer mode;

[0128] The processing module 63 is further used to enhance the second voice stream;

[0129] The transceiver module 61 is further configured to send the enhanced second voice stream to the first terminal device.

[0130] In a feasible implementation, when the processing module 63 enhances the second voice stream, it is used to separate noise data from the second voice stream; determine the noise spectrum of the noise data; and perform noise reduction processing on the second voice stream according to the noise spectrum.

[0131] The online conference implementation device provided in the embodiment of the present application can execute the actions of the server in the above embodiment. Its implementation principle and technical effects are similar and will not be repeated here.

[0132] Figure 7 A schematic diagram of another online conference implementation device provided in an embodiment of the present application. The online conference implementation device 700 is arranged on a terminal device, and the online conference implementation device 700 includes: a sending module 71 , a receiving module 72 , a processing module 73 and a display module 74 .

[0133] A sending module 71, configured to send a first request message to a server, wherein the first request message is used to request setting a conference mode;

[0134] A receiving module 72, configured to receive a first response message from the server, wherein the first response message carries a data stream for presenting a conference mode setting interface;

[0135] A processing module 73, configured to generate a conference mode setting interface according to the data stream;

[0136] Display module 74, used to display the conference mode setting interface;

[0137] The sending module 71 is further used to send an instruction message to the server, where the instruction message is used to instruct the user to select the lecturer mode in the conference mode setting interface.

[0138] In a feasible implementation, the processing module 73 is further used to identify the lecturer information input by the user in the conference setting interface after the display module 74 displays the conference setting interface;

[0139] The sending module 71 is further configured to send a second request message carrying the lecturer information to the server, so that the server sets the terminal device corresponding to the lecturer information as the second terminal device.

[0140] In a feasible implementation, when the terminal device is the first terminal device of the audience, the receiving module 72 is further used to receive prompt information from the server;

[0141] The processing module 73 is further configured to play the prompt information to prompt the audience to speak close to the microphone of the first terminal device.

[0142] The online conference implementation device provided in the embodiment of the present application can execute the actions of the first terminal device or the second terminal device in the above embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0143] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 8 As shown, the electronic device 800 includes:

[0144] Processor 81 and memory 82;

[0145] The memory 82 stores computer instructions;

[0146] The processor 81 executes the computer instructions stored in the memory 82, so that the processor 81 implements the online conference implementation method as described above.

[0147] The specific implementation process of the processor 81 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.

[0148] Optionally, the electronic device 800 further includes a communication component 83 , wherein the processor 81 , the memory 82 and the communication component 83 may be connected via a bus 84 .

[0149] An embodiment of the present application also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed by a processor, they are used to implement the online conference implementation method as described above.

[0150] An embodiment of the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the online conference implementation method as described above.

[0151] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0152] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A method for implementing an online conference, characterized in that: Applied to a server, the server establishing a communication connection with at least two terminal devices, the method comprising: In lecturer mode, a first voice stream is received from a first terminal device among the at least two terminal devices, wherein the lecturer's voice stream and the audience's voice stream correspond to different processing modes, wherein the audience uses the first terminal device to participate in the conference and the lecturer uses the second terminal device among the at least two terminals to participate in the conference, wherein the lecturer mode is set according to the user's settings, wherein the second terminal device is determined to be obtained according to the terminal device corresponding to the lecturer information, wherein the first terminal device is a terminal device other than the second terminal device among the at least two terminal devices, and wherein the first terminal device is set to a mute state when the first terminal device is determined to be obtained; determining a signal-to-noise ratio of the first voice stream; processing the first voice stream according to the signal-to-noise ratio; The processing of the first voice stream according to the signal-to-noise ratio comprises: When the signal-to-noise ratio is less than a preset signal-to-noise ratio, discarding the first voice stream, and sending a prompt message to the first terminal device to prompt a listener using the first terminal device to speak closer to a microphone; When the signal-to-noise ratio is greater than or equal to a preset signal-to-noise ratio, sending the first voice stream to the second terminal device and the other first terminal devices, the number of the audiences is at least two, different audiences use different first terminal devices to participate in the conference, and the other first terminal devices are terminal devices other than the first terminal device that sends the first voice stream; Also includes: receiving a second voice stream from the second terminal device in lecturer mode; enhancing the second voice stream; Sending the enhanced second voice stream to the first terminal device; The enhancing the second voice stream comprises: separating noise data from the second speech stream; determining a noise spectrum of the noise data; The second voice stream is subjected to noise reduction processing according to the noise spectrum.

2. The method according to claim 1, characterized in that: Before receiving the first voice stream from the first terminal device of the at least two terminal devices in the lecturer mode, the method further includes: Receiving a first request message from a target terminal device among the at least two terminal devices, where the first request message is used to request setting of a conference mode, and the target terminal device is any one of the at least two terminal devices; Sending a first response message to the target terminal device, where the first response message carries a data stream for presenting a conference mode setting interface; An instruction message is received from the target terminal device, where the instruction message is used to instruct the user to select the lecturer mode in the conference mode setting interface.

3. The method according to claim 2, characterized in that After receiving the indication message from the target terminal device, the method further includes: Receiving a second request message from the target terminal device, the second request message carrying lecturer information input by the user in the conference mode setting interface; The first terminal device and the second terminal device are determined from the at least two terminal devices according to the lecturer information.

4. An online conference implementation device, characterized in that: include: a transceiver module, configured to receive a first voice stream from a first terminal device among at least two terminal devices in a lecturer mode, wherein the lecturer's voice stream and the audience's voice stream in the lecturer mode correspond to different processing methods, wherein the audience uses the first terminal device to participate in a conference, and the lecturer uses the second terminal device among the at least two terminals to participate in a conference, wherein the lecturer mode is set according to user settings, wherein the second terminal device is determined to be obtained according to the terminal device corresponding to the lecturer information, wherein the first terminal device is a terminal device other than the second terminal device among the at least two terminal devices, and wherein the first terminal device is set to a mute state when the first terminal device is determined to be obtained; A determination module, configured to determine a signal-to-noise ratio of the first voice stream; a processing module, configured to process the first voice stream according to the signal-to-noise ratio; The processing module is used to process the first voice stream according to the signal-to-noise ratio in the following manner: When the signal-to-noise ratio is less than a preset signal-to-noise ratio, discarding the first voice stream, and sending a prompt message to the first terminal device to prompt a listener using the first terminal device to speak closer to a microphone; When the signal-to-noise ratio is greater than or equal to a preset signal-to-noise ratio, sending the first voice stream to the second terminal device and the other first terminal devices, the number of the audiences is at least two, different audiences use different first terminal devices to participate in the conference, and the other first terminal devices are terminal devices other than the first terminal device that sends the first voice stream; The transceiver module is further used to receive a second voice stream from the second terminal device in the lecturer mode; The processing module is further used to enhance the second voice stream; The transceiver module is further used to send the enhanced second voice stream to the first terminal device; The processing module is used to enhance the second voice stream in a manner that specifically includes: Noise data is separated from the second voice stream; a noise spectrum of the noise data is determined; and noise reduction processing is performed on the second voice stream according to the noise spectrum.

5. An electronic device comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the electronic device implements the method according to any one of claims 1 to 3.

6. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, which are used to implement the method according to any one of claims 1 to 3 when executed by a processor.

Images