Online conference sound self-excitation elimination method, device, equipment and storage medium
By monitoring the sound signal and automatically turning off the audio equipment of the conference terminal that is not in the speaking state, the problem of self-excitation of sound in online multi-person meetings is solved, and the user experience and meeting efficiency are improved.
Patent Information
- Application Number
- CN202311440393.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-31
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2043-10-31
AI Technical Summary
In online multi-person meetings, the speakers and sound receivers of multiple laptops are prone to echoing, resulting in self-excitation of sound. The existing methods eliminate inefficiency and poor user experience.
By monitoring the sound signal, determine whether the sound self-excited occurs in the meeting, obtain the mapping relationship table between the participants and the meeting access point, turn off the audio equipment of the conference terminal that is not in the speaking state, and automatically eliminate the sound self-excited.
Quickly removes sound self-excitation, improves user experience, and improves the convenience and efficiency of online meetings.
Smart Images

Figure CN117440093B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the technical field of online video calls, and in particular to a method, device, equipment and storage medium for eliminating self-excitation of sound in an online conference. Background Art
[0002] An online multi-person conference is a meeting between people in two or more locations, communicating online through conference terminals such as laptops and smartphones. Depending on the number of participating locations, video conferences can be divided into point-to-point conferences and multi-point conferences. With the development of 5G new calls, online multi-person conferences can integrate intelligent translation, fun calls, intelligent customer service, multi-screen calls, content sharing, remote assistance and other functions into video conferences, greatly increasing the convenience and fun of online multi-person conferences.
[0003] In an actual conference scenario, a conference access point will have multiple conference terminal devices. For example, several participants in conference room A each bring a laptop computer to participate in an online conference with participants in conference room B located in a different place. Each participant in conference room A can view PPT and other screen contents by watching their own laptop screen, and can listen to other people's speeches through the speaker. Each participant can speak instantly. After the laptop's sound receiver receives the speech, it sends the speech content to other participants through the network. Since there are multiple laptops in conference room A, each laptop has a speaker and a sound receiver. If multiple laptops have their speakers and sound receivers turned on, the sound can easily generate oscillations and echoes between the computers. A sound is emitted from a laptop speaker and enters another laptop sound receiver. The signal passes through the network and returns to the original laptop, causing the laptop speaker to emit the sound again. This cycle forms an echo, and the echo frequency gradually increases, eventually forming a harsh sound. This phenomenon is also called sound self-excitation.
[0004] Currently, conference participants often need to manually turn off the speakers and sound receivers of one or more laptop computers to eliminate sound self-excitation. The sound self-excitation elimination efficiency is low and the user experience is poor. Summary of the invention
[0005] The present invention provides a method, device, equipment and storage medium for eliminating self-excitation sound in an online conference, so as to at least solve the problems of low efficiency, long time of self-excitation sound elimination and poor user experience in the existing sound self-excitation elimination.
[0006] The technical solution of the present disclosure is as follows:
[0007] The present disclosure provides a method for eliminating self-excitation of online conference sound, including:
[0008] Determine whether sound self-excitation occurs in the online conference based on the monitored sound signals;
[0009] When it is determined that the online conference has self-excited sound, a mapping relationship table between conference participants and conference access points is obtained;
[0010] Determine, according to the mapping relationship table, whether the participant corresponding to the target conference access point is in a speaking state, wherein the target conference access point is any one of the multiple conference access points;
[0011] The audio device of the target conference terminal corresponding to the target conference participant in the target conference access point is turned off, wherein the target conference participant is a conference participant in the target conference access point who is not in a speaking state.
[0012] Optionally, determining whether sound self-excitation occurs in the online conference based on the monitored sound signal includes at least one of the following determination methods:
[0013] According to the monitored sound signal, counting the number of target sounds in the sound signal; if the number is greater than a threshold, determining that sound self-excitation occurs in the online conference;
[0014] According to the monitored sound signal, counting the sound signal power in the first time period; when the sound signal power is greater than the power threshold, determining that sound self-excitation occurs in the online conference;
[0015] Receive the sound self-excitation information uploaded by the conference terminal; and determine that the sound self-excitation occurs in the online conference according to the sound self-excitation information.
[0016] Optionally, before determining whether sound self-excitation occurs in the online conference according to the monitored sound signal, the method further includes:
[0017] In response to the sound self-excitation cancellation function mode start operation, the sound self-excitation cancellation function mode is turned on.
[0018] Optionally, before obtaining the mapping relationship table between conference participants and conference access points, the method further includes:
[0019] receiving the mapping relationship table uploaded by the conference terminal, wherein the mapping relationship table is a mapping relationship table established by the conference terminal in response to a conference participant's selection operation on a conference access point; or,
[0020] receiving the mapping relationship table uploaded by the conference initiating terminal, wherein the mapping relationship table is a mapping relationship table established by the conference initiating terminal in response to the configuration operation of the conference initiating user on the conference participants and the conference access points; or
[0021] The IP address and / or historical access point information of the conference terminal of the participant accessing the online conference is detected, and a mapping relationship table between the participant and the conference access point is established according to the IP address and / or the historical access point information.
[0022] Optionally, the method further comprises:
[0023] A new conference access point uploaded by the conference terminal is received, wherein the new conference access point is an access point obtained by modifying an original conference access point by the conference terminal in response to an access point modification operation.
[0024] Optionally, determining whether a participant corresponding to the target conference access point is in a speaking state according to the mapping relationship table includes:
[0025] According to the target conference access point, query the mapping relationship table to obtain the conference participants corresponding to the target conference access point;
[0026] Monitoring a target sound signal of a conference terminal of a conference participant corresponding to the target conference access point within a second time period;
[0027] According to the target sound signal, it is determined whether the participant corresponding to the target conference access point is in a speaking state.
[0028] Optionally, determining whether the participant corresponding to the target conference access point is in a speaking state according to the target sound signal includes:
[0029] Determine whether the target sound signal is the user's speech sound;
[0030] In the case where the target sound signal is the user's speech sound, determining that the participant corresponding to the target conference access point is in a speaking state;
[0031] When the target sound information is not the user's speech sound, it is determined that the participant corresponding to the target conference access point is not in a speaking state.
[0032] Optionally, after querying the mapping relationship table according to the target conference access point to obtain the conference participant corresponding to the target conference access point, the method further includes:
[0033] When there is only one conference terminal of the conference participant corresponding to the target conference access point, the audio device of the conference terminal of the conference participant corresponding to the target conference access point is kept turned on.
[0034] Optionally, after shutting down the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, the method further includes:
[0035] After the audio device of the target conference terminal is turned off for a set time, the audio device of the target conference terminal is turned on.
[0036] The present disclosure also provides a device for eliminating self-excitation of online conference sound, including:
[0037] A first determination module is used to determine whether sound self-excitation occurs in the online conference based on the monitored sound signal;
[0038] An acquisition module, when it is determined that the online conference has self-excited sound, is used to acquire a mapping relationship table between conference participants and conference access points;
[0039] A second determination module is used to determine whether the participant corresponding to the target conference access point is in a speaking state according to the mapping relationship table, wherein the target conference access point is any one of the multiple conference access points;
[0040] The closing module is used to close the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, wherein the target conference participant is a participant in the target conference access point who is not in a speaking state.
[0041] Optionally, the first determination module determines whether sound self-excitation occurs in the online conference according to the monitored sound signal, including at least one of the following determination methods:
[0042] According to the monitored sound signal, counting the number of target sounds in the sound signal; if the number is greater than a threshold, determining that sound self-excitation occurs in the online conference;
[0043] According to the monitored sound signal, counting the sound signal power in the first time period; when the sound signal power is greater than the power threshold, determining that sound self-excitation occurs in the online conference;
[0044] Receive the sound self-excitation information uploaded by the conference terminal; and determine that the sound self-excitation occurs in the online conference according to the sound self-excitation information.
[0045] Optionally, before determining whether sound self-excitation occurs in the online conference according to the monitored sound signal, the first determination module may also be used to:
[0046] In response to the sound self-excitation cancellation function mode start operation, the sound self-excitation cancellation function mode is turned on.
[0047] Optionally, before acquiring the mapping relationship table between conference participants and conference access points, the acquisition module may also be used to:
[0048] receiving the mapping relationship table uploaded by the conference terminal, wherein the mapping relationship table is a mapping relationship table established by the conference terminal in response to a conference participant's selection operation on a conference access point; or,
[0049] receiving the mapping relationship table uploaded by the conference initiating terminal, wherein the mapping relationship table is a mapping relationship table established by the conference initiating terminal in response to the configuration operation of the conference initiating user on the conference participants and the conference access points; or
[0050] The IP address and / or historical access point information of the conference terminal of the participant accessing the online conference is detected, and a mapping relationship table between the participant and the conference access point is established according to the IP address and / or the historical access point information.
[0051] Optionally, the acquisition module may also be used to:
[0052] A new conference access point uploaded by the conference terminal is received, wherein the new conference access point is an access point obtained by modifying an original conference access point by the conference terminal in response to an access point modification operation.
[0053] Optionally, when the second determination module determines whether the participant corresponding to the target conference access point is in a speaking state according to the mapping relationship table, it is configured to:
[0054] According to the target conference access point, query the mapping relationship table to obtain the conference participants corresponding to the target conference access point;
[0055] Monitoring a target sound signal of a conference terminal of a conference participant corresponding to the target conference access point within a second time period;
[0056] According to the target sound signal, it is determined whether the participant corresponding to the target conference access point is in a speaking state.
[0057] Optionally, when the second determination module determines whether the participant corresponding to the target conference access point is in a speaking state according to the target sound signal, it is configured to:
[0058] Determine whether the target sound signal is the user's speech sound;
[0059] In the case where the target sound signal is the user's speech sound, determining that the participant corresponding to the target conference access point is in a speaking state;
[0060] When the target sound information is not the user's speech sound, it is determined that the participant corresponding to the target conference access point is not in a speaking state.
[0061] Optionally, after querying the mapping relationship table according to the target conference access point to obtain the conference participant corresponding to the target conference access point, the second determination module may also be used to:
[0062] When there is only one conference terminal of the conference participant corresponding to the target conference access point, the audio device of the conference terminal of the conference participant corresponding to the target conference access point is kept turned on.
[0063] Optionally, after shutting down the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, the shut-down module may also be used to:
[0064] After the audio device of the target conference terminal is turned off for a set time, the audio device of the target conference terminal is turned on.
[0065] The present disclosure also provides an electronic device, including:
[0066] processor;
[0067] a memory for storing instructions executable by the processor;
[0068] The processor is configured to execute the instructions to implement each step in the above method.
[0069] The embodiment of the present disclosure further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, each step in the above method is implemented.
[0070] The embodiment of the present disclosure further provides a computer program product, including a computer program / instruction, which implements each step of the above method when executed by a processor.
[0071] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:
[0072] In some embodiments of the present disclosure, it is determined whether sound self-excitation occurs in an online conference based on a monitored sound signal; when it is determined that sound self-excitation occurs in the online conference, a mapping relationship table between participants and conference access points is obtained; according to the mapping relationship table, it is determined whether the participant corresponding to the target conference access point is in a speaking state, wherein the target conference access point is any one of multiple conference access points; the audio device of the target conference terminal corresponding to the target participant in the target conference access point is turned off; when the present disclosure monitors that sound self-excitation occurs in an online conference, the audio device of the conference terminal of the participant who is not in the speaking state is automatically turned off, so as to quickly eliminate the sound self-excitation and improve the user experience.
[0073] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0074] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.
[0075] Figure 1 A flow chart of a method for eliminating self-excitation of online conference sound provided by an exemplary embodiment of the present disclosure;
[0076] Figure 2 A flowchart of a method for determining whether a conference participant is in a speaking state provided by an exemplary embodiment of the present disclosure;
[0077] Figure 3 A schematic diagram of the structure of a device for eliminating self-excitation of online conference sound provided by an exemplary embodiment of the present disclosure;
[0078] Figure 4 A schematic structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION
[0079] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.
[0080] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure.
[0081] It should be noted that the user information involved in this disclosure includes but is not limited to: user device information and user personal information; the collection, storage, use, processing, transmission, provision and disclosure of user information in this disclosure comply with the relevant laws and regulations and do not violate public order and good morals.
[0082] In order to eliminate the sound self-excitation, hardware can also be updated and upgraded. For example, sound receivers such as microphones or speakers such as stereos can be improved to eliminate the sound self-excitation. However, hardware upgrades require additional costs. And for conference terminal devices such as laptops and smartphones, it is very inconvenient to upgrade their sound receivers and speakers.
[0083] In view of the above technical problems, in some embodiments of the present disclosure, it is determined whether sound self-excitation occurs in an online conference based on the monitored sound signal; when it is determined that sound self-excitation occurs in the online conference, a mapping relationship table between participants and conference access points is obtained; according to the mapping relationship table, it is determined whether the participant corresponding to the target conference access point is in a speaking state, wherein the target conference access point is any one of multiple conference access points; the audio device of the target conference terminal corresponding to the target participant in the target conference access point is turned off; when the present disclosure monitors that sound self-excitation occurs in an online conference, the audio device of the conference terminal of the participant who is not in the speaking state is automatically turned off, so as to quickly eliminate the sound self-excitation and improve the user experience.
[0084] The technical solutions provided by various embodiments of the present disclosure are described in detail below in conjunction with the accompanying drawings.
[0085] Figure 1 The following is a flow chart of a method for eliminating self-excitation of online conference sound provided by an exemplary embodiment of the present disclosure. Figure 1 As shown, the method includes:
[0086] S101: Determine whether sound self-excitation occurs in the online conference according to the monitored sound signal;
[0087] S102: When it is determined that the online conference has self-excited sound, a mapping relationship table between conference participants and conference access points is obtained;
[0088] S103: determining, according to the mapping relationship table, whether a participant corresponding to a target conference access point is in a speaking state, wherein the target conference access point is any one of the multiple conference access points;
[0089] S104: Turn off the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, wherein the target conference participant is a participant in the target conference access point who is not in a speaking state.
[0090] In this embodiment, the execution subject of the above method may be a server or other types of computer devices.
[0091] In the case where the execution subject of the above method is a server, the present disclosure does not limit the implementation form of the server. For example, the server can be a conventional server, a cloud server, a cloud host, a virtual center, and other server devices. Among them, the composition of the server mainly includes a processor, a hard disk, a memory, a system bus, etc., and a general computer architecture type.
[0092] In some embodiments of the present disclosure, the audio device includes a speaker and a sound receiver.
[0093] In some embodiments of the present disclosure, a sound self-excitation elimination function may be set in the conference system. The sound self-excitation elimination function may be an optional function. When initiating a conference, the conference initiator (i.e., the conference creator) may choose whether to enable the self-excitation elimination function as needed. The conference system may also enable the sound self-excitation elimination function by default.
[0094] In some embodiments of the present disclosure, the conference initiator creates a conference access point list. One achievable method is that the conference initiating terminal obtains the conference access point list in response to the conference access point list creation operation. The conference access point list includes the names of two or more conference access points participating in the conference, such as Beijing venue, Guangzhou venue, Shanghai venue, conference room A, conference room B, conference room C, etc. The specific names can be freely defined.
[0095] In some embodiments of the present disclosure, after obtaining the conference access point list, the server needs to further obtain a mapping relationship table between conference participants and conference access points. The mapping relationship table may be created in the following ways, including but not limited to:
[0096] Creation method one: the conference terminal responds to the configuration operation of the conference initiator user on the participants and the conference access points, and establishes a mapping relationship table. The conference terminal uploads the established mapping relationship table to the server, and the server receives the mapping relationship table uploaded by the conference terminal. In creation method one, when the conference terminal accesses the conference, it displays the conference access point list on the display screen of the conference terminal, reminding the participants to select the conference access point name to participate in the conference in the conference access point list. The participants select the conference access point name according to their geographical address. For example, participants in Beijing select the Beijing venue, participants in Guangzhou select the Guangzhou venue, and participants in Shanghai select the Shanghai venue, and obtain the created mapping relationship table.
[0097] Creation method 2: The conference initiating terminal responds to the configuration operation of the conference initiating user on the conference participants and the conference access point to establish a mapping relationship table. The conference initiating terminal uploads the established mapping relationship table to the server, and the server receives the mapping relationship table uploaded by the conference initiating terminal. The conference initiating user can help other participants select the conference access point name to participate in the conference in the conference access point list.
[0098] Creation method three: When a participant enters a meeting, the server detects the IP address and / or historical access point information of the conference terminal of the participant who accesses the online meeting, and establishes a mapping relationship table between the participant and the conference access point based on the IP address and / or historical access point information. The server selects a conference access point for each participant in turn to obtain the established mapping relationship table between the participant and the conference access point. For example, when a participant enters a meeting, the server detects the IP address of the conference terminal of the participant who accesses the online meeting, and the administrative region corresponding to the IP address is Beijing, and automatically selects the conference access point name for the participant as Beijing venue.
[0099] In the above embodiment, the participants can use the conference terminal to view their conference access points. When the conference access point information is incorrect, they can modify their conference access points through the conference terminal. One possible implementation is that the conference terminal responds to the access point modification operation and modifies the original conference access point to obtain an access point, thereby improving the accuracy of the conference access point and enhancing the user experience.
[0100] It should be noted that the specific form of the above mapping relationship table can be a mapping relationship table between conference participants, conference terminals and conference access points, for example, a mapping relationship table of conference participant names, conference terminal device models and conference access point names.
[0101] When sound self-excitation occurs in an online conference, a sound is emitted from the speaker of one conference terminal device and enters the sound receiver of another conference terminal device. The signal then passes through the network and returns to the original conference terminal device, causing the speaker of the conference terminal device to repeat the sound. This cycle forms an echo, and the repetition frequency gradually increases, eventually forming a sharp and harsh sound. The content of the sound cannot be distinguished. After the sharp and harsh sound continues for a period of time, the self-excited sound begins to decay. Based on this characteristic, sound self-excitation is divided into the self-excited echo period, the self-excited sharp period, and the self-excited decay period. The self-excited echo period refers to the stage where a sound is constantly repeated, the self-excited sharp period refers to the stage where a sharp and harsh sound is formed, and the self-excited decay period refers to the stage where the self-excited sound begins to decay until the self-excitation disappears.
[0102] In some embodiments of the present disclosure, determining whether sound self-excitation occurs in an online conference based on the monitored sound signal includes at least one of the following determination methods:
[0103] Determination method one, based on the monitored sound signal, count the number of target sounds in the sound signal; when the number is greater than the number threshold, determine that sound self-excitation has occurred in the online meeting. It should be noted that the disclosed embodiment does not limit the number threshold, and the number threshold can be adjusted according to actual conditions. For example, the server monitors the sound signal in real time, and when the number of repetitions of a certain sound signal is greater than the number threshold, it is judged that sound self-excitation has occurred. For example, when a participant says "start meeting", and the sound of "start meeting" is repeated more than 3 times in a row in the same device, it is judged that sound self-excitation has occurred. This implementation method can be applied to the self-excitation echo period to enable the system to determine whether sound self-excitation has occurred.
[0104] Determination method two, based on the monitored sound signal, count the sound signal power in the first time period; when the sound signal power is greater than the power threshold, determine that sound self-excitation has occurred in the online conference. It should be noted that the embodiment of the present disclosure does not limit the power threshold, and the power threshold can be adjusted according to actual conditions. For example, the server monitors the sound signal power in real time, and when it detects that the sound signal power exceeds the power threshold in a certain time period, it determines that sound self-excitation has occurred. This implementation can be applied to the system to determine whether sound self-excitation has occurred during the sharp period of self-excitation.
[0105] Determination method three, receiving the sound self-excitation information uploaded by the conference terminal; according to the sound self-excitation information, determining that the sound self-excitation occurs in the online conference. For example, a participant finds that the sound self-excitation occurs, manually clicks the relevant reporting function key, and manually reports the sound self-excitation to the system. After receiving the information reported by the participant, the system determines that the sound self-excitation occurs. This implementation method can be applied to the self-excitation echo period, the self-excitation sharp period, and the self-excitation decay period to enable the system to determine whether the sound self-excitation occurs.
[0106] In some embodiments of the present disclosure, when it is determined that sound self-excitation occurs in an online conference, a mapping relationship table between conference participants and conference access points is obtained, and the conference access point corresponding to each conference participant can be determined according to the mapping relationship table.
[0107] Figure 2 A flowchart of a method for determining whether a conference participant is in a speaking state is provided for an exemplary embodiment of the present disclosure. Figure 2 As shown, the method includes:
[0108] S201: querying a mapping relationship table according to a target conference access point to obtain conference participants corresponding to the target conference access point;
[0109] S202: monitoring a target sound signal of a conference terminal of a conference participant corresponding to a target conference access point in a second time period;
[0110] S203: Determine, according to the target sound signal, whether the participant corresponding to the target conference access point is in a speaking state.
[0111] It should be noted that the present disclosure does not limit the first time period and the second time period, and the first time period and the second time period can be adjusted according to actual conditions.
[0112] In this embodiment, when there is only one conference terminal of the participant corresponding to the target conference access point, the audio device of the conference terminal of the participant corresponding to the target conference access point is kept turned on. If there is only one conference terminal at a conference access point, it cannot form a "sound loop", so there is no need to turn off its speaker and sound receiver, and the speaker and sound receiver can be kept in normal use.
[0113] In this embodiment, it is determined whether the participant corresponding to the target conference access point is in a speaking state based on the target sound signal. One achievable method is to determine whether the target sound signal is the user's speaking sound; when the target sound signal is the user's speaking sound, it is determined that the participant corresponding to the target conference access point is in a speaking state; when the target sound information is not the user's speaking sound, it is determined that the participant corresponding to the target conference access point is not in a speaking state. Among them, when the target sound signal is the user's speaking sound, it means that the user is speaking, and the user is in a speaking state; if the target sound signal is not the user's speaking sound, the target sound signal may also be the noise of the user's action behavior. When the user is not in a speaking state, the accuracy of determining the user's speaking state can be improved.
[0114] In the above embodiment, a neural network model may be used to determine whether the target sound signal is the user's speech sound. The target sound signal is input into the neural network model to obtain a result of whether it is the user's speech sound.
[0115] When sound self-excitation occurs, a sound is emitted from the speaker of a conference terminal device and enters the sound receiver of another conference terminal device. The signal passes through the network and returns to the starting conference terminal device, so that the speaker of the conference terminal device repeats the sound, and so on. In order to eliminate the sound self-excitation, it is necessary to remove the condition of this "sound loop". That is, turn off the audio devices of some conference terminals. In order to minimize the impact on the normal progress of the meeting due to turning off the audio devices of some conference terminal devices, it is only necessary to turn off the audio devices of the conference terminals of multiple conference terminals that are in the same conference access point and are not currently in the speaking state, while the participants who are currently in the speaking state need to keep the audio devices available for normal use. Therefore, the audio devices of the target conference terminal corresponding to the target participant in the target conference access point are turned off, where the target participant is the participant who is not in the speaking state in the target conference access point.
[0116] In actual conference scenarios, the participants who speak may change constantly, that is, the conference terminal switches between "speaking state" and "not speaking state". In order to further reduce the impact on the normal progress of the meeting due to turning off the audio devices of some conference terminals, the shutdown time can be set to a certain time value. One feasible way is to turn on the audio device of the target conference terminal after the audio device of the target conference terminal has been turned off for a set time. The disclosed embodiment does not limit the set time length, which can be 30 seconds, 60 seconds, etc.
[0117] For example, when sound self-excitation occurs, the audio devices of the conference terminals of multiple conference terminals that are at the same conference access point and are not currently in a speaking state are turned off, and after 30 seconds, the audio devices of the conference terminals that are in a turned-off state are turned on again.
[0118] In the above method embodiment of the present disclosure, it is determined whether sound self-excitation occurs in an online conference based on the monitored sound signal; when it is determined that sound self-excitation occurs in the online conference, a mapping relationship table between participants and conference access points is obtained; according to the mapping relationship table, it is determined whether the participant corresponding to the target conference access point is in a speaking state, wherein the target conference access point is any one of multiple conference access points; the audio device of the target conference terminal corresponding to the target participant in the target conference access point is turned off; when the present disclosure monitors that sound self-excitation occurs in an online conference, the audio device of the conference terminal of the participant who is not in the speaking state is automatically turned off, so as to quickly eliminate the sound self-excitation and improve the user experience.
[0119] Figure 3 The structure diagram of an online conference sound self-excitation elimination device 30 provided by the exemplary embodiment of the present disclosure is shown in FIG. Figure 3 As shown, the online conference sound self-excitation elimination device 30 includes: a first determination module 31, an acquisition module 32, a second determination module 33 and a closing module 34.
[0120] The first determination module 31 is used to determine whether the online conference has self-excitation of sound according to the monitored sound signal;
[0121] An acquisition module 32 is used to acquire a mapping relationship table between conference participants and conference access points when it is determined that the online conference has self-excited sound;
[0122] A second determination module 33 is used to determine whether the participant corresponding to the target conference access point is in a speaking state according to the mapping relationship table, wherein the target conference access point is any one of the multiple conference access points;
[0123] The closing module 34 is used to close the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, wherein the target conference participant is a participant in the target conference access point who is not in a speaking state.
[0124] Optionally, the first determination module 31 determines whether the online conference has self-excitation of sound according to the monitored sound signal, including at least one of the following determination methods:
[0125] According to the monitored sound signal, the number of target sounds in the sound signal is counted; when the number is greater than the number threshold, it is determined that the online conference has self-excited sound;
[0126] According to the monitored sound signal, the sound signal power in the first time period is counted; when the sound signal power is greater than the power threshold, it is determined that the online conference has sound self-excitation;
[0127] Receive the sound self-excitation information uploaded by the conference terminal; and determine that the sound self-excitation occurs in the online conference according to the sound self-excitation information.
[0128] Optionally, before determining whether sound self-excitation occurs in the online conference according to the monitored sound signal, the first determining module 31 may also be used to:
[0129] In response to the sound self-excitation cancellation function mode start operation, the sound self-excitation cancellation function mode is turned on.
[0130] Optionally, before acquiring the mapping relationship table between conference participants and conference access points, the acquisition module 32 may also be used to:
[0131] Receiving a mapping relationship table uploaded by a conference terminal, wherein the mapping relationship table is a mapping relationship table established by the conference terminal in response to a conference participant's selection operation of a conference access point; or,
[0132] Receiving a mapping relationship table uploaded by a conference initiating terminal, wherein the mapping relationship table is a mapping relationship table established by the conference initiating terminal in response to a configuration operation of a conference initiating user on conference participants and conference access points; or
[0133] The IP address and / or historical access point information of the conference terminal of the participant accessing the online conference is detected, and a mapping relationship table between the participant and the conference access point is established according to the IP address and / or the historical access point information.
[0134] Optionally, the acquisition module 32 may also be used to:
[0135] A new conference access point uploaded by a conference terminal is received, wherein the new conference access point is an access point obtained by modifying an original conference access point in response to an access point modification operation by the conference terminal.
[0136] Optionally, when determining whether the participant corresponding to the target conference access point is in a speaking state according to the mapping relationship table, the second determining module 33 is configured to:
[0137] According to the target conference access point, query the mapping relationship table to obtain the participants corresponding to the target conference access point;
[0138] Monitoring target sound signals of conference terminals of conference participants corresponding to the target conference access point within a second time period;
[0139] According to the target sound signal, determine whether the participant corresponding to the target conference access point is in a speaking state.
[0140] Optionally, when determining whether the participant corresponding to the target conference access point is in a speaking state according to the target sound signal, the second determination module 33 is configured to:
[0141] Determine whether the target sound signal is the user's speech sound;
[0142] When the target sound signal is a user's speaking sound, determining that the participant corresponding to the target conference access point is in a speaking state;
[0143] When the target sound information is not the user's speaking sound, it is determined that the participant corresponding to the target conference access point is not in a speaking state.
[0144] Optionally, after the second determining module 33 queries the mapping relationship table according to the target conference access point to obtain the conference participant corresponding to the target conference access point, it can also be used to:
[0145] When there is only one conference terminal of the participant corresponding to the target conference access point, the audio device of the conference terminal of the participant corresponding to the target conference access point is kept turned on.
[0146] Optionally, after shutting down the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, the closing module 34 may also be used to:
[0147] After the audio device of the target conference terminal is turned off for a set time, the audio device of the target conference terminal is turned on.
[0148] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0149] Figure 4 FIG. 1 is a schematic diagram of a structure of an electronic device provided by an exemplary embodiment of the present disclosure. Figure 4As shown, the electronic device includes: a memory 41 and a processor 42. In addition, the electronic device also includes a power supply component 43 and a communication component 44.
[0150] The memory 41 is used to store computer programs and can be configured to store various other data to support operations on the electronic device. Examples of such data include instructions for any application program or method operating on the electronic device.
[0151] The memory 41 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0152] The communication component 44 is used for data transmission with other devices.
[0153] The processor 42 can execute computer instructions stored in the memory 41 to: determine whether sound self-excitation occurs in the online conference based on the monitored sound signal; when it is determined that sound self-excitation occurs in the online conference, obtain a mapping relationship table between participants and conference access points; determine whether the participant corresponding to the target conference access point is in a speaking state based on the mapping relationship table, wherein the target conference access point is any one of multiple conference access points; and turn off the audio device of the target conference terminal corresponding to the target participant in the target conference access point, wherein the target participant is a participant in the target conference access point who is not in a speaking state.
[0154] Optionally, when the processor 42 determines whether the online conference has self-excitation of sound according to the monitored sound signal, at least one of the following determination methods is included:
[0155] According to the monitored sound signal, the number of target sounds in the sound signal is counted; when the number is greater than the number threshold, it is determined that the online conference has self-excited sound;
[0156] According to the monitored sound signal, the sound signal power in the first time period is counted; when the sound signal power is greater than the power threshold, it is determined that the online conference has sound self-excitation;
[0157] Receive the sound self-excitation information uploaded by the conference terminal; and determine that the sound self-excitation occurs in the online conference according to the sound self-excitation information.
[0158] Optionally, before determining whether sound self-excitation occurs in the online conference based on the monitored sound signal, the processor 42 may also be used to:
[0159] In response to the sound self-excitation cancellation function mode start operation, the sound self-excitation cancellation function mode is turned on.
[0160] Optionally, before acquiring the mapping relationship table between conference participants and conference access points, the processor 42 may also be used to:
[0161] Receiving a mapping relationship table uploaded by a conference terminal, wherein the mapping relationship table is a mapping relationship table established by the conference terminal in response to a conference participant's selection operation of a conference access point; or,
[0162] Receiving a mapping relationship table uploaded by a conference initiating terminal, wherein the mapping relationship table is a mapping relationship table established by the conference initiating terminal in response to a configuration operation of a conference initiating user on conference participants and conference access points; or
[0163] The IP address and / or historical access point information of the conference terminal of the participant accessing the online conference is detected, and a mapping relationship table between the participant and the conference access point is established according to the IP address and / or the historical access point information.
[0164] Optionally, the processor 42 may also be configured to:
[0165] A new conference access point uploaded by a conference terminal is received, wherein the new conference access point is an access point obtained by modifying an original conference access point in response to an access point modification operation by the conference terminal.
[0166] Optionally, when the processor 42 determines whether the participant corresponding to the target conference access point is in a speaking state according to the mapping relationship table, it is configured to:
[0167] According to the target conference access point, query the mapping relationship table to obtain the participants corresponding to the target conference access point;
[0168] Monitoring target sound signals of conference terminals of conference participants corresponding to the target conference access point within a second time period;
[0169] According to the target sound signal, determine whether the participant corresponding to the target conference access point is in a speaking state.
[0170] Optionally, when the processor 42 determines whether the participant corresponding to the target conference access point is in a speaking state according to the target sound signal, it is configured to:
[0171] Determine whether the target sound signal is the user's speech sound;
[0172] When the target sound signal is a user's speaking sound, determining that the participant corresponding to the target conference access point is in a speaking state;
[0173] When the target sound information is not the user's speaking sound, it is determined that the participant corresponding to the target conference access point is not in a speaking state.
[0174] Optionally, after the processor 42 queries the mapping relationship table according to the target conference access point to obtain the conference participant corresponding to the target conference access point, it can also be used to:
[0175] When there is only one conference terminal of the participant corresponding to the target conference access point, the audio device of the conference terminal of the participant corresponding to the target conference access point is kept turned on.
[0176] Optionally, after shutting down the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, the processor 42 may also be used to:
[0177] After the audio device of the target conference terminal is turned off for a set time, the audio device of the target conference terminal is turned on.
[0178] Accordingly, the present disclosure also provides a computer-readable storage medium storing a computer program. When the computer-readable storage medium stores the computer program and the computer program is executed by one or more processors, the one or more processors execute Figure 1 Each step in the method embodiment.
[0179] Accordingly, the present disclosure also provides a computer program product, the computer program product includes a computer program / instruction, the computer program / instruction is executed by a processor Figure 1 Each step in the method embodiment.
[0180] Above Figure 4 The communication component in is configured to facilitate wired or wireless communication between the device where the communication component is located and other devices. The device where the communication component is located can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G / LTE, 5G and other mobile communication networks, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0181] Above Figure 4 The power supply component in the device provides power to various components of the device where the power supply component is located. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device where the power supply component is located.
[0182] The electronic device also includes a display screen and an audio component.
[0183] The display screen includes a screen, and the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
[0184] The audio component may be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC), and when the device where the audio component is located is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal may be further stored in a memory or sent via a communication component. In some embodiments, the audio component also includes a speaker for outputting an audio signal.
[0185] In the above method, device, storage medium and computer program product embodiments of the present disclosure, it is determined whether sound self-excitation occurs in an online conference based on the monitored sound signal; when it is determined that sound self-excitation occurs in the online conference, a mapping relationship table between participants and conference access points is obtained; according to the mapping relationship table, it is determined whether the participant corresponding to the target conference access point is in a speaking state, wherein the target conference access point is any one of multiple conference access points; the audio device of the target conference terminal corresponding to the target participant in the target conference access point is turned off; when the present disclosure monitors that sound self-excitation occurs in an online conference, the audio device of the conference terminal of the participant who is not in the speaking state is automatically turned off, so as to quickly eliminate the sound self-excitation and improve the user experience.
[0186] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0187] The present disclosure is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present disclosure. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0188] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0189] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0190] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0191] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0192] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0193] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0194] The above are only specific embodiments of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to these embodiments herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A method for eliminating self-excitation of online conference sound, characterized in that: include: Determine whether sound self-excitation occurs in the online conference based on the monitored sound signals; When it is determined that the online conference has self-excited sound, a mapping relationship table between conference participants and conference access points is obtained; Determine, according to the mapping relationship table, whether the participant corresponding to the target conference access point is in a speaking state, wherein the target conference access point is any one of the multiple conference access points; Turning off the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, wherein the target conference participant is a conference participant in the target conference access point who is not in a speaking state; The determining, according to the mapping relationship table, whether the participant corresponding to the target conference access point is in a speaking state includes: According to the target conference access point, query the mapping relationship table to obtain the conference participants corresponding to the target conference access point; Monitoring target sound signals of conference terminals of conference participants corresponding to the target conference access point within a preset time period; Determine whether the target sound signal is the user's speech sound; In the case where the target sound signal is the user's speech sound, determining that the participant corresponding to the target conference access point is in a speaking state; In a case where the target sound information is not the user's speech sound, determining that the participant corresponding to the target conference access point is not in a speaking state; Determining whether sound self-excitation occurs in the online conference according to the monitored sound signal includes at least one of the following determination methods: According to the monitored sound signal, the number of target sounds in the sound signal is counted, where the target sound is any sound of a participant; if the number is greater than a threshold, it is determined that the online conference has self-excited sound; According to the monitored sound signal, the sound signal power within a preset time period is counted; when the sound signal power is greater than the power threshold, it is determined that the online conference has self-excited sound; Receive the sound self-excitation information uploaded by the conference terminal; and determine that the sound self-excitation occurs in the online conference according to the sound self-excitation information.
2. The method according to claim 1, characterized in that Before determining whether sound self-excitation occurs in the online conference according to the monitored sound signal, the method further includes: In response to the sound self-excitation cancellation function mode start operation, the sound self-excitation cancellation function mode is turned on.
3. The method according to claim 1, characterized in that Before obtaining the mapping relationship table between conference participants and conference access points, the method further includes: receiving the mapping relationship table uploaded by the conference terminal, wherein the mapping relationship table is a mapping relationship table established by the conference terminal in response to a conference participant's selection operation on a conference access point; or, receiving the mapping relationship table uploaded by the conference initiating terminal, wherein the mapping relationship table is a mapping relationship table established by the conference initiating terminal in response to the configuration operation of the conference initiating user on the conference participants and the conference access points; or The IP address and / or historical access point information of the conference terminal of the participant accessing the online conference is detected, and a mapping relationship table between the participant and the conference access point is established according to the IP address and / or the historical access point information.
4. The method according to claim 3, characterized in that The method further comprises: A new conference access point uploaded by the conference terminal is received, wherein the new conference access point is an access point obtained by modifying an original conference access point by the conference terminal in response to an access point modification operation.
5. The method according to claim 1, characterized in that After querying the mapping relationship table according to the target conference access point to obtain the conference participants corresponding to the target conference access point, the method further includes: In the case that there is only one conference terminal of the conference participant corresponding to the target conference access point, the audio device of the conference terminal of the conference participant corresponding to the target conference access point is kept turned on.
6. The method according to claim 1, characterized in that After shutting down the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, the method further includes: After the audio device of the target conference terminal is turned off for a set time, the audio device of the target conference terminal is turned on.
7. A device for eliminating self-excitation of online conference sound, characterized in that: include: A first determination module is used to determine whether sound self-excitation occurs in the online conference based on the monitored sound signal; An acquisition module, when it is determined that the online conference has self-excited sound, is used to acquire a mapping relationship table between conference participants and conference access points; A second determination module is used to determine whether the participant corresponding to the target conference access point is in a speaking state according to the mapping relationship table, wherein the target conference access point is any one of the multiple conference access points; A closing module, used to close the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, wherein the target conference participant is a participant in the target conference access point who is not in a speaking state; When the second determination module determines whether the participant corresponding to the target conference access point is in a speaking state according to the mapping relationship table, it is used to: According to the target conference access point, query the mapping relationship table to obtain the conference participants corresponding to the target conference access point; Monitoring target sound signals of conference terminals of conference participants corresponding to the target conference access point within a preset time period; Determine whether the target sound signal is the user's speech sound; In the case where the target sound signal is the user's speech sound, determining that the participant corresponding to the target conference access point is in a speaking state; In a case where the target sound information is not the user's speech sound, determining that the participant corresponding to the target conference access point is not in a speaking state; The first determination module determines whether sound self-excitation occurs in the online conference according to the monitored sound signal, including at least one of the following determination methods: According to the monitored sound signal, the number of target sounds in the sound signal is counted, where the target sound is any sound of a participant; if the number is greater than a threshold, it is determined that the online conference has self-excited sound; According to the monitored sound signal, the sound signal power within a preset time period is counted; when the sound signal power is greater than the power threshold, it is determined that the online conference has self-excited sound; Receive the sound self-excitation information uploaded by the conference terminal; and determine that the sound self-excitation occurs in the online conference according to the sound self-excitation information.
8. The device according to claim 7, characterized in that Before determining whether sound self-excitation occurs in the online conference based on the monitored sound signal, the first determination module may also be used to: In response to the sound self-excitation cancellation function mode start operation, the sound self-excitation cancellation function mode is turned on.
9. The device according to claim 7, characterized in that Before obtaining the mapping relationship table between conference participants and conference access points, the acquisition module may also be used to: receiving the mapping relationship table uploaded by the conference terminal, wherein the mapping relationship table is a mapping relationship table established by the conference terminal in response to a conference participant's selection operation on a conference access point; or, receiving the mapping relationship table uploaded by the conference initiating terminal, wherein the mapping relationship table is a mapping relationship table established by the conference initiating terminal in response to the configuration operation of the conference initiating user on the conference participants and the conference access points; or The IP address and / or historical access point information of the conference terminal of the participant accessing the online conference is detected, and a mapping relationship table between the participant and the conference access point is established according to the IP address and / or the historical access point information.
10. The device according to claim 9, characterized in that The acquisition module can also be used for: A new conference access point uploaded by the conference terminal is received, wherein the new conference access point is an access point obtained by modifying an original conference access point by the conference terminal in response to an access point modification operation.
11. The device according to claim 7, characterized in that After the second determination module queries the mapping relationship table according to the target conference access point to obtain the conference participant corresponding to the target conference access point, it can also be used to: In the case that there is only one conference terminal of the conference participant corresponding to the target conference access point, the audio device of the conference terminal of the conference participant corresponding to the target conference access point is kept turned on.
12. The device according to claim 7, characterized in that After shutting down the audio device of the target conference terminal corresponding to the target conference participant in the target conference access point, the shut-down module may also be used to: After the audio device of the target conference terminal is turned off for a set time, the audio device of the target conference terminal is turned on.
13. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement each step in the method according to any one of claims 1 to 6.
14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, each step of the method according to any one of claims 1 to 6 is implemented.
15. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the steps in the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Multi-frequency band self-excited interference elimination repeater
CN101583210A
Audio processing method and device, computer equipment and storage medium
CN111710346A
Systems and methods for integrated conferencing platform
CN112425146A
Speech control method and device for video conference, equipment and storage medium
CN112601045A
Remote conference management method and system
CN113746822A
