Audio call system and control method, device, equipment and program product thereof

Abstract

The invention relates to an audio call system and a control method, device, equipment and program product thereof, and the control method of the audio call system comprises the steps: building communication connection with a plurality of first terminals, so as to enable each first terminal to be connected to the audio call system; determining a target audio control mode of each first terminal based on the distribution information of the plurality of first terminals and the audio equipment information of each first terminal; and sending a corresponding control instruction to each first terminal, wherein the control instruction is used for indicating the audio equipment of the first terminal to execute the corresponding target audio control mode. According to the embodiment of the invention, the audio equipment of each first terminal implements the cooperation among the first terminals by executing the corresponding target audio control mode, and the interference and influence of downlink audio output by other first terminals on the collection of uplink audio can be eliminated or weakened, so that the squeal problem is avoided, the audio call effect is ensured, and the user experience is improved.

Description

Technical Field

[0001] This disclosure relates to the field of audio communication, specifically to an audio communication system and its control method, apparatus, equipment, and program products. Background Technology

[0002] In recent years, with the rapid development of communication connection technology and audio processing technology, audio call systems with multi-party audio call functions have been widely used in audio conferencing, online classes and interactive live streaming, etc. Users can make audio calls with other users through electronic devices connected to the audio call system.

[0003] However, when using related technologies to control the operation of an audio call system, it is difficult for multiple terminals in the same location to coordinate with each other. During audio acquisition, it is easy to collect audio output from other terminals, causing feedback problems, affecting the audio call effect and resulting in a poor user experience. Summary of the Invention

[0004] To overcome the problems existing in related technologies, this disclosure provides an audio call system and its control method, device, equipment, and program product.

[0005] According to a first aspect of the present disclosure, a control method for an audio call system is provided, the control method for the audio call system comprising:

[0006] Establish communication connections with multiple first terminals so that each first terminal can access the audio call system;

[0007] Based on the distribution information of the plurality of first terminals and the audio device information of each first terminal, the target audio control mode of each first terminal is determined.

[0008] Send corresponding control instructions to each of the first terminals. The control instructions are used to instruct the audio devices of the first terminals to execute the corresponding target audio control mode in order to eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio devices of the first terminals.

[0009] In some embodiments of this disclosure, the distribution information of the plurality of first terminals includes the number of the first terminals and the location information of the first terminals; and / or,

[0010] The audio device information includes the type of audio device contained in the first terminal.

[0011] In some embodiments of this disclosure, the audio device of the first terminal includes a microphone, and the target audio control mode includes a target audio acquisition area of ​​the microphone; and / or,

[0012] The audio device of the first terminal includes a speaker, and the target audio control mode includes the target audio output area of ​​the speaker.

[0013] In some embodiments of this disclosure, the target audio control mode of each first terminal is configured such that the target audio acquisition area corresponding to any first terminal is staggered from the target audio output areas corresponding to other first terminals; or...

[0014] The proportion of the overlapping area between the target audio acquisition area corresponding to any one of the first terminals and the target audio output areas corresponding to other first terminals is less than a first preset proportion threshold; or...

[0015] The angle between the center direction of the target audio acquisition area corresponding to any of the first terminals and the center direction of the target audio output areas corresponding to other first terminals is greater than a preset angle threshold.

[0016] In some embodiments of this disclosure, the proportion of the target audio output region of each speaker to the maximum audio output region of the speaker is equal to or greater than a second preset proportion threshold.

[0017] The proportion of the target audio acquisition area of ​​each microphone to the maximum audio acquisition area of ​​that microphone is equal to or greater than a third preset proportion threshold.

[0018] In some embodiments of this disclosure, the target audio control mode further includes:

[0019] At least one of the following: the on / off state of the microphone, the on / off state of the speaker, and the volume of the speaker.

[0020] In some embodiments of this disclosure, the control method of the audio call system further includes:

[0021] In response to a change in the distribution information, the target audio control mode of each of the first terminals is updated based on the changed distribution information.

[0022] In some embodiments of this disclosure, establishing a communication connection with a plurality of first terminals includes:

[0023] Search for multiple terminals to connect within a preset range;

[0024] Send a first request instruction to each of the searched terminals to be connected, the first request instruction being used to request the terminals to be connected to access the audio call system;

[0025] In response to receiving a response signal from the terminal to be connected, each terminal to be connected that sent the response signal is designated as the first terminal, and a communication connection is established with each of the first terminals; or,

[0026] In response to receiving a second request instruction from the terminal to be connected, a first prompt message is displayed, wherein the second request instruction is used to request access to the audio call system;

[0027] In response to the user's first preset operation on the first prompt information, the terminal to be connected that sent the second request instruction is designated as the first terminal, and a communication connection is established with each of the first terminals.

[0028] In some embodiments of this disclosure, the downlink audio output by the audio device of the first terminal includes the uplink audio collected by each of the audio devices and the online audio transmitted to the audio call system.

[0029] According to a second aspect of the present disclosure, a control method for an audio call system is provided, the control method comprising:

[0030] Establish a communication connection with the second terminal to access the audio call system;

[0031] Receive control commands sent by the second terminal;

[0032] Based on the control command, the audio device is controlled to execute the target audio control mode corresponding to the control command;

[0033] The target audio control mode is determined based on the distribution information of the first terminal in the audio call system and the audio device information of the first terminal.

[0034] In some embodiments of this disclosure, the control audio device executes a target audio control mode corresponding to the control command, including:

[0035] Control the microphone in the audio device to acquire upstream audio to the target audio acquisition area; and / or,

[0036] Control the speakers in the audio device to output downlink audio to the target audio output area.

[0037] In some embodiments of this disclosure, the proportion of the target audio output region to the maximum audio output region is equal to or greater than a second preset proportion threshold.

[0038] The proportion of the target audio acquisition area to the maximum audio acquisition area is equal to or greater than the third preset proportion threshold.

[0039] In some embodiments of this disclosure, the target audio control mode further includes the on / off state of the microphone, and controlling the microphone in the audio device to acquire uplink audio to the target audio acquisition area includes:

[0040] In response to the microphone being in the on state, the uplink audio is acquired through the microphone in the target audio acquisition area;

[0041] The target audio control mode also includes the speaker's on / off state and volume, and controlling the speaker in the audio device to output downlink audio to the target audio output area includes:

[0042] In response to the speaker being in an on / off state, the downlink audio is output through the microphone at the target audio output area and the volume.

[0043] In some embodiments of this disclosure, the control method of the audio call system further includes:

[0044] In response to a change in location information or audio device information, the updated location information and audio device information are sent to the second terminal.

[0045] In some embodiments of this disclosure, establishing a communication connection with the second terminal includes:

[0046] In response to receiving a first request instruction sent by the second terminal, a second prompt message is displayed, wherein the first request instruction is used to request the first terminal to access the audio call system;

[0047] In response to a user's second preset operation on the second prompt information, a response signal is sent to the second terminal, and a communication connection is established with the second terminal; or...

[0048] A second request instruction is sent to the second terminal to cause the second terminal to display a first prompt message. The second request instruction is used to request access to the audio call system.

[0049] In response to the user's first preset operation on the first prompt information, a communication connection is established with the second terminal.

[0050] According to a third aspect of the present disclosure, a control device for an audio call system is provided, the control device for the audio call system comprising:

[0051] A first connection module is used to establish a communication connection with multiple first terminals, so that each first terminal can access the audio call system;

[0052] The determining module is used to determine the target audio control mode of each first terminal based on the distribution information of the plurality of first terminals and the audio device information of each first terminal.

[0053] The sending module is used to send corresponding control instructions to each of the first terminals. The control instructions are used to instruct the audio devices of the first terminals to execute the corresponding target audio control mode in order to eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio devices of the first terminals.

[0054] According to a fourth aspect of the present disclosure, a control device for an audio call system is provided, the control device for the audio call system comprising:

[0055] The second connection module is used to establish a communication connection with the second terminal to access the audio call system;

[0056] The receiving module is used to receive control commands sent by the second terminal;

[0057] The control module is used to control the audio device to execute a target audio control mode corresponding to the control command based on the control command;

[0058] The target audio control mode is determined based on the distribution information of the first terminal in the audio call system and the audio device information of the first terminal.

[0059] According to a fifth aspect of the present disclosure, an audio call system is provided, the audio call system including a second terminal and a plurality of first terminals, the second terminal being used for:

[0060] Establish communication connections with multiple first terminals so that each first terminal can access the audio call system;

[0061] Based on the distribution information of the plurality of first terminals and the audio device information of each first terminal, the target audio control mode of each first terminal is determined.

[0062] Send corresponding control instructions to each of the first terminals. The control instructions are used to instruct the audio devices of the first terminals to execute the corresponding target audio control mode in order to eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio devices of the first terminals.

[0063] Each of the first terminals is used for:

[0064] Establish a communication connection with the second terminal to access the audio call system;

[0065] Receive the control command sent by the second terminal;

[0066] Based on the control command, the audio device is controlled to execute the target audio control mode corresponding to the control command.

[0067] According to a sixth aspect of the present disclosure, an electronic device is provided, the electronic device comprising:

[0068] processor;

[0069] Memory used to store processor-executable instructions;

[0070] The processor is configured to execute the control method of the audio call system as described in the first or second aspect.

[0071] According to a seventh aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, wherein when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform a control method for an audio call system as described in the first or second aspect.

[0072] According to an eighth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements a control method for an audio call system as described in the first or second aspect.

[0073] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects: the target audio control mode of each first terminal can be determined according to the distribution of each first terminal and the audio device of the first terminal. The audio device of each first terminal realizes the coordination between each first terminal by executing the corresponding target audio control mode, which can eliminate or reduce the interference and influence of the downlink audio output by other first terminals on the acquisition of uplink audio, thereby avoiding the occurrence of howling problems, ensuring the audio call effect, and improving the user experience.

[0074] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0075] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0076] Figure 1 This is a flowchart illustrating a control method for an audio call system according to an exemplary embodiment.

[0077] Figure 2This is a flowchart illustrating the establishment of a communication connection with a plurality of first terminals according to an exemplary embodiment.

[0078] Figure 3 This is a flowchart illustrating the establishment of a communication connection with a plurality of first terminals according to another exemplary embodiment.

[0079] Figure 4 This is a flowchart illustrating a control method for an audio call system according to another exemplary embodiment.

[0080] Figure 5 This is a flowchart illustrating a control method for an audio call system according to another exemplary embodiment.

[0081] Figure 6 This is a flowchart illustrating the establishment of a communication connection with a second terminal according to an exemplary embodiment.

[0082] Figure 7 This is a flowchart illustrating the establishment of a communication connection with a second terminal according to another exemplary embodiment.

[0083] Figure 8 This is a flowchart illustrating a control method for an audio call system according to another exemplary embodiment.

[0084] Figure 9 This is a block diagram of a control device for an audio call system according to an exemplary embodiment.

[0085] Figure 10 This is a block diagram of a control device for an audio call system according to another exemplary embodiment.

[0086] Figure 11 This is a schematic diagram of an audio call system according to an exemplary embodiment.

[0087] Figure 12 This is a block diagram of an electronic device according to an exemplary embodiment.

[0088] In the picture:

[0089] 10-First connection module; 20-Determining module; 30-Transmitting module; 40-Second connection module; 50-Receiving module; 60-Control module; 70-Second terminal; 80-First terminal; 101-Processing component; 102-Memory; 103-Power component; 104-Multimedia component; 105-Audio component; 106-Input / output interface; 107-Sensor component; 108-Communication component; 109-Processor. Detailed Implementation

[0090] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the invention as detailed in the appended claims.

[0091] In recent years, with the rapid development of audio processing technology and communication connection technology between electronic devices, audio call systems with multi-party audio call functions have been widely used in audio conferencing, online classes and interactive live streaming. Users can collect and output audio through the audio devices of the terminals connected to the audio call system to achieve audio calls with other users.

[0092] In related technologies, in order to ensure the stability and convenience of audio acquisition by each terminal in the audio call system, as well as the stability and clarity of audio output, it is usually necessary to simultaneously turn on the audio devices of each terminal and acquire uplink audio and output downlink audio through the audio devices.

[0093] However, when using related technologies to control the operation of an audio call system, if multiple terminals connected to the audio call system are located in the same space, such as the same conference room, it is difficult to ensure their coordination. When users collect audio through their own devices, they are likely to collect audio output from other users' devices. After positive excitation, the collected audio will cause feedback problems, affecting the audio call effect and resulting in a poor user experience.

[0094] Based on this, an exemplary embodiment of this disclosure provides a control method for an audio call system. This method establishes communication connections with multiple first terminals to connect each first terminal to the audio call system. Based on the distribution information of the multiple first terminals and the audio device information of each first terminal, a target audio control mode for each first terminal is determined. Then, a control command corresponding to the target audio control mode is sent to each first terminal to instruct its audio device to execute the corresponding target audio control mode. This can eliminate or reduce downlink audio output by other first terminals' audio devices included in the uplink audio collected by the first terminal's audio device. The target audio control mode for each first terminal can be determined based on its distribution and audio device information. By executing the corresponding target audio control mode, the audio devices of each first terminal achieve coordination, eliminating or reducing the interference and impact of downlink audio output by other first terminals on the collected uplink audio. This avoids feedback problems, ensures audio call quality, and improves user experience.

[0095] The control method for the audio call system provided in this application can be applied to audio call scenarios involving multiple users. Each user can access the audio call system through their own terminal device, and audio acquisition and output can be achieved without moving their location or switching devices when speaking alternately. For example, all users accessing the audio call system can be located in the same space, such as the same conference room, or some users can be located in the same space, such as the same conference room, while other users can participate in the audio call online.

[0096] In one exemplary embodiment, a control method for an audio call system is provided, applied to a second terminal, such as a mobile phone, laptop computer, or other electronic device. The second terminal can act as the master control device in the audio call system, allowing the organizer of the audio call to control the system. (Reference) Figure 1 As shown, the control method of the audio call system includes:

[0097] S100: Establish communication connections with multiple first terminals so that each first terminal can access the audio call system.

[0098] In step S100, the second terminal establishes a communication connection with multiple first terminals, enabling each first terminal to access an audio call system for conducting audio calls. The audio call system may include, for example, an audio conferencing system, an online classroom system, or an interactive live streaming system—systems requiring audio calls. The organizers of the audio call can create device monitoring and network the devices using the second terminal. The first terminals can be electronic devices with audio equipment, such as mobile phones or laptops. The first terminals can act as slave devices in the audio call system, and participants in the audio call can access the audio call system through their first terminals.

[0099] S200: Based on the distribution information of multiple first terminals and the audio device information of each first terminal, determine the target audio control mode of each first terminal.

[0100] In step S200, the distribution information of multiple first terminals is used to characterize the distribution of each first terminal, and the relative positional relationship of each first terminal can be determined based on the distribution information of multiple first terminals. The audio device information of each first terminal is used to characterize whether the audio device of each first terminal is used to collect uplink audio, output downlink audio, or simultaneously collect uplink audio and output downlink audio. The second terminal can determine the distribution information of multiple first terminals and obtain the audio device information of each first terminal, so as to determine the target audio control mode corresponding to each first terminal based on the distribution information of multiple first terminals connected to the audio call system and the audio device information of each first terminal. The target audio control mode may include, for example, the on / off state of the audio device of each first terminal and the spatial area that can be radiated after being turned on. The target audio control mode can determine the number, location, and directionality of each first terminal with its audio device turned on in the audio call system.

[0101] S300: Send corresponding control instructions to each first terminal. The control instructions are used to instruct the audio device of the first terminal to execute the corresponding target audio control mode in order to eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio device of the first terminal.

[0102] In step S300, the second terminal sends control commands corresponding to its target audio control mode to each first terminal in the audio call system, instructing the audio device of the first terminal to execute the corresponding target audio control mode. Since the target audio control mode corresponding to each first terminal is determined based on the distribution information of multiple first terminals and the audio device information of each first terminal, the target audio control mode of each first terminal can be adapted to the distribution of each first terminal and the audio devices possessed by the first terminal. By executing the corresponding target audio control mode, each first terminal can control the spatial area radiated after its audio device is turned on, thereby eliminating or reducing the downlink audio output by other first terminal's audio devices contained in the uplink audio collected by the first terminal's audio device, thus avoiding the occurrence of feedback problems while ensuring clear and convenient audio calls.

[0103] In this embodiment, communication connections are established with multiple first terminals to connect them to the audio call system. Based on the distribution information of the multiple first terminals and the audio device information of each first terminal, a target audio control mode for each first terminal is determined. Then, control commands corresponding to the target audio control mode are sent to each first terminal to instruct its audio device to execute the corresponding target audio control mode. This eliminates or reduces downlink audio output from other first terminals' audio devices that is included in the uplink audio collected by the first terminal's audio device. The target audio control mode for each first terminal can be determined based on its distribution and audio device information. By executing the corresponding target audio control mode, the audio devices of each first terminal achieve coordination, eliminating or reducing the interference and impact of downlink audio output from other first terminals on the collected uplink audio. This avoids feedback problems, ensures audio call quality, and improves user experience.

[0104] In some embodiments, the distribution information of the plurality of first terminals includes the number of first terminals and the location information of the first terminals, and the audio device information includes the type of audio device contained in the first terminal.

[0105] The distribution information of multiple first terminals can include the number of first terminals and their location information. This allows for characterizing the distribution of each first terminal and determining their relative positional relationships. The second terminal can statistically analyze the first terminals accessing the audio call system to determine their total number. Each first terminal can be located, for example, using Ultra Wide Band (UWB) technology, to acquire its location information and transmit it to the second terminal.

[0106] The audio device information includes the type of audio device contained in the first terminal. The audio device types include microphones and speakers. When the audio device information indicates that the type of audio device contained in the first terminal is a microphone, it means that the audio device of the first terminal can be used for uplink audio acquisition. The target audio control mode corresponding to this first terminal needs to control the spatial area corresponding to the microphone's audio acquisition. When the audio device information indicates that the type of audio device contained in the first terminal is a speaker, it means that the audio device of the first terminal can be used for downlink audio output. The target audio control mode corresponding to this first terminal needs to control the spatial area corresponding to the speaker's audio output, thereby ensuring that the target audio control mode can eliminate or reduce the downlink audio output by other audio devices of the first terminal contained in the uplink audio acquired by the first terminal's audio device.

[0107] In this embodiment, the number of first terminals and their location information are used as the distribution information of the first terminals, and the type of audio devices included in the first terminals is used as the audio device information of the first terminals. This allows the number, location, and type of audio devices included in the first terminals to serve as the basis for determining the corresponding target audio control mode. This enables the target audio control mode to be compatible with the distribution of the first terminals and the functions of audio acquisition and output. As a result, it can eliminate or reduce the downlink audio output by other audio devices of the first terminals that are included in the uplink audio acquired by the audio devices of the first terminals, thus avoiding the occurrence of feedback problems, ensuring the audio call effect, and improving the user experience.

[0108] In some embodiments, the audio device of the first terminal includes a microphone, and the target audio control mode includes the target audio acquisition area of ​​the microphone; or, the audio device of the first terminal includes a speaker, and the target audio control mode includes the target audio output area of ​​the speaker; or, the audio device of the first terminal includes a microphone and a speaker, and the target audio control mode includes the target audio acquisition area of ​​the microphone and the target audio output area of ​​the speaker.

[0109] The audio device of the first terminal may include a microphone, which can be used to capture uplink audio. When the audio device of the first terminal held by the user includes a microphone, the user can speak through the microphone. The target audio control mode includes the target audio acquisition area of ​​the microphone. The target audio acquisition area of ​​the microphone is the spatial area in which the microphone can capture uplink audio under the current posture of the first terminal. The target audio acquisition area of ​​the microphone can be changed by controlling the microphone directivity. When the first terminal executes the corresponding target audio control mode, the microphone can capture the user's voice located within the target audio acquisition area as uplink audio.

[0110] The audio device of the first terminal may also include a speaker, which is capable of outputting downlink audio. When the audio device of the first terminal held by the user includes a speaker, the user can hear the voices of other users through the speaker. The target audio control mode includes a target audio output area of ​​the speaker, which is the spatial area in which the downlink audio output by the speaker can be heard in the current posture of the first terminal. The target audio output area of ​​the speaker can be changed by controlling the sound field of the speaker. When the first terminal executes the corresponding target audio control mode, the speaker can output downlink audio within the target audio output area, so that the user located within the target audio output area can hear the voices of other users in the audio call system.

[0111] In this embodiment, the audio device of the first terminal includes a microphone and a speaker. The target audio acquisition area of ​​the microphone and the target audio output area of ​​the speaker are used as the target audio control mode. The target audio acquisition area of ​​the microphone and the target audio output area of ​​the speaker are determined according to the distribution information of the first terminal and the audio device information of the first terminal. This can avoid large-scale overlap between the target audio acquisition area of ​​the microphone of the first terminal and the target audio output area of ​​the speaker of other first terminals. This allows the acquisition of uplink audio and the output of downlink audio of other first terminals to act on relatively independent spatial areas, thereby eliminating or reducing the downlink audio output of other first terminals' speakers contained in the uplink audio acquired by the microphone of the first terminal. This avoids the occurrence of feedback problems, ensures the audio call effect, and improves the user experience.

[0112] In some embodiments, the target audio control mode of each first terminal is configured such that the target audio acquisition area corresponding to any first terminal is offset from the target audio output areas corresponding to other first terminals. Alternatively, the overlapping area of ​​the target audio acquisition area corresponding to any first terminal with the target audio output areas corresponding to other first terminals is less than a first preset proportion threshold. Alternatively, the angle between the center direction of the target audio acquisition area corresponding to any first terminal and the center direction of the target audio output areas corresponding to other first terminals is greater than a preset angle threshold.

[0113] The target audio control mode of each first terminal can be configured such that the target audio acquisition area corresponding to any first terminal is staggered from the target audio output areas corresponding to other first terminals. That is, the spatial area in which the microphone of any first terminal acquires the uplink audio is staggered from the spatial area in which the speaker of other first terminals outputs the downlink audio. This can completely prevent the downlink audio output by the speaker of other first terminals from being acquired by the microphone, thereby eliminating the downlink audio output by the speaker of other first terminals contained in the uplink audio acquired by the microphone of the first terminal.

[0114] The target audio control mode for each first terminal can also be configured such that the proportion of the overlapping area between the target audio acquisition area of ​​any first terminal and the target audio output areas of other first terminals is less than a first preset proportion threshold. In other words, the spatial area where the microphone of any first terminal acquires uplink audio is offset from or partially overlaps with the spatial area where the speaker outputs downlink audio of other first terminals. This reduces the signal strength of the downlink audio output by the speakers of other first terminals acquired by the microphone, thereby eliminating or weakening the downlink audio output by the speakers of other first terminals contained in the uplink audio acquired by the microphone of the first terminal. The first preset proportion threshold can be set based on empirical values ​​when feedback problems occur.

[0115] The target audio control mode for each first terminal can also be configured such that the angle between the center direction of the target audio acquisition area corresponding to any first terminal and the center direction of the target audio output area corresponding to other first terminals is greater than a preset angle threshold. In other words, the difference between the extension direction of the spatial area where the microphone of any first terminal acquires the uplink audio and the extension direction of the spatial area where the speaker of another first terminal outputs the downlink audio is sufficiently large to reduce the signal strength of the downlink audio output by the speaker of another first terminal acquired by the microphone. This eliminates or weakens the downlink audio output by the speaker of another first terminal contained in the uplink audio acquired by the microphone of the first terminal. The preset angle threshold can be set based on empirical values ​​when feedback problems occur.

[0116] In this embodiment, by controlling the relative positional relationship between the target audio acquisition area corresponding to each first terminal and the target audio output area corresponding to other first terminals, the execution of the target audio control mode is realized. This allows the acquisition of uplink audio and the output of downlink audio to act on relatively independent spatial areas, thereby eliminating or reducing the downlink audio output by the speakers of other first terminals contained in the uplink audio acquired by the microphone of the first terminal. This avoids the occurrence of feedback problems, ensures the audio call effect, and improves the user experience.

[0117] In some embodiments, the proportion of the target audio output area of ​​each speaker to the maximum audio output area of ​​that speaker is equal to or greater than a second preset proportion threshold. The proportion of the target audio acquisition area of ​​each microphone to the maximum audio acquisition area of ​​that microphone is equal to or greater than a third preset proportion threshold.

[0118] The target audio output area of ​​each speaker is typically smaller than its maximum audio output area. The ratio of the target audio output area to the maximum audio output area of ​​each speaker can be set to be equal to or greater than a second preset ratio threshold. This means that the actual downward audio output area of ​​the first terminal's speaker occupies a sufficiently large proportion of the maximum area the speaker can use for downward audio output, ensuring the sound intensity of the downward audio output and thus guaranteeing the clarity of the output. The second preset ratio threshold can be set based on empirical values ​​that ensure good sound quality.

[0119] The target audio acquisition area of ​​each microphone is typically smaller than its maximum audio acquisition area. The ratio of the target audio acquisition area to the maximum audio acquisition area of ​​each microphone can be set to be equal to or greater than a third preset ratio threshold. This means that the actual uplink audio acquisition area of ​​the first terminal's microphone occupies a sufficiently large proportion of the maximum uplink audio acquisition area available for that microphone, ensuring the signal strength of the acquired uplink audio and thus guaranteeing the stability of the uplink audio acquisition. The third preset ratio threshold can be set based on empirical values ​​that ensure good sound reception.

[0120] In this embodiment, by setting the ratio of the target audio output area of ​​each speaker to the maximum audio output area of ​​the speaker to be equal to or greater than a second preset ratio threshold, and setting the ratio of the target audio acquisition area of ​​each microphone to the maximum audio acquisition area of ​​the microphone to be equal to or greater than a third preset ratio threshold, the sound intensity of the downlink audio output by the speaker and the signal strength of the uplink audio acquired by the microphone can be guaranteed. This ensures the clarity of the downlink audio output and the stability of the uplink audio acquisition. Under the premise of ensuring the audio call effect of each first terminal, the problem of howling is avoided, and the user experience is improved.

[0121] In some embodiments, the target audio control mode further includes at least one of: microphone on / off state, speaker on / off state, and speaker volume.

[0122] The target audio control mode can also include the on / off state of the microphone. When there are multiple microphones with overlapping target audio acquisition areas in a small spatial area, one or more microphones can be turned off by executing the corresponding target audio control mode. When the target audio acquisition area of ​​a microphone is difficult to offset from the target audio output area of ​​other first terminal speakers, the microphone can be turned off by executing the corresponding target audio control mode.

[0123] The target audio control mode can also include the speaker's on / off state. When there are multiple speakers with overlapping target audio output areas in a small space, one or more speakers can be turned off by executing the corresponding target audio control mode. When the target audio output area of ​​a speaker is difficult to avoid being misaligned with the target audio acquisition area of ​​other first terminal's microphone, the speaker can be turned off by executing the corresponding target audio control mode.

[0124] The target audio control mode may also include speaker volume. The volume of each speaker can be controlled by executing the corresponding target audio control mode through the speaker, which can ensure the clarity of the output downlink audio and reduce the downlink audio output by other first terminal speakers in the uplink audio collected by the first terminal's microphone by reducing the speaker volume.

[0125] In this embodiment, at least one of the microphone's on / off state, the speaker's on / off state, and the speaker's volume is used as the target audio control mode. This allows the microphone and speaker to control their on / off states and speaker volume by executing the corresponding target audio control mode. The microphone's on / off state, the speaker's on / off state, and the speaker's volume are determined based on the distribution information of the first terminal and the audio device information. This ensures that the microphone and speaker's on / off states and speaker volume are adapted to actual needs and the current audio call scenario. It avoids wasting power and interfering with call quality caused by activating unnecessary audio devices, thus improving the user experience.

[0126] In some embodiments, the control method of the audio call system further includes: in response to a change in distribution information, updating the target audio control mode of each first terminal based on the changed distribution information.

[0127] During the operation of the audio call system, the number of first terminals in the system will change when a first terminal leaves or a new first terminal joins. Furthermore, the location of the first terminal will change when the user moves while holding it, thus altering the distribution information of the multiple first terminals. To maintain coordination among the first terminals, the target audio control mode of each first terminal needs to be updated based on the changed distribution information. This ensures that the updated target audio control mode can still eliminate or reduce the downlink audio output from other first terminals' audio devices that is included in the uplink audio collected by the first terminal's audio device.

[0128] In this embodiment, when the distribution information changes, the target audio control mode of each first terminal is updated according to the changed distribution information, and corresponding control commands are issued to make the audio devices of each first terminal execute the updated target audio control mode. This ensures that the target audio control mode can be adapted to the current distribution of the first terminals, thereby ensuring that the updated target audio control mode can still eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio devices of the first terminals. This provides timely control of the audio call system and improves the user experience.

[0129] In some embodiments, reference Figure 2As shown, establishing communication connections with multiple first terminals includes:

[0130] S110: Search for multiple terminals to be connected within a preset range.

[0131] In step S110, the second terminal can search for multiple terminals within a preset search range to be connected. Each of these terminals has the permission to access the audio call system as a first terminal. For example, the audio call system is an audio conferencing system, and the second terminal can search for multiple terminals equipped with audio devices within a conference room.

[0132] S120. Send a first request instruction to each of the searched terminals to be connected. The first request instruction is used to request the terminals to be connected to access the audio call system.

[0133] In step S120, the second terminal sends a first request instruction to each of the searched terminals to be connected. The first request instruction is used to request the terminals to be connected to access the audio call system, thereby sending an audio call invitation to users holding the searched terminals. It is understood that the organizers of the audio call can also select from the searched terminals to send the first request instruction to only some of them, avoiding connecting terminals without audio call needs to the audio call system.

[0134] S130. In response to receiving a response signal sent by a terminal to be connected, each terminal to be connected that sent the response signal is designated as a first terminal, and a communication connection is established with each first terminal.

[0135] In step S130, after receiving the first request instruction, if the user holding the terminal to be connected agrees to the audio call invitation, the terminal to be connected can send a response signal corresponding to the first request instruction to the second terminal. When the second terminal receives the response signal sent by the terminal to be connected, it can identify the terminal to be connected that sent the response signal, i.e., agreed to access the audio call system, as the first terminal, and establish a communication connection with each first terminal, so that each first terminal can access the audio call system.

[0136] In this embodiment, multiple terminals to be connected within a preset range are searched, and a first request instruction is sent to each of the searched terminals. When a response signal is received from a terminal to be connected, the terminal that sent the response signal is taken as a first terminal, and a communication connection is established with each first terminal. This realizes the communication connection between the second terminal and the first terminal, so that each first terminal can access the audio call system, thereby realizing the networking of the devices and the establishment of the audio call system.

[0137] In other embodiments, reference is made to... Figure 3As shown, establishing communication connections with multiple first terminals includes:

[0138] S140. In response to receiving a second request instruction sent by the terminal to be connected, display a first prompt message. The second request instruction is used to request access to the audio call system.

[0139] In step S140, the terminal to be connected can also actively send a second request instruction to the second terminal. The second request instruction is used to request access to the audio call system. When the second terminal receives the second request instruction sent by the terminal to be connected, it can display a first prompt message on the interactive interface of the second terminal to prompt the user holding the terminal to be connected to request access to the audio call system.

[0140] S150: In response to the user's first preset operation on the first prompt information, the terminal to be connected that sends the second request instruction is designated as the first terminal, and a communication connection is established with each of the first terminals.

[0141] In step S150, the user can perform a corresponding first preset operation in response to the first prompt information. When the second terminal recognizes the user's first preset operation in response to the first prompt information, the terminal to be connected that sent the second request instruction is designated as the first terminal, and a communication connection is established with the first terminal so that each first terminal can access the audio call system.

[0142] For example, the first prompt information may be displayed as a prompt box, showing the ID of the terminal to be connected and the time of requesting access to the audio call. The prompt box of the first prompt information may include control icons corresponding to "agree to access" and "disagree to access". The first preset operation may be the user clicking the control icon corresponding to "agree to access" in the interactive interface of the second terminal.

[0143] In this embodiment, when a second request instruction is received from a terminal to be connected, a first prompt message is displayed. When a user's first preset operation on the first prompt message is detected, the terminal to be connected that sent the second request instruction is designated as a first terminal, and a communication connection is established with each first terminal. This realizes the communication connection between the second terminal and the first terminal, enabling each first terminal to access the audio call system, thereby realizing the networking of the devices and the establishment of the audio call system.

[0144] In some embodiments, the downlink audio output by the audio device of the first terminal includes uplink audio collected by each audio device and online audio transmitted to the audio call system.

[0145] The downlink audio output by the speaker of the first terminal includes the uplink audio collected by each microphone, so that other users can hear the voice of the user speaking in the same space through the speaker. The downlink audio output by the speaker of the first terminal also includes online audio transmitted to the audio call system, so that users can also hear the voices of other users participating in the audio call online through the speaker. This allows the control method of the audio call system to be used in a variety of different audio call scenarios.

[0146] In this embodiment, the uplink audio collected by each audio device and the online audio transmitted to the audio call system are combined as the downlink audio output by the audio device of the first terminal. This allows the user to hear the voices of the speaking user in the same space and the voices of other users participating in the audio call online through the speaker. This improves the applicability of the control method of the audio call system and can eliminate or reduce the interference and influence of the output downlink audio on the collected uplink audio, thereby avoiding the occurrence of howling problems, ensuring the audio call effect, and improving the user experience.

[0147] In one exemplary embodiment, a control method for an audio call system is provided, applied to a second terminal, with reference to... Figure 4 As shown, the control method of the audio call system includes:

[0148] S1. Search for multiple terminals to be connected within a preset range;

[0149] S2. Send a first request instruction to each of the searched terminals to be connected. The first request instruction is used to request the terminals to be connected to access the audio call system.

[0150] S3. In response to receiving a response signal sent by a terminal to be connected, each terminal to be connected that sent the response signal is designated as a first terminal, and a communication connection is established with each first terminal so that each first terminal can access the audio call system.

[0151] S4. Based on the number of first terminals, the location information of the first terminals, and the type of audio devices contained in the first terminals, determine the target audio control mode of each first terminal. The target audio control mode includes the target audio acquisition area of ​​each microphone, the target audio output area of ​​each speaker, the on / off state of each microphone, the on / off state of each speaker, and the volume of each speaker.

[0152] S5. Send corresponding control commands to each first terminal. The control commands are used to instruct the microphone and speaker of the first terminal to execute the corresponding target audio control mode in order to eliminate or reduce the downlink audio output by the speakers of other first terminals contained in the uplink audio collected by the microphone of the first terminal.

[0153] S6. In response to changes in distribution information, re-execute S4.

[0154] In this embodiment, communication connections are established with multiple first terminals to connect them to the audio call system. Based on the number of first terminals, their location information, and the type of audio devices they contain, a target audio control mode is determined for each first terminal. Control commands corresponding to the target audio control mode are then sent to each first terminal, instructing their audio devices to execute the corresponding target audio control mode. This eliminates or reduces the downlink audio output from other first terminals' speakers that is included in the uplink audio collected by the microphone of a first terminal. By executing the corresponding target audio control mode, the audio devices of each first terminal achieve coordination, eliminating or reducing the interference and impact of downlink audio output from other first terminals on the collected uplink audio. This avoids feedback problems, ensures audio call quality, and improves the user experience.

[0155] In one exemplary embodiment, a control method for an audio call system is provided, applied to a first terminal. The first terminal can be, for example, an electronic device with audio equipment such as a mobile phone or a laptop. The first terminal can act as a slave device in the audio call system, and participants in the audio call can access the audio call system through the first terminal. (Reference) Figure 5 As shown, the control method of the audio call system includes:

[0156] S400: Establish a communication connection with the second terminal to access the audio call system.

[0157] In step S400, the first terminal establishes a communication connection with the second terminal, enabling the first terminal to access an audio call system for conducting audio calls. The audio call system may include, for example, an audio conferencing system, an online classroom system, or an interactive live streaming system—systems requiring audio calls. The second terminal may be an electronic device such as a mobile phone or laptop. The second terminal acts as the master control device in the audio call system, allowing the organizers to create device monitoring and network connections through the second terminal.

[0158] S500 receives control commands sent by the second terminal.

[0159] S600: Based on control commands, control the audio device to execute the target audio control mode corresponding to the control commands. The target audio control mode is determined according to the distribution information of the first terminal in the audio call system and the audio device information of the first terminal.

[0160] In steps S500 and S600, the first terminal can receive control commands sent by the second terminal, and according to the received control commands, control the audio device of the first terminal to execute the target audio control mode corresponding to the control commands. The target audio control mode may include, for example, the on / off state of the audio device of the first terminal and the spatial area that it can radiate after being turned on. The target audio control mode corresponding to each first terminal collectively determines the number, location, and directionality of each first terminal with its audio device turned on in the audio call system.

[0161] The target audio control mode corresponding to the first terminal is determined based on the distribution information of multiple first terminals connected to the audio call system and the audio device information of each first terminal. Different first terminals receive different control commands and execute different target audio control modes, so that the target audio control mode of each first terminal can be adapted to the distribution of each first terminal and the audio device of the first terminal.

[0162] It is understandable that by controlling the first terminal to execute the corresponding target audio control mode, it is possible to eliminate or reduce the downlink audio output by other first terminal audio devices contained in the uplink audio collected by the first terminal's audio device in the audio call system, thereby avoiding the occurrence of howling problems while ensuring clear and convenient audio calls.

[0163] In this embodiment, by establishing a communication connection with the second terminal to access the audio call system and receiving control commands sent by the second terminal, the audio device is controlled to execute the target audio control mode corresponding to the control command, thereby realizing the control of the audio device of the first terminal in the audio call system. The audio devices of each first terminal can achieve coordination among multiple first terminals by executing the corresponding target audio control mode. This can eliminate or reduce the interference and impact of downlink audio output from other first terminals on the uplink audio collected by one first terminal, thereby avoiding the howling problem, ensuring audio call quality, and improving the user experience.

[0164] In some embodiments, controlling the audio device to execute a target audio control mode corresponding to the control command includes: controlling the microphone in the audio device to acquire uplink audio in the target audio acquisition area, or controlling the speaker in the audio device to output downlink audio in the target audio output area. Alternatively, it may involve controlling the microphone in the audio device to acquire uplink audio in the target audio acquisition area and controlling the speaker in the audio device to output downlink audio in the target audio output area.

[0165] The audio device of the first terminal may include a microphone, which can be used to capture uplink audio. When the audio device of the first terminal held by the user includes a microphone, the user can speak through the microphone. The target audio control mode includes the target audio acquisition area of ​​the microphone. The target audio acquisition area of ​​the microphone is the spatial area in which the microphone can capture uplink audio in the current posture of the first terminal. The target audio acquisition area of ​​the microphone can be changed by controlling the microphone directivity. When the first terminal controls the audio device to execute the target audio control mode corresponding to the control command, it can control the microphone in the audio device to capture uplink audio with the target audio acquisition area, using the user's voice located within the target audio acquisition area as the uplink audio.

[0166] The audio device of the first terminal may also include a speaker, which is used to output downlink audio. When the audio device of the first terminal held by the user includes a speaker, the user can hear the voices of other users through the speaker. The target audio control mode includes a target audio output area of ​​the speaker, which is the spatial area in which the downlink audio output by the speaker can be heard in the current posture of the first terminal. The target audio output area of ​​the speaker can be changed by controlling the sound field of the speaker. When the first terminal controls the audio device to execute the target audio control mode corresponding to the control command, it can control the speaker in the audio device to output downlink audio in the target audio output area, so that the user located in the target audio output area can hear the voices of other users in the audio call system.

[0167] In this embodiment, by controlling the microphone in the audio device to collect uplink audio with a target audio acquisition area and controlling the speaker in the audio device to output downlink audio with a target audio output area, the target audio control mode corresponding to the control command is realized. This allows the target audio acquisition area of ​​the microphone of the first terminal and the target audio output area of ​​the speaker to be determined based on the distribution information of multiple first terminals in the audio call system and the audio device information of each first terminal. This avoids large-scale overlap between the target audio acquisition area of ​​the microphone of the first terminal and the target audio output area of ​​the speaker of other first terminals. This allows the acquisition of uplink audio and the output of downlink audio of other first terminals to act on relatively independent spatial areas, thereby eliminating or reducing the downlink audio output of other first terminals' speakers contained in the uplink audio acquired by the microphone of one first terminal. This avoids the occurrence of feedback problems, ensures the audio call effect, and improves the user experience.

[0168] In some embodiments, the target audio control mode further includes a microphone on / off state, controlling the microphone in the audio device to acquire uplink audio within the target audio acquisition area, including: in response to the microphone's on / off state being in an on state, acquiring uplink audio within the target audio acquisition area via the microphone. The target audio control mode also includes a speaker on / off state and volume, controlling the speaker in the audio device to output downlink audio within the target audio output area, including: in response to the speaker's on / off state being in an on state, outputting downlink audio within the target audio output area and volume via the microphone.

[0169] The target audio control mode can also include the microphone's on / off state. When controlling the microphone in the audio device to collect upstream audio from the target audio acquisition area, the microphone can be in the on / off state to collect upstream audio from the target audio acquisition area, thereby controlling the on / off state of the microphone of the first terminal. When there are multiple microphones with overlapping target audio acquisition areas in a small spatial area, one or more microphones of the first terminal can be turned off by executing the corresponding target audio control mode. When the target audio acquisition area of ​​a microphone of a first terminal is difficult to offset from the target audio output area of ​​the speakers of other first terminals, the microphone of that first terminal can be turned off by executing the corresponding target audio control mode.

[0170] The target audio control mode can also include the speaker's on / off state and volume. When controlling the speaker in the audio device to output downlink audio in the target audio output area, the microphone can output downlink audio in the target audio output area and volume when the speaker's on / off state is on, thereby controlling the on / off state and volume of the first terminal's speaker. When there are multiple speakers with overlapping target audio output areas in a small space, one or more first terminal speakers can be turned off by executing the corresponding target audio control mode. When the target audio output area of ​​a first terminal's speaker is difficult to offset from the target audio acquisition area of ​​other first terminal microphones, the speaker of that first terminal can be turned off by executing the corresponding target audio control mode. Controlling the volume of the first terminal's speaker by executing the corresponding target audio control mode ensures the clarity of the downlink audio output by the first terminal and reduces the downlink audio output by other first terminal speakers included in the uplink audio acquired by the first terminal's microphone by reducing the volume of other first terminal speakers.

[0171] In this embodiment, the on / off state of the microphone, the on / off state of the speaker, and the speaker volume are used as target audio control modes. This allows the microphone and speaker to control their on / off states and speaker volume by executing the corresponding target audio control modes. The on / off states of the microphone and speaker, and the speaker volume are determined based on the distribution information of the first terminal and the audio device information. This ensures that the on / off states of the microphone and speaker, as well as the speaker volume, are adapted to the actual needs and the current audio call scenario. It avoids the power waste caused by turning on unnecessary audio devices and the interference with call quality, thus improving the user experience.

[0172] In some embodiments, the control method of the audio call system further includes: in response to a change in location information or audio device information, sending updated location information and audio device information to a second terminal.

[0173] During the operation of the audio call system, when a user moves the first terminal, the location of the first terminal changes, thus changing its location information. When the first terminal installs or removes a type of audio device, or when a type of audio device malfunctions, its audio device information changes. These changes in the location or audio device information of the first terminal lead to changes in the distribution information and audio device information of multiple first terminals within the audio call system. To maintain coordination among the first terminals, the first terminal whose location or audio device information has changed needs to send updated location and audio device information to the second terminal. This allows the second terminal to update the target audio control mode for each first terminal based on the changed distribution and audio device information.

[0174] It is understandable that if a first terminal chooses to exit the audio call system, the number of first terminals in the audio call system will change, and the distribution information of multiple first terminals in the audio call system will also change. The second terminal can recognize and respond to the action of the first terminal exiting the audio call system, and update the target audio control mode of each first terminal according to the changed distribution information.

[0175] In this embodiment, when the location information or audio device information of the first terminal changes, the updated location information and audio device information are sent to the second terminal. This allows the second terminal to update the target audio control mode of each first terminal based on the changed distribution information and audio device information, and issue corresponding control commands to make the audio devices of each first terminal execute the updated target audio control mode. This ensures that the target audio control mode is compatible with the current distribution of the first terminals and the available audio devices, thereby ensuring that the updated target audio control mode can still eliminate or reduce the downlink audio output by other first terminal audio devices contained in the uplink audio collected by the first terminal's audio device. This provides timely control of the audio call system and improves the user experience.

[0176] In some embodiments, reference Figure 6 As shown, establishing a communication connection with the second terminal includes:

[0177] S410. In response to receiving a first request instruction sent by the second terminal, display a second prompt message. The first request instruction is used to request the first terminal to access the audio call system.

[0178] In step S410, the first terminal can receive a first request instruction sent by the second terminal. The first request instruction is used to request the first terminal to access the audio call system. The organizer of the audio call can send an audio call invitation to the user holding the first terminal through the first request instruction. When the first terminal receives the first request instruction sent by the second terminal, it can display a second prompt message on the interactive interface of the first terminal to indicate that the first terminal has received an audio call invitation.

[0179] S420: In response to the user's second preset operation on the second prompt information, send a response signal to the second terminal and establish a communication connection with the second terminal.

[0180] The user can perform the corresponding second preset operation in response to the second prompt information. When the user performs the second preset operation, the first terminal can send a response signal corresponding to the first request instruction to the second terminal, and establish a communication connection with the second terminal through the sent response signal, so that the first terminal can access the audio call system.

[0181] For example, the second prompt information may be displayed as a prompt box, showing the ID of the second terminal and the time when the first terminal was invited to access the audio call system. The prompt box of the second prompt information may include control icons corresponding to "agree to access" and "disagree to access". The second preset operation may be the user clicking the control icon corresponding to "agree to access" in the interactive interface of the first terminal.

[0182] In this embodiment, when a first request instruction is received from the second terminal, a second prompt message is displayed. When the user performs a second preset operation in response to the second prompt message, a response signal is sent to the second terminal, and a communication connection is established with the second terminal. This enables the first terminal to access the audio call system, thereby realizing the networking of the devices and the establishment of the audio call system.

[0183] In other embodiments, reference is made to... Figure 7 As shown, establishing a communication connection with the second terminal includes:

[0184] S430. Send a second request instruction to the second terminal so that the second terminal displays the first prompt information. The second request instruction is used to request access to the audio call system.

[0185] In step S430, the first terminal may also actively send a second request instruction to the second terminal, which is used to request access to the audio call system. When the second terminal receives the second request instruction sent by the terminal to be connected, it may display a first prompt message on the interactive interface of the second terminal to prompt the user holding the terminal to be connected to request access to the audio call system.

[0186] S440: In response to the user's first preset operation on the first prompt information, establish a communication connection with the second terminal.

[0187] In step S440, the user can perform a corresponding first preset operation in response to the first prompt information. When the second terminal recognizes the user's first preset operation in response to the first prompt information, a communication connection is established between the first terminal and the second terminal so that the first terminal can access the audio call system.

[0188] For example, the first prompt information may be displayed as a prompt box, showing the ID of the terminal to be connected and the time of requesting access to the audio call. The prompt box of the first prompt information may include control icons corresponding to "agree to access" and "disagree to access". The first preset operation may be the user clicking the control icon corresponding to "agree to access" in the interactive interface of the second terminal.

[0189] In this embodiment, by sending a second request instruction to the second terminal, the second terminal displays the first prompt information. When the user's first preset operation on the first prompt information is detected, a communication connection is established with the second terminal, thus realizing the communication connection between the first terminal and the second terminal. This enables the first terminal to access the audio call system, thereby realizing the networking of the devices and the establishment of the audio call system.

[0190] In one exemplary embodiment, a control method for an audio call system is provided, applied to a first terminal, with reference to... Figure 8 As shown, the control method of the audio call system includes:

[0191] S11. In response to receiving a first request instruction sent by the second terminal, display a second prompt message. The first request instruction is used to request the first terminal to access the audio call system.

[0192] S12. In response to the user's second preset operation on the second prompt information, send a response signal to the second terminal and establish a communication connection with the second terminal to access the audio call system;

[0193] S13, Receive control commands sent by the second terminal;

[0194] S14. In response to the microphone being in the on / off state, based on the control command, the microphone is used to collect uplink audio to the target audio acquisition area.

[0195] S15. In response to the speaker being in the on / off state, based on the control command, the microphone outputs downlink audio at the target audio output area and volume.

[0196] S16. In response to a change in location information or audio device information, send updated location information and audio device information to the second terminal.

[0197] In this embodiment, by establishing a communication connection with the second terminal to access the audio call system and receiving control commands sent by the second terminal, the audio device is controlled to execute the target audio control mode corresponding to the control command, thereby realizing the control of the audio device of the first terminal in the audio call system. The audio devices of each first terminal can achieve coordination among multiple first terminals by executing the corresponding target audio control mode. This can eliminate or reduce the interference and impact of downlink audio output from other first terminals on the uplink audio collected by one first terminal, thereby avoiding the howling problem, ensuring audio call quality, and improving the user experience.

[0198] In one exemplary embodiment, a control device for an audio call system is provided, applied to a second terminal, with reference to... Figure 9As shown, the control device of the audio call system includes a first connection module 10, a determining module 20, and a sending module 30. The first connection module 10 is used to establish communication connections with multiple first terminals, so that each first terminal can access the audio call system. The determining module 20 is used to determine the target audio control mode of each first terminal based on the distribution information of the multiple first terminals and the audio device information of each first terminal. The sending module 30 is used to send corresponding control commands to each first terminal. The control commands are used to instruct the audio device of the first terminal to execute the corresponding target audio control mode, so as to eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio device of the first terminal.

[0199] In this embodiment, a communication connection is established with multiple first terminals through the first connection module 10 to connect each first terminal to the audio call system. The determining module 20 determines the target audio control mode for each first terminal based on the distribution information of the multiple first terminals and the audio device information of each first terminal. Then, the sending module 30 sends control commands corresponding to the target audio control mode to each first terminal, instructing the audio devices of each first terminal to execute the corresponding target audio control mode. This can eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio devices of the first terminals. Based on the distribution and audio device information of each first terminal, the target audio control mode for each first terminal can be determined. By executing the corresponding target audio control mode, the audio devices of each first terminal achieve coordination among themselves, eliminating or reducing the interference and influence of downlink audio output by other first terminals on the collected uplink audio, thereby avoiding the howling problem, ensuring audio call quality, and improving user experience.

[0200] In one embodiment, the distribution information of the plurality of first terminals includes the number of first terminals and the location information of the first terminals; and / or, the audio device information includes the type of audio device contained in the first terminal.

[0201] In one embodiment, the audio device of the first terminal includes a microphone, and the target audio control mode includes a target audio acquisition area of ​​the microphone; and / or, the audio device of the first terminal includes a speaker, and the target audio control mode includes a target audio output area of ​​the speaker.

[0202] In one embodiment, the target audio control mode of each first terminal is configured such that the target audio acquisition area corresponding to any first terminal is staggered from the target audio output areas corresponding to other first terminals; or, the overlapping area of ​​the target audio acquisition area corresponding to any first terminal and the target audio output areas corresponding to other first terminals accounts for a proportion of the target audio acquisition area that is less than a first preset proportion threshold; or, the angle between the center direction of the target audio acquisition area corresponding to any first terminal and the center direction of the target audio output areas corresponding to other first terminals is greater than a preset angle threshold.

[0203] In one embodiment, the proportion of the target audio output area of ​​each speaker to the maximum audio output area of ​​the speaker is equal to or greater than a second preset proportion threshold; the proportion of the target audio acquisition area of ​​each pickup to the maximum audio acquisition area of ​​the pickup is equal to or greater than a third preset proportion threshold.

[0204] In one embodiment, the target audio control mode further includes at least one of: the on / off state of the microphone, the on / off state of the speaker, and the volume of the speaker.

[0205] In one embodiment, the control device of the audio call system further includes an update module, which is used to update the target audio control mode of each first terminal based on the changed distribution information in response to a change in the distribution information.

[0206] In one embodiment, the first connection module 10 is further configured to: search for a plurality of terminals to be connected within a preset range; send a first request instruction to each of the searched terminals to be connected, the first request instruction being used to request the terminals to be connected to access the audio call system; in response to receiving a response signal sent by a terminal to be connected, designate each terminal to be connected that sent the response signal as a first terminal and establish a communication connection with each first terminal; or, in response to receiving a second request instruction sent by a terminal to be connected, display a first prompt message, the second request instruction being used to request access to the audio call system; in response to a first preset operation by the user on the first prompt message, designate the terminal to be connected that sent the second request instruction as a first terminal and establish a communication connection with each first terminal.

[0207] In one embodiment, the downlink audio output by the audio device of the first terminal includes uplink audio collected by each audio device and online audio transmitted to the audio call system.

[0208] In one exemplary embodiment, a control device for an audio call system is provided, applied to a first terminal, with reference to... Figure 10As shown, the control device of the audio call system includes a second connection module 40, a receiving module 50, and a control module 60. The second connection module 40 is used to establish a communication connection with a second terminal to access the audio call system. The receiving module 50 is used to receive control commands sent by the second terminal. The control module 60 is used to control the audio device to execute a target audio control mode corresponding to the control command based on the control command. The target audio control mode is determined based on the distribution information of the first terminal in the audio call system and the audio device information of the first terminal.

[0209] In this embodiment, a communication connection is established with the second terminal via the second connection module 40 to access the audio call system. The receiving module 50 receives control commands sent by the second terminal, and the control module 60, based on the control commands, controls the audio devices to execute the target audio control mode corresponding to the control commands. This achieves control over the audio devices of the first terminal in the audio call system. The audio devices of each first terminal can achieve coordination among multiple first terminals by executing the corresponding target audio control mode. This eliminates or reduces the interference and impact of downlink audio output from other first terminals on the uplink audio collected by one first terminal, thereby avoiding howling problems, ensuring audio call quality, and improving user experience.

[0210] In one embodiment, the control module 60 is further configured to: control the microphone in the audio device to acquire uplink audio in the target audio acquisition area; and / or control the speaker in the audio device to output downlink audio in the target audio output area.

[0211] In one embodiment, the proportion of the target audio output area to the maximum audio output area is equal to or greater than a second preset proportion threshold; the proportion of the target audio acquisition area to the maximum audio acquisition area is equal to or greater than a third preset proportion threshold.

[0212] In one embodiment, the target audio control mode further includes a microphone on / off state, and the control module 60 is further configured to: in response to the microphone being in an on / off state, acquire uplink audio through the microphone in the target audio acquisition area. The target audio control mode also includes a speaker on / off state and volume, and the control module 60 is further configured to: in response to the speaker being in an on / off state, output downlink audio through the microphone in the target audio output area and volume.

[0213] In one embodiment, the control device of the audio call system further includes a reporting module, which is used to: send updated location information and audio device information to the second terminal in response to changes in location information or audio device information.

[0214] In one embodiment, the second connection module 40 is further configured to: display a second prompt message in response to receiving a first request instruction sent by the second terminal, wherein the first request instruction is used to request the first terminal to access the audio call system; send a response signal to the second terminal and establish a communication connection with the second terminal in response to a second preset operation by the user on the second prompt message; or send a second request instruction to the second terminal so that the second terminal displays the first prompt message, wherein the second request instruction is used to request access to the audio call system; and establish a communication connection with the second terminal in response to a first preset operation by the user on the first prompt message.

[0215] In one exemplary embodiment, an audio call system is provided, with reference to Figure 11 As shown, the audio call system includes a second terminal 70 and multiple first terminals 80.

[0216] The second terminal 70 is used to: establish communication connections with multiple first terminals 80, so that each first terminal 80 can access the audio call system; determine the target audio control mode of each first terminal 80 based on the distribution information of the multiple first terminals 80 and the audio device information of each first terminal 80; and send corresponding control instructions to each first terminal 80, the control instructions being used to instruct the audio device of the first terminal 80 to execute the corresponding target audio control mode, so as to eliminate or reduce the downlink audio output by the audio devices of other first terminals 80 contained in the uplink audio collected by the audio device of the first terminal 80.

[0217] Each first terminal 80 is used to: establish a communication connection with the second terminal 70 to access the audio call system; receive control commands sent by the second terminal 70; and, based on the control commands, control the audio device to execute the target audio control mode corresponding to the control commands.

[0218] The second terminal 70 in the audio call system can execute the control method of the audio call system applied to the second terminal 70 shown in the above embodiments, and each first terminal 80 in the audio call system can execute the control method of the audio call system applied to the first terminal 80 shown in the above embodiments, which will not be described in detail here.

[0219] In one exemplary embodiment, an electronic device is provided. The electronic device may be a terminal with an audio device, such as a mobile phone or a laptop. The electronic device may be the first terminal 80 or the second terminal 70 in the control method of the above-described audio call system.

[0220] refer to Figure 12As shown, the electronic device may include one or more of the following components: processing component 101, memory 102, power component 103, multimedia component 104, audio component 105, input / output (I / O) interface 106, sensor component 107, and communication component 108.

[0221] Processing component 101 typically controls the overall operation of an electronic device, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 101 may include one or more processors 109 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 101 may include one or more modules to facilitate interaction between processing component 101 and other components. For example, processing component 101 may include a multimedia module to facilitate interaction between multimedia component 104 and processing component 101.

[0222] Memory 102 is configured to store various types of data to support the operation of the electronic device. Examples of such data include instructions for any application or method used to operate on the electronic device, contact data, phonebook data, messages, pictures, videos, etc. Memory 102 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0223] Power component 103 provides power to various components of the electronic device. Power component 103 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device.

[0224] Multimedia component 104 includes a screen that provides an output interface between the electronic device and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 104 includes a front-facing camera and / or a rear-facing camera. When the electronic device is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0225] Audio component 105 is configured to output and / or input audio signals. For example, audio component 105 includes a microphone (MIC) configured to receive external audio signals when the electronic device is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 102 or transmitted via communication component 108. In some embodiments, audio component 105 also includes a speaker for outputting audio signals.

[0226] I / O interface 106 provides an interface between processing component 101 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0227] Sensor assembly 107 includes one or more sensors for providing state assessments of various aspects of the electronic device. For example, sensor assembly 107 can detect the on / off state of the electronic device, the relative positioning of components such as the display and keypad of the electronic device, changes in the position of the electronic device or a component of the electronic device, the presence or absence of user contact with the electronic device, the orientation or acceleration / deceleration of the electronic device, and temperature changes of the electronic device. Sensor assembly 107 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 107 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 107 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0228] Communication component 108 is configured to facilitate wired or wireless communication between electronic devices and other devices. Devices can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 108 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 108 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0229] In an exemplary embodiment, the electronic device may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the control method described above for an audio call system applied to an electronic device.

[0230] In one exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 102 including instructions, which can be executed by a processor 109 of an electronic device to perform the control method of the audio call system applied to the first terminal 80 or the second terminal 70 described above. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc. When the instructions in the storage medium are executed by the processor 109 of the electronic device, the electronic device is able to perform the control method of the audio call system applied to the first terminal 80 or the second terminal 70 shown in the above embodiment.

[0231] In one exemplary embodiment, a computer program product is also provided, including a computer program that, when executed by a processor 109, implements the control method described above for an audio call system applied to a first terminal 80 or a second terminal 70.

[0232] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the following claims.

[0233] It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. A control method for an audio call system, characterized in that, The control method for the audio call system includes: Establish communication connections with multiple first terminals so that each first terminal can access the audio call system; Based on the distribution information of the plurality of first terminals and the audio device information of each first terminal, the target audio control mode of each first terminal is determined. A corresponding control command is sent to each of the first terminals. The control command is used to instruct the audio device of the first terminal to execute the corresponding target audio control mode in order to eliminate or reduce the downlink audio output by the audio device of other first terminals contained in the uplink audio collected by the audio device of the first terminal.

2. The control method for the audio call system according to claim 1, characterized in that, The distribution information of the plurality of first terminals includes the number of the first terminals and the location information of the first terminals; and / or, The audio device information includes the type of audio device contained in the first terminal.

3. The control method for the audio call system according to claim 1, characterized in that, The audio device of the first terminal includes a microphone, and the target audio control mode includes the target audio acquisition area of ​​the microphone; And / or, The audio device of the first terminal includes a speaker, and the target audio control mode includes the target audio output area of ​​the speaker.

4. The control method for the audio call system according to claim 3, characterized in that, The target audio control mode of each first terminal is configured such that the target audio acquisition area corresponding to any first terminal is staggered from the target audio output areas corresponding to other first terminals. or, The proportion of the overlapping area of ​​the target audio acquisition area corresponding to any first terminal with the target audio output area corresponding to each of the other first terminals is less than a first preset proportion threshold. or, The angle between the center direction of the target audio acquisition area corresponding to any of the first terminals and the center direction of the target audio output areas corresponding to other first terminals is greater than a preset angle threshold.

5. The control method for the audio call system according to claim 3, characterized in that, The proportion of the target audio output area of ​​each speaker to the maximum audio output area of ​​the speaker is equal to or greater than a second preset proportion threshold. The proportion of the target audio acquisition area of ​​each microphone to the maximum audio acquisition area of ​​that microphone is equal to or greater than a third preset proportion threshold.

6. The control method for the audio call system according to claim 3, characterized in that, The target audio control mode also includes: At least one of the following: the on / off state of the microphone, the on / off state of the speaker, and the volume of the speaker.

7. The control method for the audio communication system according to any one of claims 1 to 6, characterized in that, The control method for the audio call system also includes: In response to a change in the distribution information, the target audio control mode of each of the first terminals is updated based on the changed distribution information.

8. The control method for the audio call system according to any one of claims 1 to 6, characterized in that, The establishment of communication connections with multiple first terminals includes: Search for multiple terminals to connect within a preset range; Send a first request instruction to each of the searched terminals to be connected, the first request instruction being used to request the terminals to be connected to access the audio call system; In response to receiving a response signal from the terminal to be connected, each terminal to be connected that sent the response signal is designated as the first terminal, and a communication connection is established with each of the first terminals; or, In response to receiving a second request instruction from the terminal to be connected, a first prompt message is displayed, wherein the second request instruction is used to request access to the audio call system; In response to the user's first preset operation on the first prompt information, the terminal to be connected that sent the second request instruction is designated as the first terminal, and a communication connection is established with each of the first terminals.

9. The control method for the audio communication system according to any one of claims 1 to 6, characterized in that, The downlink audio output by the audio device of the first terminal includes the uplink audio collected by each of the audio devices and the online audio transmitted to the audio call system.

10. A control method for an audio call system, characterized in that, The control method for the audio call system includes: Establish a communication connection with the second terminal to access the audio call system; Receive control commands sent by the second terminal; Based on the control command, the audio device is controlled to execute the target audio control mode corresponding to the control command; The target audio control mode is determined based on the distribution information of the first terminal in the audio call system and the audio device information of the first terminal.

11. The control method for the audio call system according to claim 10, characterized in that, The control of the audio device to execute the target audio control mode corresponding to the control command includes: Control the microphone in the audio device to acquire upstream audio to the target audio acquisition area; and / or, Control the speakers in the audio device to output downlink audio to the target audio output area.

12. The control method for the audio call system according to claim 11, characterized in that, The proportion of the target audio output area to the maximum audio output area is equal to or greater than the second preset proportion threshold. The proportion of the target audio acquisition area to the maximum audio acquisition area is equal to or greater than the third preset proportion threshold.

13. The control method for the audio call system according to claim 11, characterized in that, The target audio control mode also includes the on / off state of the microphone, and controlling the microphone in the audio device to acquire uplink audio to the target audio acquisition area includes: In response to the microphone being in the on state, the uplink audio is acquired through the microphone in the target audio acquisition area; The target audio control mode also includes the speaker's on / off state and volume, and controlling the speaker in the audio device to output downlink audio to the target audio output area includes: In response to the speaker being in an on / off state, the downlink audio is output through the microphone at the target audio output area and the volume.

14. The control method for the audio communication system according to any one of claims 10-13, characterized in that, The control method for the audio call system also includes: In response to a change in location information or audio device information, the updated location information and audio device information are sent to the second terminal.

15. The control method for the audio call system according to any one of claims 10-13, characterized in that, Establishing a communication connection with the second terminal includes: In response to receiving a first request instruction sent by the second terminal, a second prompt message is displayed, wherein the first request instruction is used to request the first terminal to access the audio call system; In response to a user's second preset operation on the second prompt information, a response signal is sent to the second terminal, and a communication connection is established with the second terminal; or... A second request instruction is sent to the second terminal to cause the second terminal to display a first prompt message. The second request instruction is used to request access to the audio call system. In response to the user's first preset operation on the first prompt information, a communication connection is established with the second terminal.

16. A control device for an audio communication system, characterized in that, The control device for the audio call system includes: A first connection module is used to establish a communication connection with multiple first terminals, so that each first terminal can access the audio call system; The determining module is used to determine the target audio control mode of each first terminal based on the distribution information of the plurality of first terminals and the audio device information of each first terminal. The sending module is used to send corresponding control instructions to each of the first terminals. The control instructions are used to instruct the audio devices of the first terminals to execute the corresponding target audio control mode in order to eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio devices of the first terminals.

17. A control device for an audio communication system, characterized in that, The control device for the audio call system includes: The second connection module is used to establish a communication connection with the second terminal to access the audio call system; The receiving module is used to receive control commands sent by the second terminal; The control module is used to control the audio device to execute a target audio control mode corresponding to the control command based on the control command; The target audio control mode is determined based on the distribution information of the first terminal in the audio call system and the audio device information of the first terminal.

18. An audio call system, characterized in that, The audio call system includes a second terminal and a plurality of first terminals. The second terminal is used to: establish a communication connection with the plurality of first terminals so that each first terminal can access the audio call system. Based on the distribution information of the plurality of first terminals and the audio device information of each first terminal, the target audio control mode of each first terminal is determined. Send corresponding control instructions to each of the first terminals. The control instructions are used to instruct the audio devices of the first terminals to execute the corresponding target audio control mode in order to eliminate or reduce the downlink audio output by the audio devices of other first terminals contained in the uplink audio collected by the audio devices of the first terminals. Each of the first terminals is used for: Establish a communication connection with the second terminal to access the audio call system; Receive the control command sent by the second terminal; Based on the control command, the audio device is controlled to execute the target audio control mode corresponding to the control command.

19. An electronic device, characterized in that, The electronic device includes: processor; Memory used to store processor-executable instructions; The processor is configured to perform a control method for an audio call system as described in any one of claims 1 to 9 or 10 to 15.

20. A non-transitory computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform the control method of the audio call system as described in any one of claims 1 to 9 or 10 to 15.

21. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the control method of the audio call system as described in any one of claims 1 to 9 or 10 to 15.

Images