Communication terminal, communication system and audio information processing method

Abstract

The disclosed embodiment provides a communication terminal, a communication system and an audio information processing method, wherein the communication terminal includes a sound receiving component and a basic communication module, and a second sound pickup audio information is received wirelessly through a basic communication module of a communication terminal, so that the communication terminal obtains return audio information according to the first sound pickup audio information generated by the communication terminal and the received second sound pickup audio information, and sends the return audio information outward. Therefore, the technical solution of the disclosed embodiment can realize the synchronous sound reception of multiple wireless sound receiving devices or wireless sound receiving components, which can meet the needs of multiple people and achieve good sound reception effect.

Description

Technical Field

[0001] The present invention relates to the technical field of information processing, and in particular to a communication terminal, a communication system and an audio information processing method. Background Art

[0002] Meetings are a common communication activity for mutual communication, exchange or problem solving. Meetings often require the use of communication terminals or communication systems for communication. In existing wireless communication systems, when there are multiple wireless sound receiving devices or wireless sound receiving components for sound reception, usually only a single wireless sound receiving device or wireless sound receiving component can be selected for sound reception, and multiple wireless sound receiving devices or wireless sound receiving components cannot be used for sound reception at the same time, which makes it impossible to achieve a good sound reception effect when multiple people are talking at the same time. Summary of the invention

[0003] In view of this, the embodiments of the present invention provide a communication terminal, a communication system and an audio information processing method, which can realize synchronous sound reception when used by multiple people.

[0004] In a first aspect, an embodiment of the present invention provides a communication terminal, which includes a sound receiving component and a basic communication module; the sound receiving component includes a first sound receiving unit, which is configured to pick up sound to generate first picked up audio information; the basic communication module is configured to receive second picked up audio information wirelessly and send return audio information to the outside, and the return audio information is obtained based on the first picked up audio information and the second picked up audio information.

[0005] In some embodiments, the first sound receiving unit includes a first acoustic-to-electric conversion device and a first audio processing module; the first acoustic-to-electric conversion device is configured to pick up sound to generate a first audio signal; the first audio processing module is configured to generate the first picked-up audio information according to the first audio signal.

[0006] In some embodiments, the basic communication module is further configured to send the second picked-up audio information to the first audio processing module, and the first audio processing module is further configured to mix the first picked-up audio information and the second picked-up audio information to obtain the return audio information.

[0007] In some embodiments, the first sound receiving unit further includes a first wireless communication module; the first wireless communication module is electrically connected to the first audio processing module, and the first wireless communication module is configured to send the first picked-up audio information to the basic communication module.

[0008] In some embodiments, the communication terminal further includes a third audio processing module; the third audio processing module is electrically connected to the basic communication module, and the third audio processing module is configured to mix the first picked-up audio information and the second picked-up audio information to obtain the return audio information.

[0009] In some embodiments, the basic communication module is also configured to receive audio information to be played; the communication terminal also includes a speaker component for playing the audio information to be played; the basic communication module is also configured to send the audio information to be played to the first sound receiving unit, and the first audio processing module is also configured to perform echo cancellation processing on the first audio signal according to the audio information to be played to generate the first picked-up audio information.

[0010] In some embodiments, the sound receiving component also includes at least one second sound receiving unit, the second sound receiving unit includes a second acoustic-to-electric conversion device, a second audio processing module and a second wireless communication module; the second acoustic-to-electric conversion device is configured to pick up sound to generate the second audio signal; the second audio processing module is configured to generate the second picked-up audio information according to the second audio signal; the second wireless communication module is configured to send the second picked-up audio information to the basic communication module.

[0011] In some embodiments, the basic communication module is also configured to receive audio information to be played; the communication terminal also includes a speaker component for playing the audio information to be played; the basic communication module is also configured to send the audio information to be played to the second sound receiving unit, and the second audio processing module is also configured to perform echo cancellation processing on the second audio signal according to the audio information to be played to generate the second picked-up audio information.

[0012] In some embodiments, the basic communication module is also configured to receive audio information to be played; the communication terminal also includes a speaker component for playing the audio information to be played; the basic communication module is also configured to broadcast the audio information to be played wirelessly, and the first sound receiving unit is also configured to receive the audio information to be played that is broadcast wirelessly.

[0013] In a second aspect, an embodiment of the present invention also provides another communication terminal, comprising a sound receiving component and a basic communication module; the sound receiving component is configured to pick up sound to generate first picked-up audio information; the basic communication module is configured to send return audio information to other communication terminals paired with the basic communication module via a wireless manner, and the return audio information is obtained based on the first picked-up audio information.

[0014] In a third aspect, an embodiment of the present invention further provides a communication system, comprising a main communication terminal and at least one secondary communication terminal; the main communication terminal comprises a main basic communication module and a main sound receiving component, the main sound receiving component being configured to pick up sound to generate main sound pickup audio information; the secondary communication terminal comprises a secondary basic communication module and a secondary sound receiving component, the secondary sound receiving component being configured to pick up sound to generate secondary sound pickup audio information, the secondary basic communication module being configured to wirelessly send secondary return audio information to the main basic communication module, the secondary return audio information being obtained based on the secondary sound pickup audio information; wherein the main basic communication module is configured to send main return audio information externally, the return audio information being obtained based on the main sound pickup audio information and the secondary return audio information.

[0015] In some embodiments, the main basic communication module is also configured to receive audio information to be played, the main sound receiving component includes a main sound-to-electric conversion device and a main audio processing module, the main sound-to-electric conversion device is configured to pick up sound and generate a main audio signal, the main audio processing module is configured to perform echo cancellation processing on the main audio signal according to the audio information to be played to generate the main sound picked up audio information; the secondary sound receiving component includes a secondary sound-to-electric conversion device and a secondary audio processing module, the secondary sound-to-electric conversion device is configured to pick up sound and generate a secondary audio signal, the secondary audio processing module is configured to perform echo cancellation processing on the secondary audio signal according to the audio information to be played to generate the secondary sound picked up audio information.

[0016] In a fourth aspect, an embodiment of the present invention further provides an audio information processing method, which is applied to a communication terminal, and the method comprises the following steps: generating first sound pickup audio information by a first sound receiving unit; acquiring second sound pickup audio information wirelessly by a basic communication module; obtaining return audio information based on the first sound pickup audio information and the second sound pickup audio information; and sending the return audio information outward by the basic communication module.

[0017] In some embodiments, obtaining the return audio information based on the first picked up audio information and the second picked up audio information includes: mixing the first picked up audio information and the second picked up audio information to obtain the return audio information; mixing the first picked up audio information and the second picked up audio information to obtain the return audio information includes: mixing the first picked up audio information and the second picked up audio information by a first sound receiving unit to obtain the return audio information; or, mixing the first picked up audio information and the second picked up audio information by a third audio processing module to obtain the return audio information, wherein the third audio processing module is electrically connected to the basic communication module.

[0018] In some embodiments, the method further includes the following steps: obtaining, by the basic communication module, audio information to be played from the outside; playing the audio information to be played by the speaker assembly; broadcasting the audio information to be played wirelessly by the basic communication module; picking up sound by the second sound receiving unit to generate a second audio signal; and performing echo cancellation processing on the second audio signal according to the audio information to be played to obtain the second picked-up audio information; the generation of the first picked-up audio information by the first sound receiving unit includes: picking up sound by the first sound receiving unit to generate a first audio signal; and performing echo cancellation processing on the first audio signal according to the audio information to be played to obtain the first picked-up audio information.

[0019] The disclosed embodiment provides a communication terminal, a communication system and an audio information processing method, wherein the communication terminal includes a sound receiving component and a basic communication module, and a second sound pickup audio information is received wirelessly through a basic communication module of a communication terminal, so that the communication terminal obtains return audio information according to the first sound pickup audio information generated by the communication terminal and the received second sound pickup audio information, and sends the return audio information outward. Therefore, the technical solution of the disclosed embodiment can realize the synchronous sound reception of multiple wireless sound receiving devices or wireless sound receiving components, which can meet the needs of multiple people and achieve good sound reception effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

[0021] Figure 1 is a schematic diagram of a usage scenario of a communication terminal in some embodiments of the present disclosure;

[0022] Figure 2 is a schematic diagram of another usage scenario of a communication terminal in some embodiments of the present disclosure;

[0023] Figure 3 is a structural block diagram of a first communication terminal in some embodiments of the present disclosure;

[0024] Figure 4 is a structural block diagram of a first sound receiving unit in some embodiments of the present disclosure;

[0025] Figure 5 It is a schematic diagram of information flow when the first sound receiving unit in some embodiments of the present disclosure is working;

[0026] Figure 6 is a structural block diagram of another first sound receiving unit in some embodiments of the present disclosure;

[0027] Figure 7is a structural block diagram of a second communication terminal in some embodiments of the present disclosure;

[0028] Figure 8 is a schematic diagram of information flow when the third audio processing module in some embodiments of the present disclosure is working;

[0029] Fig. 9 is a structural block diagram of a third communication terminal in some embodiments of the present disclosure;

[0030] Fig.10 is a structural block diagram of a second sound receiving unit in some embodiments of the present disclosure;

[0031] Fig.11 is a structural block diagram of a fourth communication terminal in some embodiments of the present disclosure;

[0032] Fig.12 is a schematic diagram of information flow for echo cancellation processing performed by a first sound receiving unit in some embodiments of the present disclosure;

[0033] Fig.13 It is another information flow diagram of the first sound receiving unit performing echo cancellation processing in some embodiments of the present disclosure;

[0034] Fig.14 is a schematic diagram of information flow for echo cancellation processing performed by the second sound receiving unit in some embodiments of the present disclosure;

[0035] Fig.15 is a structural block diagram of a fifth communication terminal in some embodiments of the present disclosure;

[0036] Fig.16 This is a basic architecture diagram of using a communication terminal to implement a remote conference in an embodiment of the present disclosure;

[0037] Fig.17 is a schematic diagram of a usage scenario of a communication system in some embodiments of the present disclosure;

[0038] Fig.18 is a structural block diagram of a communication system in some embodiments of the present disclosure;

[0039] Fig.19 It is a schematic diagram of information flow when the communication system of some embodiments of the present disclosure is working;

[0040] Fig. 20 is a structural block diagram of another communication system according to some embodiments of the present disclosure;

[0041] Fig.21 It is a schematic diagram of information flow when the main communication terminal performs echo cancellation processing in some embodiments of the present disclosure;

[0042] Fig. 22It is a schematic diagram of information flow when a secondary communication terminal performs echo cancellation processing in some embodiments of the present disclosure;

[0043] Fig.23 is a flowchart of an audio information processing method in some embodiments of the present disclosure;

[0044] Fig.24 It is a flowchart of another audio information processing method in some embodiments of the present disclosure. DETAILED DESCRIPTION

[0045] The present invention is described below based on embodiments, but the present invention is not limited to these embodiments. In the detailed description of the present invention below, some specific details are described in detail. It is possible for a person skilled in the art to fully understand the present invention without the description of these details. In order to avoid confusing the essence of the present invention, known methods, processes, flows, components and circuits are not described in detail.

[0046] In addition, persons of ordinary skill in the art will appreciate that the drawings provided herein are for illustration purposes and are not necessarily drawn to scale.

[0047] Unless the context clearly requires otherwise, words such as “include”, “including” and the like in the specification should be interpreted as including rather than being exclusive or exhaustive; that is, as meaning “including but not limited to”.

[0048] In the description of the present invention, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0049] Figure 1-Figure 2 Schematic diagram of two usage scenarios of the communication terminal of some embodiments of the present disclosure. Figure 3 It is a structural block diagram of the first communication terminal in some embodiments of the present disclosure.

[0050] Reference Figure 1-Figure 3 , the communication terminal 1000 includes a sound receiving component 1002 and a basic communication module 1006. The sound receiving component 1002 includes a first sound receiving unit 1004, and the first sound receiving unit 1004 is used to pick up sound to generate first picked-up audio information. The basic communication module 1002 is used to receive second picked-up audio information in a wireless manner. The communication terminal 1000 obtains return audio information based on the first picked-up audio information and the second picked-up audio information. The basic communication module 1006 can establish an electrical connection and / or a communication connection with an external device outside the communication terminal 1000 in a wired and / or wireless manner, and send return audio information to the external device ED.

[0051] In the present disclosure, the external device ED is a device that can perform signal transmission with the basic communication module 1006 of the communication terminal 1000 in a wired and / or wireless manner. The external device can be various devices that can receive the returned audio information and store and / or process the returned audio information, such as a computer, a tablet computer, a mobile phone, a server, other communication terminals, etc. The basic communication module 1006 sends the returned audio information to the external device ED, so that the external device ED can store, process, transmit to the outside, or perform one or more of other operations on the returned audio information.

[0052] In one usage scenario, refer to Figure 1 and Figure 2 , the external device ED may be a computer, which can communicate with devices located in other geographical locations through one or more wired or wireless networks (e.g., the Internet). The computer can send return audio information to devices located in other geographical locations through the wired or wireless network, and can also receive information from devices located in other geographical locations. For example, the external device ED located at location A can communicate with the device located at location B through the Internet, transmitting audio, video, text, pictures or other information, thereby enabling people located in different geographical locations to hold remote meetings.

[0053] In the present disclosure, the basic communication module 1006 can communicate in a wireless manner. The wireless communication mode of the basic communication module 1006 may include one or more of Bluetooth communication, WIFI communication, infrared communication, radio frequency communication or other wireless communication modes. In one embodiment, the basic communication module 1006 includes multiple wireless communication modes, and the basic communication module 1006 can switch between multiple wireless communication modes according to the communication mode supported by the device (such as other communication terminals) for establishing a communication connection to ensure the versatility of the communication terminal 1000. In some embodiments, the basic communication module 1006 can also communicate in a wired manner. In one embodiment, the communication terminal 1000 also includes one or more hardware interfaces, through which the basic communication module 1006 can be connected to an external device ED having a corresponding interface or other components on the communication terminal to transmit information. The hardware interface may include one or more of a USB interface, an HDMI interface, an optical fiber interface, a digital coaxial interface or other hardware interfaces capable of transmitting audio information.

[0054] The basic communication module 1006 can establish a wireless communication connection with other devices outside the communication terminal 1000 and / or with other parts of the communication terminal 1000 in a wireless manner, and receive the second sound pickup audio information from outside the communication terminal 1000 and / or from other parts of the communication terminal 1000. After the basic communication module 1006 receives the second sound pickup audio information, the communication terminal 1000 obtains corresponding return audio information according to the first sound pickup audio information and the second sound pickup audio information according to a predetermined rule or the user's input, and enables the basic communication module 1006 to send the return audio information to the external device ED. Compared with the method in which the device generating the second sound pickup audio information directly sends the second sound pickup audio information to the external device in a wireless manner, enabling the communication terminal 1000 to receive the second sound pickup audio information and generating and sending the return audio information to the external device ED by the communication terminal 1000 can reduce the amount of information received by the external device ED, and avoid the external device ED being able to receive only audio information sent by a small number of wireless sound receiving devices due to the limitation of the wireless network bandwidth. At the same time, the communication terminal 1000 can process multiple audio information from different sources, thereby reducing the amount of processing calculations performed by the external device ED or other computing devices connected to the external device ED for processing the audio information.

[0055] In the present disclosure, the first sound receiving unit 1004 may be any device that can pick up sound and output a signal that can reflect the picked up sound and can be read by the basic communication module. The first sound receiving unit 1004 can establish communication with the basic communication module 1006 in a wired and / or wireless manner, thereby transmitting information with the basic communication module 1006. In the various structural block diagrams shown in the present disclosure, the connection between components is only to illustrate that the components connected by the connection have a signal transmission relationship, and does not mean that the components connected by the connection must have a physical connection or electrical connection relationship. The signal transmission relationship can be achieved by wire or by wireless. For example, Figure 3 The connection between the first sound receiving unit 1004 and the basic communication module 1006 is used to illustrate that there is a signal transmission relationship between the first sound receiving unit 1004 and the basic communication module 1006, which does not mean that the first sound receiving unit 1004 and the basic communication module 1006 must have a physical connection or electrical connection relationship. The first sound receiving unit 1004 and the basic communication module 1006 can transmit signals through wired or wireless means.

[0056] The first sound receiving unit 1004 may be integrated with the main body of the communication terminal 1000, or may be separated from the main body of the communication terminal 1000. Figure 2, the basic communication module 1006 and the first sound receiving unit 1004 are both arranged in the main body of the communication terminal 1000, and the basic communication module 1006 is electrically connected to the first sound receiving unit 1004. In another embodiment, referring to Figure 1 The basic communication module 1006 is disposed in the main body of the communication terminal 1000, and the first sound receiving unit 1004 is separated from the main body of the communication terminal 1000. For example, the first sound receiving unit 1004 may be a wireless microphone (refer to Figure 1 ), or is set in a wireless microphone so that it can be separated from the main part of the communication terminal 1000 and used. In one application scenario, the communication terminal 1000 can be implemented as a wireless headset, which has one or more microphones, and the one or more microphones serve as the sound receiving component 1002 of the communication terminal 1000, wherein at least one microphone serves as the first sound receiving unit 1004. In one embodiment, the one or more microphones are connected to the main part of the wireless headset in a detachable manner, that is, the microphone and the main part of the wireless headset have two states of combination and separation. When the wireless headset is in use, the microphone can be combined with the main part of the wireless headset for use, or the microphone can be removed from the main part of the wireless headset for user convenience.

[0057] Figure 4 It is a structural block diagram of a first radio unit in some embodiments of the present disclosure. Figure 5 It is a schematic diagram of information flow when the first sound receiving unit in some embodiments of the present disclosure is working.

[0058] Reference Figure 4 and Figure 5 In some embodiments, the first sound receiving unit 1004 includes a first acoustic-to-electric conversion device 1008 and a first audio processing module 1010, and the first audio processing module 1010 is electrically connected to the first acoustic-to-electric conversion device 1008. The first acoustic-to-electric conversion device 1008 can pick up sound and convert the picked-up sound signal into an electrical signal to generate a first audio signal AS1. The first acoustic-to-electric conversion device 1008 can include one or more of a piezoelectric microphone, an electromagnetic microphone, an electret microphone, or other forms of acoustic-to-electric conversion devices. The first acoustic-to-electric conversion device 1008 sends the first audio signal AS1 to the first audio processing module 1010, and the first audio processing module 1010 generates corresponding first picked-up audio information PA1 according to the first audio signal AS1. The first audio processing module 1010 can be wired to the basic communication module 1006 to achieve signal transmission between the basic communication module 1006.

[0059] In the present disclosure, each information flow diagram only shows one possible information flow. In practical applications, the order in which each information flow occurs does not necessarily follow the order from top to bottom in the flow diagram. For example, Figure 5 The arrow representing the generation of the first sound pickup audio information PA1 is located above the arrow representing the transmission of the second sound pickup audio information PA2 from the basic communication module 1006 to the first audio processing module 1010, but the generation time of the first sound pickup audio information PA1 is not necessarily earlier than the time when the second sound pickup audio information PA2 arrives at the first audio processing module 1010 from the basic communication module 1006. The generation of the first sound pickup audio information PA1 may also occur at the same time as the second sound pickup audio information PA2 arrives at the first audio processing module 1010 from the basic communication module 1006, or later than the second sound pickup audio information PA2 arrives at the first audio processing module 1010 from the basic communication module 1006. At the same time, in order to facilitate the display of the working principle of the communication terminal, not all components of the communication terminal are listed in the information flow diagram.

[0060] Reference Figure 3-Figure 5 In some embodiments, the basic communication module 1006 is further configured to send the received second sound pickup audio information PA2 to the first audio processing module 1010 of the first sound receiving unit 1004. The first audio processing module 1010 is further configured to perform mixing processing on the first sound pickup audio information PA1 and the second sound pickup audio information PA2 according to a predetermined rule or user input, and obtain corresponding return audio information TX according to the result of the mixing processing. The first audio processing module 1010 also sends the return audio information TX to the basic communication module 1006.

[0061] In the present disclosure, mixing refers to integrating sounds from multiple sources into a stereo track or a mono track. During the mixing process, the audio processing module can adjust the frequency, sound quality, positioning, etc. of each picked-up audio information to optimize each track. For example, the positioning of each picked-up audio information can be adjusted according to the difference in the time delay amount when the picked-up audio information from different sources is transmitted. For another example, the volume of the picked-up audio information with a smaller volume among the multiple picked-up audio information can be increased. By mixing the first picked-up audio information and the second picked-up audio information, the returned audio information can obtain a better sound effect.

[0062] Of course, as required, the communication terminal may not perform mixing processing on the first picked-up audio information and the second picked-up audio information.

[0063] Figure 6 It is a structural block diagram of another first radio unit in some embodiments of the present disclosure.

[0064] Reference Figure 6 In some embodiments, the first sound receiving unit 1004 is connected to the basic communication module 1006 in a wireless manner. In a feasible implementation, the first sound receiving unit 1004 may include a first acoustic-to-electric conversion device 1008, a first audio processing module 1010 and a first wireless communication module 1012. The first wireless communication module 1012 is electrically connected to the first audio processing module 1010 and can send the first sound pickup audio information to the basic communication module 1006 in a wireless manner. The wireless communication mode of the first wireless communication module 1012 may include one or more of Bluetooth communication, WIFI communication, infrared communication, radio frequency communication or other wireless communication modes. The first wireless communication module 1012 and the basic communication module 1006 should have at least one of the same wireless communication modes so that the first wireless communication module 1012 can establish a wireless communication connection with the basic communication module 1006. In a feasible implementation, the first wireless communication module 1012 can achieve communication connection by means of a short-range wireless transmission mode (e.g., Bluetooth).

[0065] Figure 7 It is a structural block diagram of a second communication terminal in some embodiments of the present disclosure. Figure 8 It is a schematic diagram of information flow when the third audio processing module in some embodiments of the present disclosure is working.

[0066] Reference Figure 7 In some embodiments, the communication terminal 1000 further includes a third audio processing module 1014 , and the third audio processing module 1014 is electrically connected to the basic communication module 1006 . Figure 8 Schematically shows Figure 7 An information flow when the third audio processing module 1014 in the second communication terminal of some embodiments of the present disclosure is working. Figure 7 and Figure 8In some embodiments, the first sound receiving unit of the sound receiving component 1002 is wirelessly connected to the basic communication module 1006, and the first sound receiving unit is sent to the basic communication module 1006. The first sound receiving unit can be separated from the main body of the communication terminal 1000. In one embodiment, the basic communication module 1006 is arranged in the main body of the communication terminal 1000, and the first sound receiving unit is separated from the main body of the communication terminal 1000. For example, the first sound receiving unit can be a wireless microphone, or be arranged in a wireless microphone. The basic communication module 1006 sends the received first sound picking audio information PA1 and second sound picking audio information PA2 to the third audio processing module 1014, and the third audio processing module 1014 is configured to perform mixing processing on the first sound picking audio information PA1 and the second sound picking audio information PA2 according to a predetermined rule or user input, and obtain corresponding return audio information TX according to the result of the mixing processing. The third audio processing module 1014 is also configured to send the return audio information TX to the basic communication module.

[0067] Fig. 9 It is a structural block diagram of a third communication terminal in some embodiments of the present disclosure.

[0068] Reference Fig. 9 In some embodiments, the sound receiving component 1002 further includes a second sound receiving unit 1016. The second sound receiving unit 1016 is configured to pick up sound to generate second sound picked up audio information, and send the second sound picked up audio information to the basic communication module 1006 in a wireless manner. Similar to the first sound receiving unit 1004, the second sound receiving unit 1016 can be any device that can pick up sound and output a signal that can be read by the basic communication module 1006 reflecting the picked up sound. For example, the second sound receiving unit 1016 can be a wireless microphone (see Figure 1 and Figure 2 ), or set in a wireless microphone. In one embodiment, refer to Figure 1 and Figure 2 The second sound receiving unit 1016 can be used separately from the main body of the communication terminal 1000, thereby improving the flexibility of the communication terminal in receiving sound. When there are multiple people participating in the meeting, different people can use the first sound receiving unit 1004 and the second sound receiving unit 1016 to receive sound respectively.

[0069] In one application scenario, the communication terminal 1000 can be implemented as a wireless headset as described above, and the wireless headset has multiple microphones, at least one of which is used as a first sound receiving unit 1004, and at least one of which is used as a second sound receiving unit 1016. For example, the wireless headset includes two microphones, one of which is used as the first sound receiving unit 1004, and the other is used as the second sound receiving unit 1016. The microphone used as the second sound receiving unit 1016 is connected to the main body of the wireless headset in a detachable manner. When the wireless headset is used, the microphone used as the second sound receiving unit 1016 can be combined with the main body of the wireless headset for use, or the second sound receiving unit 1016 can be removed from the main body of the wireless headset for user convenience. The microphone used as the first sound receiving unit 1004 can be integrated in the main body of the wireless headset, or it can be connected to the main body of the wireless headset in a detachable manner, and can be used separately from the main body of the wireless headset.

[0070] Fig.10 It is a structural block diagram of the second sound receiving unit in some embodiments of the present disclosure.

[0071] Reference Fig.10 In some embodiments, the second sound receiving unit 1016 includes a second acoustic-to-electric conversion device 1018, a second audio processing module 1020, and a second wireless communication module 1022. The second acoustic-to-electric conversion device 1018 picks up sound and converts the picked-up sound signal into an electrical signal to generate a second audio signal. The second acoustic-to-electric conversion device 1018 may include one or more of a piezoelectric microphone, an electromagnetic microphone, an electret microphone, or other forms of acoustic-to-electric conversion devices. The second audio processing module 1020 is electrically connected to the second acoustic-to-electric conversion device 1018, and generates corresponding second sound pickup audio information according to the second audio signal. The second wireless communication module 1022 is electrically connected to the second audio processing module 1020, and sends the second sound pickup audio information to the basic communication module 1006 in a wireless manner. The wireless communication mode of the second wireless communication module 1022 may include one or more of Bluetooth communication, WIFI communication, infrared communication, radio frequency communication, or other wireless communication modes. The second wireless communication module 1022 and the basic communication module 1006 should have at least one of the same wireless communication modes so that the second wireless communication module 1022 can establish a wireless communication connection with the basic communication module 1006. In one implementation, the second wireless communication module 1022 may achieve communication connection via a short-range wireless transmission method (eg, Bluetooth).

[0072] The second sound receiving unit 1016 may be one or more. In one embodiment, there are multiple second sound receiving units 1016, and the multiple second sound receiving units 1016 are respectively connected to the basic communication module 1006 for communication. The basic communication module 1006 receives the second sound pickup audio information from the multiple second sound receiving units 1016 respectively. The communication terminal 1000 obtains the corresponding return audio information according to the first sound pickup audio information and the multiple second sound pickup audio information.

[0073] In some embodiments, the basic communication module 1006 receives the first sound pickup audio information from the first sound receiving unit 1004, receives the second sound pickup audio information from the second sound receiving unit 1016, and then sends the first sound pickup audio information and the second sound pickup audio information to the external device, that is, the returned audio information includes the first sound pickup audio information and the second sound pickup audio information. The first sound receiving unit 1004 can be connected to the basic communication module 1006 wirelessly or by wire.

[0074] In some embodiments, reference Figure 5 As well as the previous Figure 5 Description and reference Fig. 9 , the first sound receiving unit 1004 is electrically connected to the basic communication module 1006. The basic communication module 1006 receives the second sound pickup audio information PA2 from the second sound receiving unit 1016 in a wireless manner, and then sends the second sound pickup audio information PA2 to the first sound receiving unit 1004. The first audio processing module 1010 performs mixing processing on the first sound pickup audio information PA1 and the second sound pickup audio information PA2 according to a predetermined rule or user input, obtains corresponding return audio information TX according to the result of the mixing processing, and sends the return audio information TX to the basic communication module 1006.

[0075] In some embodiments, reference Figure 7-Figure 8 As well as the previous Figure 7-Figure 8 Description and reference Figure 9-10, the communication terminal also includes a third audio processing module 1004. The first sound receiving unit 1004 of the sound receiving component 1002 sends the first sound pickup audio information PA1 to the basic communication module 1006 by wireless means, and the second sound receiving unit 1016 of the sound receiving component 1002 sends the second sound pickup audio information PA2 to the basic communication module 1006 by wireless means, and the basic communication module 1006 sends the first sound pickup audio information PA1 and the second sound pickup audio information PA2 to the third audio processing module 1014. The third audio processing module 1014 is configured to perform mixing processing on the first sound pickup audio information PA1 and the second sound pickup audio information PA2 according to a predetermined rule or user input, and obtain corresponding return audio information TX according to the result of the mixing processing. The third audio processing module 1014 also sends the return audio information TX to the basic communication module 1006.

[0076] Fig.11 It is a structural block diagram of a fourth communication terminal in some embodiments of the present disclosure.

[0077] Reference Fig.11 In some embodiments, the communication terminal 1000 may further include a speaker assembly 1024, and the basic communication module 1006 is further configured to receive audio information to be played from an external device. The speaker assembly 1024 is connected to the basic communication module 1006 by wire or wirelessly to receive and play the audio information to be played. For example, the speaker assembly 1024 and the basic communication module 1006 may be electrically connected to achieve the transmission of the audio information to be played.

[0078] In the present disclosure, the audio information to be played may be audio information generated by an external device, read from a machine-readable storage medium, obtained through wired or wireless communication, or obtained through other means. For example, the audio information to be played may be audio material stored in an external device. In one application scenario, a user may operate an external device (such as a computer) to cause the external device to send the audio information to be played to the basic communication module 1006 to display the corresponding audio material. For another example, the external device is connected to other devices for participating in a meeting in other geographical locations via a wired or wireless network, and receives the audio information to be played (such as the voices of the participants in the meeting collected by the other devices for participating in the meeting) from the other devices for participating in the meeting.

[0079] In the present disclosure, the speaker assembly 1024 may include an electroacoustic converter and a corresponding audio processing circuit. The electroacoustic converter may include one or more of a piezoelectric speaker, an electromagnetic speaker, an electrostatic speaker, or other forms of electroacoustic converters. The audio processing circuit converts the audio information to be played into a corresponding analog electrical signal and transmits it to the electroacoustic converter, and the electroacoustic converter converts the analog electrical signal into an acoustic signal to play the audio information to be played. The audio processing circuit may include a power amplifier circuit to drive the electroacoustic converter to make a sound.

[0080] In some embodiments, the basic communication module 1006 also sends the received audio information to be played to other devices other than the communication terminal 1000 that communicate with it or other parts other than the speaker assembly 1024 on the communication terminal 1000. In a wireless communication system, the signal communication method between the sender and the receiver includes unicast, multicast (groupcast) and broadcast. In this application, unicast means that the sender sends a signal to a specific receiver, which is a one-to-one communication method; multicast means that the sender sends a signal to multiple receivers who join a specific group, that is, the receivers who join the same group can receive all the data in this group; broadcast means that the sender sends a signal to all receivers in the wireless network. According to the needs of the actual application, the basic communication module 1006 can use at least one of unicast, multicast (groupcast) or broadcast to send the audio information to be played to other parts of the communication terminal 1000 or other devices other than the communication terminal 1000. In one application scenario, the basic communication module 1006 can send the received audio information to be played to other specific devices (such as other communication terminals or wireless speakers, etc.) that are paired and connected thereto by unicast or multicast to play the audio information to be played or perform other processing on the audio information to be played. In another application scenario, the basic communication module 1006 can broadcast the audio information to be played to a certain area so that all relevant devices in the certain area can receive the audio information to be played. For example, the basic communication module 1006 can broadcast the audio information to be played to all devices in the corresponding Bluetooth network by Bluetooth broadcast. The first sound receiving unit 1004 can receive the audio information to be played that is broadcasted to the outside by wireless means.

[0081] In some embodiments, the other device paired with it can perform echo cancellation processing on the collected audio signal according to the audio information to be played.

[0082] During an audio conference, in addition to processing the user voices collected at the own location, the communication terminal or other sound receiving device at the own location can also collect the sound received from the equipment at the other location participating in the audio conference and played by the speaker at the own location. The sound at the other location reproduced by the speaker at the own location and collected by the sound receiving device at the own location is called an echo. In the case of an echo, if the echo is not eliminated and the sound is sent to the other location, the speaker at the other location will reproduce the sound at the other location with a certain time difference, thereby causing inconvenience and trouble in communication to the users participating in the conference. Through echo cancellation processing, the smoothness of user communication can be improved. Echo cancellation processing can usually obtain a corresponding echo feedback signal based on the signal played by the speaker according to the characteristics of echo transmission, and eliminate the echo by subtracting the echo feedback signal from the sound signal collected by the sound receiving device through a filter.

[0083] Fig.12 It is a schematic diagram of information flow for echo cancellation processing performed by a first sound receiving unit in some embodiments of the present disclosure. Fig.13 It is another information flow diagram of the first sound receiving unit performing echo cancellation processing in some embodiments of the present disclosure.

[0084] Reference Fig.12 and Fig.13 Further, in some embodiments, the basic communication module 1006 also sends the received audio information RX to be played to the first sound receiving unit 1004. In the case where the first sound receiving unit 1004 is connected to the basic communication module 1006 by wire, the basic communication module 1006 sends the audio information RX to be played to the first audio processing module 1010. Fig.12 When the first sound receiving unit 1004 is connected to the basic communication module 1006 by wireless communication, the basic communication module 1006 sends the audio information RX to be played to the first wireless communication module 1012 of the first sound receiving unit 1004, and the first wireless communication module 1012 sends the audio information RX to be played to the first audio processing module 1010. Fig.13As shown. When the speaker assembly 1024 plays the audio information to be played RX, the first audio signal AS1 generated by the first acoustic-to-electric conversion device 1008 contains an echo. The first audio processing module 1010 is also configured to perform echo cancellation processing on the first audio signal AS1 according to the audio information to be played RX in accordance with a predetermined rule or user input, and generate corresponding first sound pickup audio information PA1 according to the result of the echo cancellation processing. The communication terminal 1000 can also measure the distance between the first sound receiving unit 1004 and the speaker assembly 1024, and the first audio processing module 1010 can also perform echo cancellation processing on the first audio signal AS1 according to the measured distance between the first sound receiving unit 1004 and the speaker assembly 1024 to obtain a better echo cancellation effect.

[0085] Fig.14 It is a schematic diagram of the information flow of the second sound receiving unit performing echo cancellation processing in some embodiments of the present disclosure.

[0086] Reference Fig.14 In some embodiments, the basic communication module 1006 also sends the received audio information to be played RX to the second sound receiving unit 1016. The basic communication module 1006 sends the audio information to be played RX to the second wireless communication module 1022 of the second sound receiving unit 1016, and the second wireless communication module 1022 sends the audio information to be played RX to the second audio processing module 1020. When the speaker assembly 1024 plays the audio information to be played RX, the second audio signal AS2 generated by the second acoustic-to-electric conversion device 1018 contains an echo. The second audio processing module 1020 is also configured to perform echo cancellation processing on the second audio signal AS2 according to the audio information to be played RX according to a predetermined rule or user input, and generate corresponding second sound pickup audio information PA2 according to the result of the echo cancellation processing. The communication terminal 1000 can also measure the distance between the second sound receiving unit 1016 and the speaker assembly 1024, and the second audio processing module 1020 can also perform echo cancellation processing on the second audio signal AS2 according to the measured distance between the second sound receiving unit 1016 and the speaker assembly 1024 to obtain a better echo cancellation effect.

[0087] Fig.15 It is a structural block diagram of the fifth communication terminal in some embodiments of the present disclosure.

[0088] Reference Fig.15 The present disclosure also provides another communication terminal 2000, which includes a sound receiving component 2002 and a basic communication module 2004. The sound receiving component 2002 is configured to pick up sound to generate first sound picking audio information. In some embodiments, the sound receiving component 2002 can be connected to the communication terminal 2000. Figure 3-Figure 14And reference Figure 3-Figure 14 The basic communication module 2004 is configured to pair with other communication terminals in a wireless manner and send the return audio information to the other communication terminals in the pairing connection, wherein the return audio information is obtained according to the first sound pickup audio information. The other communication terminal may be any communication terminal that can communicate with the communication terminal in a wireless manner. For example, in one usage scenario, the other communication terminal may be Figure 3-Figure 14 And the previous reference Figure 3-Figure 14 The communication terminal 1000 is described.

[0089] In some embodiments, Fig.15 The communication terminal 2000 shown in FIG. 2000 may be embodied as follows: Figure 3-Figure 14 And the previous reference Figure 3-Figure 14 The first to fourth communication terminals 1000 described above. For example, referring to Figure 3-Figure 5 The basic communication module 1006 in the first communication terminal 1000 described is also configured to pair and connect with other communication terminals wirelessly and send the generated return audio information to the other paired communication terminals, so the basic communication module 1006 has the functions of the basic communication module 2004.

[0090] Fig.16 It is a basic architecture diagram of using a communication terminal to implement a remote conference in an embodiment of the present disclosure.

[0091] Reference Fig.16In one application scenario, users at location A and location B hold a remote conference. Location A uses a communication terminal 1000, which is wirelessly connected to an external device ED1 (e.g., a computer). The communication terminal 1000 at location A includes two second sound receiving units 1016, which are wirelessly connected to the communication terminal 1000 respectively. Location B uses a communication terminal 1000 and a communication terminal 2000, which are wirelessly connected to an external device ED2 (e.g., a computer), and the communication terminal 2000 is connected to the communication terminal 1000. The external device ED1 at location A and the external device ED2 at location B communicate with the server through the network respectively, thereby realizing information exchange between the external device ED1 and the external device ED2. After the communication terminal 1000 at location A generates the return audio information, it sends the return audio information to the external device ED1, and the external device ED1 sends the return audio information to the external device ED2 through the server. The external device ED2 takes the return audio information sent by the external device ED1 as the audio information to be played, and sends it to the communication terminal 1000 at the location B so that the communication terminal 1000 plays the audio information to be played. After the communication terminal 2000 at the location B generates the return audio information, it sends the return audio information to the communication terminal 1000 at the location B. The communication terminal 1000 takes the return audio information sent by the communication terminal 2000 as the second sound pickup audio information. The communication terminal 1000 generates the return audio information based on the second sound pickup audio information from the communication terminal 2000 and the first sound pickup audio information generated by the communication terminal 1000, and sends the generated return audio information to the external device ED2. The external device ED2 sends the received return audio information sent by the communication terminal 1000 at the location B to the external device ED1 at the location A through the server, thereby realizing a remote audio conference between users at locations A and B.

[0092] Fig.17 It is a schematic diagram of the usage scenario of the communication system in some embodiments of the present disclosure. Fig.18 It is a structural block diagram of a communication system of some embodiments of the present disclosure. Fig.19 It is a schematic diagram of information flow when the communication system of some embodiments of the present disclosure is working.

[0093] Reference Figure 17-Figure 19, the embodiment of the present disclosure also provides a communication system 3000. The communication system 3000 includes a main communication terminal 3002A and at least one secondary communication terminal 3002B. The main communication terminal 3002A includes a main basic communication module 3006A and a main sound receiving component 3004A, and the secondary communication terminal 3002B includes a secondary basic communication module 3006B and a secondary sound receiving component 3004B. The secondary sound receiving component 3002B is configured to pick up sound to generate secondary sound pickup audio information PAB. The secondary basic communication module 3006B can establish a wireless communication connection with the main basic communication module 3006A. The secondary basic communication module 3006B is configured to wirelessly send secondary return audio information TXB to the main basic communication module 3006A, wherein the secondary return audio information TXB is obtained according to the secondary sound pickup audio information PAB. The main sound receiving component 3004A is configured to pick up sound to generate the main sound pickup audio information PAA. The main basic communication module 3006A is also configured to send main return audio information TXA to the external device ED, wherein the main return audio information TXA is obtained according to the main pickup audio information PAA and the secondary return audio information TXB. Thus, the communication system 3000 of the embodiment of the present disclosure can realize the association of multiple communication terminals, realize the synchronous sound reception of multiple communication terminals, and the main communication terminal processes the sound reception results of multiple communication terminals, so that the main return audio information sent by the external device ED received by the external device ED has a better sound effect, reduces the processing calculation amount of the external device ED to process the audio information, and avoids the external device ED being able to receive only the audio information sent by a small number of communication terminals due to the limitation of network bandwidth.

[0094] There may be one or more secondary communication terminals 3002B. In some embodiments, there are multiple secondary communication terminals 3002B, and the multiple secondary communication terminals 3002B are respectively connected to the main communication terminal 3002A by wireless communication to perform signal transmission.

[0095] In some embodiments, the primary communication terminal 3002A is further configured to perform mixing processing on the primary pickup audio information and the secondary return audio information to obtain return audio information.

[0096] Fig. 20 It is a structural block diagram of another communication system of some embodiments of the present disclosure.

[0097] Reference Fig. 20 In some embodiments, the main communication terminal 3002A further includes a main speaker component 3008A, and the main basic communication module 3006A is further configured to receive audio information to be played from the outside. The main basic communication module 3006A sends the received audio information to be played to the main speaker component 3008A, and the main speaker component 3008A can play the audio information to be played.

[0098] Fig.21 It is a schematic diagram of information flow when the main communication terminal performs echo cancellation processing in some embodiments of the present disclosure.

[0099] Furthermore, the main communication terminal 3002A can also use the received audio information to be played to perform echo cancellation processing on the collected sound to generate the main sound pickup audio information PAA. Fig.17 In some embodiments, the main sound receiving component 3004A includes a main sound-to-electric conversion device 3010A and a main audio processing module 3012A. The main sound-to-electric conversion device 3010A is configured to pick up sound and convert the picked up sound signal into an electrical signal to generate a main audio signal ASA. The main sound-to-electric conversion device 3010A may include one or more of a piezoelectric microphone, an electromagnetic microphone, an electret microphone, or other forms of sound-to-electric conversion devices. The main audio processing module 3012A receives the main audio signal ASA and performs echo cancellation processing on the main audio signal ASA according to the audio information to be played RX to generate the main sound pickup audio information PAA.

[0100] Please refer again Fig. 20 In some embodiments, the secondary communication terminal 3002B further includes a secondary speaker assembly 3008B. The secondary basic communication module 3006B is capable of receiving the audio information to be played and sending the audio information to be played to the secondary speaker assembly 3008B, and the secondary speaker assembly 3008B is capable of playing the audio information to be played. The secondary basic communication module 3006B can receive the audio information to be played from outside the main communication terminal 3002A and / or the communication system 3000. In one embodiment, the main basic communication module 3006A is further configured to obtain the audio information to be played from outside the communication system 3000 by wire or wireless means, and send the audio information to be played to the secondary communication terminal 3002B by wireless means, so that the secondary speaker assembly 3008B plays the audio information to be played. When the communication system 3000 includes multiple secondary communication terminals 3002B, and the multiple secondary communication terminals 3002B are respectively connected to the main communication terminal 3002A, the main communication terminal 3002A can send the audio information to be played to all the secondary communication terminals 3002B connected to it or a part of the multiple secondary communication terminals 3002B according to a predetermined rule or user input. In another embodiment, the secondary communication terminal 3002B can also obtain the audio information to be played from outside the communication system 3000, for example, an external device is respectively connected to the main communication terminal 3002A and the secondary communication terminal 3002B, and sends the audio information to be played to the main communication terminal 3002A and the secondary communication terminal 3002B respectively.

[0101] Fig. 22It is a schematic diagram of information flow when a secondary communication terminal in some embodiments of the present disclosure performs echo cancellation processing.

[0102] Furthermore, the secondary communication terminal 3002B can use the received audio information to be played to perform echo cancellation processing on the collected sound to generate secondary sound pickup audio information. Fig. 22 In some embodiments, the secondary sound receiving component 3004B includes a secondary acoustic-to-electric conversion device 3010B and a secondary audio processing module 3012B. The secondary acoustic-to-electric conversion device 3010B is configured to pick up sound and convert the picked-up sound signal into an electrical signal to generate a secondary audio signal ASB. The secondary acoustic-to-electric conversion device 3010B may include one or more of a piezoelectric microphone, an electromagnetic microphone, an electret microphone, or other forms of acoustic-to-electric conversion devices. The secondary audio processing module 3012B receives the secondary audio signal ASB and performs echo cancellation processing on the secondary audio signal ASB according to the audio information to be played RX to generate secondary sound pickup audio information PAB.

[0103] Fig.23 It is a flowchart of an audio information processing method in some embodiments of the present disclosure.

[0104] The present disclosure also provides an audio information processing method, which is applied to a communication terminal. The audio information processing method can be applied to Figure 3-Figure 14 The communication terminal. Fig.23 In some embodiments, the audio information processing method includes the following steps S110 to S170:

[0105] Step S110: The first sound pickup unit generates first sound pickup audio information.

[0106] The communication terminal includes a first sound receiving unit. The first sound receiving unit picks up sound and generates first sound pickup audio information based on the picked up sound.

[0107] Step S130: The basic communication module obtains second sound pickup audio information in a wireless manner.

[0108] The basic communication module has a wireless communication function. The basic communication module establishes a wireless communication connection with other devices capable of picking up sound, and obtains the second sound pickup audio information in a wireless manner, wherein the other devices capable of picking up sound can generate the second sound pickup audio information. The other devices capable of picking up sound can be other sound pickup devices other than the first sound receiving unit on the communication terminal, or other communication terminals paired with the basic communication module, or other devices capable of picking up sound that can be wirelessly connected to the basic communication module. The basic communication module can obtain one or more second sound pickup audio information from one or more sources. For example, the basic communication module can establish wireless communication connections with multiple other communication terminals respectively, and obtain the second sound pickup audio information from the multiple other communication terminals respectively, thereby obtaining multiple second sound pickup audio information. When the basic communication module obtains multiple second sound pickup audio information from multiple sources, the multiple sources can be different types of sources.

[0109] Depending on the source of the second picked-up audio information obtained by the basic communication module, step S130 may include at least one of the following steps S130a or S130b:

[0110] Step S130a: The basic communication module obtains the second sound pickup audio information from other communication terminals paired with the basic communication module in a wireless manner.

[0111] The basic communication module can be paired with other communication terminals to establish a wireless communication relationship, and receive second sound pickup audio information generated by other communication terminals picking up sound from other communication terminals. For example, the basic communication module can be connected to other communication terminals through short-range wireless communication methods such as Bluetooth to transmit signals. The other communication terminals can have the same structure as the communication terminal or different structures.

[0112] Step S130b: The basic communication module obtains the second sound pickup audio information from the second sound receiving unit in a wireless manner.

[0113] The communication terminal also includes a second sound receiving unit, and the second sound receiving unit communicates with the basic communication module wirelessly. The basic communication module obtains the second sound pickup audio information from the second sound receiving unit. In one embodiment, step S130b also includes step S120: the second sound pickup audio information is generated by the second sound receiving unit. The second sound receiving unit picks up the sound and generates the corresponding second sound pickup audio information according to the picked up sound. Specifically, step S120 may include the following steps S121 to S123:

[0114] Step S121: The second sound receiving unit picks up sound to generate a second audio signal.

[0115] The communication terminal also includes a second sound receiving unit, and the second sound receiving unit is configured to pick up sound, convert the sound signal into a corresponding electrical signal, and generate a second audio signal.

[0116] Step S123: Generate the second picked-up audio information according to the second audio signal.

[0117] The second sound receiving unit also processes the second sound picked up audio information accordingly according to a predetermined method or user input, thereby obtaining the second sound picked up audio information.

[0118] After step S120, the communication terminal executes step S130b, and the basic communication module obtains the second sound pickup audio information from the second sound receiving unit in a wireless manner. According to the need for sound pickup in the use scenario, the second sound receiving unit may include one or more. In a feasible implementation, the second sound receiving unit includes multiple units, and the basic communication module obtains the second sound pickup audio information from the multiple second sound receiving units respectively, thereby obtaining multiple second sound pickup audio information.

[0119] Step S130 may include both step S130a and step S130b. For example, the communication terminal includes a second sound receiving unit and the basic communication module establishes a communication connection with the second sound receiving unit and other communication terminals, the second sound receiving unit and other communication terminals receive sound simultaneously, and the basic communication module obtains multiple second sound pickup audio information from the second sound receiving unit and other communication terminals respectively by wireless means.

[0120] Step S150: Obtain return audio information according to the first picked-up audio information and the second picked-up audio information.

[0121] The communication terminal obtains corresponding return audio information according to the first picked-up audio information and the second picked-up audio information in accordance with a predetermined rule or user input. The return audio information may reflect the first picked-up audio information and the second picked-up audio information, or may reflect only the first picked-up audio information or the second picked-up audio information according to the needs of the actual application scenario.

[0122] In some embodiments, step S150 may further include the following step S151:

[0123] Step S151: Mix the first picked-up audio information and the second picked-up audio information to obtain the returned audio information.

[0124] The communication terminal includes a corresponding audio processing module, which performs mixing processing on the first picked-up audio information and the second picked-up audio information according to a predetermined rule or a user's input, thereby obtaining corresponding return audio information.

[0125] According to different configuration modes of the audio processing module for performing the mixing process, step S151 may include the following step S151a or step S151b:

[0126] Step 151a: The first sound receiving unit mixes the first sound picked up audio information and the second sound picked up audio information to obtain the return audio information.

[0127] After receiving the second sound pickup audio information, the basic communication module sends the second sound pickup audio information to the first sound receiving unit, wherein the first sound receiving unit and the basic communication module may be connected by wire or wirelessly. The first sound receiving unit includes a first audio processing module, which performs mixing processing on the first sound pickup audio information and the second sound pickup audio information, and obtains return audio information based on the result of the mixing processing. The first sound receiving unit also sends the return audio information to the basic communication module.

[0128] Step S151b: The third audio processing module performs mixing processing on the first picked-up audio information and the second picked-up audio information to obtain the returned audio information.

[0129] In some embodiments, the communication terminal also includes a third audio processing module, and the third audio processing module is electrically connected to the basic communication module. The first sound receiving unit and the basic communication module may be connected by wire or by wireless. After the first sound receiving unit generates the first sound pickup audio information, the first sound pickup audio information is directly sent to the third audio processing module, or is sent to the third audio processing module through the basic communication module. After the basic communication module receives the second sound pickup audio information, the second sound pickup audio information is sent to the third audio processing module. The third audio processing module performs mixing processing on the received first sound pickup audio information and the second sound pickup audio information, and obtains the return audio information according to the result of the mixing processing. The third audio processing module also sends the return audio information to the basic communication module.

[0130] Step S170: The basic communication module sends the returned audio information outward.

[0131] The basic communication module can send the return audio information to the outside in a wired or wireless manner. The basic communication module can send the return audio information to one or more of other communication terminals, multimedia devices, cloud servers or other devices. For example, the basic communication module can send audio information to a computer, a mobile phone, etc. In one embodiment, the basic communication module establishes a communication connection with a computer through a short-range wireless communication method (such as Bluetooth, 2.4G), and sends the return audio information to the computer. The computer can exchange information with other devices used by conference participants at the other location through the Internet or other communication methods, thereby meeting the needs of people in different locations for remote meetings.

[0132] In some embodiments, further, after step S110 and before step S150, a step of obtaining first sound pickup audio information from the first sound receiving unit by the basic communication module may be included.

[0133] Specifically, the basic communication module can be connected to the first sound receiving unit by wire or wirelessly for signal transmission. After the first sound receiving unit generates the first sound pickup audio information, the first sound receiving unit can actively send the first sound pickup audio information to the basic communication module, or send the first sound pickup audio information to the basic communication module in response to a request for obtaining the first sound pickup audio information sent by the basic communication module. The basic communication module receives the first sound pickup audio information from the first sound receiving unit. For example, the first sound receiving unit is wirelessly connected to the basic communication module, the first sound receiving unit generates and sends the first sound pickup audio information to the basic communication module, and after the basic communication module receives the first sound pickup audio information, the communication terminal can further process the first sound pickup audio information and the second sound pickup audio information to obtain the return audio information.

[0134] Fig.24 It is a flowchart of an audio information processing method in some embodiments of the present disclosure.

[0135] Reference Fig.24 In some embodiments, before the aforementioned steps S110 to S170, the audio information processing method may further include the following steps S101 to S105. Among them, steps S110 to S170 are similar to the aforementioned steps S101 to S105. Fig.23 The described steps S110 to S170 are substantially the same.

[0136] Step S101: The basic communication module obtains audio information to be played from the outside.

[0137] The basic communication module obtains the audio information to be played from the communication terminal through wired or wireless means. The audio information to be played can be the audio information generated and sent by the device at the own location (such as the audio material that the personnel at the own location want to show), or it can be the audio information generated by the voice of the participants picked up at the other location.

[0138] Step S103: the speaker component plays the audio information to be played.

[0139] The communication terminal also includes a speaker component. The basic communication module sends the audio information to be played to the speaker component, and the speaker component plays the audio information to be played.

[0140] Step S105: The basic communication module broadcasts the audio information to be played wirelessly.

[0141] The basic communication module also broadcasts the received audio information to be played wirelessly, so that all devices in the network can receive the audio information to be played, thereby sending the audio information to be played to other devices or other parts of the communication terminal. For example, the basic communication module 1006 can broadcast the audio information to be played to all devices in the corresponding Bluetooth network through Bluetooth broadcasting. The first sound receiving unit and the second sound receiving unit can receive the broadcasted audio information to be played.

[0142] According to the need, after step S101, the following step S107 may be further included:

[0143] Step S107: The basic communication module sends the audio information to be played to other communication terminals or the second sound receiving unit in a unicast or multicast manner.

[0144] In one embodiment, the basic communication module is paired with one or more other communication terminals or a second sound receiving unit in a wireless manner, and the basic communication module sends the audio information to be played to the one or more other communication terminals or the second sound receiving unit to which the basic communication module is paired. The other communication terminal may have a speaker so that the audio information to be played received from the basic communication module can be played.

[0145] When the other communication terminal is used to pick up sound to generate second sound pickup audio information, and step S130 includes step S130a (i.e., the basic communication module obtains the second sound pickup audio information from the other communication terminal paired with the basic communication module in a wireless manner), the other communication terminal can use the audio information to be played to perform echo cancellation processing on the picked up sound. When the other communication terminal is not used to play the audio information to be played, the audio information to be played can be used as a reference signal for echo cancellation processing, thereby improving the quality of the second sound pickup audio information generated by the other communication terminal.

[0146] The above-mentioned step S105 and step S107 may be performed either one or simultaneously.

[0147] In some embodiments, step S130b may include the aforementioned step S120, and step S120 includes the aforementioned steps S121 to S123. Among them, step S123 includes the following step S123b:

[0148] Step S123b: perform echo cancellation processing on the second audio signal according to the audio information to be played to obtain the second picked-up audio information.

[0149] After step S105 and step S121, the second sound receiving unit performs echo cancellation processing on the second audio signal obtained in step S121 according to the audio information to be played received from the basic communication module, in accordance with a predetermined rule or user input, and obtains corresponding second sound pickup audio information according to the result of the echo cancellation processing. When the second sound receiving unit does not include a speaker, the audio information not played by the second sound receiving unit is used as a reference signal for the echo cancellation processing. After the basic communication module sends the audio information to be played to the second sound receiving unit, the second sound receiving unit can use the received audio information to be played as a reference signal for the echo cancellation processing, and perform echo cancellation processing on the picked up sound, thereby improving the quality of the second sound pickup audio information generated by the second sound receiving unit.

[0150] In some embodiments, step S110 may include the following steps S111 and S113:

[0151] Step S111: The first sound receiving unit picks up sound to generate a first audio signal.

[0152] The first sound receiving unit picks up sound, converts the sound signal into a corresponding electrical signal, and generates a first audio signal.

[0153] Step S113: performing echo cancellation processing on the first audio signal according to the audio information to be played to obtain the first picked-up audio information.

[0154] The basic communication module sends the received audio information to be played to the first sound receiving unit via wired or wireless means. The first sound receiving unit performs echo cancellation processing on the first audio signal obtained in step S111 according to the received audio information to be played and in accordance with predetermined rules or user input, and obtains corresponding first sound pickup audio information according to the result of the echo cancellation processing. When the first sound receiving unit does not include a speaker, the audio information not played by the first sound receiving unit is used as a reference signal for the echo cancellation processing. After the basic communication module sends the audio information to be played to the first sound receiving unit, the first sound receiving unit can use the received audio information to be played as a reference signal for the echo cancellation processing, and perform echo cancellation processing on the picked up sound, thereby improving the quality of the first sound pickup audio information generated by the first sound receiving unit.

[0155] Those skilled in the art should be aware that the audio information processing method does not have to strictly follow the above steps, and the order of the above steps can be adjusted, new steps can be added, or some steps can be deleted according to actual needs. For example, step S110 and step S130 can be performed successively or simultaneously.

[0156] Those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including a number of instructions for making a corresponding device or processor in a communication terminal execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0157] The communication terminal, communication system and audio information processing method of the embodiments of the present disclosure collect picked-up audio information from multiple different sources through a communication terminal, so that the communication terminal receives return audio information generated according to the picked-up audio information from the multiple sources, and sends the return audio information to an external device, thereby achieving the effect of synchronous sound reception using multiple sound receiving devices or sound receiving components when used by multiple people.

[0158] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A communication terminal, characterized in that: include: The sound pickup component comprises a first sound pickup unit, wherein the first sound pickup unit is configured to pick up sound to generate first picked-up audio information; as well as A basic communication module is configured to receive the second sound pickup audio information wirelessly and send out return audio information, wherein the return audio information is obtained according to the first sound pickup audio information and the second sound pickup audio information; The sound pickup assembly further includes at least one second sound pickup unit, wherein the second sound pickup unit is configured to pick up sound to generate second picked-up audio information; The basic communication module is further configured to receive audio information to be played, and send the audio information to be played to the first sound receiving unit and the second sound receiving unit; The first sound receiving unit is further configured to perform echo cancellation processing on the first audio signal according to the audio information to be played, so as to generate the first sound pickup audio information; The second sound pickup unit is further configured to perform echo cancellation processing on the second audio signal according to the audio information to be broadcast, so as to generate the second sound pickup audio information.

2. The communication terminal according to claim 1, characterized in that: The first sound receiving unit comprises: A first acoustic-to-electric conversion device configured to pick up sound and generate a first audio signal; and The first audio processing module is configured to generate the first picked-up audio information according to the first audio signal.

3. The communication terminal according to claim 2, characterized in that: The basic communication module is further configured to send the second picked-up audio information to the first audio processing module, and the first audio processing module is further configured to perform mixing processing on the first picked-up audio information and the second picked-up audio information to obtain the return audio information.

4. The communication terminal according to claim 2, characterized in that: The first sound receiving unit further includes: The first wireless communication module is electrically connected to the first audio processing module, and the first wireless communication module is configured to send the first picked-up audio information to the basic communication module.

5. The communication terminal according to claim 4, characterized in that: The communication terminal also includes: The third audio processing module is electrically connected to the basic communication module, and the third audio processing module is configured to perform mixing processing on the first picked-up audio information and the second picked-up audio information to obtain the return audio information.

6. The communication terminal according to claim 1, characterized in that: The communication terminal also includes a speaker component for playing the audio information to be played.

7. The communication terminal according to claim 1, characterized in that: The second sound receiving unit comprises: A second sound-to-electric conversion device is configured to pick up sound and generate the second audio signal; A second audio processing module, configured to generate the second picked-up audio information according to the second audio signal; and The second wireless communication module is configured to send the second picked-up audio information to the basic communication module.

8. The communication terminal according to claim 1, characterized in that: The basic communication module is also configured to receive audio information to be played; The communication terminal also includes a speaker component for playing the audio information to be played; The basic communication module is further configured to broadcast the audio information to be played wirelessly, and the first sound receiving unit is further configured to receive the audio information to be played wirelessly.

9. A communication system, characterized in that: include: A main communication terminal, the main communication terminal comprising a main basic communication module and a main sound receiving component, the main sound receiving component being configured to pick up sound to generate main sound pickup audio information; as well as at least one secondary communication terminal, the secondary communication terminal comprising a secondary basic communication module and a secondary sound pickup component, the secondary sound pickup component being configured to pick up sound to generate secondary sound pickup audio information, the secondary basic communication module being configured to wirelessly send secondary return audio information to the primary basic communication module, the secondary return audio information being obtained based on the secondary sound pickup audio information; Wherein, the primary basic communication module is configured to send out return audio information, the return audio information being obtained according to the primary sound pickup audio information and the secondary return audio information; The main basic communication module is further configured to receive audio information to be played, and the main communication terminal is configured to perform echo cancellation processing on the picked-up sound according to the audio information to be played; The secondary basic communication module is further configured to receive audio information to be played, and the secondary communication terminal is configured to perform echo cancellation processing on the picked-up sound according to the audio information to be played.

10. The communication system according to claim 9, characterized in that: The main sound receiving component includes a main sound-to-electric conversion device and a main audio processing module, wherein the main sound-to-electric conversion device is configured to pick up sound to generate a main audio signal, and the main audio processing module is configured to perform echo cancellation processing on the main audio signal according to the audio information to be played, so as to generate the main sound pickup audio information; The secondary sound receiving component includes a secondary sound-to-electric conversion device and a secondary audio processing module. The secondary sound-to-electric conversion device is configured to pick up sound to generate a secondary audio signal. The secondary audio processing module is configured to perform echo cancellation processing on the secondary audio signal according to the audio information to be played to generate the secondary sound pickup audio information.

11. An audio information processing method, applied to a communication terminal, characterized in that: The method comprises: Generating first sound pickup audio information by the first sound receiving unit; The basic communication module obtains the second sound pickup audio information in a wireless manner; Obtaining return audio information according to the first picked-up audio information and the second picked-up audio information; and The basic communication module sends the returned audio information outward; The method further comprises: The basic communication module obtains the audio information to be played from the outside; The basic communication module broadcasts the audio information to be played wirelessly; The second sound receiving unit picks up the sound to generate a second audio signal; and Performing echo cancellation processing on the second audio signal according to the to-be-played audio information to obtain the second picked-up audio information; The generating of the first sound pickup audio information by the first sound receiving unit comprises: The first sound receiving unit picks up sound to generate a first audio signal; and The first audio signal is subjected to echo cancellation processing according to the audio information to be played, so as to obtain the first picked-up audio information.

12. The audio information processing method according to claim 11, characterized in that: The obtaining of the returned audio information according to the first picked-up audio information and the second picked-up audio information comprises: Mixing the first picked-up audio information and the second picked-up audio information to obtain the returned audio information; The mixing process of the first sound picked-up audio information and the second sound picked-up audio information to obtain the returned audio information comprises: The first sound pickup unit performs mixing processing on the first sound pickup audio information and the second sound pickup audio information to obtain the return audio information; or, The first picked-up audio information and the second picked-up audio information are mixed by a third audio processing module to obtain the return audio information, wherein the third audio processing module is electrically connected to the basic communication module.

13. The audio information processing method according to claim 11, characterized in that: The method further comprises: The audio information to be played is played by the speaker component.

Images