Call device, sound signal processing method, and storage medium

Abstract

The application provides a call device, a sound signal processing method and a storage medium, and belongs to the technical field of calls. The call device comprises a sound collection module, a control module, a first sound emitting module and a second sound emitting module which are dipoles of each other; the first sound emitting module and the second sound emitting module are used for playing a first sound signal of a call opposite end and canceling a first leakage sound signal in a near-field area of the first sound emitting module; the sound collection module is arranged in the near-field area, and the sound collection module is electrically connected with the control module, and the control module is electrically connected with the second sound emitting module; the control module is used for controlling the second sound emitting module to emit a second sound signal based on the first leakage sound signal collected by the sound collection module, and the second sound signal is used for canceling a second leakage sound signal in a far-field area of the first sound emitting module. The application can improve the privacy of calls.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a communication device, a method for processing audio signals, and a storage medium. Background Technology

[0002] When a user makes a phone call, their ear is close to the earpiece to receive the other person's voice. However, the other person's voice is also transmitted through the earpiece to the surrounding area, which means that the user's conversation can be heard by others in the vicinity, resulting in the leakage of the call audio. Therefore, how to reduce the risk of call audio leakage in this scenario to ensure the privacy of users' calls is a key focus of the industry. Summary of the Invention

[0003] This application provides a communication device, a method for processing audio signals, and a storage medium, which can improve the privacy of phone calls. The technical solution is as follows:

[0004] On the one hand, a communication device is provided, the communication device comprising: a sound acquisition module and a control module, a first sound-emitting module and a second sound-emitting module that are dipoles to each other;

[0005] The first sound module and the second sound module are used to play the first sound signal of the other end of the call and to cancel the first sound leakage signal in the near field area of ​​the first sound module. The distance between the position point in the near field area and the first sound module is less than a preset distance.

[0006] The sound acquisition module is located in the near-field area, and the sound acquisition module is electrically connected to the control module, and the control module is electrically connected to the second sound-generating module;

[0007] The control module is used to control the second sound-emitting module to emit a second sound signal based on the first sound leakage signal acquired by the sound acquisition module. The second sound signal cancels out the second sound leakage signal in the far field region of the first sound-emitting module. The second sound signal and the second sound leakage signal have the same amplitude but opposite phase. The distance between the position point in the far field region and the first sound-emitting module is greater than the preset distance.

[0008] On the other hand, a method for processing audio signals is provided, which is applied to the aforementioned communication device, the method comprising:

[0009] The first sound signal from the other end of the call is played through the first sound module and the second sound module, and the first sound leakage signal in the near field area of ​​the first sound module is canceled.

[0010] The control module controls the second sound-emitting module to emit a second sound signal based on the first sound leakage signal.

[0011] The second sound signal cancels out the second leaked sound signal in the far field region of the first sound-generating module. The second sound signal and the second leaked sound signal have the same amplitude but opposite phase.

[0012] On the other hand, a computer-readable storage medium is provided, wherein at least one piece of program code is stored in the storage medium, the at least one piece of program code being loaded and executed by a processor to implement the above-described method for processing sound signals.

[0013] On the other hand, a computer program product is provided, which stores at least one piece of program code for execution by a processor to implement the above-described method for processing sound signals.

[0014] In this embodiment of the application, a control module and a first sound-emitting module and a second sound-emitting module that are dipoles to each other are provided in the communication device; the control module controls the second sound-emitting module to emit a second sound signal, the second sound signal having the same amplitude but opposite phase to the second leakage sound signal in the far field region of the first sound-emitting module; therefore, the second sound signal can cancel out the second leakage sound signal, thereby preventing the second leakage sound signal in the far field region from being heard by other users and improving the privacy of the call. Attached Figure Description

[0015] Figure 1 A block diagram of a communication device illustrated in an exemplary embodiment of this application is shown;

[0016] Figure 2 A block diagram of a communication device illustrated in an exemplary embodiment of this application is shown;

[0017] Figure 3 A block diagram of a communication device illustrated in an exemplary embodiment of this application is shown;

[0018] Figure 4 A block diagram of a communication device illustrated in an exemplary embodiment of this application is shown;

[0019] Figure 5 A block diagram of a communication device illustrated in an exemplary embodiment of this application is shown;

[0020] Figure 6 A flowchart illustrating a method for processing sound signals according to an exemplary embodiment of this application is shown;

[0021] Figure 7 A flowchart illustrating a method for processing sound signals according to an exemplary embodiment of this application is shown;

[0022] Figure 8 A flowchart illustrating a method for processing sound signals according to an exemplary embodiment of this application is shown;

[0023] Figure 9 A flowchart illustrating a method for processing sound signals according to an exemplary embodiment of this application is shown;

[0024] Figure 10 A block diagram of a calling device illustrated in an exemplary embodiment of this application is shown.

[0025] 10 Sound acquisition module; 20 Control module; 30 First sound generation module; 40 Second sound generation module; 201 Feedback unit; 202 Control unit; 203 Mixing processing unit; 204 Feedforward unit; 101 First microphone; 102 Second microphone; 103 Third microphone; 2011 First feedback subunit; 2012 Second feedback subunit; 2013 Third feedback subunit; 2014 First filter; 2015 Second filter; 2016 Third filter; 2021 Decision subunit; 2022 Reconstruction subunit; 2023 Amplitude control subunit; 2031 Mixing subunit; 2032 Phase inversion subunit. Detailed Implementation

[0026] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0027] In this article, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0028] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the sound signals, control signals, and reference signals involved in this application were all obtained with full authorization.

[0029] Please refer to Figure 1 The diagram illustrates a block diagram of a communication device according to an exemplary embodiment of this application. See also... Figure 1The communication device includes: a sound acquisition module 10 and a control module 20, a first sound-emitting module 30 and a second sound-emitting module 40 that are dipoles to each other; the first sound-emitting module 30 and the second sound-emitting module 40 are used to play the first sound signal of the other end of the call and to cancel the first sound leakage signal in the near field area of ​​the first sound-emitting module 30, wherein the distance between the position point in the near field area and the first sound-emitting module 30 is less than a preset distance; the sound acquisition module 10 is set in the near field area and is electrically connected to the control module 20, and the control module 20 is electrically connected to the second sound-emitting module 40.

[0030] The control module 20 is used to control the second sound-emitting module 40 to emit a second sound signal based on the first leaked sound signal collected by the sound acquisition module 10. The second sound signal cancels out the second leaked sound signal in the far field region of the first sound-emitting module 30. The second sound signal and the second leaked sound signal have the same amplitude but opposite phase. The distance between the position point in the far field region and the first sound-emitting module 30 is greater than a preset distance.

[0031] In some embodiments, the first sound module 30 and the second sound module 40 are used to convert digital signals into sound signals and play the sound signals; for example, the first sound module 30 and the second sound module 40 can be an earpiece. Since the first sound module 30 and the second sound module 40 are dipoles to each other, they can cancel out the first sound leakage signal in the near-field region of the first sound module 30. Furthermore, since there is sound leakage in the near-field region, it can also be referred to as the near-field sound leakage region.

[0032] In this embodiment, a control module 20 and a first sound-emitting module 30 and a second sound-emitting module 40, which are dipoles, are provided in the communication device. The control module 20 controls the second sound-emitting module 40 to emit a second sound signal. The second sound signal has the same amplitude but opposite phase to the second leakage signal in the far-field region of the first sound-emitting module 30. Therefore, the second sound signal can cancel out the second leakage signal, thereby preventing other users from hearing the second leakage signal in the far-field region and improving the privacy of the call. Since the first sound-emitting module 30 and the second sound-emitting module 40, which are dipoles, can cancel out the first leakage signal in the near-field region, and the second sound signal emitted by the second sound-emitting module 40 controlled by the control module 20 can cancel out the second leakage signal in the far-field region, a secondary cancellation is achieved, improving the cancellation effect of the leakage signal. In addition, the far-field region is often a quiet region; therefore, the far-field region can also be called the far-field quiet zone.

[0033] Please refer to Figure 2The control module 20 includes a feedback unit 201, a control unit 202, and a mixing processing unit 203. The feedback unit 201 is electrically connected to the sound acquisition module 10, and the feedback unit 201 is electrically connected to the mixing processing unit 203 through the control unit 202. The mixing processing unit 203 is electrically connected to the second sound generation module 40.

[0034] Feedback unit 201 is used to determine a first control signal that matches the first leaked sound signal based on the transfer function, and input the first control signal to control unit 202. The transfer function is used to represent the changes in amplitude and phase of the sound signal transmitted to the far field region.

[0035] The control unit 202 is used to modify the first control signal to obtain a second control signal, and input the second control signal to the mixing processing unit 203.

[0036] The mixing processing unit 203 is used to mix the first digital signal corresponding to the first sound signal and the second control signal to obtain a second digital signal, and drive the second sound module 40 to emit the second sound signal corresponding to the second digital signal.

[0037] Both the first control signal and the second control signal are digital signals. When the first control signal contains ambient noise, the control unit 202 corrects the first control signal to obtain a second control signal that does not contain ambient noise. Based on the second control signal, the second sound module 40 is driven to emit a corresponding second sound signal, which can improve the accuracy of the second sound signal and thus improve the accuracy of canceling the second leaked sound signal based on the second sound signal, thereby improving the privacy of the call.

[0038] The sound acquisition module 10 includes M microphones, and the feedback unit 201 includes M feedback subunits. Each microphone is electrically connected to a feedback subunit, and all M feedback subunits are electrically connected to the control unit. M is an integer not less than 1, meaning that the sound acquisition module 10 includes one or more microphones. In this embodiment, the number of microphones is not specifically limited, as long as the number of microphones is the same as the number of feedback subunits.

[0039] In some embodiments, the sound acquisition module 10 includes a microphone (first microphone), the first leaked sound signal includes a first leaked sound sub-signal, and the feedback unit 201 includes a feedback sub-unit (first feedback sub-unit). The first microphone is electrically connected to the first feedback sub-unit, and the first feedback sub-unit is electrically connected to the control unit 202. The first microphone is used to acquire the first leaked sound sub-signal and input the first leaked sound sub-signal to the feedback sub-unit. The feedback sub-unit is used to determine a first control signal matching the first leaked sound sub-signal based on a transfer function, and input the first control signal to the control unit 202, whereby the control unit 202 corrects the first control signal.

[0040] In some embodiments, the sound acquisition module 10 includes two microphones, namely a first microphone and a second microphone. The first leaked sound signal includes a first leaked sound sub-signal and a second leaked sound sub-signal. The feedback unit 201 includes two feedback sub-units, namely a first feedback sub-unit and a second feedback sub-unit. The first microphone is electrically connected to the first feedback sub-unit, and the first feedback sub-unit is electrically connected to the control unit 202. The second microphone is electrically connected to the second feedback sub-unit, and the second feedback sub-unit is electrically connected to the control unit 202. The first microphone is used to acquire the first leaked sound sub-signal and transmit it to the first feedback sub-unit. The first feedback sub-unit is used to determine a first control signal matching the first leaked sound sub-signal based on a transfer function and transmit the first control signal to the control unit 202, whereby the control unit 202 corrects the first control signal. The second microphone is used to collect the second leaked sound sub-signal and transmit the second leaked sound sub-signal to the second feedback sub-unit; the second feedback sub-unit is used to determine the first control signal that matches the second leaked sound sub-signal based on the transfer function, and transmit the first control signal to the control unit 202, which then corrects the first control signal.

[0041] In some embodiments, the sound acquisition module 10 includes three microphones; please refer to [the relevant documentation]. Figure 3 The sound acquisition module 10 includes a first microphone 101, a second microphone 102, and a third microphone 103; the first leakage signal includes a first leakage sub-signal, a second leakage sub-signal, and a third leakage sub-signal; the feedback unit 201 includes a first feedback sub-unit 2011, a second feedback sub-unit 2012, and a third feedback sub-unit 2013; the first microphone 101 is electrically connected to the first feedback sub-unit 2011, and the first feedback sub-unit 2011 is electrically connected to the control unit 202; the second microphone 102 is electrically connected to the second feedback sub-unit 2012, and the second feedback sub-unit 2012 is electrically connected to the control unit 202; the third microphone 103 is electrically connected to the third feedback sub-unit 2013, and the third feedback sub-unit 2013 is electrically connected to the control unit 202.

[0042] The first microphone 101 is used to acquire a first leaked sound sub-signal and input it to the first feedback sub-unit 2011. The first feedback sub-unit 2011 is used to determine a first control signal matching the first leaked sound sub-signal based on a transfer function, and transmit the first control signal to the control unit 202, whereby the control unit 202 corrects the first control signal. The second microphone 102 acquires a second leaked sound sub-signal and inputs it to the second feedback sub-unit 2012. The second feedback sub-unit 2012 is used to determine a first control signal matching the second leaked sound sub-signal based on a transfer function, and transmit the first control signal to the control unit 202, whereby the control unit 202 corrects the first control signal. The third microphone 103 acquires a third leaked sound sub-signal and inputs it to the third feedback sub-unit 2013. The third feedback sub-unit is used to determine a first control signal matching the third leaked sound sub-signal based on a transfer function, and transmit the first control signal to the control unit 202, whereby the control unit 202 corrects the first control signal.

[0043] In this embodiment, the use of multiple microphones not only enhances the voice quality of calls but also reduces interference from ambient noise. Furthermore, by flexibly adjusting the number of feedback subunits included in the feedback unit 201 to accommodate different sound acquisition modules 10 with varying numbers of microphones, the adaptability of the communication device in this solution is improved.

[0044] In some embodiments, the feedback unit 201 further includes filters, and the number of filters included in the feedback unit 201 is the same as the number of microphones included in the sound acquisition module 10. That is, the feedback unit 201 further includes M filters, one filter corresponding to one microphone and one feedback subunit respectively. The filters are electrically connected between the microphone and the feedback subunit, and the filters are used to filter out signals with frequencies higher than a preset frequency in the leaked sound sub-signals acquired by the microphone, and input the filtered leaked sound sub-signals to the feedback subunit.

[0045] In this embodiment, the filter can be a low-pass filter (LPF). By setting an LPF in the communication device, high-frequency signals in the leaky tone signal input to the feedback subunit are filtered out, thereby making the filtered leaky tone signal smoother and more stable, and improving the call quality.

[0046] In some embodiments, when the sound acquisition module 10 includes a microphone (first microphone) and the feedback unit 201 includes a first feedback subunit, the feedback unit 201 further includes a first filter. The first filter is electrically connected between the first microphone and the first feedback subunit, and the first filter is used to filter out signals with frequencies higher than a preset frequency in the first leaked sound sub-signal acquired by the first microphone, and input the filtered leaked sound sub-signal to the first feedback subunit.

[0047] In some embodiments, when the sound acquisition module 10 includes a first microphone and a second microphone, and the feedback unit 201 includes a first feedback subunit and a second feedback subunit, the feedback unit 201 further includes a first filter and a second filter. The first filter is electrically connected between the first microphone and the first feedback subunit. The first filter is used to filter out signals with frequencies higher than a preset frequency in the first leaked sound sub-signal acquired by the first microphone, and inputs the filtered first leaked sound sub-signal to the first feedback subunit. The second filter is electrically connected between the second microphone and the second feedback subunit. The second filter is used to filter out signals with frequencies higher than a preset frequency in the second leaked sound sub-signal acquired by the second microphone, and inputs the filtered second leaked sound sub-signal to the second feedback subunit.

[0048] In some embodiments, when the sound acquisition module 10 includes a first microphone 101, a second microphone 102, and a third microphone 103, and the feedback unit 201 includes a first feedback subunit 2011, a second feedback subunit 2012, and a third feedback subunit 2013, the feedback unit 201 further includes a first filter 2014, a second filter 2015, and a third filter 2016; the first filter 2014 is electrically connected between the first microphone 101 and the first feedback subunit 2011, and the first filter 2014 is used to filter out signals with frequencies higher than a preset frequency in the first leaked sound sub-signal acquired by the first microphone 101, and input the filtered first leaked sound sub-signal into the system. The signal is fed to the first feedback subunit 2011; the second filter 2015 is electrically connected between the second microphone 102 and the second feedback subunit 2012, and the second filter 2015 is used to filter out signals with frequencies higher than a preset frequency in the second leaked sound sub-signal collected by the second microphone 102, and inputs the filtered second leaked sound sub-signal to the second feedback subunit 2012; the third filter 2016 is electrically connected between the third microphone 103 and the third feedback subunit 2013, and the third filter 2016 is used to filter out signals with frequencies higher than a preset frequency in the third leaked sound sub-signal collected by the third microphone 103, and inputs the filtered third leaked sound sub-signal to the third feedback subunit 2013.

[0049] In some embodiments, the number of microphones, feedback subunits, and filters described above are examples; the number of microphones, feedback subunits, and filters can be the same; for example, if the number of microphones is 4, then the number of feedback subunits and the number of filters are also 4; as another example, if the number of microphones is 5, then the number of feedback subunits and the number of filters are also 5.

[0050] Furthermore, when the sound acquisition module 10 includes multiple microphones, the first leaked sound signal can be acquired through all or some of the microphones. For example, the sound acquisition module 10 includes a first microphone 101, a second microphone 102, and a third microphone 103. The first leaked sound signal is acquired through the first microphone 101 and the second microphone 102, which means two feedback subunits are required. Correspondingly, the feedback unit 201 includes a first feedback subunit 2011 and a second feedback subunit 2012. The first microphone 101 is electrically connected to the first feedback subunit 2011, and the first feedback subunit 2011 is electrically connected to the control unit 202. The second microphone 102 is electrically connected to the second feedback subunit 2012. The first microphone 101 acquires the first leaked sound signal and inputs it to the first feedback subunit 2011, while the second microphone 102 acquires the second leaked sound signal and inputs it to the second feedback subunit 2012. Therefore, this application offers high flexibility.

[0051] In some embodiments, please refer to Figure 4 The control unit 202 includes a decision subunit 2021 and a reconstruction subunit 2022; the decision subunit 2021 is electrically connected to the feedback unit 201, and the decision subunit 2021 is electrically connected to the hybrid processing unit 203 through the reconstruction subunit 2022.

[0052] The decision subunit 2021 is used to determine whether the first control signal contains environmental noise based on the reference signal, wherein the reference signal is a digital signal that does not contain environmental noise; the reconstruction subunit 2022 is used to reconstruct the first control signal to obtain a second control signal that does not contain environmental noise if the first control signal contains environmental noise, and input the second control signal to the hybrid processing unit 203.

[0053] In some embodiments, the reference signal may be a first digital signal corresponding to a first audio signal; or a signal extracted based on the first digital signal corresponding to the first audio signal. Since the reference signal is a digital signal that does not contain environmental noise, it is possible to determine whether the first control signal contains environmental noise based on the reference signal. If the first control signal contains environmental noise, the first control signal is reconstructed to obtain a second control signal that does not contain environmental noise, thereby avoiding false detections caused by environmental noise and interference sources.

[0054] In some embodiments, please refer to Figure 4 The control unit 202 also includes an amplitude control subunit 2023;

[0055] The amplitude control subunit 2023 is electrically connected to the reconstruction subunit 2022 and to the mixing processing unit 203. The amplitude control subunit 2023 controls the amplitude of the second control signal reconstructed by the reconstruction subunit 2022 to be less than a preset amplitude, where the preset amplitude is the amplitude threshold for howling generated by the second sound module 40. In this embodiment, the amplitude of the second control signal is controlled by the amplitude control subunit 2023 to prevent howling caused by excessively high amplitude; therefore, this application can prevent howling generated by the second sound module 40 and improve call quality.

[0056] In some embodiments, please refer to Figure 5 The mixing processing unit 203 includes a mixing subunit 2031 and an anti-phase subunit 2032; the mixing subunit 2031 is electrically connected to the control unit 202, the mixing subunit 2031 is electrically connected to the anti-phase subunit 2032, and the anti-phase subunit 2032 is electrically connected to the second sound generation module 40.

[0057] The mixing subunit 2031 is used to mix the first digital signal corresponding to the first sound signal and the second control signal to obtain the second digital signal, and input the second digital signal to the inverting subunit 2032; the inverting subunit 2032 is used to invert the second digital signal and drive the second sound module 40 to emit the second sound signal corresponding to the inverted second digital signal.

[0058] The mixing subunit 2031 can be a mixer; for example, the mixing subunit 2031 can be an adder; the inverting subunit 2032 can be an inverter, which is used to reverse the phase of the input signal by 180 degrees, thereby obtaining a second sound signal that is opposite in phase to the second leaked sound signal.

[0059] In some embodiments, please refer to Figure 5 The control module 20 also includes a feedforward unit 204; the feedforward unit 204 is electrically connected to the sound acquisition module 10 and the second sound generation module 40.

[0060] The feedforward unit 204 is used to adjust the sound generation parameters based on the first leaked sound signal collected by the sound acquisition module 10, and drive the second sound generation module 40 to emit a second sound signal based on the adjusted sound generation parameters.

[0061] In some embodiments, the feedforward unit 204 and the feedback unit 201 can operate independently or jointly. When the feedforward unit 204 and the feedback unit 201 operate independently, and the sound acquisition module 10 includes M microphones, the feedforward unit 204 is electrically connected to each of the M microphones and is also electrically connected to the second sound-generating module 40. Based on the M leaked sound sub-signals acquired by the M microphones, the feedforward unit 204 adjusts the sound generation parameters and drives the second sound-generating module 40 to emit a second sound signal based on the adjusted sound generation parameters. In this embodiment, the feedforward unit 204 can operate independently of the feedback unit 201, and even without the feedback unit 201, the feedforward unit 204 can still drive the second sound-generating module 40 to emit a second sound signal that cancels out the second leaked sound signal, thereby achieving cancellation of the second leaked sound signal and improving the privacy of the call.

[0062] In some embodiments, the feedforward unit 204 and the feedback unit 201 work together, and when the sound acquisition module 10 includes M microphones and the feedback unit 201 includes M feedback subunits and M filters, the feedforward unit 204 is electrically connected to the M filters 2016. The feedforward unit 204 is used to adjust the sound generation parameters based on the leaked sound sub-signals filtered by the M filters, and drive the second sound generation module 40 to emit a second sound signal based on the adjusted sound generation parameters.

[0063] Before adjusting the sound generation parameters, the feedforward unit 204 drives the second sound generation module 40 to emit a first sound signal based on the initial sound generation parameters. The first sound signal is the downlink signal, which is also the voice signal from the other end of the call. The second sound generation module 40 includes a filter, which is used to adjust the amplitude and / or phase of the digital signal, thereby driving the second sound generation module 40 to generate sound signals with different amplitudes and / or phases; correspondingly, the sound generation parameters can be the filter parameters.

[0064] In this embodiment, a feedforward unit 204 and a feedback unit 201 are provided in the communication device. The feedback unit 201 can generate a first control signal, and then drive the second sound module 40 to emit a second sound signal by mixing the first control signal with a first digital signal corresponding to the first sound signal. That is, the feedback unit 201 controls the second sound module 40 through signal driving. The feedforward unit 204 can adjust the sound generation parameters of the second sound module 40 adaptively. That is, the feedforward unit 204 can control the second sound module 40 through parameter adjustment. Thus, the feedforward unit 204 and the feedback unit 201 interact to jointly drive the second sound module 40 to emit the second sound signal, so that the second sound module 40 emits a more accurate second sound signal to cancel the second leakage signal, thereby improving the accuracy of generating the second sound signal, improving the degree of cancellation between the second sound signal and the second leakage signal, and thus improving the privacy of the call.

[0065] Furthermore, since a feedforward unit 204 is provided in the communication device, and the feedforward unit 204 can also control the second sound module 40, even if the second sound signal emitted by the second sound module 40 controlled by the feedback unit 201 is inaccurate, the feedforward unit 204 can adjust the second sound module 40 by adjusting the parameters so that the second sound module 40 emits a second sound signal that cancels out the second leakage signal, thereby making the communication device more robust and improving the privacy of the call.

[0066] In some embodiments, a calling device is provided, which includes any of the calling devices described above. The calling device can be any device capable of communicating with a third party; for example, it can be a smartphone or a feature phone, a smart wearable device (e.g., smart glasses), a tablet computer, or a headset. The calling device can also be a novel carrier that may emerge in the future, incorporating the aforementioned calling device.

[0067] Please refer to Figure 6 This document illustrates a flowchart of a method for processing audio signals according to an exemplary embodiment of this application. The method is applied to any of the aforementioned communication devices or communication equipment; the method includes:

[0068] Step 601: Play the first audio signal of the other end of the call through the first sound module and the second sound module, and cancel the first sound leakage signal in the near field area of ​​the first sound module.

[0069] In some embodiments, the first sound-generating module and the second sound-generating module are used to convert digital signals into sound signals and play the sound signals. Since the first sound-generating module and the second sound-generating module are dipoles of each other, the first sound-generating module and the second sound-generating module can cancel out the first sound leakage signal in the near-field region of the first sound-generating module.

[0070] Step 602: Using the control module, based on the first sound leakage signal, control the second sound generation module to emit a second sound signal.

[0071] The second sound signal will be transmitted to the far field region, and there will be a second sound leakage signal in the far field region. Therefore, after controlling the second sound module to emit the second sound signal, step 603 is executed.

[0072] Step 603: The second sound signal cancels out the second leakage sound signal in the far field region of the first sound module. The second sound signal and the second leakage sound signal have the same amplitude but opposite phase.

[0073] Since the second sound signal and the second leaked sound signal have the same amplitude but opposite phase, the sum of the second sound signal and the second leaked sound signal is zero, which means that the two signals cancel each other out, thereby eliminating the second leaked sound signal and preventing the second leaked sound signal from being intercepted by other users.

[0074] In this embodiment of the application, a control module and a first sound-emitting module and a second sound-emitting module that are dipoles to each other are provided in the communication device; the control module controls the second sound-emitting module to emit a second sound signal, the second sound signal having the same amplitude but opposite phase to the second leakage sound signal in the far field region of the first sound-emitting module; therefore, the second sound signal can cancel out the second leakage sound signal, thereby preventing the second leakage sound signal in the far field region from being heard by other users and improving the privacy of the call.

[0075] Please refer to Figure 7 This document illustrates a flowchart of a method for processing audio signals according to an exemplary embodiment of this application. The method is applied to any of the aforementioned communication devices or communication equipment; the method includes:

[0076] Step 701: Play the first audio signal of the other end of the call through the first sound module and the second sound module, and cancel the first sound leakage signal in the near field area of ​​the first sound module.

[0077] In some embodiments, this step is the same as step 601, and will not be described again here.

[0078] Step 702: The control module determines a first control signal that matches the first leaky sound signal based on the transfer function.

[0079] The transfer function is used to represent the changes in amplitude and phase of the sound signal transmitted to the far-field region. Furthermore, the transfer function includes a first transfer function and a second transfer function. The first transfer function represents the changes in amplitude and phase of the sound signal emitted by the second sound-generating module transmitted to the far-field region; the second transfer function represents the mapping relationship between the leaked sound signal acquired by the data acquisition module and the second leaked sound signal. Accordingly, this step can be implemented through the following steps (1) to (2), including:

[0080] (1) The frequency domain expression of the second leakage signal in the far field region is determined by the control module.

[0081] This step can be achieved through the following steps (1-1) to (1-3), including:

[0082] (1-1) The comprehensive leakage expression of the second leakage signal is determined by the leakage comprehensive function.

[0083] A first leaked sound signal is acquired through a sound acquisition module. This first leaked sound signal is a digital signal. Based on the first leaked sound signal, a comprehensive leaked sound expression for the second leaked sound signal is determined using a leaked sound synthesis function. This achieves the goal of representing the second leaked sound signal based on the first leaked sound signal. In some embodiments, when the sound acquisition module includes multiple microphones, the first leaked sound signal includes multiple leaked sound sub-signals; for example, the sound acquisition module includes a first microphone, a second microphone, and a third microphone. In this step, the first leaked sound sub-signal is acquired through the first microphone, the second leaked sound sub-signal through the second microphone, and the third leaked sound sub-signal through the third microphone. Based on the first, second, and third leaked sound sub-signals, a comprehensive leaked sound expression for the second leaked sound signal is determined using a leaked sound synthesis function. The independent variables of the leaked sound synthesis function are the three leaked sound sub-signals, and the dependent variable is the comprehensive leaked sound expression.

[0084] (1-2) Based on the second transfer function, the comprehensive transfer function expression of the second leak signal is determined by the transmission path comprehensive function. The second transfer function is used to represent the mapping relationship between the leak signal acquired by the data acquisition module and the second leak signal.

[0085] When the sound acquisition module includes M microphones, the second transmission function includes M transmission sub-functions, with one transmission sub-function corresponding to each microphone. The transmission sub-function corresponding to each microphone represents the mapping relationship between the leaked sound sub-signal acquired by that microphone and the second leaked sound signal. In this step, based on the M transmission sub-functions, the comprehensive transmission function expression for the second leaked sound signal is determined through the transmission path synthesis function. The independent variables of the transmission path synthesis function are the M transmission sub-functions, and the dependent variable is the comprehensive transmission function expression.

[0086] In some embodiments, when the sound acquisition module includes a first microphone and a second microphone, the second transmission function includes a first transmission subfunction and a second transmission subfunction. The first transmission subfunction represents the mapping relationship between the first leaked sound sub-signal and the second leaked sound signal acquired by the first microphone; the second transmission subfunction represents the mapping relationship between the second leaked sound sub-signal and the second leaked sound signal acquired by the second microphone. In this step, based on the first and second transmission subfunctions, a comprehensive transmission function expression for the second leaked sound signal is determined through a transmission path synthesis function. The independent variables of the transmission path synthesis function are the first and second transmission subfunctions, and the dependent variable is the comprehensive transmission function expression.

[0087] In some embodiments, when the sound acquisition module includes a first microphone, a second microphone, and a third microphone, the second transmission function includes a first transmission subfunction, a second transmission subfunction, and a third transmission subfunction. The first transmission subfunction represents the mapping relationship between the first leaked sound sub-signal and the second leaked sound signal acquired by the first microphone; the second transmission subfunction represents the mapping relationship between the second leaked sound sub-signal and the second leaked sound signal acquired by the second microphone; and the third transmission subfunction represents the mapping relationship between the third leaked sound sub-signal and the second leaked sound signal acquired by the third microphone. In this step, based on the first, second, and third transmission subfunctions, a comprehensive transmission function expression for the second leaked sound signal is determined through a transmission path synthesis function. The independent variables of the transmission path synthesis function are the three transmission subfunctions, and the dependent variable is the comprehensive transmission function expression.

[0088] (1-3) Based on the comprehensive leakage tone expression and the comprehensive transfer function expression, the frequency domain expression of the second leakage tone signal is determined.

[0089] Determine the product expression of the synthesized leaky tone expression and the synthesized transfer function expression, and then determine the Fourier transform of the product expression to obtain the frequency domain expression of the second leaky tone signal. For example, the frequency domain expression of the second leaky tone signal is shown in Formula 1 below:

[0090] Formula 1: M f =F{f(m1,m2,m3)}g(H1,H2,H3)

[0091] Among them, M fHere, f is the frequency domain expression of the second leaky signal, f is the leaky signal synthesis function, m1, m2, and m3 are the first, second, and third leaky sub-signals, respectively, and f(m1, m2, m3) is the synthesized leaky signal expression; g is the transmission path synthesis function, H1, H2, and H3 are the first, second, and third transmission sub-functions, respectively; and g(H1, H2, H3) is the synthesized transmission function expression, where F is the Fourier transform function. In some embodiments, the leaky signal synthesis function can be any function that synthesizes the three leaky sub-signals; for example, the leaky signal synthesis function can be a function that sums or averages the three leaky sub-signals. The transmission path synthesis function can be any function that synthesizes the three transmission sub-functions; for example, the transmission path synthesis function can be a function that sums or averages the three transmission sub-functions.

[0092] In some embodiments, the control module further includes a filter (e.g., a low-pass filter). Therefore, the step of determining the first control signal matching the first leaky sound signal based on the transfer function by the control module can be as follows: the control module filters out signals with frequencies higher than a preset frequency in the first leaky sound signal, and determines the first control signal matching the filtered first leaky sound signal based on the transfer function. For example, the control module includes a first filter (e.g., a first low-pass filter), a second filter (e.g., a second low-pass filter), and a third filter (e.g., a third low-pass filter). The first leaky sound signal includes a first leaky sound sub-signal, a second leaky sound sub-signal, and a third leaky sound sub-signal. Then, the first filter filters out signals with frequencies higher than a preset frequency in the first leaky sound sub-signal, the second filter filters out signals with frequencies higher than a preset frequency in the second leaky sound sub-signal, and the third filter filters out signals with frequencies higher than a preset frequency in the third leaky sound sub-signal. Correspondingly, m1, m2, and m3 are the filtered first leaky sound sub-signal, the filtered second leaky sound sub-signal, and the filtered third leaky sound sub-signal, respectively.

[0093] In this embodiment, by setting three LPFs, high-frequency signals in the three leaky tone sub-signals are filtered out, thereby making the filtered leaky tone sub-signals smoother and more stable, and improving call quality.

[0094] In some embodiments, Formula 1 is illustrated using an example where the sound acquisition module includes three microphones; however, if the sound acquisition module includes two microphones, only m1, m2, H1, and H2 in the formula are retained, and m3 and H3 in Formula 1 are deleted. Similarly, if the sound acquisition module includes four microphones, m4 and H4 are added to the formula.

[0095] (2) Based on the frequency domain expression of the second leaked sound signal and the first transfer function, determine the first control signal. The sum of the frequency domain expression of the first control signal multiplied by the first transfer function and the frequency domain expression of the second leaked sound signal is zero. The first transfer function is used to represent the changes in amplitude and phase of the sound signal emitted by the second sound module transmitted to the far field region.

[0096] Since the sound signal corresponding to the first control signal emitted by the second sound module needs to cancel out the second leaked sound signal, the first control signal needs to satisfy the relationship shown in Formula 2 below.

[0097] Formula 2: C f H s +M f =0

[0098] Among them, C f H is the frequency domain expression of the first control signal C. s It is the first transfer function, M f This is the frequency domain expression of the second leaky signal. Based on Formula 2, the frequency domain expression of the first control signal can be determined, that is, the first control signal can be determined.

[0099] Step 703: Correct the first control signal to obtain the second control signal.

[0100] Based on a reference signal, it is determined whether the first control signal contains environmental noise. The reference signal is a digital signal that does not contain environmental noise. If the first control signal contains environmental noise, it is reconstructed to obtain a second control signal that does not contain environmental noise. If the first control signal does not contain environmental noise, no correction is made to the first control signal; that is, the first control signal can be used as the second control signal to execute subsequent steps. In this embodiment, when the first control signal contains environmental noise, the first control signal is corrected to obtain a second control signal that does not contain environmental noise, thereby avoiding false detections caused by environmental noise and interference sources.

[0101] The reference signal can be a first digital signal corresponding to the first sound signal; or a signal extracted based on the first digital signal corresponding to the first sound signal. In the first implementation, the correlation between the first control signal and the reference signal is used to make the determination; correspondingly, the step of determining whether the first control signal contains environmental noise based on the reference signal can be: determining the correlation between the first control signal and the reference signal; if the correlation is lower than a preset correlation, determining that the first control signal contains environmental noise; if the correlation is not lower than the preset correlation, determining that the first control signal does not contain environmental noise.

[0102] In the second implementation, the ratio of the energy of the first control signal to the energy of the reference signal is used to make the judgment. Accordingly, the step of determining whether the first control signal contains environmental noise based on the reference signal can be: determining the ratio between the energy of the first control signal and the energy of the reference signal; if the ratio is less than a preset ratio, determining that the first control signal contains environmental noise; if the ratio is not less than the preset ratio, determining that the first control signal does not contain environmental noise.

[0103] In the third implementation, the frequency components of the first control signal are used for determination; correspondingly, the step of determining whether the first control signal contains environmental noise based on the reference signal can be: determining the first frequency component of the first control signal and the second frequency component of the reference signal; if the difference between the first frequency component and the second frequency component is greater than a preset difference, the first control signal is determined to contain environmental noise; if the difference between the first frequency component and the second frequency component is not greater than a preset difference, the first control signal is determined not to contain environmental noise.

[0104] In some embodiments, the determination of whether the first control signal contains environmental noise can be made using any of the above implementation methods; alternatively, any two or three of the above implementation methods can be combined to determine whether the first control signal contains environmental noise. For example, by combining the first and second implementation methods, the step of determining whether the first control signal contains environmental noise based on the reference signal can be: determining the correlation between the first control signal and the reference signal, and determining the ratio between the energy of the first control signal and the energy of the reference signal; if the correlation is lower than a preset correlation and the ratio is lower than a preset ratio, the first control signal is determined to contain environmental noise; if the correlation is not lower than a preset correlation or the ratio is not lower than a preset ratio, the first control signal is determined not to contain environmental noise. In the embodiments of this application, by combining multiple determination methods to determine whether the first control signal contains environmental noise, the accuracy of the determination result can be improved.

[0105] In some embodiments, the first control signal is modified iteratively to obtain the second control signal; for example, the amplitude and / or phase of the first control signal is adjusted, and it is determined whether the adjusted first control signal contains environmental noise; if the adjusted first control signal does not contain environmental noise, the adjusted first control signal is the second control signal; if the adjusted first control signal still contains environmental noise, the amplitude and / or phase of the first control signal is adjusted again until a second control signal without environmental noise is obtained.

[0106] Step 704: Determine the amplitude of the second control signal.

[0107] If the amplitude of the second control signal is lower than the preset amplitude, proceed to step 705; if the amplitude of the second control signal is not greater than the preset amplitude, return to step 703 and continue to correct the first control signal until a second control signal with an amplitude not lower than the preset amplitude is obtained.

[0108] Step 705: When the amplitude of the second control signal is lower than the preset amplitude, the first digital signal corresponding to the first sound signal and the second control signal are mixed to obtain the second digital signal, and the second sound module is driven to emit the second sound signal corresponding to the second digital signal.

[0109] The preset amplitude is the threshold value at which the second sound module generates feedback. The second control signal is also a digital signal; in this step, the first digital signal corresponding to the first sound signal and the second control signal are added together to obtain the second digital signal; the second digital signal is sent to the second sound module; the second sound module receives the second digital signal and emits the second sound signal corresponding to the second digital signal. In this embodiment, by controlling the amplitude of the second control signal, feedback from the second sound module can be prevented, thereby improving call quality.

[0110] Step 706: The second sound signal cancels out the second leakage sound signal in the far field region of the first sound module. The second sound signal and the second leakage sound signal have the same amplitude but opposite phase.

[0111] In some embodiments, this step is the same as step 603, and will not be described again here.

[0112] In this embodiment, a control module and a first and second sound-emitting modules that act as dipoles are provided in the communication device. The control module controls the second sound-emitting module to emit a second sound signal. The second sound signal has the same amplitude but opposite phase to the second leakage signal in the far-field region of the first sound-emitting module. Therefore, the second sound signal can cancel out the second leakage signal, thereby preventing other users from hearing the second leakage signal in the far-field region and improving the privacy of the call. Furthermore, by controlling the amplitude of the second control signal, it is possible to prevent the second sound-emitting module from generating howling, thereby improving the call quality.

[0113] Please refer to Figure 8 This document illustrates a flowchart of a method for processing audio signals according to an exemplary embodiment of this application. The method is applied to any of the aforementioned communication devices or communication equipment; the method includes:

[0114] Step 801: Play the first audio signal of the other end of the call through the first sound module and the second sound module, and cancel the first sound leakage signal in the near field area of ​​the first sound module.

[0115] In some embodiments, this step is the same as step 601, and will not be described again here.

[0116] Step 802: Using the control module, based on the first sound leakage signal, control the second sound generation module to emit a second sound signal.

[0117] In some embodiments, this step can be implemented through steps 702-705, which will not be described in detail here.

[0118] Step 803: The second sound signal cancels out the second leakage sound signal in the far field region of the first sound module. The second sound signal and the second leakage sound signal have the same amplitude but opposite phase.

[0119] In some embodiments, this step is the same as step 603, and will not be described again here.

[0120] Step 804: Adjust the sound generation parameters based on the first leaked sound signal.

[0121] The first leaked audio signal includes M leaked audio sub-signals. Based on these M leaked audio sub-signals, the sound generation parameters are adjusted in real time using an adaptive algorithm or an optimization algorithm. That is, the sound generation parameters are adjusted once for each frame of the M leaked audio sub-signals acquired. For example, if the first leaked audio signal includes a first leaked audio sub-signal, a second leaked audio sub-signal, and a third leaked audio sub-signal, the sound generation parameters are adjusted in real time using an adaptive algorithm or an optimization algorithm based on these three leaked audio sub-signals. This means that the sound generation parameters are adjusted once for each frame of the first, second, and third leaked audio sub-signals acquired, thereby further reducing the leakage volume and improving the privacy of the call.

[0122] In some embodiments, the adaptive algorithm may employ LMS or its related derivatives; the itinerant algorithm may employ a genetic algorithm, simulated annealing algorithm, or its related derivatives. These algorithms are merely examples; this application may employ any adaptive adjustment algorithm to adjust the sound generation parameters. In the embodiments of this application, the adaptive adjustment algorithm is not specifically limited. For example, if the sound generation parameters are adjusted using LMS, then based on the first leaked sound signal, the adjusted sound generation parameters are determined using the following formula three:

[0123] Formula 3: W(n+1)=W(n)+2μe(n)x(n)

[0124] x(n)=[x(n),x(n-1),…x(n-L+1)] T

[0125] Where W(n+1) is the adjusted sound generation parameter, and n+1 represents the current time; Wn is the original sound generation parameter, and n represents the time before the current time; e(n) is the second leaky sound signal M. f In the time domain expression at time n, x(n) is the time domain expression of the digital signal transmitted from the second sound generation module to the far field region at time n, and L is the length of the sound generation parameters.

[0126] Step 805: Based on the adjusted sound generation parameters, drive the second sound generation module to emit the first sound signal.

[0127] The communication device includes a filter used to adjust the amplitude and / or phase of a digital signal, thereby driving a second sound-generating module to generate sound signals of different amplitudes and / or phases; correspondingly, the sound generation parameters can be filter parameters. In this embodiment, the filter parameters are set to the adjusted filter parameters, and the amplitude and / or phase of the digital signal are adjusted by the filter, thereby driving the second sound-generating module to emit a first sound signal corresponding to the adjusted digital signal.

[0128] In this embodiment, the first leaked sound signal acquired by the sound acquisition module is also input to the feedforward unit. The feedforward unit adaptively adjusts the sound generation parameters to improve the accuracy of the sound generation parameters, thereby improving the accuracy of generating the second sound signal based on the sound generation parameters, so as to improve the degree of cancellation between the second sound signal and the second leaked sound signal and improve the privacy of the call.

[0129] Please refer to Figure 9 This document illustrates a flowchart of a method for processing audio signals according to an exemplary embodiment of this application. The method is applied to any of the aforementioned communication devices or communication equipment; the method includes:

[0130] Step 901: Drive the second sound module to play the first sweep frequency signal.

[0131] The processor, connected to the communication device, sends a first sound command to the second sound module, which instructs the second sound module to play a first frequency sweep signal. For example, the processor drives the second sound module to play the first frequency sweep signal s0.

[0132] Step 902: Acquire the second sweep frequency signal in the far field region. The second sweep frequency signal is the sweep frequency signal transmitted from the second sound module to the far field region by the first sweep frequency signal.

[0133] A standard microphone is placed at the center of the far-field region; a second sweep frequency signal is acquired through the standard microphone; since sound wave signals attenuate during transmission, meaning that both phase and amplitude may change, the second sweep frequency signal is not exactly the same as the first sweep frequency signal. For example, the second sweep frequency signal s1 acquired through the standard microphone.

[0134] Step 903: Determine the first transfer function based on the second sweep frequency signal and the first sweep frequency signal.

[0135] Determine the Fourier transform of the second frequency sweep signal and the Fourier transform of the first frequency sweep signal, and determine the ratio of the Fourier transform of the second frequency sweep signal to the Fourier transform of the first frequency sweep signal to obtain the first transfer function. This process can be found in Formula 4.

[0136] Formula 4: H s =F{s1} / F{s0}

[0137] F is the Fourier transform function, s0 is the first sweep frequency signal, and s1 is the second sweep frequency signal.

[0138] Step 904: Drive the first sound module and the second sound module to simultaneously play the third sweep frequency signal.

[0139] The processor, connected to the communication device, simultaneously sends a second sound command to both the first and second sound modules. This second sound command instructs the first and second sound modules to play a third frequency sweep signal. For example, the processor drives the second sound module to play the first frequency sweep signal s0.

[0140] Step 905: Acquire a third sound signal in the far-field region and a fourth sound signal through the sound acquisition module. The third and fourth sound signals are sound signals transmitted to the far-field and near-field regions as a third sweep frequency signal.

[0141] A standard microphone is placed at the center of the far-field region; a third sound signal is acquired through the standard microphone. If the sound acquisition module includes M microphones, the fourth sound signal includes M sound sub-signals; for example, if the sound acquisition module includes a first microphone, a second microphone, and a third microphone, the fourth sound signal includes a first sound sub-signal, a second sound sub-signal, and a third sound sub-signal. In this step, the first sound sub-signal is acquired through the first microphone, the second sound sub-signal through the second microphone, and the third sound sub-signal through the third microphone.

[0142] Step 906: Determine the second transfer function based on the third and fourth audio signals.

[0143] When the sound acquisition module includes M microphones, the second transmission function includes M transmission sub-functions, with one transmission sub-function corresponding to each microphone. The transmission sub-function corresponding to each microphone represents the mapping relationship between the leaked sound sub-signal acquired by that microphone and the second leaked sound signal. For example, when the acquisition module includes a first microphone, a second microphone, and a third microphone, the second transmission function includes a first transmission sub-function, a second transmission sub-function, and a third transmission sub-function. The first transmission sub-function represents the mapping relationship between the leaked sound signal acquired by the first microphone and the second leaked sound signal; the second transmission sub-function represents the mapping relationship between the leaked sound signal acquired by the second microphone and the second leaked sound signal; and the third transmission sub-function represents the mapping relationship between the leaked sound signal acquired by the third microphone and the second leaked sound signal.

[0144] In some embodiments, for any microphone, the process of determining the first transmission sub-function corresponding to the microphone is as follows: determining the Fourier transform of the third sound signal and determining the Fourier transform of the sound sub-signal collected by the microphone, determining the ratio of the Fourier transform of the third sound signal to the Fourier transform of the sound sub-signal collected by the microphone, and obtaining the transmission sub-function corresponding to the microphone.

[0145] In some embodiments, when the sound acquisition module includes a first microphone, a second microphone, and a third microphone, the step of determining the first transmission sub-function corresponding to the first microphone may be:

[0146] By determining the Fourier transform of the third sound signal and the Fourier transform of the first sound sub-signal, and then determining the ratio of the Fourier transform of the third sound signal to the Fourier transform of the first sound sub-signal, the first transfer function is obtained. For example, the first transfer function can be expressed by the following formula:

[0147] Formula 5: H1 = F{p0} / F{p1}

[0148] Where H1 is the first transmission sub-function, F is the Fourier transform function, p0 is the third sound signal, and p1 is the first sound sub-signal.

[0149] In some embodiments, the process of determining the second transfer function is as follows: determining the Fourier transform of the third audio signal and the Fourier transform of the second audio signal, determining the ratio of the Fourier transform of the third audio signal to the Fourier transform of the second audio signal, and obtaining the second transfer function. For example, the second transfer function can be represented by the following formula six:

[0150] Formula 6: H2 = F{p0} / F{p2}

[0151] Where H2 is the second transmission sub-function, F is the Fourier transform function, p0 is the third sound signal, and p2 is the second sound sub-signal.

[0152] In some embodiments, the process of determining the third transfer function is as follows: determining the Fourier transform of the third audio signal and the Fourier transform of the third audio sub-signal, determining the ratio of the Fourier transform of the third audio signal to the Fourier transform of the third audio sub-signal, and obtaining the third transfer function. For example, the third transfer function can be represented by the following formula seven:

[0153] Formula 7: H3 = F{p0} / F{p3}

[0154] Where H3 is the third transport function, F is the Fourier transform function, p0 is the third sound signal, and p3 is the third sound sub-signal.

[0155] In some embodiments, steps 901-906 are performed before processing the sound signal, that is, the first transfer function and the second transfer function are determined in advance through steps 901-906. In practical applications, the sound signal is processed directly based on the first transfer function and the second transfer function to improve the processing efficiency of the sound signal. Furthermore, the first transfer function and the second transfer function are determined based on the actual scenario, thus improving the accuracy of the determined first transfer function and the second transfer function.

[0156] Please refer to Figure 10 The diagram illustrates a block diagram of a communication device 1000 according to an exemplary embodiment of this application. In addition to the communication device 1010, the communication device 1000 of this application may also include one or more of the following components: a processor 1020, a memory 1030, and a display screen 1040.

[0157] Processor 1020 may include one or more processing cores. Processor 1020 connects to various parts within the entire communication device 1000 using various interfaces and lines, and performs various functions and processes data of the communication device 1000 by running or executing instructions, programs, code sets, or instruction sets stored in memory 1030, and by calling data stored in memory 1030. Optionally, processor 1020 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). Processor 1020 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), Neural-network Processing Unit (NPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content displayed on the screen 1040; the NPU is used to implement artificial intelligence (AI) functions; and the modem is used for wireless communication. It is understood that the modem may not be integrated into the processor 1020 and can be implemented as a separate chip.

[0158] The memory 1030 may include random access memory (RAM) or read-only memory. Optionally, the memory 1030 may include a non-transitory computer-readable storage medium. The memory 1030 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 1030 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the various method embodiments described below, etc.; the data storage area may store data (such as audio data, phone book, etc.) created based on the use of the communication device 1000.

[0159] Display screen 1040 is a display component used to display a user interface. Optionally, the display screen 1040 is a touch-enabled display screen, through which users can use their fingers, styluses, or any suitable object to perform touch operations on the display screen 1040.

[0160] The display screen 1040 is typically located on the front panel of the communication device 1000. The display screen 1040 can be designed as a full-screen, curved screen, irregularly shaped screen, dual-sided screen, or foldable screen. The display screen 1040 can also be designed as a combination of a full-screen and a curved screen, or a combination of an irregularly shaped screen and a curved screen, etc., but this embodiment does not limit it in this way.

[0161] In addition, those skilled in the art will understand that the structure of the communication device 1000 shown in the above figures does not constitute a limitation on the communication device 1000. The communication device 1000 may include more or fewer components than shown, or combine certain components, or have different component arrangements. For example, the communication device 1000 may also include audio acquisition devices, speakers, radio frequency circuits, input units, sensors, audio circuits, Wireless Fidelity (Wi-Fi) modules, power supplies, Bluetooth modules, etc., which will not be described in detail here.

[0162] This application also provides a computer-readable medium storing at least one piece of program code, which is loaded and executed by the processor to implement the sound signal processing method shown in the above embodiments.

[0163] This application also provides a computer program product that stores at least one piece of program code, which is loaded and executed by the processor to implement the sound signal processing method shown in the above embodiments.

[0164] In some embodiments, the computer program product involved in this application may be deployed and executed on a user calling device, or on multiple user calling devices located in one location, or on multiple user calling devices distributed in multiple locations and interconnected through a communication network. Multiple user calling devices distributed in multiple locations and interconnected through a communication network may form a blockchain system.

[0165] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0166] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A communication device, characterized in that, The communication device includes: a sound acquisition module and a control module, a first sound-emitting module and a second sound-emitting module that are dipoles to each other; The first sound module and the second sound module are used to play the first sound signal of the other end of the call and to cancel the first sound leakage signal in the near field area of ​​the first sound module. The distance between the position point in the near field area and the first sound module is less than a preset distance. The sound acquisition module is disposed in the near-field area for acquiring the first leaked sound signal, and the sound acquisition module is electrically connected to the control module, and the control module is electrically connected to the second sound generation module; the control module includes: a feedback unit, a control unit, and a mixing processing unit; the feedback unit is electrically connected to the sound acquisition module, the feedback unit is electrically connected to the mixing processing unit through the control unit, and the mixing processing unit is electrically connected to the second sound generation module; The feedback unit is used to determine a first control signal that matches the first leaked sound signal based on the transfer function, and input the first control signal to the control unit. The transfer function is used to represent the change in amplitude and phase of the sound signal transmitted from the near field region to the far field region. The control unit is configured to modify the first control signal to obtain a second control signal, and input the second control signal to the mixing processing unit; The mixing processing unit is used to mix the first digital signal corresponding to the first sound signal and the second control signal to obtain a second digital signal, drive the second sound module to emit the second sound signal corresponding to the second digital signal, and cancel out the second sound leakage signal in the far field region of the first sound module through the second sound signal. The second sound signal and the second sound leakage signal have the same amplitude but opposite phase, and the distance between the position point in the far field region and the first sound module is greater than the preset distance.

2. The communication device according to claim 1, characterized in that, The control unit includes a decision subunit and a reconstruction subunit; The decision subunit is electrically connected to the feedback unit, and the decision subunit is electrically connected to the hybrid processing unit through the reconstruction subunit; The decision subunit is used to determine whether the first control signal contains environmental noise based on a reference signal, wherein the reference signal is a digital signal that does not contain environmental noise. The reconstruction subunit is used to reconstruct the first control signal to obtain a second control signal that does not contain environmental noise when the first control signal contains environmental noise, and input the second control signal to the hybrid processing unit.

3. The communication device according to claim 2, characterized in that, The control unit also includes an amplitude control subunit; The amplitude control subunit is electrically connected to the reconstruction subunit, and the amplitude control subunit is electrically connected to the hybrid processing unit; The amplitude control subunit is used to control the amplitude of the second control signal reconstructed by the reconstruction subunit to be less than a preset amplitude, wherein the preset amplitude is the amplitude threshold for the second sound-generating module to generate a howling sound.

4. The communication device according to claim 1, characterized in that, The mixing processing unit includes: a mixing subunit and an anti-phase subunit; The mixing subunit is electrically connected to the control unit, the mixing subunit is electrically connected to the inverting subunit, and the inverting subunit is electrically connected to the second sound-generating module; The mixing subunit is used to mix the first digital signal corresponding to the first sound signal and the second control signal to obtain a second digital signal, and input the second digital signal to the inverting subunit; The inverting subunit is used to invert the second digital signal and drive the second sound module to emit a second sound signal corresponding to the inverted second digital signal.

5. The communication device according to claim 1, characterized in that, The sound acquisition module includes M microphones; the feedback unit includes M feedback subunits, where M is an integer not less than 1; A microphone is electrically connected to a feedback subunit, and all M feedback subunits are electrically connected to the control unit.

6. The communication device according to claim 5, characterized in that, The feedback unit also includes M filters, each filter corresponding to a microphone and a feedback subunit; The filter is electrically connected between the microphone and the feedback subunit, and the filter is used to filter out signals with frequencies higher than a preset frequency in the leaked sound sub-signal collected by the microphone, and input the filtered leaked sound sub-signal to the feedback subunit.

7. The communication device according to any one of claims 1-6, characterized in that, The control module further includes: a feedforward unit; The feedforward unit is electrically connected to the sound acquisition module, and the feedforward unit is electrically connected to the second sound generation module; The feedforward unit is used to adjust the sound generation parameters based on the first leaked sound signal acquired by the sound acquisition module, and drive the second sound generation module to emit the second sound signal based on the adjusted sound generation parameters.

8. A method for processing sound signals, characterized in that, The method is applied to the communication device according to any one of claims 1-7, and the method includes: The first sound signal from the other end of the call is played through the first sound module and the second sound module, and the first sound leakage signal in the near field area of ​​the first sound module is canceled. The control module determines a first control signal that matches the first leaked sound signal based on a transfer function. The transfer function is used to represent the changes in amplitude and phase of the sound signal transmitted from the near-field region to the far-field region. The first control signal is modified to obtain the second control signal; The first digital signal corresponding to the first sound signal and the second control signal are mixed to obtain a second digital signal, which drives the second sound module to emit the second sound signal corresponding to the second digital signal; The second sound signal cancels out the second leaked sound signal in the far field region of the first sound-generating module. The second sound signal and the second leaked sound signal have the same amplitude but opposite phase.

9. The method according to claim 8, characterized in that, The step of modifying the first control signal based on the transfer function to obtain the second control signal includes: Based on a reference signal, it is determined whether the first control signal contains environmental noise, wherein the reference signal is a digital signal that does not contain environmental noise. If the first control signal contains ambient noise, the first control signal is reconstructed to obtain a second control signal that does not contain ambient noise.

10. The method according to claim 9, characterized in that, Determining whether the first control signal contains environmental noise based on the reference signal includes at least one of the following: Determine the correlation between the first control signal and the reference signal; if the correlation is lower than a preset correlation, determine that the first control signal contains environmental noise. Determine the ratio between the energy of the first control signal and the energy of the reference signal; if the ratio is less than a preset ratio, determine that the first control signal contains environmental noise. A first frequency component of the first control signal and a second frequency component of the reference signal are determined. If the difference between the first frequency component and the second frequency component is greater than a preset difference, the first control signal is determined to contain environmental noise.

11. The method according to claim 8, characterized in that, The method further includes: When the amplitude of the second control signal is lower than the preset amplitude, the step of mixing the first digital signal corresponding to the first sound signal and the second control signal to obtain a second digital signal is executed, and the second sound module is driven to emit the second sound signal corresponding to the second digital signal. The preset amplitude is the amplitude threshold for the second sound module to generate a howling.

12. The method according to claim 8, characterized in that, The step of determining a first control signal matching the first leaky sound signal based on a transfer function through the control module includes: The frequency domain expression of the second leaky sound signal in the far-field region is determined by the control module. Based on the frequency domain expression of the second leaked sound signal and the first transfer function, the first control signal is determined. The sum of the frequency domain expression of the first control signal multiplied by the first transfer function and the frequency domain expression of the second leaked sound signal is zero. The first transfer function is used to represent the changes in amplitude and phase of the sound signal emitted by the second sound module transmitted to the far field region.

13. The method according to claim 12, characterized in that, The method further includes: Drive the second sound module to play the first frequency sweep signal; A second sweep frequency signal is acquired in the far-field region. The second sweep frequency signal is the sweep frequency signal transmitted from the second sound module to the far-field region by the first sweep frequency signal. The first transfer function is determined based on the second sweep frequency signal and the first sweep frequency signal.

14. The method according to claim 12, characterized in that, The step of determining the frequency domain expression of the second leakage signal in the far-field region through the control module includes: The comprehensive leakage expression of the second leakage signal is determined by the leakage synthesis function; Based on the second transfer function, the comprehensive transfer function expression of the second leaked sound signal is determined by the transmission path comprehensive function. The second transfer function is used to represent the mapping relationship between the leaked sound signal acquired by the sound acquisition module and the second leaked sound signal. Based on the comprehensive leaky tone expression and the comprehensive transfer function expression, the frequency domain expression of the second leaky tone signal is determined.

15. The method according to claim 14, characterized in that, The method further includes: The first and second sound modules are driven to simultaneously play the third sweep frequency signal; A third sound signal is acquired in the far-field region, and a fourth sound signal is acquired through the sound acquisition module. The third sound signal and the fourth sound signal are sound signals transmitted from the third sweep frequency signal to the far-field region and the near-field region. The second transmission function is determined based on the third and fourth audio signals.

16. The method according to claim 8, characterized in that, The step of determining a first control signal matching the first leaky sound signal based on a transfer function through the control module includes: The control module filters out signals with frequencies higher than a preset frequency from the first leaked sound signal. Based on the transfer function, a first control signal is determined that matches the filtered first leaky sound signal.

17. The method according to claim 8, characterized in that, The method further includes: Based on the first leaked sound signal, adjust the sound generation parameters; Based on the adjusted sound generation parameters, the second sound generation module is driven to emit the second sound signal.

18. A computer-readable storage medium, characterized in that, The storage medium stores at least one piece of program code, which is loaded and executed by a processor to implement the sound signal processing method according to any one of claims 8 to 17.

19. A computer program product, characterized in that, The computer program product stores at least one piece of program code, which is executed by a processor to implement the sound signal processing method according to any one of claims 8 to 17.

Images