Signal processing method and acoustic system

Abstract

The invention provides a signal processing method and an acoustic system, and the method comprises the steps: obtaining a first signal and a second signal, the first signal being obtained by collecting environment sound when a first sound sensor in a sound sensor module works, the second signal is obtained by collecting the environment sound when a second sound sensor in the sound sensor module works, and the environment sound at least comprises target sound emitted when the loudspeaker works, executing a first target operation on the first signal and the second signal, and a second target operation is carried out on the target signal so as to reduce the pickup of the target sound by the sound sensor module on the target frequency band and reduce the signal corresponding to the target sound picked by the sound sensor module, thereby obtaining the target signal and executing a second target operation on the target signal. According to the scheme, the signal component from the loudspeaker in the target signal can be reduced, so that the effect of suppressing howling or eliminating echo can be achieved.

Description

Signal processing method and acoustic system Technical Field

[0001] The present application relates to the field of acoustic technology, and in particular to a signal processing method and an acoustic system. Background Art

[0002] Some acoustic systems include both speakers and sound sensors. In these acoustic systems, the ambient sound collected by the sound sensor may include the sound emitted from the speaker, which is detrimental to the operation of the acoustic system. For example, when a hearing aid system is working, it collects ambient sound through a sound sensor, amplifies the ambient sound, and then plays it through the speaker to compensate for the wearer's hearing loss. When the sound emitted by the speaker is re-collected by the sound sensor, the acoustic system forms a closed loop. As a result, the sound emitted by the speaker is continuously amplified in the closed loop, causing howling in the acoustic system and making the wearer feel uncomfortable. For example, in a telephone system or conference system, the voice signal emitted by the remote user is played through the local speaker and is collected by the local sound sensor together with the voice emitted by the local user. It is then transmitted back to the remote end, so that the remote user is disturbed by the echo.

[0003] Summary of the Invention

[0004] The present application provides a signal processing method and an acoustic system, which can reduce the signal component from the loudspeaker in the target signal, thereby achieving the effect of suppressing howling or eliminating echo.

[0005] In a first aspect, the present application provides a signal processing method, comprising: obtaining, through a signal processing circuit: a first signal, wherein the first signal is obtained by collecting ambient sound when a first sound sensor in a sound sensor module is working, wherein the ambient sound includes at least a target sound, and the target sound is the sound output when a speaker is working; obtaining a second signal, wherein the second signal is obtained by collecting the ambient sound when a second sound sensor in the sound sensor module is working; performing a first target operation on the first signal and the second signal to reduce the sound sensor module's pickup of the target sound in a target frequency band and to reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal; and performing a second target operation on the target signal.

[0006] In some embodiments, the first target operation includes: a sound pickup control operation to direct the sound sensor module toward the speaker in the zero-point sound pickup direction of the target frequency band; and an adaptive filtering operation to reduce the signal corresponding to the target sound.

[0007] In some embodiments, the sound pickup control operation is performed by a sound pickup control circuit in the signal processing circuit, and the adaptive filtering operation is performed by an adaptive filtering circuit in the signal processing circuit.

[0008] In some embodiments, performing the first target operation on the first signal and the second signal includes: performing the sound pickup control operation on the first signal and the second signal to obtain a sound pickup control output signal; and obtaining the input signal of the speaker, and performing the adaptive filtering operation on the sound pickup control output signal based on the input signal to obtain the target signal.

[0009] In some embodiments, the adaptive filtering operation includes: providing a target gain to the input signal to obtain a third signal, wherein the target gain corresponds to a transfer function between the speaker and the sound sensor module; and subtracting the third signal from the sound pickup control output signal to obtain the target signal.

[0010] In some embodiments, performing the first target operation on the first signal and the second signal includes: obtaining an input signal of the speaker, and performing the adaptive filtering operation on the first signal and the second signal based on the input signal to obtain a first filtered signal corresponding to the first signal and a second filtered signal corresponding to the second signal; and performing the pickup control operation on the first filtered signal and the second filtered signal to obtain the target signal.

[0011] In some embodiments, the adaptive filtering operation includes: providing a first target gain to the input signal to obtain a fourth signal, and subtracting the fourth signal from the first signal to obtain the first filtered signal, wherein the first target gain corresponds to the transfer function between the speaker and the first sound sensor; and providing a second target gain to the input signal to obtain a fifth signal, and subtracting the fifth signal from the second signal to obtain the second filtered signal, wherein the second target gain corresponds to the transfer function between the speaker and the second sound sensor.

[0012] In some embodiments, the target frequency band corresponds to the sound pickup band of the sound sensor module; and the sound pickup control operation includes: a zero-point differential operation, performing zero-point differential on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module to point toward the speaker, thereby obtaining a differential result signal, wherein the first individual signal corresponds to the pickup signal of the first sound sensor, and the second individual signal corresponds to the pickup signal of the second sound sensor, and the differential result signal serves as the output signal of the sound pickup control operation.

[0013] In some embodiments, the sound pickup band of the sound sensor module includes a first frequency band and a second frequency band, and the target frequency band corresponds to the first frequency band; and the sound pickup control operation includes: a zero-point differential operation, performing zero-point differential on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module to point to the speaker, thereby obtaining a differential result signal, wherein the first individual signal corresponds to the pickup signal of the first sound sensor, and the second individual signal corresponds to the pickup signal of the second sound sensor; and a signal synthesis operation, synthesizing the differential result signal and the first individual signal to obtain a comprehensive signal, and the comprehensive signal serves as the output signal of the sound pickup control operation, wherein the component of the first frequency band in the comprehensive signal comes from the differential result signal, and the component of the second frequency band comes from the first individual signal.

[0014] In some embodiments, the signal synthesis operation includes: performing a first filtering on the first individual signal to obtain the component of the second frequency band in the first individual signal; performing a second filtering on the differential result signal to obtain the component of the first frequency band in the differential result signal; and synthesizing the component of the first frequency band with the component of the second frequency band to obtain the integrated signal.

[0015] In some embodiments, the first filtering and the second filtering are complementary filtering.

[0016] In some embodiments, the zero-point differential operation includes: a first delay operation, delaying the second individual signal to obtain a second delayed signal; a first differential operation, performing a differential operation on the first individual signal and the second delayed signal to obtain a first differential signal; and a gain compensation operation, performing gain compensation on at least part of the frequency band of the first differential signal to obtain the differential result signal.

[0017] In some embodiments, the zero-point differential operation includes: a first delay operation, delaying the second individual signal to obtain a second delayed signal; a second delay operation, delaying the first individual signal to obtain a first delayed signal; a first differential operation, performing a differential operation on the first individual signal and the second delayed signal to obtain a first differential signal; a second differential operation, performing a differential operation on the second individual signal and the first delayed signal to obtain a second differential signal; a third differential operation, performing a differential operation on the first differential signal and the second differential signal to obtain a third differential signal; and a gain compensation operation, performing gain compensation on the signal of at least part of the frequency band in the third differential signal to obtain the differential result signal.

[0018] In some embodiments, the zero-point differential operation also includes: a target parameter generation operation, which generates a target parameter with the goal of minimizing the signal component from the speaker in the third differential signal; and a multiplication operation, which is performed between the second differential operation and the third differential operation, multiplying the target parameter with the second differential signal to obtain a multiplication result, so that the third differential operation performs a differential operation on the first differential signal and the multiplication result to obtain the third differential signal.

[0019] In some embodiments, the second target operation includes: performing a gain amplification on the target signal and sending the gain-amplified signal to the speaker, so that the speaker emits the target sound.

[0020] In some embodiments, the speaker and the sound sensor module are deployed on a first acoustic device, the first acoustic device is communicatively connected to a second acoustic device; and the second target operation includes: sending the target signal to the second acoustic device to reduce the echo of the second acoustic device.

[0021] In a second aspect, the present application also provides an acoustic system, comprising: a speaker, a sound sensor module, and a signal processing circuit, wherein the speaker receives an input signal and outputs a target sound when in operation, and the sound sensor module comprises at least a first sound sensor and a second sound sensor, wherein the first sound sensor collects ambient sound and generates a first signal when in operation, and the second sound sensor collects the ambient sound and generates a second signal when in operation, and the ambient sound includes at least the target sound; the signal processing circuit is connected to the sound sensor module, and executes the method described in any one of the first aspects when in operation.

[0022] In some embodiments, the signal processing circuit includes: at least one storage medium storing at least one instruction set for signal processing; and a processor communicatively connected to the sound sensor module and the at least one storage medium, wherein, when the acoustic system is running, the processor reads the at least one instruction set and executes any one of the methods described in the first aspect according to the instructions of the at least one instruction set.

[0023] In some embodiments, the acoustic system is any one of a hearing aid system, a sound amplification system, a headphone system, a telephone system, and a conference system.

[0024] In some embodiments, the acoustic system is a hearing aid system, which further includes a shell, and the speaker, the sound sensor module and the signal processing circuit are arranged in the shell, wherein when the acoustic system is worn on the user's head, the sound output end of the speaker is facing the user's head, and the pickup end of at least one sound sensor in the sound sensor module is located on the side of the shell away from the user's head.

[0025] As can be seen from the above technical solution, the present application provides a signal processing method and acoustic system. The signal processing method includes: obtaining a first signal and a second signal, wherein the first signal is obtained by a first sound sensor in a sound sensor module collecting ambient sound when in operation, and the second signal is obtained by a second sound sensor in the sound sensor module collecting ambient sound when in operation, wherein the ambient sound includes at least a target sound emitted by an operating speaker; performing a first target operation on the first signal and the second signal to reduce the sound sensor module's pickup of the target sound in a target frequency band and attenuate the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal; and then performing a second target operation on the target signal. In the above solution, because the first target operation can, on the one hand, reduce the sound sensor module's pickup of the target sound, and, on the other hand, attenuate the signal corresponding to the target sound picked up by the sound sensor module, the obtained target signal contains no or minimal signal components from the speaker, thereby enabling the acoustic system to achieve the effect of suppressing howling or eliminating echoes.

[0026] Other functions of the signal processing method and acoustic system provided by the present application will be partially listed in the following description. The creative aspects of the signal processing method and acoustic system provided by the present application can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0028] FIG1 is a schematic diagram showing a howling scenario according to an embodiment of the present application;

[0029] FIG2 shows a schematic diagram of an echo scenario provided according to an embodiment of the present application;

[0030] FIG3A shows a schematic structural diagram of an acoustic system provided according to an embodiment of the present application;

[0031] FIG3B shows a logic diagram of an acoustic system provided according to an embodiment of the present application;

[0032] FIG4 shows a schematic diagram of a design of the acoustic system shown in FIG3A-3B ;

[0033] FIG5 shows a flow chart of a signal processing method provided according to an embodiment of the present application;

[0034] FIG6 shows a schematic diagram of a signal processing process provided according to an embodiment of the present application;

[0035] FIG7 shows a schematic diagram of another signal processing process provided according to an embodiment of the present application;

[0036] FIG8 shows a schematic diagram of a sound pickup control operation provided according to an embodiment of the present application;

[0037] FIG9 shows a schematic diagram of a zero-point differential operation provided according to an embodiment of the present application;

[0038] FIG10 is a schematic diagram showing a sound pickup direction pattern corresponding to the zero-point differential operation in FIG9 ;

[0039] FIG11 is a schematic diagram showing a frequency response curve of a first differential signal obtained by using the zero-point differential operation shown in FIG9 ;

[0040] FIG12 shows a schematic diagram of another zero-point differential operation provided according to an embodiment of the present application;

[0041] FIG13 is a schematic diagram showing the principle of adjusting the sound pickup direction corresponding to the zero-point differential operation in FIG12 ;

[0042] FIG14 is a schematic diagram showing the sound pickup direction patterns of the zero-point differential operation 41 b in FIG12 in three different scenarios;

[0043] FIG15 shows a schematic diagram of another zero-point differential operation provided according to an embodiment of the present application;

[0044] FIG16 shows a schematic diagram of adjusting the zero-point pickup direction using the target parameter β according to an embodiment of the present application;

[0045] FIG17 is a schematic diagram showing another sound pickup control operation provided according to an embodiment of the present application;

[0046] FIG18 is a schematic diagram showing another sound pickup control operation provided according to an embodiment of the present application;

[0047] FIG19 is a schematic diagram showing a frequency response curve corresponding to a set of complementary filtering operations provided according to an embodiment of the present application;

[0048] FIG20 is a schematic diagram showing the background noise components corresponding to the differential result signal and the integrated signal in FIG18 ;

[0049] FIG21 is a schematic diagram showing zero-point attenuation effects corresponding to different zero-point differential operations provided according to an embodiment of the present application; and

[0050] FIG22 shows a schematic diagram of yet another sound pickup control operation provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0051] The following description provides specific application scenarios and requirements of the present application, with the purpose of enabling those skilled in the art to make and use the content of this application. Various local modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this application. Therefore, this application is not limited to the embodiments shown, but is intended to be of the widest scope consistent with the claims.

[0052] The terms used herein are for the purpose of describing specific example embodiments only and are not intended to be limiting. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a," "an," and "the" may also include the plural forms. When used in this application, the terms "comprise," "include," and / or "contain" are meant to refer to the presence of associated integers, steps, operations, elements, and / or components, but do not exclude the presence of one or more other features, integers, steps, operations, elements, components, and / or groups or the addition of other features, integers, steps, operations, elements, components, and / or groups in the system / method.

[0053] With the following description in mind, these and other features of the present application, as well as the operation and function of the associated elements of the structure, and the economical assembly and manufacture of the components, can be significantly improved. Reference is made to the accompanying drawings, all of which form a part of this application. However, it should be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this application. It should also be understood that the drawings are not drawn to scale.

[0054] The flowcharts used in this application illustrate the operations of the system implementation according to some embodiments of the present application. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. Instead, the operations may be implemented in reverse order or simultaneously. In addition, one or more additional operations may be added to the flowcharts. One or more operations may be removed from the flowcharts.

[0055] For the convenience of description, the terms appearing in this application are first explained.

[0056] Howling: Howling is a common phenomenon in acoustic systems. The following describes the howling generation process with reference to Figure 1. Figure 1 shows a schematic diagram of a howling scenario 001 provided according to an embodiment of the present application. Howling scenario 001 can correspond to scenarios such as a sound amplification system and a hearing aid / assisted listening system. As shown in Figure 1, howling scenario 001 includes a speaker 110, a sound sensor 120-A, and a gain amplifier 130. When operating, sound sensor 120-A collects ambient sound. During this process, if speaker 110 is also playing sound simultaneously, the sound played by speaker 110 will also be collected by sound sensor 120-A. The ambient sound collected by sound sensor 120-A thus includes both the sound from target sound source 160 and the sound from speaker 110. Furthermore, the ambient sound is input into gain amplifier 130 for gain amplification and then played through speaker 110. This forms a closed "speaker-sound sensor-speaker" loop in the acoustic system. In this case, howling occurs when sound signals of certain frequencies self-oscillate. Such howling can make users feel uncomfortable and may even damage acoustic equipment when the howling is severe. In addition, the existence of the howling also limits the gain amplification factor of the gain amplifier 130, thereby restricting the maximum sound gain that the acoustic system 003 can achieve.

[0057] Echo: Echo is also a phenomenon that often occurs in acoustic systems. The process of generating echo is explained below in conjunction with Figure 2. Figure 2 shows a schematic diagram of an echo scene 002 provided according to an embodiment of the present application. The echo scene 002 can correspond to scenarios such as a telephone system, a conference system, and a voice call system. As shown in Figure 2, the echo scene 002 includes a local end and a remote end, wherein the local end includes a local user 140-A, a speaker 110-A, and a sound sensor 120-A, and the remote end includes a remote user 140-B, a speaker 110-B, and a sound sensor 120-B. The local end and the remote end can be connected through a network. The network is a medium for providing a communication connection between the local end and the remote end, which can facilitate the exchange of information or data between the two. In some embodiments, the network can be any type of wired or wireless network, or a combination thereof. For example, the network may include a cable network, a wired network, a fiber optic network, a telecommunications network, an intranet, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a wide area network (WAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, a near field communication (NFC) network, or the like. In some embodiments, the network may include one or more network access points. For example, the network may include a wired or wireless network access point, such as a base station or an Internet exchange point, through which a local end and a remote end can connect to the network to exchange data or information.

[0058] Continuing with Figure 2, during a call between local user 140-A and remote user 140-B, the remote voice emitted by remote user 140-B is collected by sound sensor 120-B and transmitted to the local end, where it is then played through local speaker 110-A. The remote voice played by speaker 110-A, along with the local voice emitted by local user 140-A, is collected by local sound sensor 120-A, then transmitted back to the remote end and played through remote speaker 110-B. As a result, remote user 140-B hears its own echo, which interferes with the call. It should be noted that Figure 2 illustrates the process in which remote user 140-B is disturbed by the echo. It should be understood that local user 140-A may also be disturbed by the echo. The echo generation process on the local end is similar to that described above and will not be elaborated upon here. Such an echo can interfere with the user's normal conversation.

[0059] Background noise: This refers to the ambient noise outside the sound source being measured. In this application, any sound that is unwelcome, unwanted, or disturbing to the user's hearing can be referred to as noise.

[0060] Pickup pattern: This refers to a pattern used to characterize the sensitivity of a sound sensor / sound sensor module to sounds coming from different directions. Simply put, the pickup pattern represents the ability of a sound sensor / sound sensor module to pick up sounds from different directions. Common pickup patterns include omnidirectional, cardioid, figure-8, and supercardioid.

[0061] Zero-point pickup direction: In theory, if the sensitivity of the sound sensor / sound sensor module to sounds in a certain direction is 0 or close to 0, then this direction is called the zero-point pickup direction. It should be understood that when the sound source is located in the zero-point pickup direction, the sound sensor / sound sensor module will not theoretically collect the sound emitted by the sound source. In actual situations, due to the manufacturing errors of the sound sensor / sound sensor module and the fact that the sound source in reality is not necessarily an ideal point, the sound sensor / sound sensor module can still collect less sound in the zero-point pickup direction. It should be noted that in the present application, the zero-point pickup direction can refer to a specific direction, or it can refer to a range of directions including multiple directions.

[0062] Far-field sound source: may refer to a sound source that is farther away from the sound sensor / sound sensor module. Generally speaking, when the distance between the sound source to be measured and the sound sensor / sound sensor module is greater than N times the physical size of the sound sensor / sound sensor module, the sound source can be approximately regarded as a far-field sound source. It should be noted that the value of N may be different in different application scenarios. For example, in the scenario of headphones, the physical size of the sound sensor / sound sensor module may be less than or equal to 0.01m, and the value of N may be greater than or equal to 10. That is to say, a sound source that is greater than or equal to 0.1m from the sound sensor / sound sensor module can be regarded as a far-field sound source. Compared with near-field sound sources, the sound waves of the far-field sound sources are approximately plane, and the amplitude of the sound waves decreases less with propagation.

[0063] Near-field sound source: It can refer to a sound source that is closer to the sound sensor / sound sensor module. Generally speaking, when the distance between the sound source to be measured and the sound sensor / sound sensor module is less than 2 to 3 times the physical size of the sound sensor / sound sensor module, the sound source can be approximately regarded as a far-field sound source. For example, in the scenario of headphones, the sound source with a distance of less than 0.1m can be considered a near-field sound source. Compared with the aforementioned far-field sound source, the sound wave of the near-field sound source is closer to a sphere, and the amplitude of the sound wave decreases more as it propagates.

[0064] Before describing the specific embodiments of the present application, the application scenarios of the present application are first introduced as follows: the signal processing method and acoustic system provided by the present application can be applied in scenarios where howling suppression is required (such as the scenario shown in FIG1 ), and can also be applied in scenarios where echo cancellation is required (such as the scenario shown in FIG2 ). In the above scenarios, the acoustic system collects ambient sound through a sound sensor module, and uses the signal processing method described in the present application to process the collected signal to generate a target signal, so as to reduce the signal component from the speaker in the target signal, thereby achieving the purpose of suppressing howling or canceling echoes.

[0065] It should be noted that the above-mentioned howling suppression and echo cancellation scenarios are only some of the multiple usage scenarios provided by this application. The signal processing method and acoustic system provided by this application can also be applied to other similar scenarios. Those skilled in the art should understand that the application of the signal processing method and acoustic system provided by this application to other usage scenarios is also within the scope of protection of this application.

[0066] Figure 3A shows a schematic diagram of the structure of an acoustic system 003 provided according to an embodiment of the present application; Figure 3B shows a logical diagram of an acoustic system 003 provided according to an embodiment of the present application. Acoustic system 003 may be a sound reinforcement system, a hearing aid / assisted hearing system, a telephone system, a conference system, or a voice call system, among others. As shown in Figures 3A-3B, acoustic system 003 may include: a speaker 110, a sound sensor module 120, and a signal processing circuit 150. Sound sensor module 120 includes at least a first sound sensor 120-1 and a second sound sensor 120-2.

[0067] It should be noted that in the acoustic system 003 shown in Figures 3A-3B, the physical position relationship between the speaker 110, the first sound sensor 120-1, and the second sound sensor 120-2 can be arbitrary, and Figures 3A-3B do not show the physical position relationship between the three. For example, in some embodiments, the speaker 110, the first sound sensor 120-1, and the second sound sensor 120-2 can be arranged in a straight line. For another example, in some embodiments, the speaker 110 can be located (or approximately located) on the perpendicular bisector of the first sound sensor 120-1 and the second sound sensor 120-2. In this case, the distance between the speaker 110 and the first sound sensor 120-1 is equal to (or approximately equal to) the distance between the speaker 110 and the second sound sensor 120-2. Of course, the speaker 110, the first sound sensor 120-1, and the second sound sensor 120-2 can also have other physical position relationships, which are not listed in this application.

[0068] In some embodiments, the acoustic system 003 is a hearing aid system, and the acoustic system 003 may further include a housing, and the speaker 110, the sound sensor module 120, and the signal processing circuit 150 may be arranged in the housing. The housing protects the components inside it and is convenient for the user to pick up and wear. The acoustic system 003 can be worn on the user's head. For example, the acoustic system 003 can be worn on the user's ear in an in-ear or hanging-ear manner. When the acoustic system 003 is worn on the user's head, the sound output end of the speaker 110 is directed toward the user's head, for example, toward the user's ear canal opening or toward the vicinity of the ear canal opening. The sound pickup end of at least one sound sensor in the sound sensor module 120 is located on the side of the housing away from the user's head. In this way, on the one hand, it is convenient to pick up ambient sound, and on the other hand, the pickup of the sound emitted by the speaker 110 can be minimized.

[0069] The first sound sensor 120-1 and the second sound sensor 120-2 can be the same sound sensor or different sound sensors. For ease of description, in this application, the sound sensor in the sound sensor module 120 that is closer to the speaker 110 is referred to as the second sound sensor 120-2, and the sound sensor that is farther away from the speaker 110 is referred to as the first sound sensor. That is, the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1. In this way, the sound emitted by the speaker 110 will be collected by the second sound sensor 120-2 first, and then by the first sound sensor 120-1. In this case, the phase of the signal component corresponding to the target sound in the second signal is earlier than the phase of the signal component corresponding to the target sound in the first signal. When the distance between the two sound sensors and the speaker 110 is equal, any one of them can be referred to as the first sound sensor 120-1, and the other can be referred to as the second sound sensor 120-2. In this case, the phase of the signal component corresponding to the target sound in the second signal is equal to the phase of the signal component corresponding to the target sound in the first signal. In addition, the speaker 110, the first sound sensor 120-1, and the second sound sensor 120-2 may be integrated into the same electronic device, or may be independent of each other, which is not limited in this application.

[0070] The speaker 110 can also be called an electroacoustic converter, which is a device for converting an electrical signal into a sound signal. For example, the speaker 110 can be a horn. When working, the speaker 110 receives an input signal and converts it into audio to play it out. Among them, the above-mentioned input signal refers to an electrical signal that carries sound information, and the above-mentioned audio refers to the sound played out by the speaker 110. In some embodiments, the input signal received by the speaker 110 can come from the sound sensor module 120. This situation can correspond to the acoustic scene shown in Figure 1. For example, after the sound sensor module 120 collects environmental sound and generates an electrical signal, the electrical signal is provided to the speaker 110 for playback, or the electrical signal is subjected to preset processing and then provided to the speaker 110 for playback, wherein the above-mentioned preset processing can include at least one of amplification processing, noise reduction processing, and enhancement processing. In some embodiments, the input signal received by the speaker 110 can also come from other electronic devices. This situation can correspond to the acoustic scene shown in Figure 2. For example, the acoustic system 003 can receive an input signal from a remote device and convert the input signal into audio through the speaker 110 for playback. Alternatively, the input signal can be subjected to a preset process and converted into audio for playback through the speaker 110. The preset process may include at least one of amplification, noise reduction, and enhancement. In some embodiments, the acoustic system 003 may include multiple speakers 110. In this case, the multiple speakers 110 may be arranged in an array, such as a linear array, a planar array, a spherical array, or other arrays.

[0071] The sound sensor (first sound sensor 120-1 and / or second sound sensor 120-2) can also be called an acoustic-to-electrical converter or a sound pickup device. It is a device for collecting sound and converting it into an electrical signal. For example, the sound sensor can be a microphone (MIC). When working, the sound sensor collects ambient sound and converts it into an electrical signal that carries sound information. Among them, the sound sensor can be an omnidirectional sound sensor, in which case the sound sensor can collect ambient sound from all directions. The sound sensor can also be a directional sound sensor, in which case the sound sensor can collect ambient sound from some directions.

[0072] Continuing to refer to Figures 3A-3B, in some embodiments, the acoustic system 003 can sense and process the sound from the target sound source 160. For example, the target sound source 160 can be an electronic device with a sound playback function (such as a TV, a speaker, a mobile phone, etc.). For another example, the target sound source 160 can also be a person's throat. In this case, the ambient sound includes both the sound from the target sound source 160 and the sound from the speaker 110. When the first sound sensor 120-1 is working, it collects the ambient sound and generates a first signal. The first signal includes the sound signal from the target sound source 160 and the sound signal from the speaker 110. When the second sound sensor 120-2 is working, it collects the ambient sound and generates a second signal. The second signal includes the sound signal from the target sound source 160 and the sound signal from the speaker 110. For ease of description, this application refers to the sound emitted by the speaker 110 as the target sound. In this way, the ambient sound includes at least the target sound, the first signal includes at least the signal corresponding to the target sound, and the second signal includes at least the signal corresponding to the target sound.

[0073] The signal processing circuit 150 is connected to the sound sensor module 120. As shown in Figures 3A-3B, the signal processing circuit 150 is connected to the first sound sensor 120-1 and the second sound sensor 120-2, respectively. In this way, the signal processing circuit 150 can obtain a first signal from the first sound sensor 120-1 and a second signal from the second sound sensor 120-2. Furthermore, the signal processing circuit 150 can perform a first target operation 40 on the first and second signals to reduce the sound sensor module 120's pickup of a target sound in a target frequency band and attenuate the signal corresponding to the target sound picked up by the sound sensor module 120, thereby obtaining a target signal. It should be understood that because the first target operation 40 can reduce the sound sensor module 120's pickup of the target sound in the target frequency band and attenuate the signal corresponding to the target sound picked up by the sound sensor module 120, the signal processing circuit 150 can reduce the signal component from the speaker 110 in the target signal by performing the first target operation 40. In some embodiments, "reducing the signal component from the speaker 110 in the target signal" means reducing the signal component from the speaker 110 in the target signal relative to the first signal and / or the second signal. That is, the signal component from the speaker 110 in the target signal is less than the signal component from the speaker 110 in the first signal and / or less than the signal component from the speaker 110 in the second signal. In some embodiments, "reducing the signal component from the speaker 110 in the target signal" may mean lowering the signal strength from the speaker 110 in the target signal relative to the first signal and / or the second signal. That is, the signal strength from the speaker 110 in the target signal is less than the signal strength from the speaker 110 in the first signal and / or less than the signal strength from the speaker 110 in the second signal.

[0074] Continuing to refer to Figures 3A-3B, after generating the target signal, the signal processing circuit 150 can perform a second target operation 50 on the target signal. In some embodiments, the second target operation 50 may include: performing gain amplification on the target signal and sending the gain-amplified signal (i.e., the input signal of the speaker 110) to the speaker 110, so that the speaker 110 converts it into the target sound. The above scheme can be applied to the howling suppression scenario as shown in Figure 1. It should be understood that since the signal processing circuit 150 reduces the pickup of the target sound by the sound sensor module 120 and reduces the signal corresponding to the target sound picked up by the sound sensor module 120, the signal component from the speaker 110 is reduced in the target signal (or the signal strength from the speaker 110 is reduced), thereby destroying the condition for the sound emitted by the speaker 110 to generate howling in the closed loop shown in Figure 1, thereby achieving the effect of suppressing howling.

[0075] In some embodiments, when the speaker 110, the sound sensor module 120 and the signal processing circuit 150 are deployed in the first acoustic device, the first acoustic device can be communicatively connected with the second acoustic device. In this case, the second target operation 50 may include: sending the target signal to the second acoustic device to reduce the echo of the second acoustic device. The above scheme can be applied to the echo cancellation scenario shown in Figure 2. For example, the first acoustic device can be a local device, and the second acoustic device can be a remote device. Since the signal component from the speaker is reduced in the target signal sent by the first acoustic device to the second acoustic device (or the signal strength from the speaker is reduced), it is equivalent to eliminating / reducing the sound from the second acoustic device. Therefore, when the second acoustic device receives the target signal and plays it, the user on the second acoustic device side (i.e., the remote user) will not hear the echo, thereby achieving the effect of echo cancellation.

[0076] The signal processing circuit 150 can be configured to perform the signal processing method described in this application. In some embodiments, the signal processing circuit 150 may include multiple hardware circuits with a connection relationship, each hardware circuit includes one or more electrical components, and when working, implements one or more steps in the signal processing method described in this application. The above multiple hardware circuits cooperate with each other to implement the signal processing method described in this application when working. In some embodiments, the signal processing circuit 150 may include a hardware device with data information processing functions and the necessary programs required to drive the hardware device to work. The hardware device implements the signal processing method described in this application by executing the programs. The signal processing method will be described in detail later.

[0077] FIG4 shows a schematic diagram of a design of an acoustic system 003. As shown in FIG4 , the signal processing circuit 150 may include: at least one storage medium 210 and at least one processor 220. The at least one processor 220 is communicatively connected to the speaker 110, the first sound sensor 120-1, and the second sound sensor 120-2. It should be noted that, for the purpose of illustration only, the signal processing circuit 150 in this application includes at least one storage medium 210 and at least one processor 220. It will be understood by those skilled in the art that the signal processing circuit 150 may also include other hardware circuit structures, which are not limited in this application, as long as they can meet the functions mentioned in this application without departing from the spirit of this application.

[0078] Continuing with FIG4 , in some embodiments, the acoustic system 003 may further include a communication port 230. The communication port 230 is used for data communication between the acoustic system and the outside world. For example, the communication port 230 may be used for data communication between the acoustic system and other devices / systems. In some embodiments, the acoustic system 003 may further include an internal communication bus 240. The internal communication bus 240 may connect different system components. For example, the speaker 110, the first sound sensor 120-1, the second sound sensor 120-2, the processor 220, the storage medium 210, and the communication port 230 may all be connected via the internal communication bus 240.

[0079] The storage medium 210 may include a data storage device. The data storage device may be a non-transitory storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk 2101, a read-only storage medium (ROM) 2102, or a random access storage medium (RAM) 2103. The storage medium 210 also includes at least one instruction set stored in the data storage device. The instruction set includes instructions, which are computer program codes. The computer program codes may include programs, routines, objects, components, data structures, processes, modules, etc. that execute the signal processing method provided in this application.

[0080] At least one processor 220 is used to execute the at least one instruction set mentioned above. When the acoustic system 003 is running, the at least one processor 220 reads the at least one instruction set and, according to the instructions of the at least one instruction set, executes the signal processing method provided in the present application. The processor 220 can perform all or part of the steps included in the above-mentioned signal processing method. The processor 220 can be in the form of one or more processors. In some embodiments, the processor 220 can include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof. For illustration purposes only, the acoustic system 003 shown in Figure 4 illustrates a case where only one processor 220 is included. However, it should be noted that the acoustic system 003 provided in the present application may also include multiple processors. Therefore, the operations and / or method steps disclosed in the present application may be performed by a single processor or jointly by multiple processors. For example, if the processor 220 of the acoustic system in the present application performs steps A and B, it should be understood that steps A and B may also be performed jointly or separately by two different processors 220 (e.g., the first processor performs step A, the second processor performs step B, or the first and second processors perform steps A and B together).

[0081] FIG5 shows a flow chart of a signal processing method according to an embodiment of the present application. The signal processing method P100 described in the present application can be applied to the acoustic system 003 as described above. Specifically, the signal processing circuit 150 can execute the signal processing method P100. As shown in FIG5 , the signal processing method P100 may include:

[0082] S310: Obtain a first signal, where the first signal is obtained by collecting ambient sound when a first sound sensor in the sound sensor module is working. The ambient sound at least includes a target sound, and the target sound is the sound output by the speaker when the speaker is working.

[0083] S320: Obtain a second signal, where the second signal is obtained when the second sound sensor in the sound sensor module collects the ambient sound when in operation.

[0084] The signal processing circuit 150 can obtain a first signal from the first sound sensor 120-1 and a second signal from the second sound sensor 120-2. As previously described, since the ambient sound includes both the sound emitted by the target sound source 160 and the target sound emitted by the speaker 110, the first signal and the second signal obtained by the signal processing circuit 150 both include signal components from the target sound source 160 and signal components from the speaker 110.

[0085] It should be noted that the present application does not limit the execution order of S310 and S320. The execution order of the two can be interchanged, or the two can be executed simultaneously.

[0086] S330: Perform a first target operation on the first signal and the second signal to reduce the pickup of the target sound by the sound sensor module in the target frequency band and reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal.

[0087] The signal processing circuit 150 can generate a target signal by performing a first target operation 40 on the first signal and the second signal. The first target operation 40 can play the following two roles:

[0088] On the one hand, the signal processing circuit 150 can reduce the sound sensor module 120's pickup of the target sound (i.e., the sound from the speaker 110) in the target frequency band by performing the first target operation 40 on the first signal and the second signal. "Reducing the sound sensor module's pickup of the target sound in the target frequency band" means that, compared to the sound sensor module 120's pickup of the target sound when the first target operation 40 is not performed, the sound sensor module 120's pickup of the target sound is reduced when the first target operation 40 is performed.

[0089] In some embodiments, the first target operation 40 may direct the zero-point pickup direction of the sound sensor module 120 in the target frequency band toward the speaker. The above-mentioned "zero-point pickup direction is directed toward the speaker" should be understood as the zero-point pickup direction generally pointing toward the speaker. For example, the zero-point pickup direction may point to the center point of the speaker. For another example, the zero-point pickup direction may point to any point on the sound emitting surface of the speaker. For another example, the zero-point pickup direction may point to a preset area on the sound emitting surface of the speaker. For another example, assuming that the direction angle corresponding to the center point of the speaker is θ, the direction angle corresponding to the zero-point pickup direction may be located at It should be understood that when the null-point pickup direction of the sound sensor module 120 points toward the speaker, the sound emitted by the speaker is not collected by the sound sensor module 120, or is less collected by the sound sensor module 120. Therefore, the signal processing circuit 150 can reduce the sound sensor module 120's pickup of the target sound by pointing the null-point pickup direction of the sound sensor module 120 in the target frequency band toward the speaker.

[0090] It should be noted that the above-mentioned target frequency band can be a full frequency band or a partial frequency band. For example, the full frequency band can refer to the audio pickup band of the sound sensor module, and the partial frequency band can refer to a sub-frequency band in the audio pickup band of the sound sensor module. The audio pickup band refers to the frequency band range of the picked-up sound supported by the sound sensor module when it is working. It should be noted that when the target frequency band is a partial frequency band, the target frequency band can correspond to any sub-frequency band in the audio pickup band of the sound sensor module, for example, it can correspond to a high-frequency sub-frequency band in the audio pickup band, it can also correspond to a low-frequency sub-frequency band in the audio pickup band, it can also correspond to a medium-frequency sub-frequency band in the audio pickup band, etc.

[0091] On the other hand, the signal processing circuit 150 can also reduce the signal corresponding to the target sound picked up by the sound sensor module 120 by performing the first target operation 40 on the first signal and the second signal. Here, "the signal corresponding to the target sound" refers to the signal component from the speaker picked up by the sound sensor module 120. In some embodiments, the signal processing circuit 150 can reduce the signal corresponding to the target sound picked up by the sound sensor module 120 by filtering the signal picked up by the sound sensor module 120. It is easy to understand that by reducing the signal picked up by the sound sensor module 120, the signal processing circuit 150 can reduce the signal component from the speaker 110 in the target signal.

[0092] Thus, the first target operation 40 can, on the one hand, minimize the sound sensor module 120's pickup of the target sound (i.e., minimize or minimize the sound emitted by the speaker by the sound sensor module 120), and on the other hand, reduce the signal corresponding to the target sound picked up by the sound sensor module 120. By combining these two functions, the signal processing circuit 150 can minimize the signal component from the speaker in the target signal.

[0093] FIG6 shows a schematic diagram of a signal processing process provided according to an embodiment of the present application, and FIG7 shows a schematic diagram of another signal processing process provided according to an embodiment of the present application. As shown in FIG6 and FIG7, the first target operation 40 may include a sound pickup control operation 43 and an adaptive filtering operation 44. The sound pickup control operation 43 is configured to point the zero-point pickup direction of the sound sensor module 120 in the target frequency band toward the speaker to reduce the pickup of the target sound by the sound sensor module 120. The adaptive filtering operation 44 is configured to reduce the signal corresponding to the target sound picked up by the sound sensor module 120. In some embodiments, the adaptive filtering operation 44 can adaptively reduce the signal from the speaker 110 from the signal picked up by the sound sensor module 120 based on the input signal of the speaker 110. In this case, the above-mentioned adaptive filtering operation 44 can be implemented by an adaptive feedback cancellation (AFC) algorithm.

[0094] In some embodiments, the aforementioned sound pickup control operation 43 and / or adaptive filtering operation 44 can be implemented by the processor 220 in the signal processing circuit 150. That is, the processor 220 executes an instruction set and performs the sound pickup control operation 43 and / or adaptive filtering operation 44 according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a sound pickup control circuit, and the aforementioned sound pickup control operation 43 can be implemented by the sound pickup control circuit. In some embodiments, the signal processing circuit 150 may include an adaptive filtering circuit, and the aforementioned adaptive filtering operation 44 can be implemented by the adaptive filtering circuit.

[0095] In some embodiments, as shown in FIG6 , the signal processing circuit 150 may first perform the sound pickup control operation 43 and then perform the adaptive filtering operation 44. Specifically, the process of the signal processing circuit 150 performing the first target operation 40 may include:

[0096] (1) Performing a sound pickup control operation 43 on the first signal and the second signal to direct the sound sensor module 120 toward the speaker in a zero-point sound pickup direction of a target frequency band, thereby obtaining a sound pickup control output signal.

[0097] By executing the sound pickup control operation 43, the signal processing circuit 150 can adjust the null pickup direction of the sound sensor module 120 in the target frequency band to point toward the speaker 110. In this case, the single-channel signal picked up by the sound sensor module 120 is referred to as the sound pickup control output signal. It should be understood that when the null pickup direction of the sound sensor module 120 in the target frequency band points toward the speaker 110, the sound sensor module 120 can reduce its pickup of the target sound in the target frequency band. As a result, the sound pickup control output signal contains fewer signal components from the speaker 110. It should be noted that the specific implementation of the sound pickup control operation 43 will be described in detail later and will not be elaborated on here.

[0098] (2) Obtaining an input signal of the loudspeaker, and performing an adaptive filtering operation 44 on the sound pickup control output signal based on the input signal to obtain the target signal.

[0099] Since the target sound is emitted by the speaker 110 based on the input signal, the signal processing circuit 150 can predict the sound sensor module 120's pickup of the target sound based on the input signal, and then adaptively filter the sound pickup control output signal based on the pickup status to obtain the target signal. This further reduces the signal component from the speaker 110 in the target signal.

[0100] In some embodiments, referring to FIG. 6 , the process of the signal processing circuit 150 performing the adaptive filtering operation 44 may include: providing a target gain to the input signal. A third signal (i.e., a signal corresponding to the target sound) is obtained, and the target signal is obtained by subtracting the third signal from the sound pickup control output signal. For example, assuming that the input signal is u and the sound pickup control output signal is y, the target signal s can be expressed as follows:

[0101] The target gain corresponds to the transfer function between the speaker 110 and the sound sensor module 120. Assuming that the transfer function between the speaker 110 and the sound sensor module 120 is F, the signal processing circuit 150 can predict the transfer function F to obtain a predicted transfer function, and determine the predicted transfer function as the target gain. In this way, by providing a target gain to the input signal, it is possible to simulate the situation in which the target sound is picked up by the sound sensor module 120. Furthermore, considering that the transfer function F between the speaker 110 and the sound sensor module 120 is constantly changing due to factors such as the environment and user actions, a preset algorithm can be used in some embodiments to adjust the target gain. Perform adaptive updates so that the target gain Continuously track the transfer function F (i.e. target gain With the change of transfer function F), so that based on the input signal u and the target gain The third signal obtained More precisely, the third signal It can more accurately characterize the target sound pickup result of the sound sensor module 120. It should be noted that the present application does not limit the preset algorithm. For example, the least mean square (LMS) algorithm, the normalized least mean square (NLMS) algorithm, the recursive least square (RLS) algorithm, etc. can be used.

[0102] In some embodiments, as shown in FIG7 , the signal processing circuit 150 may also first perform the adaptive filtering operation 44 and then perform the sound pickup control operation 43. Specifically, the process of the signal processing circuit 150 performing the first target operation 40 may include:

[0103] (1) Obtaining an input signal of the speaker, and performing the adaptive filtering operation 44 on the first signal and the second signal based on the input signal to obtain a first filtered signal corresponding to the first signal and a second filtered signal corresponding to the second signal.

[0104] Because the target sound is emitted by the speaker 110 based on the input signal, the signal processing circuit 150 can predict, based on the input signal, how the first sound sensor 120-1 and the second sound sensor 120-2 pick up the target sound, and then adaptively filter the first and second signals based on the pickup conditions to obtain first and second filtered signals. In other words, the first filtered signal can be considered a signal obtained by reducing the signal component from the speaker 110 in the first signal, and the second filtered signal can be considered a signal obtained by reducing the signal component from the speaker 110 in the second signal. Therefore, the first and second filtered signals contain fewer signal components from the speaker 110.

[0105] In some embodiments, referring to FIG. 7 , the process of the signal processing circuit 150 performing the adaptive filtering operation 44 may include providing a first target gain to the input signal. Obtain a fourth signal, and subtract the fourth signal from the first signal to obtain a first filtered signal, and provide a second target gain for the input signal A fifth signal is obtained, and the fifth signal is subtracted from the second signal to obtain a second filtered signal. For example, assuming that the input signal is u, the first signal is y1, and the second signal is y2, the first filtered signal s1 and the second filtered signal s2 can be expressed by the following formula:

[0106] Among them, the first target gain Corresponding to the transfer function between the speaker 110 and the first sound sensor 120-1, the second target gain Corresponding to the transfer function between the speaker 110 and the second sound sensor 120-2. It should be understood that the first target gain and the second target gain Determination method and target gain The method of determining is similar and will not be described here.

[0107] (2) Performing a sound pickup control operation 43 on the first filtered signal and the second filtered signal to obtain the target signal.

[0108] The signal processing circuit 150 performs the sound pickup control operation 43 on the first filtered signal and the second filtered signal to adjust the null pickup direction of the sound sensor module 120 in the target frequency band to point toward the speaker 110. It should be understood that when the null pickup direction of the sound sensor module 120 in the target frequency band points toward the speaker 110, the sound sensor module 120 can reduce pickup of the target signal in the target frequency band, thereby further reducing the signal component from the speaker 110 contained in the target signal.

[0109] FIG6 and FIG7 above only illustrate the specific implementation of the adaptive filtering operation 44, and do not illustrate the implementation of the sound pickup control operation 43. The specific implementation of the sound pickup control operation 43 is described in detail below with reference to FIG8 through FIG22. It should be understood that any of the sound pickup control operations 43 described below can be applied to both FIG6 and FIG7.

[0110] FIG8 illustrates a schematic diagram of a sound pickup control operation 43a provided according to an embodiment of the present application. As shown in FIG8 , the sound pickup control operation 43a may include a zero-point differential operation 41, which is configured to perform a zero-point differential on a first individual signal and a second individual signal to adjust the zero-point sound pickup direction of the sound sensor module 120 toward the speaker 110, thereby obtaining a differential result signal. The first individual signal and the second individual signal are the two input signals for the sound pickup control operation 43a. The first individual signal corresponds to the signal picked up by the first sound sensor 120-1, and may be, for example, the original signal picked up by the first sound sensor 120-1, or a signal after a preset processing has been performed on the original signal. The second individual signal corresponds to the signal picked up by the second sound sensor 120-2, and may be, for example, the original signal picked up by the second sound sensor 120-2, or a signal after a preset processing has been performed on the original signal. In some embodiments, when the sound pickup control operation 43a is applied to FIG6 , the first individual signal may be the first signal, and the second individual signal may be the second signal. In some embodiments, when the sound pickup control operation 43a is applied to FIG. 7 , the first individual signal can be a first filtered signal, and the second individual signal can be a second filtered signal. The differential result signal serves as the output signal of the sound pickup control operation 43a. The aforementioned "zero-point differential" refers to a differential operation that can adjust the zero-point sound pickup direction of the sound sensor module 120. It should be noted that this application does not limit the specific method of the differential operation; as long as the zero-point sound pickup direction of the sound sensor module 120 can be adjusted, it will be sufficient.

[0111] FIG9 illustrates a schematic diagram of a zero-point differential operation 41a according to an embodiment of the present application. As shown in FIG9 , the zero-point differential operation 41a may include a first delay operation 411 and a first differential operation 413. The first delay operation 411 is configured to delay the second individual signal to obtain a second delayed signal. The first differential operation 413 is configured to differentially perform a first differential signal on the first individual signal and the second delayed signal (e.g., subtract the first individual signal from the second delayed signal) to obtain a first differential signal.

[0112] The zero-point differential operation 41a shown in FIG9 can be applied to a scenario where the speaker 110 is a far-field sound source. In this scenario, the distance between the speaker 110 and the sound sensor module 120 is relatively large. It can be assumed that the amplitude and direction of the sound signals collected by the two sound sensors are the same, and there is only a time difference (i.e., a phase difference) between the two. In this case, when the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1, the sound emitted by the speaker 110 is first collected by the second sound sensor 120-2 and then by the first sound sensor 120-1. In other words, the phase of the signal component from the speaker 110 in the second individual signal precedes the phase of the signal component from the speaker 110 in the first individual signal. Therefore, by performing the first delay operation 411 (i.e., delaying the second individual signal to obtain the second delayed signal), the signal processing circuit 150 can align the phase of the signal component from the speaker 110 in the second delayed signal with the phase of the signal component from the speaker 110 in the first individual signal.

[0113] In some embodiments, when the signal processing circuit 150 performs the first delay operation 411 , it may determine the delay duration T corresponding to the second individual signal based on the following formula (4): T=d / c Formula (4)

[0114] Wherein, d is the distance between the first sound sensor 120 - 1 and the second sound sensor 120 - 2 , and c is the speed of sound.

[0115] After performing the above-mentioned first delay operation 411, since the phase of the signal component from the loudspeaker 110 in the second delayed signal is aligned with the phase of the signal component from the loudspeaker 110 in the first body signal, the signal processing circuit 150 can perform the first differential operation 413 (i.e., subtract the first body signal from the second delayed signal) to make the signal component from the loudspeaker 110 in the first body signal and the signal component from the loudspeaker 110 in the second delayed signal cancel each other out, so that the obtained first differential signal presents a pickup zero-point characteristic in the direction of the loudspeaker 110.

[0116] Figure 10 shows a schematic diagram of the sound pickup direction pattern corresponding to the zero-point differential operation 41a in Figure 9 . As shown in Figure 10 , the sound sensor module 120 exhibits a sound pickup null characteristic in the 180-degree direction. When the speaker 110 is located at or near the 180-degree direction, the sound sensor module 120 will not (or will rarely) pick up the sound emitted by the speaker 110. Thus, the zero-point differential operation 41a shown in Figure 9 can adjust the sound pickup direction pattern of the sound sensor module 120 to a cardioid shape, with the null-point pickup direction pointing toward the speaker 110. Therefore, the first differential signal obtained after the signal processing circuit 150 performs the zero-point differential operation 41a shown in Figure 7 on the first individual signal and the second individual signal does not contain (or contains relatively few) signal components from the speaker 110.

[0117] Furthermore, the inventors analyzed and experimented with the zero-point differential operation 41a in FIG9 and found that the zero-point differential operation 41a has an attenuation effect on components in some frequency bands. This is illustrated below with reference to FIG11 . FIG11 shows a schematic diagram of the frequency response curve of the first differential signal obtained by using the zero-point differential operation 41a shown in FIG9 . As shown in FIG11 , curve 1 represents the frequency response curve corresponding to the first differential signal in the 0-degree direction, and curve 2 represents the frequency response curve corresponding to the first differential signal in the 90-degree direction. It can be seen from curves 1 and 2 that the components of the first differential signal in some frequency bands (for example, below 1000 Hz) are attenuated, that is, the sensitivity of the sound sensor module 120 to the sound signals in these frequency bands is low.

[0118] Therefore, in some embodiments, referring again to FIG9 , the zero-point differential operation 41a may further include a gain compensation operation 416 . The gain compensation operation 416 is configured to perform gain compensation on at least a portion of the frequency band of the first differential signal to obtain a sound pickup result signal. For example, gain compensation can be performed on components in the first differential signal with attenuation in the frequency band (e.g., below 1000 Hz), so that the sound sensor module 120 also has a high sensitivity to sound signals in this frequency band. Referring again to FIG11 , Curve 3 shows the frequency response curve of the compensated first differential signal (i.e., the differential result signal) at 0 degrees, and Curve 4 shows the frequency response curve of the compensated first differential signal (i.e., the differential result signal) at 90 degrees. Thus, by performing the gain compensation operation 416 (i.e., performing gain compensation on at least a portion of the frequency band of the first differential signal), the signal processing circuit 150 enables the sound sensor module 120 to have a high and relatively flat sensitivity to sound signals across the entire frequency band.

[0119] As mentioned above, the zero-point differential operation 41a shown in Figure 9 is applicable to the scenario where the loudspeaker 110 is a far-field sound source. During the research process of the inventor, it was found that when the distance between the loudspeaker 110 and the sound sensor module 120 is close (for example, less than or equal to 0.1m), the above-mentioned far-field assumption (that is, the amplitude and direction of the sound signals collected by the two sound sensors are the same, and there is only a time difference between the two) is no longer valid. Therefore, for the near-field sound source scenario, if the zero-point differential operation 41a shown in Figure 9 is used to adjust the pickup direction, the adjusted pickup direction pattern no longer has a pickup zero point. To this end, the present application also provides another zero-point differential operation, which can be applied to both scenarios where the loudspeaker 110 is a far-field sound source and where the loudspeaker 110 is a near-field sound source. This will be explained below in conjunction with Figure 12.

[0120] Figure 12 shows a schematic diagram of another zero-point differential operation 41b provided according to an embodiment of the present application. As shown in Figure 12, the zero-point differential operation 41b may include: a first delay operation 411, a second delay operation 412, a first differential operation 413, a second differential operation 414, and a third differential operation 415.

[0121] Among them, the first delay operation 411 is configured to delay the second individual signal to obtain a second delayed signal. In some embodiments, the delay length of the second individual signal can be determined based on the aforementioned formula (4), which is not described here. The second delay operation 412 is configured to delay the first individual signal to obtain a first delayed signal. In some embodiments, the delay length of the first individual signal can be determined based on the aforementioned formula (4), which is not described here. The first differential operation 413 is configured to perform a differential operation on the first individual signal and the second delayed signal (i.e., subtract the first individual signal from the second delayed signal) to obtain a first differential signal. The second differential operation 414 is configured to perform a differential operation on the second individual signal and the first delayed signal (i.e., subtract the second individual signal from the first delayed signal) to obtain a second differential signal. The third differential operation 415 is configured to perform a differential operation on the first differential signal and the second differential signal (i.e., subtract the first differential signal from the second differential signal) to obtain a third differential signal.

[0122] It should be understood that the principle of adjusting the sound pickup direction of the zero-point differential operation 41b shown in FIG12 is similar to that of FIG9 . The difference between the two is that the zero-point differential operation 41b in FIG12 requires two delay operations. Therefore, the scheme shown in FIG9 can be referred to as a single-delay zero-point differential scheme, while the scheme shown in FIG12 can be referred to as a double-delay zero-point differential scheme. FIG13 shows a schematic diagram of the sound pickup direction adjustment principle corresponding to the zero-point differential operation 41b in FIG12 . As shown in FIG13 , the signal processing circuit 150 can generate a cardioid pattern with a zero-point pickup direction pointing to 180 degrees (see pattern I in FIG13 ) by performing a first delay operation 411 and a first differential operation 413. This construction principle is the same as that of FIG9 and will not be further described here. Furthermore, the signal processing circuit 150 can generate a cardioid pattern with a zero-point pickup direction pointing to 0 degrees (see pattern II in FIG13 ) by performing a second delay operation 412 and a second differential operation 414. This construction principle is also similar to that of FIG9 and will not be further described here. It should be understood that the cardioid pattern with the null-point pickup direction pointing to 180 degrees (i.e., pattern I) in FIG13 corresponds to the first differential signal, and the cardioid pattern with the null-point pickup direction pointing to 0 degrees (i.e., pattern II) corresponds to the second differential signal. The signal processing circuit 150 can obtain an 8-shaped pattern with the null-point pickup direction pointing to 90 degrees and 270 degrees (see pattern III in FIG13 ) by performing the third differential operation 415 (equivalent to taking the difference between pattern I and pattern II).

[0123] As can be seen from the aforementioned figure-eight sound pickup direction pattern (i.e., pattern III), the sound sensor module 120 exhibits a sound pickup null-point characteristic at 90 and 270 degrees. When the speaker 110 is located at or near the 90 / 270 degree direction, the sound sensor module 120 does not pick up (or only picks up very little) sound emitted by the speaker 110. Therefore, the double-delay-based zero-point differential operation 41b shown in FIG12 can adjust the sound pickup direction pattern of the sound sensor module 120 into a figure-eight shape, with the null-point sound pickup direction pointing toward the speaker 110. Therefore, the third differential signal obtained by the signal processing circuit 150 through the zero-point differential operation 41b contains no (or very little) signal components from the speaker 110.

[0124] FIG14 illustrates schematic diagrams of the sound pickup direction patterns of the zero-point differential operation 41b in FIG12 under three different scenarios. As shown in FIG14 , Pattern I illustrates the sound pickup direction pattern obtained when the distance between the speaker 110 and the sound sensor module 120 is 1 meter, Pattern II illustrates the sound pickup direction pattern obtained when the distance between the speaker 110 and the sound sensor module 120 is 0.1 meter, and Pattern III illustrates the sound pickup direction pattern obtained when the distance between the speaker 110 and the sound sensor module 120 is 0.06 meter. As can be seen from FIG14 , regardless of the distance between the speaker 110 and the sound sensor module 120, the zero-point differential operation 41b shown in FIG12 can produce an 8-shaped sound pickup direction pattern. Therefore, the zero-point differential operation 41b shown in FIG12 can be applied to scenarios where the speaker 110 is a near-field sound source, as well as scenarios where the speaker 110 is a far-field sound source. Therefore, the zero-point differential operation 41 b shown in FIG. 12 can effectively reduce the signal component from the speaker 110 in the third differential signal in all scenarios.

[0125] Furthermore, referring to FIG12 , the zero-point differential operation 41b may also include a gain compensation operation 416. Gain compensation operation 416 is configured to perform gain compensation on at least a portion of the frequency band of the third differential signal to produce a sound pickup result signal. It should be understood that the principles and functions of gain compensation operation 416 in FIG12 are the same as those of gain compensation operation 416 in FIG9 , and are not further described here.

[0126] When using the zero-point differential operation 41b shown in FIG12 , the sound pickup null direction of the sound sensor module 120 points at 90 degrees and 270 degrees. That is, each position on the perpendicular midline between the first sound sensor 120-1 and the second sound sensor 120-2 lies in the sound pickup null direction of the sound sensor module 120. Therefore, during product design, the speaker 110 can be positioned on the perpendicular midline between the first sound sensor 120-1 and the second sound sensor 120-2, thereby eliminating the signal component from the speaker 110 from the sound pickup signal of the sound sensor module 120. However, in actual use, due to various factors such as product form, production tolerances, and wearing posture, the speaker 110 is often not positioned strictly on the perpendicular midline between the first sound sensor 120-1 and the second sound sensor 120-2. As a result, the signal component from the speaker 110 is reduced in the sound pickup signal of the sound sensor module 120 compared to a sound pickup signal without the zero-point differential operation, but the signal component from the speaker 110 is still present. To this end, the present application also provides another zero-point differential operation that can adaptively adjust the zero-point sound pickup direction so that the signal component from the loudspeaker 110 in the sound pickup result signal is minimized. This will be explained below with reference to FIG15 .

[0127] FIG15 shows a schematic diagram of another zero-point differential operation 41c provided according to an embodiment of the present application. As shown in FIG15 , based on the zero-point differential operation 41b shown in FIG12 , the zero-point differential operation 41c may further include a multiplication operation 417 and a target parameter generation operation 418. The target parameter generation operation 418 is configured to generate a target parameter β with the goal of minimizing the signal component from the speaker 110 in the third differential signal. The multiplication operation 417 is performed between the second differential operation 414 and the third differential operation 415, or between the first differential operation 413 and the third differential operation 415. For ease of description, in the following text of this application and in the accompanying drawings, “the multiplication operation 417 is performed between the second differential operation 414 and the third differential operation 415” is used as an example for illustration. Specifically, the multiplication operation 417 is configured to multiply the target parameter β with the second differential signal to obtain a multiplication result, so that the third differential operation 415 performs a differential operation on the first differential signal and the multiplication result to obtain the third differential signal.

[0128] It should be understood that the second differential signal corresponds to pattern II in FIG13 (i.e., a cardioid pattern with the null pickup direction pointing at 0 degrees). The signal processing circuit 150 adjusts the second differential signal by multiplying the target parameter β with the second differential signal. Furthermore, based on the first differential signal and the adjusted second differential signal, a third differential operation 415 is performed to adjust the null pickup direction from 90 degrees / 270 degrees to other angles. FIG16 shows a schematic diagram of adjusting the null pickup direction using the target parameter β according to an embodiment of the present application. As shown in FIG16, when the target parameter β is set to 0.99, the null points in the pickup direction pattern point to 90 degrees and 270 degrees. When the target parameter β is updated to 0.16, the null points in the pickup direction pattern point to 135 degrees and 225 degrees. Thus, the signal processing circuit 150 can adaptively adjust the null pickup direction by performing the multiplication operation 417 and the target parameter generation operation 418, so that the signal component from the speaker 110 is minimized in the pickup result signal.

[0129] It should be noted that the various zero-point differential operations 41 involved in this application (such as the zero-point differential operation 41a shown in Figure 9, the zero-point differential operation 41b shown in Figure 12, and the zero-point differential operation 41c shown in Figure 15) can be performed in the time domain or in the frequency domain, and this application does not limit this.

[0130] In some embodiments, any one or more of the first delay operation 411, the second delay operation 412, the first differential operation 413, the second differential operation 414, the third differential operation 415, the gain compensation operation 416, the multiplication operation 417, and the target parameter generation operation 418 can be implemented by the processor 220 in the signal processing circuit 150, i.e., the processor 220 executes an instruction set and performs one or more of the above operations according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a first delay circuit, and the first delay operation 411 may be implemented by the first delay circuit. In some embodiments, the signal processing circuit 150 may include a second delay circuit, and the second delay operation 412 may be implemented by the second delay circuit. In some embodiments, the signal processing circuit 150 may include a first differential circuit, and the first differential operation 413 may be implemented by the first differential circuit. In some embodiments, the signal processing circuit 150 may include a second differential circuit, and the second differential operation 414 may be implemented by the second differential circuit. In some embodiments, the signal processing circuit 150 may include a third differential circuit, and the third differential operation 415 described above may be implemented by the third differential circuit. In some embodiments, the signal processing circuit 150 may include a gain compensation circuit, and the gain compensation operation 416 described above may be implemented by the gain compensation circuit. In some embodiments, the signal processing circuit 150 may include a multiplication circuit, and the multiplication operation 417 described above may be implemented by the multiplication circuit. In some embodiments, the signal processing circuit 150 may include a target parameter generation circuit, and the target parameter generation operation 418 described above may be implemented by the target parameter generation circuit.

[0131] The zero-point differential operation 41 described above performs zero-point differential within the full frequency band of the first individual signal and the second individual signal (i.e., the audio pickup band of the sound sensor module 120). Therefore, the zero-point differential operation 41 can point the zero-point pickup direction of the sound sensor module 120 within the full frequency band toward the speaker. As can be seen, the sound pickup control operation 43a shown in FIG8 can reduce the pickup of the target sound across the full frequency band. In some embodiments, the signal processing circuit 150 can also reduce the pickup of the target sound in some frequency bands. In this case, the sound pickup control operation 43b shown in FIG17 can be adopted. This will be explained below in conjunction with FIG17. For ease of description, it is assumed in the following text that the audio pickup band of the sound sensor module 120 includes a first frequency band and a second frequency band, wherein the target frequency band corresponds to the first frequency band, that is, the signal processing circuit 150 reduces the pickup of the target sound in the first frequency band.

[0132] FIG17 shows a schematic diagram of another sound pickup control operation 43b provided according to an embodiment of the present application. As shown in FIG17 , the sound pickup control operation 43b may include: a zero-point differential operation 41 and a signal synthesis operation 42. The zero-point differential operation 41 is configured to perform zero-point differential on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module 120 to point toward the speaker 110, thereby obtaining a differential result signal. It should be understood that the zero-point differential operation 41 in FIG17 may adopt the zero-point differential operation 41a shown in FIG9 , the zero-point differential operation 41b shown in FIG12 , or the zero-point differential operation 41c shown in FIG15 . For details, please refer to the description of the relevant part above, which will not be repeated here.

[0133] The signal synthesis operation 42 is configured to synthesize the differential result signal and the first individual signal to obtain a composite signal, wherein the component of the first frequency band in the composite signal comes from the differential result signal, and the component of the second frequency band comes from the first individual signal or the second individual signal. Since the first individual signal and the second individual signal have not undergone the zero-point differential operation 41, compared with the differential result signal, the first individual signal and the second individual signal can more accurately reflect certain characteristics of the real environment sound (such as the background noise characteristics). Therefore, when the signal of the second frequency band comes from the first individual signal or the second individual signal, the composite signal retains the components of the original signal, so that the composite signal can more accurately reflect the characteristics of the real environment sound. It can be understood that when the signal of the first frequency band in the composite signal comes from the differential result signal and the signal of the second frequency band comes from the first individual signal or the second individual signal, since the composite signal retains the components of the original signal and reduces the signal components from the speaker 110, the composite signal can reduce the signal components from the speaker 110 while reflecting the real environment sound as accurately as possible, thereby improving the accuracy of the composite signal. For ease of description, the following description uses the example of the signal of the second frequency band coming from the first individual signal. It should be understood that when the signal of the second frequency band comes from the second individual signal, its implementation method is similar, and this application will not elaborate on this.

[0134] As can be seen from the foregoing description, the zero-point differential operation 41 (e.g., zero-point differential operation 41a shown in FIG9 , zero-point differential operation 41b shown in FIG12 , and zero-point differential operation 41c shown in FIG15 ) all include a gain compensation operation 416. This gain compensation operation 416 inevitably causes the noise floor components in certain frequency bands of the sound pickup signal to be boosted. When the noise floor is boosted to a certain sound intensity, it can affect the user's auditory experience. Therefore, in some embodiments, the second frequency band may include the frequency band corresponding to the current environment's noise floor, and the first frequency band includes frequency bands other than the second frequency band. Thus, when the component of the second frequency band (i.e., the frequency band corresponding to the noise floor) in the integrated signal comes from the first individual signal, and the component of the first frequency band (the frequency bands other than the frequency band corresponding to the noise floor) comes from the differential result signal, the first individual signal, because it does not undergo the zero-point differential operation 41, can truly reflect the noise floor characteristics of the current environment, thereby avoiding the problem of boosted noise floor components.

[0135] In practical applications, considering that the background noise in the environment is usually low-frequency noise, in some embodiments, the frequency in the first frequency band may be higher than the frequency in the second frequency band. For example, the first frequency band may be a high frequency band, and the second frequency band may be a low frequency band. For another example, the first frequency band may be a medium-high frequency band, and the second frequency band may be a low frequency band. For another example, the first frequency band may be a high frequency band, and the second frequency band may be a medium-low frequency band. For another example, the first frequency band may be a medium frequency band, and the second frequency band may be a low frequency band, and so on. In other words, the frequency band corresponding to the lower frequency range in the audio pickup band of the sound sensor module 120 is used as the second frequency band, and the component of the second frequency band in the integrated signal is taken from the first signal, thereby avoiding the problem of the background noise component being raised.

[0136] The low frequency band refers to a frequency band generally below 1 kHz, the mid-frequency band refers to a frequency band generally between 1 kHz and 4 kHz, the high frequency band refers to a frequency band above 4 kHz, the mid-low frequency band refers to a frequency band generally below 4 kHz, and the mid-high frequency band refers to a frequency band generally above 1 kHz. Those skilled in the art will appreciate that the distinction between the above frequency bands is merely an example of a rough range. The definition of the above frequency bands may vary depending on different industries, different application scenarios, and different classification standards. For example, in some application scenarios, the low frequency band may refer to a frequency band generally between 20 Hz and 150 Hz, the mid-frequency band may refer to a frequency band generally between 150 Hz and 5 kHz, the high frequency band may refer to a frequency band generally between 5 kHz and 20 kHz, the mid-low frequency band may refer to a frequency band generally between 150 Hz and 500 Hz, and the mid-high frequency band may refer to a frequency band generally between 500 Hz and 5 kHz. For example, in some other application scenarios, the low frequency band refers to the frequency band of roughly 20Hz to 80Hz, the mid-low frequency band may refer to the frequency band of roughly 80Hz-160Hz, the mid-frequency band may refer to the frequency band of roughly 160Hz to 1280Hz, the mid-high frequency band may refer to the frequency band of roughly 1280Hz-2560Hz, and the high frequency band may refer to the frequency band of roughly 2560Hz to 20KHz.

[0137] In some embodiments, the aforementioned zero-point differential operation 41 and / or signal synthesis operation 42 can be implemented by the processor 220 in the signal processing circuit 150, i.e., the processor 220 executes an instruction set and performs the zero-point differential operation 41 and / or signal synthesis operation 42 according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a zero-point differential circuit, and the aforementioned zero-point differential operation 41 can be implemented by the zero-point differential circuit. In some embodiments, the signal processing circuit 150 may include a signal synthesis circuit, and the aforementioned signal synthesis operation 42 can be implemented by the signal synthesis circuit.

[0138] Figure 18 shows a schematic diagram of another sound pickup control operation 43b provided according to an embodiment of the present application, which further illustrates the signal synthesis operation 42 in Figure 17 . As shown in Figure 18 , the signal synthesis operation 42 may include a first filtering operation 421, a second filtering operation 422, and a synthesis operation 424. The first filtering operation 421 is configured to perform a first filtering operation on the first individual signal to obtain a component in the second frequency band of the first individual signal. For example, when the second frequency band is a low frequency band, the first filtering operation 421 may be implemented using a low-pass filter. The second filtering operation 422 is configured to perform a second filtering operation on the differential result signal to obtain a component in the first frequency band of the differential result signal. For example, when the first frequency band is a high frequency band, the second filtering operation 422 may be implemented using a high-pass filter. The synthesis operation 424 is configured to synthesize the component in the second frequency band obtained by the first filtering operation 421 with the component in the first frequency band obtained by the second filtering operation 422 to obtain the composite signal. In some embodiments, the synthesis operation 424 may be implemented using an adder. It can be seen that the signal processing circuit 150 performs the signal synthesis operation 42 so that the first frequency band in the integrated signal comes from the differential result signal, and the second frequency band comes from the first individual signal.

[0139] In some embodiments, the first filtering and the second filtering may be complementary filtering, or in other words, the sum of the transfer function of the first filtering and the transfer function of the second filtering is equal to 1. For example, assuming that the transfer function corresponding to the first filtering is expressed as the following formula (2), the transfer function corresponding to the second filtering can be expressed as the following formula (3).

[0140] It can be seen from formula (5) and formula (6) that the denominator expressions corresponding to the transfer functions of the two filtering operations are the same, both A(z), and the numerator expressions corresponding to the transfer functions of the two filtering operations are B(z) and A(z)-B(z), respectively. This design makes the sum of the transfer functions of the two filtering operations equal to 1, so that the two filtering operations exhibit all-pass characteristics when working in combination. For ease of understanding, Figure 19 shows a schematic diagram of the frequency response curves corresponding to a set of complementary filtering operations provided according to an embodiment of the present application. As shown in Figure 19, curve 1 can correspond to the frequency response curve of the first filtering operation 421 in Figure 18, showing a low-pass characteristic, and curve 2 can correspond to the frequency response curve of the second filtering operation 422 in Figure 18, showing a high-pass characteristic. The above two filtering operations will exhibit all-pass characteristics when used in combination.

[0141] It should be noted that the complementary filtering operations exemplified in the above formulas (5) and (6) are only used as a possible example. Those skilled in the art will appreciate that any filter group capable of frequency division and synthesis is feasible. For example, in some embodiments, the above-mentioned first filtering and second filtering can also be implemented by a first filter and a second filter having the same cutoff frequency. The cutoff frequency of the first filter is w1, and the cutoff frequency of the second filter is w2. The cutoff frequencies of the two filters are the same: w1 = w2, and the amplitude responses of the two filters at the cutoff frequency satisfy

[0142] FIG20 is a schematic diagram showing the noise floor components corresponding to the differential result signal and the integrated signal in FIG18 . As shown in FIG20 , Curve 1 shows the noise floor component in the first individual signal, and Curve 2 shows the noise floor component in the second individual signal. Curve 3 shows the noise floor component in the differential result signal obtained using the zero-point differential operation 41a shown in FIG9 (corresponding to the cardioid pickup direction pattern). Curve 4 shows the noise floor component in the differential result signal obtained using the zero-point differential scheme 41b shown in FIG12 (corresponding to the figure-eight pickup direction pattern). As can be seen from Curves 3 and 4, both the zero-point differential operation 41a shown in FIG9 (single-delay zero-point differential scheme) and the zero-point differential operation 41b shown in FIG12 (double-delay zero-point differential scheme) significantly increase the noise floor in the low-frequency band (i.e., the second frequency band), thereby causing significant noise interference to the user.

[0143] Continuing with Figure 20, Curve 5 shows the noise floor component of the composite signal obtained by performing a frequency-band synthesis of the differential signal obtained by the first individual signal and the zero-point differential operation 41a shown in Figure 9 (corresponding to the cardioid pickup direction pattern). Curve 6 shows the noise floor component of the composite signal obtained by performing a frequency-band synthesis of the differential signal obtained by the first individual signal and the zero-point differential operation 41b shown in Figure 12 (corresponding to the figure-eight pickup direction pattern). Curves 5 and 6 show that, by performing signal synthesis operation 42, signal processing circuit 150 can circumvent the noise floor increase caused by zero-point differential operation 41, thereby preventing noise interference to the user.

[0144] In some embodiments, when there are multiple speakers 110, the sound frequency bands corresponding to different speakers may differ. In this case, different zero-point differential schemes can be used for different frequency bands, ensuring that the null-point pickup direction of the sound sensor module 120 in each frequency band points toward the speaker in the corresponding frequency band, thereby minimizing the signal component from each speaker in the integrated signal. Taking two speakers as an example, for ease of description, the two speakers will be referred to as the first speaker and the second speaker, respectively. The first frequency band may include a first sub-band and a second sub-band. Accordingly, the signal of the first sub-band in the integrated signal comes from a first sound pickup result signal obtained by the sound sensor module 120 in a first sound pickup state. The first sound pickup state corresponds to the null-point pickup direction of the sound sensor module 120 pointing toward the first speaker. The signal of the second sub-band in the integrated signal comes from a second sound pickup result signal obtained by the sound sensor module 120 in a second sound pickup state. The second sound pickup state corresponds to the null-point pickup direction of the sound sensor module 120 pointing toward the second speaker. The first and second sound pickup states correspond to different sound pickup direction patterns. That is, when the signal processing circuit 150 performs the sound pickup control operation 43, it can use different zero-point differential operations 41 for the first sub-band and the second sub-band, respectively, so that the sound pickup direction pattern corresponding to the first sub-band is different from the sound pickup direction pattern corresponding to the second sub-band. In actual applications, considering that each zero-point differential scheme may have different zero-point attenuation effects (i.e., sound intensity attenuation in the zero-point pickup direction) in different frequency bands, the zero-point differential operation 41 with better zero-point attenuation effect can be used for the first sub-band and the second sub-band, respectively, with reference to the zero-point attenuation performance of each zero-point differential operation 41 in different frequency bands, thereby improving the zero-point attenuation effect of the entire frequency band.

[0145] FIG21 is a schematic diagram illustrating the zero-point attenuation effects corresponding to different zero-point differential operations provided according to an embodiment of the present application. As shown in FIG21 , Curve 1 illustrates the frequency response of the first individual signal. Curve 2 illustrates the frequency response of the differential signal obtained using the zero-point differential operation 41a (corresponding to a cardioid pickup pattern) shown in FIG9 in the null-point pickup direction. Curve 3 illustrates the frequency response of the differential signal obtained using the zero-point differential operation 41b (corresponding to a figure-eight pickup pattern) shown in FIG12 in the null-point pickup direction. FIG21 shows that within the 1kHz-4kHz frequency range, the attenuation of Curve 2 relative to Curve 1 is greater than the attenuation of Curve 3 relative to Curve 1. In other words, the sound intensity attenuation in the null-point pickup direction for the zero-point differential operation 41a (corresponding to a cardioid pickup pattern) shown in FIG9 is greater than the sound intensity attenuation in the null-point pickup direction for the zero-point differential operation 41b (corresponding to a figure-eight pickup pattern) shown in FIG12. Therefore, in the frequency band of 1kHz-4kHz, the zero-point attenuation effect of the zero-point differential operation 41a shown in FIG9 (corresponding to the cardioid pickup direction pattern) is better than that of the zero-point differential operation 41b shown in FIG12 (corresponding to the figure-8 pickup direction pattern).

[0146] Continuing with FIG. 21 , within the 4 kHz-8 kHz frequency band, the attenuation of Curve 3 relative to Curve 1 is more pronounced than the attenuation of Curve 2 relative to Curve 1. In other words, the sound intensity attenuation in the null-point pickup direction of the null-point differential operation 41 b (corresponding to the figure-eight pickup direction pattern) shown in FIG. 12 is greater than the sound intensity attenuation in the null-point pickup direction of the null-point differential operation 41 a (corresponding to the cardioid pickup direction pattern) shown in FIG. Therefore, within the 4 kHz-8 kHz frequency band, the null-point attenuation effect of the null-point differential operation 41 b (corresponding to the figure-eight pickup direction pattern) shown in FIG. 12 is superior to the null-point differential operation 41 a (corresponding to the cardioid pickup direction pattern) shown in FIG. 9.

[0147] Based on the comparison of the zero-point attenuation effect shown in FIG21 , in some embodiments, the first frequency band can be divided into a first sub-band and a second sub-band, where the frequencies in the first sub-band are lower than the frequencies in the second sub-band. For example, the first sub-band can be a mid-frequency band (e.g., 1kHz-4kHz as shown in FIG21 ), and the second sub-band can be a high-frequency band (e.g., 4kHz-8kHz as shown in FIG21 ). In this case, the zero-point differential operation 41a shown in FIG9 can be used for the first sub-band, in which case the sound sensor module 120 correspondingly has a cardioid pickup direction pattern. The zero-point differential operation 41b shown in FIG12 or the zero-point differential operation 41c shown in FIG15 can be used for the second sub-band, in which case the sound sensor module 120 correspondingly has an 8-shaped pickup direction pattern. As a result, both the first and second sub-bands have greater attenuation in the null-point pickup direction, thereby improving the overall zero-point attenuation effect.

[0148] FIG22 shows a schematic diagram of another sound pickup control operation 43b provided according to an embodiment of the present application. Assuming that the acoustic system 003 includes a first speaker and a second speaker, the sound emission frequency band of the first speaker includes a first sub-band, and the sound emission frequency band of the second speaker includes a second sub-band. FIG22 is applicable to a scenario in which different zero-point differential operations are respectively used for the first sub-band and the second sub-band. As shown in FIG22, the zero-point differential operation 41 may include a first zero-point differential operation 41-1 and a second zero-point differential operation 41-2. The first zero-point differential operation 41-1 may adopt the zero-point differential operation 41a shown in FIG9 (i.e., a single-delay zero-point differential solution corresponding to a cardioid pickup direction pattern), and the second zero-point differential operation 41-2 may adopt the zero-point differential operation 41b shown in FIG12 or the zero-point differential operation 41c shown in FIG15 (i.e., a double-delay zero-point differential solution corresponding to a figure-8 pickup direction pattern). After obtaining the first individual signal and the second individual signal, the signal processing circuit 150 can perform a first zero-point differential operation 41-1 on the first individual signal and the second individual signal to point the zero-point pickup direction of the sound sensor module 120 toward the first speaker, thereby obtaining a first differential result signal, and perform a second zero-point differential operation 41-2 on the first individual signal and the second individual signal to point the zero-point pickup direction of the sound sensor module 120 toward the second speaker, thereby obtaining a second differential result signal.

[0149] Continuing with FIG. 22 , the signal synthesis operation 42 may include a first filtering operation 421, a second filtering operation 422, a third filtering operation 423, and a synthesis operation 424. The first filtering operation 421 is configured to perform a first filtering operation on the first individual signal to obtain a component in a second frequency band within the first individual signal. For example, the second frequency band may be a low frequency band (e.g., less than 1000 Hz), in which case the first filtering operation 421 may be implemented using a low-pass filter. The second filtering operation 422 is configured to perform a second filtering operation on the first differential result signal to obtain a component in a first sub-frequency band within the first differential result signal. For example, the first sub-frequency band may be a high frequency band (e.g., greater than 4 kHz), in which case the second filtering operation 422 may be implemented using a high-pass filter. The third filtering operation 423 is configured to perform a third filtering operation on the second differential result signal to obtain a component in a second sub-frequency band within the second differential result signal. For example, the second sub-frequency band may be a mid-frequency band (e.g., 1 kHz-4 kHz), in which case the second filtering operation 422 may be implemented using a band-pass filter. The synthesis operation 424 is configured to synthesize the components of the second frequency band obtained by the first filtering operation 421, the components of the first sub-frequency band obtained by the second filtering operation 422, and the components of the second sub-frequency band obtained by the third filtering operation 423 to obtain a composite signal. In some embodiments, the synthesis operation 424 can be implemented using an adder.

[0150] Similar to FIG18 , the first filtering operation 421, the second filtering operation 422, and the third filtering operation 423 in FIG22 can be referred to as a set of complementary filters. In other words, the sum of the transfer function corresponding to the first filtering operation 421, the transfer function corresponding to the second filtering operation 422, and the transfer function corresponding to the third filtering operation 423 is equal to 1. For the explanation and effects of complementary filters, please refer to the relevant description above and will not be repeated here.

[0151] In some embodiments, any one or more of the first filtering operation 421, the second filtering operation 422, the third filtering operation 423, and the synthesis operation 424 described above can be implemented by the processor 220 in the signal processing circuit 150, i.e., the processor 220 executes an instruction set and performs one or more of the above operations according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a first filtering circuit, and the first filtering operation 421 described above may be implemented by the first filtering circuit. In some embodiments, the signal processing circuit 150 may include a second filtering circuit, and the second filtering operation 422 described above may be implemented by the second filtering circuit. In some embodiments, the signal processing circuit 150 may include a third filtering circuit, and the third filtering operation 423 described above may be implemented by the third filtering circuit. In some embodiments, the signal processing circuit 150 may include a synthesis circuit, and the synthesis operation 424 described above may be implemented by the synthesis circuit.

[0152] S340: Perform a second target operation on the target signal.

[0153] After obtaining the target signal, the signal processing circuit 150 may perform a second target operation 50 on the target signal based on the requirements of the application scenario. In some embodiments, referring to Figures 6 and 7, the signal processing circuit 150 may also be connected to the speaker 110. In this case, the second target operation 50 may include a gain amplification operation 51. After obtaining the target signal, the signal processing circuit 150 may perform a gain amplification on the target signal by performing the gain amplification operation 51, and then send the gain-amplified signal to the speaker 110 so that the speaker 110 emits sound. In some embodiments, when the acoustic system 003 includes a first speaker and a second speaker, the signal processing circuit 150 may perform a gain amplification operation 51 on the target signal to obtain a gain-amplified signal, and then, according to the sound frequency bands of the first speaker and the second speaker, perform a frequency division operation on the gain-amplified signal, and send the frequency-divided signal to the first speaker and the second speaker, respectively. For example, assuming that the sound frequency band of the first speaker includes the second frequency band and the first sub-frequency band, and the sound frequency band of the second speaker includes the second sub-frequency band, in this case, the frequency division operation can extract the first target signal corresponding to the second frequency band and the first sub-frequency band from the gain-amplified signal, and extract the second target signal corresponding to the second sub-frequency band. Furthermore, the signal processing circuit 150 can send the first target signal to the first speaker and the second target signal to the second speaker. The frequency division operation can be implemented by a filter or other feasible methods, which are not limited in this application. The above scheme can be applied to the howling suppression scenario shown in Figure 1. It should be understood that since the signal component from the speaker 110 is reduced in the target signal (or the signal strength from the speaker 110 is reduced), the condition for the sound emitted by the speaker 110 to generate howling in the closed loop shown in Figure 1 is destroyed, thereby achieving the effect of suppressing howling. In some embodiments, the above-mentioned gain amplification operation 51 can be implemented by the processor 220 in the signal processing circuit 150, that is, the processor 220 executes the instruction set and performs the above-mentioned gain amplification operation 51 according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a gain amplification circuit, and the above-mentioned gain amplification operation 51 may be implemented by the gain amplification circuit.

[0154] In some embodiments, the speaker 110, the sound sensor module 120 and the signal processing circuit 150 are integrated in the first acoustic device, and the first acoustic device is communicatively connected to the second acoustic device. In this case, the second target operation 50 may include: sending the target signal to the second acoustic device to reduce the echo of the second acoustic device. The above scheme can be applied to the echo cancellation scenario shown in Figure 2. For example, the first acoustic device can be a local device, and the second acoustic device can be a remote device. Since the signal component from the speaker is reduced in the target signal (or the signal strength from the speaker is reduced), it is equivalent to reducing the sound from the second acoustic device. Therefore, when the second acoustic device receives the target signal and plays it, the user on the second acoustic device side (i.e., the remote user) will not hear or hear less of the echo, thereby achieving the effect of echo cancellation.

[0155] In summary, the present application provides a signal processing method and acoustic system, wherein the signal processing method includes: obtaining a first signal and a second signal, wherein the first signal is obtained by collecting ambient sound when a first sound sensor in a sound sensor module is operating, and the second signal is obtained by collecting ambient sound when a second sound sensor in the sound sensor module is operating, wherein the ambient sound at least includes a target sound emitted by a speaker when the speaker is operating, performing a first target operation on the first signal and the second signal to reduce the sound sensor module's pickup of the target sound in a target frequency band and reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal, and then performing a second target operation on the target signal. In the above scheme, since the first target operation can, on the one hand, reduce the sound sensor module's pickup of the target sound, and on the other hand, reduce the signal corresponding to the target sound picked up by the sound sensor module, the obtained target signal does not contain or contains less signal components from the speaker, thereby enabling the acoustic system to achieve the effect of suppressing howling or eliminating echoes.

[0156] Another aspect of the present application provides a non-transitory storage medium storing at least one set of executable instructions for performing image recognition. When the executable instructions are executed by a processor, the executable instructions direct the processor to implement the steps of the image recognition method P100 described in the present application. In some possible embodiments, various aspects of the present application may also be implemented in the form of a program product comprising program code. When the program product is executed on a computing device 600, the program code is used to cause the computing device 600 to perform the steps of the image recognition method P100 described in the present application. The program product for implementing the above method may include the program code in a portable compact disc read-only memory (CD-ROM) and may be executed on the computing device 600. However, the program product of the present application is not limited to this. In the present application, a readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system. The program product may utilize any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or any combination thereof. More specific examples of computer-readable storage media include: an electrical connection having one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. The computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable storage medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing. Program code for performing the operations of the present application may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the computing device 600, partially on the computing device 600, as a stand-alone software package, partially on the computing device 600 and partially on a remote computing device, or entirely on the remote computing device.

[0157] The foregoing description describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require a specific or sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0158] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented by way of example only and may not be limiting. Although not expressly stated herein, those skilled in the art will understand that the present application requires various reasonable changes, improvements, and modifications to the embodiments. Such changes, improvements, and modifications are intended to be proposed by the present application and are within the spirit and scope of the exemplary embodiments of the present application.

[0159] In addition, certain terms in this application have been used to describe embodiments of the application. For example, "one embodiment," "an embodiment," and / or "some embodiments" mean that a particular feature, structure, or characteristic described in conjunction with that embodiment may be included in at least one embodiment of the application. Therefore, it is emphasized and should be understood that two or more references to "an embodiment," "one embodiment," or "an alternative embodiment" in various sections of this application do not necessarily refer to the same embodiment. Furthermore, particular features, structures, or characteristics may be appropriately combined in one or more embodiments of the application.

[0160] It should be understood that in the foregoing description of the embodiments of this application, in order to facilitate understanding of a feature and to simplify this application, this application combines various features into a single embodiment, figure, or description thereof. However, this does not mean that the combination of these features is required. When reading this application, it is entirely possible for a person skilled in the art to mark out some of the devices and understand them as separate embodiments. In other words, the embodiments of this application can also be understood as the integration of multiple secondary embodiments. This also applies when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.

[0161] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, articles, and the like, cited herein, except any historical prosecution documents to which it relates, any equivalent that may be inconsistent or conflicting with this document, or any equivalent historical prosecution documents that may have a limiting effect on the broadest scope of the claims, is hereby incorporated by reference for all purposes now or hereafter connected with this document. In addition, in the event of any inconsistency or conflict between the descriptions, definitions, and / or use of terms associated with any incorporated material and the terminology, descriptions, definitions, and / or use associated with this document, the terminology in this document shall control.

[0162] Finally, it should be understood that the embodiments of the application disclosed herein are illustrations of the principles of the embodiments of the present application. Other modified embodiments are also within the scope of the present application. Therefore, the embodiments disclosed in the present application are merely examples and not limitations. Those skilled in the art can adopt alternative configurations based on the embodiments in the present application to implement the applications in the present application. Therefore, the embodiments of the present application are not limited to the embodiments precisely described in the application.

Claims

1. A signal processing method, characterized in that: Included, through signal processing circuitry: Obtaining a first signal, wherein the first signal is obtained by collecting environmental sound when the first sound sensor in the sound sensor module is working, wherein the environmental sound at least includes a target sound, and the target sound is the sound output when the speaker is working; Obtaining a second signal, where the second signal is obtained by collecting the environmental sound when the second sound sensor in the sound sensor module is working; Performing a first target operation on the first signal and the second signal to reduce the pickup of the target sound by the sound sensor module in a target frequency band and to reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal; as well as A second target operation is performed on the target signal.

2. The method according to claim 1, characterized in that The first target operation includes: A sound pickup control operation is performed to direct the zero-point sound pickup direction of the sound sensor module in the target frequency band toward the speaker; and The adaptive filtering operation attenuates the signal corresponding to the target sound.

3. The method according to claim 2, characterized in that The sound pickup control operation is performed by a sound pickup control circuit in the signal processing circuit, and the adaptive filtering operation is performed by an adaptive filtering circuit in the signal processing circuit.

4. The method according to claim 2, characterized in that: The performing a first target operation on the first signal and the second signal includes: performing the sound pickup control operation on the first signal and the second signal to obtain a sound pickup control output signal; and An input signal of the loudspeaker is obtained, and the adaptive filtering operation is performed on the sound pickup control output signal based on the input signal to obtain the target signal.

5. The method according to claim 4, characterized in that The adaptive filtering operation includes: Providing a target gain to the input signal to obtain a third signal, wherein the target gain corresponds to a transfer function from the speaker to the sound sensor module; and The target signal is obtained by subtracting the third signal from the sound pickup control output signal.

6. The method according to claim 2, characterized in that The performing a first target operation on the first signal and the second signal includes: Obtaining an input signal of the speaker, and performing the adaptive filtering operation on the first signal and the second signal based on the input signal to obtain a first filtered signal corresponding to the first signal and a second filtered signal corresponding to the second signal; and The sound pickup control operation is performed on the first filtered signal and the second filtered signal to obtain the target signal.

7. The method according to claim 6, characterized in that The adaptive filtering operation includes: Providing a first target gain to the input signal to obtain a fourth signal, and subtracting the fourth signal from the first signal to obtain the first filtered signal, wherein the first target gain corresponds to a transfer function between the speaker and the first sound sensor; and A second target gain is provided to the input signal to obtain a fifth signal, and the fifth signal is subtracted from the second signal to obtain the second filtered signal, wherein the second target gain corresponds to a transfer function from the speaker to the second sound sensor.

8. The method according to claim 2, characterized in that: The target frequency band corresponds to the audio pickup band of the sound sensor module; as well as The sound pickup control operation includes: A zero-point differential operation is performed on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module to point to the speaker, thereby obtaining a differential result signal, wherein the first individual signal corresponds to the pickup signal of the first sound sensor, and the second individual signal corresponds to the pickup signal of the second sound sensor, and the differential result signal is used as the output signal of the sound pickup control operation.

9. The method according to claim 2, characterized in that: The sound pickup band of the sound sensor module includes a first frequency band and a second frequency band, and the target frequency band corresponds to the first frequency band; as well as The sound pickup control operation includes: a zero-point differential operation, performing a zero-point differential on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module to point to the speaker, thereby obtaining a differential result signal, wherein the first individual signal corresponds to the pickup signal of the first sound sensor, and the second individual signal corresponds to the pickup signal of the second sound sensor, and A signal synthesis operation is performed to synthesize the differential result signal and the first individual signal to obtain a comprehensive signal, and the comprehensive signal is used as the output signal of the sound pickup control operation, wherein the component of the first frequency band in the comprehensive signal comes from the differential result signal, and the component of the second frequency band comes from the first individual signal.

10. The method according to claim 9, characterized in that The signal synthesis operation includes: Performing a first filtering on the first individual signal to obtain a component of the second frequency band in the first individual signal; Performing a second filtering on the differential result signal to obtain a component of the first frequency band in the differential result signal; and The component of the first frequency band is synthesized with the component of the second frequency band to obtain the integrated signal.

11. The method according to claim 10, characterized in that The first filtering and the second filtering are complementary filtering.

12. The method according to claim 8 or 9, characterized in that: The zero point differential operation includes: A first delay operation is performed to delay the second individual signal to obtain a second delayed signal; A first differential operation is performed to perform a differential operation on the first individual signal and the second delayed signal to obtain a first differential signal; and The gain compensation operation performs gain compensation on signals of at least a partial frequency band in the first differential signal to obtain the differential result signal.

13. The method according to claim 8 or 9, characterized in that: The zero point differential operation includes: A first delay operation is performed to delay the second individual signal to obtain a second delayed signal; A second delay operation is performed to delay the first individual signal to obtain a first delayed signal; A first differential operation is performed to perform a differential operation on the first individual signal and the second delayed signal to obtain a first differential signal; A second differential operation is performed to perform a differential operation on the second individual signal and the first delayed signal to obtain a second differential signal; a third differential operation, performing a differential operation on the first differential signal and the second differential signal to obtain a third differential signal; and The gain compensation operation performs gain compensation on signals of at least a partial frequency band in the third differential signal to obtain the differential result signal.

14. The method according to claim 13, characterized in that The zero point differential operation further includes: a target parameter generating operation, generating the target parameter with the goal of minimizing the signal component from the loudspeaker in the third differential signal; and A multiplication operation is performed between the second differential operation and the third differential operation, multiplying the target parameter with the second differential signal to obtain a multiplication result, so that the third differential operation performs a differential operation on the first differential signal and the multiplication result to obtain the third differential signal.

15. The method according to claim 1, characterized in that The second target operation includes: performing gain amplification on the target signal and sending the gain-amplified signal to the speaker, so that the speaker emits the target sound.

16. The method according to claim 1, characterized in that The loudspeaker and the sound sensor module are deployed on a first acoustic device, and the first acoustic device is communicatively connected with a second acoustic device; as well as The second target operation includes sending the target signal to the second acoustic device to reduce an echo of the second acoustic device.

17. An acoustic system, characterized in that: include: The speaker receives input signals and outputs target sounds when in operation; The sound sensor module comprises at least: a first sound sensor and a second sound sensor, wherein the first sound sensor collects environmental sounds and generates a first signal when in operation, and the second sound sensor collects the environmental sounds and generates a second signal when in operation, wherein the environmental sounds at least include the target sound; as well as The signal processing circuit is connected to the sound sensor module and executes the method according to any one of claims 1 to 16 when in operation.

18. The acoustic system according to claim 17, characterized in that The signal processing circuit comprises: at least one storage medium storing at least one instruction set for performing signal processing; and A processor is communicatively connected to the sound sensor module and the at least one storage medium, wherein when the acoustic system is running, the processor reads the at least one instruction set and executes the method of any one of claims 1-16 according to the instructions of the at least one instruction set.

19. The acoustic system according to claim 17, characterized in that The acoustic system is any one of a hearing aid system, a sound amplification system, a headphone system, a telephone system, and a conference system.

20. The acoustic system according to claim 17, characterized in that The acoustic system is a hearing aid system, and the acoustic system further comprises a housing, wherein the speaker, the sound sensor module and the signal processing circuit are arranged in the housing, wherein When the acoustic system is worn on the user's head, the sound output end of the speaker faces the user's head, and the sound pickup end of at least one sound sensor in the sound sensor module is located on a side of the housing away from the user's head.

Images