Signal processing method and acoustic system
Through signal processing method, the sound sensor picks up the speaker signal in the acoustic system, and the whistling and echo problems caused by the closed loop of the speaker signal are solved, and the normal operation of the system is achieved.
Patent Information
- Application Number
- CN202310546658.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-15
- Publication Date
- 2024-11-15
AI Technical Summary
The sound emitted by the speaker in the acoustic system is re-acquisitioned by the sound sensor, resulting in a closed loop, causing a whistle or echo, affecting the normal operation of the system.
Through the signal processing method, the signal collected by the speaker and the sound sensor is obtained by using the signal processing circuit, and the sound pickup control operation and adaptive filtering operation are performed to reduce the pickup of the speaker signal by the sound sensor, reduce the speaker signal components in the target signal, and generate the target signal. .
Effectively suppress whistling or eliminate echoes, improve the working performance of the acoustic system, reduce the intensity of the speaker signal in the target signal, and prevent the formation of closed loop loops.
Smart Images

Figure CN118972742A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of acoustic technology, and in particular to a signal processing method and an acoustic system. Background Art
[0002] Some acoustic systems include both speakers and sound sensors. In these acoustic systems, the ambient sound collected by the sound sensor may include the sound emitted from the speaker, which is not conducive to the operation of the acoustic system. For example, when the hearing aid system is working, the ambient sound is collected by the sound sensor, the ambient sound is amplified and then played through the speaker, thereby compensating for the hearing loss of the wearer. When the sound emitted by the speaker is re-collected by the sound sensor, the acoustic system forms a closed loop, so that the sound emitted by the speaker is continuously amplified in the closed loop, causing the acoustic system to howl, making the wearer feel uncomfortable. For another example, in a telephone system or a conference system, the voice signal emitted by the remote user is played through the local speaker, and is collected by the local sound sensor together with the voice emitted by the local user, and then transmitted back to the remote end, so that the remote user will be disturbed by the echo. Summary of the invention
[0003] The present application provides a signal processing method and an acoustic system, which can reduce the signal component from a loudspeaker in a target signal, thereby achieving the effect of suppressing howling or eliminating echo.
[0004] In a first aspect, the present application provides a signal processing method, comprising: obtaining, through a signal processing circuit: a first signal, wherein the first signal is obtained by collecting ambient sound when a first sound sensor in a sound sensor module is working, and the ambient sound at least includes a target sound, and the target sound is the sound output when a speaker is working; obtaining a second signal, wherein the second signal is obtained by collecting the ambient sound when a second sound sensor in the sound sensor module is working; performing a first target operation on the first signal and the second signal to reduce the sound sensor module's pickup of the target sound in a target frequency band and to reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal; and performing a second target operation on the target signal.
[0005] In some embodiments, the first target operation includes: a sound pickup control operation to direct the sound sensor module toward the speaker in the zero-point sound pickup direction of the target frequency band; and an adaptive filtering operation to reduce the signal corresponding to the target sound.
[0006] In some embodiments, the sound pickup control operation is performed by a sound pickup control circuit in the signal processing circuit, and the adaptive filtering operation is performed by an adaptive filtering circuit in the signal processing circuit.
[0007] In some embodiments, performing the first target operation on the first signal and the second signal includes: performing the sound pickup control operation on the first signal and the second signal to obtain a sound pickup control output signal; and obtaining an input signal of the speaker, and performing the adaptive filtering operation on the sound pickup control output signal based on the input signal to obtain the target signal.
[0008] In some embodiments, the adaptive filtering operation includes: providing a target gain to the input signal to obtain a third signal, wherein the target gain corresponds to a transfer function between the speaker and the sound sensor module; and subtracting the third signal from the pickup control output signal to obtain the target signal.
[0009] In some embodiments, performing the first target operation on the first signal and the second signal includes: obtaining an input signal of the speaker, and performing the adaptive filtering operation on the first signal and the second signal based on the input signal to obtain a first filtered signal corresponding to the first signal and a second filtered signal corresponding to the second signal; and performing the pickup control operation on the first filtered signal and the second filtered signal to obtain the target signal.
[0010] In some embodiments, the adaptive filtering operation includes: providing a first target gain to the input signal to obtain a fourth signal, and subtracting the fourth signal from the first signal to obtain the first filtered signal, wherein the first target gain corresponds to a transfer function between the speaker and the first sound sensor; and providing a second target gain to the input signal to obtain a fifth signal, and subtracting the fifth signal from the second signal to obtain the second filtered signal, wherein the second target gain corresponds to the transfer function between the speaker and the second sound sensor.
[0011] In some embodiments, the target frequency band corresponds to the pickup frequency band of the sound sensor module; and the sound pickup control operation includes: a zero-point differential operation, performing a zero-point differential on a first individual signal and a second individual signal to adjust the zero-point sound pickup direction of the sound sensor module to point toward the speaker, thereby obtaining a differential result signal, wherein the first individual signal corresponds to the pickup signal of the first sound sensor, and the second individual signal corresponds to the pickup signal of the second sound sensor, and the differential result signal serves as the output signal of the sound pickup control operation.
[0012] In some embodiments, the sound pickup band of the sound sensor module includes a first frequency band and a second frequency band, and the target frequency band corresponds to the first frequency band; and the sound pickup control operation includes: a zero-point differential operation, performing zero-point differential on a first individual signal and a second individual signal to adjust the zero-point sound pickup direction of the sound sensor module to point toward the speaker, thereby obtaining a differential result signal, wherein the first individual signal corresponds to the pickup signal of the first sound sensor, and the second individual signal corresponds to the pickup signal of the second sound sensor; and a signal synthesis operation, synthesizing the differential result signal and the first individual signal to obtain a comprehensive signal, and the comprehensive signal serves as the output signal of the sound pickup control operation, wherein the component of the first frequency band in the comprehensive signal comes from the differential result signal, and the component of the second frequency band comes from the first individual signal.
[0013] In some embodiments, the signal synthesis operation includes: performing a first filtering on the first individual signal to obtain the component of the second frequency band in the first individual signal; performing a second filtering on the differential result signal to obtain the component of the first frequency band in the differential result signal; and synthesizing the component of the first frequency band with the component of the second frequency band to obtain the integrated signal.
[0014] In some embodiments, the first filtering and the second filtering are complementary filtering.
[0015] In some embodiments, the zero-point differential operation includes: a first delay operation, delaying the second individual signal to obtain a second delayed signal; a first differential operation, performing a differential operation on the first individual signal and the second delayed signal to obtain a first differential signal; and a gain compensation operation, performing gain compensation on at least part of the frequency band of the first differential signal to obtain the differential result signal.
[0016] In some embodiments, the zero-point differential operation includes: a first delay operation, delaying the second individual signal to obtain a second delayed signal; a second delay operation, delaying the first individual signal to obtain a first delayed signal; a first differential operation, performing a differential operation on the first individual signal and the second delayed signal to obtain a first differential signal; a second differential operation, performing a differential operation on the second individual signal and the first delayed signal to obtain a second differential signal; a third differential operation, performing a differential operation on the first differential signal and the second differential signal to obtain a third differential signal; and a gain compensation operation, performing gain compensation on at least part of the frequency band of the third differential signal to obtain the differential result signal.
[0017] In some embodiments, the zero-point differential operation also includes: a target parameter generation operation to generate a target parameter with the goal of minimizing the signal component from the speaker in the third differential signal; and a multiplication operation performed between the second differential operation and the third differential operation to multiply the target parameter with the second differential signal to obtain a multiplication result, so that the third differential operation performs a differential operation on the first differential signal and the multiplication result to obtain the third differential signal.
[0018] In some embodiments, the second target operation includes: performing a gain amplification on the target signal and sending the gain-amplified signal to the speaker, so that the speaker emits the target sound.
[0019] In some embodiments, the speaker and the sound sensor module are deployed on a first acoustic device, the first acoustic device is communicatively connected to a second acoustic device; and the second target operation includes: sending the target signal to the second acoustic device to reduce the echo of the second acoustic device.
[0020] In a second aspect, the present application also provides an acoustic system, comprising: a speaker, a sound sensor module and a signal processing circuit, wherein the speaker receives an input signal and outputs a target sound when in operation, the sound sensor module comprises at least a first sound sensor and a second sound sensor, the first sound sensor collects ambient sound and generates a first signal when in operation, the second sound sensor collects the ambient sound and generates a second signal when in operation, the ambient sound at least includes the target sound; the signal processing circuit is connected to the sound sensor module, and executes the method described in any one of the first aspects when in operation.
[0021] In some embodiments, the signal processing circuit includes: at least one storage medium storing at least one instruction set for signal processing; and a processor communicatively connected to the sound sensor module and the at least one storage medium, wherein when the acoustic system is running, the processor reads the at least one instruction set and executes any one of the methods described in the first aspect according to the instructions of the at least one instruction set.
[0022] In some embodiments, the acoustic system is any one of a hearing aid system, a sound amplification system, a headphone system, a telephone system, and a conference system.
[0023] In some embodiments, the acoustic system is a hearing aid system, which further includes a shell, and the speaker, the sound sensor module and the signal processing circuit are arranged in the shell, wherein when the acoustic system is worn on the user's head, the sound output end of the speaker faces the user's head, and the pickup end of at least one sound sensor in the sound sensor module is located on a side of the shell away from the user's head.
[0024] As can be seen from the above technical scheme, the present application provides a signal processing method and an acoustic system, the signal processing method comprising: obtaining a first signal and a second signal, the first signal being obtained by collecting environmental sound when the first sound sensor in the sound sensor module is working, and the second signal being obtained by collecting environmental sound when the second sound sensor in the sound sensor module is working, the environmental sound at least including the target sound emitted when the speaker is working, performing a first target operation on the first signal and the second signal to reduce the sound sensor module's pickup of the target sound in the target frequency band and reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal, and then performing a second target operation on the target signal. In the above scheme, since the first target operation can reduce the sound sensor module's pickup of the target sound on the one hand, and can also reduce the signal corresponding to the target sound picked up by the sound sensor module on the other hand, the obtained target signal does not contain or contains less signal components from the speaker, so that the acoustic system can achieve the effect of suppressing howling or eliminating echoes.
[0025] Other functions of the signal processing method and acoustic system provided by the present application will be partially listed in the following description. The creative aspects of the signal processing method and acoustic system provided by the present application can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0027] Figure 1 A schematic diagram of a howling scenario provided according to an embodiment of the present application is shown;
[0028] Figure 2 A schematic diagram of an echo scenario provided according to an embodiment of the present application is shown;
[0029] Figure 3AA schematic diagram of the structure of an acoustic system provided according to an embodiment of the present application is shown;
[0030] Figure 3B A logical schematic diagram of an acoustic system provided according to an embodiment of the present application is shown;
[0031] Figure 4 Shows Figure 3A-3B A schematic diagram of a design of an acoustic system shown;
[0032] Figure 5 A flow chart of a signal processing method provided according to an embodiment of the present application is shown;
[0033] Figure 6 A schematic diagram of a signal processing process provided according to an embodiment of the present application is shown;
[0034] Figure 7 A schematic diagram showing another signal processing process provided according to an embodiment of the present application is shown;
[0035] Figure 8 A schematic diagram of a sound pickup control operation provided according to an embodiment of the present application is shown;
[0036] Fig. 9 A schematic diagram of a zero-point differential operation provided according to an embodiment of the present application is shown;
[0037] Fig.10 Shows Fig. 9 Schematic diagram of the sound pickup direction pattern corresponding to the zero-point differential operation in ;
[0038] Fig.11 Shows the use of Fig. 9 A schematic diagram of a frequency response curve of a first differential signal obtained by a zero-point differential operation is shown;
[0039] Fig.12 A schematic diagram of another zero-point differential operation provided according to an embodiment of the present application is shown;
[0040] Fig.13 Shows Fig.12 Schematic diagram of the principle of adjusting the sound pickup direction corresponding to the zero-point differential operation;
[0041] Fig.14 Shows Fig.12 Schematic diagram of the sound pickup direction pattern of the zero-point differential operation 41b in three different scenarios;
[0042] Fig.15 A schematic diagram showing another zero-point differential operation provided according to an embodiment of the present application is shown;
[0043] Fig.16A schematic diagram showing the adjustment of the zero-point pickup direction by the target parameter β provided in an embodiment of the present application is shown;
[0044] Fig.17 A schematic diagram showing another sound pickup control operation provided according to an embodiment of the present application is shown;
[0045] Fig.18 A schematic diagram showing another sound pickup control operation provided according to an embodiment of the present application is shown;
[0046] Fig.19 A schematic diagram of a frequency response curve corresponding to a set of complementary filtering operations provided according to an embodiment of the present application is shown;
[0047] Fig. 20 Shows Fig.18 Schematic diagram of the background noise components corresponding to the differential result signal and the integrated signal respectively;
[0048] Fig.21 A schematic diagram showing zero-point attenuation effects corresponding to different zero-point differential operations provided according to an embodiment of the present application; and
[0049] Fig. 22 A schematic diagram of another sound pickup control operation provided according to an embodiment of the present application is shown. DETAILED DESCRIPTION
[0050] The following description provides specific application scenarios and requirements of the present application, with the purpose of enabling those skilled in the art to make and use the content in the present application. It will be apparent to those skilled in the art that various local modifications to the disclosed embodiments are apparent, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the present application. Therefore, the present application is not limited to the embodiments shown, but to the widest scope consistent with the claims.
[0051] The terms used herein are only used for the purpose of describing specific example embodiments and are not restrictive. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a", "an" and "the" may also include plural forms. When used in this application, the terms "include", "comprise" and / or "contain" mean to refer to the existence of associated integers, steps, operations, elements and / or components, but do not exclude the existence of one or more other features, integers, steps, operations, elements, components and / or groups or other features, integers, steps, operations, elements, components and / or groups may be added in the system / method.
[0052] In view of the following description, these and other features of the present application, as well as the operation and function of the related elements of the structure, and the economy of the combination and manufacture of the parts can be significantly improved. With reference to the accompanying drawings, all of which form a part of this application. However, it should be clearly understood that the drawings are only for the purpose of illustration and description and are not intended to limit the scope of the present application. It should also be understood that the drawings are not drawn to scale.
[0053] The flow chart used in this application illustrates the operation of the system implementation according to some embodiments in this application. It should be clearly understood that the operation of the flow chart can be implemented out of order. On the contrary, the operation can be implemented in reverse order or simultaneously. In addition, one or more other operations can be added to the flow chart. One or more operations can be removed from the flow chart.
[0054] For the convenience of description, the terms appearing in this application are first explained.
[0055] Howling: Howling is a common phenomenon in acoustic systems. Figure 1 The process of howling generation is described. Figure 1 FIG. 1 is a schematic diagram of a howling scene 001 provided according to an embodiment of the present application, wherein the howling scene 001 may correspond to scenes such as a sound reinforcement system, a hearing aid / assisted hearing system, etc. Figure 1 As shown, the howling scene 001 includes a loudspeaker 110, a sound sensor 120-A and a gain amplifier 130. The sound sensor 120-A collects ambient sound when it is working. During this process, if the loudspeaker 110 is also playing sound synchronously, the sound played by the loudspeaker 110 will also be collected by the sound sensor 120-A. In this way, the ambient sound collected by the sound sensor 120-A includes both the sound from the target sound source 160 and the sound from the loudspeaker 110. Furthermore, the above-mentioned ambient sound is input to the gain amplifier 130 for gain amplification, and then played through the loudspeaker 110. In this way, a closed loop of "loudspeaker-sound sensor-loudspeaker" is formed in the acoustic system. In this case, when a sound signal of a certain frequency undergoes self-excited oscillation, a howling phenomenon will occur. Such howling will make the user feel uncomfortable, and when the howling is severe, it may also cause damage to the acoustic equipment. In addition, the existence of the howling also brings limitations to the gain amplification factor of the gain amplifier 130, thereby restricting the maximum sound gain that the acoustic system 003 can achieve.
[0056] Echo: Echo is also a common phenomenon in acoustic systems. Figure 2 The process of generating an echo is described. Figure 2 FIG. 1 shows a schematic diagram of an echo scene 002 provided according to an embodiment of the present application. The echo scene 002 may correspond to scenes such as a telephone system, a conference system, and a voice call system. Figure 2 As shown, the echo scene 002 includes a local end and a remote end, wherein the local end includes a local user 140-A, a speaker 110-A and a sound sensor 120-A, and the remote end includes a remote user 140-B, a speaker 110-B and a sound sensor 120-B. The local end and the remote end can be connected through a network. Among them, the network is a medium for providing a communication connection between the local end and the remote end, which can facilitate the exchange of information or data between the two. In some embodiments, the network can be any type of wired or wireless network, or a combination thereof. For example, the network can include a cable network, a wired network, an optical fiber network, a telecommunications network, an intranet, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a wide area network (WAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, a near field communication (NFC) network or a similar network. In some embodiments, the network can include one or more network access points. For example, the network may include a wired or wireless network access point, such as a base station or an Internet exchange point, through which local and remote terminals can connect to the network to exchange data or information.
[0057] Continue to see Figure 2 During a call between a local user 140-A and a remote user 140-B, the remote voice emitted by the remote user 140-B is collected by the sound sensor 120-B and transmitted to the local end, and then played through the local speaker 110-A. The remote voice played by the speaker 110-A is collected by the local sound sensor 120-A together with the local voice emitted by the local user 140-A, and then transmitted back to the remote end and played through the remote speaker 110-B. In this way, the remote user 140-B will hear his own echo and be disturbed by the echo. It should be noted that Figure 2 The example in the figure is the process of the remote user 140-B being disturbed by the echo. It should be understood that the local user 140-A may also be disturbed by the echo. The echo generation process at the local end is similar to the above description and will not be repeated here. Such an echo will affect the normal conversation of the user.
[0058] Background noise: refers to background noise, generally refers to the surrounding environment sound other than the sound source being measured. In this application, any sound that is not welcome, unwanted, or disturbing to the user's hearing can be called noise.
[0059] Sound pickup direction pattern: refers to the pattern used to characterize the sensitivity of the sound sensor / sound sensor module to sounds from different directions. Simply put, the sound pickup direction pattern can characterize the ability of the sound sensor / sound sensor module to pick up sounds from different directions. Generally, the sound pickup direction pattern can include: omnidirectional, cardioid, figure 8, supercardioid, etc.
[0060] Zero-point pickup direction: In theory, if the sound sensitivity of the sound sensor / sound sensor module to a certain direction is 0 or close to 0, then this direction is called the zero-point pickup direction. It should be understood that when the sound source is located in the zero-point pickup direction, the sound sensor / sound sensor module will not theoretically collect the sound emitted by the sound source. In actual situations, due to the manufacturing errors of the sound sensor / sound sensor module and the fact that the sound source in reality is not necessarily an ideal point, the sound sensor / sound sensor module can still collect less sound in the zero-point pickup direction. It should be noted that in the present application, the zero-point pickup direction can refer to a specific direction, or it can refer to a range of directions including multiple directions.
[0061] Far-field sound source: may refer to a sound source that is farther away from the sound sensor / sound sensor module. Generally speaking, when the distance between the sound source to be measured and the sound sensor / sound sensor module is greater than N times the physical size of the sound sensor / sound sensor module, the sound source can be approximately regarded as a far-field sound source. It should be noted that the value of N may be different in different application scenarios. For example, in the scenario of headphones, the physical size of the sound sensor / sound sensor module may be less than or equal to 0.01m, and the value of N may be greater than or equal to 10, that is, a sound source that is greater than or equal to 0.1m from the sound sensor / sound sensor module can be considered a far-field sound source. Compared with near-field sound sources, the sound waves of the far-field sound sources are approximately plane, and the amplitude of the sound waves decreases less with propagation.
[0062] Near-field sound source: may refer to a sound source that is closer to the sound sensor / sound sensor module. Generally speaking, when the distance between the sound source to be measured and the sound sensor / sound sensor module is less than 2 to 3 times the physical size of the sound sensor / sound sensor module, the sound source can be approximately regarded as a far-field sound source. For example, in the scenario of headphones, the sound source with a distance less than 0.1m can be considered a near-field sound source. Compared with the aforementioned far-field sound source, the sound wave of the near-field sound source is closer to a sphere, and the amplitude of the sound wave decreases more with propagation.
[0063] Before describing the specific embodiments of the present application, the application scenarios of the present application are first introduced as follows: the signal processing method and acoustic system provided by the present application can be applied to scenarios where howling suppression is required (for example Figure 1 The scenario shown in the figure) can also be applied to the scenario where echo cancellation is required (for example Figure 2 In the above scenario, the acoustic system collects ambient sound through the sound sensor module, and uses the signal processing method described in this application to process the collected signal to generate a target signal, so as to reduce the signal component from the speaker in the target signal, thereby achieving the purpose of suppressing howling or echo elimination.
[0064] It should be noted that the above-mentioned howling suppression scenario and echo cancellation scenario are only some of the multiple usage scenarios provided by this application, and the signal processing method and acoustic system provided by this application can also be applied to other similar scenarios. Those skilled in the art should understand that the application of the signal processing method and acoustic system provided by this application to other usage scenarios is also within the protection scope of this application.
[0065] Figure 3A A schematic structural diagram of an acoustic system 003 provided according to an embodiment of the present application is shown; Figure 3B FIG. 1 shows a logic diagram of an acoustic system 003 provided according to an embodiment of the present application. The acoustic system 003 may be a sound reinforcement system, a hearing aid / auxiliary hearing system, a telephone system, a conference system, or a voice call system. Figure 3A-3B As shown, the acoustic system 003 may include: a speaker 110, a sound sensor module 120 and a signal processing circuit 150. The sound sensor module 120 includes at least a first sound sensor 120-1 and a second sound sensor 120-2.
[0066] It should be noted that Figure 3A-3B In the acoustic system 003 shown, the physical position relationship between the speaker 110, the first sound sensor 120-1 and the second sound sensor 120-2 can be arbitrary. Figure 3A-3B The physical position relationship between the three is not shown. For example, in some embodiments, the speaker 110, the first sound sensor 120-1 and the second sound sensor 120-2 can be arranged in a straight line. For another example, in some embodiments, the speaker 110 can be located (or substantially located) on the perpendicular bisector of the first sound sensor 120-1 and the second sound sensor 120-2. In this case, the distance between the speaker 110 and the first sound sensor 120-1 is equal to the distance between the speaker 110 and the second sound sensor 120-2 (or substantially equal). Of course, there can be other physical position relationships between the speaker 110, the first sound sensor 120-1 and the second sound sensor 120-2, which are not listed one by one in this application.
[0067] In some embodiments, the acoustic system 003 is a hearing aid system, and the acoustic system 003 may further include a housing, and the speaker 110, the sound sensor module 120, and the signal processing circuit 150 may be arranged in the housing. The housing protects the components inside it and is convenient for the user to take and wear. The acoustic system 003 can be worn on the user's head. For example, the acoustic system 003 can be worn on the user's ear in an in-ear or hanging-ear manner. When the acoustic system 003 is worn on the user's head, the sound outlet of the speaker 110 faces the user's head, for example, it can face the user's ear canal opening or near the ear canal opening. The sound pickup end of at least one sound sensor in the sound sensor module 120 is located on the side of the housing away from the user's head, so that it is convenient to pick up environmental sounds on the one hand, and on the other hand, the sound pickup of the speaker 110 can be minimized.
[0068] The first sound sensor 120-1 and the second sound sensor 120-2 can be the same sound sensor or different sound sensors. For ease of description, in this application, the sound sensor closer to the speaker 110 in the sound sensor module 120 is referred to as the second sound sensor 120-2, and the sound sensor farther from the speaker 110 is referred to as the first sound sensor, that is, the second sound sensor 120-2 is closer to the speaker 110 relative to the first sound sensor 120-1. In this way, the sound emitted by the speaker 110 will be first collected by the second sound sensor 120-2, and then collected by the first sound sensor 120-1. In this case, the phase of the signal component corresponding to the target sound in the second signal is earlier than the phase of the signal component corresponding to the target sound in the first signal. When the distance between the two sound sensors and the speaker 110 is equal, any one of them can be referred to as the first sound sensor 120-1, and the other can be referred to as the second sound sensor 120-2. In this case, the phase of the signal component corresponding to the target sound in the second signal is equal to the phase of the signal component corresponding to the target sound in the first signal. In addition, the speaker 110, the first sound sensor 120-1, and the second sound sensor 120-2 may be integrated into the same electronic device, or may be independent of each other, which is not limited in the present application.
[0069] The speaker 110 may also be called an electroacoustic converter, which is a device for converting an electrical signal into an acoustic signal. For example, the speaker 110 may be a horn. When working, the speaker 110 receives an input signal and converts it into an audio signal for playback. The above-mentioned input signal refers to an electrical signal carrying sound information, and the above-mentioned audio refers to the sound played by the speaker 110. In some embodiments, the input signal received by the speaker 110 may come from the sound sensor module 120. This situation may correspond to Figure 1 In the acoustic scene shown, for example, after the sound sensor module 120 collects the ambient sound and generates an electrical signal, the electrical signal is provided to the speaker 110 for playback, or the electrical signal is provided to the speaker 110 for playback after a preset process is performed on the electrical signal, wherein the preset process may include at least one of amplification process, noise reduction process, and enhancement process. In some embodiments, the input signal received by the speaker 110 may also come from other electronic devices. This situation may correspond to Figure 2 The acoustic scene shown. For example, the acoustic system 003 can receive an input signal from a remote device, and convert the input signal into audio through the speaker 110 for playback, or convert the input signal into audio for playback through the speaker 110 after performing a preset process, wherein the preset process may include at least one of amplification, noise reduction, and enhancement. In some embodiments, the acoustic system 003 may include a plurality of speakers 110. In this case, the plurality of speakers 110 may be arranged in an array, such as a linear array, a planar array, a spherical array, or other arrays.
[0070] The sound sensor (first sound sensor 120-1 and / or second sound sensor 120-2) may also be referred to as an acoustic-to-electric converter or a sound pickup device, which is a device for collecting sound and converting the sound into an electrical signal. For example, the sound sensor may be a microphone (MIC). When working, the sound sensor collects ambient sound and converts it into an electrical signal that carries sound information. Among them, the sound sensor may be an omnidirectional sound sensor, in which case the sound sensor can collect ambient sound from all directions. The sound sensor may also be a directional sound sensor, in which case the sound sensor can collect ambient sound from some directions.
[0071] Continue to see Figure 3A-3BIn some embodiments, the acoustic system 003 can sense and process the sound from the target sound source 160. For example, the target sound source 160 can be an electronic device with a sound playback function (such as a TV, a speaker, a mobile phone, etc.), and for another example, the target sound source 160 can also be a human throat. In this case, the ambient sound includes both the sound from the target sound source 160 and the sound from the speaker 110. When the first sound sensor 120-1 is working, it collects the ambient sound and generates a first signal, and the first signal includes the sound signal from the target sound source 160 and the sound signal from the speaker 110. When the second sound sensor 120-2 is working, it collects the ambient sound and generates a second signal, and the second signal includes the sound signal from the target sound source 160 and the sound signal from the speaker 110. For the convenience of description, the present application refers to the sound emitted by the speaker 110 as the target sound, so that the ambient sound at least includes the target sound, the first signal at least includes a signal corresponding to the target sound, and the second signal at least includes a signal corresponding to the target sound.
[0072] The signal processing circuit 150 is connected to the sound sensor module 120, such as Figure 3A-3BAs shown, the signal processing circuit 150 is connected to the first sound sensor 120-1 and the second sound sensor 120-2 respectively. In this way, the signal processing circuit 150 can obtain the first signal from the first sound sensor 120-1 and obtain the second signal from the second sound sensor 120-2. Furthermore, the signal processing circuit 150 can perform the first target operation 40 on the first signal and the second signal to reduce the pickup of the target sound by the sound sensor module 120 in the target frequency band and reduce the signal corresponding to the target sound picked up by the sound sensor module 120, thereby obtaining the target signal. It should be understood that since the first target operation 40 can reduce the pickup of the target sound by the sound sensor module 120 in the target frequency band and can also reduce the signal corresponding to the target sound picked up by the sound sensor module 120, the signal processing circuit 150 can reduce the signal component from the speaker 110 in the target signal by performing the first target operation 40. In some embodiments, "reducing the signal component from the speaker 110 in the target signal" means reducing the signal component from the speaker 110 in the target signal relative to the first signal and / or the second signal. That is, the signal component from the speaker 110 in the target signal is less than the signal component from the speaker 110 in the first signal, and / or, less than the signal component from the speaker 110 in the second signal. In some embodiments, "reducing the signal component from the speaker 110 in the target signal" may mean reducing the signal strength from the speaker 110 in the target signal relative to the first signal and / or the second signal. That is, the signal strength from the speaker 110 in the target signal is less than the signal strength from the speaker 110 in the first signal, and / or, less than the signal strength from the speaker 110 in the second signal.
[0073] Continue to see Figure 3A-3B After generating the target signal, the signal processing circuit 150 may perform a second target operation 50 on the target signal. In some embodiments, the second target operation 50 may include: performing a gain amplification on the target signal and sending the gain amplified signal (i.e., the input signal of the speaker 110) to the speaker 110, so that the speaker 110 converts it into the target sound. The above solution can be applied to Figure 1 It should be understood that since the signal processing circuit 150 reduces the pickup of the target sound by the sound sensor module 120 and reduces the signal corresponding to the target sound picked up by the sound sensor module 120, the signal component from the speaker 110 is reduced in the target signal (or the signal strength from the speaker 110 is reduced), which destroys the sound emitted by the speaker 110. Figure 1 The closed loop circuit shown generates the conditions for howling, thereby achieving the effect of suppressing howling.
[0074] In some embodiments, when the speaker 110, the sound sensor module 120 and the signal processing circuit 150 are deployed in the first acoustic device, the first acoustic device can be connected to the second acoustic device for communication. In this case, the second target operation 50 may include: sending the target signal to the second acoustic device to reduce the echo of the second acoustic device. The above solution can be applied to Figure 2 The echo cancellation scenario shown. For example, the first acoustic device can be a local device, and the second acoustic device can be a remote device. Since the signal component from the speaker is reduced in the target signal sent by the first acoustic device to the second acoustic device (or the signal strength from the speaker is reduced), it is equivalent to eliminating / reducing the sound from the second acoustic device. Therefore, when the second acoustic device receives the target signal and plays it, the user on the second acoustic device side (i.e., the remote user) will not hear the echo, thereby achieving the effect of echo cancellation.
[0075] The signal processing circuit 150 may be configured to perform the signal processing method described in this application. In some embodiments, the signal processing circuit 150 may include multiple hardware circuits with a connection relationship, each hardware circuit includes one or more electrical components, and when working, implements one or more steps in the signal processing method described in this application, and the above multiple hardware circuits cooperate with each other to implement the signal processing method described in this application when working. In some embodiments, the signal processing circuit 150 may include a hardware device with a data information processing function and a necessary program required to drive the hardware device to work, and the hardware device implements the signal processing method described in this application by executing the program. The signal processing method will be described in detail in the following content.
[0076] Figure 4 A schematic diagram of a design of the acoustic system 003 is shown. Figure 4 As shown, the signal processing circuit 150 may include: at least one storage medium 210 and at least one processor 220. The at least one processor 220 is in communication with the speaker 110, the first sound sensor 120-1 and the second sound sensor 120-2. It should be noted that the signal processing circuit 150 in this application includes at least one storage medium 210 and at least one processor 220 for the purpose of demonstration only. It can be understood by those of ordinary skill in the art that the signal processing circuit 150 may also include other hardware circuit structures, which are not limited in this application, as long as they can meet the functions mentioned in this application without deviating from the spirit of this application.
[0077] Continue to see Figure 4In some embodiments, the acoustic system 003 may further include a communication port 230. The communication port 230 is used for data communication between the acoustic system and the outside world. For example, the communication port 230 can be used for data communication between the acoustic system and other devices / systems. In some embodiments, the acoustic system 003 may further include an internal communication bus 240. The internal communication bus 240 can connect different system components. For example, the speaker 110, the first sound sensor 120-1, the second sound sensor 120-2, the processor 220, the storage medium 210 and the communication port 230 can all be connected via the internal communication bus 240.
[0078] The storage medium 210 may include a data storage device. The data storage device may be a non-temporary storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk 2101, a read-only storage medium (ROM) 2102, or a random access storage medium (RAM) 2103. The storage medium 210 also includes at least one instruction set stored in the data storage device. The instruction set includes instructions, which are computer program codes, and the computer program codes may include programs, routines, objects, components, data structures, processes, modules, etc. for executing the signal processing method provided in the present application.
[0079] At least one processor 220 is used to execute the at least one instruction set mentioned above. When the acoustic system 003 is running, at least one processor 220 reads the at least one instruction set and executes the signal processing method provided in the present application according to the instructions of the at least one instruction set. The processor 220 can perform all or part of the steps included in the above signal processing method. The processor 220 can be in the form of one or more processors. In some embodiments, the processor 220 may include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof. Just for illustration, Figure 4The acoustic system 003 shown illustrates a case where only one processor 220 is included. However, it should be noted that the acoustic system 003 provided in the present application may also include multiple processors, and therefore, the operations and / or method steps disclosed in the present application may be performed by one processor or jointly by multiple processors. For example, if the processor 220 of the acoustic system performs step A and step B in the present application, it should be understood that step A and step B may also be performed jointly or separately by two different processors 220 (for example, the first processor performs step A, the second processor performs step B, or the first and second processors perform steps A and B together).
[0080] Figure 5 1 shows a flow chart of a signal processing method provided according to an embodiment of the present application. The signal processing method P100 described in the present application can be applied to the acoustic system 003 as described above. Specifically, the signal processing circuit 150 can execute the signal processing method P100. Figure 5 As shown, the signal processing method P100 may include:
[0081] S310: Obtain a first signal, where the first signal is obtained by collecting environmental sound when the first sound sensor in the sound sensor module is working, and the environmental sound at least includes a target sound, and the target sound is the sound output when the speaker is working.
[0082] S320: Obtain a second signal, where the second signal is obtained when the second sound sensor in the sound sensor module collects the environmental sound when it is working.
[0083] The signal processing circuit 150 can obtain the first signal from the first sound sensor 120-1 and obtain the second signal from the second sound sensor 120-2. As mentioned above, since the ambient sound includes both the sound emitted by the target sound source 160 and the target sound emitted by the speaker 110, the first signal and the second signal obtained by the signal processing circuit 150 both include the signal component from the target sound source 160 and the signal component from the speaker 110.
[0084] It should be noted that the present application does not limit the execution order of S310 and S320, and the execution order of the two can be interchanged, or the two can be executed simultaneously.
[0085] S330: Perform a first target operation on the first signal and the second signal to reduce the pickup of the target sound by the sound sensor module in the target frequency band and reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal.
[0086] The signal processing circuit 150 can generate a target signal by performing a first target operation 40 on the first signal and the second signal. The first target operation 40 can play the following two roles:
[0087] On the one hand, the signal processing circuit 150 can reduce the pickup of the target sound (i.e., the sound from the speaker 110) by the sound sensor module 120 at the target frequency band by performing the first target operation 40 on the first signal and the second signal. Here, "reducing the pickup of the target sound by the sound sensor module at the target frequency band" means that, compared with the pickup of the target sound by the sound sensor module 120 when the first target operation 40 is not performed, the pickup of the target sound by the sound sensor module 120 is reduced when the first target operation 40 is performed.
[0088] In some embodiments, the first target operation 40 may direct the zero-point pickup direction of the sound sensor module 120 in the target frequency band toward the speaker. The above-mentioned “zero-point pickup direction is directed toward the speaker” should be understood as the zero-point pickup direction generally being directed toward the speaker. For example, the zero-point pickup direction may be directed toward the center point of the speaker. For another example, the zero-point pickup direction may be directed toward any point on the sound output surface of the speaker. For another example, the zero-point pickup direction may be directed toward a preset area on the sound output surface of the speaker. For another example, assuming that the direction angle corresponding to the center point of the speaker is θ, the direction angle corresponding to the zero-point pickup direction may be located at It should be understood that when the zero-point pickup direction of the sound sensor module 120 points to the speaker, the sound emitted by the speaker is not collected by the sound sensor module 120, or is less collected by the sound sensor module 120. Therefore, the signal processing circuit 150 can reduce the pickup of the target sound by the sound sensor module 120 by pointing the zero-point pickup direction of the sound sensor module 120 in the target frequency band to the speaker.
[0089] It should be noted that the above-mentioned target frequency band can be a full frequency band or a partial frequency band. For example, the full frequency band can refer to the audio pickup band of the sound sensor module, and the partial frequency band can refer to a sub-frequency band in the audio pickup band of the sound sensor module. Among them, the audio pickup band refers to the frequency band range of the picked-up sound supported by the sound sensor module when it is working. It should be noted that when the target frequency band is a partial frequency band, the target frequency band can correspond to any sub-frequency band in the audio pickup band of the sound sensor module, for example, it can correspond to a high-frequency sub-frequency band in the audio pickup band, it can also correspond to a low-frequency sub-frequency band in the audio pickup band, it can also correspond to a medium-frequency sub-frequency band in the audio pickup band, etc.
[0090] On the other hand, the signal processing circuit 150 can also reduce the signal corresponding to the target sound picked up by the sound sensor module 120 by performing the first target operation 40 on the first signal and the second signal. Here, "the signal corresponding to the target sound" refers to the signal component from the speaker picked up by the sound sensor module 120. In some embodiments, the signal processing circuit 150 can reduce the signal corresponding to the target sound picked up by the sound sensor module 120 by filtering the signal picked up by the sound sensor module 120. It is not difficult to understand that the signal processing circuit 150 can reduce the signal component from the speaker 110 in the target signal by reducing the signal picked up by the sound sensor module 120.
[0091] It can be seen that the first target operation 40 can, on the one hand, reduce the pickup of the target sound by the sound sensor module 120 as much as possible (i.e., make the sound sensor module 120 pick up as little or no sound from the speaker as possible), and on the other hand, can also reduce the signal corresponding to the target sound picked up by the sound sensor module 120. By combining the above two aspects, the signal processing circuit 150 can minimize the signal component from the speaker in the target signal.
[0092] Figure 6 A schematic diagram of a signal processing process provided according to an embodiment of the present application is shown. Figure 7 FIG. 2 shows a schematic diagram of another signal processing process provided according to an embodiment of the present application. Figure 6 and Figure 7 As shown, the first target operation 40 may include a sound pickup control operation 43 and an adaptive filtering operation 44. The sound pickup control operation 43 is configured to direct the zero-point sound pickup direction of the sound sensor module 120 in the target frequency band toward the speaker to reduce the pickup of the target sound by the sound sensor module 120. The adaptive filtering operation 44 is configured to reduce the signal corresponding to the target sound picked up by the sound sensor module 120. In some embodiments, the adaptive filtering operation 44 can adaptively reduce the signal from the speaker 110 from the signal picked up by the sound sensor module 120 based on the input signal of the speaker 110. In this case, the above-mentioned adaptive filtering operation 44 can be implemented by an adaptive feedback cancellation (Adaptive Feedback Cancellation, AFC) algorithm.
[0093] In some embodiments, the above-mentioned sound pickup control operation 43 and / or adaptive filtering operation 44 can be implemented by the processor 220 in the signal processing circuit 150, that is, the processor 220 executes the instruction set and performs the sound pickup control operation 43 and / or adaptive filtering operation 44 according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a sound pickup control circuit, and the above-mentioned sound pickup control operation 43 can be implemented by the sound pickup control circuit. In some embodiments, the signal processing circuit 150 may include an adaptive filtering circuit, and the above-mentioned adaptive filtering operation 44 can be implemented by the adaptive filtering circuit.
[0094] In some embodiments, Figure 6 As shown, the signal processing circuit 150 may first perform the sound pickup control operation 43 and then perform the adaptive filtering operation 44. Specifically, the process of the signal processing circuit 150 performing the first target operation 40 may include:
[0095] (1) Performing a sound pickup control operation 43 on the first signal and the second signal to direct the sound sensor module 120 toward the speaker in the zero-point sound pickup direction of the target frequency band, thereby obtaining a sound pickup control output signal.
[0096] The signal processing circuit 150 can adjust the zero-point pickup direction of the sound sensor module 120 in the target frequency band to point to the speaker 110 by executing the pickup control operation 43. In this case, the single-channel signal picked up by the sound sensor module 120 is called the pickup control output signal. It should be understood that when the zero-point pickup direction of the sound sensor module 120 in the target frequency band points to the speaker 110, the sound sensor module 120 can reduce the pickup of the target sound in the target frequency band, so the signal component from the speaker 110 contained in the pickup control output signal is less. It should be noted that the specific implementation method of the pickup control operation 43 will be described in detail later and will not be repeated here.
[0097] (2) Obtaining an input signal of the loudspeaker, and performing an adaptive filtering operation 44 on the sound pickup control output signal based on the input signal to obtain the target signal.
[0098] Since the target sound is emitted by the speaker 110 based on the input signal, the signal processing circuit 150 can predict the pickup situation of the target sound by the sound sensor module 120 based on the input signal, and then adaptively filter the sound pickup control output signal based on the pickup situation to obtain the target signal. In this way, the signal component from the speaker 110 in the target signal is further reduced.
[0099] In some embodiments, see Figure 6The process of the signal processing circuit 150 performing the adaptive filtering operation 44 may include: providing a target gain to the input signal A third signal (i.e., a signal corresponding to the target sound) is obtained, and the target signal is obtained by subtracting the third signal from the sound pickup control output signal. For example, assuming that the input signal is u and the sound pickup control output signal is y, the target signal s can be expressed by the following formula:
[0100]
[0101] The target gain corresponds to the transfer function between the speaker 110 and the sound sensor module 120. Assuming that the transfer function between the speaker 110 and the sound sensor module 120 is F, the signal processing circuit 150 can predict the transfer function F to obtain a predicted transfer function, and determine the predicted transfer function as the target gain In this way, by providing a target gain to the input signal, it is possible to simulate the situation in which the target sound is picked up by the sound sensor module 120. Furthermore, considering that the transfer function F between the speaker 110 and the sound sensor module 120 is constantly changing due to factors such as the environment and user actions, a preset algorithm may be used in some embodiments to adjust the target gain. Perform adaptive update so that the target gain Continuously track the transfer function F (i.e. target gain With the change of transfer function F), so that based on the input signal u and the target gain The third signal obtained More precisely, the third signal It is possible to more accurately characterize the pickup result of the target sound by the sound sensor module 120. It should be noted that the present application does not limit the preset algorithm, for example, the least mean square (LMS) algorithm, the normalized least mean square (NLMS) algorithm, the recursive least square (RLS) algorithm, etc. can be used.
[0102] In some embodiments, Figure 7 As shown, the signal processing circuit 150 may also first perform the adaptive filtering operation 44 and then perform the sound pickup control operation 43. Specifically, the process of the signal processing circuit 150 performing the first target operation 40 may include:
[0103] (1) Obtaining an input signal of the speaker, and performing the adaptive filtering operation 44 on the first signal and the second signal based on the input signal to obtain a first filtered signal corresponding to the first signal and a second filtered signal corresponding to the second signal.
[0104] Since the target sound is emitted by the speaker 110 based on the input signal, the signal processing circuit 150 can predict the pickup conditions of the target sound by the first sound sensor 120-1 and the second sound sensor 120-2 based on the input signal, and then adaptively filter the first signal and the second signal based on the pickup conditions to obtain the first filtered signal and the second filtered signal. In other words, the first filtered signal can be regarded as a signal obtained by reducing the signal component from the speaker 110 in the first signal, and the second filtered signal can be regarded as a signal obtained by reducing the signal component from the speaker 110 in the second signal. Therefore, the first filtered signal and the second filtered signal contain fewer signal components from the speaker 110.
[0105] In some embodiments, see Figure 7 The process of the signal processing circuit 150 performing the adaptive filtering operation 44 may include: providing a first target gain to the input signal Obtain a fourth signal, and subtract the fourth signal from the first signal to obtain a first filtered signal, and provide a second target gain for the input signal A fifth signal is obtained, and the fifth signal is subtracted from the second signal to obtain a second filtered signal. For example, assuming that the input signal is u, the first signal is y1, and the second signal is y2, the first filtered signal s1 and the second filtered signal s2 can be expressed by the following formula:
[0106]
[0107]
[0108] Among them, the first target gain Corresponding to the transfer function between the speaker 110 and the first sound sensor 120-1, the second target gain Corresponding to the transfer function between the speaker 110 and the second sound sensor 120-2. It should be understood that the first target gain and the second target gain Determination method and target gain The method of determining is similar and will not be described here.
[0109] (2) Performing a sound pickup control operation 43 on the first filtered signal and the second filtered signal to obtain the target signal.
[0110] The signal processing circuit 150 can adjust the zero-point pickup direction of the sound sensor module 120 in the target frequency band to point to the speaker 110 by performing the pickup control operation 43 on the first filtered signal and the second filtered signal. It should be understood that when the zero-point pickup direction of the sound sensor module 120 in the target frequency band points to the speaker 110, the sound sensor module 120 can reduce the pickup of the target signal in the target frequency band, thereby further reducing the signal component from the speaker 110 contained in the target signal.
[0111] Above Figure 6 and Figure 7 Only the specific implementation of the adaptive filtering operation 44 is shown, and the implementation of the sound pickup control operation 43 is not shown. Figures 8 to 22 The specific implementation of the sound pickup control operation 43 is described in detail. It should be understood that any of the sound pickup control operations 43 described below can be applied to Figure 6 It can also be applied to Figure 7 middle.
[0112] Figure 8 FIG. 4 is a schematic diagram showing a sound pickup control operation 43a provided according to an embodiment of the present application. Figure 8 As shown, the sound pickup control operation 43a may include a zero-point differential operation 41, and the zero-point differential operation 41 is configured to perform a zero-point differential on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module 120 to point to the speaker 110, thereby obtaining a differential result signal. Among them, the first individual signal and the second individual signal are two input signals of the sound pickup control operation 43a. The first individual signal corresponds to the pickup signal of the first sound sensor 120-1, for example, it can be the original signal picked up by the first sound sensor 120-1, or it can be a signal after a preset processing is performed on the original signal. The second individual signal corresponds to the pickup signal of the second sound sensor 120-2, for example, it can be the original signal picked up by the second sound sensor 120-2, or it can be a signal after a preset processing is performed on the original signal. In some embodiments, when the sound pickup control operation 43a is applied to Figure 6 In some embodiments, when the sound pickup control operation 43a is applied to Figure 7, the first individual signal can be the first filtered signal, and the second individual signal can be the second filtered signal. The differential result signal is used as the output signal of the sound pickup control operation 43a. The above-mentioned "zero-point differential" refers to a differential operation that can adjust the zero-point sound pickup direction of the sound sensor module 120. It should be noted that the present application does not limit the specific method of differential operation, as long as the zero-point sound pickup direction of the sound sensor module 120 can be adjusted.
[0113] Fig. 9 FIG. 4 shows a schematic diagram of a zero-point differential operation 41a provided according to an embodiment of the present application. Fig. 9 As shown, the zero-point differential operation 41a may include: a first delay operation 411 and a first differential operation 413. The first delay operation 411 is configured to delay the second individual signal to obtain a second delayed signal. The first differential operation 413 is configured to differentiate the first individual signal from the second delayed signal (for example, the first individual signal is subtracted from the second delayed signal) to obtain a first differential signal.
[0114] Above Fig. 9 The zero-point differential operation 41a shown can be applied to the scenario where the speaker 110 is a far-field sound source. In this scenario, the distance between the speaker 110 and the sound sensor module 120 is relatively far, and it can be assumed that the amplitude and direction of the sound signals collected by the two sound sensors are the same, and there is only a time difference (i.e., phase difference) between the two. In this case, when the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1, the sound emitted by the speaker 110 is first collected by the second sound sensor 120-2, and then collected by the first sound sensor 120-1, that is, the phase of the signal component from the speaker 110 in the second individual signal precedes the signal component from the speaker 110 in the first individual signal. Therefore, the signal processing circuit 150 can align the phase of the signal component from the speaker 110 in the second delayed signal with the phase of the signal component from the speaker 110 in the first individual signal by performing the above-mentioned first delay operation 411 (i.e., delaying the second individual signal to obtain the second delayed signal).
[0115] In some embodiments, when the signal processing circuit 150 performs the first delay operation 411, it can determine the delay time length T corresponding to the second individual signal based on the following formula (4):
[0116] T=d / c Formula (4)
[0117] Wherein, d is the distance between the first sound sensor 120 - 1 and the second sound sensor 120 - 2 , and c is the speed of sound.
[0118] After executing the above-mentioned first delay operation 411, since the phase of the signal component from the speaker 110 in the second delayed signal is aligned with the phase of the signal component from the speaker 110 in the first body signal, the signal processing circuit 150 can cancel each other out by executing the first differential operation 413 (i.e., subtracting the first body signal from the second delayed signal), so that the signal component from the speaker 110 in the first body signal and the signal component from the speaker 110 in the second delayed signal, thereby making the obtained first differential signal present a pickup zero point characteristic in the direction of the speaker 110.
[0119] Fig.10 Shows Fig. 9 Schematic diagram of the sound pickup direction pattern corresponding to the zero-point differential operation 41a in FIG. Fig.10 As shown, the sound sensor module 120 presents a sound pickup zero point characteristic in the 180-degree direction. When the speaker 110 is located at or near the 180-degree direction, the sound sensor module 120 will not collect (or rarely collect) the sound emitted by the speaker 110. Fig. 9 The zero-point differential operation 41a shown can adjust the sound pickup direction pattern of the sound sensor module 120 to a cardioid shape, and the zero-point sound pickup direction points to the speaker 110. Therefore, the signal processing circuit 150 performs the following steps on the first individual signal and the second individual signal: Figure 7 The first differential signal obtained after the zero-point differential operation 41 a does not contain (or contains less) signal components from the speaker 110 .
[0120] Furthermore, the inventors Fig. 9 Through analysis and experiments, it is found that the zero-point differential operation 41a will attenuate the components of some frequency bands. Fig.11 Give an example. Fig.11 Shows the use of Fig. 9 FIG. 4 is a schematic diagram of a frequency response curve of a first differential signal obtained by the zero-point differential operation 41a. Fig.11 As shown, curve 1 represents the frequency response curve of the first differential signal in the 0 degree direction, and curve 2 represents the frequency response curve of the first differential signal in the 90 degree direction. It can be seen from curves 1 and 2 that the components of the first differential signal in some frequency bands (e.g., below 1000 Hz) are attenuated, that is, the sound sensor module 120 has a low sensitivity to sound signals in these frequency bands.
[0121] Therefore, in some embodiments, continue to see Fig. 9, the zero-point differential operation 41a may also include a gain compensation operation 416. The gain compensation operation 416 is configured to perform gain compensation on at least part of the frequency band of the first differential signal to obtain a sound pickup result signal. For example, gain compensation may be performed on the components of the frequency band (e.g., below 1000 Hz) in the first differential signal where attenuation exists, so that the sound sensor module 120 also has a high sensitivity to the sound signals in these frequency bands. Fig.11 , Curve 3 shows the frequency response curve of the compensated first differential signal (i.e., differential result signal) at 0 degrees, and Curve 4 shows the frequency response curve of the compensated first differential signal (i.e., differential result signal) at 90 degrees. It can be seen that the signal processing circuit 150 performs the gain compensation operation 416 (i.e., performs gain compensation on at least a part of the frequency band of the first differential signal), so that the sound sensor module 120 has a higher and flatter sensitivity to the sound signals of the full frequency band.
[0122] As mentioned earlier, Fig. 9 The zero-point differential operation 41a shown is applicable to the scenario where the speaker 110 is a far-field sound source. During the research process, the inventors found that when the distance between the speaker 110 and the sound sensor module 120 is relatively close (for example, less than or equal to 0.1m), the above far-field assumption (that is, the amplitude and direction of the sound signals collected by the two sound sensors are the same, and there is only a time difference between the two) is no longer valid. Therefore, for the near-field sound source scenario, if the Fig. 9 The zero-point differential operation 41a shown adjusts the sound pickup direction, and the adjusted sound pickup direction pattern no longer has a sound pickup zero point. To this end, the present application also provides another zero-point differential operation, which can be applied to both the far-field sound source and the near-field sound source of the speaker 110. Fig.12 Provide explanation.
[0123] Fig.12 FIG. 4 is a schematic diagram showing another zero-point differential operation 41b provided according to an embodiment of the present application. Fig.12 As shown, the zero-point differential operation 41 b may include: a first delay operation 411 , a second delay operation 412 , a first differential operation 413 , a second differential operation 414 and a third differential operation 415 .
[0124] Among them, the first delay operation 411 is configured to delay the second individual signal to obtain a second delayed signal. In some embodiments, the delay duration of the second individual signal can be determined based on the aforementioned formula (4), which is not described here. The second delay operation 412 is configured to delay the first individual signal to obtain a first delayed signal. In some embodiments, the delay duration of the first individual signal can be determined based on the aforementioned formula (4), which is not described here. The first differential operation 413 is configured to perform a differential on the first individual signal and the second delayed signal (i.e., subtract the first individual signal from the second delayed signal) to obtain a first differential signal. The second differential operation 414 is configured to perform a differential on the second individual signal and the first delayed signal (i.e., subtract the second individual signal from the first delayed signal) to obtain a second differential signal. The third differential operation 415 is configured to perform a differential on the first differential signal and the second differential signal (i.e., subtract the first differential signal from the second differential signal) to obtain a third differential signal.
[0125] It should be understood that Fig.12 The principle of adjusting the sound pickup direction of the zero point differential operation 41b shown is similar to Fig. 9 are similar, the difference between the two is Fig.12 The zero-point differential operation 41b in needs two delay operations, so Fig. 9 The scheme shown can be called a single-delay zero-point differential scheme. Fig.12 The scheme shown may be referred to as a double-delay zero-differential scheme. Fig.13 Shows Fig.12 Schematic diagram of the sound pickup direction adjustment principle corresponding to the zero-point differential operation 41b in FIG. Fig.13 As shown, the signal processing circuit 150 can construct a cardioid pattern with a zero-point pickup direction pointing to 180 degrees by performing the first delay operation 411 and the first differential operation 413 (see Fig.13 Pattern I), the construction principle is similar to Fig. 9 Further, the signal processing circuit 150 can construct a cardioid pattern with the zero-point pickup direction pointing to 0 degrees by performing the second delay operation 412 and the second differential operation 414 (see Fig.13 Pattern II) in the figure, the construction principle is also similar to Fig. 9 Similar, no further details will be given here. It should be understood that Fig.13 The heart-shaped pattern with the null-point pickup direction pointing to 180 degrees (i.e., pattern I) corresponds to the first differential signal, and the heart-shaped pattern with the null-point pickup direction pointing to 0 degrees (i.e., pattern II) corresponds to the second differential signal. The signal processing circuit 150 can obtain the figure-8 pattern with the null-point pickup direction pointing to 90 degrees and 270 degrees by performing the third differential operation 415 (equivalent to performing a difference between pattern I and pattern II) (see Fig.13 Pattern III).
[0126] It can be seen from the above-mentioned 8-shaped sound pickup direction pattern (i.e., pattern III) that the sound sensor module 120 presents a sound pickup zero point characteristic in the 90-degree and 270-degree directions. When the speaker 110 is located in the 90-degree / 270-degree direction or near the 90-degree / 270-degree direction, the sound sensor module 120 will not collect (or will rarely collect) the sound emitted by the speaker 110. It can be seen that Fig.12 The double-delay based zero-point differential operation 41b can adjust the sound pickup direction pattern of the sound sensor module 120 to an 8-shape, and the zero-point sound pickup direction points to the speaker 110. Therefore, the third differential signal obtained by the signal processing circuit 150 by performing the zero-point differential operation 41b does not contain (or contains less) signal components from the speaker 110.
[0127] Fig.14 Shows Fig.12 Schematic diagram of the sound pickup direction pattern of the zero-point differential operation 41b in three different scenarios. Fig.14 As shown, pattern I illustrates the sound pickup direction pattern obtained when the distance between the speaker 110 and the sound sensor module 120 is 1m, pattern II illustrates the sound pickup direction pattern obtained when the distance between the speaker 110 and the sound sensor module 120 is 0.1m, and pattern III illustrates the sound pickup direction pattern obtained when the distance between the speaker 110 and the sound sensor module 120 is 0.06m. Fig.14 It can be seen that no matter how far the distance between the speaker 110 and the sound sensor module 120 is, Fig.12 The zero-point differential operation 41b shown can obtain an 8-shaped sound pickup direction pattern. Fig.12 The zero-point differential operation 41b shown can be applied to the scenario where the speaker 110 is a near-field sound source, and can also be applied to the scenario where the speaker 110 is a far-field sound source. Fig.12 The zero-point differential operation 41 b shown can effectively reduce the signal component from the speaker 110 in the third differential signal in all scenarios.
[0128] For further information, see Fig.12 The zero-point differential operation 41b may also include a gain compensation operation 416. The gain compensation operation 416 is configured to perform gain compensation on at least a portion of the frequency band of the third differential signal to obtain a sound pickup result signal. It should be understood that Fig.12 The gain compensation operation 416 in Fig. 9 The principle and function of the mid-gain compensation operation 416 are the same and will not be described in detail here.
[0129] In adopting Fig.12 In the case of the zero-point differential operation 41b shown, the sound pickup zero point direction of the sound sensor module 120 points to 90 degrees and 270 degrees, that is, each position on the midpoint perpendicular line of the first sound sensor 120-1 and the second sound sensor 120-2 is located in the sound pickup zero point direction of the sound sensor module 120. Therefore, the speaker 110 can be set on the midpoint perpendicular line of the first sound sensor 120-1 and the second sound sensor 120-2 during product design, so that the sound pickup result signal of the sound sensor module 120 does not contain the signal component from the speaker 110. However, in actual applications, due to the influence of various factors such as product form, production error, wearing posture, etc., the speaker 110 is usually not strictly located on the midpoint perpendicular line of the first sound sensor 120-1 and the second sound sensor 120-2, so that the signal component of the speaker 110 in the sound pickup result signal of the sound sensor module 120 is reduced compared with the sound pickup result signal that has not undergone the zero-point differential operation, but still contains the signal component from the speaker 110. To this end, the present application also provides another zero-point differential operation that can adaptively adjust the zero-point sound pickup direction so that the signal component from the speaker 110 in the sound pickup result signal is minimal. Fig.15 Provide explanation.
[0130] Fig.15 FIG. 4 shows a schematic diagram of another zero-point differential operation 41c provided according to an embodiment of the present application. Fig.15 As shown, in Fig.12 On the basis of the zero-point differential operation 41b shown, the zero-point differential operation 41c may also include a multiplication operation 417 and a target parameter generation operation 418. The target parameter generation operation 418 is configured to generate a target parameter β with the goal of minimizing the signal component from the speaker 110 in the third differential signal. The multiplication operation 417 is performed between the second differential operation 414 and the third differential operation 415, or between the first differential operation 413 and the third differential operation 415. For ease of description, in the following text of this application and in the accompanying drawings, "the multiplication operation 417 is performed between the second differential operation 414 and the third differential operation 415" is used as an example for illustration. Specifically, the multiplication operation 417 is configured to multiply the target parameter β with the second differential signal to obtain a multiplication result, so that the third differential operation 415 performs a differential operation on the first differential signal and the multiplication result to obtain the third differential signal.
[0131] It should be understood that the second differential signal corresponds to Fig.13For pattern II in the image (i.e., a heart-shaped pattern with the zero-point pickup direction pointing to 0 degrees), the signal processing circuit 150 adjusts the second differential signal by multiplying the target parameter β by the second differential signal. Then, a third differential operation 415 is performed based on the first differential signal and the adjusted second differential signal, so that the zero-point pickup direction can be adjusted from 90 degrees / 270 degrees to other angles. Fig.16 FIG. 2 shows a schematic diagram of adjusting the zero-point pickup direction according to the target parameter β provided in an embodiment of the present application. Fig.16 As shown, when the value of the target parameter β is 0.99, the zero point in the sound pickup direction pattern points to 90 degrees and 270 degrees, and when the value of the target parameter β is updated to 0.16, the zero point in the sound pickup direction pattern points to 135 degrees and 225 degrees. It can be seen that the signal processing circuit 150 can adaptively adjust the zero-point sound pickup direction by performing the multiplication operation 417 and the target parameter generation operation 418, so that the signal component from the speaker 110 in the sound pickup result signal is minimized.
[0132] It should be noted that the various zero-point differential operations 41 (eg Fig. 9 The zero point differential operation 41a shown, Fig.12 The zero point differential operation 41b shown, Fig.15 The zero-point differential operation 41c) shown can be performed in the time domain or in the frequency domain, which is not limited in the present application.
[0133] In some embodiments, any one or more of the above-mentioned first delay operation 411, second delay operation 412, first differential operation 413, second differential operation 414, third differential operation 415, gain compensation operation 416, multiplication operation 417 and target parameter generation operation 418 can be implemented by the processor 220 in the signal processing circuit 150, that is, the processor 220 executes the instruction set and performs one or more of the above-mentioned operations according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a first delay circuit, and the above-mentioned first delay operation 411 may be implemented by the first delay circuit. In some embodiments, the signal processing circuit 150 may include a second delay circuit, and the above-mentioned second delay operation 412 may be implemented by the second delay circuit. In some embodiments, the signal processing circuit 150 may include a first differential circuit, and the above-mentioned first differential operation 413 may be implemented by the first differential circuit. In some embodiments, the signal processing circuit 150 may include a second differential circuit, and the above-mentioned second differential operation 414 may be implemented by the second differential circuit. In some embodiments, the signal processing circuit 150 may include a third differential circuit, and the third differential operation 415 may be implemented by the third differential circuit. In some embodiments, the signal processing circuit 150 may include a gain compensation circuit, and the gain compensation operation 416 may be implemented by the gain compensation circuit. In some embodiments, the signal processing circuit 150 may include a multiplication circuit, and the multiplication operation 417 may be implemented by the multiplication circuit. In some embodiments, the signal processing circuit 150 may include a target parameter generation circuit, and the target parameter generation operation 418 may be implemented by the target parameter generation circuit.
[0134] The zero-point differential operation 41 described above performs zero-point differential in the full frequency band of the first individual signal and the second individual signal (i.e., the sound pickup band of the sound sensor module 120). Therefore, the zero-point differential operation 41 can point the zero-point sound pickup direction of the sound sensor module 120 in the full frequency band to the speaker. Figure 8 The pickup control operation 43a shown in FIG. 4 can reduce the pickup of the target sound in the full frequency band. In some embodiments, the signal processing circuit 150 can also reduce the pickup of the target sound in a partial frequency band. In this case, the following method can be used: Fig.17 The pickup control operation 43b shown. Fig.17 For ease of description, it is assumed in the following that the sound sensor module 120 picks up sound in a first frequency band and a second frequency band, wherein the target frequency band corresponds to the first frequency band, that is, the signal processing circuit 150 reduces the pickup of the target sound in the first frequency band.
[0135] Fig.17FIG. 4 is a schematic diagram showing another sound pickup control operation 43b provided according to an embodiment of the present application. Fig.17 As shown, the sound pickup control operation 43b may include: a zero-point differential operation 41 and a signal synthesis operation 42. The zero-point differential operation 41 is configured to perform a zero-point differential on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module 120 to point to the speaker 110, thereby obtaining a differential result signal. It should be understood that Fig.17 The zero point differential operation 41 in the embodiment can be implemented as follows: Fig. 9 The zero-point differential operation 41a shown in FIG. 4 may also be performed as follows: Fig.12 The zero-point differential operation 41b shown can also be performed as follows Fig.15 The zero-point differential operation 41c shown is specifically described in the relevant part above and will not be elaborated here.
[0136] The signal synthesis operation 42 is configured to synthesize the differential result signal and the first individual signal to obtain a composite signal, wherein the component of the first frequency band in the composite signal comes from the differential result signal, and the component of the second frequency band comes from the first individual signal or the second individual signal. Since the first individual signal and the second individual signal have not undergone the zero-point differential operation 41, compared with the differential result signal, the first individual signal and the second individual signal can more accurately reflect certain characteristics of the real environment sound (such as background noise characteristics). Therefore, when the signal of the second frequency band comes from the first individual signal or the second individual signal, the components of the original signal are retained in the composite signal, so that the composite signal can more accurately reflect the characteristics of the real environment sound. It can be understood that in the case where the signal of the first frequency band in the composite signal comes from the differential result signal and the signal of the second frequency band comes from the first individual signal or the second individual signal, since the composite signal retains the components of the original signal and reduces the signal components from the speaker 110, the composite signal can reduce the signal components from the speaker 110 while reflecting the real environment sound as accurately as possible, thereby improving the accuracy of the composite signal. For ease of description, the following description uses the example that the signal in the second frequency band comes from the first individual signal. It should be understood that when the signal in the second frequency band comes from the second individual signal, the implementation method is similar and this application will not elaborate on this.
[0137] As can be seen from the above description, the zero-point differential operation 41 (eg Fig. 9 The zero point differential operation 41a shown, Fig.12 The zero point differential operation 41b shown, Fig.15The zero-point differential operation 41c) shown in the figure will include a gain compensation operation 416, and the gain compensation operation 416 will inevitably cause the background noise components in certain frequency bands in the sound pickup result signal to be raised. When the background noise is raised to a certain sound intensity, it will affect the user's auditory experience. Therefore, in some embodiments, the second frequency band may include the frequency band corresponding to the background noise of the current environment, and the first frequency band includes the frequency band other than the second frequency band. In this way, when the component of the second frequency band (i.e., the frequency band corresponding to the background noise) in the integrated signal comes from the first individual signal, and the component of the first frequency band (other frequency bands except the frequency band corresponding to the background noise) comes from the differential result signal, since the first individual signal has not undergone the zero-point differential operation 41, it can truly reflect the background noise characteristics of the current environment, and therefore, the problem of the background noise component being raised can be avoided.
[0138] In practical applications, considering that the background noise in the environment is usually low-frequency noise, in some embodiments, the frequency in the first frequency band may be higher than the frequency in the second frequency band. For example, the first frequency band may be a high frequency band, and the second frequency band may be a low frequency band. For another example, the first frequency band may be a medium-high frequency band, and the second frequency band may be a low frequency band. For another example, the first frequency band may be a high frequency band, and the second frequency band may be a medium-low frequency band. For another example, the first frequency band may be a medium frequency band, and the second frequency band may be a low frequency band, and so on. In other words, the frequency band corresponding to the lower frequency range in the audio pickup band of the sound sensor module 120 is used as the second frequency band, and the component of the second frequency band in the integrated signal is taken from the first signal, thereby avoiding the problem of the background noise component being raised.
[0139] Among them, the above-mentioned low frequency band refers to the frequency band generally below 1KHz, the medium frequency band refers to the frequency band generally between 1KHz-4KHz, the high frequency band refers to the frequency band above 4KHz, the medium-low frequency band refers to the frequency band generally below 4KHz, and the medium-high frequency band refers to the frequency band generally above 1KHz. It should be understood by ordinary technicians in this field that the distinction of the above frequency bands is only given as an example. The definition of the above frequency bands may change with different industries, different application scenarios and different classification standards. For example, in some application scenarios, the above-mentioned low frequency band may refer to the frequency band of generally 20Hz to 150Hz, the medium frequency band may refer to the frequency band of generally 150Hz to 5KHz, the high frequency band may refer to the frequency band of generally 5KHz to 20KHz, the medium-low frequency band may refer to the frequency band of generally 150Hz to 500Hz, and the medium-high frequency band may refer to the frequency band of 500Hz to 5KHz. For example, in some other application scenarios, the low frequency band refers to the frequency band of roughly 20Hz to 80Hz, the mid-low frequency band may refer to the frequency band of roughly 80Hz-160Hz, the mid-frequency band may refer to the frequency band of roughly 160Hz to 1280Hz, the mid-high frequency band may refer to the frequency band of roughly 1280Hz-2560Hz, and the high frequency band may refer to the frequency band of roughly 2560Hz to 20KHz.
[0140] In some embodiments, the above-mentioned zero-point differential operation 41 and / or signal synthesis operation 42 can be implemented by the processor 220 in the signal processing circuit 150, that is, the processor 220 executes the instruction set and performs the zero-point differential operation 41 and / or signal synthesis operation 42 according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a zero-point differential circuit, and the above-mentioned zero-point differential operation 41 can be implemented by the zero-point differential circuit. In some embodiments, the signal processing circuit 150 may include a signal synthesis circuit, and the above-mentioned signal synthesis operation 42 can be implemented by the signal synthesis circuit.
[0141] Fig.18 A schematic diagram of another sound pickup control operation 43b provided according to an embodiment of the present application is shown, which is used to Fig.17 The signal synthesis operation 42 in FIG. Fig.18As shown, the signal synthesis operation 42 may include: a first filtering operation 421, a second filtering operation 422 and a synthesis operation 424. The first filtering operation 421 is configured to perform a first filtering on the first individual signal to obtain a component of the second frequency band in the first individual signal. For example, when the second frequency band is a low frequency band, the first filtering operation 421 may be implemented by a low-pass filter. The second filtering operation 422 is configured to perform a second filtering on the differential result signal to obtain a component of the first frequency band in the differential result signal. For example, when the first frequency band is a high frequency band, the second filtering operation 422 may be implemented by a high-pass filter. The synthesis operation 424 is configured to synthesize the component of the second frequency band obtained by the first filtering operation 421 with the component of the first frequency band obtained by the second filtering operation 422 to obtain the synthesized signal. In some embodiments, the synthesis operation 424 may be implemented by an adder. It can be seen that the signal processing circuit 150 performs the signal synthesis operation 42 so that the first frequency band in the synthesized signal comes from the differential result signal, and the second frequency band comes from the first individual signal.
[0142] In some embodiments, the first filtering and the second filtering may be complementary filtering, or in other words, the sum of the transfer function of the first filtering and the transfer function of the second filtering is equal to 1. For example, assuming that the transfer function corresponding to the first filtering is expressed as the following formula (2), the transfer function corresponding to the second filtering can be expressed as the following formula (3).
[0143]
[0144]
[0145] It can be seen from formula (5) and formula (6) that the denominator expressions corresponding to the transfer functions of the two filtering operations are the same, both A(z), and the numerator expressions corresponding to the transfer functions of the two filtering operations are B(z) and A(z)-B(z) respectively. This design makes the sum of the transfer functions of the two filtering operations equal to 1, so that the two filtering operations present an all-pass characteristic when working in combination. For ease of understanding, Fig.19 FIG. 2 shows a schematic diagram of a frequency response curve corresponding to a set of complementary filtering operations provided according to an embodiment of the present application. Fig.19 As shown, curve 1 can correspond to Fig.18 The frequency response curve of the first filtering operation 421 in the example shows a low-pass characteristic. Curve 2 may correspond to Fig.18 The frequency response curve of the second filtering operation 422 in FIG. 4 shows a high-pass characteristic. When the above two filtering operations are used in combination, they will show an all-pass characteristic.
[0146] It should be noted that the complementary filtering operations illustrated in the above formulas (5) and (6) are only used as a possible example. Those skilled in the art will appreciate that any filter group capable of frequency division and synthesis is feasible. For example, in some embodiments, the above-mentioned first filtering and second filtering can also be implemented by a first filter and a second filter having the same cutoff frequency. The cutoff frequency of the first filter is w1, and the cutoff frequency of the second filter is w2. The cutoff frequencies of the two filters are the same: w1=w2, and the amplitude responses of the two filters at the cutoff frequency satisfy
[0147] Fig. 20 Shows Fig.18 Schematic diagram of the background noise components corresponding to the differential result signal and the integrated signal. Fig. 20 As shown, curve 1 shows the background noise component in the first individual signal, and curve 2 shows the background noise component in the second individual signal. Fig. 9 The noise floor component in the differential result signal obtained by the zero-point differential operation 41a (corresponding to the cardioid pickup direction pattern) shown in FIG. Fig.12 The noise floor component in the differential result signal obtained by the zero-point differential scheme 41b (corresponding to the 8-shaped sound pickup direction pattern) is shown in FIG. Fig. 9 The zero-point differential operation 41a shown (single-delay zero-point differential solution) is still Fig.12 The zero-point differential operation 41b (double-delay zero-point differential solution) shown will greatly increase the background noise of the low frequency band (ie, the second frequency band), thereby causing greater noise interference to the user.
[0148] Continue to see Fig. 20 , Curve 5 shows the first individual signal and Fig. 9 The noise floor component in the integrated signal is obtained by performing frequency-band synthesis on the differential result signal obtained by the zero-point differential operation 41a (corresponding to the cardioid pickup direction pattern). Curve 6 shows the noise floor component in the integrated signal obtained by performing frequency-band synthesis on the first individual signal and Fig.12 The noise floor component in the integrated signal obtained by performing frequency band synthesis of the differential result signal obtained by the zero-point differential operation 41b (corresponding to the 8-shaped sound pickup direction pattern) shown in FIG. 5 and FIG. 6 show that the signal processing circuit 150 can avoid the noise floor rise problem caused by the zero-point differential operation 41 by performing the signal synthesis operation 42, thereby avoiding noise interference to the user.
[0149] In some embodiments, when there are multiple speakers 110, the sound frequency bands corresponding to different speakers may be different. In this case, different zero-point differential schemes may be used for different frequency bands, so that the zero-point pickup directions of the sound sensor module 120 in different frequency bands are all directed to the speakers of the corresponding frequency bands, thereby minimizing the signal components from each speaker in the integrated signal. Taking two speakers as an example, for the convenience of description, the two speakers are respectively referred to as the first speaker and the second speaker. The first frequency band may include a first sub-band and a second sub-band. Correspondingly, the signal of the first sub-band in the integrated signal comes from the first sound pickup result signal obtained by the sound sensor module 120 in the first sound pickup state, and the first sound pickup state corresponds to the zero-point pickup direction of the sound sensor module 120 pointing to the first speaker. The signal of the second sub-band in the integrated signal comes from the second sound pickup result signal obtained by the sound sensor module 120 in the second sound pickup state, and the second sound pickup state corresponds to the zero-point pickup direction of the sound sensor module 120 pointing to the second speaker. Wherein, the sound pickup direction patterns corresponding to the first sound pickup state and the second sound pickup state are different. That is to say, when the signal processing circuit 150 performs the sound pickup control operation 43, different zero-point differential operations 41 may be used for the first sub-frequency band and the second sub-frequency band, respectively, so that the sound pickup direction pattern corresponding to the first sub-frequency band is different from the sound pickup direction pattern corresponding to the second sub-frequency band. In practical applications, considering that each zero-point differential scheme may have different zero-point attenuation effects (i.e., the sound intensity attenuation in the zero-point sound pickup direction) in different frequency bands, therefore, the zero-point differential operation 41 with better zero-point attenuation effect may be used for the first sub-frequency band and the second sub-frequency band, respectively, with reference to the zero-point attenuation performance of each zero-point differential operation 41 in different frequency bands, so that the zero-point attenuation effect of the overall frequency band is improved.
[0150] Fig.21 FIG. 1 is a schematic diagram showing the zero-point attenuation effect corresponding to different zero-point differential operations provided in an embodiment of the present application. Fig.21 As shown, Curve 1 shows the frequency response diagram of the first individual signal. Curve 2 shows the frequency response diagram of the first individual signal. Fig. 9 The frequency response diagram of the differential result signal obtained by the zero-point differential operation 41a (corresponding to the cardioid pickup direction pattern) in the zero-point pickup direction is shown in FIG. Fig.12 The frequency response diagram of the differential result signal obtained by the zero-point differential operation 41b (corresponding to the 8-shaped sound pickup direction pattern) in the zero-point sound pickup direction is shown. Fig.21 It can be seen that in the 1kHz-4kHz frequency band, the attenuation of curve 2 relative to curve 1 is greater than the attenuation of curve 3 relative to curve 1, that is, Fig. 9 The zero-point differential operation 41a (corresponding to a cardioid pickup direction pattern) shown has a sound intensity attenuation in the zero-point pickup direction greater than Fig.12The zero-point differential operation 41b (corresponding to the 8-shaped pickup direction pattern) shown in the figure shows the attenuation of the sound intensity in the zero-point pickup direction. Therefore, within the 1kHz-4kHz frequency band, Fig. 9 The zero-point differential operation 41a shown (corresponding to a cardioid pickup pattern) has a zero-point attenuation effect that is better than Fig.12 The zero-point differential operation 41b is shown (corresponding to an 8-shaped sound pickup direction pattern).
[0151] Continue to see Fig.21 , in the 4kHz-8kHz frequency band, the attenuation of curve 3 relative to curve 1 is more obvious than the attenuation of curve 2 relative to curve 1, that is, Fig.12 The zero-point differential operation 41b (corresponding to the 8-shaped sound pickup direction pattern) shown in FIG. 1 has a sound intensity attenuation greater than Fig. 9 The zero-point differential operation 41a (corresponding to the cardioid pickup direction pattern) shown in the figure shows the attenuation of the sound intensity in the zero-point pickup direction. Therefore, within the 4kHz-8kHz frequency band, Fig.12 The zero-point differential operation 41b (corresponding to the 8-shaped sound pickup direction pattern) has a zero-point attenuation effect that is better than Fig. 9 The zero-point differential operation 41a is shown (corresponding to a cardioid pickup direction pattern).
[0152] based on Fig.21 In some embodiments, the first frequency band may be divided into a first sub-frequency band and a second sub-frequency band, and the frequency in the first sub-frequency band is lower than the frequency in the second sub-frequency band. For example, the first sub-frequency band may be a mid-frequency band (e.g. Fig.21 1kHz-4kHz as shown), the second sub-band can be a high frequency band (such as Fig.21 In this case, the following can be used for the first sub-band: Fig. 9 The zero-point differential operation 41a shown in the figure, at this time, the sound pickup direction pattern corresponding to the sound sensor module 120 is a cardioid; for the second sub-band, the Fig.12 The zero-point differential operation 41b shown, or the Fig.15 In the zero-point differential operation 41c shown, at this time, the sound pickup direction pattern corresponding to the sound sensor module 120 is in the shape of a figure 8. Therefore, both the first sub-band and the second sub-band have a large attenuation in the zero-point sound pickup direction, thereby improving the zero-point attenuation effect as a whole.
[0153] Fig. 22 A schematic diagram of another sound pickup control operation 43b provided according to an embodiment of the present application is shown. Assume that the acoustic system 003 includes a first speaker and a second speaker, the sound frequency band of the first speaker includes a first sub-frequency band, and the sound frequency band of the second speaker includes a second sub-frequency band. Fig. 22This is applicable to the scenario where the first sub-band and the second sub-band use different zero-point differential operations. Fig. 22 As shown, the zero point differential operation 41 may include a first zero point differential operation 41-1 and a second zero point differential operation 41-2. The first zero point differential operation 41-1 may be implemented as follows: Fig. 9 The zero-point differential operation 41a shown in FIG. 1 (i.e., a single-delay zero-point differential scheme corresponding to a cardioid pickup direction pattern) and the second zero-point differential operation 41-2 may be implemented as follows: Fig.12 The zero point differential operation 41b shown or Fig.15 The signal processing circuit 150 may perform a first zero point differential operation 41-1 on the first individual signal and the second individual signal after obtaining the first individual signal and the second individual signal, so that the zero point pickup direction of the sound sensor module 120 points to the first speaker, thereby obtaining a first differential result signal, and perform a second zero point differential operation 41-2 on the first individual signal and the second individual signal, so that the zero point pickup direction of the sound sensor module 120 points to the second speaker, thereby obtaining a second differential result signal.
[0154] Continue to see Fig. 22 , the signal synthesis operation 42 may include: a first filtering operation 421, a second filtering operation 422, a third filtering operation 423 and a synthesis operation 424. Among them, the first filtering operation 421 is configured to perform a first filtering on the first body signal to obtain a component of the second frequency band in the first body signal. For example, the second frequency band may be a low frequency band (for example, less than 1000Hz), and the first filtering operation 421 may be implemented by a low-pass filter. The second filtering operation 422 is configured to perform a second filtering on the first differential result signal to obtain a component of the first sub-frequency band in the first differential result signal. For example, the first sub-frequency band may be a high frequency band (for example, greater than 4kHz), and the second filtering operation 422 may be implemented by a high-pass filter. The third filtering operation 423 is configured to perform a third filtering on the second differential result signal to obtain a component of the second sub-frequency band in the second differential result signal. For example, the second sub-frequency band may be a mid-frequency band (for example, 1kHz-4kHz), and the second filtering operation 422 may be implemented by a band-pass filter. The synthesis operation 424 is configured to synthesize the components of the second frequency band obtained by the first filtering operation 421, the components of the first sub-frequency band obtained by the second filtering operation 422, and the components of the second sub-frequency band obtained by the third filtering operation 423 to obtain a composite signal. In some embodiments, the synthesis operation 424 can be implemented by an adder.
[0155] and Fig.18 Similar to the example shown, Fig. 22The first filtering operation 421, the second filtering operation 422, and the third filtering operation 423 in the embodiment can be referred to as a set of complementary filters, or in other words, the sum of the transfer function corresponding to the first filtering operation 421, the transfer function corresponding to the second filtering operation 422, and the transfer function corresponding to the third filtering operation 423 is equal to 1. For the description and effect of the complementary filter, please refer to the relevant description above, which will not be repeated here.
[0156] In some embodiments, any one or more of the first filtering operation 421, the second filtering operation 422, the third filtering operation 423 and the synthesis operation 424 can be implemented by the processor 220 in the signal processing circuit 150, that is, the processor 220 executes the instruction set and performs one or more of the above operations according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a first filtering circuit, and the first filtering operation 421 may be implemented by the first filtering circuit. In some embodiments, the signal processing circuit 150 may include a second filtering circuit, and the second filtering operation 422 may be implemented by the second filtering circuit. In some embodiments, the signal processing circuit 150 may include a third filtering circuit, and the third filtering operation 423 may be implemented by the third filtering circuit. In some embodiments, the signal processing circuit 150 may include a synthesis circuit, and the synthesis operation 424 may be implemented by the synthesis circuit.
[0157] S340: Perform a second target operation on the target signal.
[0158] After obtaining the target signal, the signal processing circuit 150 may perform a second target operation 50 on the target signal based on the requirements of the application scenario. Figure 6 and Figure 7, the signal processing circuit 150 can also be connected to the speaker 110. In this case, the second target operation 50 may include a gain amplification operation 51. After obtaining the target signal, the signal processing circuit 150 may perform a gain amplification operation 51 on the target signal, and then send the gain-amplified signal to the speaker 110 so that the speaker 110 emits a sound. In some embodiments, when the acoustic system 003 includes a first speaker and a second speaker, the signal processing circuit 150 may perform a gain amplification operation 51 on the target signal to obtain a gain-amplified signal, and then, according to the sound frequency bands of the first speaker and the second speaker, perform a frequency division operation on the gain-amplified signal, and send the frequency-divided signal to the first speaker and the second speaker respectively. For example, assuming that the sound frequency band of the first speaker includes the second frequency band and the first sub-frequency band, and the sound frequency band of the second speaker includes the second sub-frequency band, in this case, the frequency division operation can extract the first target signal corresponding to the second frequency band and the first sub-frequency band from the gain-amplified signal, and extract the second target signal corresponding to the second sub-frequency band. Furthermore, the signal processing circuit 150 may send the first target signal to the first speaker, and send the second target signal to the second speaker. The frequency division operation may be implemented by a filter or other feasible methods, which are not limited in the present application. The above scheme may be applied to Figure 1 It should be understood that since the signal component from the speaker 110 is reduced in the target signal (or the signal strength from the speaker 110 is reduced), the sound emitted by the speaker 110 is destroyed. Figure 1 The closed loop circuit shown in the figure generates the condition of howling, so as to achieve the effect of suppressing howling. In some embodiments, the above-mentioned gain amplification operation 51 can be implemented by the processor 220 in the signal processing circuit 150, that is, the processor 220 executes the instruction set and performs the above-mentioned gain amplification operation 51 according to the instruction of the instruction set. In some embodiments, the signal processing circuit 150 may include a gain amplification circuit, and the above-mentioned gain amplification operation 51 can be implemented by the gain amplification circuit.
[0159] In some embodiments, the speaker 110, the sound sensor module 120 and the signal processing circuit 150 are integrated in the first acoustic device, and the first acoustic device is connected to the second acoustic device for communication. In this case, the second target operation 50 may include: sending the target signal to the second acoustic device to reduce the echo of the second acoustic device. Figure 2The echo cancellation scenario shown. For example, the first acoustic device can be a local device, and the second acoustic device can be a remote device. Since the signal component from the speaker is reduced in the target signal (or the signal strength from the speaker is reduced), it is equivalent to reducing the sound from the second acoustic device. Therefore, when the second acoustic device receives the target signal and plays it, the user on the second acoustic device side (i.e., the remote user) will not hear or hear less of the echo, thereby achieving the effect of echo cancellation.
[0160] In summary, the present application provides a signal processing method and an acoustic system, wherein the signal processing method includes: obtaining a first signal and a second signal, wherein the first signal is obtained by collecting environmental sounds when the first sound sensor in the sound sensor module is working, and the second signal is obtained by collecting environmental sounds when the second sound sensor in the sound sensor module is working, wherein the environmental sounds at least include the target sounds emitted when the loudspeaker is working, and performing a first target operation on the first signal and the second signal to reduce the sound sensor module's pickup of the target sound in the target frequency band and reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal, and then performing a second target operation on the target signal. In the above scheme, since the first target operation can reduce the sound sensor module's pickup of the target sound on the one hand, and can also reduce the signal corresponding to the target sound picked up by the sound sensor module on the other hand, the obtained target signal does not contain or contains less signal components from the loudspeaker, so that the acoustic system can achieve the effect of suppressing howling or eliminating echoes.
[0161] On the other hand, the present application provides a non-transitory storage medium storing at least one set of executable instructions for image recognition. When the executable instructions are executed by the processor, the executable instructions instruct the processor to implement the steps of the method P100 for image recognition described in the present application. In some possible implementations, various aspects of the present application can also be implemented in the form of a program product, which includes a program code. When the program product is run on a computing device 600, the program code is used to enable the computing device 600 to perform the steps of the method P100 for image recognition described in the present application. The program product for implementing the above method can use a portable compact disk read-only memory (CD-ROM) to include program code and can be run on a computing device 600. However, the program product of the present application is not limited to this. In the present application, a readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system or used in combination with it. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media include: an electrical connection with one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. The computer-readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above. Program code for performing the operations of the present application may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the computing device 600, partially on the computing device 600, as a stand-alone software package, partially on the computing device 600 and partially on a remote computing device, or entirely on a remote computing device.
[0162] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require a specific order or a continuous order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0163] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented only by way of example and may not be restrictive. Although not explicitly stated herein, those skilled in the art will appreciate that the requirements of this application encompass various reasonable changes, improvements and modifications to the embodiments. These changes, improvements and modifications are intended to be proposed by the present application and are within the spirit and scope of the exemplary embodiments of the present application.
[0164] In addition, certain terms in this application have been used to describe embodiments of the present application. For example, "one embodiment", "embodiment" and / or "some embodiments" mean that a particular feature, structure or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present application. Therefore, it can be emphasized and should be understood that two or more references to "embodiment" or "one embodiment" or "alternative embodiment" in various parts of the present application do not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics can be appropriately combined in one or more embodiments of the present application.
[0165] It should be understood that in the foregoing description of the embodiments of the present application, in order to help understand a feature and for the purpose of simplifying the present application, the present application combines various features in a single embodiment, drawing or its description. However, this does not mean that the combination of these features is necessary. When reading the present application, it is entirely possible for a person skilled in the art to mark out a part of the devices as a separate embodiment. In other words, the embodiments in the present application can also be understood as the integration of multiple secondary embodiments. This is also true when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.
[0166] Each patent, patent application, patent application publication, and other material, such as articles, books, specifications, publications, documents, articles, etc., cited herein, except any historical prosecution documents to which it is relevant, any equivalent that may be inconsistent or conflicting with this document, or any equivalent historical prosecution documents that may have a limiting effect on the broadest scope of the claims, may be incorporated herein by reference and used for all purposes now or hereafter associated with this document. In addition, in the event of any inconsistency or conflict between the descriptions, definitions, and / or use of terms associated with any of the incorporated materials and the terminology, descriptions, definitions, and / or use associated with this document, the terminology in this document shall control.
[0167] Finally, it should be understood that the embodiments of the application disclosed herein are explanations of the principles of the embodiments of the present application. Other modified embodiments are also within the scope of the present application. Therefore, the embodiments disclosed in the present application are merely examples and not limitations. Those skilled in the art can adopt alternative configurations according to the embodiments in the present application to implement the application in the present application. Therefore, the embodiments of the present application are not limited to the embodiments accurately described in the application.
Claims
1. A signal processing method, It is characterized in that Included, through signal processing circuitry: Obtaining a first signal, wherein the first signal is obtained by collecting environmental sound when the first sound sensor in the sound sensor module is working, wherein the environmental sound at least includes a target sound, and the target sound is the sound output when the speaker is working; Obtaining a second signal, where the second signal is obtained by collecting the environmental sound when the second sound sensor in the sound sensor module is working; Performing a first target operation on the first signal and the second signal to reduce the pickup of the target sound by the sound sensor module in a target frequency band and to reduce the signal corresponding to the target sound picked up by the sound sensor module, thereby obtaining a target signal; as well as A second target operation is performed on the target signal.
2. The method according to claim 1, It is characterized in that The first target operation includes: A sound pickup control operation is performed to direct the zero-point sound pickup direction of the sound sensor module in the target frequency band toward the speaker; and The adaptive filtering operation attenuates the signal corresponding to the target sound.
3. The method according to claim 2, It is characterized in that The sound pickup control operation is performed by a sound pickup control circuit in the signal processing circuit, and the adaptive filtering operation is performed by an adaptive filtering circuit in the signal processing circuit.
4. The method according to claim 2, It is characterized in that The performing a first target operation on the first signal and the second signal includes: performing the sound pickup control operation on the first signal and the second signal to obtain a sound pickup control output signal; and An input signal of the loudspeaker is obtained, and the adaptive filtering operation is performed on the sound pickup control output signal based on the input signal to obtain the target signal.
5. The method according to claim 4, It is characterized in that The adaptive filtering operation includes: Providing a target gain to the input signal to obtain a third signal, wherein the target gain corresponds to a transfer function from the speaker to the sound sensor module; and The target signal is obtained by subtracting the third signal from the sound pickup control output signal.
6. The method according to claim 2, It is characterized in that The performing a first target operation on the first signal and the second signal includes: Obtaining an input signal of the speaker, and performing the adaptive filtering operation on the first signal and the second signal based on the input signal to obtain a first filtered signal corresponding to the first signal and a second filtered signal corresponding to the second signal; and The sound pickup control operation is performed on the first filtered signal and the second filtered signal to obtain the target signal.
7. The method according to claim 6, It is characterized in that The adaptive filtering operation includes: Providing a first target gain to the input signal to obtain a fourth signal, and subtracting the fourth signal from the first signal to obtain the first filtered signal, wherein the first target gain corresponds to a transfer function between the speaker and the first sound sensor; and A second target gain is provided to the input signal to obtain a fifth signal, and the fifth signal is subtracted from the second signal to obtain the second filtered signal, wherein the second target gain corresponds to a transfer function from the speaker to the second sound sensor.
8. The method according to claim 2, It is characterized in that The target frequency band corresponds to the audio pickup band of the sound sensor module; as well as The sound pickup control operation includes: A zero-point differential operation is performed on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module to point to the speaker, thereby obtaining a differential result signal, wherein the first individual signal corresponds to the pickup signal of the first sound sensor, and the second individual signal corresponds to the pickup signal of the second sound sensor, and the differential result signal is used as the output signal of the sound pickup control operation.
9. The method according to claim 2, It is characterized in that The sound pickup band of the sound sensor module includes a first frequency band and a second frequency band, and the target frequency band corresponds to the first frequency band; as well as The sound pickup control operation includes: a zero-point differential operation, performing a zero-point differential on the first individual signal and the second individual signal to adjust the zero-point sound pickup direction of the sound sensor module to point to the speaker, thereby obtaining a differential result signal, wherein the first individual signal corresponds to the pickup signal of the first sound sensor, and the second individual signal corresponds to the pickup signal of the second sound sensor, and A signal synthesis operation is performed to synthesize the differential result signal and the first individual signal to obtain a comprehensive signal, and the comprehensive signal is used as the output signal of the sound pickup control operation, wherein the component of the first frequency band in the comprehensive signal comes from the differential result signal, and the component of the second frequency band comes from the first individual signal.
10. The method according to claim 9, It is characterized in that The signal synthesis operation includes: Performing a first filtering on the first individual signal to obtain a component of the second frequency band in the first individual signal; Performing a second filtering on the differential result signal to obtain a component of the first frequency band in the differential result signal; and The component of the first frequency band is synthesized with the component of the second frequency band to obtain the integrated signal.
11. The method according to claim 10, It is characterized in that The first filtering and the second filtering are complementary filtering.
12. The method according to claim 8 or 9, It is characterized in that The zero point differential operation includes: A first delay operation is performed to delay the second individual signal to obtain a second delayed signal; A first differential operation is performed to perform a differential operation on the first individual signal and the second delayed signal to obtain a first differential signal; and The gain compensation operation performs gain compensation on signals of at least a partial frequency band in the first differential signal to obtain the differential result signal.
13. The method according to claim 8 or 9, It is characterized in that The zero point differential operation includes: A first delay operation is performed to delay the second individual signal to obtain a second delayed signal; A second delay operation is performed to delay the first individual signal to obtain a first delayed signal; A first differential operation is performed to perform a differential operation on the first individual signal and the second delayed signal to obtain a first differential signal; A second differential operation is performed to perform a differential operation on the second individual signal and the first delayed signal to obtain a second differential signal; a third differential operation, performing a differential operation on the first differential signal and the second differential signal to obtain a third differential signal; and The gain compensation operation performs gain compensation on signals of at least a partial frequency band in the third differential signal to obtain the differential result signal.
14. The method according to claim 13, It is characterized in that The zero point differential operation further includes: a target parameter generating operation, generating the target parameter with the goal of minimizing the signal component from the loudspeaker in the third differential signal; and A multiplication operation is performed between the second differential operation and the third differential operation, multiplying the target parameter with the second differential signal to obtain a multiplication result, so that the third differential operation performs a differential operation on the first differential signal and the multiplication result to obtain the third differential signal.
15. The method according to claim 1, It is characterized in that The second target operation includes: performing gain amplification on the target signal and sending the gain-amplified signal to the speaker, so that the speaker emits the target sound.
16. The method according to claim 1, It is characterized in that The loudspeaker and the sound sensor module are deployed on a first acoustic device, and the first acoustic device is communicatively connected with a second acoustic device; as well as The second target operation includes sending the target signal to the second acoustic device to reduce an echo of the second acoustic device.
17. An acoustic system, It is characterized in that include: The speaker receives input signals and outputs target sounds when in operation; The sound sensor module comprises at least: a first sound sensor and a second sound sensor, wherein the first sound sensor collects environmental sounds and generates a first signal when in operation, and the second sound sensor collects the environmental sounds and generates a second signal when in operation, wherein the environmental sounds at least include the target sound; as well as The signal processing circuit is connected to the sound sensor module and executes the method according to any one of claims 1 to 16 when in operation.
18. The acoustic system according to claim 17, It is characterized in that The signal processing circuit comprises: at least one storage medium storing at least one instruction set for performing signal processing; and A processor is communicatively connected to the sound sensor module and the at least one storage medium, wherein when the acoustic system is running, the processor reads the at least one instruction set and executes the method of any one of claims 1-16 according to the instructions of the at least one instruction set.
19. The acoustic system according to claim 17, It is characterized in that The acoustic system is any one of a hearing aid system, a sound amplification system, a headphone system, a telephone system, and a conference system.
20. The acoustic system according to claim 17, It is characterized in that The acoustic system is a hearing aid system, and the acoustic system further comprises a housing, wherein the speaker, the sound sensor module and the signal processing circuit are arranged in the housing, wherein When the acoustic system is worn on the user's head, the sound output end of the speaker faces the user's head, and the sound pickup end of at least one sound sensor in the sound sensor module is located on a side of the housing away from the user's head.
