Signal processing method and acoustic system

Abstract

The embodiment of the invention provides a signal processing method and an acoustic system, M sound sensors in a sound sensor module collect environment sound and generate M pickup signals when working, and the environment sound comprises first sound from a loudspeaker and second sound from a target sound source, the signal processing circuit can perform filtering operation on the M pickup signals based on M groups of target filtering parameters to obtain M filtering signals, perform synthesis operation on the M filtering signals to obtain a comprehensive signal, and perform target operation on the comprehensive signal. The M groups of target filtering parameters are configured to minimize signal components from the loudspeaker in the comprehensive signal under the target constraint, so that the filtering operation can reduce or eliminate feedback sound (namely sound from the loudspeaker) in the acoustic system, thereby avoiding the problems of squeal, echo and the like of the acoustic system.

Description

Signal processing method and acoustic system Technical Field

[0001] The present application relates to the field of acoustic technology, and in particular to a signal processing method and an acoustic system. Background Art

[0002] Some acoustic systems include both speakers and sound sensors. In these acoustic systems, the ambient sound collected by the sound sensor may include the sound emitted from the speaker, which is detrimental to the operation of the acoustic system. For example, when a hearing aid system is working, it collects ambient sound through a sound sensor, amplifies the ambient sound, and then plays it through the speaker to compensate for the wearer's hearing loss. When the sound emitted by the speaker is re-collected by the sound sensor, the acoustic system forms a closed loop. As a result, the sound emitted by the speaker is continuously amplified in the closed loop, causing howling in the acoustic system and making the wearer feel uncomfortable. For example, in a telephone system or conference system, the voice signal emitted by the remote user is played through the local speaker and is collected by the local sound sensor together with the voice emitted by the local user. It is then transmitted back to the remote end, so that the remote user is disturbed by the echo.

[0003] Summary of the Invention

[0004] The present application provides a signal processing method and an acoustic system, which can reduce or eliminate feedback sound in the acoustic system, thereby avoiding problems such as howling and echo in the acoustic system.

[0005] In a first aspect, the present application provides a signal processing method, comprising: obtaining M sound pickup signals, wherein the M sound pickup signals are respectively obtained by collecting ambient sounds when M sound sensors in a sound sensor module of an acoustic system are working, and the ambient sounds include a first sound and a second sound, the first sound is a sound from a speaker in the acoustic system, and the second sound is a sound from a target sound source, and M is an integer greater than 1; performing filtering operations on the M sound pickup signals based on M groups of target filtering parameters to obtain M filtered signals, and performing a synthesis operation on the M filtered signals to obtain a composite signal, wherein the M groups of target filtering parameters are configured to minimize the signal component corresponding to the first sound in the composite signal under a target constraint; and performing a target operation on the composite signal.

[0006] In some embodiments, the target constraint includes: an attenuation degree of a signal component corresponding to the second sound in the integrated signal is within a preset range.

[0007] In some embodiments, the M groups of target filtering parameters are obtained based on M first transfer functions and M second transfer functions, wherein the nth first transfer function is the transfer function between the speaker and the nth sound sensor, the nth second transfer function is the transfer function between the target sound source and the nth sound sensor, and n is an integer less than or equal to M.

[0008] In some embodiments, the M groups of target filter parameters are obtained in the following manner: based on the M first transfer functions, a first expression is generated with the goal of minimizing the signal component corresponding to the first sound in the integrated signal, and the first expression uses the M groups of target filter parameters as unknown quantities; based on the M second transfer functions and the target constraints, a second expression is generated, and the second expression uses the M groups of target filter parameters as unknown quantities; and the M groups of target filter parameters are solved using the second expression as a constraint condition and the first expression as the target function.

[0009] In some embodiments, the M groups of target filtering parameters are obtained in the following manner: based on the M first transfer functions, the transfer function between the first sound and the integrated signal is expressed to generate a third expression, and the third expression uses the M groups of target filtering parameters as unknown quantities; based on the M second transfer functions and the target constraints, a fourth expression is generated, and the fourth expression uses the M groups of target filtering parameters as unknown quantities; a fifth expression is obtained by weighted summation of the third expression and the fourth expression; and the M groups of target filtering parameters are obtained by solving the problem with the objective function of minimizing the fifth expression.

[0010] In some embodiments, the M first transfer functions are obtained by: determining a current wearing posture corresponding to the acoustic system; and determining the M first transfer functions based on the current wearing posture.

[0011] In some embodiments, the M first transfer functions are obtained in the following manner: sending a test signal to the speaker to drive the speaker to emit a test sound; obtaining M acquisition signals respectively obtained by the M sound sensors picking up the test sound; and determining the M first transfer functions based on the test signal and the M acquisition signals.

[0012] In some embodiments, the M second transfer functions are obtained in the following manner: obtaining the M second transfer functions from a preset storage space.

[0013] In some embodiments, the M second transfer functions are obtained in the following manner: setting the i-th second transfer function as a preset function, where i is an integer less than or equal to M; and determining the j-th second transfer function based on the i-th second transfer function and the distance between the j-th sound sensor and the i-th sound sensor, where j is an integer less than or equal to M, and j is different from i.

[0014] In some embodiments, the target constraint includes: the M groups of target filter parameters are not zero at the same time; and the M groups of target filter parameters are obtained based on M first transfer functions, wherein the nth first transfer function is the transfer function between the speaker and the nth sound sensor, and n is an integer less than or equal to M.

[0015] In some embodiments, the M groups of target filtering parameters include K groups of first filtering parameters and MK groups of second filtering parameters, where K is an integer greater than or equal to 1; and the M groups of target filtering parameters are obtained in the following manner: setting the K groups of first filtering parameters to preset non-zero values, and determining the MK groups of second filtering parameters based on the M first transfer functions and the K groups of first filtering parameters.

[0016] In some embodiments, performing the target operation on the integrated signal includes: performing gain amplification on the integrated signal, and sending the gain-amplified signal as a driving signal to the speaker to drive the speaker to produce sound.

[0017] In some embodiments, the speaker and the sound sensor module are deployed on a first acoustic device, the first acoustic device is communicatively connected to a second acoustic device; and performing the target operation on the integrated signal includes: sending the integrated signal to the second acoustic device to reduce the echo of the second acoustic device.

[0018] In a second aspect, the present application also provides an acoustic system, comprising a speaker, a sound sensor module, and a signal processing circuit, wherein the speaker receives a driving signal and converts it into a first sound when in operation; the sound sensor module comprises M sound sensors, which pick up ambient sound and generate M pickup signals when in operation, wherein the ambient sound includes the first sound and a second sound from a target sound source, and M is an integer greater than 1; the signal processing circuit is connected to the sound sensor module, and when in operation, performs any of the methods described in the first aspect.

[0019] In some embodiments, the signal processing circuit includes: at least one storage medium and at least one processor, wherein the at least one storage medium stores at least one instruction set for signal processing; the at least one processor is communicatively connected to the sound sensor module and the at least one storage medium, wherein when the acoustic system is running, the at least one processor reads the at least one instruction set and executes any one of the methods described in the first aspect according to the instructions of the at least one instruction set.

[0020] In some embodiments, the acoustic system is any one of a hearing aid system, a sound amplification system, a headphone system, a telephone system, and a conference system.

[0021] In some embodiments, the acoustic system is a hearing aid, which further includes a housing, and the speaker, the sound sensor module and the signal processing circuit are arranged in the housing, wherein when the acoustic system is worn on the user's head, the sound output end of the speaker is facing the user's head, and the pickup end of at least one sound sensor in the sound sensor module is located on the side of the housing away from the user's head.

[0022] As can be seen from the above technical solutions, the signal processing method and acoustic system provided by the present application, when the M sound sensors in the sound sensor module are working, collect ambient sound and generate M sound pickup signals, wherein the ambient sound includes a first sound from a speaker and a second sound from a target sound source. The signal processing circuit can perform filtering operations on the M sound pickup signals based on M sets of target filtering parameters to obtain M filtered signals, and perform synthesis operations on the M filtered signals to obtain a comprehensive signal, and then perform target operations on the comprehensive signal. Since the M sets of target filtering parameters are configured to minimize the signal component from the speaker in the comprehensive signal under the target constraint, the above filtering operation can reduce or eliminate the feedback sound (i.e., the sound from the speaker) in the acoustic system, thereby avoiding problems such as howling and echo in the acoustic system.

[0023] Other functions of the signal processing method and acoustic system provided by the present application will be partially listed in the following description. The creative aspects of the signal processing method and acoustic system provided by the present application can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0025] FIG1 shows a schematic diagram of an application scenario provided according to an embodiment of the present application;

[0026] FIG2 shows a schematic diagram of another application scenario provided according to an embodiment of the present application;

[0027] FIG3 shows a schematic diagram of a design of an acoustic system provided according to an embodiment of the present application;

[0028] FIG4 shows a schematic structural diagram of an acoustic system provided according to an embodiment of the present application;

[0029] FIG5 shows a schematic diagram of the hardware design of an acoustic system provided according to an embodiment of the present application;

[0030] FIG6 shows a flowchart of a signal processing method provided according to an embodiment of the present application;

[0031] FIG7 shows a schematic diagram of a signal processing process provided according to an embodiment of the present application;

[0032] FIG8A is a schematic diagram showing how the signal processing solution shown in FIG7 cancels out the sound from the speaker; and

[0033] FIG8B is a schematic diagram showing the attenuation of the sound from the target sound source by the signal processing solution shown in FIG7 . DETAILED DESCRIPTION

[0034] The following description provides specific application scenarios and requirements of the present application, with the purpose of enabling those skilled in the art to make and use the content of this application. Various local modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this application. Therefore, this application is not limited to the embodiments shown, but is intended to be of the widest scope consistent with the claims.

[0035] The terms used herein are for the purpose of describing specific example embodiments only and are not intended to be limiting. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a," "an," and "the" may also include the plural forms. When used in this application, the terms "comprise," "include," and / or "contain" are meant to refer to the presence of associated integers, steps, operations, elements, and / or components, but do not exclude the presence of one or more other features, integers, steps, operations, elements, components, and / or groups or the addition of other features, integers, steps, operations, elements, components, and / or groups in the system / method.

[0036] With the following description in mind, these and other features of the present application, as well as the operation and function of the associated elements of the structure, and the economical assembly and manufacture of the components, can be significantly improved. Reference is made to the accompanying drawings, all of which form a part of this application. However, it should be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this application. It should also be understood that the drawings are not drawn to scale.

[0037] The flowcharts used in this application illustrate the operations of the system implementation according to some embodiments of the present application. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. Instead, the operations may be implemented in reverse order or simultaneously. In addition, one or more additional operations may be added to the flowcharts. One or more operations may be removed from the flowcharts.

[0038] Before describing the specific embodiments of the present application, the application scenarios of the present application are first introduced as follows.

[0039] FIG1 shows a schematic diagram of an application scenario provided according to an embodiment of the present application. The scenario can be a sound amplification scenario, an auxiliary listening scenario, or a hearing-aiding scenario. As shown in FIG1 , the application scenario 001 includes a loudspeaker 110-A and a sound sensor 120-A. When the sound sensor 120-A is working, it collects ambient sound. During this process, if the loudspeaker 110-A is also playing sound synchronously, the sound played by the loudspeaker 110-A will also be collected by the sound sensor 120-A. In this way, the ambient sound collected by the sound sensor 120-A includes both the sound from the target sound source 160 and the sound from the loudspeaker 110-A. Furthermore, the above-mentioned ambient sound is input into a gain amplifier (such as G in FIG1 ) for gain amplification, and then the amplified signal is sent to the loudspeaker 110-A for playback. In this way, a closed loop of "loudspeaker-sound sensor-loudspeaker" is formed in the acoustic system. In this case, when sound signals of certain frequencies undergo self-excited oscillation, a howling phenomenon will occur. Such howling will make the user feel uncomfortable, and when the howling is severe, it may also cause damage to the acoustic equipment. In addition, the existence of the howling also limits the gain amplification factor of the gain amplifier 130 , thereby restricting the maximum sound gain that can be achieved by the acoustic system 003 .

[0040] FIG2 shows a schematic diagram of another application scenario provided according to an embodiment of the present application. The scenario can be a call scenario, such as a call scenario through a telephone system, a conference system, or a voice call system. As shown in FIG2 , the application scenario 002 includes a local end and a remote end, wherein the local end includes a local user 140-A, a speaker 110-A, and a sound sensor 120-A, and the remote end includes a remote user 140-B, a speaker 110-B, and a sound sensor 120-B. The local end and the remote end can be connected via a network. The network is a medium for providing a communication connection between the local end and the remote end, which can facilitate the exchange of information or data between the two. In some embodiments, the network can be any type of wired or wireless network, or a combination thereof. For example, the network may include a cable network, a wired network, a fiber optic network, a telecommunications network, an intranet, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a wide area network (WAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, a near field communication (NFC) network, or the like. In some embodiments, the network may include one or more network access points. For example, the network may include a wired or wireless network access point, such as a base station or an Internet exchange point, through which a local end and a remote end can connect to the network to exchange data or information.

[0041] Continuing with Figure 2 , during a call between local user 140-A and remote user 140-B, the far-end voice emitted by remote user 140-B is collected by sound sensor 120-B and transmitted to the local end, where it is then played back through local speaker 110-A. The far-end voice played back by speaker 110-A, along with the local voice emitted by local user 140-A, is collected by local sound sensor 120-A, transmitted back to the remote end, and played back through remote speaker 110-B. As a result, remote user 140-B hears its own voice echoing, which can interfere with the call. It should be noted that Figure 2 illustrates the process of remote user 140-B being disturbed by the echo. It should be understood that local user 140-A may also be disturbed by the echo. The echo generation process on the local end is similar to the one described above and will not be further elaborated here. Such an echo can disrupt the user's normal conversation.

[0042] The signal processing method and acoustic system provided in the embodiments of the present application can be applied in scenarios where howling suppression is required (such as the scenario shown in FIG1 ), and can also be applied in scenarios where echo cancellation is required (such as the scenario shown in FIG2 ). In the above scenarios, the acoustic system collects ambient sound through M sound sensors to obtain M sound pickup signals, and uses the signal processing method described in the embodiments of the present application to process the M sound pickup signals to generate a composite signal, thereby reducing the signal component from the speaker in the composite signal, thereby achieving the purpose of suppressing howling or canceling echoes.

[0043] It should be noted that the above-mentioned howling suppression and echo cancellation scenarios are only some of the multiple usage scenarios provided by the embodiments of this application. The signal processing method and acoustic system provided by the embodiments of this application can also be applied to other similar scenarios. Those skilled in the art should understand that the application of the signal processing method and acoustic system provided by the embodiments of this application to other usage scenarios is also within the scope of the embodiments of this application.

[0044] FIG3 shows a schematic diagram of a design of an acoustic system according to an embodiment of the present application. The acoustic system 003 may be a sound reinforcement system, a hearing aid system, or an auxiliary hearing system, and in this case, the acoustic system 003 may be applied to the application scenario shown in FIG1 . The acoustic system 003 may also be a telephone system, a conference system, or a voice call system, and in this case, the acoustic system 003 may be applied to the application scenario shown in FIG2 .

[0045] As shown in FIG3 , acoustic system 003 may include a speaker 110, a sound sensor module 120, and a signal processing circuit 150. The sound sensor module 120 may include M sound sensors 120-1 through 120-M, where M is an integer greater than 1. For example, FIG3 illustrates M=2, meaning that the sound sensor module 120 includes a sound sensor 120-1 and a sound sensor 120-2. The M sound sensors may be identical or different.

[0046] In the acoustic system 003, the speaker 110 and the sound sensor module 120 can be integrated into the same electronic device or can be independent of each other, and the embodiments of the present application do not limit this. For example, Figure 4 shows a structural schematic diagram of the acoustic system 003 provided according to the embodiments of the present application; as shown in Figure 4, when the acoustic system 003 is a hearing aid system or an auxiliary hearing system, the acoustic system 003 can also include a housing 115. In this case, the speaker 110, the sound sensor module 120 and the signal processing circuit 150 can be arranged in the housing 115. The housing 115 protects the components inside it and is convenient for the user to pick up and wear it. The acoustic system 003 can be worn on the user's head. For example, the acoustic system 003 can be worn on the user's ear in an in-ear manner, an ear-hanging manner or other manners. When the acoustic system 003 is worn on the user's head, the sound output end of the speaker 110 is facing the user's head, for example, it can be facing the user's ear canal opening or near the ear canal opening. The sound pickup end of at least one sound sensor in the sound sensor module 120 is located on the side of the housing 115 away from the user's head. This makes it easier to pick up ambient sound and minimizes the pickup of sound from the speaker 110.

[0047] In an embodiment of the present application, the speaker 110 is a device for converting an electrical signal into sound, and may also be referred to as an electroacoustic converter. For example, the speaker 110 may be a speaker. Continuing with FIG3 , the speaker 110 may be connected to the signal processing circuit 150, and when in operation, receives a driving signal from the signal processing circuit 150 and converts it into sound for playback. The speaker 110 may be directly connected to the signal processing circuit 150, or may be connected to the signal processing circuit 150 through a first peripheral circuit (not shown in the accompanying drawings). The first peripheral circuit may perform some processing on the electrical signal output by the signal processing circuit 150, so that the processed electrical signal is suitable for playback by the speaker 110. The first peripheral circuit may include, but is not limited to, at least one of an operational amplifier device, a power amplifier device, a digital-to-analog converter device, a filter device, a tuning device, a capacitor, a resistor, an inductor, and a chip.

[0048] It should be noted that the speaker 110 can be a device that produces sound through at least one of gas, liquid, and solid conduction methods, and this application does not limit this. The speaker 110 can be a speaker itself, or it can include a speaker and its accompanying simple circuit components. The number of speakers 110 can be one or more. When there are multiple speakers 110, the multiple speakers 110 can be arranged in an array.

[0049] In an embodiment of the present application, the sound sensors 120-1 to 120-M are devices for picking up sound and converting the sound into an electrical signal, and may also be referred to as an acoustic-to-electrical converter. For example, the sound sensors 120-1 to 120-M may be microphones (MIC). Continuing with FIG3 , the sound sensors 120-1 to 120-M may be connected to the signal processing circuit 150, picking up ambient sound during operation to generate a pickup signal, and sending the pickup signal to the signal processing circuit 150. The sound sensors 120-1 to 120-M may be directly connected to the signal processing circuit 150, or may be connected to the signal processing circuit 150 through a second peripheral circuit (not shown in the drawings). The second peripheral circuit may perform some processing on the electrical signals (i.e., pickup signals) picked up by the sound sensors 120-1 to 120-M in order to convert them into signals suitable for processing by the signal processing circuit 150. The second peripheral circuit may include, but is not limited to, at least one of a power amplifier device, an operational amplifier device, an analog-to-digital converter device, a filter device, a tuning device, a capacitor, a resistor, an inductor, and a chip.

[0050] It should be noted that the sound sensors 120-1 to 120-M can be devices that pick up sound based on at least one of gas, liquid, and solid conduction modes, which is not limited in this application. The sound sensors 120-1 to 120-M can be the MIC itself, or can include the MIC and its accompanying simple circuit components.

[0051] Continuing with Figure 3 , the acoustic system 003 operates as follows: the speaker 110 receives a driving signal u from the signal processing circuit 150 and converts it into a first sound. The target sound source 160 emits a second sound. The target sound source 160 refers to a sound source other than the speaker 110. For example, the target sound source 160 may include an electronic device with a sound playback function (e.g., a television, speakers, or mobile phone); or, as another example, the human throat. The sound sensor 120-1 collects ambient sound to generate a sound pickup signal y1. The ambient sound includes the first sound from the speaker 110 and the second sound from the target sound source 160. Therefore, the sound pickup signal y1 includes both a signal component x1 corresponding to the first sound and a signal component v1 corresponding to the second sound. The sound sensor 120-1 transmits the sound pickup signal y1 to the signal processing circuit 150. It should be understood that the operating processes of the sound sensors 120-2 through 120-M are similar to those of the sound sensor 120-1 and are not described in detail here.

[0052] The signal processing circuit 150 may be a circuit with certain signal processing capabilities. The signal processing circuit 150 may receive sound pickup signals from M sound sensors, that is, the signal processing circuit 150 may receive M sound pickup signals, which are sound pickup signals y1 to y M The signal processing circuit 150 may be configured to execute the signal processing method described in the embodiment of the present application based on the M sound pickup signals. The signal processing method will be described in detail below.

[0053] In some embodiments, the signal processing circuit 150 may include multiple hardware circuits with a connection relationship, each hardware circuit includes one or more electrical components, and when working, implements one or more steps in the signal processing method described in the embodiments of the present application. The above-mentioned multiple hardware circuits cooperate with each other when working to implement the signal processing method described in the embodiments of the present application.

[0054] In some embodiments, the signal processing circuit 150 may include a hardware device with a data information processing function and the necessary program to drive the hardware device to work, and the hardware device implements the signal processing method described in the embodiment of the present application by executing the program. For example, Figure 5 shows a hardware design schematic diagram of the acoustic system 003 provided according to the embodiment of the present application. As shown in Figure 5, the signal processing circuit 150 may include: at least one storage medium 210 and at least one processor 220. The at least one processor 220 is communicatively connected to the speaker 110 and the sound sensor module 120. It should be noted that, for the purpose of demonstration only, the signal processing circuit 150 provided in the embodiment of the present application includes at least one storage medium 210 and at least one processor 220. It will be understood by those skilled in the art that the signal processing circuit 150 may also include other hardware circuit structures, which are not limited in the embodiments of the present application, as long as they can meet the functions mentioned in the present application without deviating from the spirit of the present application.

[0055] Continuing with FIG5 , in some embodiments, the acoustic system 003 may further include a communication port 230 . The communication port 230 is used for data communication between the acoustic system and the outside world. For example, the communication port 230 may be used for data communication between the acoustic system and other devices / systems. In some embodiments, the acoustic system 003 may further include an internal communication bus 240 . The internal communication bus 240 may connect different system components. For example, the speaker 110 , the sound sensor module 120 , the processor 220 , the storage medium 210 , and the communication port 230 may all be connected via the internal communication bus 240 .

[0056] The storage medium 210 may include a data storage device. The data storage device may be a non-transitory storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk 2101, a read-only storage medium (ROM) 2102, or a random access storage medium (RAM) 2103. The storage medium 210 also includes at least one instruction set stored in the data storage device. The instruction set includes instructions, which are computer program codes. The computer program codes may include programs, routines, objects, components, data structures, processes, modules, etc. for executing the signal processing methods provided in the embodiments of the present application.

[0057] At least one processor 220 is used to execute the at least one instruction set mentioned above. When the acoustic system 003 is running, the at least one processor 220 reads the at least one instruction set and, according to the instructions of the at least one instruction set, executes the signal processing method provided by the embodiment of the present application. The processor 220 can perform all or part of the steps included in the above-mentioned signal processing method. The processor 220 can be in the form of one or more processors. In some embodiments, the processor 220 can include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof. For illustration purposes only, the acoustic system 003 shown in Figure 5 illustrates a case where only one processor 220 is included. However, it should be noted that the acoustic system 003 provided in the embodiments of the present application may also include multiple processors. Therefore, the operations and / or method steps disclosed in the embodiments of the present application may be performed by one processor or jointly by multiple processors. For example, if the processor 220 of the acoustic system in the embodiments of the present application performs step A and step B, it should be understood that step A and step B may also be performed jointly or separately by two different processors 220 (for example, the first processor performs step A, the second processor performs step B, or the first and second processors perform steps A and B together).

[0058] FIG6 shows a flow chart of a signal processing method according to an embodiment of the present application. The signal processing method P100 can be applied to the acoustic system 003 described above. Specifically, the signal processing circuit 150 can execute the signal processing method P100. For example, the processor 220 in the signal processing circuit 150 can execute the signal processing method P100. As shown in FIG6 , the signal processing method P100 may include:

[0059] S10: Obtain M sound pickup signals, where the M sound pickup signals are obtained by M sound sensors in the acoustic system collecting ambient sounds when in operation, and the ambient sounds include a first sound and a second sound, where the first sound is sound from a speaker in the acoustic system, and the second sound is sound from a target sound source, and M is an integer greater than 1.

[0060] The signal processing circuit 150 can obtain M sound pickup signals from the sound sensor module 120. It should be noted that the process of the M sound sensors in the sound sensor module 120 respectively collecting ambient sound and generating sound pickup signals has been described above and will not be repeated here. Since the ambient sound includes both the first sound from the speaker 110 and the second sound from the target sound source 160, each sound pickup signal includes both a signal component corresponding to the first sound (i.e., a feedback component) and a signal component corresponding to the second sound.

[0061] S20: Performing filtering operations on the M sound pickup signals based on M groups of target filtering parameters to obtain M filtered signals, and performing a synthesis operation on the M filtered signals to obtain a composite signal, wherein the M groups of target filtering parameters are configured to minimize a signal component corresponding to the first sound in the composite signal under a target constraint.

[0062] For ease of understanding, FIG7 shows a schematic diagram of the signal processing process provided in accordance with an embodiment of the present application. As shown in FIG7 , it is assumed that the M sound pickup signals obtained by the signal processing circuit 150 from the sound sensor module 120 are denoted as y1 to y M The signal processing circuit 150 can perform filtering operations on the M sound pickup signals based on M sets of target filtering parameters to obtain M filtered signals y1′ to y M '. Specifically, referring to FIG7, the signal processing circuit 150 performs a filtering operation on the sound pickup signal y1 based on the target filtering parameter w1 to obtain a filtered signal y1', that is, y1'=y1*w1. The signal processing circuit 150 performs a filtering operation on the sound pickup signal y2 based on the target filtering parameter w2 to obtain a filtered signal y2', that is, y2'=y2*w2. Similarly, the signal processing circuit 150 performs a filtering operation on the sound pickup signal y2 based on the target filtering parameter w M Pickup signal y MPerform the filtering operation to obtain the filtered signal y M ′, that is, y M ′=y M *w M Furthermore, the signal processing circuit 150 obtains M filtered signals y1′ to y M 'After that, the M filtered signals y1' to y M ' Perform the synthesis operation to obtain the integrated signal y, that is, y = y1' + y2' + ... + y M For example, the above synthesis operation can be implemented by an adder. The above synthesis signal y can be regarded as the comprehensive pickup result of the ambient sound by the sound sensor module 120. It should be noted that FIG7 only takes M=2 as an example for the sake of convenience.

[0063] The M sets of target filtering parameters are configured to minimize the signal component corresponding to the first sound (i.e., the feedback component) in the integrated signal y under target constraints. That is, when performing the filtering operation, the signal processing circuit 150 is able to minimize the feedback component in the integrated signal y as much as possible within certain constraints, thereby minimizing the feedback component in the integrated signal y. In other words, by performing the filtering operation, the signal processing circuit 150 implements beamforming for the sound sensor module 120, thereby minimizing the feedback component in the integrated signal y.

[0064] For the convenience of subsequent description, the first sound emitted by the speaker 110 is recorded as x, and the second sound emitted by the target sound source 160 is recorded as v. The transfer function between the speaker 110 and the nth sound sensor is called the first transfer function and is recorded as h n , that is, the first transfer functions between the loudspeaker 110 and the M sound sensors are h1 to h M The transfer function between the target sound source 160 and the nth sound sensor is called the second transfer function and is denoted by d n , that is, the second transfer functions between the loudspeaker 110 and the M sound sensors are denoted as d1 to d M In this way, the M sound signals picked up by the M sound sensors can be expressed as follows: y1=x*h1+v*d1 Formula (1-1) y2=x*h2+v*d2 Formula (1-2) ……… y M =x*h M +v*d M Formula (1-M)

[0065] Furthermore, the M filtered signals can be expressed as follows: y1′=y1*w1=x*h1*w1+v*d1*w1 Formula (2-1) y2′=y2*w2=x*h2*w2+v*d2*w2 Formula (2-2) … y M ′=y M *w M =x*h M *w M +v*d M *w M Formula (2-M)

[0066] The integrated signal y can be expressed as follows:

[0067] It can be seen from the above formula (3) that the integrated signal y includes two signal components, namely: the signal component corresponding to the first sound and a signal component corresponding to the second sound Therefore, when determining the M groups of target filter parameters, the signal processing circuit 150 may use the following formula (4) as a solution target, so as to minimize the signal component corresponding to the first sound in the integrated signal y.

[0068] Among them, ||·|| i Represents the i-norm, where i can be 1, 2, or ∞.

[0069] When w1 to w n When the values ​​of are all zero, the signal component corresponding to the first sound in the integrated signal y is zero. Although the above formula (4) can be satisfied, the signal component corresponding to the second sound in the integrated signal y will also become zero at the same time, which will affect the operation of the acoustic system. Therefore, in some embodiments, the target constraint may include: M groups of target filter parameters are not all zero at the same time. That is, the signal processing circuit 150 uses the above formula (4) as the objective function to solve the target filter parameters w1 to w n .

[0070] Based on the above target constraints, the M groups of target filter parameters can be based on M first transfer functions (i.e., h1 to h M). For example, the M groups of target filter parameters can be obtained by dividing the M groups of target filter parameters into K groups of first filter parameters and MK groups of second filter parameters. K is an integer greater than or equal to 1. The K groups of first filter parameters are first set to preset non-zero values, and then the MK groups of second filter parameters are determined based on the M first transfer functions and the K groups of first filter parameters.

[0071] The following example uses M=2 as an example. The signal processing circuit 150 can first set w1 to a preset non-zero value. For example, assuming that each set of target filtering parameters is represented by an N-dimensional vector, the value of w1 can be a unit vector e (for example, one element in the N-dimensional vector is 1 and the other elements are 0), that is: w1=e Formula (5)

[0072] Furthermore, the signal processing circuit 150 can solve formula (4) as the objective function to obtain w2. For example, the obtained w2 can be as follows:

[0073] in, represents the convolution matrix of h2, Represents the transposed matrix of the convolution matrix of h2.

[0074] Since w1 and w2 satisfy the above formula (4), the signal care circuit 150 performs a filtering operation based on w1 and w2, which can minimize the feedback component in the integrated signal y.

[0075] It should be noted that the embodiments of the present application do not limit the specific values ​​of w1 and w2. Formulas (5) and (6) are only a set of possible examples. Those skilled in the art will understand that w1 and w2 may also adopt other values, as long as they are not zero at the same time and satisfy the above formula (4).

[0076] In some embodiments, the target constraint may include: the attenuation degree of the signal component corresponding to the second sound in the integrated signal y is within a preset range (or the attenuation degree is less than or equal to a preset value). "Minimizing the signal component corresponding to the first sound in the integrated signal y under the above target constraint" can be understood as: under the premise of not attenuating or attenuating as little as possible the signal component corresponding to the second sound in the integrated signal y, the signal component corresponding to the first sound in the integrated signal y is reduced to the greatest extent. In this way, in the above filtering process, since the signal component corresponding to the first sound in the integrated signal y is reduced as much as possible, and the signal component corresponding to the second sound is not attenuated or is rarely attenuated, the accuracy of the integrated signal y obtained based on the above target constraint is higher.

[0077] Based on the above target constraints, the M groups of target filtering parameters (i.e., w1 to w M ) can be based on the first transfer function h1 to h M and the second transfer function d1 to d M The following examples illustrate two possible solutions.

[0078] For example, the signal processing circuit 150 may obtain the target filtering parameters w1 to w2 in the following manner: M :

[0079] (1) Based on the first transfer function h1 to h M , with the goal of minimizing the signal component corresponding to the first sound in the integrated signal y, a first expression is generated. Wherein, the first expression is based on the first transfer function h1 to h M As known quantities, the target filter parameters w1 to w M as an unknown quantity.

[0080] For example, the first expression can be expressed as formula (4). In this case, the meaning of the first expression is: minimize the transfer function between the first sound x and the integrated signal y.

[0081] Among them, ||·|| i Represents the i-norm, where i can be 1, 2, or ∞.

[0082] (2) Based on the second transfer function d1 to d M and the target constraint to generate a second expression. Wherein, the second expression is a second transfer function d1 to d M As known quantities, the target filter parameters w1 to w M as an unknown quantity.

[0083] For example, the second expression can be expressed using formula (7). In this case, the meaning of the second expression is that the transfer function from the second sound v to the integrated signal y is equal to the second transfer function d1. In other words, the integrated sound pickup effect of the sound sensor module 120 for the second sound (i.e., the signal component corresponding to the second sound in the integrated signal y) is equivalent to the sound pickup effect of the single sound sensor 120-1 for the second sound. Those skilled in the art will understand that formula (7) can ensure that the attenuation degree of the signal component corresponding to the second sound in the integrated signal y is within a preset range.

[0084] It should be noted that the above formula (7) is only one possible form of the second expression. In practical applications, the second expression can also be in other forms. For example, the content on the right side of the equal sign of formula (7) is modified to d2 to dM For another example, the second expression can also be expressed using formula (7-1):

[0085] Wherein, in formula (7-1), e represents a unit vector. Formula (7-1) can be regarded as the second transfer function d1 to d in formula (7). M In other words, one of the M sound sensors (for example, the sound sensor 120-1) is used as a reference sound sensor. The meaning of can be understood as: relative transfer function between the target sound source 160 and the nth sound sensor relative to the reference sound sensor.

[0086] (3) Using the second expression (e.g., formula (7) or formula (7-1)) as the constraint condition and the first expression (e.g., formula (4)) as the objective function, the target filter parameters w1 to w M .

[0087] For example, using formula (7-1) as the constraint condition and formula (4) as the objective function, the analytical solution is as follows:

[0088] in, represents the transposed matrix of w1, represents the convolution matrix of h1, express The convolution matrix.

[0089] For another example, the signal processing circuit 150 may also obtain the target filtering parameters w1 to w M :

[0090] (1) Based on the first transfer function h1 to h M , the transfer function between the first sound x and the integrated signal y is expressed to generate a third expression. Wherein, the third expression is based on the first transfer function h1 to h M As known quantities, the target filter parameters w1 to w M as an unknown quantity.

[0091] For example, the third expression can be expressed using formula (9).

[0092] (2) Based on the second transfer function d1 to d M The fourth expression is generated by the second transfer function d1 to d M As known quantities, the target filter parameters w1 to wM as an unknown quantity.

[0093] For example, the fourth expression can be expressed using formula (10). In this case, the fourth expression means the difference between the transfer function from the second sound v to the integrated signal y and the second transfer function d1. When this difference is smaller, it indicates that the integrated sound pickup effect of the sound sensor module 120 for the second sound (i.e., the signal component corresponding to the second sound in the integrated signal y) is comparable to the sound pickup effect of the single sound sensor 120-1 for the second sound. In this case, the attenuation degree of the signal component corresponding to the second sound in the integrated signal y is within a preset range, i.e., the target constraint is satisfied.

[0094] It should be noted that the above formula (10) is only one possible form of the fourth expression. In practical applications, the fourth expression can also be in other forms. For example, modify d1 in formula (10) to d2 to d M For another example, the fourth expression can also be expressed using formula (10-1):

[0095] Wherein, in formula (10-1), e represents a unit vector. Formula (10-1) can be regarded as the second transfer function d1 to d in formula (10). M In other words, one of the M sound sensors (for example, the sound sensor 120-1) is used as a reference sound sensor. The meaning of can be understood as: relative transfer function between the target sound source 160 and the nth sound sensor relative to the reference sound sensor.

[0096] (3) Perform weighted summation on the third expression (eg, formula (9)) and the fourth expression (eg, formula (10) or formula (10-1)) to obtain a fifth expression.

[0097] For example, set the weight corresponding to formula (9) to 1, set the weight corresponding to formula (10-1) to λ, and perform weighted summation of the i-norm of formula (9) and the i-norm of formula (10-1) to obtain formula (11):

[0098] Among them, ||·|| i Represents the i-norm, where i can be 1, 2, or ∞.

[0099] (4) By minimizing the fifth expression as the objective function, the target filtering parameters w1 to w1 are obtained. M .

[0100] That is, the following formula (12) is solved as the objective function to obtain the target filtering parameters w1 to w M The target filter parameters w1 to w are obtained. M It can be shown as formula (13).

[0101] in, represents the transposed matrix of w1, represents the convolution matrix of h1, express The convolution matrix.

[0102] FIG8A is a schematic diagram showing how the signal processing scheme shown in FIG7 cancels out the sound from the speaker. Referring to FIG8A , curve A corresponds to the signal component from the speaker 110 in the sound pickup signal y1 obtained by the sound sensor 120-1, curve B corresponds to the signal component from the speaker 110 in the sound pickup signal y2 obtained by the sound sensor 120-2, and curve C corresponds to the signal component from the speaker 110 in the integrated signal y. Comparing curve C with curves A and B, it can be seen that the signal component from the speaker 110 in the integrated signal y is significantly reduced relative to the sound pickup signals y1 and y2, especially in the mid-frequency band (e.g., 2000 Hz to 5000 Hz). This shows that the signal processing method shown in FIG7 can effectively reduce the signal component from the speaker 110 (i.e., the feedback component) in the integrated signal y.

[0103] Figure 8B is a schematic diagram illustrating the attenuation of the sound from the target sound source by the signal processing scheme shown in Figure 7. Referring to Figure 8B , curve D shows the attenuation of the signal component from target sound source 160 in the integrated signal y. As can be seen from Figure 8B , the signal processing scheme shown in Figure 7 does not significantly attenuate the signal component from target sound source 160 in the integrated signal y, with the attenuation remaining generally within 0.01 dB. This demonstrates that the signal processing scheme shown in Figure 7 can, on the one hand, effectively reduce the feedback component in the integrated signal y, and on the other hand, achieves no or minimal attenuation of the signal component from target sound source 160 in the integrated signal y.

[0104] The target filter parameters w1 to w described above M In the several solutions, the first transfer function h1 to h M It should be noted that the signal processing circuit 150 can obtain the first transfer functions h1 to h2 in a variety of ways. M , the following only takes two possible methods as examples to illustrate.

[0105] Method 1: The signal processing circuit 150 can control the speaker 110 to emit a test sound to measure the first transfer function h1 to h M The specific measurement method can be as follows:

[0106] (1) Send a test signal to the speaker 110 to drive the speaker 110 to emit a test sound.

[0107] For example, after detecting that the acoustic system 003 enters the wearing state, the signal processing circuit 150 may trigger the sending of a test signal to the speaker 110 to drive the speaker 110 to emit a test sound. For another example, the signal processing circuit 150 may include a voice activity detection (VAD) unit, which may be connected to the sound sensor module 120 and obtain M pickup signals from the sound sensor module 120. The VAD unit may determine whether there is a human voice in the current environment and / or determine the signal energy of the speaker 110 based on the M pickup signals. When it is determined that there is no human voice in the current environment and / or the signal energy of the speaker 110 is less than a preset threshold, the signal processing circuit 150 may send a test signal to the speaker 110 to drive the speaker 110 to emit a test sound. This can avoid interference of other sounds on the test sound.

[0108] (2) Obtain M acquisition signals respectively obtained by M sound sensors picking up the test sound.

[0109] (3) Determine the M first transfer functions based on the test signal and the M acquisition signals.

[0110] For example, the sound sensor 120-1 is used as an example. The sound sensor 120-1 picks up the test sound and generates a collection signal. Then, based on the test signal and the collection signal, the signal processing circuit 150 can determine the first transfer function h1 between the speaker 110 and the sound sensor 120-1. It will be understood by those skilled in the art that the signal processing circuit 150 can use a similar method to determine the first transfer functions h2 to h3. M .

[0111] The signal processing circuit 150 controls the speaker 110 to emit a test sound to measure and obtain the first transfer functions h1 to h M , the implementation is simple and has high application flexibility.

[0112] Method 2: When the same acoustic system is worn by different users or by the same user multiple times, it may be in different wearing positions. When the wearing position of the acoustic system changes, the acoustic transmission path between the speaker 110 and each sound sensor may change accordingly. M is related to the current wearing posture of the acoustic system 003, so the signal processing circuit 150 can determine the first transfer functions h1 to h2 based on the current wearing posture. M .

[0113] Specifically, the signal processing circuit 150 can obtain the first transfer functions h1 to h2 in the following manner: M :

[0114] (1) Determine the current wearing posture corresponding to the acoustic system 003.

[0115] Among them, the current wearing posture refers to the posture of the acoustic system 003 when it is worn by the user. For example, the acoustic system 003 can be pre-set with several wearing gears, and different wearing gears correspond to different wearing postures. When wearing the acoustic system, the user can select one of the wearing gears according to needs. In this case, the signal processing circuit 150 can determine the current wearing posture based on the wearing gear selected by the user. For another example, the acoustic system 003 can also be provided with a posture detection device, and the posture detection device can detect the current wearing posture of the acoustic system 003 in real time or periodically. In this way, the signal processing circuit 150 can be connected to the posture detection device and obtain the current wearing posture from the posture detection device.

[0116] (2) Determine the first transfer functions h1 to h2 based on the current wearing posture M .

[0117] For example, before the acoustic system 003 leaves the factory, the first transfer function of the acoustic system 003 in different wearing postures can be measured, and the measurement results can be stored in the storage device of the acoustic system 003. For example, the measurement results can be shown in Table 1. In this way, the signal processing circuit 150 can obtain the first transfer functions h1 to h2 when it is necessary to do so. M When the measurement results in Table 1 are queried based on the current wearing posture, the first transfer functions h1 to h2 corresponding to the current wearing posture can be obtained. M .

[0118] Table 1

[0119] The above method 2 obtains the first transfer functions h1 to h2 corresponding to different wearing postures by pre-measurement. M, so that the signal processing circuit 150 can detect the current wearing posture of the acoustic system and determine the first transfer functions h1 to h M , which can improve the efficiency of solving the M groups of target filtering parameters.

[0120] It should be noted that the above two methods can be combined or used in conjunction with each other. For example, when the user just wears the acoustic system 003, the signal processing circuit 150 can use the above method 1 to obtain the first transfer function h1 to h M When the user wears the device for a long time, the signal processing circuit 150 can obtain the first transfer functions h1 to h2 by using the above method 2 at preset time intervals. M In this way, the first transfer function h1 to h2 can be improved in different wearing scenarios. M The accuracy of the M group of target filter parameters can more accurately eliminate the feedback components and improve the effect of eliminating the feedback sound.

[0121] The target filter parameters w1 to w described above M In some solutions, the second transfer function d1 to d M It should be noted that the signal processing circuit 150 can obtain the second transfer functions d1 to d M , the following only takes two possible methods as examples to illustrate.

[0122] Method 1: The signal processing circuit 150 can obtain the second transfer functions d1 to d2 from a preset storage space. M .

[0123] For example, before the acoustic system 003 leaves the factory, the second transfer functions d1 to d M Taking the second transfer function d1 as an example, its measurement method may include: providing a test signal to the external sound source to drive the external sound source to emit a test sound, obtaining a collection signal generated by the sound sensor 120-1 picking up the test sound, and then determining the second transfer function d1 between the external sound source and the sound sensor 120-1 based on the test signal and the collection signal. It will be understood by those skilled in the art that the second transfer function d2 to d M The second transfer functions d1 to d2 can be obtained by testing in a similar manner as above. M can be stored in the preset storage space. In this way, the signal processing circuit 150 needs to use the second transfer functions d1 to d M When the data is read from the preset storage space.

[0124] The above method obtains the second transfer functions d1 to d1 by pre-measurement. M and convert the second transfer function d1 to d M The second transfer functions d1 to d2 can be directly read from the preset storage space when the signal processing circuit 150 solves the M sets of target filter parameters. M , which can improve the efficiency of solving the M groups of target filtering parameters.

[0125] Method 2: Since the target sound source 160 can be considered a far-field sound source, the sound waves of the far-field sound source are approximately plane waves, that is, the amplitude of the sound waves decreases less as they propagate. Therefore, the sound waves from the target sound source 160 picked up by different sound sensors can be considered to have only phase differences. In this way, for any two sound sensors, there is only a certain delay information between the second transfer functions from the target sound source 160 to the two sound sensors, and this delay information is related to the distance between the two sound sensors. Therefore, the signal processing circuit 150 can obtain the second transfer functions d1 to d2 based on the distance assumption between different sound sensors. M .

[0126] Specifically, the signal processing circuit 150 can set the i-th second transfer function to a preset function, where i is an integer less than or equal to M; and then determine the j-th second transfer function based on the i-th second transfer function and the distance between the j-th sound sensor and the i-th sound sensor, where j is an integer less than or equal to M, and j is different from i.

[0127] For example, assuming M = 3, set d1 to the unit impulse function δ(n). d2 can be obtained as follows: Based on the distance between the sound sensor 120-2 and the sound sensor 120-1, determine the time delay information of d2 relative to d1, and then determine d2 based on the time delay information and d1. Similarly, d3 can be obtained as follows: Based on the distance between the sound sensor 120-3 and the sound sensor 120-1, determine the time delay information of d3 relative to d1, and then determine d3 based on the time delay information and d1. M Those skilled in the art will appreciate that when setting d1 , the signal processing circuit may also set d1 to other forms of transfer functions, and the above-mentioned unit impulse function δ(n) is only one possible example.

[0128] The above method can obtain the second transfer functions d1 to d2 based on the distance assumption between different sound sensors. M , without the need to pre-adjust the second transfer function d1 to d M Measurements can be made with high application flexibility.

[0129] S30: performing a target operation on the integrated signal.

[0130] After obtaining the integrated signal y, the signal processing circuit 150 may perform a target operation on the integrated signal y based on the requirements of the application scenario.

[0131] For example, in some embodiments, referring to FIG7 , the signal processing circuit 150 may also be connected to the speaker 110. In this case, the target operation may include a gain amplification operation. That is, after obtaining the integrated signal y, the signal processing circuit 150 performs gain amplification on the integrated signal y, and sends the gain-amplified signal as a driving signal to the speaker 110 to drive the speaker 110 to make a sound. The above scheme can be applied to the howling suppression scenario shown in FIG1 . It should be understood that since the signal component from the speaker 110 is reduced in the integrated signal y (or the feedback component is reduced), the condition for the sound emitted by the speaker 110 to produce howling in the closed-loop circuit shown in FIG1 is destroyed, thereby achieving the effect of suppressing howling.

[0132] In some embodiments, the aforementioned gain amplification operation can be implemented by the processor 220 in the signal processing circuit 150, i.e., the processor 220 executes an instruction set and performs the aforementioned gain amplification operation according to the instructions of the instruction set. In some embodiments, the signal processing circuit 150 may include a gain amplification circuit, and the aforementioned gain amplification operation can be implemented by the gain amplification circuit.

[0133] In some embodiments, the speaker 110, the sound sensor module 120 and the signal processing circuit 150 can be integrated into a first acoustic device, and the first acoustic device is communicatively connected to the second acoustic device. In this case, the target operation may include: sending a comprehensive signal y to the second acoustic device to reduce the echo of the second acoustic device. The above scheme can be applied to the echo cancellation scenario shown in Figure 2. For example, the first acoustic device can be a local device, and the second acoustic device can be a remote device. Since the signal component from the speaker 110 is reduced in the comprehensive signal y (or the feedback component is reduced), it is equivalent to reducing the sound from the second acoustic device. Therefore, when the second acoustic device receives the comprehensive signal y and plays it, the user on the second acoustic device side (i.e., the remote user) will not hear or hear less of the echo, thereby achieving the effect of echo cancellation.

[0134] In summary, the signal processing method and acoustic system provided by the embodiments of the present application are such that the M sound sensors in the sound sensor module 120 collect ambient sound and generate M sound pickup signals when in operation. The signal processing circuit 150 can perform filtering operations on the M sound pickup signals based on M sets of target filtering parameters to obtain M filtered signals, and perform synthesis operations on the M filtered signals to obtain a composite signal, and then perform target operations on the composite signal. Since the M sets of target filtering parameters are configured to minimize the signal component from the speaker in the composite signal under target constraints, the above filtering operations can reduce or eliminate feedback sound (i.e., sound from the speaker) in the acoustic system, thereby avoiding problems such as howling and echo in the acoustic system.

[0135] On the other hand, the present application provides a non-transitory storage medium storing at least one set of executable instructions for performing signal processing. When the executable instructions are executed by a processor, the executable instructions instruct the processor to implement the steps of the signal processing method P100 described in the present application. In some possible embodiments, various aspects of the present application can also be implemented in the form of a program product, which includes program code. When the program product is run on an acoustic system, the program code is used to cause the acoustic system to perform the steps of the signal processing method P100 described in the present application. The program product for implementing the above method can use a portable compact disc read-only memory (CD-ROM) to include program code and can be run on the acoustic system. However, the program product of the present application is not limited to this. In the present application, a readable storage medium can be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media include: an electrical connection having one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. The computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable storage medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing. Program code for performing the operations of the present application may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, and conventional procedural programming languages ​​such as C or similar programming languages. The program code may be executed entirely on the acoustic system, partially on the acoustic system, as a stand-alone software package, partially on the acoustic system and partially on a remote computing device, or entirely on the remote computing device.

[0136] The foregoing description describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require a specific or sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0137] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented by way of example only and may not be limiting. Although not expressly stated herein, those skilled in the art will understand that the present application requires various reasonable changes, improvements, and modifications to the embodiments. Such changes, improvements, and modifications are intended to be proposed by the present application and are within the spirit and scope of the exemplary embodiments of the present application.

[0138] In addition, certain terms in this application have been used to describe embodiments of the application. For example, "one embodiment," "an embodiment," and / or "some embodiments" mean that a particular feature, structure, or characteristic described in conjunction with that embodiment may be included in at least one embodiment of the application. Therefore, it is emphasized and should be understood that two or more references to "an embodiment," "one embodiment," or "an alternative embodiment" in various sections of this application do not necessarily refer to the same embodiment. Furthermore, particular features, structures, or characteristics may be appropriately combined in one or more embodiments of the application.

[0139] It should be understood that in the foregoing description of the embodiments of this application, in order to facilitate understanding of a feature and to simplify this application, this application combines various features into a single embodiment, figure, or description thereof. However, this does not mean that the combination of these features is required. When reading this application, it is entirely possible for a person skilled in the art to mark out some of the devices and understand them as separate embodiments. In other words, the embodiments of this application can also be understood as the integration of multiple secondary embodiments. This also applies when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.

[0140] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, articles, and the like, cited herein, except any historical prosecution documents to which it relates, any equivalent that may be inconsistent or conflicting with this document, or any equivalent historical prosecution documents that may have a limiting effect on the broadest scope of the claims, is hereby incorporated by reference for all purposes now or hereafter connected with this document. In addition, in the event of any inconsistency or conflict between the descriptions, definitions, and / or use of terms associated with any incorporated material and the terminology, descriptions, definitions, and / or use associated with this document, the terminology in this document shall control.

[0141] Finally, it should be understood that the embodiments of the application disclosed herein are illustrations of the principles of the embodiments of the present application. Other modified embodiments are also within the scope of the present application. Therefore, the embodiments disclosed in the present application are merely examples and not limitations. Those skilled in the art can adopt alternative configurations based on the embodiments in the present application to implement the applications in the present application. Therefore, the embodiments of the present application are not limited to the embodiments precisely described in the application.

Claims

1. A signal processing method, characterized in that: include: Obtaining M sound pickup signals, wherein the M sound pickup signals are respectively obtained by collecting environmental sounds when M sound sensors in the sound sensor module of the acoustic system are working, the environmental sounds include a first sound and a second sound, the first sound is a sound from a speaker in the acoustic system, the second sound is a sound from a target sound source, and M is an integer greater than 1; Based on M groups of target filtering parameters, filtering operations are respectively performed on the M sound pickup signals to obtain M filtered signals, and synthesis operations are performed on the M filtered signals to obtain a composite signal, wherein the M groups of target filtering parameters are configured to minimize the signal component corresponding to the first sound in the composite signal under a target constraint; as well as A target operation is performed on the composite signal.

2. The method according to claim 1, characterized in that The target constraint includes: the attenuation degree of the signal component corresponding to the second sound in the integrated signal is within a preset range.

3. The method according to claim 2, characterized in that The M groups of target filtering parameters are obtained based on M first transfer functions and M second transfer functions, wherein: The nth first transfer function is a transfer function between the loudspeaker and the nth sound sensor. The nth second transfer function is a transfer function between the target sound source and the nth sound sensor. The n is an integer less than or equal to M.

4. The method according to claim 3, characterized in that: The M groups of target filtering parameters are obtained in the following manner: Based on the M first transfer functions, generating a first expression with the goal of minimizing the signal component corresponding to the first sound in the integrated signal, wherein the first expression uses the M groups of target filter parameters as unknown quantities; generating a second expression based on the M second transfer functions and the target constraint, wherein the second expression uses the M groups of target filter parameters as unknown quantities; as well as The M groups of target filtering parameters are obtained by solving the second expression as a constraint condition and the first expression as an objective function.

5. The method according to claim 3, characterized in that: The M groups of target filtering parameters are obtained in the following manner: Based on the M first transfer functions, expressing the transfer function from the first sound to the integrated signal to generate a third expression, wherein the third expression uses the M groups of target filter parameters as unknown quantities; Generate a fourth expression based on the M second transfer functions and the target constraint, the fourth expression using the M groups of target filter parameters as unknown quantities; Performing weighted summation on the third expression and the fourth expression to obtain a fifth expression; as well as The objective function is to minimize the fifth expression and obtain the M groups of target filtering parameters.

6. The method according to claim 3, characterized in that The M first transfer functions are obtained in the following manner: Determining a current wearing posture corresponding to the acoustic system; and The M first transfer functions are determined based on the current wearing posture.

7. The method according to claim 3, characterized in that The M first transfer functions are obtained in the following manner: Sending a test signal to the speaker to drive the speaker to emit a test sound; Respectively obtain M acquisition signals obtained by the M sound sensors picking up the test sound; as well as The M first transfer functions are determined based on the test signal and the M acquired signals.

8. The method according to claim 3, characterized in that The M second transfer functions are obtained in the following manner: The M second transfer functions are obtained from a preset storage space.

9. The method according to claim 3, characterized in that: The M second transfer functions are obtained in the following manner: Setting the i-th second transfer function to a preset function, where i is an integer less than or equal to M; as well as A j-th second transfer function is determined based on the i-th second transfer function and a distance between the j-th sound sensor and the i-th sound sensor, wherein j is an integer less than or equal to M and different from i.

10. The method according to claim 1, characterized in that The target constraint includes: the M groups of target filter parameters are not zero at the same time; and The M groups of target filtering parameters are obtained based on M first transfer functions, wherein the nth first transfer function is a transfer function between the speaker and the nth sound sensor, and n is an integer less than or equal to M.

11. The method according to claim 10, characterized in that The M groups of target filtering parameters include K groups of first filtering parameters and MK groups of second filtering parameters, where K is an integer greater than or equal to 1; and The M groups of target filtering parameters are obtained in the following manner: The K groups of first filter parameters are set to preset non-zero values, and Based on the M first transfer functions and the K groups of first filtering parameters, the MK groups of second filtering parameters are determined.

12. The method according to claim 1, characterized in that The performing a target operation on the integrated signal comprises: The integrated signal is gain-amplified, and the gain-amplified signal is sent to the speaker as a driving signal to drive the speaker to produce sound.

13. The method according to claim 1, characterized in that The loudspeaker and the sound sensor module are deployed on a first acoustic device, and the first acoustic device is communicatively connected with a second acoustic device; as well as The performing a target operation on the integrated signal includes: sending the integrated signal to the second acoustic device to reduce an echo of the second acoustic device.

14. An acoustic system, characterized in that: include: The loudspeaker receives the driving signal and converts it into a first sound when in operation; a sound sensor module, comprising M sound sensors, which pick up ambient sounds and generate M sound pickup signals when in operation, wherein the ambient sounds include the first sounds and second sounds from a target sound source, and M is an integer greater than 1; and The signal processing circuit is connected to the sound sensor module and executes the method according to any one of claims 1 to 13 when in operation.

15. The acoustic system according to claim 14, characterized in that The signal processing circuit comprises: at least one storage medium storing at least one instruction set for performing signal processing; and At least one processor is communicatively connected to the sound sensor module and the at least one storage medium, wherein, when the acoustic system is running, the at least one processor reads the at least one instruction set and executes the method of any one of claims 1-13 according to the instructions of the at least one instruction set.

16. The acoustic system according to claim 14, characterized in that The acoustic system is any one of a hearing aid system, a sound amplification system, a headphone system, a telephone system, and a conference system.

17. The acoustic system according to claim 14, characterized in that The acoustic system is a hearing aid system, and the acoustic system further comprises a housing, wherein the speaker, the sound sensor module and the signal processing circuit are arranged in the housing, wherein When the acoustic system is worn on the user's head, the sound output end of the speaker faces the user's head, and the sound pickup end of at least one sound sensor in the sound sensor module is located on a side of the housing away from the user's head.

Images