Acoustic system
By using speakers, sound sensors and signal processing circuits in the acoustic system, the feedback components are reduced and processed, and the howling problem caused by acoustic feedback is solved and the performance of the acoustic system is improved.
Patent Information
- Application Number
- PCT/CN2023/096286
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-25
- Publication Date
- 2024-11-28
AI Technical Summary
There are acoustic feedback problems in existing acoustic systems, which lead to problems such as howling and limit the maximum forward gain, and require a technology that can reduce or eliminate feedback sounds.
Using an acoustic system including a speaker, a first sound sensor and a second sound sensor, the feedback component in the second signal is reduced by a signal processing circuit to obtain a target signal, and an adaptive filtering operation is performed in the signal processing circuit to reduce or eliminate Feedback sound.
Effectively reduce or eliminate feedback sound, avoid whistling problems, and improve the maximum forward gain of the acoustic system.
Smart Images

Figure CN2023096286_28112024_PF_FP_ABST
Abstract
Description
Acoustic System Technical Field
[0001] This specification relates to the field of acoustic technology, and in particular to an acoustic system. Background Art
[0002] Some acoustic systems include both speakers and sound sensors. These acoustic systems often suffer from the problem of acoustic feedback. Acoustic feedback refers to the process in which the sound signal collected by the sound sensor is played through the speaker after certain processing, and the sound emitted by the speaker is re-collected by the sound sensor, thereby forming a closed loop of "speaker->sound sensor->speaker" in the acoustic system. In the above-mentioned acoustic system, the sound of the speaker picked up by the sound sensor can be called feedback sound. The existence of feedback sound causes some problems in the acoustic system. For example, it causes problems such as howling in the acoustic system and may also limit the maximum forward gain that the acoustic system can achieve. Therefore, it is necessary to provide an acoustic system that can reduce or eliminate feedback sound.
[0003] Summary of the Invention
[0004] This specification provides an acoustic system that can reduce or eliminate feedback sound, thereby avoiding problems such as howling caused by the feedback sound and improving the maximum forward gain that the acoustic system can achieve.
[0005] In a first aspect, the present specification provides an acoustic system comprising: a loudspeaker, a first sound sensor, a second sound sensor, and a signal processing circuit, wherein the loudspeaker receives a driving signal and converts it into a first sound when in operation, the first sound sensor collects ambient sound and generates a first signal when in operation, the ambient sound including the first sound and a second sound from a target sound source, the target sound source including other sound sources other than the loudspeaker, the second sound sensor collects the ambient sound and generates a second signal when in operation, wherein the first signal and the second signal satisfy k2≥2k1, wherein k1 is the ratio of the signal energy corresponding to the first sound in the first signal to the signal energy corresponding to the second sound, and k2 is the ratio of the signal energy corresponding to the first sound in the second signal to the signal energy corresponding to the second sound, the signal processing circuit is connected to the first sound sensor and the second sound sensor respectively, and when in operation, based on the second signal, reduces the signal component corresponding to the first sound in the first signal to obtain a target signal, and performs a target operation on the target signal.
[0006] In some embodiments, in order to satisfy k2≥2k1, the first signal and the second signal satisfy at least one of the following conditions: the ratio of the signal energy corresponding to the first sound in the second signal to the signal energy corresponding to the second sound in the second signal is greater than or equal to 2; the ratio of the signal energy corresponding to the first sound in the second signal to the signal energy corresponding to the first sound in the first signal is greater than or equal to 2; and the ratio of the signal energy corresponding to the second sound in the first signal to the signal energy corresponding to the first sound in the first signal is greater than or equal to 2.
[0007] In some embodiments, a positional relationship between the first sound sensor, the second sound sensor, and the speaker satisfies a preset condition, such that the first signal and the second signal satisfy k2≥2k1.
[0008] In some embodiments, the preset condition includes: L1≥2L2, where L2 is the distance between the second sound sensor and the speaker, and L1 is the distance between the first sound sensor and the speaker.
[0009] In some embodiments, the acoustic system further includes a shell, a partial area of the shell forms an acoustic cavity, the speaker and the second sound sensor are both located inside the acoustic cavity, and the first sound sensor is located outside the acoustic cavity.
[0010] In some embodiments, the sound-emitting component of the speaker separates the acoustic cavity into a first acoustic cavity and a second acoustic cavity, and the sound-emitting surface of the sound-emitting component faces the first acoustic cavity, wherein the second sound sensor is located inside the first acoustic cavity, or the second sound sensor is located inside the second acoustic cavity.
[0011] In some embodiments, the second sound sensor is coupled to a sound emitting component of the speaker.
[0012] In some embodiments, the acoustic system further includes a housing, the sound pickup surface of the second sound sensor and the sound pickup surface of the first sound sensor are both located in free space outside the housing, and the second sound sensor is closer to the speaker than the first sound sensor.
[0013] In some embodiments, the acoustic system further includes a shell, a partial area of which is formed with a first acoustic cavity and a second acoustic cavity, the speaker is located in the first acoustic cavity, the second sound sensor is located in the second acoustic cavity, and the second sound sensor is closer to the speaker than the first sound sensor.
[0014] In some embodiments, the acoustic system further comprises a shell, the sound pickup surface of the first sound sensor is located in the free space outside the shell, the sound pickup surface of the second sound sensor is located in the internal space of the shell, and the second sound sensor is closer to the speaker than the first sound sensor.
[0015] In some embodiments, the acoustic system further comprises a first shell and a second shell, wherein,
[0016] The second shell is located inside the first shell, and an acoustic cavity is formed in the second shell. The speaker and the second sound sensor are located inside the acoustic cavity.
[0017] In some embodiments, the acoustic system further includes a barrier, the second sound sensor and the speaker are located on a first side of the barrier, and the first sound sensor is located on a second side of the barrier.
[0018] In some embodiments, the sound pickup directivities of the first sound sensor and the second sound sensor meet a preset condition, so that the first signal and the second signal satisfy k2≥2k1.
[0019] In some embodiments, the sound pickup directivities of the first sound sensor and the second sound sensor satisfy at least one of the following conditions: the sound pickup sensitivity of the first sound sensor in a first direction is greater than the sound pickup sensitivity in a second direction; and the sound pickup sensitivity of the second sound sensor in the first direction is less than the sound pickup sensitivity in the second direction, wherein the first direction points to the target sound source and the second direction points to the speaker.
[0020] In some embodiments, the first sound sensor is located at a first position within the target area, and the second sound sensor is located at a second position within the target area, wherein the first position and the second position satisfy at least one of the following conditions: the sound energy from the speaker at the first position is less than the sound energy from the speaker at other positions within the target area except the first position; and the sound energy from the speaker at the second position is greater than the sound energy from the speaker at other positions within the target area except the second position.
[0021] In some embodiments, to obtain the target signal, the signal processing circuit performs an adaptive filtering operation on the second signal to obtain a third signal, and subtracts the third signal from the first signal to obtain the target signal.
[0022] In some embodiments, the signal processing circuit further updates filtering parameters corresponding to the adaptive filtering operation based on at least one of the second signal and the target signal.
[0023] In some embodiments, in order to obtain the target signal, the signal processing circuit: performs a first preprocessing operation on the first signal to obtain a first intermediate signal; performs a second preprocessing operation on the second signal to obtain a second intermediate signal; and based on the second intermediate signal, reduces the signal component corresponding to the first sound in the first intermediate signal to obtain the target signal.
[0024] In some embodiments, the first preprocessing operation includes at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation; and the second preprocessing operation includes at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation.
[0025] In some embodiments, the signal processing circuit is also connected to the speaker. When performing the target operation, the signal processing circuit: performs gain amplification on the target signal, and sends the gain-amplified signal to the speaker to drive the speaker to make sound.
[0026] As can be seen from the above technical solution, the acoustic system provided in this specification includes: a loudspeaker, a first sound sensor, a second sound sensor, and a signal processing circuit. The loudspeaker receives a driving signal and converts it into a first sound when in operation; the first sound sensor collects ambient sound and generates a first signal when in operation, wherein the ambient sound includes the first sound and a second sound from a target sound source; the second sound sensor collects ambient sound and generates a second signal when in operation, wherein the first signal and the second signal satisfy k2 ≥ 2k1, wherein k1 is the ratio of the signal energy corresponding to the first sound in the first signal to the signal energy corresponding to the second sound, and k2 is the ratio of the signal energy corresponding to the first sound in the second signal to the signal energy corresponding to the second sound; the signal processing circuit is connected to the first sound sensor and the second sound sensor, respectively, and when in operation, reduces the signal component corresponding to the first sound in the first signal based on the second signal to obtain a target signal, and performs a target operation on the target signal. It can be seen that the acoustic system provided in this specification can reduce or eliminate the feedback component in the target signal, thereby avoiding problems such as howling caused by feedback sound, and can also improve the maximum forward gain that the acoustic system can achieve.
[0027] Other functions of the acoustic system provided by this specification will be partially listed in the following description. The creative aspects of the acoustic system provided by this specification can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0029] FIG1 is a schematic diagram showing an application scenario provided according to an embodiment of this specification;
[0030] FIG2 shows a schematic diagram of a design of an acoustic system provided according to an embodiment of this specification;
[0031] FIG3 shows another schematic diagram of a design of an acoustic system according to an embodiment of this specification;
[0032] FIG4 shows another schematic diagram of a design of an acoustic system according to an embodiment of this specification;
[0033] FIG5 shows another schematic diagram of a design of an acoustic system according to an embodiment of this specification;
[0034] 6A to 6F show several structural schematic diagrams of acoustic systems provided according to embodiments of this specification;
[0035] 7A to 7G show several other structural schematic diagrams of acoustic systems provided according to embodiments of this specification;
[0036] 8A to 8F show several further structural schematic diagrams of acoustic systems provided according to embodiments of this specification;
[0037] FIG9 shows a schematic diagram of sound pickup directions of an acoustic system provided according to an embodiment of this specification;
[0038] FIG10A is a schematic diagram showing the positions of a first sound sensor and a second sound sensor within a target area in an acoustic system according to an embodiment of this specification;
[0039] FIG10B is a schematic diagram showing feedback sound energy corresponding to various positions within the target area of the acoustic system; and
[0040] FIG11 is a schematic diagram showing test results of the adaptive filtering performance of the acoustic system provided according to an embodiment of this specification. DETAILED DESCRIPTION
[0041] The following description provides specific application scenarios and requirements for this specification, with the goal of enabling those skilled in the art to make and use the contents of this specification. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but is intended to be accorded the broadest scope consistent with the claims.
[0042] The terms used herein are for the purpose of describing specific example embodiments only and are not intended to be limiting. For example, as used herein, the singular forms "a," "an," and "the" may also include the plural forms unless the context clearly indicates otherwise. When used in this specification, the terms "comprise," "include," and / or "contain" are intended to refer to the presence of the associated integers, steps, operations, elements, and / or components, but do not preclude the presence of one or more other features, integers, steps, operations, elements, components, and / or groups or the addition of other features, integers, steps, operations, elements, components, and / or groups in the system / method.
[0043] These and other features of this specification, as well as the operation and function of the associated elements of the structure, and the economical assembly and manufacture of the components, can be significantly improved with consideration of the following description. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be expressly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.
[0044] The flowcharts used in this specification illustrate operations implemented by systems according to some embodiments of the present specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. Rather, the operations may be implemented in reverse order or simultaneously. Furthermore, one or more additional operations may be added to the flowcharts. One or more operations may be removed from the flowcharts.
[0045] Before describing the specific embodiments of this specification, the application scenarios of this specification are first introduced as follows. The acoustic system provided in this specification can be applied to scenarios where feedback sound needs to be reduced or eliminated. An example is given below with reference to FIG1.
[0046] FIG1 shows a schematic diagram of an application scenario provided according to an embodiment of this specification. As shown in FIG1 , application scenario 001 can be a sound amplification scenario, an auxiliary listening scenario, a hearing aid scenario, etc. In this scenario, the sound sensor 120 collects ambient sound while in operation. During this process, if the speaker 110 is also playing sound synchronously, the sound played by the speaker 110 will also be collected by the sound sensor 120. In this way, the ambient sound collected by the sound sensor 120 includes both the sound from the target sound source 160 and the sound from the speaker 110. Furthermore, the sound pickup signal collected by the sound sensor 120 is amplified by the forward gain (G) and then input to the speaker 110, thereby driving the speaker 110 to produce sound. In this way, a closed loop of "speaker->sound sensor->speaker" is formed in the acoustic system. In this case, when sound signals of certain frequencies undergo self-oscillation, a howling phenomenon will occur. Such howling will make the user feel uncomfortable, and when the howling is severe, it may also cause damage to the components in the acoustic system. In addition, the existence of the howling also brings limitations to the forward gain amplification factor of the acoustic system, thereby restricting the maximum forward gain that can be achieved by the acoustic system.
[0047] It should be noted that the application scenarios shown in FIG1 above are only some of the multiple application scenarios applicable to this application. The acoustic system provided by this application can also be applied to other similar scenarios, which are not listed one by one in this specification. Those skilled in the art should understand that the application of the acoustic system provided by this application to other usage scenarios is also within the scope of protection of this application.
[0048] In summary, the presence of feedback sound can cause a series of problems in acoustic systems, including but not limited to: generating howling, limiting the maximum forward gain that the acoustic system can achieve, etc. To this end, the present application provides an acoustic system that reduces or eliminates feedback sound, thereby avoiding the above-mentioned series of problems.
[0049] The acoustic system provided in this application can use acoustic feedback cancellation (AFC) technology to reduce or eliminate feedback sound. To facilitate subsequent description, the principle of AFC technology is first introduced in conjunction with Figure 2.
[0050] FIG2 shows a schematic diagram of a design of an acoustic system provided according to an embodiment of this specification. The acoustic system 10 can be a hearing aid / assisted hearing system or a sound amplification system. The acoustic system 10 can utilize AFC technology to reduce or eliminate feedback components (i.e., signal components corresponding to feedback sound). As shown in FIG2 , the acoustic system 10 can include a speaker 110, a sound sensor 120, and a signal processing circuit 150.
[0051] The speaker 110 is a device for converting an electrical signal into sound, and may also be referred to as an electroacoustic converter. For example, the speaker 110 may be a speaker. The speaker 110 may be a device that produces sound based on at least one of a gas, a liquid, and a solid. The speaker 110 may be connected to the signal processing circuit 150, and when in operation, receives the electrical signal from the signal processing circuit 150 and converts it into sound for playback. In some embodiments, the acoustic system 10 may further include a first peripheral circuit (not shown in FIG. 2 ). The first peripheral circuit is connected between the signal processing circuit 150 and the speaker 110. The first peripheral circuit may include all or part of the circuits between the output end of the signal processing circuit 150 and the speaker 110. The first peripheral circuit may perform some processing on the electrical signal output by the signal processing circuit 150 so that the processed electrical signal is suitable for playback by the speaker 110. The first peripheral circuit may include, but is not limited to, at least one of an operational amplifier device, a power amplifier device, a digital-to-analog converter device, a capacitor, an inductor, a resistor, and the like.
[0052] The sound sensor 120 is a device for picking up sound and converting it into an electrical signal, and may also be referred to as an acoustic-to-electrical converter. For example, the sound sensor 120 may be a microphone (MIC). The sound sensor 120 may be a device that picks up sound using at least one of the conductive modes of gas, liquid, or solid. The sound sensor 120 may be connected to the signal processing circuit 150. During operation, the sound sensor 120 collects ambient sound and converts it into an electrical signal, which is then sent to the signal processing circuit 150. In some embodiments, the acoustic system 10 may further include a second peripheral circuit (not shown in FIG. 2 ). The second peripheral circuit is connected between the sound sensor 120 and the signal processing circuit 150. The second peripheral circuit may include all or part of the circuits between the sound sensor 120 and the input terminal of the signal processing circuit 150. The second peripheral circuit may perform some processing on the electrical signal picked up by the sound sensor 120 to convert it into a signal suitable for processing by the signal processing circuit 150. The second peripheral circuit may include, but is not limited to, at least one of a power amplifier, an operational amplifier, an analog-to-digital converter, a capacitor, an inductor, a resistor, and the like.
[0053] Continuing with FIG2 , the sound sensor 120 collects ambient sound to generate a sound pickup signal y, and inputs the sound pickup signal y into the signal processing circuit 150 . The ambient sound includes at least a second sound emitted by a target sound source 160 . The target sound source 160 refers to a sound source other than the speaker 110 . For example, the target sound source 160 may include an electronic device with a sound playback function (e.g., a television, a speaker, a mobile phone, etc.); or, for another example, the target sound source 160 may also include a human throat. The sound pickup signal y may be referred to as the input signal of the signal processing circuit 150 . The signal processing circuit 150 performs a series of processing on the sound pickup signal y to obtain a drive signal u, and sends the drive signal u to the speaker 110 . The drive signal u may serve as the output signal of the signal processing circuit 150 . The speaker 110 receives the drive signal u and converts it into a first sound. The first sound is re-collected by the sound sensor 120 after being transmitted through the feedback path, and therefore, the first sound may also be referred to as feedback sound. Thus, the ambient sound collected by the sound sensor 120 includes not only the second sound from the target sound source 160, but also the first sound from the speaker 110. In other words, the sound pickup signal y includes both the signal component x corresponding to the first sound (i.e., the feedback sound) and the signal component v corresponding to the second sound.
[0054] The signal processing circuit 150 can be a circuit with certain signal processing capabilities. Its input is connected to the sound sensor 120, and its output is connected to the speaker 110. During operation, the signal processing circuit 150 can obtain a sound pickup signal y from the sound sensor 120, perform a predetermined signal processing on the sound pickup signal y, and generate a driving signal u, which is then transmitted to the speaker 110.
[0055] In some embodiments, the signal processing circuit 150 may include multiple hardware circuits with a connection relationship, each hardware circuit includes one or more electrical components, and each electrical component implements one or more functional units, so that the above-mentioned multiple hardware circuits cooperate with each other when working to implement the signal processing process.
[0056] In some embodiments, the signal processing circuit 150 may include a hardware device with a data information processing function and a necessary program to drive the hardware device to work, and the hardware device implements the signal processing process by executing the program. For example, the signal processing circuit 150 may include at least one storage medium and at least one processor. Among them, the storage medium may include a data storage device. The data storage device may be a non-temporary storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk, a read-only storage medium (ROM) or a random access storage medium (RAM). The storage medium also includes at least one instruction set stored in the data storage device. The instruction is a computer program code, and the computer program code may include a program, routine, object, component, data structure, process, module, etc. for executing the signal processing method provided in this specification.
[0057] The at least one processor may be communicatively connected to the at least one storage medium. The at least one processor is configured to execute the at least one instruction set. When the acoustic system is running, the at least one processor reads the at least one instruction set and executes the signal processing process according to the instructions of the at least one instruction set. The processor may include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof.
[0058] Continuing with FIG2 , to reduce or eliminate feedback components, the signal processing circuit 150 may include an acoustic feedback cancellation unit 170. The inputs to the acoustic feedback cancellation unit 170 include a drive signal u and a picked-up sound signal y. Based on the drive signal u, the acoustic feedback cancellation unit 170 may reduce the signal component corresponding to the first sound in the picked-up sound signal y, thereby generating a target signal e.
[0059] 2 for specific explanation, the acoustic feedback cancellation unit 170 can solve and adaptively update a time-varying transfer function F' to fit the transfer function F corresponding to the feedback path. To distinguish them, the transfer function F' will be referred to as the predicted transfer function F' and the transfer function F corresponding to the feedback path will be referred to as the true transfer function F. The acoustic feedback cancellation unit 170 uses the predicted transfer function F' to perform an adaptive filtering operation on the driving signal u to obtain a signal x', that is, x'=u*F'. The signal x' can be regarded as a predicted value of the feedback component in the picked-up signal y (that is, the signal component corresponding to the first sound in the picked-up signal y). Furthermore, the acoustic feedback cancellation unit 170 can subtract the signal x' from the picked-up signal y to obtain the target signal e, that is, e=y-x'. The target signal e obtained in this way does not contain or contains less feedback sound components.
[0060] It should be noted that the acoustic feedback cancellation unit 170 can use a variety of adaptive filtering algorithms to solve the predicted transfer function F', such as least mean square (LMS), normalized least mean square (NLMS), recursive least squares (RLS), other adaptive filtering algorithms, and any derivative algorithms of the above-mentioned algorithms. This application does not limit this. In addition, the adaptive filtering algorithm can be adaptive filtering in the time domain, frequency domain, or other transform domains.
[0061] According to the theory of adaptive filtering algorithm, the update method of the predicted transfer function F' can be achieved by minimizing the expectation of the mean square function of the target signal e, that is: min F′ E[2 2 ]=min F′ E[(yu*F′) 2 ] Formula (1-1)
[0062] For example, taking the acoustic feedback cancellation unit 170 using the LMS algorithm as an example, the above formula (1-1) is derived based on the gradient descent optimization method, and the update formula of the predicted transfer function F' can be obtained as follows: F'←F'+μ*e*u Formula (2-1)
[0063] Where μ is the iteration step size.
[0064] It should be understood that when the acoustic feedback cancellation unit 170 adopts algorithms such as NLMS and RLS, the update formula of the predicted transfer function F' can be derived in a similar manner, and this specification does not provide examples one by one for this purpose.
[0065] It can be seen that the acoustic system shown in FIG2 can reduce or eliminate feedback sound by adopting AFC technology, thereby avoiding a series of problems caused by feedback sound.
[0066] According to signal processing theory, the closed-loop gain A of the acoustic system shown in Figure 2 can be expressed as follows:
[0067] According to the Nyquist stability criterion, an acoustic system must be able to cancel feedback if the predicted transfer function F' is exactly equal to the true transfer function F, that is, F' = F. When this requirement is met, the acoustic system is always stable, with no howling. Furthermore, the acoustic system can achieve infinite gain. Specifically, when the forward gain G → ∞, A = G → ∞.
[0068] However, in actual acoustic systems, since the true transfer function F may be time-varying and the convergence process of the iterative solution may oscillate, it is difficult for the iterative process of F' to achieve the ideal condition F' = F. In other words, there is a certain deviation between the predicted transfer function F' obtained by the actual iteration and the true transfer function F. In this case, in order to keep the acoustic system stable, the forward gain G provided by the gain amplifier unit 130 naturally cannot be infinite. The maximum forward gain that the acoustic system can achieve is:
[0069] As can be seen from formula (4), the deviation between the predicted transfer function F′ and the true transfer function F can be used to measure the convergence performance of the adaptive filtering algorithm, and thus the acoustic system's ability to cancel feedback sound. Specifically, the smaller the deviation between the predicted transfer function F′ and the true transfer function F, the better the convergence performance of the adaptive filtering algorithm, and thus the better the acoustic system's ability to cancel feedback sound. The larger the deviation between the predicted transfer function F′ and the true transfer function F, the worse the convergence performance of the adaptive filtering algorithm, and thus the worse the acoustic system's ability to cancel feedback sound.
[0070] In some embodiments, we can also use misalignment (MIS) to measure the convergence performance of the adaptive filtering algorithm. The misalignment MIS can be expressed as follows:
[0071] The unit of offset MIS is decibel (dB). When the predicted transfer function F' is initialized to zero, the offset MIS is 0dB. As the offset MIS decreases and approaches negative infinity, the deviation between the predicted transfer function F' and the true transfer function F decreases, indicating better convergence of the adaptive filtering algorithm and, consequently, better feedback cancellation by the acoustic system. As the offset MIS increases and approaches positive infinity, the deviation between the predicted transfer function F' and the true transfer function F increases, indicating worse convergence of the adaptive filtering algorithm and, consequently, worse feedback cancellation by the acoustic system.
[0072] It should be noted that the convergence performance of the adaptive filtering algorithm in this application includes, but is not limited to, convergence speed, convergence error, etc. The convergence speed may refer to the speed at which the predicted transfer function F′ fits the true transfer function F, and the convergence error may refer to the deviation between the predicted transfer function F′ and the true transfer function F when the convergence condition is met.
[0073] In the acoustic system shown in FIG2 , the reason why a time-varying predicted transfer function F′ can be solved by an adaptive filtering algorithm to fit the transfer function F corresponding to the feedback path is based on the following ideal assumption: the feedback path is entirely linear.
[0074] However, actual acoustic systems usually cannot meet the above ideal assumptions. This is because in actual acoustic systems, there are multiple devices in the feedback path, and these devices may have nonlinear responses. For example, the interaction between the diaphragm and magnet of the speaker 110 causes hysteresis effects and saturation distortion, so the response of the speaker 110 contains nonlinear response components. In addition, there are usually power amplifiers, operational amplifiers and other devices between the signal processing circuit 150 and the speaker 110. Power amplifiers and operational amplifiers usually have limiting effects, so the responses of the two also contain nonlinear response components. Similarly, other devices between the signal processing circuit 150 and the speaker 110 may also have nonlinear response components.
[0075] Because the acoustic feedback cancellation unit 170 obtains the drive signal u before the output port of the signal processing circuit 150 and adaptively filters the drive signal u using the predicted transfer function F′, the nonlinear responses of components such as the speaker 110, power amplifier, and operational amplifier are inevitably introduced into the iterative solution of the predicted transfer function F′. This results in poor convergence performance of the adaptive filtering algorithm, for example, causing the predicted transfer function F′ to fail to converge, converge slowly, or have a large convergence error. This deteriorates the acoustic system's misalignment indicator (MIS), further affecting the acoustic system's ability to cancel feedback sound.
[0076] Furthermore, in some acoustic system architectures, the acoustic feedback cancellation unit 170 may be independent of other units in the signal processing circuit 150, and the acoustic system architecture may restrict access rights or communication capabilities between different units. Consequently, the acoustic feedback cancellation unit 170 may be unable to obtain the driving signal u from other units. Consequently, such acoustic systems cannot use AFC technology to reduce or eliminate feedback.
[0077] FIG3 shows another schematic diagram of an acoustic system according to an embodiment of the present disclosure. As shown in FIG3 , the acoustic system 20 may include: a speaker 110 , a first sound sensor 120 - 1 , a second sound sensor 120 - 2 , and a signal processing circuit 150 .
[0078] The acoustic system 20 shown in Figure 3 can be considered a further improvement on the acoustic system 10 shown in Figure 2 . Comparing Figures 2 and 3 , it can be seen that the first sound sensor 120-1 in the acoustic system 20 shown in Figure 3 corresponds to the sound sensor 120 in the acoustic system 10 shown in Figure 2 . Thus, the acoustic system 20 shown in Figure 3 is equivalent to the acoustic system 10 shown in Figure 2 with the addition of a second sound sensor 120-2. The structure of the second sound sensor 120-2 can be the same as or different from that of the first sound sensor 120-1, and this is not limited in this application.
[0079] The acoustic system 20 shown in FIG3 operates as follows: When the speaker 110 is operating, it receives a driving signal u from the signal processing circuit 150 and converts the driving signal u into a first sound. When the first sound sensor 120-1 is operating, it collects ambient sound and generates a first signal y1. When the second sound sensor 120-2 is operating, it collects ambient sound and generates a second signal y2. The ambient sound includes the first sound from the speaker 110 and the second sound from the external sound source 160. Thus, the first signal y1 includes a signal component x1 corresponding to the first sound and a signal component v1 corresponding to the second sound, and the second signal y2 includes a signal component x2 corresponding to the first sound and a signal component v2 corresponding to the second sound. The external sound source 160 includes other sound sources in the environment other than the speaker 110, such as a person's throat, an electronic device with a sound playback function, other speakers, etc.
[0080] It should be noted that the first sound emitted by the speaker 110 can be conducted through one or more media among gas, liquid and solid, and then picked up by the first sound sensor 120-1 and the second sound sensor 120-2. The second sound emitted by the target sound source 160 can be conducted through one or more media among gas, liquid and solid, and then picked up by the first sound sensor 120-1 and the second sound sensor 120-2. In addition, this specification does not limit the carrying method of the first signal y1, the second signal y2, and the driving signal u. All three can be signals carried by any carrier. For example, the first signal y1, the second signal y2, and the driving signal u can all be electrical signals, optical signals, digital carrier signals, or signals of other carrier types.
[0081] In the acoustic system 20 shown in FIG3 , the first sound sensor 120 - 1 and the second sound sensor 120 - 2 have different sound pickup emphases. The first sound sensor 120 - 1 focuses on picking up sound from the target sound source 160 , while the second sound sensor 120 - 2 focuses on picking up sound from the speaker 110 . Specifically, the first signal y1 picked up by the first sound sensor 120 - 1 and the second signal y2 picked up by the second sound sensor 120 - 2 satisfy the following relationship: k2 ≥ 2k1 Formula (6)
[0082] Wherein, k1 is the signal energy corresponding to the first sound in the first signal y1 |x1| 2 and the signal energy corresponding to the second sound |v1| 2 The ratio of |x2| to the first sound is k2, which is the signal energy in the second signal y2 corresponding to the first sound. 2 and the signal energy corresponding to the second sound |v2| 2 The ratio is:
[0083] In other words, let the ratio of k2 to k1 be N, that is, N = k2 / k1, then the value of N can be a real number greater than or equal to 2. For example, the value of N can be within the interval specified by any two of 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, ..., ∞. When the value of N is larger and closer to ∞, the second sound sensor 120-2 is closer to picking up only the sound of the speaker 110, and the first sound sensor 120-1 is closer to picking up only the sound of the target sound source 160. In addition, when the ratio between k2 and k1 is N, the closed-loop gain A of the acoustic system can be expressed as follows:
[0084] It should be noted that the derivation of formula (20) can be found in the derivation of formula (19) below and will not be detailed here. Formula (20) shows that as the value of N gradually increases, the closed-loop gain A and the forward gain G gradually approach each other, which means that the system's energy loss gradually decreases. When the value of N is ∞, the closed-loop gain A reaches the ideal forward gain G.
[0085] In order to satisfy the above condition k2≥2k1, the first signal y1 and the second signal y2 may satisfy one or more of the following conditions:
[0086] (1) The signal energy corresponding to the first sound in the second signal y2 |x2| 2 and the signal energy |v2| corresponding to the second sound in the second signal y2. 2 The ratio is greater than or equal to 2, that is:
[0087] The above condition can also be expressed as: the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |v2| corresponding to the second sound in the second signal y2. 2 . It can be understood that when |x2| 2 Much larger than |v2| 2 When k2 is set to be as large as possible, the second sound sensor 120-2 picks up the first sound much more than the second sound. When k2 approaches infinity, the second sound sensor 120-2 picks up almost only the first sound and does not pick up the second sound.
[0088] (2) The signal energy |v1| corresponding to the second sound in the first signal y1 2 and the signal energy |x1| corresponding to the first sound in the first signal y1. 2 The ratio is greater than or equal to 2, that is:
[0089] The above condition can also be expressed as: the signal energy |v1| corresponding to the second sound in the first signal y1 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 . It can be understood that when |v1| 2 Much larger than |x1| 2 When k1 is set to zero, the first sound sensor 120-2 picks up almost only the second sound and does not pick up the first sound.
[0090] (3) The signal energy corresponding to the first sound in the second signal y2 |x2| 2 and the signal energy |x1| corresponding to the first sound in the first signal y1. 2 The ratio is greater than or equal to 2, that is:
[0091] The above condition can also be expressed as: the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 . It can be understood that when |x2| 2 Much larger than |x1| 2 When the first sound is picked up by the second sound sensor 120-2, it is much greater than the first sound picked up by the first sound sensor 120-1. For example, the second sound sensor 120-2 picks up almost all of the first sound, while the first sound sensor 120-2 hardly picks up the first sound.
[0092] The signal processing circuit 150 can be connected to the first sound sensor 120-1 and the second sound sensor 120-2, respectively. The signal processing circuit 150 can obtain a first signal y1 from the first sound sensor 120-1 and a second signal y2 from the second sound sensor 120-2. Furthermore, based on the second signal y2, the signal processing circuit 150 can reduce the signal component corresponding to the first sound in the first signal y1 to obtain a target signal e. In this way, the target signal e contains no or minimal feedback sound components.
[0093] Similar to Figure 2, the acoustic system shown in Figure 3 can also reduce or eliminate the feedback component in the target signal based on AFC technology. Continuing to refer to Figure 3, the signal processing circuit 150 may include an acoustic feedback cancellation unit 170. The acoustic feedback cancellation unit 170 can solve and adaptively update a time-varying predicted transfer function F' to fit the actual transfer function F corresponding to the feedback path. The input of the acoustic feedback cancellation unit 170 includes: a first signal y1 and a second signal y2. The acoustic feedback cancellation unit 170 can reduce the signal component corresponding to the first sound in the first signal y1 based on the second signal y2, thereby obtaining the target signal e. Specifically, the acoustic feedback cancellation unit 170 uses the predicted transfer function F' to perform an adaptive filtering operation on the second signal y2 to obtain a third signal x', that is, x'=y2*F'. The third signal x' can be regarded as a predicted value of the feedback component in the first signal y1 (that is, the signal component corresponding to the first sound in the first signal y1). Furthermore, the acoustic feedback canceling unit 170 can subtract the third signal x' from the first signal y1 to obtain the target signal e, ie, e=y1-x'=y1-y2*F'. The target signal e thus obtained contains no or less feedback sound components.
[0094] After obtaining the target signal e, the signal processing circuit 150 may also update the filtering parameters of the adaptive filtering operation F′ based on at least one of the second signal y2 and the target signal e. Specifically, according to the theory of the adaptive filtering algorithm, the update method of the predicted transfer function F′ may be achieved by minimizing the expectation of the mean square function of the target signal e, that is, min F′ E[e 2 ]=min F′ E[(y1-y2*F′) 2 ] Formula (1-2)
[0095] Still taking the acoustic feedback cancellation unit 170 using the LMS algorithm as an example, the above formula (1-2) is derived based on the gradient descent optimization method, and the update formula of the predicted transfer function F′ can be obtained as follows: F′←F′+μ*e*y2 Formula (2-2)
[0096] Where μ is the iteration step size.
[0097] It should be understood that when the acoustic feedback cancellation unit 170 adopts algorithms such as NLMS, RLS, etc., a similar method can be used to derive an update formula for the predicted transfer function F′, which will not be explained one by one in this specification.
[0098] After the acoustic system shown in Figure 3 obtains the target signal e, the signal processing circuit 150 can perform a target operation on the target signal e. Continuing to refer to Figure 3, the signal processing circuit 150 can also include a gain amplification unit 130 (the gain amplification unit is marked as G in Figure 3). The gain amplification unit performs gain amplification on the target signal e, and sends the gain-amplified signal to the speaker 110 as the driving signal u at the next moment, thereby driving the speaker 110 to make a sound. Since the feedback component in the target signal e is reduced or eliminated, it is possible to avoid or suppress howling in the acoustic system 10, and it also helps to improve the maximum forward gain that the acoustic system 10 can achieve.
[0099] The acoustic system 20 shown in FIG3 uses a newly added second sound sensor 120-2 to focus on picking up the first sound to obtain a second signal y2. Then, the signal processing circuit 150 can use AFC technology to reduce the feedback component in the first signal y1 based on the second signal y2, thereby reducing or eliminating the feedback component. Compared with the acoustic system 10 shown in FIG2, the acoustic system 20 shown in FIG3 is obtained from the signal path after the speaker 110. Therefore, when solving the predicted transfer function F′, the feedback cancellation unit 170 only needs to fit the transfer function of the feedback path after the speaker 110, thereby avoiding the influence of the nonlinear response of the speaker 110 and the devices before the speaker 110 (such as operational amplifiers, power amplifiers, etc.) on the convergence performance of the adaptive filtering algorithm, thereby improving the cancellation effect of the feedback sound. In addition, since the second signal y2 required by the feedback cancellation unit 170 is picked up by the second sound sensor 120-2, even if the acoustic system 20 restricts the interaction authority between the feedback cancellation unit 170 and other units, it does not affect the application of AFC technology in the acoustic system 20, reduces the requirements of AFC technology on the design architecture of the acoustic system, and improves the application flexibility and breadth of AFC technology.
[0100] In addition, because the feedback cancellation unit 170 originally has system access rights to the first sound sensor 120-1, and the rights required to access the second sound sensor 120-2 are the same as the rights required to access the first sound sensor 120-1, after the second sound sensor 120-2 is added to the acoustic system shown in Figure 3, the feedback cancellation unit 170 does not need to add new system access rights to achieve access to the data of the second sound sensor 120-2.
[0101] Furthermore, after the acoustic system shown in FIG3 adds the second sound sensor 120-2, there is no need to change the internal implementation of the acoustic feedback cancellation unit 170, that is, there is no need to change the update formula of the predicted transfer function F′ and the calculation formula for feedback sound cancellation. Instead, it is only necessary to replace the input signal u of the acoustic feedback cancellation unit 170 with y2. It can be seen that the acoustic system shown in FIG3 can be applied, adapted, and compatible with existing acoustic feedback cancellation units 170, regardless of the adaptive filtering algorithm used by these existing acoustic feedback cancellation units 170 (including but not limited to the LMS, NLMS, RLS or other adaptive filtering algorithms mentioned above). Therefore, the modification of the acoustic system is relatively easy and has wide applicability.
[0102] Next, the system stability of the acoustic system 20 shown in FIG3 is verified.
[0103] According to the theory of signal processing, the closed-loop gain A of the acoustic system shown in Figure 3 can be expressed as follows:
[0104] Here, F1 represents the acoustic transfer function between the speaker 110 and the first sound sensor 120 - 1 , and F2 represents the acoustic transfer function between the speaker 110 and the second sound sensor 120 - 2 .
[0105] According to the Nyquist stability criterion, the requirement for the acoustic system 20 to cancel the feedback sound is that the predicted transfer function F′ to be solved satisfies the following conditions:
[0106] That is, the prediction transfer function F′ needs to satisfy:
[0107] When the predicted transfer function F′ satisfies the above formula (14), formula (3-2) can be transformed into:
[0108] Since the first signal y1 and the second signal y2 satisfy the following condition: k2 ≥ 2k1, that is:
[0109] Substituting x1 and x2 in formula (16), we get:
[0110] Simplifying formula (17) yields: |v1F2| 2 ≥2·|v2F1| 2 Formula (18)
[0111] Substituting the above formula (18) into formula (15), we get:
[0112] As can be seen from formula (19), when the forward gain G → ∞, the closed-loop gain A → ∞. Therefore, the acoustic system shown in Figure 3 remains stable when the predicted transfer function F′ reaches the convergence condition. This confirms the correctness of the solution of this application.
[0113] Based on the acoustic system 20 shown in FIG3 , in some cases, when the second sound sensor 120 - 2 is in a strong feedback environment, the acoustic transfer function F2 from the speaker 110 to the second sound sensor 120 - 2 is ≈1, and the first signal y1 and the second signal y2 satisfy the following conditions:
[0114] The signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |v2| corresponding to the second sound in the second signal y2. 2 , that is: |x2| 2 >>|v2| 2 .
[0115] In this case, the acoustic system shown in FIG3 can be simplified to the acoustic system shown in FIG4. In the acoustic system shown in FIG4, the second sound sensor 120-2 picks up almost only the sound from the speaker 110. In this case, the second signal y2≈u. Therefore, the updated formula for the predicted transfer function F′ can be updated as: F′←F′+μey2≈F′+μeu Formula (2-3)
[0116] Accordingly, the closed-loop gain A of the acoustic system 30 can be expressed as:
[0117] It can be seen that when the second sound sensor 120-2 is located in a strong feedback scenario, the AFC mathematical expression in the acoustic system shown in FIG4 is exactly the same as the AFC mathematical expression based on the ideal assumption in the acoustic system shown in FIG2. This further confirms the correctness of the solution of the present application.
[0118] Figure 5 shows another design schematic diagram of an acoustic system provided according to an embodiment of the present specification. As shown in Figure 5, the signal processing circuit 150 may further include a preprocessing unit 180. After obtaining the first signal y1 and the second signal y2, the signal processing circuit 150 may preprocess the first signal y1 and the second signal y2 respectively through the preprocessing unit 180. Specifically, the signal processing circuit 150 performs a first preprocessing operation H1 on the first signal y1 through the preprocessing unit 180 to obtain a first intermediate signal y1′, and performs a second preprocessing operation H2 on the second signal y2 to obtain a second intermediate signal y2′. Furthermore, the first intermediate signal y1′ and the second intermediate signal y2′ are input to the acoustic feedback cancellation unit 170. Based on the second intermediate signal y2′, the acoustic feedback cancellation unit 170 reduces the signal component corresponding to the first sound in the first intermediate signal y1′ to obtain a target signal e. It should be understood that the internal processing process of the acoustic feedback cancellation unit 170 has been described above and will not be repeated here.
[0119] The first preprocessing operation H1 may include, but is not limited to, at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation. The second preprocessing operation H2 may include, but is not limited to, at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation. When designing an acoustic system, the first preprocessing operation H1 and the second preprocessing operation H2 can be designed based on the requirements of different application scenarios. For example, in some cases, there may be a difference in the frequency response of the first sound sensor 120-1 and the second sound sensor 120-2. Therefore, appropriate first preprocessing operations H1 and second preprocessing operations H2 can be designed to compensate for this difference, thereby ensuring that the frequency responses of the first signal y1 and the second signal y2 match each other and meet the computational requirements of the AFC algorithm. Thus, by performing preprocessing operations on the first signal y1 and the second signal y2, the signal processing circuit 150 can meet the processing requirements of different application scenarios.
[0120] Figures 3 to 5 above illustrate an acoustic system 20 including a single speaker 110. In some scenarios, the number of speakers 110 in the acoustic system 20 may be M, where M is an integer greater than 1. In this case, the number of second sound sensors 120-2 may also be M. The M second sound sensors 120-2 correspond one-to-one to the M speakers 110. The i-th second sound sensor 120-2 specifically picks up the sound emitted by the i-th speaker 110.
[0121] Specifically, for any i-th second sound sensor among the M second sound sensors 120-2, the i-th second sound sensor 120-2 collects ambient sound and generates a second signal y when in operation. 2iAmong them, the first signal y1 and the second signal y 2i Satisfy k 2i ≥2k1,k 2i is the second signal y 2i The signal processing circuit 150 can further calculate the ratio of the signal energy corresponding to the sound emitted by the i-th speaker 110 to the signal energy corresponding to the sound emitted by the target sound source. The target sound source includes other sound sources in the environment except the i-th speaker. 2i The feedback component in the first signal y1 is reduced to obtain the target signal e i The signal processing circuit converts the target signal e1 to the target signal e M The target signal e is obtained by superposition, and then the target operation is performed on the target signal e.
[0122] Thus, when the acoustic system 20 includes M speakers 110, the acoustic system 20 can include M second sound sensors 120-2. The i-th sound sensor 120-2 focuses on picking up the sound of the i-th speaker and is used in the AFC adaptive filtering process. This is equivalent to superimposing M AFC-based adaptive filtering processes in the acoustic system 20. Each adaptive filtering process is consistent with the description of Figures 3 to 5 above and will not be repeated here.
[0123] In summary, based on the acoustic system shown in Figures 3 to 5, when the first signal y1 and the second signal y2 satisfy the condition k2≥2k1, the use of AFC technology can effectively reduce or eliminate feedback sound, and can avoid or reduce the impact of nonlinear response on the convergence performance of the adaptive filtering algorithm.
[0124] The following describes in detail how to design an acoustic system so that the first signal y1 and the second signal y2 satisfy the condition k2 ≥ 2k1. It should be noted that there are many possible solutions for designing an acoustic system, and the following only uses a few possible solutions as examples. The different solutions listed below can be combined with each other.
[0125] Solution 1: The acoustic system can be designed from a structural dimension so that the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 meets a preset condition, thereby making the first signal y1 and the second signal y2 meet the condition k2≥2k1.
[0126] In some embodiments, the first sound sensor 120 - 1 , the second sound sensor 120 - 2 , and the speaker 110 satisfy a preset distance condition.
[0127] For example, the distance condition may include: the distance between the second sound sensor 120-2 and the speaker 110 is much smaller than the distance between the first sound sensor 120-1 and the speaker 110. That is, the second sound sensor 120-2 is as close to the speaker 110 as possible compared to the first sound sensor 120-1. Assuming that the distance between the first sound sensor 120-1 and the speaker 110 is recorded as L1, and the distance between the second sound sensor 120-2 and the speaker 110 is recorded as L2, then L1 and L2 meet the distance condition: L1 ≥ 2L2. The above distance condition can also be expressed as the ratio of L1 to L2 is greater than or equal to a preset value. The above preset value can be in the interval specified by any two of 2, 3, 4, 5, 6, 7, 8, 9, 10, ...∞.
[0128] The following examples illustrate possible structures of the acoustic system with reference to Figures 6A to 6F. It should be noted that this specification does not limit the product form of the acoustic system 20. For example, the acoustic system 20 can adopt a true wireless headset form, an earmuff form, a glasses form, a back-hook form, a behind-the-ear form, an in-the-ear form, or any other possible form. Figures 6A to 6F only illustrate several possible product forms.
[0129] For example, when the acoustic system 20 adopts a true wireless headset form factor, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 can be as shown in FIG6A. When the acoustic system 20 adopts an earmuff form factor, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 can be as shown in FIG6B. When the acoustic system 20 adopts a glasses form factor, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 can be as shown in FIG6C. When the acoustic system 20 adopts a rear-hanging form factor, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 can be as shown in FIG6D. When the acoustic system 20 adopts a behind-the-ear form factor, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 can be as shown in FIG6E. Among them, the behind-the-ear form includes but is not limited to BTE (Behind-The-Ear), RIC (Receiver-In-Canal) and other forms in hearing aids. When the acoustic system 20 adopts the in-ear form, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in Figure 6F. Among them, the in-ear form includes but is not limited to: ITE (In-The-Ear), ITC (In-The-Canal), CIC (Completely-In-the-Canal) and other forms in hearing aids. The acoustic system structures shown in Figures 6A to 6F all meet the distance condition L1≥2L2.
[0130] It should be understood that when the acoustic system satisfies the distance condition L1 ≥ 2L2, the second sound sensor 120-2 can pick up a stronger first sound than the first sound sensor 120-1. Therefore, the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 , which helps to make the first signal y1 and the second signal y2 satisfy the condition k2≥2k1.
[0131] It is understandable that although Figures 6A to 6F above show some examples of acoustic systems that meet the distance condition L1 ≥ 2L2, in some cases, some acoustic systems may not meet the distance condition L1 ≥ 2L2 due to the influence of product form or specific requirements. That is, the values of L1 and L2 are relatively close. For example, Figures 7A to 7G respectively show schematic structural diagrams of acoustic systems when the values of L1 and L2 are relatively close. Specifically, when the acoustic system 20 adopts a true wireless headset form, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in Figure 7A. When the acoustic system 20 adopts an earmuff form, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in Figure 7B. When the acoustic system 20 adopts a glasses form, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in Figure 7C. When the acoustic system 20 adopts a rear-hanging form, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in Figure 7D (when the distances between the two sound sensors and the speaker are relatively far), or as shown in Figure 7E (when the distances between the two sound sensors and the speaker are relatively close). When the acoustic system 20 adopts a behind-the-ear form, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in Figure 7F. The behind-the-ear form includes but is not limited to forms such as BTE (Behind-The-Ear) and RIC (Receiver-In-Canal) in hearing aids. When the acoustic system 20 adopts an in-the-ear form, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in Figure 7G. Among them, the in-ear form includes but is not limited to: ITE (In-The-Ear), ITC (In-The-Canal), CIC (Completely-In-the-Canal) and other forms in hearing aids.
[0132] If the acoustic system cannot satisfy the distance condition L1 ≥ 2L2 (for example, as shown in Figures 7A to 7G ), the subsequent solutions can be used to design the acoustic system so that the first signal y1 and the second signal y2 satisfy the condition k2 ≥ 2k1. It should be noted that when the acoustic system adopts the design solution shown in Figures 6A to 6F , it can also be combined with one or more of the subsequent solutions.
[0133] In some embodiments, the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 meet preset structural conditions. The structural conditions met by the acoustic system are described below with reference to Figures 8A to 8F. It should be noted that Figures 8A to 8F only illustrate a partial structure of the acoustic system.
[0134] For example, the acoustic system 20 may adopt an acoustic cavity design. Referring to Figures 8A to 8C, the acoustic system 20 may include a shell 21, and an acoustic cavity 22 is formed in a partial area of the shell 21. It should be noted that the present application does not limit the specific form of the acoustic cavity 22. The loudspeaker 110 is located inside the acoustic cavity 22. The sound-emitting component of the loudspeaker 110 can separate the acoustic cavity 22 into a first acoustic cavity 22-1 and a second acoustic cavity 22-2. The above-mentioned sound-emitting component may refer to a component that generates vibration in the loudspeaker 110, for example, a vibrating membrane, a vibrating beam, a vibrating rod, a vibrating block, etc. The first acoustic cavity 22-1 refers to the acoustic resonance cavity of the first sound emitted by the loudspeaker 110 before it enters the external free space. The second acoustic cavity 22-2 refers to the acoustic resonance cavity where the component of the first sound emitted by the loudspeaker 110 that will not directly propagate to the external free space is located. In other words, the sound-emitting component of the speaker 110 divides the acoustic cavity 22 into two sub-cavities. Of these two sub-cavities, the sub-cavity to which the sound-emitting surface of the sound-emitting component faces is the first acoustic cavity 22-1, and the sub-cavity to which the sound-emitting surface of the sound-emitting component faces away is the second acoustic cavity 22-2. The first acoustic cavity 22-1 can also be called the front cavity, and the second acoustic cavity 22-2 can also be called the rear cavity.
[0135] Based on the above-described acoustic cavity design, in some embodiments, the second sound sensor 120-2 can be located inside the acoustic cavity 22, and the first sound sensor 120-2 can be located outside the acoustic cavity 22. It can be understood that since the speaker 110 is located inside the acoustic cavity 22, placing the second sound sensor 120-2 inside the acoustic cavity 22 and placing the first sound sensor 120-1 outside the acoustic cavity 22 enables the second sound sensor 120-2 to pick up a stronger sound from the speaker 110 than the first sound sensor 120-1. In other words, the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 , which helps to make the first signal y1 and the second signal y2 satisfy the condition k2≥2k1.
[0136] The specific location of the second sound sensor 120-2 within the acoustic cavity 22 can be in various situations. For example, referring to FIG8A , the second sound sensor 120-2 can be located within the first acoustic cavity 22-1. In this manner, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1, thereby helping to achieve the following condition: the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 This helps to make the first signal y1 and the second signal y2 satisfy the condition k2 ≥ 2k1.
[0137] For another example, referring to FIG8B , the second sound sensor 120-2 can be located inside the second acoustic cavity 22-2. This approach can achieve the following two effects: First, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1 at least in a portion of the frequency band, thereby helping to achieve the following condition: the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 Secondly, the loudspeaker 110 can block the second sound emitted by the target sound source 160 to a certain extent, thereby helping to achieve the following condition: the second signal y2 corresponds to the signal energy |v2| of the second sound. 2 is much smaller than the signal energy |v1| corresponding to the second sound in the first signal y1. 2 The combined effect of the above two aspects enables the condition k2 ≥ 2k1 to be achieved.
[0138] For another example, referring to FIG8C , the second sound sensor 120-2 can be coupled with the sound-emitting component of the speaker 110. For example, the second sound sensor 120-2 can be a bone conduction MIC with a relatively light mass, the speaker 110 can be an air conduction speaker, and the bone conduction MIC can be fitted on the diaphragm of the air conduction speaker. In this way, since the bone conduction MIC picks up the bone vibration signal, the air vibration will not interfere with the sound pickup of the bone conduction MIC, thereby ensuring the accuracy of the second signal y2 picked up by the bone conduction MIC. In addition, by adopting a bone conduction MIC with a relatively light mass, the acoustic system 20 can reduce the influence of the bone conduction MIC on the vibration of the speaker diaphragm, thereby avoiding the introduction of additional distortion. It should be noted that this coupling method is applicable to various types of sound sensors and speakers, and the above-mentioned coupling method of the bone conduction MIC and the air conduction speaker is only a possible example.
[0139] In the acoustic system shown in FIG8C , since the second sound sensor 120-2 is coupled to the sound-emitting component of the speaker 110, the second sound sensor 120-2 can directly pick up the sound emitted by the speaker 110. Therefore, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1. Therefore, the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 , which helps to make the first signal y1 and the second signal y2 satisfy the condition k2≥2k1.
[0140] It should be noted that the designs shown in Figures 8A to 8C above do not limit the specific location of the first sound sensor 120-1; as long as it is located outside the acoustic cavity 22 and can conveniently pick up the sound of the target sound source 160, it will suffice. For example, the first sound sensor 120-1 can be located inside the housing 21, with the sound pickup surface positioned on the surface of the housing 21 away from the acoustic cavity 22. Figures 8A to 8C do not illustrate the location of the first sound sensor 120-1.
[0141] In some embodiments, the pickup surface of the first sound sensor 120-1 and the pickup surface of the second sound sensor 120-2 can both be located in the free space outside the shell 21, and the second sound sensor 120-2 is closer to the speaker 110 (or closer to the acoustic cavity 22) relative to the first sound sensor 120-1. The free space refers to a space in which sound is not affected by reflection, refraction, or diffraction and is mainly propagated in the form of spherical waves or plane waves. For example, referring to Figure 8E, the second sound sensor 120-2 can be set in the free space outside the shell 21 without being physically connected to the shell 21. In this case, the second sound sensor 120-2 can be a wired or wireless MIC, and after the second signal y2 is picked up in the free space, the second signal y2 can be sent to the signal processing circuit 150 by wire or wireless means.
[0142] In some embodiments, referring to FIG8D , an acoustic cavity 22 and an acoustic cavity 23 may be formed in portions of the housing 21 of the acoustic system. The speaker 110 is located within the acoustic cavity 22, and the second sound sensor 120-2 is located within the acoustic cavity 23. Furthermore, the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1. The acoustic cavity 23 protects the second sound sensor 120-2 from wind and may also be referred to as a windproof cavity. While within the acoustic cavity 23, the second sound sensor 120-2 can still pick up sound signals in free space.
[0143] It should be noted that the designs shown in Figures 8D to 8E above do not limit the specific location of the first sound sensor 120-1, as long as the sound pickup surface of the first sound sensor 120-1 is located in the free space and can conveniently pick up the sound of the target sound source 160 in the free space. For example, the first sound sensor 120-1 can be located inside the housing 21, with the sound pickup surface positioned on the surface of the housing 21 away from the acoustic cavity 22. Figures 8D and 8E do not illustrate the location of the first sound sensor 120-1.
[0144] In the designs shown in Figures 8D and 8E, since the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1. Therefore, the signal energy |x2| corresponding to the first sound in the second signal y2 is 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 , which helps ensure that the first signal y1 and the second signal y2 satisfy the condition k2 ≥ 2k1. Furthermore, in the design of FIG8E , since the second sound sensor 120-2 is located in free space outside the housing 21, there is no need to modify the structure of the housing 21 or the acoustic cavity 22, making implementation easier. In the design of FIG8D , since the second sound sensor 120-2 is located in an acoustic cavity other than the acoustic cavity 22, there is no need to modify the acoustic cavity 22, making implementation easier.
[0145] In some embodiments, the sound pickup surface of the first sound sensor 120-1 can be set in the free space outside the shell 21, and the sound pickup surface of the second sound sensor 120-2 can be set in the internal space of the shell 21, and the second sound sensor 120-2 is closer to the speaker 110 (or closer to the acoustic cavity 22) than the first sound sensor 120-1. For example, referring to Figure 8F, the second sound sensor 120-2 can be located in an area inside the shell 21 close to the second acoustic cavity 22-2 (or back cavity), and the sound pickup surface of the second sound sensor 120-2 faces the second acoustic cavity 22-2. It should be noted that the present application does not limit the specific position of the first sound sensor 120-1, as long as it can conveniently pick up the sound of the target sound source 160. For example, the first sound sensor 120-1 can be located inside the shell 21, and the sound pickup surface is set on the surface of the shell 21 away from the speaker 110 (or away from the acoustic cavity 22). The position of the first sound sensor 120-1 is not illustrated in Figure 8F.
[0146] In the design shown in FIG8F , since the second sound sensor 120-2 is close to the rear cavity (i.e., the second acoustic cavity 22-2), the second sound sensor 120-2 can pick up the first sound leaking from the rear cavity or the first sound propagating through the solid medium. Furthermore, since the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1. Therefore, the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 In addition, since the first sound sensor 120-1 is hidden inside the housing 21, the housing 21 blocks the sound of the target sound source 160 to a certain extent, so that the signal energy |v2| corresponding to the second sound in the second signal y2 is 2 is much smaller than the signal energy |v1| corresponding to the second sound in the first signal y1. 2 The above two aspects work together to make the first signal y1 and the second signal y2 satisfy the condition k2≥2k1. In addition, the above solution does not require modification of the acoustic cavity 22, and is relatively easy to implement.
[0147] In some embodiments, the first sound sensor 120-1 and the speaker 110 can also be coupled to different shells respectively. For example, the acoustic system 20 can also include a first shell and a second shell. The first shell can be regarded as the device housing of the acoustic system 20. The first sound sensor 120-1 can be located inside the first shell, and the sound pickup surface is arranged on the surface of the first shell and faces the free space outside the first shell. The second shell can also be located inside the first shell, and the second shell is formed with an acoustic cavity, and the speaker 110 and the second sound sensor 120-2 are located inside the acoustic cavity. Wherein, similar to Figures 8A to 8C, the sound-emitting device of the speaker 110 can separate the acoustic cavity into a first acoustic cavity (front cavity) and a second acoustic cavity (back cavity), and the second sound sensor 120-2 can be located inside the first acoustic cavity, or inside the second acoustic cavity, and can also be coupled with the sound-emitting component of the speaker 110.
[0148] Based on the above design, first sound sensor 120-1 picks up sound in the free space outside the first housing, while second sound sensor 120-2 picks up sound in the acoustic cavity inside the first housing. Because the first housing blocks sound, the second sound sensor 120-2's pickup of target sound source 160 is reduced, while the first sound sensor 120-1's pickup of speaker 110 is reduced. Therefore, the signal energy |x2| corresponding to the first sound in the second signal y2 is 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 , and the signal energy corresponding to the second sound in the second signal y2 |v2| 2 is much smaller than the signal energy |v1| corresponding to the second sound in the first signal y1. 2 This helps to make the first signal y1 and the second signal y2 satisfy the condition k2 ≥ 2k1.
[0149] In some embodiments, the acoustic system 20 may further include a barrier. The barrier acts to block sound. It should be noted that the present application does not limit the form of the barrier, for example, it may be a barrier plate, or a barrier cover, etc. The second sound sensor 120-2 and the speaker 110 are located on the first side of the barrier, and the first sound sensor 120-1 is located on the second side of the barrier. In this way, since the barrier acts to block the first sound, the first sound sensor 120-1 picks up less of the first sound than the second sound sensor 120-2, that is, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1. Thus, the signal energy corresponding to the first sound in the second signal y2 |x2| 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 , which helps to make the first signal y1 and the second signal y2 satisfy the condition k2≥2k1.
[0150] Solution 2: The acoustic system 20 can be designed from the sound pickup direction dimension so that the sound pickup direction of the first sound sensor 120-1 and the second sound sensor 120-2 meet the preset conditions, thereby making the first signal y1 and the second signal y2 meet the condition k2≥2k1.
[0151] The sound pickup directionality of a sound sensor may refer to the different degrees of directionality in different directions due to the sound sensor's different sound pickup sensitivities in different directions. The sound pickup sensitivity in a particular direction may refer to the sound sensor's ability to pick up sound from that direction. A higher sound pickup sensitivity in a particular direction indicates a stronger sound pickup capability of the sound sensor in that direction. That is, the sound sensor picks up more signal components corresponding to sounds in that direction in the sound pickup signal, and thus, the sound sensor's directionality in that direction is stronger. A lower sound pickup sensitivity in a particular direction indicates a weaker sound pickup capability of the sound sensor in that direction. That is, the sound sensor picks up fewer signal components corresponding to sounds in that direction in the sound pickup signal, and thus, the sound sensor's directionality in that direction is weaker. When the sound pickup sensitivity in a particular direction is zero, the sound sensor does not pick up sound in that direction, and that direction may also be referred to as a zero-point pickup direction.
[0152] FIG9 shows a schematic diagram of the sound pickup direction of the acoustic system according to an embodiment of the present specification. As shown in FIG9 , the sound pickup direction of the first sound sensor 120 - 1 and the second sound sensor 120 - 2 can meet at least one of the following conditions:
[0153] (1) The first sound sensor 120 - 1 has a higher sound pickup sensitivity in the first direction than in the second direction.
[0154] The first direction points to the target sound source 160, and the second direction points to the speaker 110. It can be understood that when the above condition (1) is met, the first sound sensor 120-1 can focus on picking up the sound of the target sound source 160. When designing the acoustic system 20, in order to meet the above condition (1), the direction in which the first sound sensor 120-1 has a higher sound pickup sensitivity can be directed toward the target sound source 160, and / or the direction in which the first sound sensor 120-1 has a lower sound pickup sensitivity can be directed toward the speaker 110. For example, the direction in which the first sound sensor 120-1 has the highest sound pickup sensitivity can be directed toward the target sound source 160, and / or the direction in which the first sound sensor 120-1 has the lowest sound pickup sensitivity can be directed toward the speaker 110.
[0155] (2) The sound pickup sensitivity of the second sound sensor 120-2 in the first direction is lower than the sound pickup sensitivity in the second direction.
[0156] When the above condition (2) is met, the second sound sensor 120-2 can focus on picking up the sound of the speaker 110. When designing the acoustic system 20, in order to meet the above condition (2), the direction of the second sound sensor 120-2 with higher sound pickup sensitivity can be directed toward the speaker 110, and / or the direction of the second sound sensor 120-2 with lower sound pickup sensitivity can be directed toward the target sound source 160. For example, the direction of the second sound sensor 120-2 with the highest sound pickup sensitivity can be directed toward the speaker 110, and / or the direction of the second sound sensor 120-2 with the lowest sound pickup sensitivity can be directed toward the target sound source 160.
[0157] It should be noted that only one of the above conditions (1) and (2) needs to be met. When condition (1) is met, the first sound sensor 120-1 focuses on picking up the sound from the target sound source 160, and when condition (2) is met, the second sound sensor 120-2 focuses on picking up the sound from the speaker 110. In both cases, it helps to make the first signal y1 and the second signal y2 meet the condition k2≥2k1. Furthermore, when the above conditions (1) and (2) are met at the same time, the first sound sensor 120-1 can pick up a stronger sound from the target sound source 160 than the second sound sensor 120-2, and the second sound sensor 120-2 can pick up a stronger sound from the speaker 110 than the first sound sensor 120-1. Therefore, the signal energy |x2| corresponding to the first sound in the second signal y2 is 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 , the signal energy corresponding to the second sound in the second signal y2 |v2| 2 is much smaller than the signal energy |v1| corresponding to the second sound in the first signal y1. 2 , which is more helpful to make the first signal y1 and the second signal y2 satisfy the condition k2≥2k1.
[0158] It should be noted that the sound pickup directionality of the first sound sensor 120-1 and the sound pickup directionality of the second sound sensor 120-2 can both be achieved by using a single sound pickup device with a certain directionality, or by using multiple sound pickup devices to form a preset array, and this application does not limit this. Furthermore, this application does not specifically limit the sound pickup direction patterns corresponding to the first sound sensor 120-1 and the second sound sensor 120-2. The two can use the same sound pickup direction pattern or different sound pickup direction patterns. For example, the sound pickup direction patterns corresponding to the first sound sensor 120-1 and the second sound sensor 120-2 can each be an omnidirectional pattern, a cardioid pattern, a supercardioid pattern, a figure-8 pattern, a gun-shaped pattern, or any other directional pattern. For example, in Figure 9, the sound pickup direction pattern of the first sound sensor 120-1 is a gun-shaped pattern, with the stronger sound pickup direction directed toward the target sound source 160, while the sound pickup direction pattern of the second sound sensor 120-2 is a cardioid pattern, with the stronger sound pickup direction directed toward the speaker 110.
[0159] Because Solution 2 designs the acoustic system from the perspective of sound pickup directivity, specifically, the sound pickup directivity of first sound sensor 120-1 and / or second sound sensor 120-2 needs to be designed, while the positional relationships of the components in the acoustic system may be relaxed or eliminated. Therefore, Solution 2 is suitable for scenarios where structural changes to acoustic system 20 are inconvenient. In some embodiments, Solution 2 can be combined with one or more of the designs in Solution 1.
[0160] Solution 3: The positions of the first sound sensor 120 - 1 and the second sound sensor 120 - 2 may be designed based on the feedback sound energy at each position in the target area, so that the first signal y1 and the second signal y2 satisfy the condition k2 ≥ 2k1.
[0161] For example, the first sound sensor 120-1 is located at a first position within the target area, and the second sound sensor 120-2 is located at a second position within the target area, wherein the first position and the second position meet at least one of the following conditions:
[0162] (1) The sound energy from the speaker 110 at the first position is smaller than the sound energy from the speaker 110 at other positions within the target area except the first position.
[0163] That is, the first sound sensor 120-1 is set at the position in the target area where the corresponding feedback sound energy (i.e., the sound energy from the speaker 110) is minimum. When condition (1) is met, the first sound sensor 120-1 does not pick up the sound of the speaker 110 or picks up a weak sound.
[0164] (2) The sound energy from the speaker 110 at the second position is greater than the sound energy from the speaker 110 at other positions within the target area except the second position.
[0165] That is, the second sound sensor 120-2 is set at the position in the target area where the corresponding feedback sound energy (ie, the sound energy from the speaker 110) is the largest. When condition (2) is met, the second sound sensor 120-2 can pick up the stronger sound of the speaker 110.
[0166] It should be noted that only one of the above conditions (1) and (2) needs to be met. When either one is met, it helps to make the first signal y1 and the second signal y2 meet the condition k2 ≥ 2k1. Furthermore, when the above conditions (1) and (2) are met at the same time, the first sound sensor 120-1 cannot pick up or picks up the weaker sound of the speaker 110, and the second sound sensor 120-2 can pick up the stronger sound of the speaker 110. Therefore, the signal energy |x2| corresponding to the first sound in the second signal y2 is 2 is much larger than the signal energy |x1| corresponding to the first sound in the first signal y1. 2 , which is more helpful to make the first signal y1 and the second signal y2 satisfy the condition k2≥2k1.
[0167] FIG10A shows a schematic diagram of the positions of the first sound sensor and the second sound sensor in the target area of the acoustic system provided according to an embodiment of the present specification. As shown in FIG10A , arrows are marked at different positions within the target area 190, and the length of the arrow represents the magnitude of the feedback sound energy (i.e., the sound energy from the speaker 110) corresponding to the position. The longer the arrow, the greater the feedback sound energy, and the shorter the arrow, the smaller the feedback sound energy. Continuing to refer to FIG10A , in the target area 190, the feedback sound energy corresponding to the position of the first sound sensor 120-1 is the smallest, and the feedback sound energy corresponding to the position of the second sound sensor 120-2 is the largest.
[0168] In order to meet the above conditions (1) and (2), the acoustic system 20 can be designed in the following manner: first, a target area 190 where the first sound sensor 120-1 and the second sound sensor 120-2 are to be placed is determined within the device of the acoustic system 20. Then, the feedback sound energy distribution corresponding to each position on the target area 190 is obtained through simulation calculation or field measurement. For example, FIG10B shows a schematic diagram of the feedback sound energy corresponding to each position in the target area of an acoustic system. Among them, the larger the grayscale value of a certain position in the target area 190 (black when the grayscale value is 0, white when the grayscale value is 255), the greater the feedback sound energy corresponding to the position, and the smaller the grayscale value of a certain position in the target area, the smaller the feedback sound energy corresponding to the position. Furthermore, the position where the corresponding feedback sound energy is the strongest in the target area 190 is set as the second position 192, and the second sound sensor 120-2 is set at the second position 192; the position where the corresponding feedback sound energy is the weakest in the target area 190 is set as the first position 191, and the first sound sensor 120-1 is set at the first position 191.
[0169] It should be noted that this application does not limit the shape of target area 190. Figures 10A and 10B illustrate a rectangle as an example. In actual applications, target area 190 can be any other shape, such as a circle, triangle, pentagon, hexagon, ring, or hollow shape. It can also be any other irregular shape, or it can be an area enclosed by a three-dimensional space.
[0170] Since Solution 3 designs the positions of the first sound sensor 120-1 and the second sound sensor 120-2 based on the feedback sound energy at each position within the target area 190, that is, the first sound sensor 120-1 is set at the position within the target area 190 where the corresponding feedback sound energy is the smallest, and the second sound sensor 120-2 is set at the position within the target area 190 where the corresponding feedback sound energy is the largest, Solution 3 does not have high requirements for the positional relationship between the various components in the acoustic system 20 (for example, it does not require the first sound sensor 120-1 to be far away from the speaker 110, the second sound sensor 120-2 to be close to the speaker 110, etc.). Solution 3 can be applied to scenarios where the positions of the components are not pre-specified, and allows the selection and determination of the positions of the components in a certain candidate area. In some embodiments, Solution 3 can also be combined with one or more designs in the aforementioned Solutions 1 and 2.
[0171] FIG11 is a schematic diagram showing the test results of adaptive filtering performance of an acoustic system provided according to an embodiment of the present disclosure. Referring to FIG11 , when the speaker 110 in the acoustic system 20 has a limiting characteristic, the calculated misalignment (MIS) is shown in Curve A when the AFC-based adaptive filtering scheme shown in FIG2 is adopted. When the AFC-based adaptive filtering scheme shown in FIG4 is adopted, the calculated misalignment (MIS) is shown in Curve B. In FIG11 , Curve B decreases faster than Curve A in the initial period (approximately before 0.2 seconds) and maintains a relatively fast average downward trend after the turning point (approximately 0.2 seconds). In other words, Curve B is located below Curve A throughout the entire time period shown. Therefore, the misalignment MIS of the scheme shown in FIG4 is consistently lower than that of the scheme shown in FIG2 , indicating that the scheme shown in FIG4 outperforms the scheme shown in FIG2 in terms of the convergence degree and convergence speed of the adaptive filtering algorithm. FIG11 shows that the scheme shown in FIG4 significantly improves both the convergence degree and convergence speed of the adaptive filtering algorithm.
[0172] In summary, the acoustic system 20 provided in this specification includes: a speaker 110, a first sound sensor 120-1, a second sound sensor 120-2, and a signal processing circuit 150. Specifically, when the speaker 110 is in operation, it receives a driving signal and converts it into a first sound. When the first sound sensor 120-1 is in operation, it collects ambient sound and generates a first signal, wherein the ambient sound includes the first sound and a second sound from a target sound source. When the second sound sensor 120-2 is in operation, it collects ambient sound and generates a second signal, wherein the first signal and the second signal satisfy k2 ≥ 2k1, where k1 is the ratio of the signal energy corresponding to the first sound to the signal energy corresponding to the second sound in the first signal, and k2 is the ratio of the signal energy corresponding to the first sound to the signal energy corresponding to the second sound in the second signal. The signal processing circuit 150 is connected to the first sound sensor 120-1 and the second sound sensor 120-2, respectively, and when in operation, it reduces the signal component corresponding to the first sound in the first signal based on the second signal to obtain a target signal, and performs a target operation on the target signal. It can be seen that the acoustic system 20 provided in this specification can reduce or eliminate the feedback component in the target signal, thereby avoiding problems such as howling caused by feedback sound, and can also improve the maximum forward gain that the acoustic system 20 can achieve.
[0173] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the particular order or sequential order shown to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0174] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented by way of example only and may not be limiting. Although not expressly stated herein, those skilled in the art will understand that this specification encompasses various reasonable changes, improvements, and modifications to the embodiments. Such changes, improvements, and modifications are intended to be suggested by this specification and are within the spirit and scope of the exemplary embodiments of this specification.
[0175] Furthermore, certain terms in this specification have been used to describe embodiments of this specification. For example, “one embodiment,” “an embodiment,” and / or “some embodiments” mean that a particular feature, structure, or characteristic described in connection with that embodiment may be included in at least one embodiment of this specification. Therefore, it is emphasized and should be understood that two or more references to “an embodiment,” “one embodiment,” or “an alternative embodiment” in various parts of this specification do not necessarily refer to the same embodiment. Furthermore, particular features, structures, or characteristics may be appropriately combined in one or more embodiments of this specification.
[0176] It should be understood that in the foregoing descriptions of the embodiments of this specification, to facilitate understanding of a feature and to simplify this specification, various features are combined in a single embodiment, figure, or description thereof. However, this does not necessarily mean that these features are combined. When reading this specification, a person skilled in the art may label some of the devices as separate embodiments. In other words, the embodiments of this specification can also be understood as the integration of multiple sub-embodiments. This also applies when each sub-embodiment contains fewer than all the features of a single previously disclosed embodiment.
[0177] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, articles, and the like, cited herein, except any historical prosecution documents to which it relates, any equivalent that may be inconsistent or conflicting with this document, or any equivalent historical prosecution documents that may have a limiting effect on the broadest scope of the claims, is hereby incorporated by reference for all purposes now or hereafter connected with this document. In addition, in the event of any inconsistency or conflict between the descriptions, definitions, and / or use of terms associated with any incorporated material and the terminology, descriptions, definitions, and / or use associated with this document, the terminology in this document shall control.
[0178] Finally, it should be understood that the embodiments of the application disclosed herein are illustrative of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are merely examples and not limitations. Those skilled in the art can adopt alternative configurations based on the embodiments in this specification to implement the application in this specification. Therefore, the embodiments of this specification are not limited to the embodiments precisely described in the application.
Claims
1. An acoustic system, characterized in that: include: The loudspeaker receives the driving signal and converts it into a first sound when in operation; a first sound sensor, which collects ambient sound and generates a first signal when in operation, wherein the ambient sound includes the first sound and a second sound from a target sound source, wherein the target sound source includes other sound sources except the speaker; a second sound sensor, which collects the environmental sound and generates a second signal when in operation, wherein the first signal and the second signal satisfy k2≥2k1, wherein k1 is a ratio of a signal energy corresponding to the first sound to a signal energy corresponding to the second sound in the first signal, and k2 is a ratio of a signal energy corresponding to the first sound to a signal energy corresponding to the second sound in the second signal; as well as The signal processing circuit is connected to the first sound sensor and the second sound sensor respectively, and when in operation: Based on the second signal, a signal component corresponding to the first sound in the first signal is reduced to obtain a target signal, and A target operation is performed on the target signal.
2. The acoustic system according to claim 1, characterized in that In order to satisfy k2≥2k1, the first signal and the second signal satisfy at least one of the following conditions: A ratio of a signal energy in the second signal corresponding to the first sound to a signal energy in the second signal corresponding to the second sound is greater than or equal to 2; a ratio of a signal energy in the second signal corresponding to the first sound to a signal energy in the first signal corresponding to the first sound is greater than or equal to 2; as well as A ratio of a signal energy in the first signal corresponding to the second sound to a signal energy in the first signal corresponding to the first sound is greater than or equal to 2.
3. The acoustic system according to claim 1, characterized in that The positional relationship among the first sound sensor, the second sound sensor, and the speaker meets a preset condition, so that the first signal and the second signal satisfy k2≥2k1.
4. The acoustic system according to claim 3, characterized in that The preset condition includes: L1≥2L2, wherein L2 is the distance between the second sound sensor and the speaker, and L1 is the distance between the first sound sensor and the speaker.
5. The acoustic system according to claim 3, characterized in that The acoustic system further includes a shell, a partial area of which forms an acoustic cavity, the speaker and the second sound sensor are both located inside the acoustic cavity, and the first sound sensor is located outside the acoustic cavity.
6. The acoustic system according to claim 5, characterized in that The sound-generating component of the speaker divides the acoustic cavity into a first acoustic cavity and a second acoustic cavity, and the sound-generating surface of the sound-generating component faces the first acoustic cavity, wherein The second sound sensor is located inside the first acoustic cavity, or The second sound sensor is located inside the second acoustic cavity.
7. The acoustic system according to claim 5, characterized in that The second sound sensor is coupled to the sound-generating component of the speaker.
8. The acoustic system according to claim 3, characterized in that The acoustic system further includes a housing, a sound pickup surface of the second sound sensor and a sound pickup surface of the first sound sensor are both located in a free space outside the housing, and the second sound sensor is closer to the speaker than the first sound sensor.
9. The acoustic system according to claim 3, characterized in that The acoustic system also includes a shell, a partial area of which is formed with a first acoustic cavity and a second acoustic cavity, the speaker is located in the first acoustic cavity, the second sound sensor is located in the second acoustic cavity, and the second sound sensor is closer to the speaker than the first sound sensor.
10. The acoustic system according to claim 3, characterized in that The acoustic system further comprises a shell, a sound pickup surface of the first sound sensor is located in a free space outside the shell, a sound pickup surface of the second sound sensor is located in an internal space of the shell, and the second sound sensor is closer to the speaker than the first sound sensor.
11. The acoustic system according to claim 3, characterized in that The acoustic system further comprises a first shell and a second shell, wherein: The second shell is located inside the first shell, and the second shell forms an acoustic cavity, and the speaker and the second sound sensor are located inside the acoustic cavity.
12. The acoustic system according to claim 3, characterized in that The acoustic system further includes a baffle, the second sound sensor and the speaker are located on a first side of the baffle, and the first sound sensor is located on a second side of the baffle.
13. The acoustic system according to claim 1, characterized in that The sound pickup directivities of the first sound sensor and the second sound sensor meet a preset condition, so that the first signal and the second signal satisfy k2≥2k1.
14. The acoustic system according to claim 13, characterized in that The sound pickup directivity of the first sound sensor and the second sound sensor satisfies at least one of the following conditions: The first sound sensor has a greater sound pickup sensitivity in the first direction than in the second direction; and The sound pickup sensitivity of the second sound sensor in the first direction is smaller than the sound pickup sensitivity in the second direction, wherein The first direction points to the target sound source, and the second direction points to the speaker.
15. The acoustic system according to claim 1, characterized in that The first sound sensor is located at a first position within the target area, and the second sound sensor is located at a second position within the target area, wherein the first position and the second position satisfy at least one of the following conditions: The sound energy from the speaker at the first position is less than the sound energy from the speaker at other positions within the target area except the first position; and The sound energy from the speaker at the second position is greater than the sound energy from the speaker at other positions within the target area except the second position.
16. The acoustic system according to claim 1, characterized in that In order to obtain the target signal, the signal processing circuit: An adaptive filtering operation is performed on the second signal to obtain a third signal, and the third signal is subtracted from the first signal to obtain the target signal.
17. The acoustic system according to claim 16, characterized in that The signal processing circuit also: A filtering parameter corresponding to the adaptive filtering operation is updated based on at least one of the second signal and the target signal.
18. The acoustic system according to claim 1, characterized in that In order to obtain the target signal, the signal processing circuit: Performing a first preprocessing operation on the first signal to obtain a first intermediate signal; Performing a second preprocessing operation on the second signal to obtain a second intermediate signal; as well as Based on the second intermediate signal, a signal component corresponding to the first sound in the first intermediate signal is reduced to obtain the target signal.
19. The acoustic system according to claim 18, characterized in that The first preprocessing operation includes at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation; and The second preprocessing operation includes at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation.
20. The acoustic system according to claim 1, characterized in that The signal processing circuit is also connected to the speaker. When performing the target operation, the signal processing circuit: amplifying the target signal, and The gain-amplified signal is sent to the speaker to drive the speaker to produce sound.
Citation Information
Patent Citations
Signal processing device, signal processing method, and program
CN107431852A
Voice signal processing method and system and audio and video communication equipment
CN113645546A
Howling suppression device and howling suppression method
JP2018157537A
Acoustic echo cancelling system and method
US20180130482A1
Echo Cancellation Using A Subset of Multiple Microphones As Reference Channels
US20210020188A1
