Acoustic system

By adjusting the sensor position and sound pick-up direction in the acoustic system, the signal energy ratio k2≥2k1 is achieved. Combined with adaptive filtering technology, the howling problem caused by acoustic feedback is solved, and the maximum forward gain of the acoustic system is improved.

CN119031309AActive Publication Date: 2024-11-26SHENZHEN SHOKZ CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202310608856.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-25
Publication Date
2024-11-26
Estimated Expiration
2043-05-25

AI Technical Summary

Technical Problem

There are acoustic feedback problems in the acoustic system, which lead to problems such as howling and limits the maximum forward gain.

Method used

Using an acoustic system including a speaker, a first sound sensor, a second sound sensor and a signal processing circuit, the first signal and the second signal energy ratio k2≥2k1 by adjusting the position and sound pick-up direction of the sensor, thereby reducing or eliminating the energy of the first signal and the second signal. Feedback sound and reduce feedback components through adaptive filtering technology.

Benefits of technology

Effectively reduce or eliminate feedback sound, avoid whistling problems, and improve the maximum forward gain of the acoustic system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031309A_ABST
    Figure CN119031309A_ABST
Patent Text Reader

Abstract

An embodiment of the present specification provides an acoustic system including a speaker, a first sound sensor, a second sound sensor, and a signal processing circuit. The first sound sensor collects environment sound and generates a first signal when working, and the environment sound comprises first sound from the loudspeaker and second sound from a target sound source; when the second sound sensor works, environment sound is collected and a second signal is generated, the first signal and the second signal meet the condition that k2 is larger than or equal to 2k1, and k1 is the ratio of signal energy corresponding to the first sound to signal energy corresponding to the second sound in the first signal; k2 is the ratio of the signal energy corresponding to the first sound to the signal energy corresponding to the second sound in the second signal; when the signal processing circuit works, a signal component corresponding to the first sound in the first signal is reduced based on the second signal to obtain a target signal, and a target operation is executed on the target signal. The acoustic system can reduce or eliminate feedback components in a target signal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present specification relates to the field of acoustic technology, and in particular to an acoustic system. Background Art

[0002] Some acoustic systems include both a speaker and a sound sensor. These acoustic systems usually have the problem of acoustic feedback. Among them, acoustic feedback means that the sound signal collected by the sound sensor is played through the speaker after a certain processing, and the sound emitted by the speaker is re-collected by the sound sensor, so that the acoustic system forms a closed loop of "speaker->sound sensor->speaker". In the above acoustic system, the sound of the speaker picked up by the sound sensor can be called feedback sound. The existence of feedback sound causes some problems in the acoustic system. For example, it causes problems such as howling in the acoustic system, and may also limit the maximum forward gain that the acoustic system can achieve. Therefore, it is necessary to provide an acoustic system that can reduce or eliminate feedback sound. Summary of the invention

[0003] The present specification provides an acoustic system that can reduce or eliminate feedback sound, thereby avoiding problems such as howling caused by the feedback sound and improving the maximum forward gain that the acoustic system can achieve.

[0004] In a first aspect, the present specification provides an acoustic system, including: a speaker, a first sound sensor, a second sound sensor, and a signal processing circuit, wherein the speaker receives a driving signal and converts it into a first sound when in operation, the first sound sensor collects ambient sound and generates a first signal when in operation, the ambient sound includes the first sound and a second sound from a target sound source, the target sound source includes other sound sources except the speaker, the second sound sensor collects the ambient sound and generates a second signal when in operation, wherein the first signal and the second signal satisfy k 2 ≥2k 1 , where k 1 is the ratio of the signal energy corresponding to the first sound to the signal energy corresponding to the second sound in the first signal, k 2 The signal processing circuit is connected to the first sound sensor and the second sound sensor respectively, and when working, based on the second signal, the signal component corresponding to the first sound in the first signal is reduced to obtain the target signal, and the target operation is performed on the target signal.

[0005] In some embodiments, to satisfy k 2 ≥2k 1, the first signal and the second signal satisfy at least one of the following conditions: the ratio of the signal energy in the second signal corresponding to the first sound to the signal energy in the second signal corresponding to the second sound is greater than or equal to 2; the ratio of the signal energy in the second signal corresponding to the first sound to the signal energy in the first signal corresponding to the first sound is greater than or equal to 2; and the ratio of the signal energy in the first signal corresponding to the second sound to the signal energy in the first signal corresponding to the first sound is greater than or equal to 2.

[0006] In some embodiments, the positional relationship between the first sound sensor, the second sound sensor, and the speaker satisfies a preset condition, so that the first signal and the second signal satisfy k 2 ≥2k 1 .

[0007] In some embodiments, the preset conditions include: 1 ≥ 2 L 2 , where L 2 is the distance between the second sound sensor and the speaker, L 1 is the distance between the first sound sensor and the speaker.

[0008] In some embodiments, the acoustic system further includes a shell, a partial area of ​​the shell forms an acoustic cavity, the speaker and the second sound sensor are both located inside the acoustic cavity, and the first sound sensor is located outside the acoustic cavity.

[0009] In some embodiments, the sound-emitting component of the speaker divides the acoustic cavity into a first acoustic cavity and a second acoustic cavity, and the sound-emitting surface of the sound-emitting component faces the first acoustic cavity, wherein the second sound sensor is located inside the first acoustic cavity, or the second sound sensor is located inside the second acoustic cavity.

[0010] In some embodiments, the second sound sensor is coupled to a sound emitting component of the speaker.

[0011] In some embodiments, the acoustic system further includes a shell, a sound pickup surface of the second sound sensor and a sound pickup surface of the first sound sensor are both located in a free space outside the shell, and the second sound sensor is closer to the speaker than the first sound sensor.

[0012] In some embodiments, the acoustic system also includes a shell, a partial area of ​​which forms a first acoustic cavity and a second acoustic cavity, the speaker is located in the first acoustic cavity, the second sound sensor is located in the second acoustic cavity, and the second sound sensor is closer to the speaker than the first sound sensor.

[0013] In some embodiments, the acoustic system further comprises a shell, the pickup surface of the first sound sensor is located in a free space outside the shell, the pickup surface of the second sound sensor is located in an internal space of the shell, and the second sound sensor is closer to the speaker than the first sound sensor.

[0014] In some embodiments, the acoustic system further comprises a first shell and a second shell, wherein:

[0015] The second shell is located inside the first shell, and the second shell forms an acoustic cavity, and the speaker and the second sound sensor are located inside the acoustic cavity.

[0016] In some embodiments, the acoustic system further includes a baffle, the second sound sensor and the speaker are located on a first side of the baffle, and the first sound sensor is located on a second side of the baffle.

[0017] In some embodiments, the sound pickup directivity of the first sound sensor and the second sound sensor meets a preset condition, so that the first signal and the second signal meet k 2 ≥2k 1 .

[0018] In some embodiments, the sound pickup directivities of the first sound sensor and the second sound sensor satisfy at least one of the following conditions: the sound pickup sensitivity of the first sound sensor in a first direction is greater than the sound pickup sensitivity in a second direction; and the sound pickup sensitivity of the second sound sensor in the first direction is less than the sound pickup sensitivity in the second direction, wherein the first direction points to the target sound source and the second direction points to the speaker.

[0019] In some embodiments, the first sound sensor is located at a first position within the target area, and the second sound sensor is located at a second position within the target area, wherein the first position and the second position satisfy at least one of the following conditions: the sound energy from the speaker at the first position is less than the sound energy from the speaker at other positions within the target area except the first position; and the sound energy from the speaker at the second position is greater than the sound energy from the speaker at other positions within the target area except the second position.

[0020] In some embodiments, in order to obtain the target signal, the signal processing circuit: performs an adaptive filtering operation on the second signal to obtain a third signal, and subtracts the third signal from the first signal to obtain the target signal.

[0021] In some embodiments, the signal processing circuit further: updates a filtering parameter corresponding to the adaptive filtering operation based on at least one of the second signal and the target signal.

[0022] In some embodiments, in order to obtain the target signal, the signal processing circuit: performs a first preprocessing operation on the first signal to obtain a first intermediate signal; performs a second preprocessing operation on the second signal to obtain a second intermediate signal; and based on the second intermediate signal, reduces the signal component corresponding to the first sound in the first intermediate signal to obtain the target signal.

[0023] In some embodiments, the first preprocessing operation includes at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation; and the second preprocessing operation includes at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation.

[0024] In some embodiments, the signal processing circuit is also connected to the speaker. When executing the target operation, the signal processing circuit: performs gain amplification on the target signal, and sends the gain-amplified signal to the speaker to drive the speaker to produce sound.

[0025] It can be seen from the above technical solution that the acoustic system provided in this specification includes: a speaker, a first sound sensor, a second sound sensor and a signal processing circuit. Among them, when the speaker is working, it receives a driving signal and converts it into a first sound; when the first sound sensor is working, it collects ambient sound and generates a first signal, and the ambient sound includes the first sound and the second sound from the target sound source; when the second sound sensor is working, it collects ambient sound and generates a second signal, and the first signal and the second signal meet k 2 ≥2k 1 , where k 1 is the ratio of the signal energy corresponding to the first sound to the signal energy corresponding to the second sound in the first signal, k 2is the ratio of the signal energy corresponding to the first sound in the second signal to the signal energy corresponding to the second sound; the signal processing circuit is connected to the first sound sensor and the second sound sensor respectively, and when working, the signal component corresponding to the first sound in the first signal is reduced based on the second signal to obtain a target signal, and a target operation is performed on the target signal. It can be seen that the acoustic system provided in this specification can reduce or eliminate the feedback component in the target signal, thereby avoiding problems such as howling caused by feedback sound, and can also improve the maximum forward gain that can be achieved by the acoustic system.

[0026] Other functions of the acoustic system provided by this specification will be partially listed in the following description. The creative aspects of the acoustic system provided by this specification can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0028] Figure 1 A schematic diagram showing an application scenario provided according to an embodiment of this specification;

[0029] Figure 2 A schematic diagram of a design of an acoustic system provided according to an embodiment of this specification is shown;

[0030] Figure 3 Another schematic diagram of the design of an acoustic system provided according to an embodiment of this specification is shown;

[0031] Figure 4 Another schematic diagram of a design of an acoustic system provided according to an embodiment of this specification is shown;

[0032] Figure 5 Another schematic diagram of a design of an acoustic system provided according to an embodiment of this specification is shown;

[0033] 6A to 6F Several structural schematic diagrams of acoustic systems provided according to embodiments of this specification are shown;

[0034] FIG. 7A to FIG. 7G Several other structural schematic diagrams of acoustic systems provided according to embodiments of this specification are shown;

[0035] FIG. 8A to FIG. 8FSeveral structural schematic diagrams of acoustic systems provided according to embodiments of this specification are shown;

[0036] Fig. 9 A schematic diagram of sound pickup direction of an acoustic system provided according to an embodiment of this specification is shown;

[0037] Fig. 10A A schematic diagram showing the positions of a first sound sensor and a second sound sensor in a target area in an acoustic system provided according to an embodiment of the present specification;

[0038] Fig. 10B A schematic diagram showing feedback sound energy corresponding to various positions within a target area of ​​an acoustic system; and

[0039] Fig.11 A schematic diagram showing test results of the adaptive filtering performance of the acoustic system provided according to an embodiment of the present specification is shown. DETAILED DESCRIPTION

[0040] The following description provides specific application scenarios and requirements of this specification, with the purpose of enabling those skilled in the art to make and use the contents of this specification. Various local modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but to the widest scope consistent with the claims.

[0041] The terms used herein are only used for the purpose of describing specific example embodiments and are not restrictive. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a", "an" and "the" may also include plural forms. When used in this specification, the terms "include", "comprise" and / or "contain" mean that the associated integers, steps, operations, elements and / or components exist, but do not exclude the existence of one or more other features, integers, steps, operations, elements, components and / or groups or that other features, integers, steps, operations, elements, components and / or groups may be added in the system / method.

[0042] In view of the following description, these and other features of the present specification, as well as the operation and function of the related elements of the structure, and the economy of the combination and manufacture of the parts can be significantly improved. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.

[0043] The flowcharts used in this specification illustrate the operations implemented by the system according to some embodiments in this specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. On the contrary, the operations may be implemented in reverse order or simultaneously. In addition, one or more other operations may be added to the flowchart. One or more operations may be removed from the flowchart.

[0044] Before describing the specific embodiments of this specification, the application scenarios of this specification are first introduced as follows. The acoustic system provided in this specification can be applied to scenarios where feedback sound needs to be reduced or eliminated. Figure 1 Give an example.

[0045] Figure 1 FIG. 1 is a schematic diagram showing an application scenario provided according to an embodiment of this specification. Figure 1 As shown, application scenario 001 can be a sound amplification scenario, an auxiliary listening scenario, a hearing aid scenario, etc. In this scenario, the sound sensor 120 collects ambient sound when it is working. In this process, if the speaker 110 is also playing sound synchronously, the sound played by the speaker 110 will also be collected by the sound sensor 120. In this way, the ambient sound collected by the sound sensor 120 includes both the sound from the target sound source 160 and the sound from the speaker 110. Furthermore, the sound pickup signal collected by the sound sensor 120 is input to the speaker 110 after forward gain amplification (G), thereby driving the speaker 110 to make a sound. In this way, a closed loop of "speaker->sound sensor->speaker" is formed in the acoustic system. In this case, when a sound signal of a certain frequency undergoes self-excited oscillation, a howling phenomenon will occur. Such howling will make the user feel uncomfortable, and when the howling is severe, it may also cause damage to the components in the acoustic system. In addition, the existence of the howling also brings limitations to the forward gain amplification factor of the acoustic system, thereby restricting the maximum forward gain that the acoustic system can achieve.

[0046] It should be noted that the above Figure 1 The application scenarios shown are only some of the multiple application scenarios applicable to this application. The acoustic system provided by this application can also be applied to other similar scenarios, which will not be listed one by one in this specification. Those skilled in the art should understand that the application of the acoustic system provided by this application to other usage scenarios is also within the protection scope of this application.

[0047] In summary, the presence of feedback sound can cause a series of problems in the acoustic system, including but not limited to: generating howling, limiting the maximum forward gain that the acoustic system can achieve, etc. To this end, the present application provides an acoustic system that reduces or eliminates feedback sound, thereby avoiding the above series of problems.

[0048] The acoustic system provided in this application can use acoustic feedback cancellation (AFC) technology to reduce or eliminate feedback sound. Figure 2 The principle of AFC technology is introduced.

[0049] Figure 2 1 shows a schematic diagram of a design of an acoustic system provided according to an embodiment of the present specification. The acoustic system 10 may be a hearing aid / auxiliary hearing system or a sound amplification system. The acoustic system 10 may use AFC technology to reduce or eliminate feedback components (i.e., signal components corresponding to feedback sounds). Figure 2 As shown, the acoustic system 10 may include a speaker 110 , a sound sensor 120 , and a signal processing circuit 150 .

[0050] The speaker 110 is a device for converting an electrical signal into sound, and may also be called an electroacoustic converter. For example, the speaker 110 may be a speaker. The speaker 110 may be a device that produces sound based on at least one of gas, liquid, and solid conduction methods. The speaker 110 may be connected to the signal processing circuit 150, and when working, receives the electrical signal from the signal processing circuit 150 and converts it into sound to play. In some embodiments, the acoustic system 10 may also include a first peripheral circuit ( Figure 2 The first peripheral circuit is connected between the signal processing circuit 150 and the speaker 110. The first peripheral circuit may include all or part of the circuits between the output end of the signal processing circuit 150 and the speaker 110. The first peripheral circuit may perform some processing on the electrical signal output by the signal processing circuit 150 so that the processed electrical signal is suitable for playback by the speaker 110. The first peripheral circuit may include but is not limited to at least one of an operational amplifier device, a power amplifier device, a digital-to-analog converter device, a capacitor, an inductor, a resistor, and the like.

[0051] The sound sensor 120 is a device for picking up sound and converting it into an electrical signal, and may also be called an acoustic-electric converter. For example, the sound sensor 120 may be a microphone (MIC). The sound sensor 120 may be a device that picks up sound based on at least one of gas, liquid, and solid conduction methods. The sound sensor 120 may be connected to the signal processing circuit 150, and when working, it may collect ambient sound and convert it into an electrical signal, and then send the electrical signal to the signal processing circuit 150. In some embodiments, the acoustic system 10 may also include a second peripheral circuit ( Figure 2The second peripheral circuit is connected between the sound sensor 120 and the signal processing circuit 150. The second peripheral circuit may include all or part of the circuits between the sound sensor 120 and the input end of the signal processing circuit 150. The second peripheral circuit may perform some processing on the electrical signal picked up by the sound sensor 120 so as to convert it into a signal suitable for processing by the signal processing circuit 150. The second peripheral circuit may include but is not limited to at least one of a power amplifier device, an operational amplifier device, an analog-to-digital converter device, a capacitor, an inductor, a resistor, and the like.

[0052] Continue to see Figure 2 , the sound sensor 120 collects the ambient sound to generate the sound pickup signal y, and inputs the sound pickup signal y to the signal processing circuit 150. The ambient sound includes at least the second sound emitted by the target sound source 160. The target sound source 160 refers to other sound sources other than the speaker 110. For example, the target sound source 160 may include an electronic device with a sound playback function (such as a TV, a speaker, a mobile phone, etc.); for another example, the target sound source 160 may also include a human throat. The above-mentioned sound pickup signal y can be called the input signal of the signal processing circuit 150. The signal processing circuit 150 performs a series of processing on the sound pickup signal y to obtain a drive signal u, and sends the drive signal u to the speaker 110. The above-mentioned drive signal u can be used as the output signal of the signal processing circuit 150. The speaker 110 receives the drive signal u and converts it into a first sound. The first sound is re-collected by the sound sensor 120 after being transmitted through the feedback path, so the first sound can also be called a feedback sound. It can be seen that the ambient sound collected by the sound sensor 120 includes not only the second sound from the target sound source 160, but also the first sound from the speaker 110. That is to say, the sound pickup signal y includes both the signal component x corresponding to the first sound (ie, the feedback sound) and the signal component v corresponding to the second sound.

[0053] The signal processing circuit 150 may be a circuit with certain signal processing capabilities. The input end of the signal processing circuit 150 is connected to the sound sensor 120, and the output end is connected to the speaker 110. When working, the signal processing circuit 150 can obtain the sound pickup signal y from the sound sensor 120, and obtain the driving signal u after performing a preset signal processing process on the sound pickup signal y, and send the driving signal u to the speaker 110.

[0054] In some embodiments, the signal processing circuit 150 may include multiple hardware circuits with a connection relationship, each hardware circuit includes one or more electrical components, and each electrical component implements one or more functional units, so that the above-mentioned multiple hardware circuits cooperate with each other when working to implement the signal processing process.

[0055] In some embodiments, the signal processing circuit 150 may include a hardware device with a data information processing function and a necessary program to drive the hardware device to work, and the hardware device implements the signal processing flow by executing the program. For example, the signal processing circuit 150 may include at least one storage medium and at least one processor. Among them, the storage medium may include a data storage device. The data storage device may be a non-temporary storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk, a read-only storage medium (ROM), or a random access storage medium (RAM). The storage medium also includes at least one instruction set stored in the data storage device. The instruction is a computer program code, and the computer program code may include a program, a routine, an object, a component, a data structure, a process, a module, etc. for executing the signal processing method provided in this specification.

[0056] The at least one processor may be communicatively connected to the at least one storage medium. The at least one processor is used to execute the at least one instruction set mentioned above. When the acoustic system is running, the at least one processor reads the at least one instruction set and executes the signal processing flow according to the instructions of the at least one instruction set. The processor may include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application specific integrated circuit (ASIC), an application specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof.

[0057] Continue to see Figure 2 In order to reduce or eliminate the feedback component, the signal processing circuit 150 may include an acoustic feedback cancellation unit 170. The input of the acoustic feedback cancellation unit 170 includes: a driving signal u and a pickup signal y. The acoustic feedback cancellation unit 170 may reduce the signal component corresponding to the first sound in the pickup signal y based on the driving signal u, thereby obtaining a target signal e.

[0058] Combination Figure 2To explain in detail, the acoustic feedback cancellation unit 170 can solve and adaptively update a time-varying transfer function F' to fit the transfer function F corresponding to the feedback path. To distinguish them, the transfer function F' will be referred to as the predicted transfer function F', and the transfer function F corresponding to the feedback path will be referred to as the real transfer function F. The acoustic feedback cancellation unit 170 uses the predicted transfer function F' to perform an adaptive filtering operation on the drive signal u to obtain the signal x', that is, x'=u*F'. The signal x' can be regarded as the predicted value of the feedback component in the picked-up signal y (that is, the signal component corresponding to the first sound in the picked-up signal y). Furthermore, the acoustic feedback cancellation unit 170 can subtract the signal x' from the picked-up signal y to obtain the target signal e, that is, e=y-x'. The target signal e obtained in this way does not contain or contains less feedback sound components.

[0059] It should be noted that the acoustic feedback cancellation unit 170 can be implemented using a variety of adaptive filtering algorithms when solving the predicted transfer function F', for example, the least mean square (LMS), normalized least mean square (NLMS), recursive least squares (RLS), other adaptive filtering algorithms, and any derivative algorithms of the above-mentioned algorithms. One or more of these algorithms are not limited in this application. In addition, the adaptive filtering algorithm can be adaptive filtering in the time domain, frequency domain or other transform domains.

[0060] According to the theory of adaptive filtering algorithm, the update method of the predicted transfer function F' can be achieved by minimizing the expectation of the mean square function of the target signal e, that is:

[0061] min F′ E[e 2 ]=min F′ E[(yu*F′) 2 ] Formula (1-1)

[0062] For example, taking the acoustic feedback cancellation unit 170 using the LMS algorithm as an example, the above formula (1-1) is derived based on the gradient descent optimization method, and the update formula of the predicted transfer function F' can be obtained as follows:

[0063] F′←F′+μ*e*u formula (2-1)

[0064] Among them, μ is the iteration step size.

[0065] It should be understood that when the acoustic feedback cancellation unit 170 adopts algorithms such as NLMS, RLS, etc., a similar method can be used to derive an update formula for the predicted transfer function F', which will not be described one by one in this specification.

[0066] It can be seen from this that Figure 2 The acoustic system shown can reduce or eliminate feedback sound by adopting the AFC technology, thereby avoiding a series of problems caused by the feedback sound.

[0067] According to signal processing theory, Figure 2 The closed-loop gain A of the acoustic system shown can be expressed as follows:

[0068]

[0069] According to the Nyquist stability criterion, the requirement for an acoustic system to offset feedback sound is that the predicted transfer function F′ is completely equal to the true transfer function F, that is, F′ = F. When the above requirements are met, the acoustic system will always be stable and will not produce howling. In addition, the acoustic system can achieve infinite gain, that is, when the forward gain G→∞, A=G→∞.

[0070] However, in an actual acoustic system, since the real transfer function F may be time-varying and the convergence process of the iterative solution may oscillate, it is difficult for the iterative process of F' to reach the ideal condition F'=F. In other words, there is a certain deviation between the predicted transfer function F' obtained by the actual iteration and the real transfer function F. At this time, in order to keep the acoustic system stable, the forward gain G provided by the gain amplifier unit 130 naturally cannot be infinite. The maximum forward gain that the acoustic system can achieve is:

[0071]

[0072] As can be seen from formula (4), the deviation between the predicted transfer function F′ and the true transfer function F can be used to measure the convergence performance of the adaptive filtering algorithm, and further measure the acoustic system's effect of canceling feedback sound. Specifically, if the deviation between the predicted transfer function F′ and the true transfer function F is smaller, it means that the convergence performance of the adaptive filtering algorithm is better, and thus the acoustic system's effect of canceling feedback sound is better. If the deviation between the predicted transfer function F′ and the true transfer function F is larger, it means that the convergence performance of the adaptive filtering algorithm is worse, and thus the acoustic system's effect of canceling feedback sound is worse.

[0073] In some embodiments, we can also use misalignment (MIS) to measure the convergence performance of the adaptive filtering algorithm. The misalignment MIS can be expressed by the following formula:

[0074]

[0075] The unit of the offset MIS is decibel (dB). When the predicted transfer function F′ is the initial value zero, the offset MIS is 0dB. When the offset MIS is smaller and approaches negative infinity, the deviation between the predicted transfer function F′ and the true transfer function F is smaller, indicating that the convergence performance of the adaptive filtering algorithm is better, and thus the acoustic system has a better effect of canceling feedback sound. When the offset MIS is larger and approaches positive infinity, the deviation between the predicted transfer function F′ and the true transfer function F is larger, indicating that the convergence performance of the adaptive filtering algorithm is worse, and thus the acoustic system has a worse effect of canceling feedback sound.

[0076] It should be noted that the convergence performance of the adaptive filtering algorithm in the present application includes but is not limited to: convergence speed, convergence error, etc. The convergence speed may refer to the fitting speed of the predicted transfer function F′ to the true transfer function F, and the convergence error may refer to the deviation between the predicted transfer function F′ and the true transfer function F when the convergence condition is reached.

[0077] exist Figure 2 In the acoustic system shown, the reason why a time-varying predicted transfer function F′ can be solved by an adaptive filtering algorithm to fit the transfer function F corresponding to the feedback path is based on the following ideal assumption: the feedback path is all linear transfer.

[0078] However, actual acoustic systems usually cannot meet the above ideal assumptions. This is because in actual acoustic systems, there are multiple devices on the feedback path, and these devices may have nonlinear responses. For example, the interaction between the diaphragm and magnet of the speaker 110 leads to hysteresis effects and saturation distortion, so the response of the speaker 110 contains nonlinear response components. In addition, there are usually power amplifiers, operational amplifiers and other devices between the signal processing circuit 150 and the speaker 110. Power amplifiers and operational amplifiers usually have limiting effects, so the responses of the two also contain nonlinear response components. Similarly, other devices between the signal processing circuit 150 and the speaker 110 may also have nonlinear response components.

[0079] Since the acoustic feedback cancellation unit 170 obtains the driving signal u at a position before the output port of the signal processing circuit 150, and uses the predicted transfer function F′ to perform adaptive filtering on the driving signal u, the nonlinear response of the loudspeaker 110, the power amplifier, the operational amplifier and other devices are inevitably introduced into the iterative solution of the predicted transfer function F′, thereby resulting in low convergence performance of the adaptive filtering algorithm, for example, resulting in the predicted transfer function F′ failing to converge, converging slowly, or having a large convergence error, etc. This deteriorates the misalignment index MIS of the acoustic system, thereby affecting the acoustic system's effect of canceling feedback sound.

[0080] In addition, in the design architecture of some acoustic systems, the acoustic feedback cancellation unit 170 may be independent of other units in the signal processing circuit 150, and the design architecture of the acoustic system limits the access rights or communication capabilities between different units. Therefore, the acoustic feedback cancellation unit 170 may not be able to obtain the driving signal u from other units. As a result, such an acoustic system cannot use the AFC technology to reduce or eliminate feedback sound.

[0081] Figure 3 Another schematic diagram of the design of an acoustic system provided according to an embodiment of this specification is shown. Figure 3 As shown, the acoustic system 20 may include: a speaker 110 , a first sound sensor 120 - 1 , a second sound sensor 120 - 2 , and a signal processing circuit 150 .

[0082] Figure 3 The acoustic system 20 shown can be considered as Figure 2 A further improvement on the acoustic system 10 shown. Figure 2 and Figure 3 visible, Figure 3 The first sound sensor 120-1 in the acoustic system 20 may correspond to Figure 2 The acoustic sensor 120 in the acoustic system 10 is shown, so that Figure 3 The acoustic system 20 shown is equivalent to Figure 2 A second sound sensor 120-2 is added to the acoustic system 10. The structure of the second sound sensor 120-2 may be the same as or different from that of the first sound sensor 120-1, which is not limited in the present application.

[0083] Figure 3 The working process of the acoustic system 20 is as follows: when the speaker 110 is working, it receives the driving signal u from the signal processing circuit 150 and converts the driving signal u into the first sound. When the first sound sensor 120-1 is working, it collects the ambient sound and generates the first signal y 1 When the second sound sensor 120-2 is working, it collects the ambient sound and generates the second signal y2 The environmental sound includes a first sound from the speaker 110 and a second sound from the external sound source 160. Thus, the first signal y 1 includes a signal component x corresponding to the first sound 1 and the signal component v corresponding to the second sound 1 , the second signal y 2 includes a signal component x corresponding to the first sound 2 and the signal component v corresponding to the second sound 2 The external sound source 160 includes other sound sources in the environment except the speaker 110, such as a human throat, an electronic device with a sound playing function, other speakers, and the like.

[0084] It should be noted that the first sound emitted by the speaker 110 can be transmitted through one or more media among gas, liquid and solid, and then picked up by the first sound sensor 120-1 and the second sound sensor 120-2. The second sound emitted by the target sound source 160 can be transmitted through one or more media among gas, liquid and solid, and then picked up by the first sound sensor 120-1 and the second sound sensor 120-2. 1 , the second signal y 2 , and the carrying method of the driving signal u are not limited, and all three can be signals carried by any carrier. 1 , the second signal y 2 , and the driving signal u can all be electrical signals, optical signals, digital carrier signals or signals of other carrier types.

[0085] exist Figure 3 In the acoustic system 20 shown, the first sound sensor 120-1 and the second sound sensor 120-2 have different sound pickup focuses. The first sound sensor 120-1 focuses on picking up the sound from the target sound source 160, and the second sound sensor 120-2 focuses on picking up the sound from the speaker 110. Specifically, the first signal y picked up by the first sound sensor 120-1 1 and the second signal y picked up by the second sound sensor 120-2. 2 Satisfies the following relationship:

[0086] k 2 ≥2k 1 Formula (6)

[0087] Among them, k 1 is the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2and the signal energy corresponding to the second sound |v 1 | 2 The ratio of k 2 is the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 and the signal energy corresponding to the second sound |v 2 | 2 The ratio is:

[0088]

[0089]

[0090] In other words, k 2 With k 1 The ratio is recorded as N, that is: N = k 2 / k 1 , then the value of N can be a real number greater than or equal to 2. For example, the value of N can be within the interval specified by any two of 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, ..., ∞. When the value of N is larger and closer to ∞, the second sound sensor 120-2 is closer to picking up only the sound of the speaker 110, and the first sound sensor 120-1 is closer to picking up only the sound of the target sound source 160. In addition, when k 2 With k 1 When the ratio between is N, the closed-loop gain A of the acoustic system can be expressed as follows:

[0091]

[0092] It should be noted that the derivation method of the above formula (20) can be referred to the derivation process of formula (19) later, which will not be described in detail here. It can be seen from the above formula (20) that when the value of N gradually increases, the closed-loop gain A and the forward gain G gradually approach each other, that is, the energy loss of the system gradually decreases. When the value of N is ∞, the closed-loop gain A reaches the ideal forward gain G.

[0093] In order to make the above condition k 2 ≥2k 1 Satisfied, the first signal y 1 and the second signal y 2 One or more of the following conditions can be met:

[0094] (1) Second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 With the second signal y2 The signal energy corresponding to the second sound |v 2 | 2 The ratio is greater than or equal to 2, that is:

[0095]

[0096] The above condition can also be expressed as: the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the second signal y 2 The signal energy corresponding to the second sound in |v 2 | 2 . It is understandable that when |x 2 | 2 Much larger than |v 2 | 2 When k 2 As large as possible, so that the second sound sensor 120-2 picks up the first sound much more than the second sound. 2 When approaching infinity, the second sound sensor 120 - 2 almost only picks up the first sound but does not pick up the second sound.

[0097] (2) First signal y 1 The signal energy corresponding to the second sound in |v 1 | 2 With the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 The ratio is greater than or equal to 2, that is:

[0098]

[0099] The above conditions can also be expressed as: the first signal y 1 The signal energy corresponding to the second sound in |v 1 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 . It is understandable that when |v 1 | 2 Much larger than |x 1 | 2 When k 1 As small as possible, so that the first sound sensor 120-1 picks up the second sound much more than the first sound. 1When it approaches zero, the first sound sensor 120 - 2 almost only picks up the second sound but does not pick up the first sound.

[0100] (3) Second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 With the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 The ratio is greater than or equal to 2, that is:

[0101]

[0102] The above condition can also be expressed as: the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 . It is understandable that when |x 2 | 2 Much larger than |x 1 | 2 When the first sound is picked up by the second sound sensor 120-2, it is much greater than the first sound picked up by the first sound sensor 120-1. For example, the second sound sensor 120-2 picks up almost all of the first sound, while the first sound sensor 120-2 hardly picks up the first sound.

[0103] The signal processing circuit 150 may be connected to the first sound sensor 120-1 and the second sound sensor 120-2 respectively. The signal processing circuit 150 may obtain the first signal y from the first sound sensor 120-1. 1 and obtain a second signal y from the second sound sensor 120-2 2 Furthermore, the signal processing circuit 150 may be based on the second signal y 2 , for the first signal y 1 The signal component corresponding to the first sound in the target signal e is reduced to obtain the target signal e. In this way, the target signal e contains no or less feedback sound components.

[0104] and Figure 2 similar, Figure 3 The acoustic system shown can also be based on AFC technology to reduce or eliminate feedback components in the target signal. Figure 3The signal processing circuit 150 may include an acoustic feedback cancellation unit 170. The acoustic feedback cancellation unit 170 may solve and adaptively update a time-varying predicted transfer function F′ to fit the actual transfer function F corresponding to the feedback path. The input of the acoustic feedback cancellation unit 170 includes: a first signal y 1 and the second signal y 2 The acoustic feedback cancellation unit 170 may be based on the second signal y 2 , for the first signal y 1 The signal component corresponding to the first sound in y is reduced to obtain the target signal e. Specifically, the acoustic feedback cancellation unit 170 uses the prediction transfer function F′ to cancel the second signal y 2 Perform adaptive filtering to obtain the third signal x′, that is, x′=y 2 *F′. The third signal x′ can be regarded as the first signal y 1 The feedback component in (i.e., the first signal y 1 Then, the acoustic feedback cancellation unit 170 can obtain the predicted value of the signal component corresponding to the first sound from the first signal y 1 Subtract the third signal x' from the target signal e, that is, e = y 1 -x′=y 1 -y 2 *F′. The target signal e thus obtained contains no or less feedback sound components.

[0105] After obtaining the target signal e, the signal processing circuit 150 can also 2 At least one of the above and the target signal e updates the filtering parameters of the adaptive filtering operation F′. Specifically, according to the theory of the adaptive filtering algorithm, the update method of the predicted transfer function F′ can be achieved by minimizing the expectation of the mean square function of the target signal e, that is:

[0106] min F′ E[e 2 ]=min F′ E[(y 1 -y 2 *F′) 2 ] Formula (1-2)

[0107] Still taking the acoustic feedback cancellation unit 170 using the LMS algorithm as an example, the above formula (1-2) is derived based on the gradient descent optimization method, and the update formula of the predicted transfer function F′ can be obtained as follows:

[0108] F′←F′+μ*e*y 2 Formula (2-2)

[0109] Among them, μ is the iteration step size.

[0110] It should be understood that when the acoustic feedback cancellation unit 170 adopts algorithms such as NLMS, RLS, etc., a similar method can be used to derive an update formula for the predicted transfer function F′, which will not be explained one by one in this specification.

[0111] Figure 3 After the acoustic system shown in FIG. 1 obtains the target signal e, the signal processing circuit 150 can perform a target operation on the target signal e. Figure 3 The signal processing circuit 150 may further include a gain amplification unit 130 ( Figure 3 The gain amplifier unit is marked as G in FIG. 1 ). The gain amplifier unit performs gain amplification on the target signal e, and sends the gain-amplified signal to the speaker 110 as the driving signal u at the next moment, thereby driving the speaker 110 to produce sound. Since the feedback component in the target signal e is reduced or eliminated, the acoustic system 10 can avoid or suppress the generation of howling, and it also helps to improve the maximum forward gain that the acoustic system 10 can achieve.

[0112] Figure 3 The acoustic system 20 shown in the figure uses the newly added second sound sensor 120-2 to focus on picking up the first sound to obtain the second signal y 2 , and then, the signal processing circuit 150 can use the AFC technology based on the second signal y 2 For the first signal y 1 The feedback components in the circuit can be reduced, thereby reducing or eliminating the feedback components. Figure 3 The acoustic system 20 shown is compared to Figure 2 The acoustic system 10 shown, due to the second signal y 2 is obtained from the signal path behind the speaker 110. Therefore, when solving the predicted transfer function F′, the feedback cancellation unit 170 only needs to fit the transfer function of the feedback path after the speaker 110, thereby avoiding the influence of the nonlinear response of the speaker 110 and the devices before the speaker 110 (such as operational amplifiers, power amplifiers, etc.) on the convergence performance of the adaptive filtering algorithm, thereby improving the cancellation effect of the feedback sound. In addition, since the second signal y required by the feedback cancellation unit 170 is 2 It is picked up by the second sound sensor 120-2. Therefore, even if the acoustic system 20 restricts the interaction authority between the feedback cancellation unit 170 and other units, it does not affect the application of the AFC technology in the acoustic system 20, reduces the requirements of the AFC technology on the design architecture of the acoustic system, and improves the application flexibility and breadth of the AFC technology.

[0113] In addition, since the feedback cancellation unit 170 originally has the system access right to the first sound sensor 120-1, and the right required to access the second sound sensor 120-2 is the same as the right required to access the first sound sensor 120-1, Figure 3 After the second sound sensor 120 - 2 is added to the acoustic system shown, the feedback cancellation unit 170 can access the data of the second sound sensor 120 - 2 without adding new system access rights.

[0114] Furthermore, Figure 3 After the second sound sensor 120-2 is added to the acoustic system shown in the figure, it is not necessary to change the internal implementation of the acoustic feedback cancellation unit 170, that is, it is not necessary to change the update formula of the predicted transfer function F′ and the calculation formula for feedback sound cancellation. Instead, it is only necessary to replace the input signal u of the acoustic feedback cancellation unit 170 with y 2 It can be seen that Figure 3 The acoustic system shown can be applied, adapted, and compatible with the existing acoustic feedback cancellation unit 170, regardless of the adaptive filtering algorithm (including but not limited to the aforementioned LMS, NLMS, RLS or other adaptive filtering algorithms) used by the existing acoustic feedback cancellation unit 170. Therefore, the modification difficulty of the acoustic system is relatively low and has wide applicability.

[0115] Below Figure 3 The system stability of the acoustic system 20 shown is verified.

[0116] According to the theory of signal processing, Figure 3 The closed-loop gain A of the acoustic system shown can be expressed as follows:

[0117]

[0118] Among them, F 1 represents the acoustic transfer function between the speaker 110 and the first sound sensor 120 - 1 , F 2 represents the acoustic transfer function between the loudspeaker 110 and the second sound sensor 120 - 2 .

[0119] According to the Nyquist stability criterion, it can be known that the requirement for the acoustic system 20 to offset the feedback sound is that the predicted transfer function F′ to be solved satisfies the following conditions:

[0120]

[0121] That is, the prediction transfer function F′ needs to satisfy:

[0122]

[0123] When the predicted transfer function F′ satisfies the above formula (14), formula (3-2) can be transformed into:

[0124]

[0125] Since the first signal y 1 and the second signal y 2 The following conditions are met: 2 ≥2k 1 ,Right now:

[0126]

[0127] For x in formula (16) 1 and x 2 Substituting, we get:

[0128]

[0129] Simplifying formula (17) yields:

[0130] |v 1 F 2 | 2 ≥2·|v 2 F 1 | 2 Formula (18)

[0131] Substituting the above formula (18) into formula (15), we get:

[0132]

[0133] It can be seen from formula (19) that when the forward gain G→∞, the closed-loop gain A→∞. Therefore, Figure 3 The acoustic system shown is still stable when the predicted transfer function F' reaches the convergence condition, thereby confirming the correctness of the solution of the present application.

[0134] based on Figure 3 In the acoustic system 20 shown, in some cases, when the second sound sensor 120-2 is in a strong feedback environment, the acoustic transfer function F between the speaker 110 and the second sound sensor 120-2 is 2 ≈1, and the first signal y 1 and the second signal y 2 The following conditions must be met:

[0135] The second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the second signal y 2 The signal energy corresponding to the second sound in |v2 | 2 , that is: |x 2 | 2 >>|v 2 | 2 .

[0136] In this case, Figure 3 The acoustic system shown can be simplified to Figure 4 The acoustic system shown. Figure 4 In the acoustic system shown, the second sound sensor 120-2 picks up almost only the sound from the speaker 110. In this case, the second signal y 2 ≈u. Therefore, the update formula of the prediction transfer function F′ can be updated as:

[0137] F′←F′+μey 2 ≈F′+μeu Formula (2-3)

[0138] Accordingly, the closed-loop gain A of the acoustic system 30 can be expressed as:

[0139]

[0140] It can be seen that when the second sound sensor 120-2 is located in a strong feedback scene, Figure 4 The mathematical expression of AFC in the acoustic system shown is similar to Figure 2 The AFC mathematical expressions based on ideal assumptions in the acoustic system shown are exactly the same, which further confirms the correctness of the solution of the present application.

[0141] Figure 5 FIG. 2 shows another design schematic diagram of an acoustic system provided according to an embodiment of the present specification. Figure 5 As shown, the signal processing circuit 150 may further include a preprocessing unit 180. The signal processing circuit 150 obtains the first signal y 1 and the second signal y 2 Afterwards, the first signal y can be processed by the preprocessing unit 180 1 and the second signal y 2 Specifically, the signal processing circuit 150 processes the first signal y through the preprocessing unit 180. 1 Perform the first preprocessing operation H 1 Get the first intermediate signal y 1 ′, and for the second signal y 2 Perform the second preprocessing operation H 2 Get the second intermediate signal y 2 '. Then, the first intermediate signal y 1 ′ and the second intermediate signal y 2' is input to the acoustic feedback cancellation unit 170. The acoustic feedback cancellation unit 170 is based on the second intermediate signal y 2 ′, for the first intermediate signal y 1 The signal component corresponding to the first sound in ' is reduced to obtain the target signal e. It should be understood that the internal processing process of the acoustic feedback cancellation unit 170 has been described above and will not be repeated here.

[0142] Among them, the first preprocessing operation H 1 The second preprocessing operation H may include but is not limited to at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation. 2 The first preprocessing operation H may include but is not limited to at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation. When designing an acoustic system, the first preprocessing operation H may be performed based on the requirements of different application scenarios. 1 and the second preprocessing operation H 2 For example, in some cases, there is a difference in the frequency response of the first sound sensor 120-1 and the second sound sensor 120-2, so a suitable first preprocessing operation H may be designed. 1 and the second preprocessing operation H 2 To compensate for the difference, so that the first signal y 1 and the second signal y 2 The frequency responses of the first signal y and the second signal y match each other, meeting the calculation requirements of the AFC algorithm. 1 and the second signal y 2 Perform preprocessing operations to meet the processing requirements of different application scenarios.

[0143] Above Figures 3 to 5 The acoustic system 20 includes a speaker 110 as an example for illustration. In some scenarios, the number of speakers 110 in the acoustic system 20 may be M, where M is an integer greater than 1. In this case, the number of second sound sensors 120-2 may also be M. The M second sound sensors 120-2 correspond one-to-one to the M speakers 110. Among them, the i-th second sound sensor 120-2 focuses on picking up the sound emitted by the i-th speaker 110.

[0144] Specifically, for any i-th second sound sensor among the M second sound sensors 120-2, the i-th second sound sensor 120-2 collects environmental sound and generates a second signal y when working. 2i Among them, the first signal y 1 and the second signal y 2i Satisfy k 2i ≥2k 1 , k 2iis the second signal y 2i The signal processing circuit 150 can further calculate the ratio of the signal energy of the sound emitted by the i-th speaker 110 to the signal energy of the sound emitted by the target sound source. The target sound source includes other sound sources in the environment except the i-th speaker. 2i For the first signal y 1 The feedback component in is reduced to obtain the target signal e i The signal processing circuit processes the target signal 1 To target signal e M The target signal e is obtained by superposition, and then the target operation is performed on the target signal e.

[0145] It can be seen that when the acoustic system 20 includes M speakers 110, the acoustic system 20 may include M second sound sensors 120-2. The i-th sound sensor 120-2 focuses on picking up the sound of the i-th speaker and is used for the adaptive filtering process of AFC. In this way, it is equivalent to superimposing M AFC-based adaptive filtering processes in the acoustic system 20. Each adaptive filtering process is similar to the previous one. Figures 3 to 5 The description is the same as that of , so I will not repeat it here.

[0146] In summary, based on Figures 3 to 5 The acoustic system shown in the figure has a first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 In this case, the use of AFC technology can effectively reduce or eliminate feedback sound, and can avoid or reduce the impact of nonlinear response on the convergence performance of the adaptive filtering algorithm.

[0147] The following describes in detail how to design the acoustic system so that the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 It should be noted that there are many possible solutions for designing an acoustic system, and the following only takes several possible solutions as examples for illustration. The different solutions listed below can be combined with each other.

[0148] Solution 1: The acoustic system can be designed from a structural dimension so that the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 meets a preset condition, so that the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0149] In some embodiments, the first sound sensor 120 - 1 , the second sound sensor 120 - 2 , and the speaker 110 satisfy a preset distance condition.

[0150] For example, the distance condition may include: the distance between the second sound sensor 120-2 and the speaker 110 is much smaller than the distance between the first sound sensor 120-1 and the speaker 110. In other words, the second sound sensor 120-2 is as close to the speaker 110 as possible compared to the first sound sensor 120-1. Assume that the distance between the first sound sensor 120-1 and the speaker 110 is L 1 , the distance between the second sound sensor 120-2 and the speaker 110 is recorded as L 2 , then L 1 and L 2 Meet the distance condition: L 1 ≥ 2 L 2 The above distance condition can also be expressed as L 1 With L 2 The ratio of is greater than or equal to a preset value. The preset value may be located in any two intervals specified by 2, 3, 4, 5, 6, 7, 8, 9, 10, ...∞.

[0151] Combine the following 6A to 6F , and examples are given for the possible structures of the acoustic system. It should be noted that this specification does not limit the product form of the acoustic system 20. For example, the acoustic system 20 can be in the form of a true wireless headset, an earmuff form, a glasses form, a back-hanging form, a behind-the-ear form, an in-ear form, or any other possible form. 6A to 6F Only a few possible product forms are used as examples.

[0152] For example, when the acoustic system 20 adopts the true wireless headset form, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as follows: Fig. 6A When the acoustic system 20 is in an earmuff-type configuration, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 may be as follows: Figure 6B When the acoustic system 20 is in the form of glasses, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in FIG. Figure 6C When the acoustic system 20 is in a rear-mounted configuration, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 may be as shown in FIG. Fig.6DWhen the acoustic system 20 adopts the behind-the-ear type, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in FIG. Fig. 6E The behind-the-ear configuration includes but is not limited to BTE (Behind-The-Ear) and RIC (Receiver-In-Canal) configurations in hearing aids. When the acoustic system 20 adopts an in-the-ear configuration, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 can be as follows: Fig. 6F The in-ear type includes, but is not limited to, ITE (In-The-Ear), ITC (In-The-Canal), CIC (Completely-In-the-Canal) and other types of hearing aids. 6A to 6F The acoustic system structures shown all meet the distance condition L 1 ≥ 2 L 2 .

[0153] It should be understood that when the acoustic system meets the distance condition L 1 ≥ 2 L 2 , the second sound sensor 120-2 can pick up a stronger first sound than the first sound sensor 120-1. 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 , which helps to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0154] It is understandable that despite the above 6A to 6F It shows that the distance condition L is satisfied 1 ≥ 2 L 2 However, in some cases, some acoustic systems may not meet the distance condition L due to product form or specific requirements. 1 ≥ 2 L 2 That is, L 1 and L 2 The values ​​of are close. For example, FIG. 7A to FIG. 7G L 1 and L 2Specifically, when the acoustic system 20 adopts the form of a true wireless headset, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as follows: Fig. 7A When the acoustic system 20 is in an earmuff-type configuration, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 may be as follows: Figure 7B When the acoustic system 20 is in the form of glasses, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in FIG. Figure 7C When the acoustic system 20 is in a rear-mounted configuration, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 may be as shown in FIG. Fig.7D As shown in FIG. 1 (the distances between the two sound sensors and the speaker are both far), it is also possible to Fig. 7E When the acoustic system 20 adopts the behind-the-ear type, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2 and the speaker 110 can be as shown in FIG. Figure 7F The behind-the-ear configuration includes but is not limited to BTE (Behind-The-Ear) and RIC (Receiver-In-Canal) configurations in hearing aids. When the acoustic system 20 adopts an in-the-ear configuration, the positional relationship between the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 can be as follows: Figure 7G The in-ear type includes, but is not limited to, ITE (In-The-Ear), ITC (In-The-Canal), CIC (Completely-In-the-Canal) and other types of hearing aids.

[0155] When the acoustic system cannot meet the distance condition L 1 ≥ 2 L 2 In the case of FIG. 7A to FIG. 7G The acoustic system can be designed using the following scheme so that the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 It should be noted that the acoustic system adopts 6A to 6F The design scheme shown may also be combined with one or more of the subsequent schemes.

[0156] In some embodiments, the first sound sensor 120-1, the second sound sensor 120-2, and the speaker 110 meet a preset structural condition. FIG. 8A to FIG. 8F The structural conditions satisfied by the acoustic system are explained. It should be noted that FIG. 8A to FIG. 8F Only a partial structure of the acoustic system is shown.

[0157] For example, the acoustic system 20 may adopt an acoustic cavity design. FIG. 8A to FIG. 8C , the acoustic system 20 may include a shell 21, and an acoustic cavity 22 is formed in a partial area of ​​the shell 21. It should be noted that the present application does not limit the specific form of the acoustic cavity 22. The speaker 110 is located inside the acoustic cavity 22. The sound-emitting component of the speaker 110 can separate the acoustic cavity 22 into a first acoustic cavity 22-1 and a second acoustic cavity 22-2. Among them, the above-mentioned sound-emitting component may refer to a component that generates vibration in the speaker 110, for example, it may be a vibration membrane, a vibration beam, a vibration rod, a vibration block, etc. The first acoustic cavity 22-1 refers to the acoustic resonance cavity of the first sound emitted by the speaker 110 before it enters the external free space. The second acoustic cavity 22-2 refers to the acoustic resonance cavity where the component of the first sound emitted by the speaker 110 that will not be directly propagated to the external free space is located. In other words, the sound-emitting component of the speaker 110 divides the acoustic cavity 22 into two sub-cavities, in which the sub-cavity facing the sound-emitting surface of the sound-emitting component is the first acoustic cavity 22-1, and the sub-cavity facing away from the sound-emitting surface of the sound-emitting component is the second acoustic cavity 22-2. The first acoustic cavity 22-1 can also be called a front cavity, and the second acoustic cavity 22-2 can also be called a rear cavity.

[0158] Based on the above-mentioned design of the acoustic cavity, in some embodiments, the second sound sensor 120-2 can be located inside the acoustic cavity 22, and the first sound sensor 120-2 can be located outside the acoustic cavity 22. It can be understood that since the speaker 110 is located inside the acoustic cavity 22, setting the second sound sensor 120-2 inside the acoustic cavity 22 and setting the first sound sensor 120-1 outside the acoustic cavity 22 can enable the second sound sensor 120-2 to pick up a stronger sound of the speaker 110 than the first sound sensor 120-1. In other words, the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 , which helps to make the first signal y 1 and the second signal y 2 Satisfy the condition k2 ≥2k 1 .

[0159] The specific position of the second sound sensor 120-2 inside the acoustic cavity 22 can be in various situations. Fig. 8A , the second sound sensor 120-2 can be located inside the first acoustic cavity 22-1. In this way, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1, thereby helping to achieve the following conditions: the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 . This helps to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0160] For another example, see Figure 8B , the second sound sensor 120-2 can be located inside the second acoustic cavity 22-2. This approach can achieve the following two effects: first, the second sound sensor 120-2 can capture a stronger first sound at least in a partial frequency band than the first sound sensor 120-1, thereby helping to achieve the following conditions: the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 On the other hand, the speaker 110 can block the second sound emitted by the target sound source 160 to a certain extent, thereby helping to achieve the following conditions: the second signal y 2 The signal energy corresponding to the second sound |v 2 | 2 Much smaller than the first signal y 1 The signal energy corresponding to the second sound |v 1 | 2 The combined effect of the above two aspects makes the condition k 2 ≥2k 1 can be achieved.

[0161] For example, see Figure 8C, the second sound sensor 120-2 can be coupled to the sound-generating component of the speaker 110. For example, the second sound sensor 120-2 can be a light-weight bone conduction MIC, and the speaker 110 can be an air conduction speaker. The bone conduction MIC can be attached to the diaphragm of the air conduction speaker. In this way, since the bone conduction MIC picks up the bone vibration signal, the air vibration will not interfere with the sound pickup of the bone conduction MIC, thereby ensuring that the second signal y picked up by the bone conduction MIC is 2 In addition, the acoustic system 20 can reduce the influence of the bone conduction MIC on the vibration of the speaker diaphragm by using a light-weight bone conduction MIC, thereby avoiding the introduction of additional distortion. It should be noted that this coupling method is applicable to various types of sound sensors and speakers, and the above-mentioned coupling method of the bone conduction MIC and the air conduction speaker is only a possible example.

[0162] Figure 8C In the acoustic system shown, since the second sound sensor 120-2 is coupled to the sound-generating component of the speaker 110, the second sound sensor 120-2 can directly pick up the sound emitted by the speaker 110. Therefore, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1. 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 , which helps to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0163] It should be noted that the above FIG. 8A to FIG. 8C The design does not limit the specific position of the first sound sensor 120-1, as long as it is located outside the acoustic cavity 22 and can conveniently pick up the sound of the target sound source 160. For example, the first sound sensor 120-1 can be located inside the housing 21, and the sound pickup surface is set on the surface of the housing 21 away from the acoustic cavity 22. FIG. 8A to FIG. 8C The position of the first sound sensor 120 - 1 is not illustrated.

[0164] In some embodiments, the sound pickup surface of the first sound sensor 120-1 and the sound pickup surface of the second sound sensor 120-2 can both be located in the free space outside the housing 21, and the second sound sensor 120-2 is closer to the speaker 110 (or closer to the acoustic cavity 22) than the first sound sensor 120-1. The free space refers to a space where sound is not affected by reflection, refraction, or diffraction and is mainly propagated in the form of spherical waves or plane waves. For example, see Fig. 8E The second sound sensor 120-2 may be disposed in a free space outside the housing 21 without being physically connected to the housing 21. In this case, the second sound sensor 120-2 may be a wired or wireless MIC that picks up the second signal y in the free space. 2 Afterwards, the second signal y may be sent to the signal processing circuit 150 via a wired or wireless method. 2 .

[0165] In some embodiments, see Fig.8D An acoustic cavity 22 and an acoustic cavity 23 may be formed in a partial area of ​​the housing 21 of the acoustic system. The speaker 110 is located in the acoustic cavity 22, the second sound sensor 120-2 is located in the acoustic cavity 23, and the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1. The acoustic cavity 23 can protect the second sound sensor 120-2 from wind, and may also be called a windproof cavity. The second sound sensor 120-2 can still pick up sound signals in the free space in the acoustic cavity 23.

[0166] It should be noted that the above FIG. 8D to FIG. 8E The design does not limit the specific position of the first sound sensor 120-1, as long as the sound pickup surface of the first sound sensor 120-1 is located in the free space and can conveniently pick up the sound of the target sound source 160 in the free space. For example, the first sound sensor 120-1 can be located inside the housing 21, and the sound pickup surface is set on the surface of the housing 21 away from the acoustic cavity 22. Fig.8D and Fig. 8E The position of the first sound sensor 120 - 1 is not illustrated.

[0167] Fig.8D and Fig. 8E In the design shown, since the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1. 2 The signal energy corresponding to the first sound in |x 2 | 2Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 , which helps to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .in addition, Fig. 8E In the design, since the second sound sensor 120-2 is located in the free space outside the shell 21, there is no need to modify the structure of the shell 21 and the acoustic cavity 22, and the implementation difficulty is relatively low. Fig.8D In the design, since the second sound sensor 120-2 is located in an acoustic cavity other than the acoustic cavity 22, there is no need to modify the acoustic cavity 22, and the implementation difficulty is relatively low.

[0168] In some embodiments, the sound pickup surface of the first sound sensor 120-1 can be set in the free space outside the housing 21, and the sound pickup surface of the second sound sensor 120-2 can be set in the internal space of the housing 21, and the second sound sensor 120-2 is closer to the speaker 110 (or closer to the acoustic cavity 22) than the first sound sensor 120-1. Fig.8F , the second sound sensor 120-2 can be located in an area inside the shell 21 close to the second acoustic cavity 22-2 (or the back cavity), and the sound pickup surface of the second sound sensor 120-2 faces the second acoustic cavity 22-2. It should be noted that the present application does not limit the specific position of the first sound sensor 120-1, as long as it can conveniently pick up the sound of the target sound source 160. For example, the first sound sensor 120-1 can be located inside the shell 21, and the sound pickup surface is set on the surface of the shell 21 away from the speaker 110 (or away from the acoustic cavity 22). Fig.8F The position of the first sound sensor 120 - 1 is not shown.

[0169] Fig.8F In the design shown, since the second sound sensor 120-2 is close to the back cavity (i.e., the second acoustic cavity 22-2), the second sound sensor 120-2 can pick up the first sound leaking from the back cavity, or pick up the first sound propagating in a solid medium. Furthermore, since the second sound sensor 120-2 is closer to the speaker 110 than the first sound sensor 120-1, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1. Thus, the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y1 The signal energy corresponding to the first sound in |x 1 | 2 In addition, since the first sound sensor 120-1 is hidden inside the housing 21, the housing 21 blocks the sound of the target sound source 160 to a certain extent, so that the second signal y 2 The signal energy corresponding to the second sound in |v 2 | 2 Much smaller than the first signal y 1 The signal energy corresponding to the second sound in |v 1 | 2 The above two aspects work together to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 In addition, the above solution does not require modification of the acoustic cavity 22 and is relatively easy to implement.

[0170] In some embodiments, the first sound sensor 120-1 and the speaker 110 can also be coupled to different shells respectively. For example, the acoustic system 20 can also include a first shell and a second shell. The first shell can be regarded as the device shell of the acoustic system 20. The first sound sensor 120-1 can be located inside the first shell, and the sound pickup surface is set on the surface of the first shell and faces the free space outside the first shell. The second shell can also be located inside the first shell, and the second shell forms an acoustic cavity, and the speaker 110 and the second sound sensor 120-2 are located inside the acoustic cavity. FIG. 8A to FIG. 8C Similarly, the sound-emitting device of the speaker 110 can divide the acoustic cavity into a first acoustic cavity (front cavity) and a second acoustic cavity (rear cavity), and the second sound sensor 120-2 can be located inside the first acoustic cavity or inside the second acoustic cavity, and can also be coupled with the sound-emitting component of the speaker 110.

[0171] Based on the above design, the first sound sensor 120-1 picks up sound in the free space outside the first shell, and the second sound sensor 120-2 picks up sound in the acoustic cavity inside the first shell. Due to the sound blocking effect of the first shell, on the one hand, the second sound sensor 120-2 will reduce the sound pickup of the target sound source 160, and on the other hand, the first sound sensor 120-1 will reduce the sound pickup of the speaker 110. Therefore, the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x1 | 2 , and the second signal y 2 The signal energy corresponding to the second sound in |v 2 | 2 Much smaller than the first signal y 1 The signal energy corresponding to the second sound in |v 1 | 2 . This helps to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0172] In some embodiments, the acoustic system 20 may further include a barrier. The barrier acts to block sound. It should be noted that the present application does not limit the shape of the barrier, for example, it may be a barrier plate, or a barrier cover, etc. The second sound sensor 120-2 and the speaker 110 are located on the first side of the barrier, and the first sound sensor 120-1 is located on the second side of the barrier. In this way, since the barrier acts to block the first sound, the first sound sensor 120-1 picks up less of the first sound than the second sound sensor 120-2, that is, the second sound sensor 120-2 can capture a stronger first sound than the first sound sensor 120-1. Thus, the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 , which helps to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0173] Solution 2: The acoustic system 20 can be designed from the perspective of sound pickup directivity, so that the sound pickup directivity of the first sound sensor 120-1 and the second sound sensor 120-2 meets the preset conditions, so that the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0174] Among them, the sound pickup directivity of the sound sensor may refer to the different degrees of directivity in different directions due to the different sound pickup sensitivities of the sound sensor in different directions. Among them, the sound pickup sensitivity in a certain direction may refer to the ability of the sound sensor to pick up the sound from that direction. When the sound pickup sensitivity in a certain direction is higher, it means that the sound sensor has a stronger ability to pick up the sound in that direction, that is, the more signal components corresponding to the sound in that direction in the sound pickup signal picked up by the sound sensor, so that the directivity of the sound sensor in that direction is stronger. When the sound pickup sensitivity in a certain direction is lower, it means that the sound sensor has a weaker ability to pick up the sound in that direction, that is, the fewer signal components corresponding to the sound in that direction in the sound pickup signal picked up by the sound sensor, so that the directivity of the sound sensor in that direction is weaker. When the sound pickup sensitivity in a certain direction is zero, it means that the sound sensor does not pick up the sound in that direction, and this direction can also be called the zero-point pickup direction.

[0175] Fig. 9 FIG. 1 shows a schematic diagram of the sound pickup direction of an acoustic system provided according to an embodiment of the present specification. Fig. 9 As shown, the sound pickup directivity of the first sound sensor 120-1 and the second sound sensor 120-2 may satisfy at least one of the following conditions:

[0176] (1) The sound pickup sensitivity of the first sound sensor 120 - 1 in the first direction is greater than the sound pickup sensitivity in the second direction.

[0177] The first direction points to the target sound source 160, and the second direction points to the speaker 110. It can be understood that when the above condition (1) is met, the first sound sensor 120-1 can focus on picking up the sound of the target sound source 160. When designing the acoustic system 20, in order to meet the above condition (1), the direction in which the first sound sensor 120-1 has a higher sound pickup sensitivity can be directed toward the target sound source 160, and / or the direction in which the first sound sensor 120-1 has a lower sound pickup sensitivity can be directed toward the speaker 110. For example, the direction in which the first sound sensor 120-1 has the highest sound pickup sensitivity can be directed toward the target sound source 160, and / or the direction in which the first sound sensor 120-1 has the lowest sound pickup sensitivity can be directed toward the speaker 110.

[0178] (2) The sound pickup sensitivity of the second sound sensor 120-2 in the first direction is lower than the sound pickup sensitivity in the second direction.

[0179] When the above condition (2) is met, the second sound sensor 120-2 can focus on picking up the sound of the speaker 110. When designing the acoustic system 20, in order to meet the above condition (2), the direction of the second sound sensor 120-2 with a higher sound pickup sensitivity can be directed toward the speaker 110, and / or the direction of the second sound sensor 120-2 with a lower sound pickup sensitivity can be directed toward the target sound source 160. For example, the direction of the second sound sensor 120-2 with the highest sound pickup sensitivity can be directed toward the speaker 110, and / or the direction of the second sound sensor 120-2 with the lowest sound pickup sensitivity can be directed toward the target sound source 160.

[0180] It should be noted that only one of the above conditions (1) and (2) needs to be met. When condition (1) is met, the first sound sensor 120-1 focuses on picking up the sound from the target sound source 160, and when condition (2) is met, the second sound sensor 120-2 focuses on picking up the sound from the speaker 110. Both cases help to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 Furthermore, when the above conditions (1) and (2) are satisfied at the same time, the first sound sensor 120-1 can pick up a stronger sound of the target sound source 160 than the second sound sensor 120-2, and the second sound sensor 120-2 can pick up a stronger sound of the speaker 110 than the first sound sensor 120-1. 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 , the second signal y 2 The signal energy corresponding to the second sound in |v 2 | 2 Much smaller than the first signal y 1 The signal energy corresponding to the second sound |v 1 | 2 , which is more helpful to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0181] It should be noted that the sound pickup directivity of the first sound sensor 120-1 and the sound pickup directivity of the second sound sensor 120-2 can be achieved by using a single sound pickup device with a certain directivity, or by using a plurality of sound pickup devices to form a preset array, and the present application does not limit this. In addition, the present application does not specifically limit the sound pickup direction patterns corresponding to the first sound sensor 120-1 and the second sound sensor 120-2, and the two can use the same sound pickup direction pattern or different sound pickup direction patterns. For example, the sound pickup direction patterns corresponding to the first sound sensor 120-1 and the second sound sensor 120-2 can be any one of an omnidirectional pattern, a heart-shaped pattern, a super-heart-shaped pattern, an 8-shaped pattern, a gun-shaped pattern or other directional patterns. For example, Fig. 9 The sound pickup direction pattern of the first sound sensor 120 - 1 is a gun-shaped pattern with a stronger sound pickup direction pointing to the target sound source 160 , while the sound pickup direction pattern of the second sound sensor 120 - 2 is a heart-shaped pattern with a stronger sound pickup direction pointing to the speaker 110 .

[0182] Since Solution 2 designs the acoustic system from the perspective of sound pickup directivity, that is, it is necessary to design the sound pickup directivity of the first sound sensor 120-1 and / or the second sound sensor 120-2, and no requirement or reduced requirement may be made for the positional relationship of each component in the acoustic system. It can be seen that Solution 2 can be applied to scenarios where it is inconvenient to change the structure of the acoustic system 20. In some embodiments, Solution 2 can also be combined with one or more designs in the aforementioned Solution 1.

[0183] Solution 3: The positions of the first sound sensor 120-1 and the second sound sensor 120-2 may be designed based on the feedback sound energy at each position in the target area, so that the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0184] For example, the first sound sensor 120-1 is located at a first position within the target area, and the second sound sensor 120-2 is located at a second position within the target area, wherein the first position and the second position satisfy at least one of the following conditions:

[0185] (1) The sound energy from the speaker 110 at the first position is smaller than the sound energy from the speaker 110 at other positions in the target area except the first position.

[0186] That is, the first sound sensor 120-1 is set at a position in the target area where the corresponding feedback sound energy (ie, the sound energy from the speaker 110) is the smallest. When condition (1) is met, the first sound sensor 120-1 cannot pick up the sound of the speaker 110 or picks up a weak sound.

[0187] (2) The sound energy from the speaker 110 at the second position is greater than the sound energy from the speaker 110 at other positions in the target area except the second position.

[0188] That is, the second sound sensor 120-2 is set at the position in the target area where the corresponding feedback sound energy (ie, the sound energy from the speaker 110) is the largest. When condition (2) is met, the second sound sensor 120-2 can pick up the stronger sound of the speaker 110.

[0189] It should be noted that only one of the above conditions (1) and (2) needs to be satisfied. When any one of them is satisfied, it is helpful to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 Further, when the above conditions (1) and (2) are satisfied at the same time, the first sound sensor 120-1 cannot pick up or picks up a weaker sound from the speaker 110, and the second sound sensor 120-2 can pick up a stronger sound from the speaker 110. Thus, the second signal y 2 The signal energy corresponding to the first sound in |x 2 | 2 Much larger than the first signal y 1 The signal energy corresponding to the first sound in |x 1 | 2 , which is more helpful to make the first signal y 1 and the second signal y 2 Satisfy the condition k 2 ≥2k 1 .

[0190] Fig. 10A FIG. 2 shows a schematic diagram of the positions of the first sound sensor and the second sound sensor in the target area of ​​the acoustic system provided in accordance with an embodiment of the present specification. Fig. 10A As shown, arrows are marked at different positions in the target area 190, and the length of the arrow represents the magnitude of the feedback sound energy (i.e., the sound energy from the speaker 110) corresponding to the position. The longer the arrow is, the greater the feedback sound energy is, and the shorter the arrow is, the smaller the feedback sound energy is. Fig. 10AIn the target area 190, the feedback sound energy corresponding to the position of the first sound sensor 120-1 is the smallest, and the feedback sound energy corresponding to the position of the second sound sensor 120-2 is the largest.

[0191] In order to meet the above conditions (1) and (2), the acoustic system 20 can be designed in the following manner: first, a target area 190 where the first sound sensor 120-1 and the second sound sensor 120-2 are to be placed is determined in the device of the acoustic system 20. Then, the feedback sound energy distribution corresponding to each position on the target area 190 is obtained through simulation calculation or field measurement. For example, Fig. 10B A schematic diagram of feedback sound energy corresponding to each position in a target area of ​​an acoustic system is shown. The larger the grayscale value of a position in the target area 190 (black when the grayscale value is 0, and white when the grayscale value is 255), the larger the feedback sound energy corresponding to the position, and the smaller the grayscale value of a position in the target area, the smaller the feedback sound energy corresponding to the position. Furthermore, the position with the strongest feedback sound energy in the target area 190 is taken as the second position 192, and the second sound sensor 120-2 is set at the second position 192; the position with the weakest feedback sound energy in the target area 190 is taken as the first position 191, and the first sound sensor 120-1 is set at the first position 191.

[0192] It should be noted that the present application does not limit the shape of the target area 190. Fig. 10A and Fig. 10B In the figure, a rectangle is used as an example for illustration. In practical applications, the target area 190 may be any other shape, such as a circle, a triangle, a pentagon, a hexagon, a ring, a hollow shape, etc. It may also be any other irregular shape, or it may be an area surrounded by a three-dimensional space.

[0193] Since Scheme 3 designs the positions of the first sound sensor 120-1 and the second sound sensor 120-2 based on the feedback sound energy at each position in the target area 190, that is, the first sound sensor 120-1 is set at the position where the corresponding feedback sound energy is the smallest in the target area 190, and the second sound sensor 120-2 is set at the position where the corresponding feedback sound energy is the largest in the target area 190, therefore, Scheme 3 does not have high requirements for the positional relationship between the components in the acoustic system 20 (for example, it is not required that the first sound sensor 120-1 must be far away from the speaker 110, and the second sound sensor 120-2 must be close to the speaker 110, etc.). Scheme 3 can be applicable to scenarios where the positions of the components are not pre-specified, and allows the selection and determination of the positions of the components in a certain candidate area. In some embodiments, Scheme 3 can also be combined with one or more designs in Scheme 1 and Scheme 2 described above.

[0194] Fig.11 FIG. 1 is a schematic diagram showing the test results of the acoustic system in terms of adaptive filtering performance according to an embodiment of the present specification. Fig.11 , in the case where the speaker 110 in the acoustic system 20 has a limiting characteristic, when using Figure 2 When the AFC-based adaptive filtering scheme is used, the calculated offset (MIS) is shown in curve A. Figure 4 When the AFC-based adaptive filtering scheme is used, the calculated offset (MIS) is shown in curve B. Fig.11 In the figure, curve B decreases faster than curve A in the initial period (about 0.2 seconds ago), and maintains a faster average downward trend after the turning point (about 0.2 seconds later). In other words, curve B is below curve A in all the time periods shown. Figure 4 The scheme's misalignment MIS has always been lower than Figure 2 The plan, that is Figure 4 The scheme is superior to the adaptive filtering algorithm in terms of convergence degree and convergence speed. Figure 2 Scheme. Fig.11 It can be seen that the use of Figure 4 The scheme shown has significantly improved the convergence degree and convergence speed of the adaptive filtering algorithm.

[0195] In summary, the acoustic system 20 provided in this specification includes: a speaker 110, a first sound sensor 120-1, a second sound sensor 120-2 and a signal processing circuit 150. The speaker 110 receives a driving signal and converts it into a first sound when it is working; the first sound sensor 120-1 collects ambient sound and generates a first signal when it is working, and the ambient sound includes the first sound and the second sound from the target sound source; the second sound sensor 120-2 collects ambient sound and generates a second signal when it is working, and the first signal and the second signal meet k 2 ≥2k 1 , where k 1 is the ratio of the signal energy corresponding to the first sound to the signal energy corresponding to the second sound in the first signal, k 2The signal processing circuit 150 is connected to the first sound sensor 120-1 and the second sound sensor 120-2 respectively, and when working, the signal component corresponding to the first sound in the first signal is reduced based on the second signal to obtain the target signal, and the target operation is performed on the target signal. It can be seen that the acoustic system 20 provided in this specification can reduce or eliminate the feedback component in the target signal, thereby avoiding problems such as howling caused by feedback sound, and can also improve the maximum forward gain that the acoustic system 20 can achieve.

[0196] The above is a description of a specific embodiment of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require a specific order or a continuous order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0197] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented only by way of example and may not be limiting. Although not explicitly stated herein, those skilled in the art will appreciate that this specification requires various reasonable changes, improvements and modifications to the embodiments. These changes, improvements and modifications are intended to be proposed by this specification and are within the spirit and scope of the exemplary embodiments of this specification.

[0198] In addition, certain terms in this specification have been used to describe embodiments of this specification. For example, "one embodiment", "an embodiment" and / or "some embodiments" mean that a particular feature, structure or characteristic described in conjunction with the embodiment may be included in at least one embodiment of this specification. Therefore, it can be emphasized and should be understood that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various parts of this specification do not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics may be appropriately combined in one or more embodiments of this specification.

[0199] It should be understood that in the foregoing description of the embodiments of this specification, in order to help understand a feature and for the purpose of simplifying this specification, this specification combines various features in a single embodiment, figure or its description. However, this does not mean that the combination of these features is necessary. When reading this specification, it is entirely possible for a person skilled in the art to mark out some of the devices as separate embodiments. In other words, the embodiments in this specification can also be understood as the integration of multiple secondary embodiments. This is also true when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.

[0200] Each patent, patent application, patent application publication, and other material, such as articles, books, specifications, publications, documents, articles, etc., cited herein, except any historical prosecution documents to which it is relevant, any equivalent that may be inconsistent or conflicting with this document, or any equivalent historical prosecution documents that may have a limiting effect on the broadest scope of the claims, may be incorporated herein by reference and used for all purposes now or hereafter associated with this document. In addition, in the event of any inconsistency or conflict between the descriptions, definitions, and / or use of terms associated with any of the incorporated materials and the terminology, descriptions, definitions, and / or use associated with this document, the terminology in this document shall control.

[0201] Finally, it should be understood that the embodiments of the application disclosed herein are explanations of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are only used as examples and not as limitations. Those skilled in the art can adopt alternative configurations according to the embodiments in this specification to implement the applications in this specification. Therefore, the embodiments of this specification are not limited to the embodiments accurately described in the application.

Claims

1. An acoustic system, characterized in that: include: The loudspeaker receives the driving signal and converts it into a first sound when in operation; a first sound sensor, which collects ambient sound and generates a first signal when in operation, wherein the ambient sound includes the first sound and a second sound from a target sound source, and the target sound source includes other sound sources except the speaker; The second sound sensor collects the environmental sound and generates a second signal when in operation, wherein the first signal and the second signal satisfy k2≥2k1, wherein k1 is the ratio of the signal energy corresponding to the first sound to the signal energy corresponding to the second sound in the first signal, and k k is the ratio of the signal energy corresponding to the first sound to the signal energy corresponding to the second sound in the second signal; as well as The signal processing circuit is connected to the first sound sensor and the second sound sensor respectively, and when in operation: Based on the second signal, a signal component corresponding to the first sound in the first signal is reduced to obtain a target signal, and A target operation is performed on the target signal.

2. The acoustic system according to claim 1, characterized in that In order to satisfy k2≥2k1, the first signal and the second signal satisfy at least one of the following conditions: A ratio of a signal energy in the second signal corresponding to the first sound to a signal energy in the second signal corresponding to the second sound is greater than or equal to 2; a ratio of a signal energy in the second signal corresponding to the first sound to a signal energy in the first signal corresponding to the first sound is greater than or equal to 2; as well as A ratio of a signal energy in the first signal corresponding to the second sound to a signal energy in the first signal corresponding to the first sound is greater than or equal to 2.

3. The acoustic system according to claim 1, characterized in that The positional relationship among the first sound sensor, the second sound sensor, and the speaker meets a preset condition, so that the first signal and the second signal satisfy k2≥2k1.

4. The acoustic system according to claim 3, characterized in that The preset condition includes: L1≥2L2, wherein L2 is the distance between the second sound sensor and the speaker, and L1 is the distance between the first sound sensor and the speaker.

5. The acoustic system according to claim 3, characterized in that The acoustic system further includes a shell, a partial area of ​​which forms an acoustic cavity, the speaker and the second sound sensor are both located inside the acoustic cavity, and the first sound sensor is located outside the acoustic cavity.

6. The acoustic system according to claim 5, characterized in that The sound-generating component of the speaker divides the acoustic cavity into a first acoustic cavity and a second acoustic cavity, and the sound-generating surface of the sound-generating component faces the first acoustic cavity, wherein The second sound sensor is located inside the first acoustic cavity, or The second sound sensor is located inside the second acoustic cavity.

7. The acoustic system according to claim 5, characterized in that The second sound sensor is coupled to the sound-generating component of the speaker.

8. The acoustic system according to claim 3, characterized in that The acoustic system further includes a housing, a sound pickup surface of the second sound sensor and a sound pickup surface of the first sound sensor are both located in a free space outside the housing, and the second sound sensor is closer to the speaker than the first sound sensor.

9. The acoustic system according to claim 3, characterized in that The acoustic system also includes a shell, a partial area of ​​which is formed with a first acoustic cavity and a second acoustic cavity, the speaker is located in the first acoustic cavity, the second sound sensor is located in the second acoustic cavity, and the second sound sensor is closer to the speaker than the first sound sensor.

10. The acoustic system according to claim 3, characterized in that The acoustic system further comprises a shell, a sound pickup surface of the first sound sensor is located in a free space outside the shell, a sound pickup surface of the second sound sensor is located in an internal space of the shell, and the second sound sensor is closer to the speaker than the first sound sensor.

11. The acoustic system according to claim 3, characterized in that The acoustic system further comprises a first shell and a second shell, wherein: The second shell is located inside the first shell, and the second shell forms an acoustic cavity, and the speaker and the second sound sensor are located inside the acoustic cavity.

12. The acoustic system according to claim 3, characterized in that The acoustic system further includes a baffle, the second sound sensor and the speaker are located on a first side of the baffle, and the first sound sensor is located on a second side of the baffle.

13. The acoustic system according to claim 1, characterized in that The sound pickup directivities of the first sound sensor and the second sound sensor meet a preset condition, so that the first signal and the second signal satisfy k2≥2k1.

14. The acoustic system according to claim 13, characterized in that The sound pickup directivity of the first sound sensor and the second sound sensor satisfies at least one of the following conditions: The first sound sensor has a greater sound pickup sensitivity in the first direction than in the second direction; and The sound pickup sensitivity of the second sound sensor in the first direction is smaller than the sound pickup sensitivity in the second direction, wherein The first direction points to the target sound source, and the second direction points to the speaker.

15. The acoustic system according to claim 1, characterized in that The first sound sensor is located at a first position within the target area, and the second sound sensor is located at a second position within the target area, wherein the first position and the second position satisfy at least one of the following conditions: The sound energy from the speaker at the first position is less than the sound energy from the speaker at other positions within the target area except the first position; and The sound energy from the speaker at the second position is greater than the sound energy from the speaker at other positions within the target area except the second position.

16. The acoustic system according to claim 1, characterized in that In order to obtain the target signal, the signal processing circuit: An adaptive filtering operation is performed on the second signal to obtain a third signal, and the third signal is subtracted from the first signal to obtain the target signal.

17. The acoustic system according to claim 16, characterized in that The signal processing circuit also: A filtering parameter corresponding to the adaptive filtering operation is updated based on at least one of the second signal and the target signal.

18. The acoustic system according to claim 1, characterized in that In order to obtain the target signal, the signal processing circuit: Performing a first preprocessing operation on the first signal to obtain a first intermediate signal; Performing a second preprocessing operation on the second signal to obtain a second intermediate signal; as well as Based on the second intermediate signal, a signal component corresponding to the first sound in the first intermediate signal is reduced to obtain the target signal.

19. The acoustic system according to claim 18, characterized in that The first preprocessing operation includes at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation; and The second preprocessing operation includes at least one of a gain amplification operation, a filtering operation, a frequency response compensation operation, and a phase modification operation.

20. The acoustic system according to claim 1, characterized in that The signal processing circuit is also connected to the speaker. When performing the target operation, the signal processing circuit: amplifying the target signal, and The gain-amplified signal is sent to the speaker to drive the speaker to produce sound.

Citation Information

Patent Citations

  • Loop gain estimating apparatus and howling preventing apparatus

    CN102165792A

  • Self-adaptive acoustic-feedback-eliminating method

    CN103475980A

  • Acoustic echo cancelling system and method

    US20180130482A1

  • Transitioning between arrayed and in-phase speaker configurations for active noise reduction

    US9508336B1