Acoustic system and signal processing method
By setting reference signal pickup points and peripheral circuits in the acoustic system, and combining them with adaptive filtering technology, the problems of howling and gain limitation caused by acoustic feedback were solved, and feedback components were effectively eliminated and gain was improved.
Patent Information
- Application Number
- CN202310604924.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-25
- Publication Date
- 2024-11-26
AI Technical Summary
Acoustic feedback problems exist in acoustic systems, causing howling and limiting maximum forward gain. Existing technologies are unable to effectively eliminate feedback components.
A reference signal pickup point is set in the acoustic system, a reference signal is obtained through the first peripheral circuit, and an adaptive filtering technique is applied in the signal processing circuit to reduce the feedback component. The signal is then converted into an appropriate reference signal using the second peripheral circuit to achieve feedback elimination.
It effectively reduces or eliminates feedback sounds in acoustic systems, avoids howling, increases maximum forward gain, adapts to access restrictions between different units, and improves the convergence performance of adaptive filtering algorithms.
Smart Images

Figure CN119031308A_ABST
Abstract
Description
Technical Field
[0001] The present specification relates to the field of acoustic technology, and in particular to an acoustic system and a signal processing method. Background Art
[0002] Some acoustic systems include both a speaker and a sound sensor. These acoustic systems usually have the problem of acoustic feedback. Among them, acoustic feedback means that the sound sensor collects the environment to obtain a sound pickup signal, and the sound pickup signal is played through the speaker after a certain processing, and the sound emitted by the speaker is re-collected by the sound sensor, so that the acoustic system forms a closed loop of "speaker->sound sensor->speaker". In the above acoustic system, the sound from the speaker picked up by the sound sensor can be called feedback sound. The existence of feedback sound causes some problems in the acoustic system. For example, it causes problems such as howling in the acoustic system, and may also limit the maximum forward gain that the acoustic system can achieve. Therefore, it is necessary to provide an acoustic solution that can reduce or eliminate feedback components. Summary of the invention
[0003] The present specification provides an acoustic system and a signal processing method, which can reduce or eliminate feedback sound, thereby avoiding problems such as howling in the acoustic system, and further improving the maximum forward gain that can be achieved by the acoustic system.
[0004] In the first aspect, the present specification provides an acoustic system, including: a speaker, a pickup assembly, a signal processing circuit, a first peripheral circuit, and a second peripheral circuit. The speaker converts a driving signal into a first sound when in operation; the pickup assembly converts an ambient sound into a first audio signal when in operation, and the ambient sound includes the first sound and a second sound from a target sound source; the signal processing circuit is connected to the pickup assembly; the first peripheral circuit includes an input port and an output port, the output port is connected to the speaker, and there is a reference signal pickup point in the first peripheral circuit; the second peripheral circuit connects the reference signal pickup point with the signal processing circuit, wherein the first peripheral circuit obtains a second audio signal through the input port when in operation, converts the second audio signal into the driving signal, and sends the driving signal to the speaker through the output port, the second peripheral circuit obtains a first reference signal from the reference signal pickup point when in operation, and outputs a second reference signal to the signal processing circuit, and the signal processing circuit reduces the signal component corresponding to the first sound in the first audio signal based on the second reference signal when in operation to obtain a target signal, and performs a target operation on the target signal.
[0005] In some embodiments, the type of the first reference signal includes at least one of an analog signal, a pulse width modulation PWM signal, a pulse density modulation PDM signal, a pulse code modulation PCM signal, an integrated circuit built-in audio I2S signal, or a time division multiplexing TDM signal.
[0006] In some embodiments, the reference signal pickup point is located at the input port; or, the reference signal pickup point is located at the output port.
[0007] In some embodiments, the first peripheral circuit also includes a first processing component, which is connected to the signal processing circuit through the input port, obtains the second audio signal from the signal processing circuit during operation, and performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the second audio signal; and the reference signal pickup point is located between the first processing component and the output port.
[0008] In some embodiments, the first peripheral circuit further includes a second processing component connecting the first processing component and the output port, wherein the reference signal pickup point is located between the first processing component and the second processing component, or the reference signal pickup point is located between the second processing component and the output port, or the second processing component includes a plurality of circuit elements, and the reference signal pickup point is located between any two circuit elements among the plurality of circuit elements.
[0009] In some embodiments, the second audio signal is derived from the target signal.
[0010] In some embodiments, the second audio signal includes a first signal component and a second signal component, wherein the first signal component comes from the target signal, and the second signal component comes from a target audio component, and the target audio component is different from the pickup component.
[0011] In some embodiments, the input port includes K branch ports, where K is an integer greater than 1; the second audio signal includes K branch audio signals; and the first peripheral circuit obtains the K branch audio signals through the K input ports and converts the K branch audio signals into the driving signal.
[0012] In some embodiments, the first peripheral circuit also includes a third processing component, which performs at least one of digital-to-analog conversion, modulation, filtering, and mixing operations on the K branch audio signals during operation; and the reference signal pickup point is located between the third processing component and the output port.
[0013] In some embodiments, the first peripheral circuit also includes: K branch processing components, which are respectively connected to the K branch ports, wherein the i-th branch processing component performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the i-th branch audio signal when running to obtain the i-th intermediate audio signal; and a first mixing component, which is respectively connected to the K third processing components and performs a mixing operation on the K intermediate audio signals when running; and the reference signal pickup point is located between the first mixing component and the output port.
[0014] In some embodiments, the first peripheral circuit also includes: a second mixing component, which is respectively connected to the K branch ports, and performs a mixing operation on the K branch audio signals to obtain a mixed audio signal during operation; and a fourth processing component, which is connected to the second mixing component and performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the mixed audio signal during operation; and the reference signal pickup point is located between the second mixing component and the fourth processing component, or the reference signal pickup point is located between the fourth processing component and the output port.
[0015] In some embodiments, the branch audio signals obtained by the first peripheral circuit through the K branch ports all come from the target signal.
[0016] In some embodiments, the K branch ports include a first part of branch ports and a second part of branch ports, wherein the branch audio signal obtained by the first peripheral circuit through the first part of branch ports comes from the target signal, and the branch audio signal obtained by the first peripheral circuit through the second part of branch ports comes from the target audio component, and the target audio component is different from the pickup component.
[0017] In some embodiments, when the second peripheral circuit is running, it performs at least one of analog-to-digital conversion operation, demodulation operation, filtering operation, and gain operation on the first reference signal to obtain the second reference signal.
[0018] In some embodiments, in order to obtain the target signal, the signal processing circuit: performs an adaptive filtering operation on the second reference signal to obtain a filtered signal; and subtracts the filtered signal from the first audio signal to obtain the target signal.
[0019] In some embodiments, the signal processing circuit further updates filtering parameters corresponding to the adaptive filtering operation based on at least one of the target signal and the second reference signal.
[0020] In some embodiments, when executing the target operation, the signal processing circuit: performs a gain amplification operation on the target signal to obtain an amplified signal; and sends the amplified signal to the first peripheral circuit.
[0021] In some embodiments, the sound pickup component includes a sound sensor and a third peripheral circuit, wherein the sound sensor converts the ambient sound into a sound pickup signal when in operation, and the third peripheral circuit converts the sound pickup signal into the first audio signal when in operation.
[0022] In some embodiments, the signal processing circuit includes: at least one storage medium and at least one processor, wherein the at least one storage medium stores at least one instruction set for signal processing; the at least one processor is communicatively connected to the first peripheral circuit, the second peripheral circuit, the pickup assembly and the at least one storage medium, wherein when the acoustic system is running, the at least one processor reads the at least one instruction set and executes according to the instructions of the at least one instruction set: based on the second reference signal, the signal component corresponding to the first sound in the first audio signal is reduced to obtain a target signal, and the target operation is performed on the target signal.
[0023] In a second aspect, the present specification also provides a signal processing method, comprising: obtaining a first audio signal through a signal processing circuit in an acoustic system, wherein the first audio signal is obtained by converting ambient sound by a sound pickup component in the acoustic system, and the ambient sound includes a first sound and a second sound, wherein the first sound is a sound from a loudspeaker in the acoustic system, and the second sound is a sound from a target sound source; obtaining a second reference signal, wherein the second reference signal is obtained by a second peripheral circuit in the acoustic system based on the first reference signal, wherein the first reference signal is obtained by the second peripheral circuit from a reference signal pickup point of a first peripheral circuit in the acoustic system, and the first peripheral circuit is connected to the signal processor and the loudspeaker; based on the second reference signal, reducing the signal component corresponding to the first sound in the first audio signal to obtain a target signal; and performing a target operation on the target signal.
[0024] In some embodiments, the type of the first reference signal includes at least one of an analog signal, a pulse width modulation PWM signal, a pulse density modulation PDM signal, a pulse code modulation PCM signal, an integrated circuit built-in audio I2S signal, or a time division multiplexing TDM signal.
[0025] In some embodiments, based on the second reference signal, the signal component corresponding to the first sound in the first audio signal is reduced to obtain a target signal, including: performing an adaptive filtering operation on the second reference signal to obtain a filtered signal; and subtracting the filtered signal from the first audio signal to obtain the target signal.
[0026] In some embodiments, the method further includes: updating a filtering parameter corresponding to the adaptive filtering operation based on at least one of the target signal and the second reference signal.
[0027] It can be seen from the above technical solutions that in the acoustic system and signal processing method provided in this specification, the sound pickup component in the acoustic system converts the ambient sound into a first audio signal, the ambient sound includes a first sound from a speaker and a second sound from a target sound source, the first peripheral circuit connects the signal processing circuit and the speaker, and there is a reference signal pickup point in the first peripheral circuit, the second peripheral circuit connects the reference signal pickup point and the signal processing circuit, obtains a first reference signal from the reference signal pickup point during operation, and outputs a second reference signal to the signal processing circuit, so that the signal processing circuit reduces the component corresponding to the first sound in the first audio signal based on the second reference signal to obtain a target signal. Since the feedback component in the target signal is reduced or eliminated, it is possible to avoid or suppress the acoustic system from generating howling, and it is also helpful to improve the maximum forward gain that the acoustic system can achieve.
[0028] Other functions of the acoustic system and signal processing method provided in this specification will be partially listed in the following description. The creative aspects of the acoustic system and signal processing method provided in this specification can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0030] Figure 1 A schematic diagram of an application scenario provided according to an embodiment of this specification is shown;
[0031] Figure 2 A schematic diagram showing the principle of feedback sound elimination based on AFC technology;
[0032] FIG. 3A to FIG. 3CSeveral schematic diagrams of acoustic systems provided according to embodiments of this specification are shown;
[0033] FIG. 4A to FIG. 4C Several schematic diagrams showing the positions of reference signal pickup points in an acoustic system are shown;
[0034] FIG. 5A to FIG. 5C A schematic diagram showing the connection of K branch ports of the first peripheral circuit in the acoustic system is shown;
[0035] FIG. 6A to FIG. 6D Several other schematic diagrams of the positions of the reference signal pickup point in the acoustic system are shown;
[0036] Figure 7 The test results of the acoustic system provided in the embodiment of this specification in terms of filtering performance are shown;
[0037] Figure 8 A schematic diagram of a hardware structure of an acoustic system provided according to an embodiment of this specification is shown; and
[0038] Fig. 9 A flow chart of a signal processing method provided according to an embodiment of this specification is shown. DETAILED DESCRIPTION
[0039] The following description provides specific application scenarios and requirements of this specification, with the purpose of enabling those skilled in the art to make and use the contents of this specification. Various local modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but to the widest scope consistent with the claims.
[0040] The terms used herein are only used for the purpose of describing specific example embodiments and are not restrictive. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a", "an" and "the" may also include plural forms. When used in this specification, the terms "include", "comprise" and / or "contain" mean that the associated integers, steps, operations, elements and / or components exist, but do not exclude the existence of one or more other features, integers, steps, operations, elements, components and / or groups or that other features, integers, steps, operations, elements, components and / or groups may be added in the system / method.
[0041] In view of the following description, these and other features of the present specification, as well as the operation and function of the related elements of the structure, and the economy of the combination and manufacture of the parts can be significantly improved. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.
[0042] The flowcharts used in this specification illustrate the operations implemented by the system according to some embodiments in this specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. On the contrary, the operations may be implemented in reverse order or simultaneously. In addition, one or more other operations may be added to the flowchart. One or more operations may be removed from the flowchart.
[0043] Before describing the specific embodiments of this specification, the application scenarios of this specification are first introduced as follows. The solution provided in this specification can be applied to scenarios where feedback sound needs to be reduced or eliminated. Figure 1 Give an example.
[0044] Figure 1 FIG. 1 is a schematic diagram showing an application scenario provided according to an embodiment of this specification. Figure 1 As shown, application scenario 001 can be a sound amplification scenario, a hearing aid scenario, an auxiliary listening scenario, etc. In this scenario, the acoustic system may include a speaker 110 and a sound sensor 120. The sound sensor 120 collects environmental sounds when working. In this specification, environmental sounds refer to sounds in the environment, that is, environmental sounds may include sounds emitted by all sound sources in the environment. During the sound pickup process of the sound sensor 120, if the speaker 110 and the target sound source 160 are both emitting sounds, the environmental sounds collected by the sound sensor 120 include both sounds from the target sound source 160 and sounds from the speaker 110. Furthermore, the signal collected by the sound sensor 120 is sent to the speaker 110 after forward gain amplification (G) to drive the speaker 110 to emit sound. In this way, a closed loop of "speaker->sound sensor->speaker" is formed in the acoustic system. In this case, when a sound signal of a certain frequency undergoes self-excited oscillation, a howling phenomenon will occur. Such howling will make the user feel uncomfortable, and when the howling is severe, it may also cause damage to the components in the acoustic system. In addition, the existence of the howling also brings limitations to the forward gain amplification factor of the acoustic system, thereby restricting the maximum forward gain that the acoustic system can achieve.
[0045] It should be noted that the above Figure 1The application scenarios shown are only some of the multiple application scenarios applicable to this application. The acoustic system provided by this application can also be applied to other similar scenarios, which are not listed one by one in this specification. Those skilled in the art should understand that the application of the solution provided by this application to other usage scenarios is also within the scope of protection of this application.
[0046] In summary, the presence of feedback sound can cause a series of problems in the acoustic system, including but not limited to: generating howling, restricting the maximum forward gain that the acoustic system can achieve, etc.
[0047] In some embodiments, the acoustic system can use acoustic feedback cancellation (AFC) technology to reduce or eliminate feedback sound. Figure 2 The principle of AFC technology is introduced.
[0048] Figure 2 FIG. 2 shows a schematic diagram of the principle of feedback sound elimination based on AFC technology. Figure 2 As shown, the acoustic system may include a sound producing component 10 , a sound pickup component 20 and a signal processing circuit 150 .
[0049] The sound generating component 10 is a component with a sound generating function. The sound generating component 10 can be connected to the output end of the signal processing circuit 150, and when working, receives the second audio signal u from the signal processing circuit 150 and converts it into sound to play. Figure 2 , the pronunciation component 10 may include a speaker 110 and a first peripheral circuit 130 (the first peripheral circuit is represented by C1 in the figure). Among them, the speaker 110 is a device for converting an electrical signal into sound, and can also be called an electroacoustic converter. For example, the speaker 110 can be a speaker. The first peripheral circuit 130 is connected between the output end of the signal processing circuit 150 and the speaker 110. The first peripheral circuit 130 may refer to all circuits or part of the circuits between the output end of the signal processing circuit 150 and the speaker 110. The first peripheral circuit 130 can perform some processing on the electrical signal (i.e., the second audio signal u) output by the signal processing circuit 150, so that the processed electrical signal is suitable for the speaker 110 to play. For the convenience of description, the electrical signal processed by the first peripheral circuit 130 is referred to as the driving signal u″′ in the following text. The first peripheral circuit 130 may include at least one circuit element, and the at least one circuit element includes but is not limited to operational amplifier devices, power amplifier devices, digital-to-analog converter devices, filter devices, modulation devices, demodulation devices, capacitors, resistors, inductors, chips and other devices.
[0050] It should be noted that the speaker 110 can be a device that produces sound based on at least one conduction method among gas, liquid, and solid, and the embodiments of this specification do not limit this. The speaker 110 can be a speaker itself, or it can include a speaker and simple circuit elements attached thereto. The number of speakers 110 can be one or more. When the number of speakers 110 is multiple, the multiple speakers 110 can be arranged in an array. In addition, when the number of speakers 110 is multiple, the multiple speakers 110 can be connected to the signal processing circuit 150 through the same first peripheral circuit 130, or the multiple speakers 110 can be connected to the signal processing circuit 150 through different first peripheral circuits 130.
[0051] The sound pickup component 20 is a component with a sound pickup function. The sound pickup component 20 can be connected to the input end of the signal processing circuit 150, pick up the ambient sound to generate the first audio signal y when working, and send the first audio signal y to the signal processing circuit 150. Figure 2 , the sound pickup component 20 may include a sound sensor 120 and a third peripheral circuit 140 (the third peripheral circuit is represented by C3 in the accompanying drawings). The sound sensor 120 is a device for picking up ambient sound and converting the ambient sound into an electrical signal, and may also be referred to as an acoustic-to-electrical converter. For example, the sound sensor 120 may be a microphone (MIC). For ease of description, the electrical signal obtained by the sound sensor 120 collecting ambient sound and converting it is referred to as a picked-up signal y′. The third peripheral circuit 140 is connected between the sound sensor 120 and the input end of the signal processing circuit 150. The third peripheral circuit 140 may refer to all circuits or part of the circuits between the sound sensor 120 and the input end of the signal processing circuit 150. The third peripheral circuit 140 may perform some processing on the electrical signal (i.e., the picked-up signal y′) picked up by the sound sensor 120, convert it into a first audio signal y, and send the first audio signal y to the signal processing circuit 150. The third peripheral circuit 140 may include at least one circuit element, and the at least one circuit element may include but is not limited to a power amplifier device, an operational amplifier device, an analog-to-digital converter device, a filter device, a modulation device, a demodulation device, a capacitor, a resistor, an inductor, a chip and other devices.
[0052] It should be noted that the sound sensor 120 can be a device that picks up sound based on at least one conductive method among gas, liquid, and solid, and this specification does not limit this. The sound sensor 120 can be the MIC itself, or it can include the MIC and its accompanying simple circuit elements. The number of sound sensors 120 can be one or more. When the number of sound sensors 120 is multiple, the multiple sound sensors 120 can be arranged in an array. In addition, when the number of sound sensors 120 is multiple, the multiple sound sensors 120 can be connected to the signal processing circuit 150 through the same third peripheral circuit 140, or the multiple sound sensors 120 can also be connected to the signal processing circuit 150 through different third peripheral circuits 140.
[0053] Continue to see Figure 2 , the working process of the acoustic system is as follows: the pronunciation component 10 receives the second audio signal u from the signal processing circuit 150 and converts it into a first sound. The target sound source 160 emits a second sound. The target sound source 160 may refer to other sound sources in the environment except the pronunciation component 10. For example, the target sound source 160 may include an electronic device with a sound playback function (such as a TV, a speaker, a mobile phone, etc.); for another example, the target sound source 160 may also include a human throat. The sound pickup component 20 collects environmental sounds and converts the environmental sounds into a first audio signal y. Among them, the environmental sounds include a first sound from the pronunciation component 10 and a second sound from the target sound source 160. Therefore, the first audio signal y simultaneously includes a signal component x corresponding to the first sound and a signal component v corresponding to the second sound. The sound pickup component 20 sends the first audio signal y to the signal processing circuit 150.
[0054] The signal processing circuit 150 may be a circuit with certain signal processing capabilities. The input end of the signal processing circuit 150 is connected to the sound pickup component 20, and the output end is connected to the sound producing component 10. The signal processing circuit 150 may obtain a first audio signal y from the sound pickup component 20, and use the AFC technology to perform a preset signal processing process on the first audio signal y to obtain a second audio signal u (i.e., a new second audio signal u, or a second audio signal u at the next moment). Furthermore, the signal processing circuit 150 sends the second audio signal u to the sound producing component 10 to drive the sound producing component 10 to produce sound. Figure 2 The signal processing flow involved in the AFC technology is described in detail.
[0055] Continue to see Figure 2In order to reduce or eliminate the feedback component in the acoustic system, the signal processing circuit 150 may include an acoustic feedback cancellation unit 151. The input of the acoustic feedback cancellation unit 151 includes: a first audio signal y and a second audio signal u. For example, the acoustic feedback cancellation unit 151 may obtain the second audio signal u from other processing units inside the signal processing circuit 150, and obtain the first audio signal y from the pickup assembly 20. The acoustic feedback cancellation unit 151 may reduce the signal component (i.e., feedback component) corresponding to the first sound in the first audio signal y based on the second audio signal u, thereby obtaining a signal e.
[0056] Specifically, the principle of the above reduction is as follows: the acoustic feedback cancellation unit 151 can solve and adaptively update a time-varying transfer function F' to fit the transfer function F corresponding to the feedback path (i.e., the transfer path of the feedback sound). In order to distinguish, the transfer function F' obtained by solving is referred to as the predicted transfer function F', and the transfer function F corresponding to the feedback path is referred to as the real transfer function F. Figure 2 , the acoustic feedback cancellation unit 151 uses the prediction transfer function F' to perform an adaptive filtering operation on the second audio signal u to obtain a signal x', that is, x'=u*F'. The signal x' can be regarded as a predicted value of the feedback component in the first audio signal y (that is, the signal component corresponding to the first sound in the first audio signal y). Furthermore, the acoustic feedback cancellation unit 151 can subtract the signal x' from the first audio signal y to obtain a signal e, that is, e=y-x'. The signal e obtained in this way does not contain or contains less feedback components.
[0057] It should be noted that the acoustic feedback cancellation unit 151 can adopt a variety of adaptive filtering algorithms when solving the predicted transfer function F', for example, it can adopt one or more of the least mean square (Least Mean Square, LMS), normalized least mean square (Normalized Least Mean Square, NLMS), recursive least squares (Recursive least squares, RLS), other adaptive filtering algorithms, and any derivative algorithms of the above-mentioned algorithms, etc., which are not limited in this specification. In addition, the adaptive filtering algorithm can be adaptive filtering in the time domain, frequency domain or other transform domains.
[0058] Continue to see Figure 2 The signal processing circuit 150 may further include a gain amplification unit 152. The gain amplification unit 152 may perform a gain amplification operation on the signal e to obtain an amplified signal. Further, the signal processing circuit 150 sends the amplified signal as a second audio signal u (i.e., a new second audio signal u, or a second audio signal u at the next moment) to the sound generating component 10 to drive the sound generating component 10 to generate sound.
[0059] According to the theory of adaptive filtering algorithm, the update method of the predicted transfer function F′ can be achieved by minimizing the expectation of the mean square function of the signal e, that is:
[0060] min F′ E[e 2 ]=min F′ E[(yu*F′) 2 ] Formula (1-1)
[0061] For example, taking the acoustic feedback cancellation unit 151 using the LMS algorithm as an example, the above formula (1-1) is derived based on the gradient descent optimization method, and the update formula of the predicted transfer function F′ can be obtained as follows:
[0062] F′←F′+μ*e*u formula (2-1)
[0063] Among them, μ is the iteration step size.
[0064] It should be understood that when the acoustic feedback cancellation unit 151 adopts algorithms such as NLMS, RLS, etc., a similar method can be used to derive an update formula for the predicted transfer function F′, which will not be explained one by one in this specification.
[0065] In summary, Figure 2 The acoustic system shown executes an AFC algorithm based on the first audio signal y and the second audio signal u, which can reduce or eliminate the feedback component in the first audio signal y, thereby avoiding problems such as howling caused by the feedback component and helping to improve the maximum forward gain that the acoustic system can achieve.
[0066] According to signal processing theory, Figure 2 The closed-loop gain A of the acoustic system shown can be expressed as follows:
[0067]
[0068] According to the Nyquist stability criterion, the requirement for the acoustic system to offset the feedback component is that the predicted transfer function F' solved is completely equal to the true transfer function F, that is, F' = F. When the above requirements are met, the acoustic system will always be stable and will not produce howling. In addition, the acoustic system at this time can achieve infinite gain, that is, when the forward gain G→∞, A=G→∞.
[0069] However, in an actual acoustic system, since the real transfer function F may be time-varying and the convergence process of the iterative solution may oscillate, it is difficult for the iterative process of F' to reach the ideal condition F'=F. In other words, there is a certain deviation between the predicted transfer function F' obtained by the actual iteration and the real transfer function F. At this time, in order to keep the acoustic system stable, the forward gain G provided by the gain amplifier unit 152 naturally cannot be infinite. The maximum forward gain that the acoustic system can achieve is:
[0070]
[0071] As can be seen from formula (4), the deviation between the predicted transfer function F′ and the true transfer function F can be used to measure the convergence performance of the adaptive filtering algorithm, and further measure the acoustic system's effect of canceling the feedback component. Specifically, if the deviation between the predicted transfer function F′ and the true transfer function F is smaller, it means that the convergence performance of the adaptive filtering algorithm is better, and thus the acoustic system's effect of canceling the feedback component is better. If the deviation between the predicted transfer function F′ and the true transfer function F is larger, it means that the convergence performance of the adaptive filtering algorithm is worse, and thus the acoustic system's effect of canceling the feedback component is worse.
[0072] In some embodiments, we can also use misalignment (MIS) to measure the convergence performance of the adaptive filtering algorithm. The misalignment MIS can be expressed by the following formula:
[0073]
[0074] The unit of the offset MIS is decibel (dB). When the predicted transfer function F′ is the initial value zero, the offset MIS is 0dB. When the offset MIS is smaller and approaches negative infinity, the deviation between the predicted transfer function F′ and the true transfer function F is smaller, indicating that the convergence performance of the adaptive filtering algorithm is better, and thus the acoustic system has a better effect of canceling the feedback component. When the offset MIS is larger and approaches positive infinity, the deviation between the predicted transfer function F′ and the true transfer function F is larger, indicating that the convergence performance of the adaptive filtering algorithm is worse, and thus the acoustic system has a worse effect of canceling the feedback component.
[0075] It should be noted that the convergence performance of the adaptive filtering algorithm in the present application includes but is not limited to: convergence speed, convergence error, etc. The convergence speed may refer to the fitting speed of the predicted transfer function F′ to the true transfer function F, and the convergence error may refer to the deviation between the predicted transfer function F′ and the true transfer function F when the convergence condition is reached.
[0076] In practical applications, the design architecture of some acoustic systems limits the access rights or communication capabilities between different units. For example, the acoustic feedback cancellation unit 151 cannot obtain the second audio signal u from other units inside the signal processing circuit 150. Therefore, such an acoustic system cannot use AFC technology to reduce or eliminate feedback components.
[0077] In addition, Figure 2 In the feedback component elimination scheme shown, the reason why a time-varying predicted transfer function F′ can be solved by an adaptive filtering algorithm to fit the real transfer function F is based on the following ideal assumption: the feedback paths in the acoustic system are all linear transfers, or in other words, the responses of the feedback paths are all linear responses. However, the actual acoustic system usually cannot meet the above ideal assumptions. In the actual acoustic system, there are usually nonlinear response components in the first peripheral circuit 130. For example, the digital-to-analog conversion device, the filter device, the modulation device, etc. in the first peripheral circuit 130 usually exhibit nonlinear responses.
[0078] Based on the principle of adaptive filtering algorithm, since the acoustic feedback cancellation unit 151 obtains the second audio signal u from other units inside the signal processing circuit 150 (i.e., obtains the second audio signal u at a position before the output end of the signal processing circuit 150), the feedback path of the feedback sound actually includes: the transmission path from the extraction point of the second audio signal u by the acoustic feedback cancellation unit 151 (which can be approximately regarded as the output end of the signal processing circuit 150) to the extraction point of the first audio signal y by the acoustic feedback cancellation unit 151 (which can be approximately regarded as the input end of the signal processing circuit 150). In other words, the transmission effect of the above-mentioned feedback path includes not only the transmission effect of the spatial path between the sound producing component 10 and the sound pickup component 20, but also the transmission effect of the sound producing component 10 itself (i.e., the transmission effect of the first peripheral circuit 130 and the transmission effect of the speaker 110), and the transmission effect of the sound pickup component 20 itself (i.e., the transmission effect of the sound sensor 120 and the transmission effect of the third peripheral circuit 140). Therefore, when Figure 2 When the feedback component cancellation scheme shown is applied to an actual acoustic system, the predicted transfer function F′ actually simulates the overall transfer effect of the feedback path, that is, it simulates the overall transfer effect of the first peripheral circuit 130, the speaker 110, the spatial path between the speaker 110 and the sound sensor 120, the sound sensor 120, and the third peripheral circuit 140.
[0079] Since there are nonlinear response components in the first peripheral circuit 130, the nonlinear response components are inevitably introduced into the iterative solution of the predicted transfer function F′, which will result in low convergence performance of the adaptive filtering algorithm, for example, causing the predicted transfer function F′ to fail to converge, converge slowly, or have a large convergence error. In addition, there may also be cached or delay effects in the first peripheral circuit 130. The above cache or delay effects will cause a certain time offset in the solved predicted transfer function F′. Since the order of the adaptive filtering algorithm is usually limited, especially in an acoustic system with high real-time requirements and insufficient computing resources, the order of the adaptive filtering algorithm is low. Therefore, when the above cache or delay effects are significant, the convergence performance of the adaptive filtering algorithm will also be reduced. Those skilled in the art will understand that when the convergence performance of the adaptive filtering algorithm is low, the offset index MIS of the acoustic system deteriorates, and the offset effect of the feedback component deteriorates.
[0080] In order to solve at least one of the above technical problems, the acoustic system provided in this specification can obtain a second reference signal from the electrical space, and eliminate the feedback component in the first audio signal y based on the second reference signal.
[0081] Figure 3A FIG. 1 shows a schematic diagram of an acoustic system provided according to an embodiment of the present specification. Figure 3A As shown, the acoustic system may include a sound-generating component 10, a sound-collecting component 20, and a signal processing circuit 150. The sound-generating component 10 may include a speaker 110 and a first peripheral circuit 130, the sound-collecting component 20 may include a sound sensor 120 and a third peripheral circuit 140, and the signal processing circuit 150 may include an acoustic feedback cancellation unit 151. When the acoustic system is working, the sound-collecting component 20 picks up the ambient sound, converts the ambient sound into a first audio signal y, and sends the first audio signal y to the signal processing circuit 150. After receiving the first audio signal y, the signal processing circuit 150 processes the first audio signal y using the acoustic feedback cancellation unit 151 to reduce the feedback component in the first audio signal y, thereby obtaining a target signal e.
[0082] Continue to see Figure 3A, the speaker 110 and the signal processing circuit 150 are connected via the first peripheral circuit 130. The first peripheral circuit 130 may include an input port 131 and an output port 132. The input port 131 refers to the port at which the first peripheral circuit 130 is connected to the signal processing circuit 150, and the output port 132 refers to the port at which the first peripheral circuit 130 is connected to the speaker 110. When the first peripheral circuit 130 is in operation, the second audio signal u is obtained through the input port 131, the second audio signal u is converted into a driving signal u″′, and the driving signal u″′ is sent to the speaker 110 through the output port 132 to drive the speaker 110 to make a sound.
[0083] In some embodiments, the second audio signal u obtained by the first peripheral circuit 130 through the input port 131 may come from the target signal e. Among them, "the second audio signal u comes from the target signal e" may include the following two cases. Case 1: the second audio signal u and the target signal e are the same signal; Case 2: the second audio signal u is a signal obtained by performing a preset process on the target signal e. The above preset process may include one or more of gain amplification process, frequency division process, filtering process or other possible processing methods. Figure 3A This illustrates the above situation 2. For example, see Figure 3A , the signal processing circuit 150 may further include a gain amplification unit 152, which may perform a gain amplification operation on the target signal e to obtain a second audio signal u. In this case, the input port 131 of the first peripheral circuit 130 may be connected to the gain amplification unit 152, so that the second audio signal u obtained by the first peripheral circuit 130 through the input port 131 is a signal obtained by performing a gain amplification on the target signal e, that is, the second audio signal u comes from the target signal e.
[0084] Figure 3A In the illustrated acoustic system, all signal components in the second audio signal u come from the target signal e, so that a signal loop is formed among the sound pickup assembly 20, the acoustic feedback cancellation unit 151, the gain amplification unit 152, the first peripheral circuit 130, and the speaker 110. However, in some cases, only part of the signal components in the second audio signal u may come from the target signal e.
[0085] Specifically, the second audio signal u may include a first signal component and a second signal component, wherein the first signal component comes from the target signal e, and the second signal component comes from a target audio component. The target audio component is another component that is different from the pickup component 20 and has an audio output function. The target audio component may be a component integrated into the signal processing circuit 150, or may be a component outside the signal processing circuit 150 (for example, the target audio component may be integrated into other circuits in the acoustic system other than the signal processing circuit 150, or may be another external acoustic device).
[0086] For example, in some embodiments, the target audio component 200 can be a Bluetooth component, which can be integrated inside the signal processing circuit 150 or in other circuit systems. The Bluetooth component can receive Bluetooth audio signals from an external acoustic device. In some embodiments, the target audio component 200 can be a codec component built into the signal processing circuit 150, which can decode the built-in audio to generate a prompt tone. In some embodiments, the target audio component 200 can also be other external components / external devices connected to the acoustic system by wire.
[0087] Figure 3B Another schematic diagram of an acoustic system provided according to an embodiment of this specification is shown. Figure 3B As shown, the signal processing circuit 150 may also include a first audio component 200 (marked as Y1 in the figure). The first audio component 200 may be connected to the gain amplification unit 152. The first audio component 200 may provide a signal n1 to the gain amplification unit 152. In this way, the gain amplification unit 152 may obtain the target signal e from the acoustic feedback cancellation unit 151 on the one hand, and obtain the signal n1 from the first audio component 200 on the other hand. The gain amplification unit 152 may perform gain amplification processing on the target signal e and the signal n1, as well as appropriate mixing and superposition calculations to obtain the second audio signal u. It can be seen that in this case, part of the signal components in the second audio signal u come from the target signal e, and the other part of the signal components come from the first audio component 200.
[0088] Figure 3C FIG. 2 shows another schematic diagram of an acoustic system provided according to an embodiment of the present specification. Figure 3CAs shown, the acoustic system may further include a second audio component 300 (marked as Y2 in the accompanying drawings), and the second audio component 300 is located outside the signal processing circuit 150. The second audio component 300 may be connected to the gain amplification unit 152. The second audio component 300 may provide a signal n2 to the gain amplification unit 152. In this way, the gain amplification unit 152 may obtain the target signal e from the acoustic feedback cancellation unit 151 on the one hand, and may obtain the signal n2 from the second audio component 300 on the other hand. The gain amplification unit 152 may perform gain amplification processing on the target signal e and the signal n2, as well as appropriate mixing and superposition calculations to obtain the second audio signal u. It can be seen that, in this case, part of the signal components in the second audio signal u come from the target signal e, and the other part of the signal components come from the second audio component 300.
[0089] Those skilled in the art will appreciate that, in practical applications, the above Figure 3B and Figure 3C They can be combined with each other. For example, the acoustic system includes both the first audio component 200 and the second audio component 300, both of which are connected to the gain amplification unit 152. The first audio component 200 provides the signal n1 to the gain amplification unit 152, the second audio component 300 provides the signal n2 to the gain amplification unit 152, and the acoustic feedback cancellation unit 151 provides the target signal e to the gain amplification unit 152. In this case, the gain amplification unit 152 performs gain amplification processing on the target signal e, the signal n1 and the signal n2, and performs appropriate mixing and superposition calculations to obtain the second audio signal u. In this case, part of the signal components in the second audio signal u come from the target signal e, part of the signal components come from the first audio component 200, and the other part of the signal components come from the second audio component 300.
[0090] Continue to see FIG. 3A to FIG. 3C , there may be a reference signal collecting point 133 in the first peripheral circuit 130. The signal flowing through the reference signal collecting point 133 in the first peripheral circuit 130 may be referred to as a first reference signal u′.
[0091] In some embodiments, the first reference signal u′ may be a signal that is continuous in time. In some embodiments, the first reference signal u′ may be a signal that is discrete in time. In some embodiments, the first reference signal u′ may be a signal modulated by one or more modulation techniques. In some embodiments, the first reference signal u′ may be an unmodulated signal. In some embodiments, the first reference signal u′ may be a mono signal. In some embodiments, the first reference signal u′ may be a dual-channel signal. In some embodiments, the first reference signal u′ may be a signal formed by overlapping multi-channel signals. In some embodiments, the first reference signal u′ may be a signal that can directly drive the speaker 110 to make a sound. In some embodiments, the first reference signal u′ may be a signal that cannot directly drive the speaker 110 to make a sound, and can only drive the speaker 110 to make a sound after being modulated.
[0092] For example, the signal type (signal standard / format) of the first reference signal u′ includes at least one of the following (1) to (6).
[0093] (1) Analog signal. An analog signal is a signal represented by a continuously changing physical quantity, whose amplitude, frequency or phase changes continuously with time, or whose characteristic quantity representing information can be presented as any value at any moment within a continuous time interval.
[0094] (2) Pulse width modulation (PWM) signal. PWM signal refers to the signal modulated by pulse width modulation technology. Pulse width modulation modulates the width of a series of pulses to produce the required waveform and digitally encode the analog signal level.
[0095] (3) Pulse Density Modulation (PDM) signal. PDM signal refers to a signal modulated by pulse density modulation technology. Pulse density modulation is a modulation method that uses binary numbers 0 and 1 to represent analog signals. In PDM signals, the amplitude of the analog signal is represented by the density of the area corresponding to the output pulse. For example, in some pulse density modulation methods, there are only 1s and 0s in the data stream corresponding to the PDM signal. The greater the density of 1s, the greater the amplitude of the analog signal corresponding to the area. Conversely, the greater the density of 0s, the smaller the amplitude of the analog signal corresponding to the area.
[0096] (4) Pulse Code Modulation (PCM) signal. PCM refers to a signal modulated using pulse code modulation technology. The process of pulse code modulation is as follows: the analog signal is first sampled at regular intervals to discretize it, and then the discretized sampled values are quantized and encoded to obtain a PCM signal. PCM can be regarded as a mono signal.
[0097] (5) Integrated circuit built-in audio I2S (Inter-IC Sound) signal. I2S signal refers to the signal transmitted based on the I2S bus. I2S signal can be regarded as a signal composed of two-channel PCM signals interleaved.
[0098] (6) Time-division multiplexing (TDM) signal. A TDM signal is a signal obtained by interleaving multiple signals using time-division multiplexing technology. For example, a TMD signal can be a signal obtained by interleaving multi-channel PCM signals using time-division multiplexing technology.
[0099] Among the above signal types, analog signals, PWM signals and some PDM signals can directly drive the speaker 110, while PCM signals, I2S signals, TDM signals and another part of PDM signals cannot directly drive the speaker 110 and need to be demodulated and decoded before driving the speaker 110. Among the above signal types, except for analog signals, the other types (PWM signals, PDM signals, PCM signals, I2S signals, TDM signals) can be regarded as modulated signals.
[0100] Those skilled in the art will appreciate that the signal types listed above are only some possible examples, and with the evolution and development of technology, the signal type of the first reference signal u′ may also be any other possible type.
[0101] It should be noted that the reference signal pickup point 133 may be located at any position in the first peripheral circuit 130, and the embodiments of this specification do not limit this. The position of the reference signal pickup point 133 is described below with reference to several possible implementations.
[0102] In some embodiments, the reference signal pickup point 133 may be located at the input port 131, that is, there is no circuit element between the input port 131 and the reference signal pickup point 133. In this case, the first reference signal u′ at the reference signal pickup point 133 is the same as the second audio signal u.
[0103] In some embodiments, the reference signal pickup point 133 may be located at the output port 132, that is, there is no circuit element between the reference signal pickup point 133 and the output port 132. In this case, the first reference signal u′ at the reference signal pickup point 133 is the same as the drive signal u″′.
[0104] In some embodiments, the reference signal pickup point 133 may be located somewhere between the input port 131 and the output port 132. That is, there is at least one circuit element between the input port 131 and the reference signal pickup point 133, and there is also at least one circuit element between the reference signal pickup point 133 and the output port 132. In other words, the reference signal pickup point 133 may divide the first peripheral circuit 130 into a first circuit portion and a second circuit portion. The first circuit portion refers to a circuit portion located between the input port 131 and the reference signal pickup point 133, and the second circuit portion refers to a circuit portion located between the reference signal pickup point 133 and the output port 132. Neither the first circuit portion nor the second circuit portion is empty. In this case, the first reference signal u′ at the reference signal pickup point 133 is a signal after the first circuit portion performs preset processing on the second audio signal u. The first reference signal u′ is different from the second audio signal u, and the first reference signal u′ is also different from the drive signal u″′.
[0105] For example, see FIG. 3A to FIG. 3C The first peripheral circuit 130 may include a first processing component 134 (labeled as DA in the drawings). The first processing component 134 is connected to the signal processing circuit 150 through the input port 131. When the first processing component 134 is running, it obtains the second audio signal u from the signal processing circuit 150, and performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the second audio signal u.
[0106] The first processing component 134 may include one or more circuit elements, and the embodiments of this specification do not limit this. Some examples are given below. For example, the first processing component 134 may include a circuit element, and the circuit element may perform at least one of the above-mentioned digital-to-analog conversion operation, modulation operation, and filtering operation. For another example, the first processing component 134 may include three circuit elements, wherein the first circuit element performs a digital-to-analog conversion operation, the second circuit element performs a modulation operation, and the third circuit element performs a filtering operation. For another example, the first processing component 134 may include two circuit elements, wherein the first circuit element performs a digital-to-analog conversion operation and a modulation operation, and the second circuit element performs a filtering operation. It should be noted that the above examples are only for ease of understanding and do not limit the embodiments of this specification.
[0107] Continue to see FIG. 3A to FIG. 3CIn the case where the first peripheral circuit 130 includes the first processing component 134, the reference signal pickup point 133 may be located between the first processing component 134 and the output port 132. That is, the reference signal pickup point 133 may be located at any position of the signal path after the first processing component 134.
[0108] In some cases, the first peripheral circuit 130 includes no other components except the first processing component 134. In this case, the reference signal pickup point 133 can be set after the first processing component 134, so that the reference signal pickup point 133 can also be regarded as being located at the output port 132.
[0109] In some other cases, the first peripheral circuit 130 may include a second processing component 135 in addition to the first processing component 134. The second processing component 135 is connected between the first processing component 134 and the output port 132. The second processing component 135 may be configured to perform at least one of a filtering operation, a gain operation, or other possible operations. The second processing component 135 may include one circuit element or multiple circuit elements. FIG. 4A to FIG. 4C The position of the reference signal pickup point 133 in this case is described by way of example.
[0110] FIG. 4A to FIG. 4C Schematic diagrams showing several locations of reference signal pickup points 133 in an acoustic system. Figure 4A , the reference signal pickup point 133 may be located between the first processing component 134 and the second processing component 135. In some embodiments, see Figure 4B , the reference signal pickup point 133 may be located between the second processing component 135 and the output port 132. In some embodiments, when the second processing component 135 includes a plurality of circuit elements, the reference signal pickup point 133 may be located between any two circuit elements of the plurality of circuit elements. Figure 4C Take the second processing component 135 including two circuit elements 135-1 and 135-2 as an example for illustration, see Figure 4C , the reference signal pickup point 133 may be located between the circuit element 135-1 and the circuit element 135-2. It should be noted that, FIG. 4A to FIG. 4C These are just some possible examples, except FIG. 4A to FIG. 4C In addition, the position of the reference signal pickup point 133 may also be set in other ways. Those skilled in the art will understand that FIG. 4A to FIG. 4C The reference signal pickup point location scheme shown can be applied to Figure 3A The acoustic system shown can also be applied to Figure 3B The acoustic system shown can also be applied to Figure 3CIn the acoustic system shown.
[0111] FIG. 3A to FIG. 3C The acoustic system shown is described by taking the example that the first peripheral circuit 130 includes only one input port 131 . In some cases, the first peripheral circuit 130 may include multiple input ports, each of which may be used to receive a signal source for driving the speaker 110 .
[0112] For ease of description, it is assumed that the input port 131 of the first peripheral circuit 130 includes K branch ports, namely 131-1, 131-2, ..., 131-K. K is an integer greater than 1. In this case, the first peripheral circuit 130 can obtain the branch audio signal u1 through the branch port 131-1, obtain the branch audio signal u2 through the branch port 131-2, and so on, obtain the branch audio signal u1 through the branch port 131-K. K In this case, the first peripheral circuit 130 obtains K branch audio signals through K branch ports, converts the K branch audio signals into a driving signal u″′, and sends the driving signal u″′ to the speaker 110 through the output port 132 .
[0113] In some embodiments, the branch audio signals obtained by the first peripheral circuit 130 through the K branch ports may all come from the target signal e.
[0114] Among them, "the branch audio signal comes from the target signal e" may include the following two situations. Situation 1: the branch audio signal and the target signal e are the same signal; Situation 2: the branch audio signal is a signal obtained by performing a preset process on the target signal e. The above preset process may include one or more of gain amplification process, frequency division process, filtering process or other possible processing methods.
[0115] Figure 5A A connection situation of K branch ports of the first peripheral circuit 130 in the acoustic system is shown. Figure 5A The above situation 2 is shown. Take K=2 as an example. Figure 5AAs shown, the signal processing circuit 150 includes an acoustic feedback cancellation unit 151 and a gain amplification unit 152, and the branch port 131-1 and the branch port 131-2 in the first peripheral circuit 130 are both connected to the gain amplification unit 152. The acoustic feedback cancellation unit 151 processes the first audio signal y to reduce the feedback component in the first audio signal y, thereby obtaining the target signal e. The gain amplification unit 152 performs gain amplification processing on the target signal e to obtain a branch audio signal u1 and a branch audio signal u2. In this way, the first peripheral circuit 130 can obtain the branch audio signal u1 through the branch port 131-1, and obtain the branch audio signal u2 through the branch port 131-2. In this case, the branch audio signal u1 and the branch audio signal u2 are both signals obtained by processing the target signal e, so the branch audio signal u1 and the branch audio signal u2 are both from the target signal e.
[0116] In some embodiments, the K branch ports may include a first portion of branch ports and a second portion of branch ports, wherein the branch audio signals obtained by the first peripheral circuit 130 through the first portion of branch ports are from the target signal e, and the branch audio signals obtained by the first peripheral circuit 130 through the second portion of branch ports are from the target audio component.
[0117] The target audio component is another component having an audio output function that is different from the sound pickup component 20. The target audio component may be a component integrated into the signal processing circuit 150, or a component outside the signal processing circuit 150 (for example, the target audio component may be integrated into another circuit in the acoustic system other than the signal processing circuit 150, or may be another external acoustic device).
[0118] For example, in some embodiments, the target audio component may be a Bluetooth component, which may be integrated in the signal processing circuit 150 or in other circuit systems. The Bluetooth component may receive a Bluetooth audio signal from an external acoustic device. In some embodiments, the target audio component may be a codec component built into the signal processing circuit 150, which may decode the built-in audio to generate a prompt tone. In some embodiments, the target audio component may also be other external components / external devices connected to the acoustic system by wire.
[0119] Figure 5B Another connection situation of the K branch ports of the first external circuit 130 in the acoustic system is shown. Figure 5B Take K=2 as an example. Figure 5BAs shown, the signal processing circuit 150 includes an acoustic feedback cancellation unit 151, a gain amplification unit 152 and a first audio component 200 (marked as Y1 in the figure). Among them, the branch port 131-1 in the first peripheral circuit 130 is connected to the gain amplification unit 152, and the branch port 131-2 is connected to the first audio component 200. The acoustic feedback cancellation unit 151 processes the first audio signal y to reduce the feedback component in the first audio signal y, thereby obtaining the target signal e. The gain amplification unit 152 performs gain amplification processing on the target signal e to obtain a branch audio signal u1, and outputs the branch audio signal u1 to the branch port 131-1. The first audio component 200 outputs the branch audio signal u2 to the branch port 131-2. In this way, the first peripheral circuit 130 can obtain the branch audio signal u1 through the branch port 131-1, and obtain the branch audio signal u2 through the branch port 131-2. In this case, the branch audio signal u1 is a signal obtained by processing the target signal e, that is, the branch audio signal u1 comes from the target signal e, and the branch audio signal u2 comes from the first audio component 200 .
[0120] Figure 5C FIG. 1 shows another connection situation of the K branch ports of the first external circuit 130 in the acoustic system. Figure 5C Take K=2 as an example. Figure 5C As shown, the signal processing circuit 150 includes an acoustic feedback cancellation unit 151 and a gain amplification unit 152. The acoustic system also includes a second audio component 300 (marked as Y2 in the figure), and the second audio component 300 is located outside the signal processing circuit 150. The branch port 131-1 in the first peripheral circuit 130 is connected to the gain amplification unit 152, and the branch port 131-2 is connected to the second audio component 300. The acoustic feedback cancellation unit 151 processes the first audio signal y to reduce the feedback component in the first audio signal y, thereby obtaining the target signal e. The gain amplification unit 152 performs gain amplification processing on the target signal e to obtain a branch audio signal u1, and outputs the branch audio signal u1 to the branch port 131-1. The second audio component 300 outputs the branch audio signal u2 to the branch port 131-2. In this way, the first peripheral circuit 130 can obtain the branch audio signal u1 through the branch port 131-1, and obtain the branch audio signal u2 through the branch port 131-2. In this case, the branch audio signal u1 is a signal obtained by processing the target signal e, that is, the branch audio signal u1 comes from the target signal e, and the branch audio signal u2 comes from the second audio component 300 .
[0121] Those skilled in the art will appreciate that, in practical applications, the above Figure 5B and Figure 5CThey can be combined with each other, for example, the acoustic system includes both the first audio component 200 and the second audio component 300, the first audio component 200 is located inside the signal processing circuit 150, the second audio component 300 is located outside the signal processing circuit 150, and both are connected to the branch port in the first peripheral circuit 130. In this case, some of the multiple branch audio signals received by the first peripheral circuit 130 come from the target signal e, some of the branch audio signals come from the first audio component 200, and the other part of the branch audio signals come from the second audio component 300.
[0122] In the case where the first peripheral circuit 130 includes a plurality of branch ports (such as FIG. 5A to FIG. 5C In the following, several examples are combined to illustrate the position of the reference signal pickup point 133. In the following examples, the first peripheral circuit 130 includes two branch ports.
[0123] Fig. 6A FIG. 1 shows a schematic diagram of the position of the reference signal pickup point 133. Fig. 6A As shown, the first peripheral circuit 130 may include a third processing component 136 (marked as DA in the figure). The third processing component 136 obtains the branch audio signal u1 from the branch port 131-1, obtains the branch audio signal u2 from the branch port 131-2, and performs at least one of a digital-to-analog conversion operation, a modulation operation, a filtering operation, and a mixing operation on the above two branch audio signals. It should be noted that the third processing component 136 may include one or more circuit elements, and the embodiments of this specification do not limit this. In this case, the reference signal pickup point 133 can be located between the third processing component 136 and the output port 132.
[0124] In some cases, the first peripheral circuit 130 includes no other components except the third processing component 136. In these cases, the reference signal pickup point 133 can be set at a position after the third processing component 136, so that the reference signal pickup point 133 can also be regarded as being located at the output port 132. In other cases, the first peripheral circuit 130 may include a second processing component 135 in addition to the third processing component 136. The second processing component 135 is connected between the third processing component 136 and the output port 132. The second processing component 135 can be configured to perform at least one of a filtering operation, a gain operation, or other possible operations. The second processing component 135 may include one circuit element or multiple circuit elements. In this case, the position of the reference signal pickup point 133 can be the same as FIG. 4A to FIG. 4C Similar, I will not go into details here.
[0125] Figure 6BFIG. 1 shows a schematic diagram of the position of the reference signal pickup point 133. Figure 6B As shown, the first peripheral circuit 130 may include two branch processing components 137-1 and 137-2 (respectively marked as DA1 and DA2 in the figure, wherein DA1 and DA2 may perform the same operation or different operations to process the same or different signals) and a first stream mixing component 138 (marked as C in the figure). The branch processing component 137-1 is connected to the branch port 131-1, and when in operation, obtains the branch audio signal u1 from the branch port 131-1, and performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the branch audio signal u1 to obtain an intermediate audio signal u′1. The branch processing component 137-2 is connected to the branch port 131-2, and when in operation, obtains the branch audio signal u2 from the branch port 131-2, and performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the branch audio signal u2 to obtain an intermediate audio signal u′2. The first mixing component 138 is connected to the branch processing components 137 - 1 and 137 - 2 respectively, and performs mixing operations on the intermediate audio signals u′ 1 and u′ 2 during operation. In this case, the reference signal pickup point 133 may be located between the first mixing component 138 and the output port 132 .
[0126] In some cases, the first peripheral circuit 130 includes no other components except the branch processing component 137-1, the branch processing component 137-2 and the first mixing component 138. In these cases, the reference signal pickup point 133 can be set at a position after the first mixing component 138, so that the reference signal pickup point 133 can also be regarded as being located at the output port 132. In other cases, the first peripheral circuit 130 includes a second processing component 135 in addition to the branch processing components 137-1, 137-2 and the first mixing component 138. For example, the second processing component 135 can be connected between the first mixing component 138 and the output port 132. The second processing component 135 can be configured to perform at least one of a filtering operation, a gain operation or other possible operations. The second processing component 135 can include one circuit element or multiple circuit elements. In this case, the position of the reference signal pickup point 133 can be the same as FIG. 4A to FIG. 4C Similar, I will not go into details here.
[0127] Figure 6C and Fig.6D Schematic diagrams of several positions of the reference signal pickup point 133 are shown. Figure 6C and Fig.6DAs shown, the first peripheral circuit 130 may include a second mixing component 139 (marked as C in the figure) and a fourth processing component 141 (marked as DA in the figure). The second mixing component 139 is connected to the branch ports 131-1 and 131-2 respectively. The second mixing component 139 obtains the branch audio signal u1 from the branch port 131-1, obtains the branch audio signal u2 from the branch port 131-2, and performs a mixing operation on the branch audio signals u1 and u2 to obtain a mixed audio signal. The fourth processing component 141 is connected to the second mixing component 139. The fourth processing component 141 performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the mixed audio signal. In this case, the reference signal pickup point 133 may be located between the second mixing component 139 and the output port 132. For example, see Figure 6C , the reference signal pickup point 133 may be located between the second mixing component 139 and the fourth processing component 141. For example, see Fig.6D , the reference signal pickup point 133 may be located between the fourth processing component 141 and the output port 132 .
[0128] In some cases, the first peripheral circuit 130 includes no other components except the second mixing component 139 and the fourth processing component 141. In these cases, the reference signal pickup point 133 can be set at a position after the fourth processing component 141, so that the reference signal pickup point 133 can also be regarded as being located at the output port 132. In other cases, the first peripheral circuit 130 may include a second processing component 135 in addition to the second mixing component 139 and the fourth processing component 141. The second processing component 135 is connected between the fourth processing component 141 and the output port 132. Among them, the second processing component 135 can be configured to perform at least one of a filtering operation, a gain operation or other possible operations. The second processing component 135 may include one circuit element or multiple circuit elements. In this case, the position of the reference signal pickup point 133 can be located at any position after the fourth processing component 141. The specific implementation method is the same as FIG. 4A to FIG. 4C Similar, I will not go into details here.
[0129] Those skilled in the art will understand that FIG. 6A to FIG. 6D Only partial circuits in the acoustic system are shown, which can be applied to Figure 5A The acoustic system shown can also be applied to Figure 5B In the acoustic system shown.
[0130] According to an embodiment of the present specification, the acoustic system may further include a second peripheral circuit 170 (labeled as C2 in the drawings). FIG. 3A to FIG. 3C , FIG. 5A to FIG. 5CAs shown, the second peripheral circuit 170 is connected between the reference signal pickup point 133 and the signal processing circuit 150. Specifically, the input end of the second peripheral circuit 170 is connected to the reference signal pickup point 133, and the output end is connected to the signal processing circuit 150. When the second peripheral circuit 170 is running, it obtains the first reference signal u′ from the reference signal pickup point 133, converts the first reference signal u′ into a second reference signal u″, and outputs the second reference signal u″ to the signal processing circuit 150.
[0131] Among them, the second reference signal u″ is a digital signal, that is, a signal that the signal processing circuit 150 can directly use to perform mathematical operations, which is usually located in the memory or cache of the signal processing circuit 150 or in the cache of the edge device. In the embodiments of the present specification, the second reference signal u″ is used to simulate the signal at the speaker 110. For example, the second reference signal u″ can be made equal to or approximately equal to the driving signal u″′ of the speaker 110.
[0132] Since the first reference signal u′ is obtained by picking up the reference signal pickup point 133 in the first peripheral circuit 130, the first reference signal u′ can be regarded as an intermediate signal obtained after the first circuit part in the first peripheral circuit 130 performs a preset operation on the second audio signal u. Therefore, after picking up the first reference signal u′, the second peripheral circuit 170 can perform certain operations (such as the inverse operation or opposite operation corresponding to the above preset operation) on the first reference signal u′, so that the obtained second reference signal u″ can simulate the signal at the speaker 110 as much as possible.
[0133] In some embodiments, the second peripheral circuit 170 may perform at least one of an analog-to-digital conversion operation, a demodulation operation, a filtering operation, and a gain operation on the first reference signal u′ to obtain a second reference signal u″. Those skilled in the art will appreciate that the specific operations performed by the second peripheral circuit 170 on the first reference signal u′ are related to the operations performed by the first circuit portion in the first peripheral circuit 130 on the second audio signal u, and / or are related to the signal type of the first reference signal u′. Several possible examples are given below for the implementation of the second peripheral circuit 170.
[0134] For example, the first reference signal u′ is a continuous analog signal. In this case, in some possible implementations, the second peripheral circuit 170 may perform an analog-to-digital conversion operation on the first reference signal u′, thereby obtaining the second reference signal u″.
[0135] For example, the first reference signal u′ is a PWM signal. In this case, in some possible implementations, the second peripheral circuit 170 may first perform a filtering operation on the first reference signal u′ to filter out the high-frequency carrier component therein, and then perform an analog-to-digital conversion operation on the filtered signal to obtain the second reference signal u″.
[0136] For example, the first reference signal u′ is a PDM signal. In this case, in some possible implementations, the second peripheral circuit 170 may first perform a filtering operation on the first reference signal u′ to filter out the high-frequency carrier component therein, and then perform an analog-to-digital conversion operation on the filtered signal to obtain the second reference signal u″. In addition, in some cases, the signal processing circuit 150 may directly receive and decode the PDM signal through the GPIO digital port. At this time, the second peripheral circuit 170 may perform any one of the filtering operation and the analog-to-digital conversion operation on the first reference signal u′, or the above two operations may not be performed.
[0137] For another example, the first reference signal u′ is a PCM signal, an I2S signal, or a TDM signal. In some possible implementations, the second peripheral circuit 170 may perform a demodulation operation.
[0138] It should be noted that the above examples are only shown for ease of understanding and should not be understood as limiting the embodiments of this specification. Those skilled in the art will understand that the second peripheral circuit 170 may have many other implementations, which are not listed one by one in this specification.
[0139] The second peripheral circuit 170 may include one or more circuit elements, and the embodiments of this specification do not limit this. Some examples are given below. For example, the second peripheral circuit 170 may include a circuit element, and the circuit element may perform at least one of an analog-to-digital conversion operation, a demodulation operation, a filtering operation, and a gain operation. For another example, the second peripheral circuit 170 may include two circuit elements, one of which performs an analog-to-digital conversion operation, and the other circuit element performs a demodulation operation. For another example, the second peripheral circuit 170 may include three circuit elements, wherein a first circuit element performs an analog-to-digital conversion operation and a demodulation operation, a second circuit element performs a filtering operation, and a third circuit element performs a gain operation. It should be noted that the above examples are only for ease of understanding and do not limit the embodiments of this specification.
[0140] Combine the following Figure 3A The process of canceling feedback components of the acoustic system provided in this specification is described. Figure 3B , Figure 3C , Figure 5A , Figure 5B , Figure 5CThe acoustic system shown has a similar feedback component cancellation process, which will not be described in detail in this manual.
[0141] See also Figure 3A The working process of the acoustic system is as follows: the first peripheral circuit 130 obtains the second audio signal u from the signal processing circuit 150 through the input port 131, converts the second audio signal u into a driving signal u″′, and sends the driving signal u″′ to the speaker 110 through the output port 132. The speaker 110 converts the driving signal u″′ into a first sound. The target sound source 160 emits a second sound. The sound sensor 120 collects ambient sound and converts the ambient sound into a pickup signal y′, the third peripheral circuit 140 converts the pickup signal y′ into a first audio signal y, and outputs the first audio signal y to the signal processing circuit 150. The second peripheral circuit 170 obtains a first reference signal u′ from the reference signal pickup point 133, converts the first reference signal u′ into a second reference signal u″, and outputs the second reference signal u″ to the signal processing circuit 150.
[0142] After the signal processing circuit 150 obtains the first audio signal y from the third peripheral circuit 140 and the second reference signal u″ from the second peripheral circuit 170, the second reference signal u″ is applied to the AFC technology, that is, the signal processing circuit 150 can reduce the signal component corresponding to the first sound in the first audio signal y based on the second reference signal u″ to obtain the target signal e.
[0143] Specifically, see Figure 3A , the signal processing circuit 150 may include an acoustic feedback cancellation unit 151. The input of the acoustic feedback cancellation unit 151 includes: a first audio signal y and a second reference signal u″. The acoustic feedback cancellation unit 151 can solve and adaptively update a time-varying transfer function F′ to fit the real transfer function F corresponding to the feedback path (i.e., the transmission path of the feedback sound). The acoustic feedback cancellation unit 151 uses the predicted transfer function F′ to perform an adaptive filtering operation on the second reference signal u″ to obtain a signal x′, i.e., x′=u″*F′. The signal x′ can be regarded as a predicted value of the feedback component in the first audio signal y (i.e., the signal component in the first audio signal y corresponding to the first sound). Furthermore, the acoustic feedback cancellation unit 151 can subtract the signal x′ from the first audio signal y to obtain a target signal e, i.e., e=yx′. The target signal e obtained in this way does not contain or contains less feedback components.
[0144] After obtaining the target signal e, the signal processing circuit 150 may also update the filtering parameters of the adaptive filtering operation based on at least one of the second reference signal u″ and the target signal e, that is, update the predicted transfer function F′. Specifically, according to the theory of the adaptive filtering algorithm, the update method of the predicted transfer function F′ may be achieved by minimizing the expectation of the mean square function of the target signal e, that is:
[0145] min F′ E[e 2 ]=min F′ E[(yu″*F′) 2 ] Formula (1-2)
[0146] Still taking the acoustic feedback cancellation unit 170 using the LMS algorithm as an example, the above formula (1-2) is derived based on the gradient descent optimization method, and the update formula of the predicted transfer function F′ can be obtained as follows:
[0147] F′←F′+μ*e*u″ formula (2-2)
[0148] Among them, μ is the iteration step size.
[0149] It should be understood that when the acoustic feedback cancellation unit 170 adopts algorithms such as NLMS, RLS, etc., a similar method can be used to derive an update formula for the predicted transfer function F′, which will not be explained one by one in this specification.
[0150] Figure 3A After the acoustic system shown in FIG. 1 obtains the target signal e, the signal processing circuit 150 can perform a target operation on the target signal e. Figure 3A The signal processing circuit 150 may further include a gain amplification unit 152 ( Figure 3A The gain amplification unit is marked as G in FIG. 1 ). The gain amplification unit 152 performs gain amplification on the target signal e, and sends the gain-amplified signal as the second audio signal u at the next moment to the first peripheral circuit 130, thereby driving the speaker 110 to produce sound.
[0151] In summary, the acoustic system provided in the present specification sets a reference signal pickup point 133 in the first peripheral circuit 130, and sets a second peripheral circuit 140 between the reference signal pickup point 133 and the signal processing circuit 150, so that the second peripheral circuit 140 can obtain the first reference signal u′ from the reference signal pickup point 133, and convert the first reference signal u′ into the second reference signal u″, so that the signal processing circuit 150 can apply the second reference signal u″ to the AFC technology, that is, the signal processing circuit 150 can reduce the feedback component in the first audio signal y based on the second reference signal u″ to obtain the target signal e. Since the feedback component in the target signal e is reduced or eliminated, it is possible to avoid or suppress the acoustic system from generating howling, and it is also helpful to improve the maximum forward gain that can be achieved by the acoustic system.
[0152] Since the acoustic feedback cancellation unit 151 can obtain the second reference signal u″ through the electrical space (i.e., the first peripheral circuit 130 and the second peripheral circuit 170) and use it for the AFC technology, it is no longer necessary to obtain the second audio signal u from other units inside the signal processing circuit 150. Therefore, even if there is an access restriction between different units inside the signal processing circuit 150, the acoustic system can use the AFC technology to cancel the feedback component, thereby improving the wide application of the AFC technology.
[0153] Figure 3A In the scheme shown, after the signal processing circuit 150 obtains the second reference signal u″ from the electrical space, it is not necessary to change the internal implementation of the acoustic feedback cancellation unit 151, that is, it is not necessary to change the update formula of the prediction transfer function F′ and the calculation formula of the feedback component cancellation, but only needs to replace the input signal u of the acoustic feedback cancellation unit 151 with u″. It can be seen that Figure 3A The acoustic system shown can be applied, adapted and compatible with the existing acoustic feedback cancellation unit 151, has low modification difficulty and is widely applicable.
[0154] Furthermore, in some embodiments, at least one circuit element in the first processing component 134 exhibits a nonlinear response. The nonlinear response refers to the output signal S of the circuit element. out With the input signal S in If the output signal S of circuit element A is out With the input signal S in If the output signal S of circuit element A is linear, it means that circuit element A exhibits a linear response. out With the input signal S inWhen there is a nonlinear relationship between them, it means that the circuit element A exhibits a nonlinear response. For example, in the design stage of the acoustic system, one or more target elements including nonlinear responses in the first peripheral circuit 130 can be counted in advance, and these target elements are used as the first processing component 134, and the reference signal pickup point 130 is set at a position after the first processing component 134.
[0155] Figure 3A In the illustrated solution, since the reference signal pickup point 133 is located after the first processing component 134, the predicted transfer function F′ actually fits the transfer conditions of the second circuit part, the speaker 110, the spatial path between the speaker 110 and the sound sensor 120, the sound sensor 120, and the third peripheral circuit 140. It can be seen that the predicted transfer function F′ no longer needs to fit the transfer conditions of the first circuit part (i.e., the first processing component 134), so that the nonlinear response of the first circuit part will not be introduced into the iterative solution of the predicted transfer function F′, reducing the impact on the convergence performance of the adaptive filtering algorithm, thereby improving the elimination effect of the feedback component.
[0156] Figure 7 The test results of the acoustic system provided in the embodiment of this specification in terms of filtering performance are shown. Figure 3A The acoustic system shown was used as the test object, see Figure 7 , when the first processing component 134 has a limiting characteristic, when using Figure 2 When the solution shown in the figure is used, the calculated misalignment (MIS) is shown as curve A. Figure 3A When the scheme shown is used, the calculated offset (MIS) is shown as curve B. The calculation method of the offset has been described in the previous article and will not be repeated here. Figure 7 In the figure, curve B decreases faster than curve A during the rapid convergence period, and maintains a relatively fast average downward trend during the stable convergence period. That is, curve B is below curve A in all the time periods shown. Figure 3A The scheme's misalignment MIS has always been lower than Figure 2 The plan, that is Figure 3A The scheme is superior to the adaptive filtering algorithm in terms of convergence degree and convergence speed. Figure 2 Scheme. Figure 7 It can be seen that the use of Figure 3A The scheme shown has significantly improved the convergence degree and convergence speed of the adaptive filtering algorithm.
[0157] The signal processing circuit 150 can be configured to execute the signal processing method described in the embodiments of this specification. In some embodiments, the signal processing circuit 150 may include a plurality of hardware circuits having a connection relationship, each of which includes one or more electrical components, and implements one or more steps of the signal processing method described in the embodiments of this specification when working. For example, the acoustic feedback cancellation unit 151 and the gain amplification unit 152 can be implemented by different hardware circuits or different electrical components, respectively. The above-mentioned multiple hardware circuits cooperate with each other to implement the signal processing method described in the embodiments of this specification when working. In some embodiments, the signal processing circuit 150 may also include a hardware device having a data information processing function and a necessary program required to drive the hardware device to work, and the hardware device implements the signal processing method described in the embodiments of this specification by executing the program. The signal processing method will be described in detail in the following content.
[0158] Figure 8 FIG. 1 shows a hardware structure diagram of an acoustic system provided according to an embodiment of this specification. Figure 8 As shown, the signal processing circuit 150 may include: at least one storage medium 210 and at least one processor 220. The at least one processor 220 is in communication with the sound generating component 10 and the sound pickup component 20. It should be noted that, for the purpose of demonstration only, the signal processing circuit 150 in the embodiment of this specification includes at least one storage medium 210 and at least one processor 220. It can be understood by those skilled in the art that the signal processing circuit 150 may also include other hardware circuit structures, which are not limited in the embodiments of this specification, as long as they can meet the functions mentioned in the embodiments of this specification without departing from the spirit of the embodiments of this specification.
[0159] Continue to see Figure 8 In some embodiments, the acoustic system may further include a communication port 230. The communication port 230 is used for data communication between the acoustic system and the outside world. For example, the communication port 230 can be used for data communication between the acoustic system and other devices / systems. In some embodiments, the acoustic system may further include an internal communication bus 240. The internal communication bus 240 can connect different system components. For example, the sound generating component 10, the sound pickup component 20, the processor 220, the storage medium 210 and the communication port 230 can all be connected via the internal communication bus 240.
[0160] The storage medium 210 may include a data storage device. The data storage device may be a non-temporary storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk 2101, a read-only storage medium (ROM) 2102, or a random access storage medium (RAM) 2103. The storage medium 210 also includes at least one instruction set stored in the data storage device. The instruction set includes instructions, which are computer program codes, and the computer program codes may include programs, routines, objects, components, data structures, processes, modules, etc. for executing the signal processing methods provided in the embodiments of this specification.
[0161] At least one processor 220 is used to execute the at least one instruction set mentioned above. When the acoustic system is running, at least one processor 220 reads the at least one instruction set and executes the signal processing method provided by the embodiment of this specification according to the instructions of the at least one instruction set. The processor 220 can perform all or part of the steps included in the above signal processing method. The processor 220 can be in the form of one or more processors. In some embodiments, the processor 220 may include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof. Just for illustration, Figure 8 The acoustic system shown exemplifies a case where only one processor 220 is included. However, it should be noted that the acoustic system provided by the embodiments of the present specification may also include multiple processors, and therefore, the operations and / or method steps disclosed in the embodiments of the present specification may be performed by one processor or jointly by multiple processors. For example, if the processor 220 of the acoustic system performs step A and step B in the embodiments of the present specification, it should be understood that step A and step B may also be performed jointly or separately by two different processors 220 (for example, the first processor performs step A, the second processor performs step B, or the first and second processors perform steps A and B together).
[0162] Fig. 91 shows a flow chart of a signal processing method P100 provided according to an embodiment of the present specification. As before, the signal processing circuit 150 in the acoustic system can execute the signal processing method P100 of the present specification. Specifically, the processor 220 can read the instruction set stored in its local storage medium, and then execute the signal processing method P100 of the present specification according to the provisions of the instruction set. Fig. 9 As shown, the signal processing method P100 may include:
[0163] S10: Obtain a first audio signal, where the first audio signal is obtained by converting ambient sound by a sound pickup component in an acoustic system, where the ambient sound includes a first sound and a second sound, where the first sound is sound from a speaker in the acoustic system, and the second sound is sound from a target sound source.
[0164] S20: Obtain a second reference signal, where the second reference signal is obtained by a second peripheral circuit in the acoustic system based on a first reference signal, wherein the first reference signal is obtained by the second peripheral circuit from a reference signal pickup point of a first peripheral circuit in the acoustic system, and the first peripheral circuit connects the signal processor and the speaker.
[0165] It should be understood that the execution order of S10 and S20 can be arbitrary. For example, the signal processing circuit 150 can execute S10 first and then S20, or can execute S20 first and then S10, or can execute S10 and S20 in parallel.
[0166] S30: Based on the second reference signal, the signal component corresponding to the first sound in the first audio signal is reduced to obtain a target signal.
[0167] S40: performing a target operation on the target signal.
[0168] In some embodiments, the type of the first reference signal includes at least one of an analog signal, a pulse width modulation PWM signal, a pulse density modulation PDM signal, a pulse code modulation PCM signal, an integrated circuit built-in audio I2S signal, or a time division multiplexing TDM signal.
[0169] In some embodiments, based on the second reference signal, the signal component corresponding to the first sound in the first audio signal is reduced to obtain a target signal, including: performing an adaptive filtering operation on the second reference signal to obtain a filtered signal; and subtracting the filtered signal from the first audio signal to obtain the target signal.
[0170] In some embodiments, the method further includes: updating a filtering parameter corresponding to the adaptive filtering operation based on at least one of the target signal and the second reference signal.
[0171] It should be noted that the detailed implementation of the signal processing method P100 can be found in the relevant description of the acoustic system above. Its implementation principle and technical effect are similar and will not be repeated here.
[0172] To summarize, in the solution provided in this specification, the acoustic system sets a reference signal pickup point 133 in the first peripheral circuit 130, and sets a second peripheral circuit 140 between the reference signal pickup point 133 and the signal processing circuit 150, so that the second peripheral circuit 140 can obtain the first reference signal u′ from the reference signal pickup point 133, and convert the first reference signal u′ into the second reference signal u″, so that the signal processing circuit 150 can apply the second reference signal u″ to the AFC technology, that is, the signal processing circuit 150 can reduce the feedback component in the first audio signal y based on the second reference signal u″ to obtain the target signal e. Since the feedback component in the target signal e is reduced or eliminated, the howling of the acoustic system can be avoided or suppressed, and it also helps to improve the maximum forward gain that the acoustic system can achieve.
[0173] On the other hand, the present specification provides a non-transitory storage medium storing at least one set of executable instructions for signal processing. When the executable instructions are executed by the processor, the executable instructions instruct the processor to implement the steps of the signal processing method P100 described in the present specification. In some possible implementations, various aspects of the present specification can also be implemented in the form of a program product, which includes a program code. When the program product is run on an acoustic system, the program code is used to make the acoustic system perform the steps of the signal processing method P100 described in the present specification. The program product for implementing the above method can use a portable compact disk read-only memory (CD-ROM) to include program code and can be run on an acoustic system. However, the program product of the present specification is not limited to this. In the present specification, the readable storage medium can be any tangible medium containing or storing a program, which can be used by the instruction execution system or used in combination with it. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media include: an electrical connection with one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. The computer-readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above. Program code for performing the operations of the present specification may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the acoustic system, partially on the acoustic system, as a stand-alone software package, partially on the acoustic system and partially on a remote computing device, or entirely on a remote computing device.
[0174] The above is a description of a specific embodiment of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require a specific order or a continuous order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0175] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented only by way of example and may not be limiting. Although not explicitly stated herein, those skilled in the art will appreciate that this specification requires various reasonable changes, improvements and modifications to the embodiments. These changes, improvements and modifications are intended to be proposed by this specification and are within the spirit and scope of the exemplary embodiments of this specification.
[0176] In addition, certain terms in this specification have been used to describe embodiments of this specification. For example, "one embodiment", "an embodiment" and / or "some embodiments" mean that a particular feature, structure or characteristic described in conjunction with the embodiment may be included in at least one embodiment of this specification. Therefore, it can be emphasized and should be understood that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various parts of this specification do not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics may be appropriately combined in one or more embodiments of this specification.
[0177] It should be understood that in the foregoing description of the embodiments of this specification, in order to help understand a feature and for the purpose of simplifying this specification, this specification combines various features in a single embodiment, figure or its description. However, this does not mean that the combination of these features is necessary. When reading this specification, it is entirely possible for a person skilled in the art to mark out some of the devices as separate embodiments. In other words, the embodiments in this specification can also be understood as the integration of multiple secondary embodiments. This is also true when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.
[0178] Each patent, patent application, patent application publication, and other material, such as articles, books, specifications, publications, documents, articles, etc., cited herein, except any historical prosecution documents to which it is relevant, any equivalent that may be inconsistent or conflicting with this document, or any equivalent historical prosecution documents that may have a limiting effect on the broadest scope of the claims, may be incorporated herein by reference and used for all purposes now or hereafter associated with this document. In addition, in the event of any inconsistency or conflict between the descriptions, definitions, and / or use of terms associated with any of the incorporated materials and the terminology, descriptions, definitions, and / or use associated with this document, the terminology in this document shall control.
[0179] Finally, it should be understood that the embodiments of the application disclosed herein are explanations of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are only used as examples and not as limitations. Those skilled in the art can adopt alternative configurations according to the embodiments in this specification to implement the applications in this specification. Therefore, the embodiments of this specification are not limited to the embodiments accurately described in the application.
Claims
1. An acoustic system, It is characterized in that include: A loudspeaker, which converts the driving signal into a first sound when in operation; A sound pickup component, which converts ambient sound into a first audio signal when in operation, wherein the ambient sound includes the first sound and a second sound from a target sound source; A signal processing circuit connected to the sound pickup assembly; A first peripheral circuit includes an input port and an output port, wherein the output port is connected to the speaker, and a reference signal pickup point exists in the first peripheral circuit; as well as The second peripheral circuit connects the reference signal pickup point and the signal processing circuit, wherein When the first peripheral circuit is running, it obtains a second audio signal through the input port, converts the second audio signal into the driving signal, and sends the driving signal to the speaker through the output port. A second peripheral circuit obtains a first reference signal from the reference signal pickup point during operation and outputs a second reference signal to the signal processing circuit, and When the signal processing circuit is running, based on the second reference signal, it reduces the signal component corresponding to the first sound in the first audio signal to obtain a target signal, and performs a target operation on the target signal.
2. The acoustic system according to claim 1, It is characterized in that The type of the first reference signal includes at least one of an analog signal, a pulse width modulation PWM signal, a pulse density modulation PDM signal, a pulse code modulation PCM signal, an integrated circuit built-in audio I2S signal, or a time division multiplexing TDM signal.
3. The acoustic system according to claim 1, It is characterized in that The reference signal pickup point is located at the input port; or The reference signal pickup point is located at the output port.
4. The acoustic system according to claim 1, It is characterized in that The first peripheral circuit further includes a first processing component, which is connected to the signal processing circuit via the input port, obtains the second audio signal from the signal processing circuit during operation, and performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the second audio signal; and The reference signal pick-off point is located between the first processing component and the output port.
5. The acoustic system according to claim 4, It is characterized in that The first peripheral circuit further includes a second processing component connected to the first processing component and the output port, wherein: The reference signal pickup point is located between the first processing component and the second processing component, or The reference signal pickup point is located between the second processing component and the output port, or The second processing component includes a plurality of circuit elements, and the reference signal pickup point is located between any two circuit elements of the plurality of circuit elements.
6. The acoustic system according to claim 4, It is characterized in that The second audio signal is derived from the target signal.
7. The acoustic system according to claim 4, It is characterized in that The second audio signal comprises a first signal component and a second signal component, wherein The first signal component comes from the target signal, The second signal component comes from a target audio component that is different from the sound pickup component.
8. The acoustic system according to claim 1, It is characterized in that The input port includes K branch ports, where K is an integer greater than 1; The second audio signal includes K branch audio signals; and The first peripheral circuit obtains the K branch audio signals through the K input ports, and converts the K branch audio signals into the driving signals.
9. The acoustic system according to claim 8, It is characterized in that The first peripheral circuit further includes a third processing component, which performs at least one of a digital-to-analog conversion operation, a modulation operation, a filtering operation, and a stream mixing operation on the K branch audio signals when in operation; and The reference signal pick-up point is located between the third processing component and the output port.
10. The acoustic system according to claim 8, It is characterized in that The first peripheral circuit further includes: K branch processing components are connected to the K branch ports respectively, wherein the i-th branch processing component performs at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the i-th branch audio signal when it is running to obtain an i-th intermediate audio signal, and A first stream mixing component, connected to the K third processing components respectively, and performing a stream mixing operation on the K intermediate audio signals when running; and The reference signal pickup point is located between the first mixing component and the output port.
11. The acoustic system according to claim 8, It is characterized in that The first peripheral circuit further includes: a second stream mixing component, connected to the K branch ports respectively, and performing a stream mixing operation on the K branch audio signals to obtain a mixed stream audio signal when in operation; and a fourth processing component, connected to the second stream mixing component, and performing at least one of a digital-to-analog conversion operation, a modulation operation, and a filtering operation on the mixed stream audio signal when running; and The reference signal pickup point is located between the second mixing component and the fourth processing component, or the reference signal pickup point is located between the fourth processing component and the output port.
12. The acoustic system according to claim 8, It is characterized in that The branch audio signals obtained by the first peripheral circuit through the K branch ports all come from the target signal.
13. The acoustic system according to claim 8, It is characterized in that The K branch ports include a first portion of branch ports and a second portion of branch ports, wherein The branch audio signal obtained by the first peripheral circuit through the first part of the branch ports comes from the target signal, and The branch audio signal obtained by the first peripheral circuit through the second part branch port comes from a target audio component, and the target audio component is different from the pickup component.
14. The acoustic system according to claim 1, It is characterized in that When the second peripheral circuit is running, it performs at least one of analog-to-digital conversion operation, demodulation operation, filtering operation, and gain operation on the first reference signal to obtain the second reference signal.
15. The acoustic system according to claim 1, It is characterized in that In order to obtain the target signal, the signal processing circuit: performing an adaptive filtering operation on the second reference signal to obtain a filtered signal; and The target signal is obtained by subtracting the filtered signal from the first audio signal.
16. The acoustic system according to claim 15, It is characterized in that The signal processing circuit also: Based on at least one of the target signal and the second reference signal, a filtering parameter corresponding to the adaptive filtering operation is updated.
17. The acoustic system according to claim 1, It is characterized in that When performing the target operation, the signal processing circuit: Performing a gain amplification operation on the target signal to obtain an amplified signal; and The amplified signal is sent to the first peripheral circuit.
18. The acoustic system according to claim 1, It is characterized in that The pickup assembly includes a sound sensor and a third peripheral circuit, wherein The sound sensor converts the ambient sound into a sound pickup signal when in operation, and The third peripheral circuit converts the picked-up sound signal into the first audio signal when in operation.
19. The acoustic system according to claim 1, It is characterized in that The signal processing circuit comprises: at least one storage medium storing at least one instruction set for performing signal processing; and at least one processor is communicatively connected to the first peripheral circuit, the second peripheral circuit, the pickup assembly, and the at least one storage medium, wherein when the acoustic system is running, the at least one processor reads the at least one instruction set and executes according to the instructions of the at least one instruction set: Based on the second reference signal, a signal component corresponding to the first sound in the first audio signal is cut to obtain a target signal, and the target operation is performed on the target signal.
20. A signal processing method, It is characterized in that Included, through signal processing circuits in the acoustic system: Obtaining a first audio signal, where the first audio signal is obtained by converting ambient sound by a sound pickup component in the acoustic system, where the ambient sound includes a first sound and a second sound, where the first sound is sound from a speaker in the acoustic system, and the second sound is sound from a target sound source; Obtaining a second reference signal, wherein the second reference signal is obtained by a second peripheral circuit in the acoustic system based on a first reference signal, wherein the first reference signal is obtained by the second peripheral circuit from a reference signal pickup point of a first peripheral circuit in the acoustic system, and the first peripheral circuit is connected to the signal processor and the speaker; Based on the second reference signal, a signal component corresponding to the first sound in the first audio signal is reduced to obtain a target signal; and A target operation is performed on the target signal.
21. The method according to claim 20, It is characterized in that The type of the first reference signal includes at least one of an analog signal, a pulse width modulation PWM signal, a pulse density modulation PDM signal, a pulse code modulation PCM signal, an integrated circuit built-in audio I2S signal, or a time division multiplexing TDM signal.
22. The method according to claim 20, It is characterized in that The step of reducing the signal component corresponding to the first sound in the first audio signal based on the second reference signal to obtain the target signal includes: performing an adaptive filtering operation on the second reference signal to obtain a filtered signal; and The target signal is obtained by subtracting the filtered signal from the first audio signal.
23. The method according to claim 22, It is characterized in that The method further comprises: Based on at least one of the target signal and the second reference signal, a filtering parameter corresponding to the adaptive filtering operation is updated.
Citation Information
Patent Citations
Device and method for echo cancellation, and computer-readable storage medium
CN108322859A
Audio signal processing method and device thereof
CN113362843A
Howling suppression method and system, storage medium and earphone equipment
CN113870882A
Signal processing method and device and storage medium
CN115297420A
Echo-Cancelling Device and Echo-Cancelling Method
US20170040026A1
