Nonlinear control compensation method for intermodulation distortion of sound-producing component, device, and medium

Abstract

Embodiments of the present invention relate to the field of noise compensation. Disclosed are a nonlinear control compensation method for intermodulation distortion of a sound-producing component, a device, and a medium. In the present invention, the method comprises: acquiring a sound source having an excitation signal obtained by mixing multiple frequencies and test sound pressure response data corresponding to the excitation signal as training set data; using the training set data to train an intermodulation distortion model; and using the trained intermodulation distortion model to perform intermodulation distortion compensation on a sound-producing component. By training in this way, response results of the sound source under different excitation signals can be obtained, then compensation-related parameters for intermodulation distortion problems are determined, and the intermodulation distortion problems of the sound-producing component are compensated by means of the intermodulation distortion model, thereby reducing the noise of the sound-producing component, and improving the auditory experience of a user.

Description

Nonlinear control and compensation methods, equipment and media for intermodulation distortion of sound-generating components Technical Field

[0001] This invention relates to the field of noise compensation, and in particular to a nonlinear control compensation method, device and medium for intermodulation distortion of sound-generating components. Background Technology

[0002] Currently, many smart devices contain sound-generating components, such as mobile phones, headphones, and smart home appliances. During the sound-generating process, if low-frequency and high-frequency signal components appear simultaneously, intermodulation distortion will occur between the low-frequency and high-frequency signals due to the Doppler effect and the nonlinearity of the device. This will make the information output by the sound-generating component blurry, or produce noise or abnormal sounds, which is detrimental to the user's auditory experience. Summary of the Invention

[0003] The purpose of this invention is to provide a nonlinear control compensation method, device and medium for intermodulation distortion of sound-generating components. It utilizes a trained intermodulation distortion model to compensate for intermodulation distortion, thereby eliminating noise from sound-generating components and improving the user's auditory experience.

[0004] To address the aforementioned technical problems, embodiments of the present invention provide a nonlinear control and compensation method for intermodulation distortion of sound-generating components, comprising: acquiring a sound source with an excitation signal obtained by mixing multiple frequencies, and test sound pressure response data corresponding to the excitation signal as training set data; training an intermodulation distortion model using the training set data; and using the trained intermodulation distortion model to compensate for intermodulation distortion of the sound-generating components.

[0005] Embodiments of the present invention also provide an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the above-described nonlinear control compensation method for intermodulation distortion of sound-producing components.

[0006] Embodiments of the present invention also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the above-described nonlinear control compensation method for intermodulation distortion of sound-generating components.

[0007] Compared with the prior art, the embodiments of the present invention utilize a sound source with an excitation signal obtained by mixing multiple frequencies, and the test sound pressure response data corresponding to the excitation signal as training data to train the intermodulation distortion model. By training in this way, the response results of the sound source under different excitation signals can be obtained, thereby determining the relevant parameters for compensating for the intermodulation distortion problem. This enables the use of the intermodulation distortion model to compensate for the intermodulation distortion problem of the sound-generating components, remove noise from the sound-generating components, and improve the user's listening experience.

[0008] In addition, the intermodulation distortion model includes identification distortion parameters and controller parameters; wherein, the identification distortion parameters are parameters that characterize the intermodulation distortion problem generated under the excitation signal obtained by mixing the multiple frequency sound sources, and the controller parameters are parameters used to compensate for the intermodulation distortion problem.

[0009] In addition, the distortion parameters and controller parameters to be identified include: time-invariant / time-varying linear parameters, and / or time-varying nonlinear parameters.

[0010] In addition, the excitation signal is an audio signal generated by means of electrical signals, force signals or sound pressure.

[0011] Furthermore, when compensating for intermodulation distortion of multiple sound-generating components, the controller parameters corresponding to each sound-generating component are determined using the intermodulation distortion model. A target compensation signal for intermodulation distortion compensation is calculated using the controller parameters corresponding to the multiple sound-generating components. This target compensation signal is then added to the sound source of one of the target sound-generating components to compensate for the intermodulation distortion of the multiple sound-generating components. For cases where multiple sound-generating components jointly generate intermodulation distortion, compensation can be achieved by controlling only one sound-generating component, reducing the difficulty of compensation and improving its efficiency.

[0012] Furthermore, the method for determining the target sound-generating component includes: selecting a sound-generating component with low control difficulty as the target sound-generating component based on the control difficulty of the sound-generating components. Selecting a sound-generating component with low control difficulty and adding a compensation signal to its sound source can reduce the difficulty of operation.

[0013] Furthermore, if the sound source of the sound-generating component includes content from different operating regions, the intermodulation distortion model is used to determine the corresponding controller parameters for each operating region. Based on the operating region of the sound-generating component, the corresponding controller parameters are selected for intermodulation distortion compensation. This allows for targeted selection of different controller parameters for the operating region of the sound-generating component, improving noise reduction performance.

[0014] In addition, if the sound source of the sound-generating component includes content from different working regions, the controller parameters for the case containing multiple working regions are determined using the intermodulation distortion model; intermodulation distortion compensation is then performed based on the controller parameters. Attached Figure Description

[0015] One or more embodiments are illustrated by way of example with reference numerals in the accompanying drawings. These illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the drawings are not to be limited by scale.

[0016] Figure 1 is a flowchart of a nonlinear control and compensation method for intermodulation distortion of sound-generating components according to a first embodiment of the present invention;

[0017] Figure 2 is an overall flowchart of the nonlinear control and compensation method for intermodulation distortion of sound-generating components according to the first embodiment of the present invention.

[0018] Figure 3 is a flowchart of a nonlinear control and compensation method for intermodulation distortion of sound-generating components according to a second embodiment of the present invention.

[0019] Figure 4 is a flowchart of the process of identifying distortion parameters and determining controller parameters according to the second embodiment of the present invention;

[0020] Figure 5 is a flowchart of the intermodulation distortion compensation process of the sound-generating components according to the second embodiment of the present invention;

[0021] Figure 6 is a flowchart of a nonlinear control and compensation method for intermodulation distortion of sound-generating components according to a second embodiment of the present invention.

[0022] Figure 7 is a flowchart of the process of identifying distortion parameters and determining controller parameters under the overall compensation method according to the third embodiment of the present invention.

[0023] Figure 8 is a flowchart of the intermodulation distortion compensation process of the sound-generating components under the overall compensation method according to the third embodiment of the present invention.

[0024] Figure 9 is a flowchart of the process of identifying distortion parameters and determining controller parameters under different working area compensation methods according to the third embodiment of the present invention.

[0025] Figure 10 is a flowchart of the intermodulation distortion compensation process of the sound-generating components under different working area compensation methods according to the third embodiment of the present invention.

[0026] Figure 11 is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Embodiments of the present invention

[0027] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the various embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, those skilled in the art will understand that many technical details have been presented in the various embodiments of the present invention to enable the reader to better understand the present invention. However, the technical solutions claimed in the present invention can be implemented even without these technical details and various changes and modifications based on the following embodiments.

[0028] The division of the following embodiments is for ease of description and should not constitute any limitation on the specific implementation of the present invention. The various embodiments can be combined with and referenced by each other without contradiction.

[0029] The first embodiment of this invention relates to a nonlinear control compensation method for intermodulation distortion of sound-generating components. The core of this embodiment lies in acquiring a sound source with an excitation signal obtained by mixing multiple frequencies, and the corresponding test sound pressure response data as training set data; training an intermodulation distortion model using the training set data; and using the trained intermodulation distortion model to compensate for intermodulation distortion in the sound-generating components. Through this training method, the response results of the sound source under different excitation signals can be obtained, thereby determining the relevant parameters for compensating for intermodulation distortion, realizing the compensation of intermodulation distortion in the sound-generating components using the intermodulation distortion model, removing noise from the sound-generating components, and improving the user's auditory experience. The following detailed description of the implementation of the nonlinear control compensation method for intermodulation distortion of sound-generating components in this embodiment is provided for ease of understanding and is not essential for implementing this solution.

[0030] The nonlinear control and compensation method for intermodulation distortion of the sound-generating components in this embodiment is shown in Figure 1, and specifically includes the following steps:

[0031] Step 101: Obtain the sound source with excitation signal obtained by mixing multiple frequencies, and the test sound pressure response data corresponding to the excitation signal as training set data.

[0032] Specifically, the sound source can be acquired by one or more sound-generating components. Multiple frequency sound sources can be freely combined from one or more signal types, such as DC signals, low-frequency signals, high-frequency signals, and noise signals. The excitation signal is an audio signal generated by any means that can drive sound production, such as electrical signals, force signals, or sound pressure.

[0033] Step 102: Train the intermodulation distortion model using the training set data.

[0034] Specifically, the intermodulation distortion model includes identification distortion parameters and controller parameters. The identification distortion parameters are those representing the intermodulation distortion problem generated by a mixed excitation signal from multiple frequency sound sources. The controller parameters are relevant parameters used to compensate for the intermodulation distortion problem by adjusting the sound source of the sound-generating components. The identification distortion parameters and controller parameters include time-invariant / time-varying linear parameters and / or time-varying nonlinear parameters. The identification distortion parameters and controller parameters can be determined through both online and offline calculations, and the appropriate calculation method can be selected based on network conditions and computational load.

[0035] Furthermore, to ensure the accuracy of the intermodulation distortion model, a large amplitude is required during the stage of applying the excitation signal to determine the distortion parameters. Since there is a positive correlation between the magnitude of intermodulation distortion and the amplitude, large-amplitude testing can more effectively obtain intermodulation distortion parameter information, thus yielding more accurate distortion parameters. This ensures the stability of the denoising effect of the trained intermodulation distortion model during practical use.

[0036] Furthermore, since sound-generating components may operate within different operating ranges—meaning the audio source may contain audio signals within different frequency ranges—the compensated output signal should, in principle, also operate within the same operating range when compensating for signals within different operating ranges. If the audio source operates within different ranges, different amplitudes can be generated during the distortion parameter determination stage. Specifically, the amplitude of the sound-generating components can be adjusted using a DC component. If the low-frequency signal accounts for a higher proportion in the audio source, a higher amplitude is required. However, when adjusting the amplitude, the upper limit of the amplitude specified by the sound-generating components must be considered to avoid damaging the components due to excessively high amplitudes.

[0037] Step 103: Use the trained intermodulation distortion model to compensate for the intermodulation distortion of the sound-generating components.

[0038] The above content introduced the training method of the intermodulation distortion model. After training the intermodulation distortion model, it can be used to compensate for intermodulation distortion in sound-generating components. The following section, with reference to Figure 2, explains the overall compensation method for intermodulation distortion in sound-generating components:

[0039] The sound-generating components are excited by an excitation signal. The intermodulation distortion parameters are identified using the parameter identification module of the intermodulation distortion model. The identified distortion parameters are then input into the intermodulation compensation control module of the intermodulation distortion model to determine the controller parameters. The controller is then designed using these parameters to perform compensation and adjustment on the sound-generating components.

[0040] The controller can be designed based on the inverse model of the parameter identification module, or through adaptive control or intelligent control.

[0041] The excitation signal includes sound sources of various frequencies, which can be a free combination of one or more types of signals, such as DC signals, low-frequency signals, high-frequency signals, and noise signals. Furthermore, a large amplitude is required in the stage of applying the excitation signal to determine the identification distortion parameters. Since the magnitude of intermodulation distortion is positively correlated with the amplitude, large-amplitude testing can more effectively obtain intermodulation distortion parameter information, i.e., obtain more accurate identification distortion parameters. Alternatively, the amplitude of the sound-generating component can be adjusted to different operating ranges for testing using methods such as DC component analysis. This facilitates compensation for sound-generating components operating within different ranges.

[0042] During the compensation phase, the current excitation signal, after being adjusted according to the controller parameters by the initial controller obtained above, is sent to the sound-generating element. The original sound source of the sound-generating element, through the adjusted excitation signal, can achieve compensation for intermodulation distortion, eliminating the noise impact caused by intermodulation distortion. Since the sound source signal emitted by the sound-generating element changes in real time, after intermodulation distortion compensation at the current moment, the latest online parameters of the sound-generating element can be obtained through model prediction or detector feedback, allowing for the next moment's compensation processing. This cycle is repeated to achieve real-time compensation of the sound-generating element.

[0043] The second embodiment of the present invention relates to a nonlinear control compensation method for intermodulation distortion of sound-generating components. When simultaneously compensating for intermodulation distortion of multiple sound-generating components, as shown in Figure 3, the compensation method includes the following steps:

[0044] Step 301: When performing intermodulation distortion compensation on multiple sound-generating components, the controller parameters corresponding to each sound-generating component are determined using the intermodulation distortion model.

[0045] Step 302: Calculate the target compensation signal for intermodulation distortion compensation of multiple sound-generating components using the controller parameters corresponding to the multiple sound-generating components.

[0046] Step 303: A target compensation signal is added to the sound source of one of the target sound-generating components among the multiple sound-generating components to perform intermodulation distortion compensation on the multiple sound-generating components.

[0047] Specifically, when multiple sound-generating components emit sound simultaneously, the following situations can be identified based on the volume of each component:

[0048] In one scenario, if the volume of one of the sound-generating components 1 is low, and the sound emitted by the low-volume component 1 is negligible, then it can be considered that the sound-generating component 2 alone generates intermodulation distortion. The main function of the sound-generating component 1 is to act as a compensator to eliminate the intermodulation distortion generated by the sound-generating component 2.

[0049] In another scenario, if the volume of the two sound-generating components is the same and both volumes can be detected by the human ear, the intermodulation distortion is jointly generated by sound-generating components 1 and 2. This can be achieved by adding a target compensation signal to the sound source of one of the sound-generating components 1 to simultaneously suppress the intermodulation distortion of sound-generating components 1 and 2, thus compensating for the two sound-generating components.

[0050] Both scenarios mentioned above propose using a single sound-generating element to add a target compensation signal for all sound-generating elements. Compared to calculating compensation parameters for each sound-generating element separately, then calculating controller parameters for each element based on those parameters, and finally compensating each element individually, controlling only one sound-generating element saves operations and improves compensation efficiency. Furthermore, since the noise ranges generated by multiple sound-generating elements may overlap, aggregating the compensation operations for multiple elements using the same signal saves resources.

[0051] Furthermore, the different structures of sound-generating components result in variations in impedance curves, sensitivity, and phase angles, which in turn affect the ease of control. Selecting sound-generating components with lower control difficulty and adding a compensation signal to the sound source can reduce operational complexity.

[0052] When performing intermodulation distortion compensation for multiple sound-generating components, the overall compensation process is as follows:

[0053] The process of identifying distortion parameters and determining controller parameters is shown in Figure 4. The identification distortion parameter 1 of the sound-generating element 1 is obtained through excitation signal 1, and the controller parameter 2 of the sound-generating element 2 is obtained through excitation signal 2.

[0054] The intermodulation distortion compensation process for multiple sound-emitting components is shown in Figure 5. At the current moment, the identification distortion parameter 1 of sound-emitting component 1 is obtained using the current excitation signal. Based on the identification distortion parameter 1, the required compensation signal 1 for sound-emitting component 1 is determined. The compensation signal 1 is input to the controller 2 of sound-emitting component 2. The controller 2 of sound-emitting component 2 determines the target compensation signal based on the controller parameter 2 and the input compensation signal 1. Finally, the controller parameter 2 is updated based on the target compensation signal, thus achieving compensation for both sound-emitting components at the current moment by controlling only sound-emitting component 2. At the next moment, the sound-emitting component signal changes. The current excitation signal is determined based on the signal of sound-emitting component 1 at the next moment. The identification distortion parameter 1 is recalculated based on the re-determined current excitation signal. Then, the above process is repeated to achieve real-time compensation for the sound-emitting components.

[0055] The third embodiment of the present invention relates to a nonlinear control compensation method for intermodulation distortion of sound-generating components. As shown in Figure 6, when compensating for intermodulation distortion of sound-generating components in different operating regions, the compensation method includes the following steps:

[0056] Step 601: If the sound source of the sound-generating component includes content from different working regions, the controller parameters corresponding to different working regions are determined using an intermodulation distortion model.

[0057] Step 602: Select the corresponding controller parameters for intermodulation distortion compensation based on the working area of ​​the sound-generating components.

[0058] Specifically, since sound-generating components may operate within different operating ranges—meaning the sound source may contain audio signals within different frequency ranges—when compensating for signals within different operating ranges, the compensated output signal should, in principle, also be within the same operating range. Therefore, the operating range of the sound-generating components also needs to be considered during compensation. For example, whether the sound-generating components operate in the low-frequency region, the high-frequency region, or generate different signals at different frequencies.

[0059] To ensure the operating range of the sound-generating components, the following two methods can be used to compensate for the intermodulation distortion problem. Firstly, the different operating ranges of the sound-generating components can be considered as a whole and compensated accordingly. The compensation process is as follows:

[0060] The process of identifying distortion parameters and determining controller parameters is shown in Figure 7. The sound-generating element is excited by an excitation signal, and the distortion parameters obtained under the condition that the working range of the sound-generating element includes all working areas under actual operation are detected. The controller parameters are then determined based on the distortion parameters.

[0061] The intermodulation distortion compensation process for the sound-generating components is shown in Figure 8. Based on the controller parameters determined above, the current excitation signal is adjusted by the controller and sent to the sound-generating components to achieve intermodulation distortion compensation at the current moment. After intermodulation distortion compensation at the current moment, the latest online parameters of the sound-generating components can be obtained through model prediction or detector feedback to proceed to the compensation process at the next moment. This process is repeated to achieve real-time compensation for the sound-generating components.

[0062] In addition, compensation designs can be implemented separately for different working areas of the sound-generating components. The specific process is as follows:

[0063] The process of identifying distortion parameters and determining controller parameters is shown in Figure 9. Multiple sets of excitation signals are used to excite the sound-generating element, and the identified distortion parameters of the sound-generating element in different frequency operating ranges (operating areas) are analyzed. Based on the identified distortion parameters corresponding to different operating areas, the controller parameters for each operating area can be determined. The setting of multiple sets of excitation signals must ensure that the sound-generating element contains both low-frequency and high-frequency signal components, and the setting of each set of excitation signals must ensure that the sound-generating element operates in a different operating area.

[0064] The intermodulation distortion compensation process for sound-generating components is shown in Figure 10. The operating range of the sound-generating components is determined through prediction or detector detection. Then, corresponding controller parameters are selected as initial controllers based on the operating range to adjust the current excitation signal and achieve intermodulation distortion compensation. During the compensation process, the distortion identification parameters and controller parameters are continuously updated iteratively based on the real-time signal detected by the prediction or detector, and the constantly updated sound source signal is processed cyclically. In the compensation stage, a single initial controller can be used to compensate for a single operating range, or multiple initial controllers can be selected to perform comprehensive compensation for multiple operating ranges of the sound-generating components.

[0065] The sound-generating components mentioned in this embodiment can be loudspeakers, amplifiers, or other components used for audio output.

[0066] The steps of the various methods described above are only for clarity. In practice, they can be combined into one step or some steps can be split into multiple steps. As long as they include the same logical relationship, they are all within the protection scope of this invention. Adding insignificant modifications or introducing insignificant designs to the algorithm or process, without changing the core design of the algorithm and process, are also within the protection scope of this patent.

[0067] This invention also relates to an electronic device, as shown in FIG11, including at least one processor 1101; and a memory 1102 communicatively connected to at least one processor 1101; wherein the memory 1102 stores instructions executable by at least one processor 1101, the instructions being executed by at least one processor 1101 to enable at least one processor 1101 to execute the aforementioned nonlinear control compensation method for intermodulation distortion of sound-generating components.

[0068] The memory 1102 and processor 1101 are connected via a bus. This bus can include any number of interconnecting buses and bridges, connecting various circuits of one or more processors 1101 and memory 1102. The bus can also connect various other circuits, such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and therefore will not be described further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver can be a single element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices over a transmission medium. Data processed by the processor is transmitted over a wireless medium via an antenna, which further receives and transmits data to the processor 1101.

[0069] Processor 1101 is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. Memory 1102 can be used to store data used by processor 1101 during operation.

[0070] This invention also relates to a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the above-described method embodiments.

[0071] That is, those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing related hardware. This program is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0072] Those skilled in the art will understand that the above embodiments are specific embodiments for implementing the present invention, and in practical applications, various changes in form and detail may be made without departing from the spirit and scope of the present invention.

Claims

1. A nonlinear control and compensation method for intermodulation distortion of sound-generating components, comprising: Acquire a sound source with an excitation signal obtained by mixing multiple frequencies, and the test sound pressure response data corresponding to the excitation signal as training set data; The intermodulation distortion model is trained using the training set data; The trained intermodulation distortion model is used to compensate for the intermodulation distortion of the sound-generating components.

2. The nonlinear control and compensation method for intermodulation distortion of sound-generating components according to claim 1, wherein, include: The intermodulation distortion model includes identification distortion parameters and controller parameters; The identification distortion parameter is a parameter representing the intermodulation distortion problem generated under the excitation signal obtained by mixing multiple frequency sound sources, and the controller parameter is a parameter used to compensate for the intermodulation distortion problem.

3. The nonlinear control and compensation method for intermodulation distortion of sound-generating components according to claim 2, wherein, include: The distortion identification parameters and controller parameters include: time-invariant / time-varying linear parameters, and / or time-varying nonlinear parameters.

4. The nonlinear control and compensation method for intermodulation distortion of sound-generating components according to any one of claims 1 to 3, wherein, include: The excitation signal is an audio signal generated by means of electrical signals, force signals, or sound pressure.

5. The nonlinear control and compensation method for intermodulation distortion of sound-generating components according to claim 1, wherein, include: When performing intermodulation distortion compensation on multiple sound-generating components, the controller parameters corresponding to each sound-generating component are determined using the intermodulation distortion model. The target compensation signal for intermodulation distortion compensation of the multiple sound-generating components is calculated using the controller parameters corresponding to the multiple sound-generating components. The target compensation signal is added to the sound source of one of the multiple sound-generating components to compensate for intermodulation distortion of the multiple sound-generating components.

6. The nonlinear control and compensation method for intermodulation distortion of sound-generating components according to claim 5, wherein, The methods for determining the target sound-emitting component include: Based on the ease of control of the sound-generating components, the sound-generating component with lower control difficulty is selected as the target sound-generating component.

7. The nonlinear control and compensation method for intermodulation distortion of sound-generating components according to claim 1, wherein, include: If the sound source of the sound-generating component includes content from different working regions, the controller parameters corresponding to different working regions are determined using the intermodulation distortion model. Based on the operating area of ​​the sound-generating component, the corresponding controller parameters are selected for intermodulation distortion compensation.

8. The nonlinear control and compensation method for intermodulation distortion of sound-generating components according to claim 1, wherein, include: If the sound source of the sound-generating component includes content from different working regions, the controller parameters for the case containing multiple working regions are determined using the intermodulation distortion model. Intermodulation distortion compensation is performed based on the controller parameters.

9. An electronic device, comprising: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the nonlinear control compensation method for intermodulation distortion of sound-generating components as described in any one of claims 1 to 8.

10. A computer-readable storage medium storing a computer program, which, when executed by a processor, implements the nonlinear control compensation method for intermodulation distortion of sound-generating components as described in any one of claims 1 to 8.

Images