Low-delay audio signal processing method and system

By acquiring and sending audio signals in segments and optimizing frame length, the delay and interruption overhead problems in active noise reduction are solved, low-latency and efficient audio signal processing are achieved, and the processing capability of the CPU is improved.

CN120416732AActive Publication Date: 2025-08-01WUXI GUOXINWEI HIGH-TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202510902555.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-07-01
Publication Date
2025-08-01
Estimated Expiration
2045-07-01

AI Technical Summary

Technical Problem

The prior art has problems of delay and CPU interruption overhead in active noise reduction, which cannot effectively solve the contradiction between frame length and delay, affecting the performance of the active noise reduction algorithm and CPU resource utilization.

Method used

By configuring noise reduction processing parameters, the audio signal is obtained and sent in segments. The sub-signal of the audio signal is first obtained and noise reduction calculation is performed. The noise reduction signal is sent in segments. The frame length fine-tuning step is combined with the frame length fine-tuning step to optimize the frame length to reduce interrupt overhead and improve CPU processing capabilities.

Benefits of technology

It realizes active noise reduction processing with low latency, reduces CPU interruption overhead, improves the CPU's MIPS upper limit, and optimizes the audio signal processing efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120416732A_ABST
    Figure CN120416732A_ABST
Patent Text Reader

Abstract

The invention relates to a low-delay audio signal processing method and system. The method comprises the following steps: selecting a group of to-be-denoised audio information, and when carrying out audio signal processing on any group of to-be-denoised audio information, obtaining a to-be-denoised second audio signal, when obtaining the to-be-denoised second audio signal, firstly obtaining a second audio first sub-signal in the to-be-denoised second audio signal, and in the process of obtaining the second audio first sub-signal, obtaining a second audio first sub-signal in the to-be-denoised second audio signal; performing noise reduction calculation processing on the first audio signal to be subjected to noise reduction, and generating a noise-reduced audio signal after the noise reduction calculation processing is performed; and after the first sub-signal of the second audio is obtained, sending and outputting the de-noised audio signal, and in the process of sending and outputting the de-noised audio signal, obtaining a second sub-signal of the second audio in the second audio signal to be de-noised. The low delay of active noise reduction can be realized, the interrupt overhead of the CPU can be reduced, and the MIPS upper limit of a CPU processing algorithm is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an audio signal processing method and system, and particularly to a low-latency audio signal processing method and system. Background Art

[0002] In industrial production and daily life, noise pollution has become a serious problem, which not only damages people's hearing health, but also affects work efficiency and the comfort of the working environment. Therefore, it is particularly important to reduce the noise level in the environment through advanced active noise reduction means. During active noise reduction, it generally includes audio acquisition, signal processing, noise reduction calculation and execution. Among them, the main means of audio acquisition is to collect a set number of audio data to obtain an audio signal with a predetermined frame length. Thereafter, noise reduction processing is achieved through signal processing and noise reduction calculation and execution steps.

[0003] However, in order to reduce the latency of active noise reduction, a common method is to reduce the frame length of the audio signal to shorten the processing time of active noise reduction. However, noise reduction algorithms usually require a large amount of data, and reducing the frame length will cause interrupts to be triggered frequently. The frequent recovery of these interrupts will bring a huge overhead to the processor (CPU) performing noise reduction, and it is necessary to have multiple interrupts before starting the noise reduction algorithm processing, which limits the MIPS (Million Instructions Per Second) of the active noise reduction algorithm occupying the CPU.

[0004] In order to solve the conflict between interrupt overhead and the real-time performance of active noise reduction, currently two methods can be adopted. Specifically: 1) Increase the audio sampling rate. It should be noted that when increasing the audio sampling rate, relatively professional audio acquisition equipment is required, and the problems of interrupt overhead and real-time performance are not fundamentally solved.

[0005] 2) Reduce the frame length of the audio signal. At this time, although the processing cycle of active noise reduction can be shortened, it will cause interrupts to be triggered frequently, increasing the CPU context switching overhead. And active noise reduction algorithms usually require a longer frame length to ensure the performance of active noise reduction, thus forming a "frame length - latency" contradiction and unable to meet the actual active noise reduction requirements. Summary of the Invention

[0006] The object of the present invention is to overcome the deficiencies in the prior art and provide a low-latency audio signal processing method and system, which can achieve low latency of active noise reduction, reduce the interrupt overhead of the CPU, and increase the MIPS upper limit of the CPU processing algorithm.

[0007] According to the technical solution provided by the present invention, a low-latency audio signal processing method, the audio signal processing method includes: Configuring noise reduction processing parameters for performing noise reduction processing on the audio signal, wherein the noise reduction processing parameters at least include a specified frame length for noise reduction processing when performing active noise reduction on the audio signal, Based on the configured noise reduction processing parameters, selecting a set of audio information to be noise reduced corresponding to the specified frame length for noise reduction processing, wherein the audio information to be noise reduced includes at least the acquired first audio signal to be noise reduced and the yet-to-be-acquired second audio signal to be noise reduced, and in a timing sequence of audio signal processing, the second audio signal to be noise reduced is immediately adjacent to the first audio signal to be noise reduced; When performing audio signal processing on any set of audio information to be de-noised, obtaining a second audio signal to be de-noised, wherein when obtaining the second audio signal to be de-noised, first obtaining a second audio first sub-signal within the second audio signal to be de-noised, and performing noise reduction calculation processing on the first audio signal to be de-noised during the process of obtaining the second audio first sub-signal, and generating a de-noised audio signal after performing the noise reduction calculation processing; After acquiring the second audio first sub-signal, transmitting and outputting the noise-reduced audio signal, and while transmitting and outputting the noise-reduced audio signal, acquiring the second audio second sub-signal within the second audio signal to be de-noised, thereafter forming the second audio signal to be de-noised based on the acquired second audio second sub-signal and the second audio first sub-signal, and using the acquired second audio signal to be de-noised as the first audio signal to be de-noised within the next set of audio information to be de-noised; The second audio first sub-signal has a first audio frame length, the second audio second sub-signal has a second audio frame length, and the sum of the first audio frame length and the second audio frame length is consistent with the specified frame length for noise reduction processing.

[0008] When sending the noise-reduced audio signal to the output, it includes: dividing the noise-reduced audio signal into a noise-reduced first sub-signal and a noise-reduced second sub-signal, wherein a frame length of the noise-reduced first sub-signal is consistent with a frame length of the second audio second sub-signal; When the reception of the second audio second sub-signal is completed, the sending and output of the noise-reduced first sub-signal is completed, and thereafter, the sending and output of the noise-reduced second sub-signal is completed.

[0009] For any group of audio information to be reduced in noise, when the second audio second sub-signal is received, the second audio signal to be reduced in noise forms the first audio signal to be reduced in noise in the next group of audio information to be reduced in noise, wherein: When the acquisition of the second audio first sub-signal in the second audio signal to be de-noised in the next set of audio information to be de-noised is completed, the sending and output of the current de-noised second sub-signal is terminated.

[0010] For any group of audio information to be noise-reduced, the first audio frame length of the first sub-signal of the second audio in the current group of audio information to be noise-reduced is generated at least according to the noise reduction calculation processing time performed on the first audio signal to be noise-reduced in the previous group.

[0011] For any group of audio information to be noise-reduced, when the reception of the first audio signal to be noise-reduced is completed, a noise reduction calculation execution interruption is triggered to perform noise reduction calculation processing on the first audio signal to be noise-reduced; When the acquisition of the first sub-signal of the second audio is completed, a noise reduction transmission interruption is triggered to transmit and output the noise-reduced audio signal after entering the noise reduction transmission interruption.

[0012] It further includes a frame length fine-tuning step to fine-tune the first audio frame length of the first sub-signal of the second audio by using the frame length fine-tuning step, where, When performing the frame length fine-tuning step, it includes: Configuring a frame length fine-tuning period for adaptively fine-tuning the first audio frame length; After the noise reduction processing of the audio signal has experienced the frame length fine-tuning period, within the current frame length fine-tuning period, count the external interruption information that occurs during the acquisition of each first sub-signal of the second audio, and generate fine-tuning weight information based on the acquired external interruption information, where the fine-tuning weight information includes several fine-tuning weight items; Based on the fine-tuning weight items in the above fine-tuning weight information and a pre-constructed fine-tuning model, calculate a fine-tuning weight value. When the fine-tuning weight value is greater than the fine-tuning threshold, the judgment status of the frame length fine-tuning judgment process is that the frame length can be fine-tuned; When the judgment status of the frame length fine-tuning judgment process is that the frame length can be fine-tuned and the frame length fine-tuning conditions are met, then fine-tune the first audio frame length of the first sub-signal of the corresponding group of audio information to be noise-reduced.

[0013] Within the frame length fine-tuning period, the counted external interruption information includes the interruption trigger times and the interruption processing time corresponding to each interruption trigger, where the types of external interruptions at least include UART interruptions; The fine-tuning weight items in the fine-tuning weight information include an interruption distribution uniformity item and an interruption trigger intensity item; The frame length fine-tuning conditions at least include the average noise reduction calculation processing time within the period and the average interruption time within the period. When the sum of the average noise reduction calculation processing time within the period and the average interruption time within the period is greater than the noise reduction calculation processing time corresponding to the current group of audio information to be noise-reduced, then the frame length fine-tuning conditions are met, otherwise, the frame length fine-tuning conditions are not met.

[0014] The fine-tuning threshold is 1. When the fine-tuning weight value is greater than 1, the judgment status of the frame length fine-tuning judgment process is that the frame length can be fine-tuned, otherwise, the judgment status of the frame length fine-tuning judgment process is that the frame length cannot be fine-tuned; When the frame length is updated, the first audio frame length of the second audio first sub-signal is increased by at least one audio frame length.

[0015] For the constructed fine-tuning model, there is:

[0016] Wherein, is the fine-tuning weight, is the distribution uniformity metric sub-term within the interruption distribution uniformity term, is the interruption trigger continuity factor within the interruption distribution uniformity term, is the average trigger intensity within the interruption trigger intensity term, is the stability factor within the interruption trigger intensity term, is the weight coefficient of the distribution uniformity metric sub-term, is the weight coefficient of the interruption trigger continuity factor.

[0017] A low-latency audio signal processing system includes at least an audio signal processing device for actively noise-canceling an audio signal. When actively noise-canceling the audio signal, the audio signal processing device uses the above-mentioned audio signal processing method.

[0018] Advantages of the present invention: For any group of audio information to be noise-canceled, when obtaining the second audio signal to be noise-canceled, first obtain the second audio first sub-signal within the second audio signal to be noise-canceled, and during the process of obtaining the second audio first sub-signal, perform noise-canceling calculation processing on the first audio signal to be noise-canceled, and generate a noise-canceled audio signal after performing the noise-canceling calculation processing; after obtaining the second audio first sub-signal, send and output the noise-canceled audio signal, and during the process of sending and outputting the noise-canceled audio signal, obtain the second audio second sub-signal within the second audio signal to be noise-canceled. Thereafter, form the second audio signal to be noise-canceled based on the obtained second audio second sub-signal and the second audio first sub-signal, and use the obtained second audio signal to be noise-canceled as the first audio signal to be noise-canceled within the next group of audio information to be noise-canceled. Thus, it can achieve low latency of active noise cancellation, reduce the interruption overhead of the CPU, and increase the MIPS upper limit of the CPU processing algorithm. Description of the Drawings

[0019] Figure 1 is a flowchart of an embodiment of the audio signal processing of the present invention.

[0020] Figure 2 is a schematic diagram of an embodiment of the present invention for receiving the second audio signal to be noise-canceled and sending the noise-canceled audio signal. Detailed Embodiments

[0021] The present invention will be further described below in conjunction with specific drawings and embodiments.

[0022] In order to achieve low latency in active noise cancellation, reduce the interruption overhead of the CPU, and increase the upper limit of MIPS for the CPU to process algorithms, the present invention provides a low-latency audio signal processing method. Specifically, the audio signal processing method includes: Configuring noise reduction processing parameters for noise reduction processing of audio signals, where the noise reduction processing parameters at least include a specified frame length for active noise cancellation of audio signals. Based on the configured noise reduction processing parameters, selecting a group of audio information to be noise-reduced corresponding to the specified frame length for noise reduction processing, where the audio information to be noise-reduced at least includes the first audio signal to be noise-reduced that has been acquired and the second audio signal to be noise-reduced that is to be acquired, and in the timing of audio signal processing, the second audio signal to be noise-reduced is adjacent to the first audio signal to be noise-reduced. When performing audio signal processing on any group of audio information to be noise-reduced, acquiring the second audio signal to be noise-reduced. When acquiring the second audio signal to be noise-reduced, first acquiring a first sub-signal of the second audio signal in the second audio signal to be noise-reduced, and during the process of acquiring the first sub-signal of the second audio signal, performing noise reduction calculation processing on the first audio signal to be noise-reduced, and generating a noise-reduced audio signal after performing the noise reduction calculation processing. After acquiring the first sub-signal of the second audio signal, sending and outputting the noise-reduced audio signal, and during the process of sending and outputting the noise-reduced audio signal, acquiring a second sub-signal of the second audio signal in the second audio signal to be noise-reduced. Thereafter, forming the second audio signal to be noise-reduced based on the acquired second sub-signal of the second audio signal and the first sub-signal of the second audio signal, and using the acquired second audio signal to be noise-reduced as the first audio signal to be noise-reduced in the next group of audio information to be noise-reduced. The first sub-signal of the second audio signal has a first audio frame length, the second sub-signal of the second audio signal has a second audio frame length, and the sum of the frame lengths of the first audio frame length and the second audio frame length is consistent with the specified frame length for noise reduction processing.

[0023] It should be understood that the audio signal processing method of the present invention mainly refers to the processing operation during active noise cancellation of audio signals. Figure 1 FIG. shows a flowchart of an embodiment of the present invention for processing audio signals. Figure 1It can be known that when processing an audio signal, noise reduction processing parameters should be configured. Specifically, the noise reduction processing parameters should at least include a specified frame length for noise reduction processing. Among them, the specified frame length for noise reduction processing specifically refers to the fixed frame length used in the above-mentioned active noise reduction processing; the situation of the specified frame length for noise reduction processing should be based on meeting the requirements of noise reduction processing. Of course, the noise reduction processing parameters should also include other necessary parameters, such as the sampling frequency for audio acquisition of the audio signal, etc. The situation of the noise reduction processing parameters can be selected according to needs, based on meeting the noise reduction processing of the audio signal.

[0024] After setting the sampling frequency of the audio signal, the specified frame length for noise reduction processing specifically refers to the number of audio sampling points that should be included, and the corresponding time length is determined according to the number of corresponding audio sampling points. For example, Figure 2 An embodiment in which the specified frame length for noise reduction processing is 15 frames is shown in Figure 2 That is, there are 15 audio sampling points within the specified frame length for noise reduction processing. According to the sampling frequency of the audio sampling points, the time length corresponding to the specified frame length for noise reduction processing can be obtained. Other situations can be referred to

[0025] In order to implement audio signal processing, after configuring the noise reduction processing parameters, a set of audio information to be noise-reduced corresponding to the noise reduction processing frame length should be selected. In an embodiment of the present invention, each set of audio information to be noise-reduced should include the acquired first audio signal to be noise-reduced and the to-be-acquired second audio signal to be noise-reduced. Specifically: the first audio signal to be noise-reduced is an audio signal that has been sampled, and the second audio signal to be noise-reduced is an audio signal to be sampled and generated. It should be understood that the corresponding frame lengths of the first audio signal to be noise-reduced and the second audio signal to be noise-reduced should both be the specified frame length for noise reduction processing.

[0026] In terms of the timing of audio signal processing, specifically, it refers to the time sequence of audio acquisition, audio reception, and noise reduction processing. The second audio signal to be noise-reduced should be adjacent to the first audio signal to be noise-reduced. For example, after receiving and acquiring the first audio signal to be noise-reduced, the second audio signal to be noise-reduced can be acquired immediately. That is, the first audio signal to be noise-reduced and the second audio signal to be noise-reduced are audio signals received in sequence. When the present invention performs audio signal noise reduction, the acquired first audio signal to be noise-reduced and the subsequent second audio signal to be noise-reduced are used as a set of audio information to be noise-reduced. It should be understood that for the acquired first audio signal to be noise-reduced, no noise reduction has been performed on the first audio signal to be noise-reduced, that is, no noise reduction calculation processing has been performed.

[0027] It should be noted that after a group of audio signals to be denoised is selected, the same signal processing is performed on each group of audio signals to be denoised. That is, during audio signal processing, the corresponding signal processing will be repeatedly executed. For example, the second audio signal to be denoised should be obtained. Here, obtaining the second audio signal to be denoised specifically means receiving the audio sampling points corresponding to forming the second audio signal to be denoised. The method of obtaining the second audio signal to be denoised and the first audio signal to be denoised is the same. For example, the audio sampling points are received in the same way. The specific way of receiving audio sampling points can be the same as the prior art and will not be elaborated here.

[0028] It can be Figure 1 seen that when the present invention obtains the second audio signal to be denoised, the second audio signal to be denoised is divided into two parts: the first sub-signal of the second audio and the second sub-signal of the second audio. That is, when receiving the second audio signal to be denoised, it includes two receiving stages. Among them, the first receiving stage performs the reception of the first sub-signal of the second audio, and the second stage performs the reception of the second sub-signal of the second audio. The specific meaning of reception can refer to the description of obtaining the second audio signal to be denoised above.

[0029] Specifically, when implemented, the first sub-signal of the second audio has a first audio frame length, the second sub-signal of the second audio has a second audio frame length, and the sum of the frame lengths of the first audio frame length and the second audio frame length is consistent with the specified frame length for denoising processing. From this, it can be seen that after the second audio signal to be denoised is divided into two parts, the number of audio sampling points included in the first sub-signal of the second audio and the second sub-signal of the second audio is equal to the number of specified audio sampling points within the specified frame length for denoising processing. Therefore, the second audio signal to be denoised can be composed of the first sub-signal of the second audio and the second sub-signal of the second audio. Different from the prior art, the audio sampling points in the second audio signal to be denoised in the present invention are not received all at once, but include two receiving stages. It should be understood that the two receiving stages are mainly to meet the requirement of performing denoising calculation processing on the first audio signal to be denoised under low-latency conditions, and the transmission output after performing the denoising calculation processing.

[0030] In specific implementation, a second-audio first sub-signal can be formed based on the previously received audio sampling points. For example, the audio sampling points with the same length as the first audio frame are received and used as the second-audio first sub-signal. In an embodiment of the present invention, during the process of receiving and forming the second-audio first sub-signal, noise reduction calculation processing is performed on the first audio signal to be noise-reduced. It should be understood that performing noise reduction calculation processing on the first audio signal to be noise-reduced means actively reducing the noise of the first audio signal to be noise-reduced. Thus, it can be seen that after performing noise reduction calculation processing on the first audio signal to be noise-reduced, a noise-reduced audio signal can be generated. Among them, the noise reduction calculation processing performed on the first audio signal to be noise-reduced can be consistent with the prior art. For example, it can be selected according to needs to meet the requirement of noise reduction processing for the first audio signal to be noise-reduced.

[0031] As can be seen from the above description, the frame length of the second-audio first sub-signal should be not less than the time for performing noise reduction calculation processing on the first audio signal to be noise-reduced. After receiving the second-audio first signal, the noise-reduced audio signal should be sent out. The way of sending out the noise-reduced audio signal can be consistent with the prior art. For example, it can be sent out through DMA, which will not be elaborated here. Completing the acquisition of the second-audio first sub-signal specifically means receiving all the audio sampling points required to form the second-audio first sub-signal.

[0032] Generally, after completing the acquisition of the second-audio first sub-signal and sending out the noise-reduced audio signal, the second-audio second sub-signal should be acquired. That is, during the process of sending out the noise-reduced audio signal, the second-audio second sub-signal in the second audio signal to be noise-reduced is acquired. The way of acquiring the second-audio second sub-signal can refer to the above description and will not be elaborated here. After the second-audio second sub-signal is acquired, the second audio signal to be noise-reduced is obtained. At this time, the obtained second audio signal to be noise-reduced can be used as the first audio signal to be noise-reduced in the next group of audio information to be noise-reduced. After that, the above-mentioned same audio signal processing is performed on the next group of audio information to be noise-reduced.

[0033] As can be seen from the above description, the present invention can effectively solve the contradiction of "frame length - delay" in the prior art. That is, in the case of using a specified frame length for noise reduction processing, noise reduction calculation processing is performed on the first audio signal to be noise-reduced during the process of acquiring the second-audio first sub-signal, and after the second-audio first sub-signal is acquired, the noise-reduced audio signal is sent out; and during the process of the second-audio second sub-signal, the noise-reduced audio signal can be sent out synchronously, which can effectively reduce the delay in the existing active noise reduction and achieve an audio processing effect with extremely low delay.

[0034] In an embodiment of the present invention, for any group of audio information to be noise-reduced, the first audio frame length of the second-audio first sub-signal in the current group of audio information to be noise-reduced is generated at least according to the time of performing noise reduction calculation processing on the first audio signal to be noise-reduced in the previous group.

[0035] In order to further reduce the latency, the first audio frame length of the second audio first sub-signal can be generated according to the noise reduction calculation time performed on the previous group of first audio signals to be noise-reduced. For example, according to the timing of processing the audio signal as described above, when performing audio signal processing on the third group of audio information to be noise-reduced, the first audio frame length of the second audio first sub-signal within the third group of audio information to be noise-reduced can be determined by statistically calculating the corresponding time for performing the noise reduction calculation processing on the first audio signal to be noise-reduced within the second group of audio signals to be noise-reduced. That is, after statistically obtaining the corresponding time for performing the noise reduction calculation processing on the first audio signal to be noise-reduced within the second group of audio signals to be noise-reduced, the first audio frame length of the second audio first sub-signal within the third group can be configured to be the corresponding time for statistically performing the noise reduction calculation processing. Of course, the first audio frame length should be equal to or slightly greater than the corresponding time for statistically performing the noise reduction calculation processing, which is specifically related to the sampling frequency within the noise reduction processing parameters. It can be understood that after determining the first audio frame length, the corresponding audio sampling points can be determined within the second audio first sub-signal.

[0036] In the initial situation, the first audio frame length and the second audio frame length are set according to the situation of the noise reduction calculation processing, such as Figure 2 In it, in the initial situation, the second audio first sub-signal can include 2 audio sampling points, and the second audio second sub-signal should include 13 audio sampling points. From Figure 2 it can be seen that after setting the first audio frame length and the second audio frame length, when receiving the first audio signal, at this time, the received audio signal only corresponds to the second audio signal to be noise-reduced, and at this time, there is no noise-reduced audio signal, nor is there a transmission and output operation of the noise-reduced audio signal. From the above description, it can be known that after receiving the first audio signal, a first audio signal to be noise-reduced within a group of audio information to be noise-reduced can be formed. After that, it can form the first group of audio information to be noise-reduced with the next second audio signal to be obtained to be noise-reduced. Figure 2 In it, the green part is the first audio signal to be noise-reduced within the first group of audio information to be noise-reduced, and the orange part is the second audio signal to be noise-reduced. Figure 2 In it, in the data reception part, "Frame 1" is the second audio first sub-signal of the present invention, and "Frame 2" is the second audio second sub-signal of the present invention.

[0037] In an embodiment of the present invention, when sending and outputting the noise-reduced audio signal, it includes: Dividing the noise-reduced audio signal into a noise-reduced first sub-signal and a noise-reduced second sub-signal, wherein the frame length of the noise-reduced first sub-signal is the same as that of the second audio second sub-signal; When receiving the second audio second sub-signal is completed, sending and outputting the noise-reduced first sub-signal is completed, and thereafter, sending and outputting the noise-reduced second sub-signal.

[0038] In order to reduce the interruption trigger when sending the output, the denoised audio signal can be sent and output in two parts. For example, the denoised audio signal can be divided into a first denoised sub-signal and a second denoised sub-signal. It can be understood that the division here only divides the order of sending the corresponding audio sampling points and does not change the content of the denoised audio signal. When specifically implemented, the frame length of the first denoised sub-signal is the same as that of the second denoised sub-signal of the second audio. For example, Figure 2 in the data sending part, the green part is the denoised audio signal, and the denoised audio signal is Figure 2 the audio signal corresponding to the green part in the data receiving part of. In the data sending part, frames 1-13 are the frame length of the first denoised sub-signal. Corresponding to the data receiving part, frames 2-13 are the frame length of the second denoised sub-signal of the second audio. When the frame lengths of the two are equal, the interruption trigger can be reduced and the latency can be further reduced.

[0039] In an embodiment of the present invention, for any group of audio information to be denoised, when the second denoised sub-signal of the second audio is received completely, the second audio signal to be denoised forms the first audio signal to be denoised that has been obtained within the next group of audio information to be denoised. Among them, when the first sub-signal of the second audio within the second audio signal to be denoised within the next group of audio information to be denoised is received completely, the sending and output of the current second denoised sub-signal is terminated.

[0040] Specifically, for each group of audio information to be denoised, when the second denoised sub-signal of the second audio is received completely, the first audio signal to be denoised can be formed by the second denoised sub-signal of the second audio and the above-mentioned first sub-signal of the second audio. At the same time, the second audio signal to be denoised forms the first audio signal to be denoised that has been obtained within the next group of audio information to be denoised.

[0041] Since the frame length of the first denoised sub-signal is the same as that of the second denoised sub-signal of the second audio, when the second denoised sub-signal of the second audio is received completely, the sending and output of the first denoised sub-signal is completed. And during the acquisition process of the first sub-signal of the second audio within the next group of audio information to be denoised, the second denoised sub-signal is sent and output synchronously. When the acquisition of the first sub-signal of the second audio within the next group of audio information to be denoised is completed, the sending and output of the current second denoised sub-signal should be terminated. It should be understood that the sending situation of the second denoised sub-signal should be related to the frame length of the current second denoised sub-signal and the first audio frame length of the corresponding first signal of the second audio. For specific reference, please refer to the following corresponding description, such as Figure 2 shown.

[0042] In an embodiment of the present invention, for any group of audio information to be noise-reduced, when the reception of the first audio signal to be noise-reduced is completed, a noise reduction calculation execution interruption is triggered to perform noise reduction calculation processing on the first audio signal to be noise-reduced; When the acquisition of the first sub-signal of the second audio is completed, a noise reduction transmission interruption is triggered, so that after entering the noise reduction transmission interruption, the noise-reduced audio signal is transmitted and output.

[0043] In order to accurately execute the above audio signal processing, when the reception of the first audio signal to be noise-reduced is completed, a noise reduction calculation execution interruption is triggered to perform noise reduction calculation processing on the first audio signal to be noise-reduced. Specifically, as can be seen from the above description, when the reception of the first audio signal to be noise-reduced is completed, it means that the reception of the second sub-signal of the second audio is completed, and the second audio signal to be noise-reduced in the audio information to be noise-reduced in the previous group forms the first audio signal to be noise-reduced in the current group of audio information to be noise-reduced. When the noise reduction calculation execution interruption is triggered, the interruption program will be entered, so that the noise reduction calculation processing on the first audio signal to be noise-reduced can be realized.

[0044] It should be noted that after triggering and entering the noise reduction calculation execution interruption, it is mainly to perform noise reduction calculation processing on the first audio signal to be noise-reduced, and it will not affect the reception of the first sub-signal of the second audio. When the reception of the first sub-signal of the second audio is completed, a noise reduction transmission interruption is triggered, so that after entering the noise reduction transmission interruption, the noise-reduced audio signal is transmitted and output.

[0045] As can be seen from the above description, when performing audio signal processing on each group of audio information to be noise-reduced, two interruptions will be triggered. Through the two interruptions, the noise reduction calculation processing and the transmission and output of the noise-reduced audio signal can be entered respectively. Therefore, the number of interruption triggers during active noise reduction for each group of audio information to be noise-reduced can be reduced, thereby reducing the interruption overhead of the CPU (Central Processing Unit) and increasing the MIPS upper limit of the CPU processing algorithm.

[0046] As can be seen from the above description, the first audio frame length of the first sub-signal of the second audio in each group of audio information to be noise-reduced can be determined based on the time for performing noise reduction calculation processing on the first audio signal to be noise-reduced in the previous group of audio information to be noise-reduced. However, during the process of performing audio information processing, external interruptions may occur. For example, external interruptions may occur during the acquisition of the first sub-signal of the second audio, especially when external interruptions occur multiple times, it may lead to a deviation in the statistics of the time for performing noise reduction calculation processing, which will affect the accuracy of configuring the first audio frame length. It should be understood that when the configuration of the first audio frame length is not precise enough, a new delay will be caused.

[0047] In order to improve the accuracy of the first audio frame length configuration and reduce the latency of audio processing, in an embodiment of the present invention, a frame length fine-tuning step is further included to fine-tune the first audio frame length of the first sub-signal of the second audio by using the frame length fine-tuning step, where When performing the frame length fine-tuning step, it includes: Configuring a frame length fine-tuning period for adaptively fine-tuning the first audio frame length; After the noise reduction process of the audio signal has gone through the frame length fine-tuning period, within the current frame length fine-tuning period, count the external interruption information that occurs during the acquisition of each first sub-signal of the second audio, and generate fine-tuning weight information based on the acquired external interruption information, where the fine-tuning weight information includes a number of fine-tuning weight items; Based on the fine-tuning weight items in the above fine-tuning weight information and a pre-constructed fine-tuning model, calculate a fine-tuning weight value. When the fine-tuning weight value is greater than the fine-tuning threshold, the judgment status of performing the frame length fine-tuning judgment process is that the frame length can be fine-tuned; When the judgment status of performing the frame length fine-tuning judgment process is that the frame length can be fine-tuned and the frame length fine-tuning condition is satisfied, then perform frame length fine-tuning on the first audio frame length of the first sub-signal of the corresponding group of audio information to be noise-reduced.

[0048] Specifically, the first audio frame length can be fine-tuned through the frame length fine-tuning step to avoid deviation in the setting of the first audio frame length caused by external interruptions. When performing adaptive fine-tuning, the frame length fine-tuning period should be set. The frame length fine-tuning period starts from the second audio signal to be noise-reduced in the first group of audio information to be noise-reduced and goes through the number of received first sub-signals of the second audio. For example, the frame length fine-tuning period can be 10. At this time, after going through 10 groups of audio information to be noise-reduced, that is, performing the above noise reduction calculation process 10 times, the frame length fine-tuning step of the present invention is executed. Of course, the frame length fine-tuning period can also be other values, which can be specifically selected according to actual needs and will not be elaborated here.

[0049] In specific implementation, after setting the frame length fine-tuning period, a sliding window method is adopted to determine the execution of the frame length fine-tuning step. For example, sliding the window from the initial situation, when the frame length fine-tuning period is satisfied, the corresponding frame length fine-tuning step is executed. For example, when the frame length fine-tuning period is 10, starting from the first group of audio information to be denoised, the frame length fine-tuning step is executed when reaching the 10th group of audio information to be denoised. In addition, starting from the second group of audio information to be denoised, the frame length fine-tuning step should also be executed when reaching the 11th group of audio information to be denoised, and so on for other cases. Of course, the way to execute the frame length fine-tuning step can also be other situations. For example, the frame length fine-tuning step is executed every 10 groups of audio information to be denoised. At this time, starting from the first group of audio information to be denoised, the frame length fine-tuning step is executed when reaching the 10th group of audio information to be denoised, and starting from the 11th group of audio information to be denoised, the frame length fine-tuning step is executed when reaching the 20th group of audio information to be denoised. The specific way to execute the frame length fine-tuning step can be selected according to needs and will not be listed one by one here.

[0050] After setting the above frame length fine-tuning period, when the signal processing performed on the audio signal experiences the set frame length fine-tuning period, the external interrupt information within the current frame length fine-tuning period should be counted. Among them, the external interrupt information is at least the external interrupt that occurs during the process of obtaining the first sub-signal of the second audio. As can be seen from the above description, the external interrupt should be other interrupts except for the noise reduction calculation execution interrupt and the noise reduction transmission interrupt; in addition, the counted external interrupt should be the external interrupt that occurs during the process of obtaining the first sub-signal of the second audio within each group of audio information to be denoised within the frame length fine-tuning period. Therefore, the counted number should be consistent with the frame length fine-tuning period. The method and process of counting the external interrupt information can be consistent with the prior art.

[0051] According to the counted external interrupt information, the fine-tuning weight information can be generated. The fine-tuning weight information can include several fine-tuning weight items. In specific implementation, within the frame length fine-tuning period, the counted external interrupt information includes the interrupt trigger times and the interrupt processing time corresponding to each interrupt trigger. Among them, the types of external interrupts at least include UART (Universal Asynchronous Receiver / Transmitter) interrupts; the fine-tuning weight items in the fine-tuning weight information include the interrupt distribution uniformity item and the interrupt trigger intensity item. Of course, the fine-tuning weight information and the fine-tuning weight items can also be other situations, which can be specifically selected according to needs to meet the fine-tuning of the first audio frame length in the present invention.

[0052] After obtaining the fine-tuned weight terms, substitute the fine-tuned weight terms into the pre-constructed fine-tuning model, from which the fine-tuned weights for the current frame length fine-tuning period can be calculated. Thereafter, compare the fine-tuned weights with the fine-tuning threshold. When the calculated fine-tuned weights are greater than the fine-tuning threshold, the first audio frame length should be fine-tuned; otherwise, the first audio frame length may not be fine-tuned. Among them, when comparing the fine-tuned weights with the fine-tuning threshold, the frame length fine-tuning judgment process is executed. When the fine-tuned weights are greater than the fine-tuning threshold, the judgment status of the frame length fine-tuning judgment process is that the frame length is fine-tunable.

[0053] In specific implementation, when the judgment status of the frame length fine-tuning judgment process is that the frame length is fine-tunable and the frame length fine-tuning condition is satisfied, the frame length of the first audio sub-signal of the second audio in the corresponding group of audio information to be denoised is fine-tuned. Among them, the corresponding group of audio information to be denoised specifically refers to the next group of audio information to be denoised corresponding to the group of audio information to be denoised corresponding to the frame length fine-tuning period. For example, when the above frame length fine-tuning period is 10, the corresponding group of audio information to be denoised can be the next group of audio information after experiencing 10 groups of audio information to be denoised. For example, if the experienced frame length fine-tuning period is from the first group of audio information to be denoised to the 10th group of audio information to be denoised, the corresponding group of audio information to be denoised is the 11th group of audio information to be denoised.

[0054] In an embodiment of the present invention, for the constructed fine-tuning model, there is:

[0055] Among them, is the fine-tuned weight, is the distribution uniformity degree sub-term in the interruption distribution uniformity term, is the interruption trigger continuity factor in the interruption distribution uniformity term, is the average trigger intensity in the interruption trigger intensity term, is the stability factor in the interruption trigger intensity term, is the weight coefficient of the distribution uniformity degree sub-term, is the weight coefficient of the interruption trigger continuity factor.

[0056] As can be seen from the above description, the interruption distribution uniformity term may include the distribution uniformity degree sub-term and the interruption trigger continuity factor , the interruption trigger intensity term includes the average trigger intensity and the stability factor , the sum of the weight coefficient and the weight coefficient should be 1. Generally, the weight coefficient can take a value of 0.6, and the weight coefficient can take a value of 0.4.

[0057] When determining the distribution uniformity metric , interrupt trigger continuity factor , average trigger strength and stability factor After that, substitute the above fine-tuning model to get the corresponding fine-tuning weight Q, and then calculate the fine-tuning weight Q. Next, we will determine the distribution uniformity metric sub-item. , interrupt trigger continuity factor , average trigger strength and stability factor Explain the situation.

[0058] If the frame length fine-tuning period is 10, the statistical external interrupt information may include 10 interrupt triggering frequency sequences, and thus: ,in, is the number of external interruptions that occur during the process of obtaining the first sub-signal of the second audio in the first group of audio information to be noise reduced, For the The number of external interruptions that occur during the process of obtaining the second audio first sub-signal from the set of audio information to be noise reduced, and so on for other cases. If 5 external interruptions occur during the process of obtaining the first sub-signal of the second audio in the first group of audio information to be reduced, the number of Should be 5. For other values of times, please refer to the instructions here.

[0059] For the distribution uniformity metric , then:

[0060] From the above distribution uniformity measurement sub-item From the calculation expression, we can see that the distribution uniformity metric sub-item The value range is [0, 1], where the distribution uniformity metric When it is 0, it indicates that the external interrupt trigger is completely unevenly distributed, and the distribution uniformity measurement sub-item When it is 1, it indicates that the external interrupt trigger is completely evenly distributed. At this time, the number of ~Number of times The values of are all equal, and n is the value of the frame length fine-tuning period.

[0061] For interrupt trigger continuity factor (Trigger continuity factor, TCF), then: =Number of non-zero trigger frames / n-length of the longest zero trigger sequence / n; In specific implementation, for triggering non-zero frame numbers, there is: among the number of times ~ the number of times , the non-zero values. For the longest zero-trigger sequence length, that is, the length of consecutive non-zero values, such as the number of times ~ the number of times are all not 0, then the longest zero-trigger sequence length is 5. If the number of times ~ the number of times , the corresponding sequence is: 2, 0, 3, 0, 4, 0, 1, 0, 2, 0, then the longest zero-trigger sequence length is 1, and so on for other cases, which will not be exemplified one by one here.

[0062] From the above calculation method of the interrupt trigger continuity factor , it can be seen that the trigger coverage rate triggered by external interrupts can be characterized by the number of non-zero trigger frames / n, and the longest zero-trigger sequence length / n can be used to punish the lack of external interrupt triggers for a long time.

[0063] For the average trigger intensity (Average trigger intensity, ATI), there is: .

[0064] For the stability factor (Stability factor, TSF), there is:

[0065] Among them, (Coefficient of Variation, CV) is the coefficient of variation, and the value range of the stability factor is: (0, 1], and the larger the value of the stability factor , the more stable it represents.

[0066] In an embodiment of the present invention, the fine-tuning threshold is 1. When the fine-tuning weight is greater than 1, the judgment state of performing the frame length fine-tuning judgment process is that the frame length can be fine-tuned; otherwise, the judgment state of the frame length fine-tuning judgment process is that the frame length cannot be fine-tuned; When the frame length is updated, the first audio frame length of the second audio first sub-signal is increased by at least 1 audio frame length.

[0067] When the fine-tuning model adopts the above expression form, the fine-tuning threshold should be 1. Therefore, when the fine-tuning weight is greater than 1, the judgment state of performing the frame length fine-tuning judgment process is that the frame length can be fine-tuned; otherwise, the judgment state of the frame length fine-tuning judgment process is that the frame length cannot be fine-tuned. However, when the fine-tuning model adopts other forms, the corresponding fine-tuning threshold can be set accordingly, which will not be exemplified one by one here.

[0068] In an embodiment of the present invention, the frame length fine-tuning conditions at least include the average noise reduction calculation processing time within a period and the average interruption time within a period. Wherein, when the sum of the average noise reduction calculation processing time within a period and the average interruption time within a period is greater than the noise reduction calculation processing time corresponding to the audio information to be noise-reduced in the current group, the frame length fine-tuning conditions are satisfied; otherwise, the frame length fine-tuning conditions are not satisfied.

[0069] During specific implementation, to statistically obtain the above-mentioned external interruption information, common technical means in the technical field can be used to statistically obtain the average noise reduction calculation processing time within a period and the average interruption time within a period. For example, when the frame length fine-tuning period is n, the time for each execution of noise reduction calculation processing within the frame length fine-tuning period is statistically obtained. Thereafter, the n times of noise reduction calculation processing times are averaged to obtain the average noise reduction calculation processing time within a period. Similarly, during the process of statistically obtaining the first sub-signal of the second audio, the interruption processing time of each external interruption is statistically obtained. Thereafter, the sum of the interruption processing times corresponding to all external interruptions is added and divided by the number of all external interruptions to calculate the average interruption time within a period.

[0070] The sum of the average noise reduction calculation processing time within a period and the average interruption time within a period specifically refers to the cumulative sum of the average noise reduction calculation processing time within a period and the average interruption time within a period. The noise reduction calculation processing time corresponding to the audio information to be noise-reduced in the current group specifically refers to the noise reduction calculation processing time executed for the nth group of audio information to be noise-reduced.

[0071] In an embodiment of the present invention, when the sum of the average noise reduction calculation processing time within a period and the average interruption time within a period is greater than the noise reduction calculation processing time corresponding to the audio information to be noise-reduced in the current group, it is considered that the frame length fine-tuning conditions are satisfied; otherwise, it should be considered that the frame length fine-tuning conditions are not satisfied.

[0072] When the frame length is updated, the first audio frame length of the first sub-signal of the second audio is increased by at least 1 audio frame length. As described above, when the first audio frame length includes 2 audio sampling points, after increasing by 1 audio frame length, the first audio frame length should include 3 audio sampling points. It should be noted that when the frame length fine-tuning conditions are not satisfied, the first audio frame length within the above-mentioned n + 1 groups of audio information to be noise-reduced should be determined according to the noise reduction calculation processing time executed for the first audio signal to be noise-reduced within the n groups of audio information to be noise-reduced. The specific determination method can refer to the above description and will not be elaborated here.

[0073] Figure 2 In it, n1 and n3 are the adjusted first audio frame lengths. As can be seen from the above description, n1 + n2 = n3 + n4, and the cumulative sum of n1 + n2 is consistent with the value corresponding to the specified frame length for the above noise reduction processing.

[0074] It can be understood that when the first audio frame length is configured as above or fine-tuned by the frame length fine-tuning step, it may result in a situation where the first audio frame length in the next set of audio information to be noise-reduced is not equal to the frame length corresponding to the second sub-signal that has been noise-reduced in the current transmitted output. For example, Figure 2 in Figure 2 , n1 is not equal to the frame length corresponding to frames 1-2 in the green part. The following will be described in combination with the situation of the corresponding first audio frame length and the frame length of the second sub-signal that has been noise-reduced.

[0075] Specifically, the noise-reduced audio signal is generally sent out by DMA (Direct Memory Access). When the first audio frame length is greater than the frame length corresponding to the second sub-signal that has been noise-reduced, after the second sub-signal that has been noise-reduced is sent out, the corresponding first sub-signal of the second audio is still in the receiving process. Since DMA generally uses cyclic transmission, at this time, the cyclic transmission method of DMA can still be maintained. For example, the corresponding number of audio points in the first sub-signal that can be noise-reduced can be sent. The number of audio points should be the difference between the first audio frame length and the frame length corresponding to the second sub-signal that has been noise-reduced. At this time, the frame length of the audio information sent out is greater than the specified frame length for noise reduction processing.

[0076] When the first audio frame length is less than the frame length corresponding to the second sub-signal that has been noise-reduced, when the corresponding first sub-signal of the second audio is received, the second sub-signal that has been noise-reduced has not been sent out yet. At this time, the transmission of the second sub-signal that has been noise-reduced will be terminated, and instead, the noise-reduced audio information in the current set of audio information to be noise-reduced will be sent out. Figure 2 in Figure 2 , when n1 is less than the frame length corresponding to frames 1-2, the transmission of frames 1-2 in the green part will be terminated, and the noise-reduced audio signal formed in the second set of audio information to be noise-reduced in the orange part will be sent out.

[0077] Therefore, it can be seen from the above description that during the process of sending out the noise-reduced audio signal, there may be a situation where the frame length of the sent noise-reduced audio signal is inconsistent with the specified frame length for noise reduction processing. At this time, specific processing can be carried out through subsequent audio processing steps. For example, the corresponding audio signal can be directly played and output. It can be understood that although in some cases, the frame length of the noise-reduced audio signal is inconsistent with the specified frame length for noise reduction processing, since the difference between the first audio frame length and the frame length corresponding to the second sub-signal that has been noise-reduced is generally small, generally, it will not affect the subsequent specific processing of the audio signal, that is, it will not affect the subsequent processing of active noise reduction.

[0078] From the above description, a low-latency audio signal processing system can be obtained. In an embodiment of the present invention, it at least includes an audio signal processing device for actively noise-reducing an audio signal. Among them, when actively noise-reducing the audio signal, the audio signal processing device adopts the above-mentioned audio signal processing method.

[0079] Specifically, the audio signal processing device may adopt a computer terminal in the prior art that can perform the above noise reduction processing. The manner and process of the audio signal processing device for active noise reduction of the audio signal may refer to the above description and will not be elaborated here.

Claims

1. A method for processing audio signals with low latency, characterized in that, The audio signal processing method includes: Configuring noise reduction processing parameters for noise reduction processing of the audio signal, where the noise reduction processing parameters at least include a specified frame length for active noise reduction of the audio signal. Based on the configured noise reduction processing parameters, selecting a set of audio information to be noise-reduced corresponding to the specified frame length for noise reduction processing, where the audio information to be noise-reduced at least includes the first audio signal to be noise-reduced that has been acquired and the second audio signal to be noise-reduced that is to be acquired, and in the timing of processing the audio signal, the second audio signal to be noise-reduced is adjacent to the first audio signal to be noise-reduced. When performing audio signal processing on any set of audio information to be noise-reduced, acquiring the second audio signal to be noise-reduced. When acquiring the second audio signal to be noise-reduced, first acquiring a first sub-signal of the second audio signal in the second audio signal to be noise-reduced, and during the process of acquiring the first sub-signal of the second audio signal, performing noise reduction calculation processing on the first audio signal to be noise-reduced, and generating a noise-reduced audio signal after performing the noise reduction calculation processing. After acquiring the first sub-signal of the second audio signal, sending and outputting the noise-reduced audio signal, and during the process of sending and outputting the noise-reduced audio signal, acquiring a second sub-signal of the second audio signal in the second audio signal to be noise-reduced. Thereafter, forming the second audio signal to be noise-reduced based on the acquired second sub-signal of the second audio signal and the first sub-signal of the second audio signal, and using the acquired second audio signal to be noise-reduced as the first audio signal to be noise-reduced in the next set of audio information to be noise-reduced. The first sub-signal of the second audio signal has a first audio frame length, the second sub-signal of the second audio signal has a second audio frame length, and the sum of the frame lengths of the first audio frame length and the second audio frame length is consistent with the specified frame length for noise reduction processing.

2. The low-latency audio signal processing method according to claim 1, wherein: When sending and outputting the noise-reduced audio signal, it includes: Dividing the noise-reduced audio signal into a first sub-signal of the noise-reduced audio signal and a second sub-signal of the noise-reduced audio signal, where the frame length of the first sub-signal of the noise-reduced audio signal is consistent with the frame length of the second sub-signal of the second audio signal. When receiving the second sub-signal of the second audio signal is completed, sending and outputting the first sub-signal of the noise-reduced audio signal is completed, and thereafter, sending and outputting the second sub-signal of the noise-reduced audio signal.

3. The low-latency audio signal processing method according to claim 2, characterized in that: For any set of audio information to be noise-reduced, when receiving the second sub-signal of the second audio signal is completed, the second audio signal to be noise-reduced forms the first audio signal to be noise-reduced that has been acquired in the next set of audio information to be noise-reduced, where When acquiring the first sub-signal of the second audio signal in the second audio signal to be noise-reduced in the next set of audio information to be noise-reduced is completed, terminating the sending and outputting of the current second sub-signal of the noise-reduced audio signal.

4. The low-latency audio signal processing method according to any one of claims 1 to 3, characterized in that: For any set of audio information to be noise-reduced, the first audio frame length of the first sub-signal of the second audio signal in the current set of audio information to be noise-reduced is at least generated according to the noise reduction calculation processing time performed on the first audio signal to be noise-reduced in the previous set.

5. The low-latency audio signal processing method according to claim 4, characterized in that: For any set of audio information to be noise-reduced, when receiving the first audio signal to be noise-reduced is completed, triggering an interruption of the execution of the noise reduction calculation to perform noise reduction calculation processing on the first audio signal to be noise-reduced. When acquiring the first sub-signal of the second audio signal is completed, triggering a noise reduction sending interruption to send and output the noise-reduced audio signal after entering the noise reduction sending interruption.

6. The low-latency audio signal processing method according to claim 4, characterized in that: It further includes a frame length fine-tuning step to fine-tune the first audio frame length of the first sub-signal of the second audio by using the frame length fine-tuning step, wherein, When performing the frame length fine-tuning step, it includes: Configuring a frame length fine-tuning period for adaptively fine-tuning the first audio frame length; After the noise reduction processing of the audio signal goes through the frame length fine-tuning period, within the current frame length fine-tuning period, count the external interruption information that occurs during the acquisition of each first sub-signal of the second audio, and generate fine-tuning weight information based on the acquired external interruption information, wherein the fine-tuning weight information includes several fine-tuning weight items; Based on the fine-tuning weight items within the above-mentioned fine-tuning weight information and a pre-constructed fine-tuning model, calculate the fine-tuning weight value. When the fine-tuning weight value is greater than the fine-tuning threshold, the judgment status of performing the frame length fine-tuning judgment process is that the frame length is fine-tunable; When the judgment status of performing the frame length fine-tuning judgment process is that the frame length is fine-tunable and the frame length fine-tuning condition is met, then fine-tune the first audio frame length of the first sub-signal of the corresponding group of audio information to be noise-reduced.

7. The low-latency audio signal processing method according to claim 6, wherein: Within the frame length fine-tuning period, the counted external interruption information includes the interruption trigger times and the interruption processing time corresponding to each interruption trigger. Among them, the type of external interruption includes at least UART interruption; The fine-tuning weight items within the fine-tuning weight information include an interruption distribution uniformity item and an interruption trigger intensity item; The frame length fine-tuning condition includes at least the average noise reduction calculation processing time within the period and the average interruption time within the period. Among them, when the sum of the average noise reduction calculation processing time within the period and the average interruption time within the period is greater than the noise reduction calculation processing time corresponding to the current group of audio information to be noise-reduced, then the frame length fine-tuning condition is met; otherwise, the frame length fine-tuning condition is not met.

8. The low-latency audio signal processing method according to claim 7, wherein: The fine-tuning threshold is 1. When the fine-tuning weight value is greater than 1, the judgment status of performing the frame length fine-tuning judgment process is that the frame length is fine-tunable; otherwise, the judgment status of the frame length fine-tuning judgment process is that the frame length is not fine-tunable; When updating the frame length, increase the first audio frame length of the first sub-signal of the second audio by at least 1 audio frame length.

9. The low-latency audio signal processing method according to claim 7, wherein Regarding the constructed fine-tuning model, there is: Among them, is the fine-tuning weight,[[]]END]] is the distribution uniformity sub-term within the interruption distribution uniformity term,[[]]END]] is the interruption trigger continuity factor within the interruption distribution uniformity term,[[]]END]] is the average trigger intensity within the interruption trigger intensity term,[[]]END]] is the stability factor within the interruption trigger intensity term,[[]]END]] is the weight coefficient of the distribution uniformity sub-term,[[]]END]] is the weight coefficient of the interruption trigger continuity factor.[[]]END]] 10. A low-latency audio signal processing system, characterized in that, It at least includes an audio signal processing device for actively reducing noise of the audio signal. When actively reducing noise of the audio signal, the audio signal processing device adopts the audio signal processing method described in any one of claims 1 to 9 above.

Citation Information

Patent Citations

  • Sound collection method, system and apparatus

    CN107071647A

  • Hearing aid method and system based on audio coding and decoding, earphone, medium and equipment

    CN113259827A

  • Wireless earphone with active noise reduction function and noise reduction method thereof

    CN113727234A

  • Coal mine dispatching room audio automatic understanding method based on deep learning

    CN117437920A

  • Voiceprint noise reduction method, electronic equipment and storage medium

    CN118301518A