An audio dynamic gain equalization method and system

Abstract

The present invention discloses a method and system for dynamic gain equalization of audio, specifically related to the technical field of audio processing; the dynamic gain equalization system is tested through the collected audio sample data; and the test results are analyzed to evaluate the dynamics of the system's adjustment for each frequency band and the accuracy of audio quality fusion; the dynamics of the system's adjustment for each frequency band and the accuracy of audio quality fusion are comprehensively analyzed to evaluate the consistency of the performance of the dynamic gain equalization system between different sound sources. The performance of the dynamic gain equalization system between different sound sources is divided into consistent performance and inconsistent performance, and corresponding processing is carried out respectively; the consistency of the performance of the processed dynamic gain equalization system between different sound sources is further analyzed and optimized, which helps to improve the stability and performance consistency of the system when processing different types of audio, thereby improving the user's auditory experience.

Description

Technical Field

[0001] The present invention relates to the technical field of audio processing, and particularly relates to an audio dynamic gain equalization method and system. Background Art

[0002] Audio dynamic gain equalization is an audio processing technology aimed at automatically adjusting the gain (volume) of an audio signal to maintain a stable output level. This technology can dynamically increase or decrease the gain of different frequency bands according to the real-time changes of the input audio, so as to ensure the balance and consistency of the audio output. In this way, even if the volume of the sound source changes greatly, the finally output volume can be maintained within a relatively stable and comfortable range, avoiding the problems of too loud or too soft sound.

[0003] Dynamic gain equalization analyzes and processes in real time by detecting the instantaneous amplitude and frequency content of the audio signal. When it detects that the volume of certain frequency bands is too high, it will automatically reduce the gain of these frequencies; conversely, when the volume of certain frequency bands is too low, it will increase the corresponding gain. This technology not only improves the clarity and audibility of the audio, but also provides a better auditory experience in various environments, especially in noisy environments or when the sound source quality is unbalanced.

[0004] The prior art has the following deficiencies:

[0005] In the prior art, when improving the audio output quality through audio dynamic gain equalization, the dynamic gain equalization system may perform inconsistently between different sound sources, resulting in unstable effects when processing different types of audio. For example, when processing music and speech, the system may require different parameter settings, but the dynamic gain equalization system may not be able to adapt to this change well. And if the dynamic gain equalization system cannot maintain consistent performance between different sound sources, then it may cause the audio quality to decline when processing different types of audio. It may be manifested as the audio sounding chaotic, distorted or unclear, thus affecting the user's auditory experience. Summary of the Invention

[0006] The purpose of the present invention is to provide an audio dynamic gain equalization method and system to solve the deficiencies in the background art.

[0007] To achieve the above purpose, the present invention provides the following technical solution: An audio dynamic gain equalization method, including the following steps:

[0008] S1: Collect audio sample data of different types of sound sources and set a test environment. Use the collected audio sample data to test the dynamic gain equalization system in the test environment, and record the test results;

[0009] S2: Analyze the test results, and based on the variation of the gain values in each frequency band, determine the retention degree of the audio dynamic range before and after being processed by the dynamic gain equalization system, and evaluate the dynamics of the system's adjustment for each frequency band;

[0010] S3: Analyze the sound quality differences of different types of audio before and after being processed by the dynamic gain equalization system, determine the deviation degree of the sound quality effect after processing, and evaluate the accuracy of audio sound quality fusion;

[0011] S4: Conduct a comprehensive analysis of the dynamics of the system's adjustment for each frequency band and the accuracy of audio sound quality fusion, and evaluate the consistency of the performance of the dynamic gain equalization system among different sound sources;

[0012] S5: According to the evaluation results, divide the performance of the dynamic gain equalization system among different sound sources into consistent performance and inconsistent performance, and perform corresponding processing respectively;

[0013] S6: Further analyze the consistency of the performance of the processed dynamic gain equalization system among different sound sources, and optimize the dynamic gain equalization system according to the analysis results to improve the consistency performance of the system.

[0014] In a preferred embodiment, in S2, to determine the retention degree of the audio dynamic range before and after being processed by the dynamic gain equalization system and evaluate the dynamics of the system's adjustment for each frequency band, specifically:

[0015] Based on the retention degree after the system performs gain adjustment while maintaining the original dynamic range, analyze the gain adjustment of each frequency band by the system at different time points, conduct a transient response analysis on the audio signals before and after processing, obtain the instantaneous response anomaly index of the system's response to the audio signal, and evaluate the dynamics of the system's adjustment for each frequency band. The method for obtaining the instantaneous response anomaly index is as follows:

[0016] Analyze the rapidly changing audio signal, mark the audio signal before processing as x(t), and mark the audio signal after processing as y(t); perform a short-time Fourier transform on the audio signal before processing. The specific calculation expression is: In the formula, x(t,f) is the short-time Fourier transform value of the audio signal before processing, (t) is the time point, f is the frequency, n is the number of time windows, is the transformation function, and the specific calculation expression is: Among them, , N is a positive integer greater than 1; perform a short-time Fourier transform on the audio signal after processing. The specific calculation expression is: In the formula, y(t,f) is the short-time Fourier transform value of the audio signal after processing;

[0017] Obtain the amplitude spectra before and after processing at each time point and frequency point, and label the amplitude spectrum before processing as , and label the amplitude spectrum after processing as , calculate the gain change value at each time point and frequency point before and after processing. The specific calculation expression is: In the formula, G(t,f) is the gain change value at each time point and frequency point before and after processing;

[0018] According to the gain change value at each time point and frequency point before and after processing, calculate the transient characteristic index T(t) of the fast-changing signal at each time point. Label the transient index before processing as , and label the transient index after processing as , calculate the transient anomaly index of the fast-changing signal at each time point. The specific calculation expression is: In the formula, is the transient anomaly index;

[0019] Statistically analyze the transient response anomaly indices at all time points, and calculate the mean value of the transient anomaly indices. The specific calculation expression is: In the formula, is the mean value of the transient anomaly indices, T is the number of transient anomaly indices at all time points. According to the calculated mean value of the transient anomaly indices, calculate the instantaneous response anomaly index. The specific calculation expression is: In the formula, is the instantaneous response anomaly index.

[0020] In a preferred embodiment, compare the obtained instantaneous response anomaly index with the reference threshold of the instantaneous response anomaly index. If the instantaneous response anomaly index is greater than or equal to the reference threshold of the instantaneous response anomaly index, generate a gain dynamic adjustment anomaly signal at this time; if the instantaneous response anomaly index is less than the reference threshold of the instantaneous response anomaly index, generate a gain dynamic adjustment normal signal at this time.

[0021] In a preferred embodiment, in S3, judge the deviation degree of the sound quality effect after processing, and evaluate the accuracy of audio sound quality fusion. Specifically:

[0022] Analyze the sound quality difference of different types of audio before and after processing by the dynamic gain equalization system, judge the deviation degree between the processed audio and the characteristics of the original audio, obtain the audio quality deviation index, and evaluate the accuracy of audio sound quality fusion. Then the method for obtaining the audio quality deviation index is:

[0023] Obtain the audio quality data before and after processing by the dynamic gain equalization system in real time. Label the original audio data as M and the processed audio data as N. Perform time-frequency analysis on the original audio data M and the processed audio data N, and establish the corresponding data set. Among them, M = , N = ; , is a positive integer greater than 0;

[0024] According to the data sets of the original audio data M and the processed audio data N, calculate their corresponding covariance. The specific calculation expression is: In the formula, is the covariance of the original audio data M and the processed audio data N, is the mean of the original audio data set M, is the mean of the processed audio data set N, is the number of elements in the set;

[0025] According to the calculated covariance of the original audio data M and the processed audio data N, calculate the sound quality similarity index. The specific calculation expression is: In the formula, is the sound quality similarity index, is the standard deviation of the original audio data set M, is the standard deviation of the processed audio data set N, and c1, c2 are constants; According to the calculated sound quality similarity index, calculate the audio quality deviation index. The specific calculation expression is: In the formula, is the audio quality deviation index.

[0026] In a preferred embodiment, compare the calculated audio quality deviation index with the audio quality deviation index reference threshold. If the audio quality deviation index is greater than or equal to the audio quality deviation index reference threshold, a sound quality abnormal signal is generated at this time; if the audio quality deviation index is less than the audio quality deviation index reference threshold, a sound quality normal signal is generated at this time.

[0027] In a preferred embodiment, in S4, comprehensively analyze the dynamicity of the system's adjustment to each frequency band and the accuracy of the audio sound quality fusion, specifically:

[0028] Normalize the instantaneous response abnormal index and the audio quality deviation index, and calculate the consistency evaluation coefficient of the dynamic gain equalization system's performance between different sound sources through the normalized instantaneous response abnormal index and audio quality deviation index.

[0029] In a preferred embodiment, in S5, divide the performance of the dynamic gain equalization system between different sound sources into consistent performance and inconsistent performance;

[0030] Compare the consistency evaluation coefficient of the obtained dynamic gain equalization system among different sound sources with the consistency reference threshold. If the consistency evaluation coefficient of the dynamic gain equalization system among different sound sources is greater than or equal to the consistency reference threshold, it is classified as consistent performance; if the consistency evaluation coefficient of the dynamic gain equalization system among different sound sources is less than the consistency reference threshold, it is classified as inconsistent performance.

[0031] In a preferred embodiment, in S6, further analyze the consistency of the processed dynamic gain equalization system among different sound sources, specifically:

[0032] If the performance of the dynamic gain equalization system among different sound sources is inconsistent, that is, the consistency evaluation coefficient generated within a fixed time period is less than the consistency reference threshold, collect several consistency evaluation coefficients generated within subsequent fixed time periods and establish a corresponding data set. Compare and analyze the consistency evaluation coefficients in the data set with the consistency reference threshold, and calculate the abnormal index of the dynamic gain equalization system;

[0033] Among them, the specific calculation expression of the abnormal index of the dynamic gain equalization system is: In the formula, is the consistency evaluation coefficient greater than the consistency reference threshold in the data set, x is the number of the consistency evaluation coefficient greater than the consistency reference threshold in the data set, x = 1, 2, 3, 4,..., A, and A is a positive integer greater than 0. is the consistency reference threshold. is the abnormal index of the dynamic gain equalization system.

[0034] In a preferred embodiment, compare the obtained abnormal index of the dynamic gain equalization system with the abnormal index reference threshold of the dynamic gain equalization system. If the abnormal index of the dynamic gain equalization system is greater than or equal to the abnormal index reference threshold of the dynamic gain equalization system, generate an abnormal signal of the dynamic gain equalization system at this time and immediately start the fault troubleshooting process; if the abnormal index of the dynamic gain equalization system is less than the abnormal index reference threshold of the dynamic gain equalization system, generate a normal signal of the dynamic gain equalization system at this time, maintain real-time monitoring of the dynamic gain equalization system, and ensure its continuous normal operation.

[0035] The present invention also provides an audio dynamic gain equalization system, including a test module, a dynamic evaluation module, an audio quality analysis module, a comprehensive analysis module, a consistency division module, and an optimization processing module;

[0036] Test module: Collect audio sample data of different types of sound sources and set a test environment. Use the collected audio sample data to test the dynamic gain equalization system within the test environment and record the test results;

[0037] Dynamic evaluation module: Analyze the test results, and based on the changes in the gain values of each frequency band, determine the retention degree of the audio dynamic range before and after being processed by the dynamic gain equalization system, and evaluate the dynamics of the system's adjustment for each frequency band;

[0038] Audio quality analysis module: Analyze the differences in the audio quality of different types of audio before and after being processed by the dynamic gain equalization system, determine the deviation degree of the processed audio quality effect, and evaluate the accuracy of audio quality fusion;

[0039] Comprehensive analysis module: Comprehensively analyze the dynamics of the system's adjustment for each frequency band and the accuracy of audio quality fusion, and evaluate the consistency of the performance of the dynamic gain equalization system among different sound sources;

[0040] Consistency division module: According to the evaluation results, divide the performance of the dynamic gain equalization system among different sound sources into consistent performance and inconsistent performance, and perform corresponding processing respectively;

[0041] Optimization processing module: Further analyze the consistency of the performance of the processed dynamic gain equalization system among different sound sources, and optimize the dynamic gain equalization system according to the analysis results to improve the consistency performance of the system.

[0042] In the above technical solution, the technical effects and advantages provided by the present invention are as follows:

[0043] 1. Through comprehensive analysis of multiple steps, the present invention evaluates the performance of the dynamic gain equalization system when processing different sound sources, comprehensively analyzes the dynamics of the system's adjustment for each frequency band and the accuracy of audio quality fusion, and evaluates the consistency of the performance of the dynamic gain equalization system among different sound sources. Secondly, through real-time data collection and test environment setting, inconsistencies in the system can be detected in a timely manner, and corresponding measures can be quickly taken according to the comparison between the anomaly index and the threshold to ensure the stability of the system. It can not only significantly improve the audio output quality, but also enhance the reliability and stability of the system, bringing a consistent and high-quality auditory experience to users.

[0044] 2. Through further analysis of the consistency of the processed dynamic gain equalization system among different sound sources and the comparison between the anomaly index and its corresponding reference threshold, the system can detect and solve consistency problems in a timely manner, improving the quality and stability of the overall audio output. This systematic method can not only significantly improve the accuracy and consistency of audio output, but also effectively ensure the reliability of the system, ensuring that users always obtain a consistent and high-quality auditory experience. Description of the Drawings

[0045] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for use in the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments described in the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings.

[0046] Figure 1 It is the flowchart of the method of the present invention.

[0047] Figure 2 It is the system module diagram of the present invention. Detailed implementation manners

[0048] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0049] Embodiment 1

[0050] Please refer to Figure 1 As shown, a method for dynamic gain equalization of an audio device in this embodiment includes the following steps:

[0051] S1: Collect audio sample data of different types of sound sources and set up a test environment. Use the collected audio sample data to test the dynamic gain equalization system in the test environment and record the test results;

[0052] S2: Analyze the test results. According to the change situation of the gain values in each frequency band, judge the retention degree of the dynamic range of the audio before and after being processed by the dynamic gain equalization system, and evaluate the dynamics of the system's adjustment for each frequency band;

[0053] S3: Analyze the sound quality difference situation of different types of audio before and after being processed by the dynamic gain equalization system, judge the deviation degree of the sound quality effect after processing, and evaluate the accuracy of audio sound quality fusion;

[0054] S4: Comprehensively analyze the dynamics of the system's adjustment for each frequency band and the accuracy of audio sound quality fusion, and evaluate the consistency of the performance of the dynamic gain equalization system among different sound sources;

[0055] S5: According to the evaluation results, divide the performance of the dynamic gain equalization system among different sound sources into consistent performance and inconsistent performance, and perform corresponding processing respectively;

[0056] S6: Further analyze the consistency of the processed dynamic gain equalization system in different sound sources, and optimize the dynamic gain equalization system according to the analysis results to improve the consistency performance of the system.

[0057] Among them, in S1, collect the audio sample data of different types of sound sources and set up a test environment. Use the collected audio sample data to test the dynamic gain equalization system in the test environment and record the test results. Specifically:

[0058] Determine different types of sound sources to be tested, such as: music (pop, classical, rock, jazz, etc.); voice (single-person speech, dialogue, broadcast news, etc.); environmental sounds (natural sound effects, city noise, mechanical sounds, etc.);

[0059] Collect high-quality audio samples from the audio library. Record on-site audio using high-quality recording equipment to ensure the diversity and representativeness of the audio samples. Classify the collected audio samples and label the sound source types. Use audio editing software to process the audio samples to remove noise and unnecessary parts to ensure the purity of the samples. Prepare high-quality audio playback equipment and audio measurement equipment, such as professional audio systems, microphones, audio interfaces, audio analyzers, etc. Ensure that the equipment is calibrated to provide accurate audio playback and measurement results.

[0060] Select a room with good acoustic conditions for testing to avoid external noise interference. Arrange sound-absorbing materials or diffusing materials in the room to minimize sound reflection and obtain accurate test results. Ensure that the settings of the audio playback equipment meet the standards, such as sampling rate, bit rate, etc. Use audio playback software to load the audio samples into the playlist for testing.

[0061] Connect the dynamic gain equalization system to the audio playback equipment and measurement equipment to ensure that all connections are correct. Perform preliminary configuration and calibration according to the system manual to ensure that the system can work properly. Play different types of audio samples in a predetermined order and process them through the dynamic gain equalization system. Use the audio measurement equipment to record the processed audio output and save it as a high-quality audio file.

[0062] During the test, monitor parameters such as the frequency response, dynamic range, and distortion level of the audio output in real time. Use professional software or tools to record the test results to ensure that the processing effects of each audio sample are detailedly recorded. Organize all the recorded test data and classify and save the test results of different types of sound sources. Use spreadsheet or database software to store the test data for subsequent analysis.

[0063] S2: Analyze the test results. According to the variation of gain values in each frequency band, judge the retention degree of the audio dynamic range before and after being processed by the dynamic gain equalization system, and evaluate the dynamics of the system's adjustment for each frequency band.

[0064] Use spectrum analysis software to perform spectrum analysis on the audio signals before and after processing. Obtain the gain values of each frequency band (such as from 20 Hz to 20 kHz). Plot the frequency response curves before and after processing on the same graph. Compare the two curves and observe the gain variation in each frequency band.

[0065] Based on the retention degree after the system adjusts the gain while maintaining the original dynamic range, analyze the gain adjustment of each frequency band by the system at different time points. Conduct transient response analysis on the audio signals before and after processing to obtain the transient response anomaly index of the system's response to the audio signal, and evaluate the dynamics of the system's adjustment for each frequency band. The method for obtaining the transient response anomaly index is as follows:

[0066] Analyze the rapidly changing audio signal. Mark the audio signal before processing as x(t), and mark the audio signal after processing as y(t); perform short-time Fourier transform on the audio signal before processing. The specific calculation expression is: In the formula, x(t,f) is the short-time Fourier transform value of the audio signal before processing, (t) is the time point, f is the frequency, n is the number of time windows, is the transformation function, and the specific calculation expression is: where, , N is a positive integer greater than 1; perform short-time Fourier transform on the audio signal after processing. The specific calculation expression is: In the formula, y(t,f) is the short-time Fourier transform value of the audio signal after processing;

[0067] Obtain the amplitude spectra before and after processing at each time point and frequency point. Mark the amplitude spectrum before processing as , and mark the amplitude spectrum after processing as , and calculate the gain change value at each time point and frequency point before and after processing. The specific calculation expression is: In the formula, G(t,f) is the gain change value at each time point and frequency point before and after processing;

[0068] According to the gain change value at each time point and frequency point before and after processing, calculate the transient characteristic index T(t) of the rapidly changing signal at each time point. Mark the transient index before processing as , and mark the transient index after processing as , and calculate the transient anomaly index of the rapidly changing signal at each time point. The specific calculation expression is: In the formula, is the transient anomaly index;

[0069] Statistically analyze the transient response anomaly indices at all time points, and calculate the mean value of the transient anomaly index. The specific calculation formula is: In the formula, is the mean value of the transient anomaly index, T is the number of transient anomaly indices at all time points. Based on the calculated mean value of the transient anomaly index, calculate the instantaneous response anomaly index. The specific calculation formula is: In the formula, is the instantaneous response anomaly index.

[0070] Compare the obtained instantaneous response anomaly index with the reference threshold of the instantaneous response anomaly index. If the instantaneous response anomaly index is greater than or equal to the reference threshold of the instantaneous response anomaly index, it indicates that the dynamic performance of the system's adjustment for each frequency band is weak. At this time, generate a gain dynamic adjustment anomaly signal; if the instantaneous response anomaly index is less than the reference threshold of the instantaneous response anomaly index, it indicates that the dynamic performance of the system's adjustment for each frequency band is strong. At this time, generate a gain dynamic adjustment normal signal.

[0071] A larger instantaneous response anomaly index indicates that the system cannot maintain a consistent dynamic response when processing audio signals. This may lead to significant differences in the gain adjustment degree of the system at different time points and frequency bands, thereby affecting the balance and consistency of the audio signal.

[0072] When the instantaneous response anomaly index is large, the system may show inconsistent characteristics in the gain adjustment of different frequency bands. Some frequency bands may be over-compensated or compressed, while some other frequency bands may not be properly adjusted, resulting in an unbalanced frequency response of the audio signal.

[0073] A larger instantaneous response anomaly index indicates that the system's response to transient signals is unreliable and cannot effectively maintain the original dynamic range. This may lead to distortion, mutation, or unnatural changes in the audio signal during processing, reducing the sound quality and listening experience.

[0074] S3: Analyze the difference in sound quality of different types of audio before and after being processed by the dynamic gain equalization system, judge the deviation degree of the sound quality effect after processing, and evaluate the accuracy of audio sound quality fusion.

[0075] Compare the sound quality characteristics of different types of audio before and after processing, such as timbre, clarity, dynamic range, etc. Observe whether the sound characteristics of the audio after processing match those of the original audio and whether there are abnormal changes, such as distortion, noise, color shift, etc. Analyze the sound quality fusion situation of the audio before and after processing, that is, whether the system can maintain the original characteristics and style of the audio while adjusting the gain.

[0076] Analyze the sound quality differences of different types of audio before and after being processed by a dynamic gain equalization system, judge the deviation degree between the processed audio and the characteristics of the original audio, obtain the audio quality deviation index, and evaluate the accuracy of audio sound quality fusion. The method for obtaining the audio quality deviation index is as follows:

[0077] Obtain the audio quality data before and after being processed by the dynamic gain equalization system in real time. The audio quality data includes spectrum and time-domain characteristics, distortion degree, signal-to-noise ratio, etc. Mark the original audio data as M and the processed audio data as N. Conduct time-frequency analysis on the original audio data M and the processed audio data N, and establish corresponding data sets. Among them, M = , N = ; , is a positive integer greater than 0;

[0078] According to the data sets of the original audio data M and the processed audio data N, calculate their corresponding covariance. The specific calculation expression is: In the formula, is the covariance of the original audio data M and the processed audio data N, is the mean of the original audio data set M, is the mean of the processed audio data set N, is the number of elements in the set;

[0079] According to the covariance of the original audio data M and the processed audio data N obtained by calculation, calculate the sound quality similarity index. The specific calculation expression is: In the formula, is the sound quality similarity index, is the standard deviation of the original audio data set M, is the standard deviation of the processed audio data set N, and c1, c2 are constants. Calculate the audio quality deviation index according to the calculated sound quality similarity index. The specific calculation expression is: In the formula, is the audio quality deviation index.

[0080] Compare the calculated audio quality deviation index with the audio quality deviation index reference threshold. If the audio quality deviation index is greater than or equal to the audio quality deviation index reference threshold, it indicates that the accuracy of audio sound quality fusion after being processed by the dynamic gain equalization system is low. At this time, generate a sound quality abnormal signal; if the audio quality deviation index is less than the audio quality deviation index reference threshold, it indicates that the accuracy of audio sound quality fusion after being processed by the dynamic gain equalization system is high. At this time, generate a sound quality normal signal.

[0081] A larger audio quality deviation index indicates a significant difference between the processed audio and the original audio. The differences can be reflected in multiple aspects such as the spectral characteristics, time-domain characteristics, and dynamic range of the audio. When the system's processing effects on different audio types are inconsistent, uneven gain adjustments may occur in various frequency bands of the audio, resulting in obvious changes in the sound quality.

[0082] A larger deviation index is usually accompanied by a higher degree of distortion. This means that additional noise or distortion components may be introduced into the processed audio signal, making the sound quality unnatural and unclear. The increase in distortion will cause the details of the original clear speech or music to be masked, thus affecting the user's auditory experience.

[0083] S4: Comprehensively analyze the dynamic nature of the system's adjustments to each frequency band and the accuracy of the audio sound quality fusion, and evaluate the consistency of the dynamic gain equalization system's performance among different sound sources.

[0084] Normalize the instantaneous response anomaly index and the audio quality deviation index, and calculate the consistency evaluation coefficient of the dynamic gain equalization system's performance among different sound sources through the normalized instantaneous response anomaly index and audio quality deviation index.

[0085] For example, the present invention can use the following formula to calculate the consistency evaluation coefficient of the dynamic gain equalization system's performance among different sound sources. The calculation expression is: In the formula, is the consistency evaluation coefficient, is the instantaneous response anomaly index, is the audio quality deviation index, is the proportionality coefficient of the instantaneous response anomaly index and the audio quality deviation index, and .

[0086] S5: According to the evaluation results, classify the performance of the dynamic gain equalization system among different sound sources into consistent performance and inconsistent performance, and perform corresponding processing respectively.

[0087] Compare the obtained consistency evaluation coefficient of the dynamic gain equalization system's performance among different sound sources with the consistency reference threshold. If the consistency evaluation coefficient of the dynamic gain equalization system's performance among different sound sources is greater than or equal to the consistency reference threshold, classify it as consistent performance; the system's performance among different sound sources is consistent, indicating that the dynamic gain equalization system can effectively process different types of audio without introducing significant differences; if the consistency evaluation coefficient of the dynamic gain equalization system's performance among different sound sources is less than the consistency reference threshold, classify it as inconsistent performance and further analysis is required.

[0088] In this embodiment, by collecting audio sample data of different types of sound sources and setting up a test environment, the collected audio sample data is used to test the dynamic gain equalization system within the test environment. The test results are analyzed. According to the variation of the gain values in each frequency band, the retention degree of the audio dynamic range before and after being processed by the dynamic gain equalization system is judged, and the dynamic performance of the system's adjustment for each frequency band is evaluated. The quality difference of different types of audio before and after being processed by the dynamic gain equalization system is analyzed to judge the deviation degree of the processed audio quality effect, and the accuracy of audio quality fusion is evaluated. The dynamic performance of the system's adjustment for each frequency band and the accuracy of audio quality fusion are comprehensively analyzed to evaluate the consistency of the dynamic gain equalization system's performance among different sound sources. According to the evaluation results, the performance of the dynamic gain equalization system among different sound sources is divided into consistent performance and inconsistent performance, and corresponding treatments are carried out respectively, which can significantly improve the performance and stability of the dynamic gain equalization system, ensure its consistent performance among different sound sources, and optimize the audio output quality.

[0089] Embodiment 2

[0090] S6: Further analyze the consistency of the processed dynamic gain equalization system among different sound sources, and optimize the dynamic gain equalization system according to the analysis results to improve the consistent performance of the system.

[0091] Further analyzing the consistency of the processed dynamic gain equalization system among different sound sources and optimizing the dynamic gain equalization system according to the analysis results to improve the consistent performance of the system means that, based on the preliminary evaluation and test of the system's performance consistency, through more in-depth and detailed analysis, the problems and inconsistent reasons existing in the system during the processing of different sound sources are found, and then targeted optimization measures are taken to ensure that the system can maintain consistent performance when processing various types of sound sources, thereby improving the overall audio output quality.

[0092] If the performance of the dynamic gain equalization system among different sound sources is inconsistent, that is, the consistency evaluation coefficient generated within a fixed time period is less than the consistency reference threshold, several consistency evaluation coefficients generated within subsequent fixed time periods are collected to establish a corresponding data set, and the consistency evaluation coefficients in the data set are compared and analyzed with the consistency reference threshold to calculate the dynamic gain equalization system anomaly index.

[0093] Among them, the specific calculation expression of the dynamic gain equalization system anomaly index is: In the formula, is the consistency evaluation coefficient greater than the consistency reference threshold in the data set, x is the number of the consistency evaluation coefficient greater than the consistency reference threshold in the data set, x = 1, 2, 3, 4,..., A, and A is a positive integer greater than 0. is the consistency reference threshold. is the abnormal index of the dynamic gain equalization system.

[0094] Compare the obtained abnormal index of the dynamic gain equalization system with the reference threshold of the abnormal index of the dynamic gain equalization system. If the abnormal index of the dynamic gain equalization system is greater than or equal to the reference threshold of the abnormal index of the dynamic gain equalization system, an abnormal signal of the dynamic gain equalization system is generated at this time; immediately start the fault troubleshooting process, analyze the system log and audio data, find out the specific reasons for the abnormality, and adjust the system parameters according to the abnormal analysis results to correct the current processing method.

[0095] If the abnormal index of the dynamic gain equalization system is less than the reference threshold of the abnormal index of the dynamic gain equalization system, a normal signal of the dynamic gain equalization system is generated at this time, and the real-time monitoring of the dynamic gain equalization system is maintained to ensure its continuous normal operation.

[0096] It should be noted here that the consistency reference threshold and the reference threshold of the abnormal index of the dynamic gain equalization system are set by those skilled in the art according to the specific performance of the dynamic gain equalization system, and will not be elaborated here.

[0097] In this embodiment, by further analyzing the consistency of the processed dynamic gain equalization system in different sound sources, collecting the consistency evaluation coefficients generated by the system in subsequent fixed time periods, and comparing them with the preset consistency reference threshold, the abnormal index of the dynamic gain equalization system is calculated. Then, according to the comparison result of the abnormal index and its reference threshold, corresponding processing measures are taken, including starting the fault troubleshooting process, analyzing the system log and audio data, adjusting the system parameters, etc., to ensure that the system can maintain consistency when processing different sound sources. If the system runs normally, continue to continuously monitor the state of the system. The implementation of this process can effectively discover and solve the consistency problems that occur when the system processes different sound sources, thereby improving the overall audio output quality.

[0098] Embodiment 3

[0099] Please refer to Figure 2 as shown, the audio dynamic gain equalization system described in this embodiment includes a test module, a dynamic evaluation module, an audio quality analysis module, a comprehensive analysis module, a consistency division module, and an optimization processing module.

[0100] Test module: Collect audio sample data of different types of sound sources and set up a test environment. Use the collected audio sample data to test the dynamic gain equalization system within the test environment and record the test results;

[0101] Dynamic evaluation module: Analyze the test results. According to the changes in the gain values of each frequency band, judge the retention degree of the audio dynamic range before and after being processed by the dynamic gain equalization system, and evaluate the dynamic performance of the system's adjustment for each frequency band;

[0102] Audio quality analysis module: Analyze the differences in the audio quality of different types of audio before and after being processed by the dynamic gain equalization system, judge the deviation degree of the processed audio quality effect, and evaluate the accuracy of audio quality fusion;

[0103] Comprehensive analysis module: Conduct a comprehensive analysis of the dynamic performance of the system's adjustment for each frequency band and the accuracy of audio quality fusion, and evaluate the consistency of the dynamic gain equalization system's performance among different sound sources;

[0104] Consistency classification module: According to the evaluation results, classify the performance of the dynamic gain equalization system among different sound sources into consistent performance and inconsistent performance, and conduct corresponding processing respectively;

[0105] Optimization processing module: Conduct further analysis on the consistency of the processed dynamic gain equalization system's performance among different sound sources, and optimize the dynamic gain equalization system according to the analysis results to improve the system's consistency performance.

[0106] The above formulas are all dimensionless and take their numerical values for calculation. The formulas are obtained by collecting a large amount of data and performing software simulation to get a formula that is closest to the actual situation. The preset parameters in the formulas are set by those skilled in the art according to the actual situation.

[0107] The above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center in a wired or wireless (such as infrared, wireless, microwave, etc.) manner. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that contains one or more collections of available media. The available media can be magnetic media (such as floppy disks, hard disks, magnetic tapes), optical media (such as DVDs), or semiconductor media. The semiconductor media can be a solid-state drive.

[0108] It should be understood that the term "and / or" in this document is merely a description of the association relationship between associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. Here, A and B can be singular or plural. In addition, the character " / " in this document generally represents an "or" relationship between the associated objects before and after, but it may also represent an "and / or" relationship, which can be specifically understood by referring to the context before and after.

[0109] It should be understood that in various embodiments of the present application, the order of the above process numbers does not mean the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0110] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed in this document can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0111] As described above, it is only the specific implementation manner of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed by this application can easily think of changes or substitutions, which should all be covered within the protection scope of this application.

Claims

1. An audio dynamic gain equalization method, characterized in that: Including the following steps; S1: Collect audio sample data of different types of sound sources and set up a test environment. Use the collected audio sample data to test the dynamic gain equalization system within the test environment and record the test results; S2: Analyze the test results. According to the change of gain values in each frequency band, judge the retention degree of the audio dynamic range before and after being processed by the dynamic gain equalization system, and evaluate the dynamic performance of the system's adjustment for each frequency band; According to the retention degree after the system makes gain adjustment while maintaining the original dynamic range, analyze the gain adjustment situation of each frequency band at different time points by the system, conduct transient response analysis on the audio signals before and after processing, obtain the transient response anomaly index of the system's response to the audio signal, and evaluate the dynamic performance of the system's adjustment for each frequency band. The method for obtaining the transient response anomaly index is as follows: Analyze a rapidly changing audio signal, mark the audio signal before processing as x(t), and mark the audio signal after processing as y(t); perform a short-time Fourier transform on the audio signal before processing, and the specific calculation expression is: In the formula, x(t,f) is the short-time Fourier transform value of the audio signal before processing, t is the time point, f is the frequency, n is the number of time windows, is the conversion function, and the specific calculation expression is: where, , N is a positive integer greater than 1; perform a short-time Fourier transform on the audio signal after processing, and the specific calculation expression is: In the formula, y(t,f) is the short-time Fourier transform value of the audio signal after processing; Obtain the amplitude spectra before and after processing at each time point and frequency point, and label the amplitude spectrum before processing as , and label the amplitude spectrum after processing as , calculate the gain change value at each time point and frequency point before and after processing. The specific calculation expression is: In the formula, G(t,f) is the gain change value at each time point and frequency point before and after processing; According to the gain change values at each time point and frequency point before and after processing, calculate the transient characteristic index T(t) of the rapidly changing signal at each time point. Mark the transient index before processing as (t), and mark the transient index after processing as (t). Calculate the transient anomaly index of the rapidly changing signal at each time point. The specific calculation expression is: In the formula, is the transient anomaly index; Statistically analyze the transient response anomaly indices at all time points and calculate the mean of the transient anomaly indices. The specific calculation expression is as follows: In the formula, is the mean of the transient anomaly indices, T is the number of transient anomaly indices at all time points. Based on the calculated mean of the transient anomaly indices, calculate the instantaneous response anomaly index. The specific calculation expression is as follows: In the formula, is the instantaneous response anomaly index; S3: Analyze the sound quality difference situation of different types of audio before and after being processed by the dynamic gain equalization system, judge the deviation degree of the processed sound quality effect, and evaluate the accuracy of audio sound quality fusion; S4: Conduct a comprehensive analysis of the dynamic performance of the system's adjustment for each frequency band and the accuracy of audio sound quality fusion, and evaluate the consistency of the dynamic gain equalization system's performance among different sound sources; S5: According to the evaluation results, divide the performance of the dynamic gain equalization system among different sound sources into consistent performance and inconsistent performance, and conduct corresponding processing respectively; S6: Conduct a further analysis of the consistency of the processed dynamic gain equalization system's performance among different sound sources, and optimize the dynamic gain equalization system according to the analysis results to improve the system's consistency performance.

2. The method for dynamic gain equalization of an audio device according to claim 1, characterized in that: Compare the obtained transient response anomaly index with the transient response anomaly index reference threshold. If the transient response anomaly index is greater than or equal to the transient response anomaly index reference threshold, a gain dynamic adjustment anomaly signal is generated at this time; if the transient response anomaly index is less than the transient response anomaly index reference threshold, a gain dynamic adjustment normal signal is generated at this time.

3. The method for dynamic gain equalization of an audio device according to claim 1, characterized in that: In S3, judge the deviation degree of the processed sound quality effect and evaluate the accuracy of audio sound quality fusion, specifically as follows: Analyze the sound quality difference situation of different types of audio before and after being processed by the dynamic gain equalization system, judge the deviation degree between the processed audio and the characteristics of the original audio, obtain the audio quality deviation index, and evaluate the accuracy of audio sound quality fusion. The method for obtaining the audio quality deviation index is as follows: Obtain the audio quality data before and after the processing of the real-time dynamic gain equalization system in real time, mark the original audio data as M and the processed audio data as N, perform time-frequency analysis on the original audio data M and the processed audio data N, and establish corresponding data sets, where, M= , N= ; , is a positive integer greater than 0; Calculate the covariance corresponding to the data sets of the original audio data M and the processed audio data N. The specific calculation expression is as follows: In the formula, is the covariance of the original audio data M and the processed audio data N, is the mean of the original audio data set M, is the mean of the processed audio data set N, is the number of elements in the set; Calculate the sound quality similarity index based on the covariance between the original audio data M obtained by calculation and the processed audio data N. The specific calculation expression is as follows: In the formula, is the sound quality similarity index, is the standard deviation of the original audio data set M, is the standard deviation of the processed audio data set N, and c1 and c2 are constants; calculate the audio quality deviation index based on the calculated sound quality similarity index. The specific calculation expression is as follows: In the formula, is the audio quality deviation index.

4. A method for dynamic gain equalization of an audio device according to claim 3, characterized in that: Compare the calculated audio quality deviation index with the audio quality deviation index reference threshold. If the audio quality deviation index is greater than or equal to the audio quality deviation index reference threshold, a sound quality anomaly signal is generated at this time; if the audio quality deviation index is less than the audio quality deviation index reference threshold, a sound quality normal signal is generated at this time.

5. A method for dynamic gain equalization of an audio device according to claim 1, characterized in that: In S4, conduct a comprehensive analysis of the dynamic performance of the system's adjustment for each frequency band and the accuracy of audio sound quality fusion, specifically as follows: Normalize the transient response anomaly index and the audio quality deviation index, and calculate the consistency evaluation coefficient of the dynamic gain equalization system's performance among different sound sources through the normalized transient response anomaly index and audio quality deviation index.

6. A method for dynamic gain equalization of an audio device according to claim 5, characterized in that: In S5, the performance of the dynamic gain equalization system between different sound sources is divided into consistent performance and inconsistent performance; Compare the obtained consistency evaluation coefficient of the dynamic gain equalization system between different sound sources with the consistency reference threshold. If the consistency evaluation coefficient of the dynamic gain equalization system between different sound sources is greater than or equal to the consistency reference threshold, it is classified as consistent performance; if the consistency evaluation coefficient of the dynamic gain equalization system between different sound sources is less than the consistency reference threshold, it is classified as inconsistent performance.

7. A method for dynamic gain equalization of an audio device according to claim 1, characterized in that: In S6, further analyze the consistency of the processed dynamic gain equalization system between different sound sources, specifically: If the performance of the dynamic gain equalization system between different sound sources is inconsistent, that is, the consistency evaluation coefficient generated within a fixed time period is less than the consistency reference threshold, collect several consistency evaluation coefficients generated within the subsequent fixed time period and establish a corresponding data set. Compare and analyze the consistency evaluation coefficients in the data set with the consistency reference threshold, and calculate the abnormal index of the dynamic gain equalization system; Among them, the specific calculation expression of the dynamic gain equalization system anomaly index is as follows: In the formula, is the consistency evaluation coefficient greater than the consistency reference threshold in the data set, x is the number of the consistency evaluation coefficient greater than the consistency reference threshold in the data set, x = 1, 2, 3, 4,..., A, and A is a positive integer greater than 0. is the consistency reference threshold. is the dynamic gain equalization system anomaly index.

8. A method for dynamic gain equalization of an audio device according to claim 7, characterized in that: Compare the obtained abnormal index of the dynamic gain equalization system with the abnormal index reference threshold of the dynamic gain equalization system. If the abnormal index of the dynamic gain equalization system is greater than or equal to the abnormal index reference threshold of the dynamic gain equalization system, generate an abnormal signal of the dynamic gain equalization system at this time and immediately start the fault troubleshooting process; if the abnormal index of the dynamic gain equalization system is less than the abnormal index reference threshold of the dynamic gain equalization system, generate a normal signal of the dynamic gain equalization system at this time, and maintain real-time monitoring of the dynamic gain equalization system to ensure its continuous normal operation.

9. An audio dynamic gain equalization system for implementing an audio dynamic gain equalization method according to any one of claims 1-8, characterized in that: It includes a test module, a dynamic evaluation module, an audio quality analysis module, a comprehensive analysis module, a consistency classification module, and an optimization processing module; Test module: Collect audio sample data of different types of sound sources and set up a test environment. Use the collected audio sample data to test the dynamic gain equalization system in the test environment and record the test results; Dynamic evaluation module: Analyze the test results, and judge the retention degree of the audio dynamic range before and after the processing of the dynamic gain equalization system according to the change of the gain value in each frequency band, and evaluate the dynamic performance of the system's adjustment in each frequency band; Audio quality analysis module: Analyze the difference in audio quality of different types of audio before and after the processing of the dynamic gain equalization system, judge the deviation degree of the processed audio quality effect, and evaluate the accuracy of audio quality fusion; Comprehensive analysis module: Comprehensively analyze the dynamic performance of the system's adjustment in each frequency band and the accuracy of audio quality fusion, and evaluate the consistency of the dynamic gain equalization system between different sound sources; Consistency classification module: According to the evaluation results, divide the performance of the dynamic gain equalization system between different sound sources into consistent performance and inconsistent performance, and perform corresponding processing respectively; Optimization processing module: Further analyze the consistency of the processed dynamic gain equalization system between different sound sources, and optimize the dynamic gain equalization system according to the analysis results to improve the consistency performance of the system.

Images