Data acquisition method and device for audio processor

Abstract

The present invention relates to the field of audio processing technology and discloses a data acquisition method and device for an audio processor. The method comprises: obtaining initial audio signal source data and initial ambient noise data, and calculating initial audio signal characteristics and initial ambient noise characteristics; constructing an initial compensation model based on the initial audio signal characteristics and initial ambient noise characteristics and obtaining an initial compensation coefficient; fine-tuning an audio input device based on the initial compensation coefficient and collecting initial audio output data of the audio input device as a feedback error characteristic value; updating the initial compensation model based on the feedback error characteristic value to obtain an optimized compensation model; and inputting the updated audio signal data into the optimized compensation model to obtain a target audio output result. This method can calculate compensation values ​​in real time while processing audio data, ensuring that the output audio signal of the audio processor is less affected by ambient noise.

Description

Technical Field

[0001] The present invention relates to the technical field of audio processing, in particular to a data acquisition method and device for an audio processor. Background Art

[0002] With the advancement of technology, audio processing has entered the digital age. As a key component of audio processing, audio processors play a vital role in this digital era. Digital audio processing improves data processing efficiency and quality, while also making the storage, transmission, and editing of audio content more convenient and flexible. Traditional audio processor data acquisition methods primarily rely on front-end acquisition devices, resulting in low data accuracy and susceptibility to interference from ambient noise.

[0003] In one prior art, a noise removal method based on a convolutional neural network is disclosed. The method includes: obtaining audio data to be processed; establishing a first fully connected layer, a convolutional layer, a second fully connected layer, and a first loss function; establishing a denoising model; processing the audio data to be processed through the denoising model to generate a denoising result, which is used to eliminate noise in the audio data to be processed. By establishing the denoising model and inputting the audio data to be processed into the denoising model for processing, the noise in the audio data to be processed is eliminated.

[0004] However, in the prior art, audio data is processed only through a denoising model. Under different noise conditions, for example, when the noise fluctuates greatly, it is difficult to maintain stable denoising performance, resulting in low data collection accuracy. Summary of the Invention

[0005] The present invention provides a data acquisition method and device for an audio processor to solve the problem that it is difficult to maintain stable denoising performance under conditions of large noise fluctuations.

[0006] In a first aspect, in order to solve the above technical problems, the present invention provides a data acquisition method for an audio processor, comprising:

[0007] After the audio input device is turned off, initial audio signal source data and initial environmental noise data are obtained;

[0008] Performing feature calculation on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features;

[0009] Constructing and training an initial compensation model based on the initial audio signal characteristics and the initial ambient noise characteristics;

[0010] Inputting preset audio input data into the initial compensation model and outputting an initial compensation coefficient;

[0011] After opening the audio input device, obtaining updated audio signal data and updated environmental noise data;

[0012] Fine-tuning the audio input device according to the initial compensation coefficient, and collecting initial audio output data of the audio input device as a feedback error characteristic value;

[0013] determining an update coefficient according to the feedback error characteristic value, and updating the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model;

[0014] Inputting the updated audio signal data into the optimized compensation model and outputting a target compensation coefficient;

[0015] The audio input device is fine-tuned according to the target compensation coefficient, and audio output data of the fine-tuned audio input device is collected as a target audio output result.

[0016] In an optional implementation, after the audio input device is turned off, obtaining initial audio signal source data and initial ambient noise data includes:

[0017] Collecting environmental noise data through a digital signal processor to obtain M environmental noise sampling values, where M is a positive integer greater than 1;

[0018] Audio signal source data is collected through an audio signal source device to obtain k audio signal source sampling values, where k is a positive integer greater than 1.

[0019] In an optional implementation, performing feature calculation on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features includes:

[0020] The initial audio signal features include the audio signal source sampling mean and the audio signal source sampling variance; the initial environmental noise features include the environmental noise sampling mean and the environmental noise sampling variance;

[0021] Preprocessing the initial audio signal source data and the initial ambient noise data to obtain preprocessed data;

[0022] The preprocessed data is calculated using the following mean and variance formulas:

[0023] Environmental noise sampling mean μ n :

[0024]

[0025] where n irepresents the i-th environmental noise sampling value, M is the number of environmental noise sampling values;

[0026] Environmental noise sampling variance

[0027]

[0028] where μ n is the mean value of the ambient noise sampling value;

[0029] Audio signal source sampling mean μ a :

[0030]

[0031] where a p represents the pth audio signal source sampling value, k is the number of audio signal source sampling values;

[0032] Audio signal source sampling variance

[0033]

[0034] where μ a is the audio signal source sampling mean.

[0035] In an optional implementation, constructing and training an initial compensation model based on the initial audio signal characteristics and the initial ambient noise characteristics includes:

[0036] Build an initial machine learning model;

[0037] Performing a preprocessing operation on the initial audio signal feature and the initial ambient noise feature to obtain preprocessed data;

[0038] Performing a data set division operation on the preprocessed data to obtain a training set, a validation set, and a test set;

[0039] The initial machine learning model is trained according to the training set, the validation set and the test set. When the number of training times reaches a preset maximum number, the training is determined to be completed, and an initial compensation model is obtained.

[0040] In an optional implementation, the fine-tuning of the audio input device according to the initial compensation coefficient and collecting initial audio output data of the audio input device as a feedback error characteristic value includes:

[0041] Sending parameter adjustment instructions through the audio input device adjustment interface to adjust parameters, including sampling frequency, sampling amplitude, adjustment parameters and adjustment amplitude;

[0042] The adjustment amplitude of the adjustment interface is calculated by the amplitude adjustment formula:

[0043] A=b(x mean -x adj )

[0044] Among them, A represents the adjustment range of the audio input device, x mean represents the mean value of the fine-tuning of the audio input device, x adj Indicates the amplitude parameter of the audio input device fine-tuning, and b indicates the adjustment ratio of the audio input device;

[0045] The audio input device interface collects the initial compensation coefficient as an adjustment parameter;

[0046] The audio input device performs fine adjustment based on the adjustment parameter and the adjustment amplitude;

[0047] Sampling the fine-tuned audio input device, collecting m sampling values, performing feature extraction on the m sampling values, calculating the weight difference between the p-th sampling value and the sampling value, accumulating the weights, and calculating the fine-tuning parameter W of the audio input device using the following formula:

[0048]

[0049] Where W is the parameter of audio input device fine-tuning, m is the number of sampling values ​​of audio input device fine-tuning, and w f Indicates the sampling value of the fine-tuning of the f-th audio input device, w f+1 Indicates the sampling value of the fine-tuning of the f+1th audio input device, (w f -w f+1 ) represents the weight difference of the sample values ​​fine-tuned by the audio input device;

[0050] The parameter W fine-tuned by the audio input device is used as the initial audio output data, and the initial audio output data is used as the feedback error characteristic value.

[0051] In an optional implementation, determining an update coefficient according to the feedback error characteristic value includes:

[0052] The update coefficient α is calculated by the following formula:

[0053]

[0054] Wherein, w is the feedback error characteristic value, and m is the number of sampling values ​​of the audio input device fine-tuning.

[0055] In an optional implementation, updating the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model includes:

[0056] Performing feature operations on the updated audio signal data and the updated ambient noise data to obtain a mean value, a variance value, and a mean value of an audio input error feature of the updated ambient noise data;

[0057] The update coefficient is used as a reference value for update calculation to update the compensation model, wherein updating the compensation model includes updating the formula:

[0058]

[0059] Among them, μ' n Represents the average value of the environmental noise characteristic noise sampling value in the updated audio processor, Represents the variance of the ambient noise characteristic noise sampling value in the updated audio processor, μ' e represents the mean value of the audio input error characteristic in the updated audio processor; and Respectively represent the updated mean, variance and mean of the ambient noise data and audio input error characteristics; α is the update coefficient;

[0060] The updated result will be used as the updated value of the initial compensation model, and will be substituted with the corresponding parameters of the initial compensation model to obtain the optimized compensation model.

[0061] In a second aspect, the present invention provides a data acquisition device for an audio processor, comprising:

[0062] A data acquisition module is used to obtain initial audio signal source data and initial environmental noise data after the audio input device is turned off;

[0063] a feature calculation module, configured to perform feature calculation on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features;

[0064] A model training module, configured to construct and train an initial compensation model based on the initial audio signal characteristics and the initial ambient noise characteristics;

[0065] A compensation coefficient module, configured to input preset audio input data into the initial compensation model and output an initial compensation coefficient;

[0066] A data update module is used to obtain and update audio signal data and update environmental noise data after the audio input device is turned on;

[0067] a device fine-tuning module, configured to fine-tune the audio input device according to the initial compensation coefficient and collect initial audio output data of the audio input device as a feedback error characteristic value;

[0068] a model updating module, configured to determine an update coefficient according to the feedback error characteristic value, and update the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model;

[0069] A coefficient updating module, configured to input the updated audio signal data into the optimized compensation model and output a target compensation coefficient;

[0070] The audio output module is used to fine-tune the audio input device according to the target compensation coefficient, and collect audio output data of the fine-tuned audio input device as a target audio output result.

[0071] In a third aspect, the present invention further provides an electronic device comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein when the processor executes the computer program, the data acquisition method of the audio processor described above is implemented.

[0072] In a fourth aspect, the present invention further provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the above-mentioned data acquisition methods for the audio processor.

[0073] Compared with the prior art, the present invention has the following beneficial effects:

[0074] The present invention provides a data acquisition method and device for an audio processor, comprising acquiring initial audio signal source data and initial ambient noise data, and calculating initial audio signal characteristics and initial ambient noise characteristics; constructing an initial compensation model based on the initial audio signal characteristics and initial ambient noise characteristics and obtaining an initial compensation coefficient; fine-tuning an audio input device based on the initial compensation coefficient, and acquiring initial audio output data of the audio input device as a feedback error characteristic value; updating the initial compensation model based on the feedback error characteristic value to obtain an optimized compensation model; and inputting the updated audio signal data into the optimized compensation model to obtain a target audio output result.

[0075] The method processes audio input data in real time by using a compensation model trained and optimized using audio signal features and environmental noise features, and collects compensation coefficients to fine-tune the audio input device in real time, thereby achieving real-time calculation of compensation values ​​while processing audio data, ensuring that the output audio signal of the audio processor is less affected by environmental noise, and improving the applicability and stability of the audio processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0076] Figure 11 is a flow chart of a data acquisition method for an audio processor provided by a first embodiment of the present invention;

[0077] Figure 2 It is a structural diagram of a data acquisition device of an audio processor provided by the second embodiment of the present invention. DETAILED DESCRIPTION

[0078] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0079] In one prior art, a noise removal method based on a convolutional neural network is disclosed. The method includes: obtaining audio data to be processed; establishing a first fully connected layer, a convolutional layer, a second fully connected layer, and a first loss function; establishing a denoising model; processing the audio data to be processed through the denoising model to generate a denoising result, which is used to eliminate noise in the audio data to be processed. By establishing the denoising model and inputting the audio data to be processed into the denoising model for processing, the noise in the audio data to be processed is eliminated.

[0080] However, in the prior art, audio data is processed only through a denoising model. Under different noise conditions, for example, when the noise fluctuates greatly, it is difficult to maintain stable denoising performance, resulting in low data collection accuracy.

[0081] In order to solve the above technical problems, refer to Figure 1 A first embodiment of the present invention provides a data acquisition method for an audio processor, comprising the following steps:

[0082] S11, after turning off the audio input device, obtaining initial audio signal source data and initial ambient noise data;

[0083] S12, performing feature calculation on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features;

[0084] S13, constructing and training an initial compensation model according to the initial audio signal characteristics and the initial ambient noise characteristics;

[0085] S14, inputting the preset audio input data into the initial compensation model, and outputting an initial compensation coefficient;

[0086] S15, after the audio input device is turned on, obtaining updated audio signal data and updated environmental noise data;

[0087] S16, fine-tuning the audio input device according to the initial compensation coefficient, and collecting initial audio output data of the audio input device as a feedback error characteristic value;

[0088] S17, determining an update coefficient according to the feedback error characteristic value, and updating the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model;

[0089] S18, inputting the updated audio signal data into the optimized compensation model, and outputting a target compensation coefficient;

[0090] S19: fine-tune the audio input device according to the target compensation coefficient, and collect audio output data of the fine-tuned audio input device as a target audio output result.

[0091] In step S11, after the audio input device is turned off, initial audio signal source data and initial ambient noise data are obtained, including:

[0092] After the audio input device is turned off, obtaining initial audio signal source data and initial ambient noise data includes:

[0093] Collecting environmental noise data through a digital signal processor to obtain M environmental noise sampling values, where M is a positive integer greater than 1;

[0094] Audio signal source data is collected through an audio signal source device to obtain k audio signal source sampling values, where k is a positive integer greater than 1.

[0095] It is worth noting that before shutting down the audio input device, it is necessary to make preliminary adjustments to the audio input device and the environment, initialize various settings of the digital signal processor and the analog-to-digital signal converter, determine the input voltage amplitude range of the audio input device, and avoid the analog-to-digital signal converter being unable to correctly process and accurately convert due to excessive or insufficient input voltage. Then start the audio input device and the audio processor, wait for the audio input device and the audio processor to enter a stable operating state, and then shut down the audio input device. Stable operation and stable output state facilitate data collection and analysis in the subsequent audio processing process, ensuring the accuracy and reliability of data collection. The acquisition of the initial audio signal source data and the initial environmental noise data requires several sets to ensure the reliability of the data analysis results. The initial audio signal source data includes but is not limited to the original signal of the audio processor; the acquisition of the initial environmental noise data includes: collection through the audio processor, collection through a removable device (such as a mobile phone, tablet computer, etc.), and collection through a microphone array.

[0096] In step S12, feature calculation is performed on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features.

[0097] It is worth noting that before performing the feature calculation, the initial audio signal source data and the initial environmental noise data need to be preprocessed, including filtering and feature extraction; wherein filtering includes denoising, frequency selection and signal separation; feature extraction is time series extraction of the initial audio signal source data and the initial environmental noise data, including spectral features, time domain features and statistical features;

[0098] The initial audio signal features include the audio signal source sampling mean and the audio signal source sampling variance; the initial environmental noise features include the environmental noise sampling mean and the environmental noise sampling variance;

[0099] Construct the mean formula and variance formula, perform feature operation on the preprocessed data, and obtain the initial audio signal feature and initial ambient noise feature; the formula is as follows

[0100] Environmental noise sampling mean μ n :

[0101]

[0102] where n i represents the i-th environmental noise sampling value, M is the number of environmental noise sampling values;

[0103] Environmental noise sampling variance

[0104]

[0105] where μ n is the mean value of the ambient noise sampling value;

[0106] Audio signal source sampling mean μ a :

[0107]

[0108] where a p represents the pth audio signal source sampling value, k is the number of audio signal source sampling values;

[0109] Audio signal source sampling variance

[0110]

[0111] where μ a is the sampling mean of the audio signal source;

[0112] In steps S13 and S14, an initial compensation model is constructed and trained according to the initial audio signal characteristics and the initial environmental noise characteristics, and the preset audio input data is input into the initial compensation model to output an initial compensation coefficient.

[0113] In one implementation, constructing and training an initial compensation model includes:

[0114] Build an initial machine learning model;

[0115] Performing a preprocessing operation on the initial audio signal feature and the initial ambient noise feature to obtain preprocessed data;

[0116] Performing a data set division operation on the preprocessed data to obtain a training set, a validation set, and a test set;

[0117] The initial machine learning model is trained according to the training set, the validation set and the test set. When the number of training times reaches a preset maximum number, the training is determined to be completed, and an initial compensation model is obtained.

[0118] It is worth noting that the machine learning model type is a reinforcement learning model. Preprocessing operations include: outlier detection and processing, filling out missing values ​​or errors with outliers using the mean or median; and calculating and normalizing the audio signal source characteristics and environmental noise characteristics after outlier detection and processing. The normalization formula is as follows:

[0119]

[0120] Wherein z is the value before normalization, z'' is the result after normalization, max(z) and min(z) are the maximum and minimum values ​​in the feature set respectively. The training set, validation set and test set are composed of several groups of audio data collected previously after feature budgeting and data preprocessing. The initial compensation model training process includes: using the training set and validation set for iterative training, and when the number of training times is greater than or equal to the preset maximum number of training times, the training is determined to be completed; an indicator evaluation is performed on the overfitting or underfitting situation, and the next step is carried out according to the evaluation results, such as: when overfitting occurs, the model complexity can be reduced by reducing the number of model layers or the number of neurons, and the model complexity can be reduced by using L1 or L2 regularization; when underfitting occurs, the opposite method of overfitting is adopted; when there is no overfitting or underfitting, the training can be determined to be completed, and the initial compensation model is obtained.

[0121] It is worth noting that the initial compensation coefficient, that is, the initial compensation value, is calculated by inputting the preset audio input data into the trained initial compensation model.

[0122] In step S15 , it is necessary to obtain updated audio signal data and updated environmental noise data after the audio input device is turned on.

[0123] Among them, the updated audio signal data and updated ambient noise data in this step are obtained through the audio input device instead of the audio processor, including: collecting through a movable device (such as a mobile phone, tablet computer, etc.) and collecting through a microphone array.

[0124] In step S16, the audio input device is fine-tuned according to the initial compensation coefficient, and initial audio output data of the audio input device is collected as a feedback error characteristic value, including:

[0125] Sending parameter adjustment instructions through the audio input device adjustment interface to adjust parameters, including sampling frequency, sampling amplitude, adjustment parameters and adjustment amplitude;

[0126] The adjustment amplitude of the adjustment interface is calculated by the amplitude adjustment formula:

[0127] A=b(x mean -x adj )

[0128] Among them, A represents the adjustment range of the audio input device, x mean represents the mean value of the fine-tuning of the audio input device, x adj Indicates the amplitude parameter of the audio input device fine-tuning, and b indicates the adjustment ratio of the audio input device;

[0129] The audio input device interface collects the initial compensation coefficient as an adjustment parameter;

[0130] The audio input device performs fine adjustment based on the adjustment parameter and the adjustment amplitude;

[0131] Sampling the fine-tuned audio input device, collecting m sampling values, performing feature extraction on the m sampling values, calculating the weight difference between the p-th sampling value and the sampling value, accumulating the weights, and calculating the fine-tuning parameter W of the audio input device using the following formula:

[0132]

[0133] Where W is the parameter of audio input device fine-tuning, m is the number of sampling values ​​of audio input device fine-tuning, and w f Indicates the sampling value of the fine-tuning of the f-th audio input device, w f+1 Indicates the sampling value of the fine-tuning of the f+1th audio input device, (w f -w f+1 ) represents the weight difference of the sample values ​​fine-tuned by the audio input device;

[0134] Using the parameter W fine-tuned by the audio input device as the initial audio output data, and using the initial audio output data as the feedback error characteristic value;

[0135] The number m of sampling values ​​fine-tuned by the audio input device is the number of sampling values ​​of the audio output data.

[0136] It is worth noting that the sampling frequency refers to the number of sample points collected per second, with Hertz (Hz) as the unit. The higher the sampling frequency, the higher the time resolution of the audio signal and the larger the data volume. The sampling amplitude refers to the amplitude value of each sample, with bits as the unit, which determines the dynamic range and volume of the audio signal. The audio input device interface collects the initial compensation coefficient as an adjustment parameter. The audio input device performs fine-tuning based on the adjustment parameter and the adjustment amplitude. The parameter W fine-tuned by the audio input device is the initial audio output data, that is, the feedback error characteristic value. The number of sampling values ​​m fine-tuned by the audio input device is the number of sampling values ​​of the output data.

[0137] In step S17, it is necessary to determine an update coefficient according to the feedback error characteristic value, and update the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model, including:

[0138] The update coefficient α is obtained by calculating the feedback error characteristic value using the following formula:

[0139]

[0140] Wherein W is the feedback error characteristic value, that is, the initial audio output data; m is the number of sample values ​​of the output data.

[0141] Perform feature operations on the updated audio signal data and the updated ambient noise data to obtain the mean, variance, and mean of the audio input error features of the updated ambient noise data. The method for using the feature operations is the same as step S12 and will not be repeated here.

[0142] The update coefficient is used as a reference value for update calculation to update the compensation model, wherein updating the compensation model includes updating the formula:

[0143]

[0144]

[0145] Among them, μ' n Represents the average value of the environmental noise characteristic noise sampling value in the updated audio processor, Represents the variance of the ambient noise characteristic noise sampling value in the updated audio processor, μ'e represents the mean value of the audio input error characteristic in the updated audio processor; and Respectively represent the updated mean, variance and mean of the ambient noise data and audio input error characteristics; α is the update coefficient;

[0146] The updated result will be used as the updated value of the initial compensation model, and will be substituted with the corresponding parameters of the initial compensation model to obtain the optimized compensation model.

[0147] In step S18, the updated audio signal data is input into the optimized compensation model, and a target compensation coefficient is output.

[0148] It's worth noting that the target compensation coefficient, or target compensation value, is calculated by inputting the updated audio signal data into the optimized compensation model. This step is similar to step S14, except that the optimized compensation model is used. Therefore, the target compensation coefficient more accurately reflects the current environmental conditions, ensuring that the audio processor maintains relatively stable performance under varying ambient noise conditions. Furthermore, subsequent fine-tuning of the audio input device will be more precise and accurate, reflecting actual conditions.

[0149] In step S19, the audio input device needs to be fine-tuned according to the target compensation coefficient, and the audio output data of the fine-tuned audio input device is collected as the target audio output result.

[0150] It is worth noting that this step uses the compensation coefficient fine-tuning device and collects the fine-tuned audio output data, uses the target compensation coefficient that more accurately reflects the environmental status for final adjustment and optimization, and outputs the target audio output result. This reflects that the data acquisition method of the audio processor calculates the compensation value in real time while processing audio data in real time, ensuring that the target audio output result is less affected by environmental noise and audio input equipment.

[0151] To facilitate understanding of the present invention, some preferred embodiments of the present invention are further described below.

[0152] The following describes the working process of the present invention using a common scenario as an example. Figure 2 , especially Figure 1 Schematic diagram of the working scenario of the method.

[0153] In this embodiment, the data acquisition device of the audio processor comprises an audio input device, an audio processor, and an audio output device. This device is designed to process audio data in real time while calculating compensation values ​​in real time to ensure that the output audio signal of the audio processor is less affected by ambient noise.

[0154] The working process is as follows:

[0155] Step 1: The audio processor starts initialization, closes the audio input device after the state stabilizes, and obtains the initial audio signal source data and initial ambient noise data;

[0156] Step 2: performing feature calculation on the audio data to obtain initial audio signal features and initial ambient noise features;

[0157] Step 3: constructing and training an initial compensation model based on the initial audio signal characteristics and the initial ambient noise characteristics;

[0158] Step 4: Inputting the preset audio input data stored in the memory or collected on-site into the initial compensation model, outputting an initial compensation coefficient, and fine-tuning the audio input device according to the initial compensation coefficient;

[0159] Step 5: Open the audio input device to collect new audio data. The new audio data can be used as the initial audio output number of the feedback error characteristic value after fine-tuning the output of the audio input device;

[0160] Step 6: Collect updated audio data and ambient noise data, and combine them with the initial audio output data to update the initial compensation model to obtain an optimized compensation model;

[0161] Step 7: Inputting the updated audio data into the optimized compensation model to obtain a target compensation coefficient;

[0162] Step eight: fine-tune the audio input device according to the target compensation coefficient, and collect audio output data of the fine-tuned audio input device as a target audio output result.

[0163] Through the above steps, the data acquisition device of the audio processor can calculate the compensation value in real time while processing the audio data in real time, ensuring that the target audio output result is less affected by the environmental noise.

[0164] In summary, the present invention discloses a data acquisition method and device for an audio processor, including obtaining initial audio signal source data and initial environmental noise data, and calculating initial audio signal characteristics and initial environmental noise characteristics; constructing an initial compensation model based on the initial audio signal characteristics and initial environmental noise characteristics and obtaining an initial compensation coefficient; fine-tuning an audio input device based on the initial compensation coefficient, and collecting initial audio output data of the audio input device as a feedback error characteristic value; updating the initial compensation model based on the feedback error characteristic value to obtain an optimized compensation model; inputting the updated audio signal data into the optimized compensation model to obtain a target audio output result. The method processes audio input data in real time by using a compensation model trained and optimized using audio signal characteristics and environmental noise characteristics, and collects compensation coefficients to fine-tune the audio input device in real time, thereby achieving real-time calculation of compensation values ​​while processing audio data, ensuring that the output audio signal of the audio processor is less affected by environmental noise, and improving the applicability and stability of the audio processor.

[0165] Reference Figure 2 A second embodiment of the present invention provides a data acquisition device for an audio processor, comprising:

[0166] A data acquisition module is used to obtain initial audio signal source data and initial environmental noise data after the audio input device is turned off;

[0167] a feature calculation module, configured to perform feature calculation on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features;

[0168] A model training module, configured to construct and train an initial compensation model based on the initial audio signal characteristics and the initial ambient noise characteristics;

[0169] A compensation coefficient module, configured to input preset audio input data into the initial compensation model and output an initial compensation coefficient;

[0170] A data update module is used to obtain and update audio signal data and update environmental noise data after the audio input device is turned on;

[0171] a device fine-tuning module, configured to fine-tune the audio input device according to the initial compensation coefficient and collect initial audio output data of the audio input device as a feedback error characteristic value;

[0172] a model updating module, configured to determine an update coefficient according to the feedback error characteristic value, and update the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model;

[0173] A coefficient updating module, configured to input the updated audio signal data into the optimized compensation model and output a target compensation coefficient;

[0174] The audio output module is used to fine-tune the audio input device according to the target compensation coefficient, and collect audio output data of the fine-tuned audio input device as a target audio output result.

[0175] Preferably, the data acquisition module includes:

[0176] An environmental noise data acquisition unit is used to acquire environmental noise data through a digital signal processor to obtain M environmental noise sampling values, where M is a positive integer greater than 1;

[0177] The audio signal source data acquisition unit is used to acquire audio signal source data through an audio signal source device and obtain k audio signal source sampling values, where k is a positive integer greater than 1.

[0178] Preferably, the feature calculation module includes:

[0179] The initial audio signal features include the audio signal source sampling mean and the audio signal source sampling variance; the initial environmental noise features include the environmental noise sampling mean and the environmental noise sampling variance;

[0180] a preprocessing unit, configured to preprocess the initial audio signal source data and the initial ambient noise data to obtain preprocessed data;

[0181] The mean-variance calculation unit is used to calculate the mean and variance of the preprocessed data using the following formula:

[0182] Environmental noise sampling mean μ n :

[0183]

[0184] where n i represents the i-th environmental noise sampling value, M is the number of environmental noise sampling values;

[0185] Environmental noise sampling variance

[0186]

[0187] where μ n is the mean value of the ambient noise sampling value;

[0188] Audio signal source sampling mean μ a :

[0189]

[0190] where a p represents the pth audio signal source sampling value, k is the number of audio signal source sampling values;

[0191] Audio signal source sampling variance

[0192]

[0193] where μ a is the audio signal source sampling mean.

[0194] Preferably, the model training module is specifically used to:

[0195] Build an initial machine learning model;

[0196] Performing a preprocessing operation on the initial audio signal feature and the initial ambient noise feature to obtain preprocessed data;

[0197] Performing a data set division operation on the preprocessed data to obtain a training set, a validation set, and a test set;

[0198] The initial machine learning model is trained according to the training set, the validation set and the test set. When the number of training times reaches a preset maximum number, the training is determined to be completed, and an initial compensation model is obtained.

[0199] Preferably, the device fine-tuning module is specifically used to:

[0200] Sending parameter adjustment instructions through the audio input device adjustment interface to adjust parameters, including sampling frequency, sampling amplitude, adjustment parameters and adjustment amplitude;

[0201] The adjustment amplitude of the adjustment interface is calculated by the amplitude adjustment formula:

[0202] A=b(x mean -x adj )

[0203] Among them, A represents the adjustment range of the audio input device, x mean represents the mean value of the fine-tuning of the audio input device, x adj Indicates the amplitude parameter of the audio input device fine-tuning, and b indicates the adjustment ratio of the audio input device;

[0204] The audio input device interface collects the initial compensation coefficient as an adjustment parameter;

[0205] The audio input device performs fine adjustment based on the adjustment parameter and the adjustment amplitude;

[0206] Sampling the fine-tuned audio input device, collecting m sampling values, performing feature extraction on the m sampling values, calculating the weight difference between the p-th sampling value and the sampling value, accumulating the weights, and calculating the fine-tuning parameter W of the audio input device using the following formula:

[0207]

[0208] Where W is the parameter of audio input device fine-tuning, m is the number of sampling values ​​of audio input device fine-tuning, and w f Indicates the sampling value of the fine-tuning of the f-th audio input device, w f+1 Indicates the sampling value of the fine-tuning of the f+1th audio input device, (w f -w f+1 ) represents the weight difference of the sample values ​​fine-tuned by the audio input device;

[0209] The parameter W fine-tuned by the audio input device is used as the initial audio output data, and the initial audio output data is used as the feedback error characteristic value.

[0210] Preferably, the model updating module is specifically used to:

[0211] The update coefficient α is calculated by the following formula:

[0212]

[0213] Wherein, W is the feedback error characteristic value, and m is the number of sampling values ​​of the audio input device fine-tuning.

[0214] Preferably, the model updating module is specifically used to:

[0215] Performing feature operations on the updated audio signal data and the updated ambient noise data to obtain a mean value, a variance value, and a mean value of an audio input error feature of the updated ambient noise data;

[0216] The update coefficient is used as a reference value for update calculation to update the compensation model, wherein updating the compensation model includes updating the formula:

[0217]

[0218] Among them, μ' n Represents the average value of the environmental noise characteristic noise sampling value in the updated audio processor, Represents the variance of the ambient noise characteristic noise sampling value in the updated audio processor, μ' e represents the mean value of the audio input error characteristic in the updated audio processor; and Respectively represent the updated mean, variance and mean of the ambient noise data and audio input error characteristics; α is the update coefficient;

[0219] The updated result will be used as the updated value of the initial compensation model, and will be substituted with the corresponding parameters of the initial compensation model to obtain the optimized compensation model.

[0220] It should be noted that the data acquisition device for an audio processor provided in an embodiment of the present invention is used to execute all the process steps of the data acquisition method for an audio processor in the above embodiment. The working principles and beneficial effects of the two correspond one to one, and thus will not be described in detail.

[0221] An embodiment of the present invention further provides an electronic device. The electronic device includes: a processor, a memory, and a computer program stored in the memory and executable on the processor, such as a data acquisition program. When the processor executes the computer program, the steps of the data acquisition method embodiment of each audio processor described above are implemented, such as Figure 1 Alternatively, when the processor executes the computer program, the functions of the modules / units in the above-mentioned device embodiments are realized, such as the real-time audio processing and compensation module.

[0222] Exemplarily, the computer program may be divided into one or more modules / units, which are stored in the memory and executed by the processor to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of implementing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device.

[0223] The electronic device may be a computing device such as a desktop computer, notebook, PDA, or smart tablet. The electronic device may include, but is not limited to, a processor and memory. Those skilled in the art will appreciate that the aforementioned components are merely examples of electronic devices and do not constitute a limitation of the electronic device. The electronic device may include more or fewer components than those described above, or a combination of certain components, or different components. For example, the electronic device may also include input / output devices, network access devices, buses, and the like.

[0224] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the electronic device, connecting various parts of the entire electronic device using various interfaces and lines.

[0225] The memory can be used to store the computer programs and / or modules, and the processor realizes various functions of the electronic device by running or executing the computer programs and / or modules stored in the memory and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area can store data created based on the use of the mobile phone (such as audio data, a phone book, etc.). In addition, the memory can include a high-speed random access memory and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage device.

[0226] Wherein, if the module / unit integrated in the electronic device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the process in the above-mentioned embodiment method, and can also be completed by a computer program to instruct the relevant hardware. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, it can implement the steps of each of the above-mentioned method embodiments. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0227] It should be noted that the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. In addition, in the drawings of the device embodiments provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines. A person of ordinary skill in the art can understand and implement the present invention without inventive effort.

[0228] The specific embodiments described above further illustrate the objectives, technical solutions, and beneficial effects of the present invention. It should be understood that the above descriptions are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. In particular, it should be noted that any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included within the scope of protection of the present invention for those skilled in the art.

Claims

1. A data acquisition method for an audio processor, characterized in that: Executed by the processor, including: After the audio input device is turned off, initial audio signal source data and initial environmental noise data are obtained; Performing feature calculation on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features; Constructing and training an initial compensation model based on the initial audio signal characteristics and the initial ambient noise characteristics; Inputting preset audio input data into the initial compensation model and outputting an initial compensation coefficient; After opening the audio input device, obtaining updated audio signal data and updated environmental noise data; Fine-tuning the audio input device according to the initial compensation coefficient, and collecting initial audio output data of the audio input device as a feedback error characteristic value; determining an update coefficient according to the feedback error characteristic value, and updating the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model; Inputting the updated audio signal data into the optimized compensation model and outputting a target compensation coefficient; The audio input device is fine-tuned according to the target compensation coefficient, and audio output data of the fine-tuned audio input device is collected as a target audio output result.

2. The data acquisition method of the audio processor according to claim 1, characterized in that: After the audio input device is turned off, obtaining initial audio signal source data and initial ambient noise data includes: Collecting environmental noise data through a digital signal processor to obtain M environmental noise sampling values, where M is a positive integer greater than 1; Audio signal source data is collected through an audio signal source device to obtain k audio signal source sampling values, where k is a positive integer greater than 1.

3. The data acquisition method of the audio processor according to claim 1, characterized in that: Performing feature calculation on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features, including: The initial audio signal features include the audio signal source sampling mean and the audio signal source sampling variance; the initial environmental noise features include the environmental noise sampling mean and the environmental noise sampling variance; Preprocessing the initial audio signal source data and the initial ambient noise data to obtain preprocessed data; The preprocessed data is calculated using the following mean and variance formulas: Environmental noise sampling mean μ n : where n i represents the i-th environmental noise sampling value, M is the number of environmental noise sampling values; Environmental noise sampling variance where μ n is the mean value of the environmental noise sampling value; Audio signal source sampling mean μ a : where a p represents the pth audio signal source sampling value, k is the number of audio signal source sampling values; Audio signal source sampling variance where μ a is the audio signal source sampling mean.

4. The data acquisition method of the audio processor according to claim 1, characterized in that: The constructing and training an initial compensation model according to the initial audio signal characteristics and the initial ambient noise characteristics includes: Build an initial machine learning model; Performing a preprocessing operation on the initial audio signal feature and the initial ambient noise feature to obtain preprocessed data; Performing a data set division operation on the preprocessed data to obtain a training set, a validation set, and a test set; The initial machine learning model is trained according to the training set, the validation set and the test set. When the number of training times reaches a preset maximum number, the training is determined to be completed, and an initial compensation model is obtained.

5. The data acquisition method of the audio processor according to claim 1, characterized in that: The step of fine-tuning the audio input device according to the initial compensation coefficient and collecting initial audio output data of the audio input device as a feedback error characteristic value includes: Sending parameter adjustment instructions through the audio input device adjustment interface to adjust parameters, including sampling frequency, sampling amplitude, adjustment parameters and adjustment amplitude; The adjustment amplitude of the adjustment interface is calculated by the amplitude adjustment formula: A=b(x mean -x adj ) Among them, A represents the adjustment range of the audio input device, x mean represents the mean value of the fine-tuning of the audio input device, x adj Indicates the amplitude parameter of the audio input device fine-tuning, and b indicates the adjustment ratio of the audio input device; The audio input device interface collects the initial compensation coefficient as an adjustment parameter; The audio input device performs fine adjustment based on the adjustment parameter and the adjustment amplitude; Sampling the fine-tuned audio input device, collecting m sampling values, performing feature extraction on the m sampling values, calculating the weight difference between the p-th sampling value and the sampling value, accumulating the weights, and calculating the fine-tuning parameter W of the audio input device using the following formula: Where W is the parameter of audio input device fine-tuning, m is the number of sampling values ​​of audio input device fine-tuning, and w f Indicates the sampling value of the fine-tuning of the f-th audio input device, w f+1 Indicates the sampling value of the fine-tuning of the f+1th audio input device, (w f -w f+1 ) represents the weight difference of the sample values ​​fine-tuned by the audio input device; The parameter W fine-tuned by the audio input device is used as the initial audio output data, and the initial audio output data is used as the feedback error characteristic value.

6. The data acquisition method of the audio processor according to claim 5, characterized in that: The determining of the update coefficient according to the feedback error characteristic value includes: The update coefficient α is calculated by the following formula: Wherein, W is the feedback error characteristic value, and m is the number of sampling values ​​of the audio input device fine-tuning.

7. The data acquisition method of the audio processor according to claim 6, characterized in that: The updating of the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model includes: Performing feature operations on the updated audio signal data and the updated ambient noise data to obtain a mean value, a variance value, and a mean value of an audio input error feature of the updated ambient noise data; The update coefficient is used as a reference value for update calculation to update the compensation model, wherein updating the compensation model includes updating the formula: Among them, μ' n Represents the average value of the environmental noise characteristic noise sampling value in the updated audio processor, Represents the variance of the ambient noise characteristic noise sampling value in the updated audio processor, μ' e represents the mean value of the audio input error characteristic in the updated audio processor; and Respectively represent the updated mean, variance and mean of the ambient noise data and audio input error characteristics; α is the update coefficient; The updated result will be used as the updated value of the initial compensation model, and will be substituted with the corresponding parameters of the initial compensation model to obtain the optimized compensation model.

8. A data acquisition device for an audio processor, characterized in that: include: A data acquisition module, used to obtain initial audio signal source data and initial environmental noise data after the audio input device is turned off; a feature calculation module, configured to perform feature calculation on the initial audio signal source data and the initial ambient noise data to obtain initial audio signal features and initial ambient noise features; A model training module, configured to construct and train an initial compensation model based on the initial audio signal characteristics and the initial ambient noise characteristics; A compensation coefficient module, configured to input preset audio input data into the initial compensation model and output an initial compensation coefficient; A data update module is used to obtain and update audio signal data and update environmental noise data after the audio input device is turned on; a device fine-tuning module, configured to fine-tune the audio input device according to the initial compensation coefficient and collect initial audio output data of the audio input device as a feedback error characteristic value; a model updating module, configured to determine an update coefficient according to the feedback error characteristic value, and update the initial compensation model according to the update coefficient, the updated audio signal data, and the updated ambient noise data to obtain an optimized compensation model; A coefficient updating module, configured to input the updated audio signal data into the optimized compensation model and output a target compensation coefficient; The audio output module is used to fine-tune the audio input device according to the target compensation coefficient, and collect audio output data of the fine-tuned audio input device as a target audio output result.

9. An electronic device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein when the processor executes the computer program, the data acquisition method of the audio processor according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the data acquisition method for the audio processor according to any one of claims 1 to 7.

Images