Audio Processing Method, Apparatus, and Storage Medium

By recording and analyzing the volume parameters of the audio clips, calculating the target adjustment value, and software adjusting the recording volume parameters, the recording inaccurate problem caused by blockage of the audio acquisition module is solved, improving the intelligence of electronic devices and reducing maintenance costs.

CN115297402BActive Publication Date: 2025-08-05BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210709263.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-21
Publication Date
2025-08-05
Estimated Expiration
2042-06-21

AI Technical Summary

Technical Problem

After long-term use of electronic products, the audio acquisition module's radio port may be blocked by foreign objects, resulting in the collected sound becoming smaller and affecting the user experience. The existing technology is mainly solved by cleaning or replacing the module, but there are incomplete problems and increase maintenance costs.

Method used

By recording standard audio clips that detect sound source playback, obtain recording and actual volume parameters, calculate target adjustment values, and software adjusts recording volume parameters to solve the problem of inaccurate recording and reduce manual intervention.

Benefits of technology

It realizes the adjustment of volume parameters through software, improves the intelligence of electronic devices, reduces maintenance costs, and avoids the need for hardware cleaning or replacement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115297402B_ABST
    Figure CN115297402B_ABST
Patent Text Reader

Abstract

The present disclosure relates to an audio processing method, device and storage medium. The method is applied to an electronic device, and the method includes: recording and detecting at least one standard audio segment played by a sound source; wherein the sound frequency of each of the standard audio segments is different; obtaining the recording volume parameters of each of the standard audio segments; determining a target adjustment value according to the actual volume parameters corresponding to each of the standard audio segments and the recording volume parameters; wherein the target adjustment value is used to adjust the volume parameters of the recorded actual audio. In this way, it is possible to adjust the volume parameters of the actual audio recorded by the electronic device through software, which can reduce manual intervention compared to cleaning the hardware or replacing the hardware to solve the problem of inaccurate recording, which can not only improve the intelligence of the electronic device, but also reduce the maintenance cost of the electronic device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of information technology, and in particular to an audio processing method, device, and storage medium. Background Art

[0002] With the advancement of science and technology and the rapid development of various electronic products, in order to realize the diversification of electronic product functions, audio acquisition modules will be configured for electronic products to perform audio acquisition through electronic products or realize the human-computer interaction function of electronic products through audio acquisition modules.

[0003] Among them, human-computer interaction through voice has received widespread attention. The entire Internet industry is actively exploring the possible applications and scenarios of voice interaction, and a large number of voice-based interaction products have been launched, such as smart speakers and voice assistants. When performing voice interaction, voice acquisition modules are required to collect voice.

[0004] However, after long-term use, the audio collection module's sound port may become clogged with foreign matter (e.g., dust), causing the collected sound to become muffled and affecting the user experience. In related technologies, the main treatment method is to clean the audio collection module or replace it, but this may not be thorough and increase the maintenance cost of the electronic product. Summary of the Invention

[0005] To overcome the problems existing in the related art, the present disclosure provides an audio processing method, device, and storage medium. These methods enable the volume parameters of actual audio recorded by an electronic device to be adjusted via software, reducing manual intervention, thereby improving the intelligence of the electronic device and reducing its maintenance costs.

[0006] According to a first aspect of an embodiment of the present disclosure, there is provided an audio processing method, applied to an electronic device, comprising:

[0007] Recording at least one standard audio segment played by a detection sound source; wherein the sound frequencies of the standard audio segments are different;

[0008] Obtaining recording volume parameters of each of the standard audio clips;

[0009] determining a target adjustment value according to the actual volume parameter corresponding to each of the standard audio clips and the recorded volume parameter;

[0010] The target adjustment value is used to adjust the volume parameter of the actual recorded audio.

[0011] In some embodiments, determining the target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recording volume parameter includes:

[0012] determining a first volume deviation value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0013] In a case where the first volume deviation value is greater than the standard volume deviation value, the target adjustment value is determined according to the actual volume parameters and the recording volume parameters corresponding to each of the standard audio segments.

[0014] In some embodiments, determining the first volume deviation value based on the difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments includes:

[0015] Determining a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0016] The first volume deviation value is determined according to the difference values and the number of the standard audio segments.

[0017] In some embodiments, determining the target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recording volume parameter includes:

[0018] determining an initial adjustment value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0019] Using the initial adjustment value, adjusting the recording volume parameter to obtain an adjusted volume parameter;

[0020] According to the difference between the adjusted volume parameter and the actual volume parameter, the initial adjustment value is adjusted until a preset stop condition is reached to obtain the target adjustment value.

[0021] In some embodiments, adjusting the initial adjustment value according to the difference between the adjusted volume parameter and the actual volume parameter includes:

[0022] determining a second volume deviation value according to a difference between the adjusted volume parameter and the actual volume parameter;

[0023] determining a compensation value according to the adjusted volume parameter and the actual volume parameter when the second volume deviation value is greater than the standard volume deviation value;

[0024] The initial adjustment value is adjusted according to the compensation value.

[0025] In some embodiments, obtaining the target adjustment value includes:

[0026] When the preset stop condition is reached, the target adjustment value is obtained according to the initial adjustment value and each of the compensation values.

[0027] Wherein, the preset stop condition at least includes: the second volume deviation value is less than or equal to the standard volume deviation value.

[0028] In some embodiments, the method further comprises:

[0029] When the number of times the initial adjustment value is adjusted is greater than or equal to the preset number of times, and the second volume deviation value is greater than the standard volume deviation value, an abnormality reminder message is output.

[0030] In some embodiments, the method further comprises:

[0031] When a detection operation based on an application interface input is detected, the detection sound source is controlled to play at least one of the standard audio segments.

[0032] According to a second aspect of an embodiment of the present disclosure, there is provided an audio processing device, applied to an electronic device, comprising:

[0033] a recording module configured to record at least one standard audio segment played by the detection sound source; wherein the sound frequencies of the standard audio segments are different;

[0034] An acquisition module configured to acquire recording volume parameters of each of the standard audio clips;

[0035] a determination module configured to determine a target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recording volume parameter;

[0036] The target adjustment value is used to adjust the volume parameter of the actual recorded audio.

[0037] In some embodiments, the determining module is configured to:

[0038] determining a first volume deviation value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0039] In a case where the first volume deviation value is greater than the standard volume deviation value, the target adjustment value is determined according to the actual volume parameters and the recording volume parameters corresponding to each of the standard audio segments.

[0040] In some embodiments, the determining module is configured to:

[0041] Determining a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0042] The first volume deviation value is determined according to the difference values and the number of the standard audio segments.

[0043] In some embodiments, the determining module is configured to:

[0044] determining an initial adjustment value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0045] Using the initial adjustment value, adjusting the recording volume parameter to obtain an adjusted volume parameter;

[0046] According to the difference between the adjusted volume parameter and the actual volume parameter, the initial adjustment value is adjusted until a preset stop condition is reached to obtain the target adjustment value.

[0047] In some embodiments, the determining module is configured to:

[0048] determining a second volume deviation value according to a difference between the adjusted volume parameter and the actual volume parameter;

[0049] determining a compensation value according to the adjusted volume parameter and the actual volume parameter when the second volume deviation value is greater than the standard volume deviation value;

[0050] The initial adjustment value is adjusted according to the compensation value.

[0051] In some embodiments, the determining module is configured to:

[0052] When the preset stop condition is reached, the target adjustment value is obtained according to the initial adjustment value and each of the compensation values.

[0053] Wherein, the preset stop condition at least includes: the second volume deviation value is less than or equal to the standard volume deviation value.

[0054] In some embodiments, the apparatus further comprises:

[0055] The output module is configured to output abnormal reminder information when the number of adjustment times for adjusting the initial adjustment value is greater than or equal to the preset adjustment number and the second volume deviation value is greater than the standard volume deviation value.

[0056] In some embodiments, the apparatus further comprises:

[0057] The control module is configured to control the detection sound source to play at least one of the standard audio segments when a detection operation based on application interface input is detected.

[0058] According to a third aspect of an embodiment of the present disclosure, there is provided an audio processing device, including:

[0059] processor;

[0060] a memory configured to store processor-executable instructions;

[0061] The processor is configured to implement the steps of any one of the audio processing methods in the first aspect when executed.

[0062] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an audio processing device, the device is enabled to perform any one of the audio processing methods in the first aspect above.

[0063] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:

[0064] In an embodiment of the present disclosure, the electronic device can play at least one standard audio clip by detecting the sound source and record each standard audio clip. After recording each standard audio clip, the target adjustment value can be determined based on the actual volume parameters and recording volume parameters corresponding to each standard audio clip, and then the volume parameters of the recorded actual audio can be adjusted according to the target adjustment value.

[0065] In the technical solution disclosed herein, the volume parameters of the actual audio recorded by the electronic device can be adjusted through software. Compared with cleaning the hardware or solving the problem of inaccurate recording by replacing the hardware, it can reduce manual intervention, which can not only improve the intelligence of the electronic device, but also reduce the maintenance cost of the electronic device.

[0066] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0068] Figure 1 The flow chart of the audio processing method according to an exemplary embodiment is as follows Figure 1 .

[0069] Figure 2The flow chart of the audio processing method according to an exemplary embodiment is as follows Figure 2 .

[0070] Figure 3 The figure is a block diagram of an audio processing device according to an exemplary embodiment.

[0071] Figure 4 is a hardware structure block diagram of an audio processing device 400 according to an exemplary embodiment.

[0072] Figure 5 is a hardware structure block diagram of an audio processing device 1300 according to an exemplary embodiment. DETAILED DESCRIPTION

[0073] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0074] Figure 1 The flow chart of the audio processing method according to an exemplary embodiment is as follows Figure 1 ,like Figure 1 As shown, the method is applied to an electronic device, and the method mainly includes the following steps:

[0075] In step 101, at least one standard audio segment played by a detection sound source is recorded; wherein the sound frequencies of the standard audio segments are different;

[0076] In step 102, the recording volume parameters of each of the standard audio clips are obtained;

[0077] In step 103, a target adjustment value is determined according to the actual volume parameter corresponding to each of the standard audio clips and the recording volume parameter;

[0078] The target adjustment value is used to adjust the volume parameter of the actual recorded audio.

[0079] Here, the electronic device may include a terminal device. The terminal device may include mobile terminals and fixed terminals, such as mobile phones, tablet computers, PDAs, laptop computers, desktop computers, wearable mobile devices, smart speakers, and televisions. In some embodiments, the electronic device may have a corresponding operating system. For example, it may have an Android operating system.

[0080] During implementation, a standard audio clip can be output via an audio output module on an electronic device. The audio output module is configured to output audio. The audio clip can be a sound clip consisting solely of sound, or it can be an audio clip that includes both sound and video. For example, if the audio clip consists solely of sound, the audio output module can be a speaker of the electronic device. In other words, the standard audio clip can be output via the speaker of the electronic device.

[0081] Taking an audio clip that includes both sound and video as an example, the audio output module can include a speaker and a display module of the electronic device, that is, the sound of the audio clip can be output through the speaker of the electronic device, and the picture of the audio clip can be output through the display module of the electronic device.

[0082] In some embodiments, the method further includes: when a detection operation based on application interface input is detected, controlling the detection sound source to play at least one of the standard audio segments.

[0083] Here, the application interface can be an interface output by an application for volume adjustment on the electronic device. For example, an application for volume adjustment can be installed on the electronic device. When it is necessary to adjust the sound recorded by the electronic device, the application can be started and the application interface can be entered. After entering the application interface, a detection operation can be input based on the application interface. When the electronic device detects the detection operation, the detection sound source can be controlled to play at least one standard audio clip.

[0084] In some embodiments, the detected sound source may be an audio output module of an electronic device, for example, a speaker of the electronic device. In other embodiments, a standard audio clip may be pre-recorded and stored in a storage space of the electronic device. When the standard audio clip needs to be played, the standard audio clip may be called from the storage space of the electronic device and output through the audio output module of the electronic device, thereby achieving playback of the standard audio clip.

[0085] In other embodiments, the detection sound source may be an external device different from the electronic device, for example, an audio output module independent of the electronic device, configured to play the standard audio clip. For another example, the detection sound source may be another electronic device having an audio output module independent of the electronic device.

[0086] In some embodiments, an audio list may be created, and each standard audio segment may be stored in the audio list in a preset order. During the process of recording the standard audio segments, the standard audio segments may be played in the preset order. It can be understood that during the detection process, each standard audio segment is played and recorded in sequence, that is, after playing and recording the first standard audio segment, the second standard audio segment is played and recorded, and then the third standard audio segment is played and recorded.

[0087] In some embodiments, the number of standard audio clips and the audio attributes of each standard audio clip can be set as needed. The audio attributes may include information such as the loudness and frequency of the standard audio clips. To achieve diversity and comprehensive coverage of standard audio clips, audio clips with different sound frequencies can be used as standard audio clips to provide more comprehensive data support for determining target adjustment values. The loudness of an audio clip can represent the volume of the audio clip, and the frequency of an audio clip can represent the pitch of the audio clip.

[0088] In the disclosed embodiment, each standard audio clip has a different sound frequency. Because sounds of different frequencies have different sound characteristics, the disclosed embodiment achieves full coverage of audio clips of different frequencies by making each standard audio clip have different sound frequencies, thereby reducing the impact of uneven sound frequency distribution on the accuracy of the determined target adjustment value.

[0089] In other embodiments, the electronic device can play audio clips through its own audio output module, and each audio clip is discrete, and each audio clip has a different sound frequency and sound loudness. In other embodiments, the audio clips can collectively constitute a complete detection audio segment. Of course, the audio clips can also be independent in content, which is not specifically limited here.

[0090] In some embodiments, taking the volume parameter including sound loudness as an example, the sound frequency of the audio clip and the sound loudness of the audio clip may constitute a frequency response curve, wherein the frequency response curve is used to represent the mapping relationship between each sound frequency and sound loudness.

[0091] For example, when collecting various standard audio clips, an actual frequency response curve can be generated based on the actual sound frequency and the actual sound loudness of the standard audio clips. For example, the discrete coordinates of the actual frequency response curve can be expressed as: (F1, L1), (F2, L2), ..., (F n ,L n), where each coordinate may correspond to a standard audio segment, where F represents the actual sound frequency, and L represents the actual sound loudness. In some embodiments, the actual frequency response curve corresponding to each standard audio segment may be pre-acquired, that is, the actual volume parameter corresponding to the standard audio segment may be pre-acquired. For example, the sound frequency and actual volume parameter (e.g., actual sound loudness) corresponding to the standard audio segment may be determined simultaneously when the standard audio segment is acquired.

[0092] In other implementations, when a standard audio clip is played, the audio acquisition module to be tested can be started synchronously, where the audio acquisition module can be a microphone of an electronic device. Taking the recording volume parameter including the recording sound loudness as an example, when the audio acquisition module to be tested is successfully started, the standard audio clip played by the detection sound source can be recorded by the audio acquisition module, and the recording frequency response curve of the standard audio clip recorded by the audio acquisition module can be obtained. For example, the discrete coordinates of the recording frequency response curve can be expressed as: (F1', L'1), (F2', L'2),…, (F n ',L' n ), each coordinate can correspond to a standard audio clip, where F' represents the frequency of the recorded sound and L' represents the loudness of the recorded sound.

[0093] After the standard audio clip is played by detecting the sound source, the standard audio clip can be recorded by an audio acquisition module. For example, the standard audio clip can be recorded by an audio acquisition module of an electronic device. The audio acquisition module can at least be used to record sound, and the audio acquisition module can include a microphone provided on the electronic device.

[0094] After an electronic device successfully records a standard audio clip using an audio capture module, a recording volume parameter of the standard audio clip can be obtained. Here, the recording volume parameter can be a volume parameter of the audio clip in the recording file after the standard audio clip is recorded, for example, the recording loudness of the standard audio clip, or the recording volume of the standard audio clip.

[0095] It should be noted that as the electronic device is used for a longer time, the sound receiving port of the audio acquisition module of the electronic device may be blocked by foreign objects, which may cause the recording volume parameters of the recorded standard audio clip to be different from the actual volume parameters of the standard audio clip. Therefore, each standard audio clip can correspond to a recording volume parameter and an actual volume parameter, where the recording volume parameter and the actual volume parameter can be the same or different.

[0096] In an embodiment of the present disclosure, after obtaining the recording volume parameters of the standard audio clips, the target adjustment value can be determined based on the actual volume parameters and recording volume parameters corresponding to each standard audio clip, wherein the target adjustment value is used to adjust the volume parameters of the actual recorded audio.

[0097] In some embodiments, a target adjustment value can be determined based on the difference between the actual volume parameter and the recorded volume parameter. For example, the difference between the actual volume parameter and the recorded volume parameter corresponding to each standard audio segment can be determined, and then the difference value corresponding to each standard audio segment can be determined, and the target adjustment value can be determined based on each difference value. For another example, the target adjustment value can be determined based on the average of the difference values. For another example, the difference values can be weighted to obtain weighted values corresponding to each standard audio segment, and then the target adjustment value can be determined based on the average of the weighted values.

[0098] In some embodiments, the audio capture module can be used in various scenarios. For example, it can be used in scenarios such as phone calls, voice calls, video conferencing, audio recording, and video recording. However, after an electronic device has been used for a period of time, the audio capture module may become clogged or age, resulting in the recorded sound being very small or unclear.

[0099] In an embodiment of the present disclosure, the electronic device can play at least one standard audio clip by detecting the sound source and record each standard audio clip. After recording each standard audio clip, the target adjustment value can be determined based on the actual volume parameters and recording volume parameters corresponding to each standard audio clip, and then the volume parameters of the recorded actual audio can be adjusted according to the target adjustment value.

[0100] In the technical solution disclosed herein, the volume parameters of the actual audio recorded by the electronic device can be adjusted through software. Compared with cleaning the hardware or solving the problem of inaccurate recording by replacing the hardware, it can reduce manual intervention, which can not only improve the intelligence of the electronic device, but also reduce the maintenance cost of the electronic device.

[0101] In other embodiments, the technical solutions in the embodiments of the present disclosure can also be used to assist after-sales personnel in detecting whether the audio acquisition module is damaged and provide corresponding data basis, etc.

[0102] In some embodiments, determining the target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recording volume parameter includes:

[0103] determining a first volume deviation value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0104] In a case where the first volume deviation value is greater than the standard volume deviation value, the target adjustment value is determined according to the actual volume parameters and the recording volume parameters corresponding to each of the standard audio segments.

[0105] Here, the difference between the recorded volume parameter and the actual volume parameter can be determined based on the difference between the recorded volume parameter and the actual volume parameter. For example, the difference between the recorded volume parameter and the actual volume parameter can be determined and the difference between the recorded volume parameter and the actual volume parameter can be determined as the first volume deviation value. For another example, assuming that the recorded volume parameter is the recorded volume value and the actual volume parameter is the actual volume value, the first volume deviation value can be determined based on the difference between the recorded volume value and the actual volume value. The volume value can be represented by the loudness of the sound.

[0106] In some embodiments, when there is only one standard audio segment, the first volume deviation value can be directly determined based on the difference between the recorded volume parameter corresponding to the standard audio segment and the actual volume parameter. For example, the difference between the recorded volume parameter corresponding to the standard audio segment and the actual volume parameter can be determined as the first volume deviation value.

[0107] In other embodiments, the first volume deviation value may be determined based on the recorded volume parameter and the actual volume parameter corresponding to any standard audio segment. For example, the first volume deviation value may be determined based on the difference between the recorded volume parameter and the actual volume parameter corresponding to the standard audio segment.

[0108] In other embodiments, when there are multiple standard audio clips, the first volume deviation value can be determined based on the recorded volume parameters and actual volume parameters corresponding to the multiple standard audio clips. For example, the deviation value corresponding to each standard audio clip can be determined based on the difference between the recorded volume parameter and the actual volume parameter corresponding to each standard audio clip, and the first volume deviation value can be determined based on the deviation value corresponding to each standard audio clip. For example, the first volume deviation value can be determined based on the average of the deviation values corresponding to the standard audio clips, or the first volume deviation value can be obtained by calculating the mean square error of the deviation values of the standard audio clips.

[0109] In other embodiments, when there are multiple standard audio clips, the difference between the recorded volume parameters and the actual volume parameters corresponding to each standard audio clip can be determined separately, and then the first volume deviation value is determined based on the difference between each recorded volume parameter and the actual volume parameter.

[0110] Here, it can be assumed that there are M standard audio clips, each of which corresponds to a recorded volume parameter and an actual volume parameter. For each standard audio clip, the difference between the recorded volume parameter and the actual volume parameter can be determined. For example, the difference between the recorded volume parameter and the actual volume parameter can be determined, and then M difference values can be obtained. After obtaining the M difference values, a first volume deviation value can be determined based on the M difference values. For example, the first volume deviation value can be determined based on the average value of the M difference values. For another example, the mean square error of the M difference values can be calculated to obtain the first volume deviation value, etc., where M is a positive integer.

[0111] In other embodiments, the first volume deviation value may be determined using a preset model. For example, the recording volume parameters and actual volume parameters corresponding to each standard audio segment may be input into the preset model, and the first volume deviation value may be output.

[0112] In some embodiments, the preset model may be a model obtained by pre-training an initial model (e.g., a neural network) through an iterative training method. When training the preset model, the loss value of the initial model may be determined by a loss function (e.g., a cross entropy loss function), and then the model parameters of the initial model may be adjusted based on the loss value until the convergence condition is reached, and the initial model after the last model parameter adjustment is determined as the preset model. The convergence condition may include: the number of model parameter adjustments reaches a threshold or the performance of the initial model meets the preset requirements. In some embodiments, the neural network may include: Convolutional Neural Networks (CNN) and Fully Convolutional Neural Networks (FCN), etc.

[0113] In the embodiment of the present disclosure, after obtaining the first volume deviation value, the first volume deviation value can be compared with the standard volume deviation value to obtain a comparison result. When the comparison result indicates that the first volume deviation value is greater than the standard volume deviation value, it indicates that there is a deviation in the recording volume of the standard audio segment recorded by the audio acquisition module of the electronic device. At this time, the target adjustment value can be determined based on the actual volume parameters and recording volume parameters corresponding to each standard audio segment.

[0114] For example, the first volume deviation value ε1 can be compared with the standard volume deviation value ε0. If ε1 is greater than ε0 (1+t%), it can be determined that the first volume deviation value (actual deviation value) exceeds the standard volume deviation value. At this time, the target adjustment value can be determined based on the actual volume parameters and recorded volume parameters corresponding to each standard audio clip.

[0115] In other embodiments, if the comparison result indicates that the first volume deviation value is less than or equal to the standard volume deviation value, then it can be determined that the state of the audio acquisition module of the electronic device is normal, and in this case, there is no need to adjust the sound collected by the audio acquisition module. That is, if ε1 is less than or equal to ε0(1+t%), then there is no need to determine the target adjustment value. The value of t can be determined as needed.

[0116] In the embodiment of the present disclosure, a first volume deviation value can be determined based on the difference between the recorded volume parameters and the actual volume parameters corresponding to each standard audio clip. After the first volume deviation value is determined, the first volume deviation value can be compared with the standard volume deviation value. When the first volume deviation value is greater than the standard volume deviation value, a target adjustment value can be determined based on the actual volume parameters and the recorded volume parameters corresponding to each standard audio clip.

[0117] Before determining the target adjustment value, the first deviation value is judged and the application scenarios are screened. Compared with directly determining the target adjustment value, this can effectively process the audio data, reduce the possibility of invalid processing, and thus improve the data processing efficiency of the electronic device.

[0118] In some embodiments, determining the first volume deviation value based on the difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments includes:

[0119] Determining a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0120] The first volume deviation value is determined according to the difference values and the number of the standard audio segments.

[0121] Here, after determining the recording volume parameters and actual volume parameters corresponding to each standard audio clip, the difference between the recording volume parameters and the actual volume parameters corresponding to each standard audio clip can be determined, and then the difference corresponding to each standard audio clip can be obtained. After obtaining the difference corresponding to each standard audio clip, the first volume deviation value can be determined based on the difference corresponding to each standard audio clip and the number of standard audio clips.

[0122] For example, the first volume deviation value can be determined by averaging. For example, the differences corresponding to the standard audio segments are summed to obtain a first sum value, and then the first sum value is divided by the number of standard audio segments to obtain the first volume deviation value. The calculation formula for the first volume deviation value is as follows:

[0123]

[0124] In formula (1), ε1 represents the first volume deviation value, n represents the number of standard audio segments, (L' i -L i ) represents the recording volume parameter L' corresponding to the i-th standard audio clip i The actual volume parameter L corresponding to the i-th standard audio clip i The difference between , where i is a positive integer.

[0125] For another example, the first volume deviation value can be determined by calculating the mean square error. For example, the square values of the differences corresponding to the standard audio segments can be determined, and then the square values can be summed to obtain a second sum value. The second sum value is then divided by the number of standard audio segments to obtain the first volume deviation value. The calculation formula for the first volume deviation value is as follows:

[0126]

[0127] In formula (2), ε1 represents the first volume deviation value, n represents the number of standard audio segments, (L' i -L i ) represents the recording volume parameter L' corresponding to the i-th standard audio clip i The actual volume parameter L corresponding to the i-th standard audio clip i The difference between , where i is a positive integer.

[0128] In the embodiment of the present disclosure, when there are multiple standard audio clips, the recorded volume parameters and actual volume parameters of each standard audio clip can be taken into consideration when determining the first volume deviation value. Compared with determining the first volume deviation value based only on the parameters corresponding to a certain standard audio clip, the versatility and accuracy of the determined first volume deviation value can be improved.

[0129] In some embodiments, determining the target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recorded volume parameter includes:

[0130] determining an initial adjustment value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0131] Using the initial adjustment value, adjusting the recording volume parameter to obtain an adjusted volume parameter;

[0132] According to the difference between the adjusted volume parameter and the actual volume parameter, the initial adjustment value is adjusted until a preset stop condition is reached to obtain the target adjustment value.

[0133] In the embodiment of the present disclosure, after obtaining the recording volume parameters and actual volume parameters corresponding to each standard audio clip, the difference between the recording volume parameters and the actual volume parameters corresponding to each standard audio clip can be determined, and then the initial adjustment value can be determined according to the difference value.

[0134] In some embodiments, the difference between the recorded volume parameter and the actual volume parameter corresponding to each standard audio segment can be determined, and then the initial adjustment value can be determined according to the difference corresponding to each standard audio segment and the number of standard audio segments.

[0135] In some embodiments, the adjustment value of the volume parameter (e.g., sound loudness) is equivalent to the gain compensation value of the audio acquisition module (e.g., microphone). Assuming that the adjustment value is set to η, the deviation value obtained after adjusting the recording volume parameter based on the adjustment value can be:

[0136]

[0137] In formula (3), ε represents the deviation value obtained after adjusting the recording volume parameter based on the adjustment value, η represents the adjustment value, and L' i Indicates the recording volume parameter corresponding to the i-th standard audio clip, L i represents the actual volume parameter corresponding to the i-th standard audio segment, and n represents the number of standard audio segments.

[0138] Since the deviation value ε reaches its minimum value at the extreme point, we can take the first-order derivative of ε and get:

[0139]

[0140] In formula (4), ε represents the deviation value obtained after adjusting the recording volume parameter based on the adjustment value, η represents the adjustment value, and L' i Indicates the recording volume parameter corresponding to the i-th standard audio clip, L i represents the actual volume parameter corresponding to the i-th standard audio segment, and n represents the number of standard audio segments.

[0141] Based on formula (4), the calculation formula for the adjustment value η can be obtained:

[0142]

[0143] In formula (5), η represents the adjustment value, L' i Indicates the recording volume parameter corresponding to the i-th standard audio clip, L i represents the actual volume parameter corresponding to the i-th standard audio segment, and n represents the number of standard audio segments.

[0144] Here, the average value of the difference values corresponding to the respective standard audio segments may be determined as the initial adjustment value. The calculation formula for the initial adjustment value may be as follows:

[0145]

[0146] In formula (6), η0 represents the initial adjustment value, n represents the number of standard audio segments, (L i -L' i ) represents the recording volume parameter L' corresponding to the i-th standard audio clip i The actual volume parameter L corresponding to the i-th standard audio clip i The difference between , where i is a positive integer.

[0147] It should be noted that the recording volume parameter here may be a volume parameter obtained by recording a standard audio clip played by the detection sound source in the current detection process.

[0148] In other embodiments, after the initial adjustment value is obtained, the detection process may be performed again, that is, the standard audio segment played by the detection sound source may be recorded again to obtain the recording volume parameter.

[0149] That is, before obtaining the target adjustment value, the standard audio clip can be played once by detecting the sound source, and the recording volume parameters obtained by recording the standard audio clip can be used as the basis for subsequent processing. In other embodiments, the standard audio clip can also be played multiple times by detecting the sound source, that is, the standard audio clip is re-recorded each time the recording volume parameters need to be adjusted. Re-recording the standard audio clip each time the recording volume parameters need to be adjusted can ensure the real-time and accuracy of the obtained recording volume parameters and reduce the impact of hardware loss on the accuracy of data processing.

[0150] In some embodiments, adjusting the recording volume parameter using the initial adjustment value to obtain the adjusted volume parameter may include: obtaining the adjusted volume parameter based on the sum of the initial adjustment value and the recording volume parameter value. Assume that the recording volume parameter is L' i , the initial adjustment value is η0, then the volume adjustment parameter can be (L' i +η0). For example, the adjusted volume parameter can be determined based on the sum of the initial adjustment value and the recording volume parameter. Assuming the recording volume parameter is 80 decibels and the determined initial adjustment value is 20 decibels, the adjusted volume parameter can be 100 decibels.

[0151] In other embodiments, the initial adjustment value may be weighted using a first weighting value to obtain a first weighting value, and the recording volume parameter may be weighted using a second weighting value to obtain a second weighting value. Then, the adjustment volume parameter may be determined based on the first weighting value and the second weighting value. For example, the adjustment volume parameter may be determined based on the sum of the first weighting value and the second weighting value.

[0152] After obtaining the adjusted volume parameter, the initial adjustment value can be adjusted according to the difference between the adjusted volume parameter and the actual volume parameter. Here, the difference between the adjusted volume parameter and the actual volume parameter can be determined according to the difference between the adjusted volume parameter and the actual volume parameter.

[0153] In some embodiments, adjusting the initial adjustment value according to the difference between the adjusted volume parameter and the actual volume parameter includes:

[0154] determining a second volume deviation value according to a difference between the adjusted volume parameter and the actual volume parameter;

[0155] determining a compensation value according to the adjusted volume parameter and the actual volume parameter when the second volume deviation value is greater than the standard volume deviation value;

[0156] The initial adjustment value is adjusted according to the compensation value.

[0157] Here, the difference between the adjusted volume parameter and the actual volume parameter can be determined based on the difference between the adjusted volume parameter and the actual volume parameter. For example, the difference between the adjusted volume parameter and the actual volume parameter can be determined, and the difference between the adjusted volume parameter and the actual volume parameter can be determined as the second volume deviation value. For another example, assuming that the adjusted volume parameter is the adjusted volume value and the actual volume parameter is the actual volume value, the second volume deviation value can be determined based on the difference between the adjusted volume value and the actual volume value. The volume value can be represented by the loudness of the sound.

[0158] In some embodiments, when there is only one standard audio segment, the second volume deviation value can be directly determined based on the difference between the adjusted volume parameter corresponding to the standard audio segment and the actual volume parameter. For example, the difference between the adjusted volume parameter corresponding to the standard audio segment and the actual volume parameter can be determined as the second volume deviation value.

[0159] In other embodiments, the second volume deviation value may be determined based on the adjusted volume parameter and the actual volume parameter corresponding to any standard audio segment. For another example, the second volume deviation value may be determined based on the difference between the adjusted volume parameter and the actual volume parameter corresponding to the any standard audio segment.

[0160] In other embodiments, when there are multiple standard audio clips, the second volume deviation value can be determined based on the adjusted volume parameters and actual volume parameters corresponding to the multiple standard audio clips. For example, the deviation value corresponding to each standard audio clip can be determined based on the difference between the adjusted volume parameter and the actual volume parameter corresponding to each standard audio clip, and the first volume deviation value can be determined based on the deviation value corresponding to each standard audio clip. For example, the second volume deviation value can be determined based on the average of the deviation values corresponding to the standard audio clips, or the second volume deviation value can be obtained by calculating the mean square error of the deviation values of the standard audio clips.

[0161] For example, the second volume deviation value can be determined by averaging. For example, the deviation values corresponding to each standard audio segment are summed to obtain a third sum, and then the third sum is divided by the number of standard audio segments to obtain the second volume deviation value. The calculation formula for the second volume deviation value is as follows:

[0162]

[0163] In formula (7), ε2 represents the second volume deviation value, n represents the number of standard audio segments, (L' i '-L i ) represents the adjusted volume parameter L' corresponding to the i-th standard audio clip i 'The actual volume parameter L corresponding to the i-th standard audio clip i The deviation value between , where i is a positive integer.

[0164] For another example, the second volume deviation value can be determined by calculating the mean square error. For example, the square values of the deviation values corresponding to each standard audio segment can be determined, and then the square values can be summed to obtain a fourth sum value. The fourth sum value is then divided by the number of standard audio segments to obtain the second volume deviation value. The calculation formula for the second volume deviation value is as follows:

[0165]

[0166] In formula (8), ε2 represents the second volume deviation value, n represents the number of standard audio segments, (L' i '-L i ) represents the adjusted volume parameter L' corresponding to the i-th standard audio clip i 'The actual volume parameter L corresponding to the i-th standard audio clip i The deviation value between , where i is a positive integer.

[0167] In the case of multiple standard audio clips, the difference between the adjusted volume parameter and the actual volume parameter corresponding to each standard audio clip can also be determined respectively, and then the second volume deviation value is determined according to the difference between each adjusted volume parameter and the actual volume parameter.

[0168] Here, it can be assumed that there are N standard audio clips, each of which corresponds to an adjusted volume parameter and an actual volume parameter. For each standard audio clip, the difference between the adjusted volume parameter and the actual volume parameter can be determined. For example, the difference between the adjusted volume parameter and the actual volume parameter can be determined, and then N differences can be obtained. After obtaining the N differences, the second volume deviation value can be determined based on the N differences. For example, the second volume deviation value can be determined based on the average value of the N differences. For another example, the mean square error of the N differences can be calculated to obtain the second volume deviation value, etc., where N is a positive integer.

[0169] In the embodiment of the present disclosure, when there are multiple standard audio clips, the adjusted volume parameters and actual volume parameters of each standard audio clip can be taken into consideration when determining the second volume deviation value. Compared with determining the second volume deviation value based only on the parameters corresponding to a certain standard audio clip, the versatility and accuracy of the determined second volume deviation value can be improved.

[0170] In other embodiments, the second volume deviation value may be determined using a preset model. For example, the adjusted volume parameters and actual volume parameters corresponding to each standard audio segment may be input into the preset model, and the second volume deviation value may be output.

[0171] In some embodiments, the preset model can be a model obtained by pre-training an initial model (such as a neural network) through an iterative training method. When training the preset model, the loss value of the initial model can be determined by a loss function (for example, a cross entropy loss function), and then the model parameters of the initial model are adjusted based on the loss value until the convergence condition is reached, and the initial model after the last model parameter adjustment is determined as the preset model. Among them, the convergence condition may include: the number of model parameter adjustments reaches a threshold or the performance of the initial model meets the preset requirements. In some embodiments, the neural network may include: a convolutional neural network and a fully convolutional neural network, etc.

[0172] In the embodiment of the present disclosure, after obtaining the second volume deviation value, the second volume deviation value can be compared with the standard volume deviation value to obtain a comparison result. When the comparison result indicates that the second volume deviation value is greater than the standard volume deviation value, it indicates that there is a deviation in the adjustment volume parameter. For example, the second volume deviation value ε2 can be compared with the standard volume deviation value ε0. If the second volume deviation value ε2 is greater than ε0(1+t%), it can be determined that the second volume deviation value exceeds the standard volume deviation value. At this time, a compensation value can be determined based on the adjustment volume parameter and the actual volume parameter, and the initial adjustment value can be adjusted based on the compensation value. The calculation formula of the compensation value can be as follows:

[0173]

[0174] In formula (9), η1 represents the compensation value, L' i ' represents the volume adjustment parameter corresponding to the i-th standard audio clip, L i represents the actual volume parameter corresponding to the i-th standard audio segment, n represents the number of standard audio segments, and i is a positive integer.

[0175] After obtaining the compensation value, the initial adjustment value can be adjusted based on the compensation value to obtain an intermediate adjustment value. For example, the sum of the initial adjustment value and the compensation value can be determined as the intermediate adjustment value. For example, if the compensation value is η1 and the initial adjustment value is η0, the intermediate adjustment value can be (η0 + η1).

[0176] In other embodiments, if the comparison result indicates that the second volume deviation value is less than or equal to the standard volume deviation value, then it can be determined that the current state of the audio acquisition module of the electronic device is normal, and in this case, there is no need to adjust the initial adjustment value. For example, if the second volume deviation value ε2 is less than or equal to ε0(1+t%), then there is no need to adjust the initial adjustment value. The value of t can be determined as needed.

[0177] It should be noted that in the embodiments of the present disclosure, the initial adjustment value may be adjusted once or multiple times. When the initial adjustment value is adjusted once, there is one corresponding compensation value. When the initial adjustment value is adjusted multiple times, there are multiple corresponding compensation values, that is, each adjustment corresponds to a compensation value.

[0178] In the embodiment of the present disclosure, a second volume deviation value can be determined based on the difference between the adjusted volume parameters and the actual volume parameters corresponding to each standard audio clip. After the second volume deviation value is determined, the second volume deviation value can be compared with the standard volume deviation value. If the second volume deviation value is greater than the standard volume deviation value, a compensation value can be determined based on the adjusted volume parameter and the actual volume parameter, and then the initial adjustment value is adjusted based on the compensation value.

[0179] Before adjusting the initial adjustment value, the second volume deviation value is judged first and the application scenarios are screened. Compared with directly adjusting the initial adjustment value, this can effectively process the audio data, reduce the possibility of invalid processing, and thus improve the data processing efficiency of the electronic device.

[0180] In some embodiments, obtaining the target adjustment value includes:

[0181] When the preset stop condition is reached, the target adjustment value is obtained according to the initial adjustment value and each of the compensation values.

[0182] Wherein, the preset stop condition at least includes: the second volume deviation value is less than or equal to the standard volume deviation value.

[0183] Here, when the second volume deviation value is less than or equal to the standard volume deviation value, it is determined that the preset stop condition has been met. At this time, a target adjustment value can be obtained based on the initial adjustment value and each compensation value. In some embodiments, the target adjustment value can be determined based on the sum of the initial adjustment value and all compensation values.

[0184] In some embodiments, relevant interface functions can be called to send the compensation value and / or adjustment value (initial compensation value, target compensation value) of the audio acquisition module to the processor for processing. For example, the compensation value and / or adjustment value can be sent to a digital signal processor (DSP) for processing. For example, data transmission can be implemented through the platform_send_audio_cal function.

[0185] In some embodiments, the initial adjustment value may be adjusted once or multiple times. When the initial adjustment value is adjusted once, there is one corresponding compensation value. When the initial adjustment value is adjusted multiple times, there are multiple corresponding compensation values, that is, each adjustment corresponds to a compensation value.

[0186] After obtaining the target adjustment value, the volume parameters of the actual audio being recorded can be adjusted using the target adjustment value. For example, the adjusted audio parameters of the actual audio can be determined based on the sum of the volume parameters of the actual audio and the target adjustment value. In some embodiments, when the actual audio is played, it can be played according to the adjusted audio parameters of the actual audio.

[0187] For another example, after recording actual audio through the audio acquisition module of an electronic device, the volume parameter of the actual audio (the recorded volume parameter) is 20 decibels, and the target adjustment value is 5 decibels. The sum of the audio parameter of the actual audio and the target adjustment value, i.e., 25 decibels, can be used as the adjusted audio parameter of the actual audio.

[0188] In the embodiment of the present disclosure, by setting a preset stop condition and determining a target adjustment value after the preset stop condition is reached, the purpose of obtaining an optimal adjustment value can be achieved, thereby improving the accuracy of adjusting the actual audio.

[0189] In some embodiments, the method further comprises:

[0190] When the number of times the initial adjustment value is adjusted is greater than or equal to the preset number of times, and the second volume deviation value is greater than the standard volume deviation value, an abnormality reminder message is output.

[0191] It should be noted that the number of times the initial adjustment value is adjusted refers to the number of times the entire process of adjusting the initial adjustment value is executed. In the embodiment of the present disclosure, if the number of times the initial adjustment value is adjusted is greater than or equal to the preset number of times, and the second volume deviation value is greater than the standard volume deviation value, the adjustment of the initial adjustment value can be stopped.

[0192] Here, the preset number of adjustments can be set as needed, for example, 3 times. Assuming the preset number of adjustments is 3, if the number of times the initial adjustment value is adjusted exceeds 3 times, it is determined that the audio acquisition module cannot be repaired by software repair. In this case, an abnormality reminder message can be output. For example, the abnormality reminder message can be output through a pop-up window.

[0193] Here, the content of the abnormal reminder information can be set as needed, as long as it can prompt the user that an abnormal situation has occurred. For example, the abnormal reminder information can be used to inform the user to go to the after-sales service to repair the electronic device.

[0194] Figure 2 The flow chart of the audio processing method according to an exemplary embodiment is as follows Figure 2 ,like Figure 2 As shown, the method is applied to an electronic device, and the method mainly includes the following steps:

[0195] In step 201, the audio processing method is executed and counting begins.

[0196] In some embodiments, when a detection operation based on an application interface input is detected, the audio processing method may be started and counting may be started. Here, the result obtained by counting is used to represent the number of times the audio processing method is executed.

[0197] In step 202, a sound source is detected to play at least one standard audio segment.

[0198] In some embodiments, when a detection operation based on an application interface input is detected, the detection sound source can be controlled to play at least one standard audio clip. Here, the application interface can be an interface output by an application for volume adjustment on an electronic device. For example, an application for volume adjustment can be installed on an electronic device. When the sound recorded by the electronic device needs to be adjusted, the application can be started and the application interface can be entered. After entering the application interface, a detection operation can be input based on the application interface. When the electronic device detects the detection operation, the detection sound source can be controlled to play at least one standard audio clip.

[0199] In step 203, at least one standard audio segment played by a detection sound source is recorded; wherein the sound frequencies of the standard audio segments are different.

[0200] In step 204, a first volume deviation value is determined according to the difference between the recorded volume parameter and the actual volume parameter corresponding to each standard audio segment.

[0201] In step 205 , it is determined whether the first volume deviation value is greater than a standard volume deviation value.

[0202] In step 206 , when the first volume deviation value is greater than the standard volume deviation value, an initial adjustment value is determined according to the difference between the recorded volume parameters and the actual volume parameters corresponding to each standard audio segment.

[0203] In step 207, the recording volume parameter is adjusted using the initial adjustment value to obtain an adjusted volume parameter.

[0204] In step 208 , it is determined whether the number of times the initial adjustment value is adjusted is greater than or equal to a preset number of times.

[0205] Here, the number of times the initial adjustment value is adjusted may be equal to the number of times the audio processing method is executed. Here, the preset number of adjustments may be set as needed, for example, it may be set to 3. Taking the preset number of adjustments as 3 as an example, it may be determined whether the number of times the initial adjustment value is adjusted is greater than 3.

[0206] In step 209 , when the number of times the initial adjustment value is adjusted is less than the preset number of times, a second volume deviation value is determined according to the difference between the adjusted volume parameter and the actual volume parameter.

[0207] In some embodiments, when the number of times the initial adjustment value is adjusted is greater than or equal to a preset number of times, and the second volume deviation value is greater than the standard volume deviation value, an abnormality reminder message is output.

[0208] In step 210 , it is determined whether the second volume deviation value is greater than the standard volume deviation value.

[0209] In step 211 , when the second volume deviation value is greater than the standard volume deviation value, a compensation value is determined according to the adjusted volume parameter and the actual volume parameter.

[0210] In step 212 , the initial adjustment value is adjusted according to the compensation value.

[0211] In step 213 , when the second volume deviation value is less than or equal to the standard volume deviation value, a target adjustment value is obtained according to the initial adjustment value and each compensation value.

[0212] In an embodiment of the present disclosure, the electronic device can play at least one standard audio clip by detecting the sound source and record each standard audio clip. After recording each standard audio clip, the target adjustment value can be determined based on the actual volume parameters and recording volume parameters corresponding to each standard audio clip, and then the volume parameters of the recorded actual audio can be adjusted according to the target adjustment value.

[0213] In the technical solution disclosed herein, the volume parameters of the actual audio recorded by the electronic device can be adjusted through software. Compared with cleaning the hardware or solving the problem of inaccurate recording by replacing the hardware, it can reduce manual intervention, which can not only improve the intelligence of the electronic device, but also reduce the maintenance cost of the electronic device.

[0214] Figure 3 FIG. 1 is a block diagram of an audio processing device according to an exemplary embodiment. Figure 3 As shown, the audio processing device 300 is applied to an electronic device and mainly includes:

[0215] The recording module 301 is configured to record at least one standard audio segment played by the detection sound source; wherein the sound frequencies of the standard audio segments are different;

[0216] An acquisition module 302 is configured to acquire a recording volume parameter of each of the standard audio segments;

[0217] A determination module 303 is configured to determine a target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recording volume parameter;

[0218] The target adjustment value is used to adjust the volume parameter of the actual recorded audio.

[0219] In some embodiments, the determining module 303 is configured to:

[0220] determining a first volume deviation value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0221] In a case where the first volume deviation value is greater than the standard volume deviation value, the target adjustment value is determined according to the actual volume parameters and the recording volume parameters corresponding to each of the standard audio segments.

[0222] In some embodiments, the determining module 303 is configured to:

[0223] Determining a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0224] The first volume deviation value is determined according to the difference values and the number of the standard audio segments.

[0225] In some embodiments, the determining module 303 is configured to:

[0226] determining an initial adjustment value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments;

[0227] Using the initial adjustment value, adjusting the recording volume parameter to obtain an adjusted volume parameter;

[0228] According to the difference between the adjusted volume parameter and the actual volume parameter, the initial adjustment value is adjusted until a preset stop condition is reached to obtain the target adjustment value.

[0229] In some embodiments, the determining module 303 is configured to:

[0230] determining a second volume deviation value according to a difference between the adjusted volume parameter and the actual volume parameter;

[0231] determining a compensation value according to the adjusted volume parameter and the actual volume parameter when the second volume deviation value is greater than the standard volume deviation value;

[0232] The initial adjustment value is adjusted according to the compensation value.

[0233] In some embodiments, the determining module 303 is configured to:

[0234] When the preset stop condition is met, obtaining the target adjustment value according to the initial adjustment value and each of the compensation values;

[0235] Wherein, the preset stop condition at least includes: the second volume deviation value is less than or equal to the standard volume deviation value.

[0236] In some embodiments, the apparatus 300 further includes:

[0237] The output module is configured to output abnormal reminder information when the number of adjustment times for adjusting the initial adjustment value is greater than or equal to the preset adjustment number and the second volume deviation value is greater than the standard volume deviation value.

[0238] In some embodiments, the apparatus 300 further includes:

[0239] The control module is configured to control the detection sound source to play at least one of the standard audio segments when a detection operation based on application interface input is detected.

[0240] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0241] Figure 4 FIG4 is a block diagram of a hardware structure of an audio processing device 400 according to an exemplary embodiment. For example, the device 400 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0242] Reference Figure 4 , apparatus 400 may include one or more of the following components: a processing component 402 , a memory 404 , a power component 406 , a multimedia component 408 , an audio component 410 , an input / output (I / O) interface 412 , a sensor component 414 , and a communication component 416 .

[0243] Processing component 402 generally controls the overall operation of device 400, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. Processing component 402 may include one or more processors 420 to execute instructions to perform all or part of the steps of the above-described method. In addition, processing component 402 may include one or more modules to facilitate interaction between processing component 402 and other components. For example, processing component 402 may include a multimedia module to facilitate interaction between multimedia component 408 and processing component 402.

[0244] The memory 404 is configured to store various types of data to support operations on the device 400. Examples of such data include instructions for any application or method operating on the device 400, contact data, phone book data, messages, pictures, videos, etc. The memory 404 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0245] Power component 406 provides power to the various components of device 400. Power component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 400.

[0246] The multimedia component 408 includes a screen that provides an output interface between the device 400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front camera and / or a rear camera. When the device 400 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0247] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC) that is configured to receive external audio signals when the device 400 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 404 or transmitted via the communication component 416. In some embodiments, the audio component 410 also includes a speaker for outputting audio signals.

[0248] I / O interface 412 provides an interface between processing component 402 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0249] The sensor assembly 414 includes one or more sensors for providing various aspects of the status assessment of the device 400. For example, the sensor assembly 414 can detect the open / closed state of the device 400, the relative positioning of components, such as the display and keypad of the device 400. The sensor assembly 414 can also detect changes in the position of the device 400 or a component of the device 400, the presence or absence of user contact with the device 400, the orientation or acceleration / deceleration of the device 400, and temperature changes of the device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 414 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0250] The communication component 416 is configured to facilitate wired or wireless communication between the device 400 and other devices. The device 400 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0251] In an exemplary embodiment, the apparatus 400 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0252] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 404 including instructions, which can be executed by the processor 420 of the apparatus 400 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0253] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an audio processing device, enables the audio processing device to perform an audio processing method, the method comprising:

[0254] Recording at least one standard audio segment played by a detection sound source; wherein the sound frequencies of the standard audio segments are different;

[0255] Obtaining recording volume parameters of each of the standard audio clips;

[0256] determining a target adjustment value according to the actual volume parameter corresponding to each of the standard audio clips and the recorded volume parameter;

[0257] The target adjustment value is used to adjust the volume parameter of the actual recorded audio.

[0258] Figure 5 FIG1 is a block diagram of a hardware structure of an audio processing device 1300 according to an exemplary embodiment. For example, the device 1300 can be provided as a server. Figure 5 The apparatus 1300 includes a processing component 1322, which further includes one or more processors and a memory resource represented by a memory 1332 for storing instructions executable by the processing component 1322, such as an application. The application stored in the memory 1332 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1322 is configured to execute the instructions to perform the above-mentioned audio processing method, which includes:

[0259] Recording at least one standard audio segment played by a detection sound source; wherein the sound frequencies of the standard audio segments are different;

[0260] Obtaining recording volume parameters of each of the standard audio clips;

[0261] determining a target adjustment value according to the actual volume parameter corresponding to each of the standard audio clips and the recorded volume parameter;

[0262] The target adjustment value is used to adjust the volume parameter of the actual recorded audio.

[0263] The device 1300 may also include a power supply component 1326 configured to perform power management of the device 1300, a wired or wireless network interface 1350 configured to connect the device 1300 to a network, and an input / output (I / O) interface 1358. The device 1300 may operate based on an operating system stored in the memory 1332, such as Windows Server™, MacOS X™, Unix™, Linux™, FreeBSD™, or the like.

[0264] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0265] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An audio processing method, characterized in that: Used in electronic equipment, including: When a detection operation based on an application interface input is detected, controlling the detection audio source to play at least one standard audio clip; Recording at least one of the standard audio segments played by the detection sound source; wherein the sound frequencies of the standard audio segments are different; Obtaining recording volume parameters of each of the standard audio clips; determining a target adjustment value according to the actual volume parameter corresponding to each of the standard audio clips and the recorded volume parameter; The target adjustment value is used to adjust the volume parameters of the actual recorded audio, and the volume parameters include: sound loudness.

2. The method according to claim 1, characterized in that The determining the target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recording volume parameter includes: determining a first volume deviation value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments; In a case where the first volume deviation value is greater than the standard volume deviation value, the target adjustment value is determined according to the actual volume parameters and the recording volume parameters corresponding to each of the standard audio segments.

3. The method according to claim 2, characterized in that The determining a first volume deviation value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments includes: Determining a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments; The first volume deviation value is determined according to the difference values and the number of the standard audio segments.

4. The method according to claim 1, wherein The determining the target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recording volume parameter includes: determining an initial adjustment value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments; Using the initial adjustment value, adjusting the recording volume parameter to obtain an adjusted volume parameter; According to the difference between the adjusted volume parameter and the actual volume parameter, the initial adjustment value is adjusted until a preset stop condition is reached to obtain the target adjustment value.

5. The method according to claim 4, characterized in that The adjusting the initial adjustment value according to the difference between the adjustment volume parameter and the actual volume parameter includes: determining a second volume deviation value according to a difference between the adjusted volume parameter and the actual volume parameter; determining a compensation value according to the adjusted volume parameter and the actual volume parameter when the second volume deviation value is greater than the standard volume deviation value; The initial adjustment value is adjusted according to the compensation value.

6. The method according to claim 5, characterized in that The obtaining of the target adjustment value includes: When the preset stop condition is met, obtaining the target adjustment value according to the initial adjustment value and each of the compensation values; Wherein, the preset stop condition at least includes: the second volume deviation value is less than or equal to the standard volume deviation value.

7. The method according to claim 6, characterized in that The method further comprises: When the number of times the initial adjustment value is adjusted is greater than or equal to the preset number of times, and the second volume deviation value is greater than the standard volume deviation value, an abnormality reminder message is output.

8. An audio processing device, characterized in that: Used in electronic equipment, including: a control module configured to control the detection audio source to play at least one standard audio clip when a detection operation based on an application interface input is detected; a recording module configured to record at least one of the standard audio segments played by the detection sound source; wherein the sound frequencies of the standard audio segments are different; An acquisition module configured to acquire recording volume parameters of each of the standard audio clips; a determination module configured to determine a target adjustment value according to the actual volume parameter corresponding to each of the standard audio segments and the recording volume parameter; The target adjustment value is used to adjust the volume parameters of the actual recorded audio, and the volume parameters include: sound loudness.

9. The device according to claim 8, characterized in that The determination module is configured as follows: determining a first volume deviation value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments; In a case where the first volume deviation value is greater than the standard volume deviation value, the target adjustment value is determined according to the actual volume parameters and the recording volume parameters corresponding to each of the standard audio segments.

10. The device according to claim 9, characterized in that The determination module is configured as follows: Determining a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments; The first volume deviation value is determined according to the difference values and the number of the standard audio segments.

11. The device according to claim 8, characterized in that The determination module is configured as follows: determining an initial adjustment value according to a difference between the recorded volume parameter and the actual volume parameter corresponding to each of the standard audio segments; Using the initial adjustment value, adjusting the recording volume parameter to obtain an adjusted volume parameter; According to the difference between the adjusted volume parameter and the actual volume parameter, the initial adjustment value is adjusted until a preset stop condition is reached to obtain the target adjustment value.

12. The device according to claim 11, characterized in that The determination module is configured as follows: determining a second volume deviation value according to a difference between the adjusted volume parameter and the actual volume parameter; determining a compensation value according to the adjusted volume parameter and the actual volume parameter when the second volume deviation value is greater than the standard volume deviation value; The initial adjustment value is adjusted according to the compensation value.

13. The device according to claim 12, characterized in that The determination module is configured as follows: When the preset stop condition is met, obtaining the target adjustment value according to the initial adjustment value and each of the compensation values; Wherein, the preset stop condition at least includes: the second volume deviation value is less than or equal to the standard volume deviation value.

14. The device according to claim 13, characterized in that The device further comprises: The output module is configured to output abnormal reminder information when the number of adjustment times for adjusting the initial adjustment value is greater than or equal to the preset adjustment number and the second volume deviation value is greater than the standard volume deviation value.

15. An audio processing device, characterized in that: include: processor; a memory configured to store processor-executable instructions; The processor is configured to implement the steps of any one of the audio processing methods in claims 1 to 7 when executed. 16 . A non-transitory computer-readable storage medium, wherein when instructions in the storage medium are executed by a processor of an audio processing device, the device is enabled to perform the audio processing method according to claim 1 .

Citation Information

Patent Citations

  • Audio signal processing method, device and equipment and storage medium

    CN113542983A