Audio playback parameter determination method, device, electronic device and readable storage medium

By acquiring and comparing audio parameters and adjusting the settings of the playback device to restore the audio loudness and tone, the problem of audio presentation distortion in the prior art is solved, and the fidelity and fidelity of the sound is improved.

CN112463107BActive Publication Date: 2025-01-10GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011337858.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-25
Publication Date
2025-01-10
Estimated Expiration
2041-01-10

AI Technical Summary

Technical Problem

The recording and playback schemes of existing electronic devices cannot accurately describe the loudness and tone of the sound source, resulting in sound distortion, mainly because the fixed settings of the volume curve and audio parameters affect the presentation of the sound.

Method used

By obtaining the parameters of the original audio and recorded audio, and comparing the results, adjusting the audio playback parameters of the playback device to make it within the preset range to restore the loudness and tone of the original audio and improve the sound fidelity.

Benefits of technology

It realizes adaptive matching of audio loudness and tone, avoids sound distortion caused by human settings, and improves the fidelity and fidelity of the sound.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112463107B_ABST
    Figure CN112463107B_ABST
Patent Text Reader

Abstract

The present application provides a method, device, electronic device and readable storage medium for determining audio playback parameters, the method comprising: obtaining original audio parameters of original audio; obtaining recorded audio parameters of recorded audio obtained by recording a recording device; the recorded audio is obtained by recording the original audio played by a playback device by the recording device; adjusting the audio playback parameters of the playback device according to the comparison result between the original audio parameters and the recorded audio parameters; when the comparison result is within a preset audio parameter range, obtaining the target audio playback parameters of the playback device; the target audio playback parameters are used to play the original audio through the playback device. The method of the present application can improve the fidelity of the sound.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an audio playback method, device, electronic device, and computer-readable storage medium. Background Art

[0002] The current recording algorithm for electronic devices is a fixed gain solution, which is generally fixed before leaving the factory in order to make the recorded sound more prominent. The current recording and playback solutions change the loudness and timbre of the sound source. When the user needs to record the loudness and timbre of the sound source heard by the human ear at the time, ordinary recordings cannot accurately describe the loudness and timbre of the sound source at the time when playing. Because its downstream loudness is affected by the playback volume curve, the maximum and minimum volumes of a general 16-level volume curve can differ by more than 50dB. The timbre will be affected by the audio parameters set by the manufacturer and change, resulting in sound distortion. Summary of the invention

[0003] The embodiments of the present application provide a method, device, electronic device, and computer-readable storage medium for determining audio playback parameters, which can improve the fidelity of sound.

[0004] A method for determining audio playback parameters, comprising:

[0005] Get the original audio parameters of the original audio;

[0006] Acquire recording audio parameters of the recording audio obtained by recording through a recording device; the recording audio is obtained by the recording device recording the original audio played by the playback device;

[0007] Adjusting the audio playback parameters of the playback device according to the comparison result between the original audio parameters and the recorded audio parameters;

[0008] When the comparison result is within a preset audio parameter range, a target audio playback parameter of the playback device is obtained; the target audio playback parameter is used to play the original audio through the playback device.

[0009] An audio playback method, the method comprising:

[0010] Obtaining target audio playback parameters of the target audio; the target audio playback parameters are audio playback parameters corresponding to the playback device when the comparison result is within the preset audio parameter range; the comparison result is obtained by comparing the original audio parameters of the target audio with the recorded audio parameters of the recorded audio in advance; the audio playback parameters are adjusted based on the comparison result; the recorded audio is obtained by recording the target audio played by the playback device through the recording device;

[0011] The target audio is played through the playing device according to the target audio playing parameters.

[0012] An audio playback parameter determination device, comprising:

[0013] A first acquisition module, used to acquire original audio parameters of the original audio;

[0014] A second acquisition module is used to acquire recording audio parameters of the recording audio obtained by recording the recording device; the recording audio is obtained by the recording device recording the original audio played by the playback device;

[0015] An adjustment module, used for adjusting the audio playback parameters of the playback device according to the comparison result of the original audio parameters and the recorded audio parameters;

[0016] The determination module is used to obtain the target audio playback parameters of the playback device when the comparison result is within the preset audio parameter range; the target audio playback parameters are used to play the original audio through the playback device.

[0017] An audio playback device, comprising:

[0018] A target audio playback parameter acquisition module is used to acquire target audio playback parameters of target audio; the target audio playback parameters are audio playback parameters corresponding to the playback device when the comparison result is within the preset audio parameter range; the comparison result is obtained by comparing the original audio parameters of the target audio with the recorded audio parameters of the recorded audio in advance; the audio playback parameters are adjusted based on the comparison result; the recorded audio is obtained by recording the target audio played by the playback device through the recording device;

[0019] A playing module is used to play the target audio according to the target audio playing parameters through the playing device.

[0020] An electronic device includes a memory, a processor, a recording device and a playback device, wherein the recording device is used to record audio and the playback device is used to play audio; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes a method for determining audio playback parameters.

[0021] An electronic device comprises a memory, a processor, a recording device and a playback device, wherein the recording device is used to record audio and the playback device is used to play audio; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes an audio playback method.

[0022] A computer-readable storage medium stores a computer program, which implements an audio playback parameter determination method when executed by a processor.

[0023] A computer-readable storage medium stores a computer program, which implements an audio playback method when executed by a processor.

[0024] The above-mentioned audio playback parameter determination method, device, electronic device and readable storage medium obtain the audio parameters of the original audio and the recorded audio parameters of the recorded audio, and adjust the audio playback parameters of the playback device according to the comparison result of the original audio parameters and the recorded audio parameters, that is, by adjusting the audio playback parameters of the playback device to make the original audio parameters and the recorded audio parameters close, the recorded audio can be made closer to the original audio to restore the original audio, thereby improving the realism of the sound. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0026] Figure 1 A diagram of an application environment of a method for determining audio playback parameters in an embodiment;

[0027] Figure 2 A flowchart of a method for determining audio playback parameters in one embodiment;

[0028] Figure 3 A schematic diagram of a process for adjusting the full-band gain of a playback device in one embodiment;

[0029] Figure 4 A schematic diagram of a flow chart of adjusting a playback equalizer curve of a playback device in one embodiment;

[0030] Figure 5 A schematic diagram of a flow chart of calibrating a recording device in one embodiment;

[0031] Figure 6 A system framework flow chart of a method for determining audio playback parameters in one embodiment;

[0032] Figure 7 A schematic diagram of a flow chart of an audio playback method in one embodiment;

[0033] Figure 8 A structural block diagram of an audio playback parameter determination device according to an embodiment;

[0034] Fig. 9 is a structural block diagram of an audio playback device according to an embodiment;

[0035] Fig.10 FIG. 1 is a schematic diagram of the internal structure of an electronic device in an embodiment. DETAILED DESCRIPTION

[0036] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0037] It is understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, without departing from the scope of this application, a first client may be referred to as a second client, and similarly, a second client may be referred to as a first client. Both the first client and the second client are clients, but they are not the same client.

[0038] Figure 1 FIG. 1 is a schematic diagram of an application environment of a method for determining audio playback parameters in an embodiment. Figure 1 As shown, the application environment includes an electronic device 110, a recording device 120 and a playback device 130. The recording device 120 may be located in the electronic device 110, and the recording device 120 and the playback device 130 may both be located in the electronic device 110. Alternatively, the recording device 120 and the playback device 130 may be connected to the electronic device by wired connection or wireless connection, respectively. The recording device 120 is used to collect audio, and the recording device 120 may specifically be a microphone, a recorder, and other devices. The playback device 130 is used to play the original audio, and the playback device 130 may specifically be a speaker, a stereo, and other devices. The electronic device 110 is used to obtain the original audio parameters of the original audio. The playback device 130 is used to play the original audio, and the recording device 120 is used to record the original audio played by the playback device 130 to obtain the recorded audio. The electronic device 110 obtains the recorded audio parameters of the recorded audio; according to the comparison result of the original audio parameters and the recorded audio parameters, the audio playback parameters of the playback device 130 are adjusted; when the comparison result is within the preset audio parameter range, the target audio playback parameters of the playback device 130 are obtained. The playback device 130 plays the original audio based on the target audio playback parameters.

[0039] Figure 2 FIG. 1 is a flowchart of a method for determining audio playback parameters in an embodiment. The method for determining audio playback parameters in this embodiment is executed at Figure 1The electronic device 110 is used as an example for description. Figure 2 As shown, the method for determining audio playback parameters includes steps 202 to 208:

[0040] Step 202: Acquire original audio parameters of the original audio.

[0041] The original audio refers to the audio formed by the sound source recorded by the electronic device. The duration of the original audio is not limited, and can be 1 second, 2 seconds, 10 seconds, 5 minutes, etc. without limitation. The original audio parameters are used to represent some sound characteristics of the original audio. For example, the original audio parameters can be the original audio loudness, original audio frequency, original audio gain, etc. without limitation.

[0042] Specifically, the electronic device obtains the original audio parameters from a recording device that records the original audio. Alternatively, the electronic device performs spectrum analysis on the original audio to obtain the original audio parameters of the original audio.

[0043] Step 204, obtaining recording audio parameters of the recording audio obtained by recording through the recording device; the recording audio is obtained by recording the original audio played by the playback device through the recording device.

[0044] The recording device is used to record the original audio played by the playback device. The number of recording devices is not limited, and can be 1, 2, 3, etc. without limitation thereto. The sound effect of the recorded audio recorded by multiple recording devices is better. The recorded audio refers to the audio obtained by recording the original audio played by the playback device. The recorded audio parameters refer to the audio parameters of the recorded audio. Similarly, the recorded audio parameters can be the recorded audio loudness, the recorded audio frequency, the recorded audio gain, etc. without limitation thereto.

[0045] Specifically, the playback device plays the original audio, and the recording device can record the original audio played by the playback device in real time. The electronic device obtains the recording audio parameters of the recorded audio. Since the audio playback parameters of each playback device may be slightly different, the recording audio parameters of the recorded audio may also be different.

[0046] Step 206: adjusting the audio playback parameters of the playback device according to the comparison result between the original audio parameters and the recorded audio parameters.

[0047] Specifically, the comparison result is used to indicate the difference between the original audio parameters and the recorded audio parameters. The comparison result may specifically be a difference or similarity, etc. The audio playback parameters of the playback device are used to adjust the playback effect of the original audio. For example, the louder the loudness of the playback device, the louder the original audio played. The electronic device adjusts the audio playback parameters of the playback device according to the parameter difference between the original audio parameters and the recorded audio parameters. For example, when the value of the comparison result is large, the adjustment range of the audio playback parameters of the playback device is larger. Or when the original audio parameters are greater than the recorded audio parameters, the audio playback parameters of the playback device are increased; when the original audio parameters are less than or equal to the recorded audio parameters, the audio playback parameters of the playback device are reduced.

[0048] Step 208: When the comparison result is within the preset audio parameter range, the target audio playback parameter of the playback device is obtained; the target audio playback parameter is used to play the original audio through the playback device.

[0049] The preset audio parameter range may be set according to actual conditions. The preset audio parameter range may be an interval. For example, the preset audio parameter range may be an interval of -1 to 1. The difference represented by the comparison result within the preset audio parameter range is smaller than the difference represented by the comparison result not within the preset audio parameter range.

[0050] Specifically, when the comparison result is within the preset audio parameter range, the electronic device obtains the corresponding audio playback parameter and obtains the target audio playback parameter. The playback device plays the original audio based on the target audio playback parameter. For example, if the comparison result between the original audio parameter and the recorded audio parameter is within the range of -2 to 2, and the preset audio parameter range is within the range of -1 to 1, then the electronic device needs to adjust the audio playback parameter of the playback device. Assuming the comparison result is 1.5, the electronic device adjusts based on 1.5 to obtain an audio playback parameter a. The electronic device determines whether the comparison result corresponding to the audio playback parameter a is within the range of -1 to 1, and obtains the target audio playback parameter a when the comparison result is within the preset audio parameter range.

[0051] The audio playback parameter determination method in this embodiment obtains the audio parameters of the original audio and the recorded audio parameters of the recorded audio, and adjusts the audio playback parameters of the playback device according to the comparison result of the original audio parameters and the recorded audio parameters. That is, by adjusting the audio playback parameters of the playback device to make the original audio parameters and the recorded audio parameters close, the recorded audio can be made closer to the original audio to restore the original audio, thereby improving the realism of the sound.

[0052] In one embodiment, the original audio parameter includes original audio loudness; the recorded audio parameter includes recorded audio loudness; the comparison result includes loudness comparison result; and the audio playback parameter includes full-band playback gain.

[0053] According to the comparison result of the original audio parameters and the recorded audio parameters, the audio playback parameters of the playback device are adjusted, including: according to the loudness comparison result of the original audio loudness and the recorded audio loudness, the full-band playback gain of the playback device is adjusted.

[0054] When the comparison result is within the preset audio parameter range, the target audio playback parameter of the playback device is obtained, including: when the loudness comparison result is within the preset loudness range, the target full-band playback gain of the playback device is obtained.

[0055] Among them, loudness is also called volume, which is used to indicate the strength of sound. The original audio loudness is the loudness corresponding to the original audio. The original audio loudness is obtained by converting the size of the membrane vibration of the recording device that records the original audio into loudness. The recorded audio loudness is the loudness corresponding to the recorded audio. The loudness comparison result is used to indicate the difference between the original audio loudness and the recorded audio loudness. The loudness comparison result can specifically be a difference or a ratio, etc. The full-band playback gain refers to the gain of the sound in the entire frequency band. That is, the gain corresponding to all frequency points is the full-band playback gain. For example, if the full frequency band is 10 Hz to 1000 Hz, then the full-band playback gain is the unified gain corresponding to each frequency point from 10 Hz to 1000 Hz.

[0056] The preset loudness range can be set according to actual conditions. The preset loudness range can be specifically an interval. For example, the preset loudness range can be an interval of -1 to 1. The difference represented by the comparison result within the preset loudness range is smaller than the difference represented by the comparison result not within the preset loudness range.

[0057] Specifically, the electronic device continuously adjusts the full-band playback gain of the playback device based on a loudness comparison result between the original audio loudness and the recorded audio loudness, when the comparison result is not within a preset audio parameter range; until the loudness comparison result is within the preset loudness range, the target full-band playback gain of the playback device is obtained.

[0058] In this embodiment, although the audio loudness of the audio at different time points is different, for the same audio, the full-band playback gain is the same. Therefore, when the playback device plays the original audio, the recording device can record the original audio played by the playback device in real time to obtain the original audio loudness and the recorded audio loudness at the same time, thereby obtaining a loudness comparison result at the same time, which is used to adjust the audio playback parameters of the playback device.

[0059] The audio playback parameter determination method in this embodiment adjusts the full-band playback gain of the playback device according to the loudness comparison result between the original audio loudness and the recorded audio loudness. When the loudness comparison result is within a preset loudness range, the target full-band playback gain of the playback device is obtained. That is, the loudness comparison result can be within a range by adjusting the full-band playback gain of the playback device, so that the original audio and the recorded audio are similar, the loudness of the original audio can be restored, and the fidelity of the loudness of the recorded audio is improved.

[0060] In one embodiment, adjusting the full-band playback gain of the playback device according to a loudness comparison result between the original audio loudness and the recorded audio loudness includes: when the recorded audio loudness is greater than the original audio loudness, reducing the full-band playback gain of the playback device; when the recorded audio loudness is less than the original audio loudness, increasing the full-band playback gain of the playback device.

[0061] Specifically, when the recorded audio loudness is greater than the original audio loudness, it means that the full-band playback gain of the playback device is too large, so the full-band playback gain of the playback device needs to be reduced. When the recorded audio loudness is less than the original audio loudness, it means that the full-band playback gain of the playback device is too small, so the full-band gain of the playback device needs to be increased. The method of increasing and decreasing is not limited, for example, it can be increasing by a fixed value each time or decreasing by a fixed value each time, etc., but is not limited to this. Or when the difference between the recorded audio loudness and the original audio loudness exceeds the first difference value, the full-band gain of the playback device is adjusted according to the first gain value; when the difference between the recorded audio loudness and the original audio loudness is less than the first difference value, the full-band gain of the playback device is adjusted according to the second difference value, wherein the first gain value is greater than the second gain value.

[0062] In one embodiment, Figure 3 As shown, it is a schematic diagram of a process of adjusting the full-band gain of a playback device in one embodiment. The original audio loudness B0 of the original audio is obtained. The playback device initializes the initial gain value A0. The playback device plays the original audio based on the current full-band playback gain. The recording device records the original audio played by the playback device to obtain the recorded audio, and obtains the recorded audio loudness Bn corresponding to the recorded audio. Determine | B n -B0| is greater than h, where h is the loudness difference value. n - Is B0 greater than h or B? n -B0 is less than -h. When |B n -B0|>h, it means that the loudness comparison result is not within the preset loudness range, so it is necessary to adjust the audio playback parameters of the playback device. This is achieved by stepping ±△a. n - When B0>0, that is, when the recorded audio loudness Bn is greater than the original audio loudness B0, reduce the audio playback parameter An of the playback device to A n-1-△a. When B n - When B0 < 0, that is, when the recorded audio loudness is less than or equal to the original audio loudness, increase the audio playback parameter An of the playback device = A n-1 +△a. When the electronic device obtains the adjusted full-band playback gain, it returns to the step of playing with the current full-band playback gain. When |B n -B0|≤h, indicating the loudness comparison result |B n -B0| When the loudness is within the preset range, the iteration ends and the target full-band playback gain An of the playback device is obtained. The playback device plays the original audio at the target full-band playback gain An.

[0063] In the audio playback parameter determination method of this embodiment, when the recorded audio loudness is greater than the original audio loudness, it means that the full-band playback gain of the playback device is too large, and therefore the full-band playback gain of the playback device needs to be reduced; when the recorded audio loudness is less than the original audio loudness, it means that the full-band playback gain of the playback device is too small, and therefore the full-band gain of the playback device needs to be increased, so that the original audio loudness and the recorded audio loudness converge, so that the playback effect of the original audio can be restored and the fidelity of the recorded audio is improved.

[0064] In one embodiment, the original audio parameters include an original equalizer curve; the recorded audio parameters include a recorded equalizer curve; and the audio playback parameters include a playback equalizer curve.

[0065] According to the comparison result of the original audio parameters and the recorded audio parameters, the audio playback parameters of the playback device are adjusted, including: adjusting the playback equalizer curve of the playback device according to the target full-band playback gain to obtain an adjusted playback equalizer curve; the adjusted playback equalizer curve is used for audio playback and audio recording; according to the equalizer curve comparison result between the original equalizer curve and the recorded equalizer curve, the adjusted playback equalizer curve is adjusted.

[0066] When the comparison result is within the preset audio parameter range, the target audio playback parameters of the playback device are obtained, including: when the equalizer curve comparison result is within the preset frequency point gain range, the target playback equalizer curve of the playback device is obtained; the target playback equalizer curve is used to play the original audio through the playback device.

[0067] Among them, the equalizer curve refers to the EQ (Equalizer) curve. The horizontal axis of the equalizer curve is frequency, and the vertical axis is gain. That is, the equalizer curve is used to characterize the relationship between each frequency point and gain. The equalizer curve can be obtained by performing spectrum analysis on the audio. The original equalizer curve refers to the equalizer curve of the original audio. The recording equalizer curve refers to the equalizer curve of the recorded audio. The playback equalizer curve refers to the equalizer curve when the playback device is currently playing the original audio. The adjusted playback equalizer curve refers to the curve adjusted by the target full-band playback gain. And the adjusted playback equalizer curve is used for audio playback and audio recording. The equalizer curve comparison result may refer to the equalizer comparison result of an optional frequency point in the equalizer curve.

[0068] Specifically, since the target full-band playback gain refers to a coarse-adjusted playback gain of all frequencies, it is necessary to adjust the playback equalizer curve of the playback device according to the target full-band playback gain to obtain the adjusted playback equalizer curve. The adjusted playback equalizer curve is used for audio playback and audio recording, that is, the playback device plays audio based on the adjusted playback equalizer curve, and the recording device records the audio played based on the adjusted playback equalizer curve. The electronic device adjusts the adjusted playback equalizer curve according to the equalizer curve comparison result between the original equalizer curve and the recorded equalizer curve, until the target playback equalizer curve of the playback device is obtained when the equalizer curve comparison result is within the preset frequency point gain range. The playback device plays the original audio based on the target playback equalizer curve. For example, the electronic device obtains the target full-band playback audio gain An, and the playback device has its own playback equalizer curve EQ1, then adjusts EQ1 according to An to obtain the adjusted EQ1. The playback device plays the original audio according to the adjusted EQ1, and the recording device records the original audio played by the playback device according to the adjusted EQ1 to obtain the recorded audio Y, and then adjusts the adjusted EQ1 according to the equalizer curve comparison result between the recorded equalizer curve of the recorded audio Y and the original equalizer curve of the original audio, until the equalizer curve comparison result is within the preset frequency point gain range, and the target playback equalizer curve EQn of the playback device is obtained.

[0069] In this embodiment, the electronic device obtains the original audio loudness and the original equalizer curve of the original audio; obtains the recorded audio loudness of the recorded audio obtained by recording the recording device; the recorded audio is obtained by recording the original audio played by the playback device by the recording device; according to the comparison result of the original audio loudness and the recorded audio loudness, the audio playback loudness of the playback device is adjusted; when the loudness comparison result is within the preset loudness range, the target full-band playback gain of the playback device is obtained; the target full-band playback gain is used to play the original audio through the playback device. The electronic device adjusts the playback equalizer curve of the playback device according to the target full-band playback gain to obtain the adjusted playback equalizer curve; obtains the recorded audio loudness of the recorded audio obtained by recording the recording device, the recorded audio is obtained by recording the original audio played by the playback device based on the adjusted playback equalizer curve; according to the equalizer curve comparison result between the original equalizer curve and the recorded equalizer curve of the recorded audio, the adjusted playback equalizer curve is adjusted; until the equalizer curve comparison result is within the preset frequency point gain range, the target playback equalizer curve of the playback device is obtained. The target playback equalizer curve is used to play the original audio through the playback device.

[0070] The audio playback parameter determination method in this embodiment adjusts the playback equalizer curve of the playback device according to the target full-band playback gain to obtain the adjusted playback equalizer curve, that is, the playback equalizer curve of the playback device is first roughly adjusted; according to the equalizer curve comparison result between the original equalizer curve and the recorded equalizer curve of the recorded audio, the adjusted playback equalizer curve is adjusted, that is, the adjusted playback equalizer curve is fine-tuned; when the equalizer curve comparison result is within the preset frequency point gain range, the target playback equalizer curve of the playback device is obtained, which can make the timbre of the original audio and the timbre of the recorded audio converge, restore the playback effect of the original audio, and improve the realism of the sound.

[0071] In one embodiment, the comparison result includes the equalizer curve comparison result; the audio playback parameters include the playback equalizer curve; the target audio playback parameters include the target playback equalizer curve; when the comparison result is within the preset audio parameter range, the target audio playback parameters of the playback device are obtained, including: when the equalizer curve comparison result is within the preset frequency point gain range, the target playback equalizer curve of the playback device is obtained.

[0072] Specifically, the comparison result of the equalizer curve is within the preset frequency gain range, which may refer to the frequency gain comparison results of preset points on the equalizer curve, which are all within the preset frequency gain range; or the frequency gain comparison results of each point on the equalizer curve are all within the preset frequency gain range, etc., and are not limited thereto. For example, the frequency ranges corresponding to the original equalizer curve and the recorded equalizer curve are both 10 to 1000 Hz, so when the gain comparison results corresponding to frequencies such as 10, 100, 200, and 300 are all within the preset frequency gain range, it means that the comparison result of the equalizer curve is within the preset frequency gain range.

[0073] In this embodiment, recording audio parameters of recorded audio recorded by at least two recording devices are obtained, including: obtaining recording audio parameters of the recorded audio recorded by each recording device, and averaging at least two recording audio parameters to obtain recording audio parameters of the recorded audio.

[0074] In the audio playback parameter determination method of this embodiment, when the equalizer curve comparison result is within the preset frequency gain range, it means that the difference between the original equalizer curve and the recorded equalizer is small, then the target playback equalizer curve of the playback device can be obtained, which can make the original audio played by the playback device have a high degree of restoration, so that the human ear can hear the original timbre of the original audio.

[0075] In one embodiment, the original audio parameters include an original equalizer curve; the recorded audio parameters include a recorded equalizer curve. According to the comparison result of the original audio parameters and the recorded audio parameters, adjusting the audio playback parameters of the playback device includes:

[0076] Step (a1), obtaining each preset frequency and the original frequency point gain corresponding to each preset frequency from the original equalizer curve.

[0077] The horizontal axis of the equalizer curve is the frequency, and the vertical axis is the frequency gain. The preset frequency refers to the frequency supported by both the original equalizer curve and the recorded equalizer curve. The preset frequency can be set according to the requirements. For example, the preset frequency can be 10 Hz, 100 Hz, 1000 Hz, etc., but is not limited thereto. The original frequency gain is used to represent the frequency gain.

[0078] Specifically, the electronic device obtains each preset frequency and the original frequency gain corresponding to each preset frequency from the original equalizer curve. For example, if the preset frequencies are 10 Hz, 100 Hz, and 1000 Hz, then the original frequency gain corresponding to 10 Hz is 5 dB (decibel), the original frequency gain corresponding to 100 Hz is 10 dB (decibel), and the original frequency gain corresponding to 1000 Hz is -3 dB (decibel).

[0079] Step (a2), obtaining each preset frequency and the recording frequency point gain corresponding to each preset frequency from the recording equalizer curve.

[0080] Specifically, each preset frequency and the recording frequency point gain corresponding to each preset frequency are obtained from the recording equalizer curve. For example, if the preset frequencies are 10 Hz, 100 Hz, and 1000 Hz, then the recording frequency point gain corresponding to 10 Hz is 10 dB (decibel), the recording frequency point gain corresponding to 100 Hz is 5 dB (decibel), and the recording frequency point gain corresponding to 1000 Hz is -6 dB (decibel).

[0081] Step (a3): for each preset frequency, the original frequency gain corresponding to the preset frequency is compared with the corresponding recorded frequency gain to obtain a frequency gain comparison result corresponding to the preset frequency.

[0082] The frequency point gain comparison result is used to indicate the gain difference corresponding to the same frequency. The frequency point gain comparison result may be the gain difference corresponding to the same frequency, or the gain difference ratio corresponding to the same frequency, etc., but is not limited thereto.

[0083] Specifically, for each preset frequency, the electronic device compares the original frequency gain corresponding to the same preset frequency with the corresponding recorded frequency gain to obtain the frequency gain comparison result corresponding to the preset frequency. For example, for a preset frequency of 10 Hz, the original frequency gain of 5dB (decibel) is compared with the recorded frequency gain of 10dB (decibel), and the frequency gain comparison result corresponding to 10 Hz is 5dB (decibel). For a preset frequency of 100 Hz, the original frequency gain of 5dB (decibel) is compared with the recorded frequency gain of 10dB (decibel), and the frequency gain comparison result corresponding to 100 Hz is 5dB (decibel). For a preset frequency of 1000 Hz, the original frequency gain of -3dB (decibel) is compared with the recorded frequency gain of -6dB (decibel), and the frequency gain comparison result corresponding to 1000 Hz is 3dB (decibel).

[0084] Step (a4), adjusting the playback gain of the frequency point corresponding to the preset frequency of the playback device according to the comparison result of the frequency point gain corresponding to the preset frequency.

[0085] Specifically, the electronic device adjusts the frequency point playback gain corresponding to the preset frequency point of the playback device according to the frequency point gain comparison result corresponding to each preset frequency. For example, the electronic device adjusts the frequency point playback gain corresponding to the frequency point gain of 10 Hz of the playback device according to the frequency point gain comparison result corresponding to 10 Hz of 5dB (decibel). The electronic device adjusts the frequency point playback gain corresponding to 100 Hz of the playback device according to the frequency point gain comparison result corresponding to 100 Hz of 5dB (decibel). The electronic device adjusts the frequency point playback gain corresponding to 1000 Hz of the playback device according to the frequency point gain comparison result corresponding to 1000 Hz of 3dB (decibel).

[0086] When the original frequency gain corresponding to the preset frequency is greater than the recorded frequency gain, the playback gain of the frequency corresponding to the preset frequency of the playback device is increased. When the original frequency gain corresponding to the preset frequency is less than the recorded frequency gain, the playback gain of the frequency corresponding to the preset frequency of the playback device is reduced.

[0087] When the equalizer curve comparison result is within the preset frequency gain range, the target playback equalizer curve of the playback device is obtained, including:

[0088] Step (a5), when the frequency point gain comparison result corresponding to the preset frequency is within the preset frequency point gain range, the target frequency point playback gain corresponding to the preset frequency is obtained.

[0089] Specifically, when the frequency gain comparison result corresponding to the preset frequency is within the preset frequency gain range, the electronic device outputs the target frequency playback gain corresponding to the preset frequency. For example, if the preset frequency gain range is within the range of -1 to 1, the electronic device outputs the target frequency playback gain corresponding to the preset frequency.

[0090] Step (a6), obtaining a target playback equalizer curve based on the target frequency playback gain of each preset frequency.

[0091] Specifically, the electronic device reconstructs a target playback equalizer curve based on the target frequency playback gain of each preset frequency. Alternatively, the electronic device adjusts the equalizer curve of the playback device based on the target frequency playback gain of each preset frequency to obtain the target playback equalizer curve.

[0092] The audio playback parameter determination method in this embodiment obtains each preset frequency and the corresponding original frequency gain and recording frequency gain from the original equalizer curve and the recorded equalizer curve respectively, and adjusts the playback frequency gain for each preset frequency, so as to obtain the final target playback equalizer curve, so that the sound effect recorded by the recording device is closer to the original audio, thereby improving the sound restoration and realism.

[0093] In one embodiment, Figure 4 As shown, it is a flow chart of adjusting the playback equalizer curve of a playback device in an embodiment. The original audio and the original equalizer curve of the original audio are obtained. The playback device plays the original audio with its own current equalizer curve. Specifically, during initialization, the playback device can play the original audio with its own calibrated frequency response curve to reduce the sound distortion of the original audio during playback. The playback device can be calibrated in the frequency domain based on the spectrum characteristics of white noise to obtain the calibrated frequency response curve of the playback device. The recording device records the original audio played by the playback device with the current equalizer curve, and obtains the recording equalizer curve corresponding to the recorded audio. It is determined whether the frequency gain comparison result between the original equalizer curve and the current equalizer curve is within the preset frequency gain range. When the frequency gain comparison result is not within the preset frequency gain range, the frequency playback gain corresponding to each preset frequency is adjusted, and the current equalizer curve of the playback device is updated based on the adjusted frequency playback gain. When the frequency gain comparison result is within the preset frequency gain range, the target playback equalizer curve is obtained.

[0094] In one embodiment, obtaining original audio parameters of original audio includes: locating a sound source through a recording device array composed of at least two recording devices to obtain a sound source depth of the sound source; the sound source is a sound source corresponding to the original audio; determining a sound source propagation loss based on the sound source depth; and determining original audio parameters based on the sound source propagation loss and the audio parameters of the original audio.

[0095] The sound source refers to the sound source corresponding to the original audio. For example, the sound source is the sound of fireworks, live music, etc. The recording device can be any recording device. The recording device array composed of at least two recording devices is a beam forming (BF) microphone array composed of at least two recording devices. The sound source depth is used to characterize the distance between the recording device array and the sound source. For example, 5 meters, 10 meters, etc. are not limited to this.

[0096] Specifically, a sound source is localized by using a recording device array composed of at least two recording devices to obtain a sound source depth. The electronic device determines the sound source propagation loss based on the sound source depth. The specific sound source depth is positively correlated with the sound source propagation loss. The greater the sound source depth, the greater the sound source propagation loss; the smaller the sound source depth, the smaller the sound source propagation loss. The electronic device can add the sound source propagation loss to the audio parameters of the original audio to obtain the original audio parameters. For example, a sound source is localized by using a beamforming microphone array composed of microphone A and microphone B, and the electronic device obtains the sound source depth of the sound source. Based on the sound source depth, the electronic device determines that the sound source propagation loss is 5dB, and the audio parameter of the original audio is 2dB. Then, based on the sound source propagation loss of 5dB and the audio parameter of the original audio of 2dB, the original audio parameter is 7dB. In a scenario, for example, the sound source is fireworks, and the original audio is recorded by user A on the shore. After determining the sound source propagation loss, the original audio parameters of the sound source can be determined based on the sound source propagation loss and the audio parameters of the original audio recorded by user A on the shore, which are equivalent to the original audio parameters obtained by user A recording next to the fireworks.

[0097] The method for determining audio playback parameters in this embodiment locates the sound source through a recording device array composed of at least two recording devices, obtains the sound source depth of the sound source, determines the sound source propagation loss based on the sound source depth, and determines the original audio parameters based on the sound source propagation loss and the audio parameters of the original audio. In this way, compensation can be made for the propagation loss caused during the propagation of the sound source, and restoration of the audio and loudness of the sound source where the audio occurs, i.e., the sound source.

[0098] In one embodiment, the method for determining audio playback parameters also includes: recording white noise through a recording device, performing spectrum analysis on the white noise, and obtaining the spectrum characteristics of the white noise; performing frequency domain calibration on the recording device based on the spectrum characteristics of the white noise to obtain a frequency response curve of the recording device; and recording audio based on the frequency response curve.

[0099] Specifically, the electronic device records white noise through a recording device, and performs spectrum analysis on the white noise to obtain the spectrum characteristics of the white noise. The electronic device calibrates the spectrum characteristics of the recording device based on the spectrum characteristics of the white noise, that is, calibrates the frequency response curve of the recording device into a straight line to obtain the frequency response curve of the recording device. That is, the characteristic of the frequency response curve of the recording device is that it does not enhance or attenuate specific frequency points, so as to ensure that the timbre of the recorded sound is restored to the greatest extent. That is, the gain of the high-gain frequency points of the recording device is reduced, and the gain of the low-gain frequency points of the recording device is increased. Audio is recorded based on the frequency response curve, and the recorded audio parameters are obtained.

[0100] In one embodiment, Figure 5The figure is a flow chart of the calibration of a recording device in an embodiment. It shows the calibration process of two recording devices. White noise is recorded by recording device 1 and recording device 2, and the electronic device performs spectrum analysis on the white noise to obtain the spectrum characteristics of the white noise. The electronic device performs frequency domain calibration on the recording device based on the spectrum characteristics of the white noise to obtain the frequency response curve of the recording device. The electronic device saves the frequency domain calibration coefficient matrix corresponding to the frequency response curve of each recording device, that is, the frequency domain dual-microphone calibration coefficient matrix.

[0101] The method for determining audio playback parameters in this embodiment records white noise through a recording device, performs spectrum analysis on the white noise, and obtains the spectrum characteristics of the white noise. Since the power spectrum density of white noise in each frequency band is the same, the gain of each frequency point is also basically the same. Therefore, the spectrum characteristics of the recording device are calibrated based on the spectrum characteristics of the white noise to obtain the frequency response curve of the recording device. The recording device records the recorded audio based on the frequency response curve, which can ensure that the timbre of the recorded sound is restored to the greatest extent.

[0102] In one embodiment, the method for determining audio playback parameters further includes: when the comparison result is not within the preset audio parameter range, adjusting based on the comparison result of the original audio parameters and the recorded audio parameters to obtain adjusted audio playback parameters; performing audio playback and audio recording based on the adjusted audio playback parameters, and returning to execute the step of obtaining the recorded audio parameters of the recorded audio obtained by recording the recording device. .

[0103] Specifically, when the comparison result is not within the preset audio parameter range, it means that the comparison result is quite different. The electronic device makes adjustments based on the comparison result of the original audio parameters and the recorded audio parameters to obtain the adjusted audio playback parameters. The playback device plays the original audio with the adjusted audio playback parameters, and the recording device records the original audio played with the adjusted audio playback parameters, and returns to execute the step of obtaining the recorded audio parameters of the recorded audio obtained by recording the recording device. After that, the original audio parameters and the recorded audio parameters are compared again, and the audio playback parameters of the playback device are adjusted until the comparison result is within the preset audio parameter range, and the target audio playback parameters of the playback device are obtained.

[0104] The audio playback parameter determination method in this embodiment, when the comparison result is not within the preset audio parameter range, makes adjustments based on the comparison result of the original audio parameters and the recorded audio parameters to obtain the adjusted audio playback parameters, and performs audio playback and audio recording based on the adjusted audio playback parameters, that is, it is necessary to loop audio playback and audio recording to cyclically adjust the audio playback parameters until the comparison result is within the preset audio parameter range, thereby obtaining the target audio playback parameters of the playback device and improving the fidelity of the sound.

[0105] In one embodiment, a scenario is provided as follows: a recording device is located in an electronic device, a playback device is connected to the electronic device, and the sound source is fireworks. The electronic device records the sound of fireworks to form original audio, and obtains original audio parameters of the original audio. The recording device can be compared to the human ear of user A. The sound heard by the human ear is the recorded audio, and the parameters of the recorded audio heard by the human ear are the recorded audio parameters. When the playback device plays the original audio, the ear of user A will determine whether the sound heard is consistent with the original sound heard. If not, it is necessary to adjust the playback audio parameters of the playback device until the sound heard is the same as the original audio, and the playback audio parameters of the playback device are obtained. At this time, the sound effect of the original audio played is very close to the original audio.

[0106] In one embodiment, Figure 6 As shown, it is a system framework flow chart of the method for determining audio playback parameters in an embodiment. Recording device recording: recording the sound source through the recording device to obtain the original audio. Calibration of the recording device: recording white noise through the recording device, performing spectrum analysis on the white noise, obtaining the spectrum characteristics of the white noise, and calibrating the recording device in the frequency domain based on the spectrum characteristics of the white noise to obtain the frequency response curve of the recording device. Full-band gain calibration: adjusting the full-band playback gain of the playback device according to the comparison result of the original audio loudness and the recorded audio loudness; when the loudness comparison result is within the preset audio parameter range, the target audio playback parameter of the playback device is obtained. Equalizer curve calibration: adjusting the playback equalizer curve of the playback device according to the target full-band playback gain to obtain the adjusted playback equalizer curve; adjusting the adjusted playback equalizer curve according to the comparison result of the equalizer curve between the original equalizer curve and the recorded equalizer curve; when the comparison result of the equalizer curve is within the preset frequency point gain range, the target playback equalizer curve of the playback device is obtained. Downlink playback: playing the original audio through the playback device with the result of the target playback equalizer curve. For different original audios, there are corresponding target audio playback parameters. That is, the target audio playback parameters are difficult to share. The present application provides a solution for users to restore the audio timbre and loudness to the greatest extent possible. When the user records the audio, the recorded sound source file will not be affected by the turning EQ curve and the volume level curve, and the loudness and timbre of the audio at that time can be reproduced with maximum fidelity. In addition, the embodiments of the present application can provide a technical solution for adaptively matching loudness and timbre. The technical solution can be applied to the sound source restoration machine solution without human intervention, avoiding the problem of inconsistent timbre and loudness caused by subjective differences in the human ear.

[0107] In one embodiment, a method for determining audio playback parameters includes the following steps:

[0108] Step (b1) locates the sound source through a recording device array composed of at least two recording devices to obtain the sound source depth of the sound source. The sound source is the sound source corresponding to the original audio.

[0109] Step (b2), determining the sound source propagation loss based on the sound source depth.

[0110] Step (b3), determining original audio parameters based on the sound source propagation loss and audio parameters of the original audio.

[0111] Step (b4), recording white noise by a recording device, performing spectrum analysis on the white noise, and obtaining spectrum characteristics of the white noise.

[0112] Step (b5), performing frequency domain calibration on the recording device based on the spectrum characteristics of white noise to obtain a frequency response curve of the recording device.

[0113] Step (b6), obtaining recording audio parameters of the recorded audio obtained by recording the audio based on the frequency response curve using the recording device.

[0114] Step (b7), when the recorded audio loudness is greater than the original audio loudness, reducing the full-band playback gain of the playback device.

[0115] Step (b8), when the recorded audio loudness is less than the original audio loudness, increasing the full-band playback gain of the playback device.

[0116] Step (b9), when the loudness comparison result is within the preset loudness range, the target full-band playback gain of the playback device is obtained.

[0117] Step (b10), adjusting the playback equalizer curve of the playback device according to the target full-band playback gain to obtain an adjusted playback equalizer curve; the adjusted playback equalizer curve is used for audio playback and audio recording.

[0118] Step (b11), obtaining each preset frequency and the original frequency point gain corresponding to each preset frequency from the original equalizer curve.

[0119] Step (b12), obtaining each preset frequency and the recording frequency point gain corresponding to each preset frequency from the recording equalizer curve.

[0120] Step (b13), for each preset frequency, the original frequency gain corresponding to the preset frequency is compared with the corresponding recorded frequency gain to obtain a frequency gain comparison result corresponding to the preset frequency.

[0121] Step (b14), according to the comparison result of the frequency point gain corresponding to the preset frequency, adjusting the frequency point playback gain corresponding to the preset frequency of the adjusted playback equalizer curve.

[0122] Step (b15), when the frequency point gain comparison result corresponding to the preset frequency is within the preset frequency point gain range, the target frequency point playback gain corresponding to the preset frequency is obtained.

[0123] Step (b16), obtaining a target playback equalizer curve based on the target frequency playback gain of each preset frequency, and the target playback equalizer curve is used to play the original audio through the playback device.

[0124] Step (b17), when the comparison result is not within the preset audio parameter range, adjustments are made based on the comparison results of the original audio parameters and the recorded audio parameters to obtain adjusted audio playback parameters; audio playback and audio recording are performed based on the adjusted audio playback parameters, and the step of obtaining the recorded audio parameters of the recorded audio obtained by recording the recording device is returned to be executed.

[0125] The audio parameter determination method in this embodiment provides a solution for users to restore the audio timbre and loudness to the greatest extent possible. When the user records the audio, the recorded sound source file will not be affected by the EQ curve and the volume level curve, and the loudness and timbre of the audio at that time can be reproduced with maximum fidelity; and the embodiment of the present application can provide a technical solution for adaptively matching loudness and timbre, which can be applied to the sound source restoration machine solution without human intervention, avoiding the problem of inconsistent timbre and loudness caused by subjective differences in the human ear.

[0126] In one embodiment, Figure 7 FIG. 1 is a flow chart of an audio playback method in an embodiment. An audio playback method includes:

[0127] Step 702, obtain target audio playback parameters of the target audio; the target audio playback parameters are the audio playback parameters corresponding to the playback device when the comparison result is within the preset audio parameter range; the comparison result is obtained by comparing the original audio parameters of the target audio with the recorded audio parameters of the recorded audio in advance; the audio playback parameters are adjusted based on the comparison result; the recorded audio is obtained by recording the target audio played by the playback device by the recording device.

[0128] Specifically, the target audio playback parameters corresponding to the target audio are pre-stored in the electronic device. Before obtaining the target audio playback parameters of the target audio, the electronic device obtains the target audio played by the recording audio recording and playback device to obtain the recorded audio. The electronic device compares the original audio parameters of the target audio with the recorded audio parameters of the recorded audio to obtain a comparison result, and adjusts the audio playback parameters according to the comparison result; when the comparison result is within the preset audio parameter range, the audio playback parameters corresponding to the playback device at that time are obtained as the target audio playback parameters.

[0129] Step 704: Play the target audio according to the target audio playback parameters through the playback device.

[0130] Specifically, the electronic device plays the target audio according to the target audio playback parameters through the playback device.

[0131] The audio playback method in this embodiment can restore the timbre effect of the target audio and improve the fidelity of the sound by acquiring the target audio playback parameters of the target audio and playing the target audio according to the target audio playback parameters through a playback device.

[0132] It should be understood that although Figure 2-6 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2-6 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0133] Figure 8 FIG. 1 is a structural block diagram of an apparatus for determining audio playback parameters according to an embodiment of the present invention. Figure 8 As shown, an audio playback parameter determination device includes a first acquisition module 802, a second acquisition module 804, an adjustment module 806 and a determination module 808, wherein:

[0134] A first acquisition module 802 is used to acquire original audio parameters of the original audio;

[0135] The second acquisition module 804 is used to obtain recording audio parameters of the recording audio obtained by recording the recording device; the recording audio is obtained by recording the original audio played by the playback device by the recording device;

[0136] An adjustment module 806, configured to adjust the audio playback parameters of the playback device according to the comparison result between the original audio parameters and the recorded audio parameters;

[0137] The determination module 808 is used to obtain the target audio playback parameters of the playback device when the comparison result is within the preset audio parameter range; the target audio playback parameters are used to play the original audio through the playback device.

[0138] The audio playback parameter determination device in this embodiment obtains the audio parameters of the original audio and the recorded audio parameters of the recorded audio, and adjusts the audio playback parameters of the playback device according to the comparison result of the original audio parameters and the recorded audio parameters. That is, by adjusting the audio playback parameters of the playback device to make the original audio parameters and the recorded audio parameters close, the recorded audio can be made closer to the original audio to restore the original audio, thereby improving the realism of the sound.

[0139] In one embodiment, the original audio parameter includes the original audio loudness; the recorded audio parameter includes the recorded audio loudness; the comparison result includes the loudness comparison result; and the audio playback parameter includes the full-band playback gain. The adjustment module 806 is used to adjust the full-band playback gain of the playback device according to the loudness comparison result of the original audio loudness and the recorded audio loudness. The determination module 808 is used to obtain the target full-band playback gain of the playback device when the loudness comparison result is within a preset loudness range.

[0140] The audio playback parameter determination device in this embodiment adjusts the full-band playback gain of the playback device according to the loudness comparison result between the original audio loudness and the recorded audio loudness. When the loudness comparison result is within a preset loudness range, the target full-band playback gain of the playback device is obtained. That is, the full-band playback gain of the playback device can be adjusted to make the loudness comparison result within a range, so that the original audio and the recorded audio are similar, the loudness of the original audio can be restored, and the fidelity of the loudness of the recorded audio is improved.

[0141] In one embodiment, the adjustment module 806 is used to reduce the full-band playback gain of the playback device when the recorded audio loudness is greater than the original audio loudness; and to increase the full-band playback gain of the playback device when the recorded audio loudness is less than the original audio loudness.

[0142] In the audio playback parameter determination device of this embodiment, when the recorded audio loudness is greater than the original audio loudness, it means that the full-band playback gain of the playback device is too large, and therefore the full-band playback gain of the playback device needs to be reduced; when the recorded audio loudness is less than the original audio loudness, it means that the full-band playback gain of the playback device is too small, and therefore the full-band gain of the playback device needs to be increased, so that the original audio loudness and the recorded audio loudness are similar, so that the playback effect of the original audio can be restored and the fidelity of the recorded audio can be improved.

[0143] In one embodiment, the original audio parameters include the original equalizer curve; the recorded audio parameters include the recording equalizer curve; and the audio playback parameters include the playback equalizer curve. The adjustment module 806 is used to adjust the playback equalizer curve of the playback device according to the target full-band playback gain to obtain an adjusted playback equalizer curve; the adjusted playback equalizer curve is adjusted according to the equalizer curve comparison result between the original equalizer curve and the recording equalizer curve, and the adjusted playback equalizer curve is used for audio playback and audio recording. The determination module 808 is used to obtain the target playback equalizer curve of the playback device when the equalizer curve comparison result is within the preset frequency point gain range; the target playback equalizer curve is used to play the original audio through the playback device.

[0144] The audio playback parameter determination device in this embodiment adjusts the playback equalizer curve of the playback device according to the target full-band playback gain to obtain the adjusted playback equalizer curve, that is, the playback equalizer curve of the playback device is first roughly adjusted; according to the equalizer curve comparison result between the original equalizer curve and the recorded equalizer curve of the recorded audio, the adjusted playback equalizer curve is adjusted, that is, the adjusted playback equalizer curve is fine-tuned; when the equalizer curve comparison result is within the preset frequency point gain range, the target playback equalizer curve of the playback device is obtained, which can make the timbre of the original audio and the timbre of the recorded audio converge, restore the playback effect of the original audio, and improve the realism of the sound.

[0145] In one embodiment, the comparison result includes an equalizer curve comparison result; the audio playback parameter includes a playback equalizer curve; and the target audio playback parameter includes a target playback equalizer curve. The determination module 808 is used to obtain a target playback equalizer curve of the playback device when the equalizer curve comparison result is within a preset frequency gain range.

[0146] In the audio playback parameter determination device of this embodiment, when the equalizer curve comparison result is within the preset frequency gain range, it means that the difference between the original equalizer curve and the recorded equalizer is small, then the target playback equalizer curve of the playback device can be obtained, which can make the original audio played by the playback device have a high degree of restoration, so that the human ear can hear the original timbre of the original audio.

[0147] In one embodiment, the original audio parameters include an original equalizer curve; the recorded audio parameters include a recorded equalizer curve. The adjustment module 806 is used to obtain each preset frequency and the original frequency point gain corresponding to each preset frequency from the original equalizer curve; obtain each preset frequency and the recorded frequency point gain corresponding to each preset frequency from the recorded equalizer curve; for each preset frequency, compare the original frequency point gain corresponding to the preset frequency with the corresponding recorded frequency point gain to obtain the frequency point gain comparison result corresponding to the preset frequency; according to the frequency point gain comparison result corresponding to the preset frequency, adjust the frequency point playback gain corresponding to the preset frequency of the playback device; when the frequency point gain comparison result corresponding to the preset frequency is within the preset frequency point gain range, obtain the target frequency point playback gain corresponding to the preset frequency; obtain the target playback equalizer curve based on the target frequency point playback gain of each preset frequency.

[0148] The audio playback parameter determination device in this embodiment obtains each preset frequency and the corresponding original frequency gain and recording frequency gain from the original equalizer curve and the recorded equalizer curve respectively, and adjusts the playback frequency gain for each preset frequency, so as to obtain the final target playback equalizer curve, so that the sound effect recorded by the recording device is closer to the original audio, thereby improving the sound restoration and realism.

[0149] In one embodiment, the first acquisition module 802 is used to locate the sound source through a recording device array composed of at least two recording devices to obtain the sound source depth of the sound source; the sound source is the sound source corresponding to the original audio; the sound source propagation loss is determined based on the sound source depth; the original audio parameters are determined based on the sound source propagation loss and the audio parameters of the original audio.

[0150] The audio playback parameter determination device in this embodiment locates the sound source through a recording device array composed of at least two recording devices, obtains the sound source depth of the sound source, determines the sound source propagation loss based on the sound source depth, and determines the original audio parameters based on the sound source propagation loss and the audio parameters of the original audio. In this way, compensation can be made for the propagation loss caused during the propagation of the sound source, and restoration of the audio and loudness of the sound source where the audio occurs, i.e., the sound source, can be achieved.

[0151] In one embodiment, the second acquisition module 804 is used to record white noise through a recording device, perform spectrum analysis on the white noise, and obtain the spectrum characteristics of the white noise; perform frequency domain calibration on the recording device based on the spectrum characteristics of the white noise to obtain the frequency response curve of the recording device; and perform audio recording based on the frequency response curve.

[0152] The audio playback parameter determination device in this embodiment records white noise through a recording device, performs spectrum analysis on the white noise, and obtains the spectrum characteristics of the white noise. Since the power spectrum density of white noise in each frequency band is the same, the gain of each frequency point is also basically the same. Therefore, the spectrum characteristics of the recording device are calibrated based on the spectrum characteristics of the white noise to obtain the frequency response curve of the recording device. The recording device records the recorded audio based on the frequency response curve, which can ensure that the timbre of the recorded sound is restored to the greatest extent.

[0153] In one embodiment, the second acquisition module 804 is also used to make adjustments based on the comparison results of the original audio parameters and the recorded audio parameters to obtain adjusted audio playback parameters when the comparison results are not within the preset audio parameter range; perform audio playback and audio recording based on the adjusted audio playback parameters, and return the recorded audio parameters of the recorded audio obtained by recording the recording device.

[0154] The audio playback parameter determination device in this embodiment makes adjustments based on the comparison results of the original audio parameters and the recorded audio parameters to obtain adjusted audio playback parameters when the comparison result is not within the preset audio parameter range, and performs audio playback and audio recording based on the adjusted audio playback parameters, that is, it is necessary to loop audio playback and audio recording to adjust the audio playback parameters until the comparison result is within the preset audio parameter range, thereby obtaining the target audio playback parameters of the playback device and improving the realism of the sound.

[0155] Fig. 9 FIG. 1 is a structural block diagram of an audio playback device according to an embodiment of the present invention. Fig. 9 As shown, an audio playback device includes a target audio playback parameter acquisition module 902 and a playback module 904, wherein:

[0156] The target audio playback parameter acquisition module 902 is used to acquire the target audio playback parameter of the target audio; the target audio playback parameter is the audio playback parameter corresponding to the playback device when the comparison result is within the preset audio parameter range; the comparison result is obtained by comparing the original audio parameters of the target audio with the recorded audio parameters of the recorded audio in advance; the audio playback parameter is adjusted based on the comparison result; the recorded audio is obtained by the recording device recording the target audio played by the playback device;

[0157] The playing module 904 is used to play the target audio according to the target audio playing parameters through the playing device.

[0158] The audio playback device in this embodiment can restore the timbre effect of the target audio and improve the fidelity of the sound by acquiring the target audio playback parameters of the target audio and playing the target audio according to the target audio playback parameters through the playback device.

[0159] The division of each module in the above-mentioned audio playback parameter determination device and audio playback device is only for illustrative purposes. In other embodiments, the audio playback parameter determination device and the audio playback device may be divided into different modules as needed to complete all or part of the functions of the above-mentioned audio playback parameter determination device and audio playback device.

[0160] For the specific definition of the audio playback parameter determination device and the audio playback device, please refer to the definition of the audio playback parameter determination method in the above text, which will not be repeated here. The various modules in the above-mentioned audio playback parameter determination device and the audio playback device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0161] Fig.10 FIG. 1 is a schematic diagram of the internal structure of an electronic device in one embodiment. Fig.10 As shown, the electronic device includes a processor and a memory connected via a system bus. The processor is used to provide computing and control capabilities to support the operation of the entire electronic device. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by the processor to implement a method for determining audio playback parameters provided in the following embodiments. The internal memory provides a cached operating environment for the operating system computer program in the non-volatile storage medium. The electronic device can be any terminal device such as a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), a vehicle-mounted computer, a wearable device, etc.

[0162] The implementation of each module in the audio playback parameter determination device provided in the embodiment of the present application can be in the form of a computer program. The computer program can be run on a terminal or a server. The program module constituted by the computer program can be stored in the memory of the electronic device. When the computer program is executed by the processor, the steps of the method described in the embodiment of the present application are implemented.

[0163] An electronic device includes a memory, a processor, a recording device and a playback device, wherein the recording device is used to record audio and the playback device is used to play audio; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of a method for determining audio playback parameters.

[0164] An electronic device includes a memory, a processor, a recording device and a playback device, wherein the recording device is used to record audio and the playback device is used to play audio; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of an audio playback method.

[0165] The embodiment of the present application further provides a computer-readable storage medium, one or more non-volatile computer-readable storage media containing computer-executable instructions, which, when executed by one or more processors, enable the processors to perform the steps of the audio playback parameter determination method.

[0166] The embodiment of the present application further provides a computer-readable storage medium, one or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, the processors execute the steps of the audio playback method.

[0167] A computer program product comprising instructions, when running on a computer, enables the computer to execute an audio playback parameter determination method.

[0168] A computer program product comprising instructions, when the computer program product is run on a computer, causes the computer to perform an audio playback method.

[0169] Any reference to memory, storage, database or other medium used in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM), which is used as an external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0170] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for determining audio playback parameters, characterized in that: include: Get the original audio parameters of the original audio; Acquire recording audio parameters of the recording audio recorded by the recording device; The recorded audio is obtained by the recording device recording the original audio played by the playback device; The original audio parameters include original audio loudness and original equalizer curve, and the recorded audio parameters include recorded audio loudness and recorded equalizer curve; Adjusting the full-band playback gain of the playback device according to a loudness comparison result between the original audio loudness and the recorded audio loudness; When the loudness comparison result is within a preset loudness range, a target full-band playback gain of the playback device is obtained; adjusting the playback equalizer curve of the playback device according to the target full-band playback gain to obtain an adjusted playback equalizer curve; the adjusted playback equalizer curve is used for audio playback and audio recording; adjusting the adjusted playback equalizer curve according to an equalizer curve comparison result between the original equalizer curve and the recording equalizer curve of the recorded audio; When the equalizer curve comparison result is within a preset audio parameter range, a target audio playback parameter of the playback device is obtained; The target audio playback parameters are used to play the original audio through the playback device.

2. The method according to claim 1, characterized in that The method further comprises: When the recorded audio loudness is greater than the original audio loudness, reducing the full-band playback gain of the playback device; When the recorded audio loudness is less than the original audio loudness, the full-band playback gain of the playback device is increased.

3. The method according to claim 1, characterized in that The target audio playback parameters include a target playback equalizer curve; When the equalizer curve comparison result is within a preset audio parameter range, obtaining a target audio playback parameter of the playback device includes: When the equalizer curve comparison result is within the preset frequency point gain range, the target playback equalizer curve of the playback device is obtained.

4. The method according to claim 3, characterized in that The method further comprises: Acquire each preset frequency and the original frequency point gain corresponding to each preset frequency from the original equalizer curve; Obtaining each of the preset frequencies and the recording frequency point gains corresponding to each of the preset frequencies from the recording equalizer curve; For each preset frequency, the original frequency gain corresponding to the preset frequency is compared with the corresponding recorded frequency gain to obtain a frequency gain comparison result corresponding to the preset frequency; According to the comparison result of the frequency point gain corresponding to the preset frequency, adjusting the playback gain of the playback device at the frequency point corresponding to the preset frequency; When the equalizer curve comparison result is within the preset frequency point gain range, obtaining the target playback equalizer curve of the playback device includes: When the frequency point gain comparison result corresponding to the preset frequency is within the preset frequency point gain range, the target frequency point playback gain corresponding to the preset frequency is obtained; A target playback equalizer curve is obtained based on the target frequency playback gain of each of the preset frequencies.

5. The method according to any one of claims 1 to 4, characterized in that Get the original audio parameters of the original audio, including: The sound source is localized by using a recording device array composed of at least two recording devices to obtain a sound source depth of the sound source; the sound source is a sound source corresponding to the original audio; determining a sound source propagation loss based on the sound source depth; The original audio parameter is determined based on the sound source propagation loss and the audio parameter of the original audio.

6. The method according to any one of claims 1 to 4, characterized in that The method further comprises: Recording white noise by the recording device, performing spectrum analysis on the white noise, and obtaining spectrum characteristics of the white noise; Performing frequency domain calibration on the recording device based on the spectrum characteristics of white noise to obtain a frequency response curve of the recording device; Audio recording is performed based on the frequency response curve.

7. The method according to any one of claims 1 to 4, characterized in that The comparison result includes the loudness comparison result and the equalizer curve comparison result; the method further includes: When the comparison result is not within the preset audio parameter range, adjusting the original audio parameter and the recorded audio parameter based on the comparison result to obtain adjusted audio playback parameters; Perform audio playback and audio recording based on the adjusted audio playback parameters, and return to execute the step of obtaining the recording audio parameters of the recorded audio obtained by recording the recording device.

8. An audio playing method, characterized in that: The method comprises: Obtaining target audio playback parameters of the target audio; the target audio playback parameters are audio playback parameters corresponding to the playback device when the comparison result is within the preset audio parameter range; the comparison result is obtained by comparing the original audio parameters of the target audio with the recorded audio parameters of the recorded audio in advance; the audio playback parameters are adjusted based on the comparison result; the recorded audio is obtained by recording the target audio played by the playback device through the recording device; Playing the target audio according to the target audio playback parameters through the playback device; The comparison result includes a loudness comparison result and an equalizer curve comparison result, the original audio parameters include original audio loudness and an original equalizer curve, the recorded audio parameters include recorded audio loudness and a recorded equalizer curve, and the audio playback parameters include a playback equalizer curve; The adjusted playback equalizer curve is obtained by adjusting the playback equalizer curve according to the target full-band playback gain, and the adjusted playback equalizer curve is adjusted according to the equalizer curve comparison result between the original equalizer curve and the recording equalizer curve of the recorded audio; the adjusted playback equalizer curve is used for audio playback and audio recording; The target full-band playback gain is obtained when the loudness comparison result is within a preset loudness range, and the target full-band playback gain is obtained by adjusting the full-band playback gain of the playback device according to the loudness comparison result of the original audio loudness and the recorded audio loudness.

9. An audio playback parameter determination device, characterized in that: include: A first acquisition module, used to acquire original audio parameters of the original audio; A second acquisition module is used to acquire recording audio parameters of the recording audio recorded by the recording device; The recorded audio is obtained by the recording device recording the original audio played by the playback device; The original audio parameters include original audio loudness and original equalizer curve, and the recorded audio parameters include recorded audio loudness and recorded equalizer curve; An adjustment module, configured to adjust the full-band playback gain of the playback device according to a loudness comparison result between the original audio loudness and the recorded audio loudness; When the loudness comparison result is within a preset loudness range, a target full-band playback gain of the playback device is obtained; a playback equalizer curve of the playback device is adjusted according to the target full-band playback gain to obtain an adjusted playback equalizer curve; the adjusted playback equalizer curve is used for audio playback and audio recording; and the adjusted playback equalizer curve is adjusted according to an equalizer curve comparison result between the original equalizer curve and the recording equalizer curve of the recorded audio; A determination module, configured to obtain a target audio playback parameter of the playback device when the equalizer curve comparison result is within a preset audio parameter range; The target audio playback parameters are used to play the original audio through the playback device.

10. An electronic device, characterized in that: It includes a memory, a processor, a recording device and a playback device, wherein the recording device is used to record audio, and the playback device is used to play audio; The memory stores a computer program, and when the computer program is executed by the processor, the processor performs the following steps: Get the original audio parameters of the original audio; Acquire recording audio parameters of the recording audio obtained by recording the recording device; the original audio parameters include original audio loudness and original equalizer curve, and the recording audio parameters include recording audio loudness and recording equalizer curve; Adjusting the full-band playback gain of the playback device according to a loudness comparison result between the original audio loudness and the recorded audio loudness; When the loudness comparison result is within a preset loudness range, a target full-band playback gain of the playback device is obtained; adjusting the playback equalizer curve of the playback device according to the target full-band playback gain to obtain an adjusted playback equalizer curve; the adjusted playback equalizer curve is used for audio playback and audio recording; adjusting the adjusted playback equalizer curve according to an equalizer curve comparison result between the original equalizer curve and the recording equalizer curve of the recorded audio; When the equalizer curve comparison result is within a preset audio parameter range, a target audio playback parameter of the playback device is obtained; The target audio playback parameters are used to play the original audio through the playback device.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

12. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, the steps of the method according to any one of claims 1 to 8 are implemented.

Citation Information

Patent Citations

  • Adaptive audio debugging method and system, and mobile terminal

    CN107231598A

  • Audio adjustment method and device, and computer readable storage medium

    CN111370024A