Sound effect adjustment method, audio playback device, and computer-readable storage medium

By analyzing the audio characteristics of the audio file, synthesize target sound effects and processing the audio file, the problem of negative listening experience caused by sound effects superposition is solved, and a better audio playback experience is achieved.

CN115119110BActive Publication Date: 2025-04-01GEER TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210908964.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-29
Publication Date
2025-04-01
Estimated Expiration
2042-07-29

AI Technical Summary

Technical Problem

How to avoid the problem of overlaying sound effects that have negative impact on users' listening experience.

Method used

By analyzing the audio characteristics of the audio file to be processed, determining that the sound effects have been applied and the sound effects to be applied, synthesize the target sound effects, and processing the audio file based on the target sound effects.

Benefits of technology

It avoids negative listening experiences caused by sound effects superposition, bringing users a better audio playback experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115119110B_ABST
    Figure CN115119110B_ABST
Patent Text Reader

Abstract

The present invention relates to the technical field of digital audio signal processing, and in particular to a sound effect adjustment method, an audio playback device, and a computer-readable storage medium, wherein the method comprises: determining the applied sound effect corresponding to the audio file to be processed according to the audio features of the audio file to be processed; determining the sound effect to be applied corresponding to the audio file to be processed; determining the target sound effect according to the applied sound effect and the sound effect to be applied; and processing the audio file to be processed based on the target sound effect. This avoids the negative auditory perception of the played audio file due to the superposition of sound effects, and brings a better audio playback experience to the user.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of digital audio signal processing, and in particular to a sound effect adjustment method, an audio playback device and a computer-readable storage medium. Background Art

[0002] When playing music, movies and other audio files on different devices, users can add some sound effects processing so that the audio playback can be optimized based on the original audio and better suit the listener's preferences.

[0003] In the relevant technical solutions, the equipment supplier or application software developer will provide some debugged sound effects for users to choose from, or allow users to edit the sound effects according to their own preferences. However, sound effects are not always positive for the user's hearing. For example, when the bass part in the audio file is relatively strong, if the frequency of the bass part is enhanced by sound effects, the user's hearing will be reduced due to the excessive intensity of the bass part. Therefore, in order to avoid the negative impact of sound effects on the user's hearing, it is necessary to analyze whether the sound effects and audio files are compatible.

[0004] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present invention is to provide a sound effect adjustment method, aiming to solve the problem of how to avoid the negative impact of sound effect superposition on the user's hearing sense.

[0006] To achieve the above object, the present invention provides a method for adjusting sound effects, the method comprising:

[0007] Determining, according to the audio features of the audio file to be processed, an applied sound effect corresponding to the audio file to be processed;

[0008] Determine the sound effect to be applied corresponding to the audio file to be processed;

[0009] Determining a target sound effect according to the applied sound effect and the sound effect to be applied;

[0010] The audio file to be processed is processed based on the target sound effect.

[0011] Optionally, the audio features include frequency domain features, music theory features and harmonic features, and the step of determining the applied sound effects corresponding to the audio file to be processed according to the audio features of the audio file to be processed is as follows:

[0012] Determine the timbre brightness of the audio file to be processed according to the frequency domain characteristics, determine the timbre deviation in the audio file to be processed according to the music theory characteristics, and / or determine the type of musical instrument in the audio file to be processed according to the harmonic characteristics;

[0013] The applied sound effects of the audio file to be processed are determined according to the timbre brightness, the timbre deviation and / or the instrument type.

[0014] Optionally, before determining the applied sound effects of the audio file to be processed according to the timbre brightness, the timbre deviation and / or the instrument type, the method includes:

[0015] Determining whether the timbre brightness is within a preset interval, and / or determining whether the timbre deviation is less than or equal to a preset threshold;

[0016] If the timbre brightness is within the interval, and / or the timbre deviation is less than or equal to the threshold, the step of determining the applied sound effects of the audio file to be processed based on the timbre brightness, the timbre deviation and / or the instrument type is performed.

[0017] Optionally, after the step of determining whether the timbre brightness is within a preset interval and / or determining whether the timbre deviation is less than or equal to a preset threshold, the following steps are included:

[0018] If the timbre brightness is outside the interval, adjusting the timbre brightness to be within the interval, and / or if the timbre deviation is greater than the threshold, adjusting the timbre deviation to be less than or equal to the threshold;

[0019] The step of determining the applied sound effects of the audio file to be processed according to the timbre brightness, the timbre deviation and / or the instrument type is performed.

[0020] Optionally, before the step of determining the sound effect to be applied corresponding to the audio file to be processed, the step includes:

[0021] Based on a spectrum analysis algorithm, determining the fundamental frequency and the overtone frequency in the audio file to be processed;

[0022] The step of determining the sound effect to be applied corresponding to the audio file to be processed comprises:

[0023] The sound effect to be applied to the audio file to be processed is determined according to the fundamental frequency and the overtone frequency.

[0024] Optionally, before the step of determining the sound effect to be applied corresponding to the audio file to be processed, the step includes:

[0025] Determine the timbre brightness, instrument type and / or sound source position in the audio file to be processed based on a fully connected neural network analysis algorithm;

[0026] The step of determining the sound effect to be applied corresponding to the audio file to be processed comprises:

[0027] The sound effect to be applied corresponding to the audio file to be processed is determined according to the timbre brightness, the instrument type and / or the sound source position.

[0028] Optionally, the step of determining the sound effect to be applied corresponding to the audio file to be processed includes:

[0029] Determine the playback environment information of the audio file to be processed;

[0030] The sound effect to be applied of the audio file to be processed is determined according to the playback environment information.

[0031] Optionally, the step of determining a target sound effect according to the applied sound effect and the sound effect to be applied includes:

[0032] Determining the sound effect types of the applied sound effect and the sound effect to be applied;

[0033] If the sound effect type of the applied sound effect is different from the sound effect type of the sound effect to be applied, taking the applied sound effect and the sound effect to be applied together as the target sound effect;

[0034] If the sound effect type of the applied sound effect is the same as the sound effect type of the sound effect to be applied, the applied sound effect is used as the target sound effect.

[0035] In addition, to achieve the above-mentioned purpose, the present invention also provides an audio playback device, which includes: a memory, a processor, and a sound effect adjustment program stored in the memory and executable on the processor, and the sound effect adjustment program, when executed by the processor, implements the steps of the sound effect adjustment method as described above.

[0036] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, on which a sound effect adjustment program is stored, and when the sound effect adjustment program is executed by a processor, the steps of the sound effect adjustment method as described above are implemented.

[0037] The embodiment of the present invention provides a sound effect adjustment method, an audio playback device, and a computer-readable storage medium, wherein the method comprises: determining the applied sound effect corresponding to the audio file to be processed according to the audio features of the audio file to be processed; determining the sound effect to be applied corresponding to the audio file to be processed; determining the target sound effect according to the applied sound effect and the sound effect to be applied; and processing the audio file to be processed based on the target sound effect. This avoids the negative auditory perception of the played audio file due to the superposition of sound effects, and brings a better audio playback experience to the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 A schematic diagram of the hardware architecture of an audio playback device according to an embodiment of the present invention;

[0039] Figure 2 It is a flowchart of a first embodiment of a sound effect adjustment method of the present invention;

[0040] Figure 3 is a flow chart of a second embodiment of the sound effect adjustment method of the present invention;

[0041] Figure 4 is a flow chart of a third embodiment of the sound effect adjustment method of the present invention;

[0042] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0043] This application obtains the sound effects that have been applied to the audio through intelligent analysis on the platform side, and determines the post-processing sound effects to be applied based on the sound effects that have been applied. This avoids the negative listening experience of the played audio files due to the superposition of sound effects, and brings users a better audio playback experience.

[0044] In order to better understand the above technical solution, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0045] As an implementation solution, the hardware architecture of the audio playback device can be as follows Figure 1 shown.

[0046] The embodiment of the present invention relates to a hardware architecture of an audio playback device, which includes: a processor 101, such as a CPU, a memory 102, and a communication bus 103. The communication bus 103 is used to realize connection and communication between these components.

[0047] The memory 102 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. Figure 1 As shown, the memory 102 as a computer-readable storage medium may include a sound effect adjustment program; and the processor 101 may be used to call the sound effect adjustment program stored in the memory 102 and perform the following operations:

[0048] Determining, according to the audio features of the audio file to be processed, an applied sound effect corresponding to the audio file to be processed;

[0049] Determine the sound effect to be applied corresponding to the audio file to be processed;

[0050] Determining a target sound effect according to the applied sound effect and the sound effect to be applied;

[0051] The audio file to be processed is processed based on the target sound effect.

[0052] In one embodiment, the processor 101 may be used to call the sound effect adjustment program stored in the memory 102 and perform the following operations:

[0053] Determine the timbre brightness of the audio file to be processed according to the frequency domain characteristics, determine the timbre deviation in the audio file to be processed according to the music theory characteristics, and / or determine the type of musical instrument in the audio file to be processed according to the harmonic characteristics;

[0054] The applied sound effects of the audio file to be processed are determined according to the timbre brightness, the timbre deviation and / or the instrument type.

[0055] In one embodiment, the processor 101 may be used to call the sound effect adjustment program stored in the memory 102 and perform the following operations:

[0056] Determining whether the timbre brightness is within a preset interval, and / or determining whether the timbre deviation is less than or equal to a preset threshold;

[0057] If the timbre brightness is within the interval, and / or the timbre deviation is less than or equal to the threshold, the step of determining the applied sound effects of the audio file to be processed based on the timbre brightness, the timbre deviation and / or the instrument type is performed.

[0058] In one embodiment, the processor 101 may be used to call the sound effect adjustment program stored in the memory 102 and perform the following operations:

[0059] If the timbre brightness is outside the interval, adjusting the timbre brightness to be within the interval, and / or if the timbre deviation is greater than the threshold, adjusting the timbre deviation to be less than or equal to the threshold;

[0060] The step of determining the applied sound effects of the audio file to be processed according to the timbre brightness, the timbre deviation and / or the instrument type is performed.

[0061] In one embodiment, the processor 101 may be used to call the sound effect adjustment program stored in the memory 102 and perform the following operations:

[0062] Based on a spectrum analysis algorithm, determining the fundamental frequency and the overtone frequency in the audio file to be processed;

[0063] The step of determining the sound effect to be applied corresponding to the audio file to be processed comprises:

[0064] The sound effect to be applied to the audio file to be processed is determined according to the fundamental frequency and the overtone frequency.

[0065] In one embodiment, the processor 101 may be used to call the sound effect adjustment program stored in the memory 102 and perform the following operations:

[0066] Determine the timbre brightness, instrument type and / or sound source position in the audio file to be processed based on a fully connected neural network analysis algorithm;

[0067] The step of determining the sound effect to be applied corresponding to the audio file to be processed comprises:

[0068] The sound effect to be applied corresponding to the audio file to be processed is determined according to the timbre brightness, the instrument type and / or the sound source position.

[0069] In one embodiment, the processor 101 may be used to call the sound effect adjustment program stored in the memory 102 and perform the following operations:

[0070] Determine the playback environment information of the audio file to be processed;

[0071] The sound effect to be applied of the audio file to be processed is determined according to the playback environment information.

[0072] In one embodiment, the processor 101 may be used to call the sound effect adjustment program stored in the memory 102 and perform the following operations:

[0073] Determining the sound effect types of the applied sound effect and the sound effect to be applied;

[0074] If the sound effect type of the applied sound effect is different from the sound effect type of the sound effect to be applied, taking the applied sound effect and the sound effect to be applied together as the target sound effect;

[0075] If the sound effect type of the applied sound effect is the same as the sound effect type of the sound effect to be applied, the applied sound effect is used as the target sound effect.

[0076] Based on the hardware architecture of the above-mentioned audio playback device based on digital audio signal processing technology, an embodiment of the sound effect adjustment method of the present invention is proposed.

[0077] Reference Figure 2 In the first embodiment, the sound effect adjustment method includes the following steps:

[0078] Step S10, determining the applied sound effect corresponding to the audio file to be processed according to the audio features of the audio file to be processed;

[0079] In this embodiment, before playing the audio file to be processed, the features of the audio are analyzed and identified by the intelligent sound effect analysis module, so as to determine the applied sound effects in the audio file to be processed according to the audio features.

[0080] Optionally, the audio feature may include a frequency domain feature, and the frequency domain feature may include a spectral centroid. The spectral centroid, as a frequency domain feature, may represent the energy concentration point in the signal spectrum. The spectral centroid is used to determine the quantitative value that can describe the signal timbre, i.e., timbre brightness, through spectrum analysis. Timbre brightness is mainly used to judge the volume and brightness of mid-high frequency and high frequency signals, which will directly affect the perception difference of "bright / dark timbre" produced by the human ear. Generally speaking, the more prominent the high frequency is, the "brighter" we will feel the timbre is, but this does not mean that the timbre should be "the brighter the better". Once the timbre is too bright, it means that there are too many high frequencies and the three frequencies are unbalanced. At this time, the human ear will actually have a hard and sharp hearing feeling. Even if some high frequency bands have nonlinear peaks, the human ear will feel harsh and uncomfortable. Therefore, after determining the timbre brightness of the audio to be processed, it is also necessary to determine whether the timbre brightness is within a preset appropriate preset range. In some embodiments, a brightness range is preset. When the timbre brightness is within the brightness range, it is determined that the sound in the audio file to be processed will not make people feel harsh or uncomfortable, and the step of determining the applied sound effect corresponding to the audio file to be processed is executed; otherwise, the timbre brightness is adjusted to within the brightness range through signal processing or other means, and then subsequent steps are executed.

[0081] Optionally, audio features may include fundamental frequency and overtone frequency. As a kind of music theory feature, the deviation degree (i.e., distortion degree) between the fundamental frequency and the overtone frequency can reflect the deviation degree between the integral multiples of the signal overtone frequency and the fundamental frequency, and the distortion degree is defined as the square root value of the ratio of the fundamental frequency to the overtone frequency. In some sound effects, the distortion degree in the audio is increased to achieve the effect of improving the sense of hearing, such as simulating the sound effect of a vacuum tube amplifier. However, when the audio file to be recorded wants to reproduce it as authentically as possible, the increased audio distortion degree in this sound effect is no longer necessary. Therefore, the sound effect applied is judged by determining the deviation degree of the fundamental frequency and the overtone frequency. In some embodiments, when the deviation degree is greater than the preset first threshold value, it is judged that the distortion in the audio at this time is too large, which will cause a negative sense of hearing, and the deviation degree is adjusted to be less than or equal to the preset first threshold value. In other embodiments, when the deviation degree is greater than the preset second threshold value, it is judged that there is a distortion class sound effect in the audio file to be processed, wherein the second threshold value is less than the first threshold value.

[0082] Optionally, the audio features may include harmonic features, and the types of musical instruments contained in the audio file to be processed can be determined by the harmonic features. Different types of musical instruments have different harmonic frequencies. For example, the harmonic frequency range of a violin is 4k-15k, and the harmonic frequency of a cello is 1k-6.5k. In some sound effects, the sound effects of some musical instruments are simulated by changing the harmonic frequency of the audio. Therefore, by determining that the range of the harmonic frequency in the audio file matches the preset harmonic frequency range, the types of musical instruments in the audio features are determined based on the matched frequency range, and thus the types of musical instruments in the audio file to be processed are determined based on the types of musical instruments.

[0083] Step S20, determining the sound effect to be applied corresponding to the audio file to be processed;

[0084] Furthermore, the intelligent sound effect analysis module can also determine the sound effects to be applied corresponding to the audio file to be processed. The sound effects to be applied are characterized by the sound effects that can be added to the audio file to be processed through analysis by the intelligent sound effect analysis module. For example, if the analysis shows that bass sound effects and reverberation sound effects can be applied to the audio file to be processed, then both the bass sound effects and the reverberation sound effects are used as the sound effects to be applied to the audio file to be processed. It should be noted that the method for determining the sound effects to be applied is also to analyze the appropriate sound effects to be applied to the audio file to be processed by extracting the audio features in the processed audio file. Therefore, the type of the determined sound effect to be applied may be the same as or different from the type of the applied sound effect.

[0085] Optionally, in some embodiments, the intelligent sound effect analysis module can obtain environmental information based on the user's settings and sensors set on the audio playback device to determine the sound effect to be applied, including the type and parameters of the sound effect. For example, by collecting environmental information through sensors and identifying that the user is in a room environment, it is concluded that the sound effect to be applied is a reverberation sound effect.

[0086] Step S30, determining a target sound effect according to the applied sound effect and the sound effect to be applied;

[0087] Step S40: Process the audio file to be processed based on the target sound effect.

[0088] After determining the applied sound effects and the sound effects to be applied in the audio file to be processed, the target sound effects actually applied to the audio file to be processed during the playback process are determined based on these two sound effects. The target sound effects include the applied sound effects pre-added in the audio file to be processed and the sound effects to be applied determined by the intelligent sound effect analysis module.

[0089] Optionally, in order to avoid the superposition of the same type of sound effects and reduce the user's hearing experience, the intelligent sound effect analysis module also needs to determine the sound effect types of the applied sound effects and the sound effects to be applied. If the sound effect types of the applied sound effects and the sound effect types to be applied are different, the applied sound effects and the sound effects to be applied are used as the target sound effects together; if the sound effect types of the applied sound effects and the sound effect types to be applied are the same, the applied sound effects are used as the target sound effects. It should be noted that, since the types of the sound effects to be applied and the applied sound effects in the audio file may be one or more, the sound effects in the obtained target sound effects may be one or more, the sound effects contained in the target sound effects may all be sound effects to be applied or sound effects already applied, or the target sound effects may contain several sound effects to be applied and sound effects already applied at the same time, depending on the factors of these different situations being the similarities and differences in the audio features of different audio files to be processed.

[0090] In the technical solution provided in this embodiment, by analyzing the audio features of the audio file to be processed, the applied sound effects corresponding to the audio file to be processed are determined, and then the sound effects to be applied corresponding to the audio file to be processed are determined, and the target sound effects corresponding to the audio file to be processed are determined according to the applied sound effects and the sound effects to be applied, and finally the audio file to be processed is processed based on the target sound effects. This avoids the negative listening experience of the played audio file due to the superposition of sound effects, and brings a better audio playback experience to the user.

[0091] Reference Figure 3 In the second embodiment, based on any embodiment, before step S20, the steps include:

[0092] Step S50, determining the fundamental frequency and the overtone frequency in the audio file to be processed based on a spectrum analysis algorithm;

[0093] The step S20 comprises:

[0094] Step S21: determining the sound effect to be applied to the audio file to be processed according to the fundamental frequency and the overtone frequency.

[0095] Optionally, the present embodiment provides a method for determining the sound effect to be applied according to the fundamental frequency and harmonic frequency of the audio file to be processed. Based on the spectrum analysis algorithm, the fundamental frequency (i.e., fundamental wave) and overtone frequency (i.e., harmonic) of the audio file to be processed can be determined. The fundamental frequency is the main frequency in the audio signal, which determines the pitch of the sound played by the audio, and the overtone frequency is the high-frequency frequency in the audio signal, which serves to beautify the sound and give the sound a sense of presence and clarity. Properly improving the equalization amount at the low-end frequency of the fundamental frequency can make the sound warmer and fuller, and properly attenuating the equalization amount of the fundamental frequency can make the sound more open; and improving the equalization amount of the overtone frequency can enhance the sense of presence and clarity of the sound, and reducing the equalization amount of the overtone frequency can avoid the sound being too harsh. Based on the above principle, some sound effects enhance the user's sense of hearing by adjusting the overtone frequency and the fundamental frequency. Therefore, the intelligent sound effect analysis module determines the overtone frequency and the fundamental frequency in the audio file to be processed. When the overtone frequency and the fundamental frequency meet the preset conditions, the sound effect to be applied corresponding to the condition is matched.

[0096] In the technical solution provided in the present embodiment, the fundamental frequency and overtone frequency in the audio file to be processed are determined by a spectrum analysis algorithm. When the preset conditions are met according to the fundamental frequency and the overtone frequency, the sound effect to be applied corresponding to the preset conditions is determined, and the existence of the sound effect to be applied in the audio file to be processed is automatically identified and adapted. Compared with the traditional method of users selecting sound effects based on their subjective hearing, the sound effects may have a negative effect on the hearing sense. In the present embodiment, the appropriate sound effects of the audio file are automatically matched through audio features, thereby avoiding the negative hearing sense of the played audio file due to the sound effect superposition phenomenon that may occur when the user selects the sound effect, thereby bringing a better audio playback experience to the user.

[0097] Reference Figure 4 In the third embodiment, based on any embodiment, before step S20, the steps include:

[0098] Step S60, determining the timbre brightness, instrument type and / or sound source position in the audio file to be processed based on a fully connected neural network analysis algorithm;

[0099] The step S20 comprises:

[0100] Step S22, determining the sound effect to be applied corresponding to the audio file to be processed according to the timbre brightness, the instrument type and / or the sound source position.

[0101] Optionally, the present embodiment provides another method for determining the sound effect to be applied. In the present embodiment, the timbre brightness, instrument type and / or sound source position in the audio file to be processed are determined by a fully connected neural network analysis algorithm. A large number of audio file training sets are input into the algorithm database in advance, and the data in these training sets are classified by a fully connected neural network to obtain the audio features of several audio files such as timbre brightness, instrument type and sound source position. Then, according to the timbre brightness, instrument type and / or sound source position, the reference timbre brightness, reference instrument type and / or reference sound source position in the preset data set are matched, and then the sound effect corresponding to the matched reference timbre brightness, reference instrument type and / or reference sound source position is selected as the sound effect to be applied.

[0102] In the technical solution provided in this embodiment, the timbre brightness, instrument type and / or sound source position in the audio file to be processed are determined through a fully connected neural network analysis algorithm. When the timbre brightness, instrument type and / or sound source position meet the preset conditions, the sound effect to be applied corresponding to the preset conditions is determined. Compared with the traditional method where users select sound effects based on their subjective hearing, the sound effects may have a negative effect on the hearing sense. In this embodiment, the audio features are used to automatically match the appropriate sound effects of the audio file, avoiding the negative hearing sense of the played audio file due to the sound effect superposition phenomenon that may occur when the user selects the sound effect, thereby bringing a better audio playback experience to the user.

[0103] In addition, it can be understood by a person skilled in the art that all or part of the processes in the method for implementing the above embodiment can be completed by instructing the relevant hardware through a computer program. The computer program includes program instructions, and the computer program can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the audio playback device to implement the process steps of the embodiment of the above method.

[0104] Therefore, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a sound effect adjustment program, and when the sound effect adjustment program is executed by a processor, the various steps of the sound effect adjustment method described in the above embodiment are implemented.

[0105] The computer-readable storage medium may be a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk, etc., which may store program codes.

[0106] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0107] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a computer-readable storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0108] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A sound effect adjustment method, characterized in that: The method comprises: Determining, according to the audio features of the audio file to be processed, an applied sound effect corresponding to the audio file to be processed; Determine the sound effect to be applied corresponding to the audio file to be processed; Determining a target sound effect according to the applied sound effect and the sound effect to be applied; Processing the audio file to be processed based on the target sound effect; The step of determining the sound effect to be applied corresponding to the audio file to be processed includes: Determine the playback environment information of the audio file to be processed; Determining the sound effect to be applied to the audio file to be processed according to the playback environment information; The step of determining the target sound effect according to the applied sound effect and the sound effect to be applied comprises: Determining the sound effect types of the applied sound effect and the sound effect to be applied; If the sound effect type of the applied sound effect is different from the sound effect type of the sound effect to be applied, taking the applied sound effect and the sound effect to be applied together as the target sound effect; If the sound effect type of the applied sound effect is the same as the sound effect type of the sound effect to be applied, the applied sound effect is used as the target sound effect.

2. The sound effect adjustment method according to claim 1, characterized in that: The audio features include frequency domain features, music theory features, and harmonic features. The step of determining the applied sound effects corresponding to the audio file to be processed according to the audio features of the audio file to be processed includes: Determine the timbre brightness of the audio file to be processed according to the frequency domain characteristics, determine the timbre deviation in the audio file to be processed according to the music theory characteristics, and / or determine the type of musical instrument in the audio file to be processed according to the harmonic characteristics; The applied sound effects of the audio file to be processed are determined according to the timbre brightness, the timbre deviation and / or the instrument type.

3. The sound effect adjustment method according to claim 2, characterized in that: Before determining the applied sound effects of the audio file to be processed according to the timbre brightness, the timbre deviation and / or the instrument type, the method includes: Determining whether the timbre brightness is within a preset interval, and / or determining whether the timbre deviation is less than or equal to a preset threshold; If the timbre brightness is within the interval, and / or the timbre deviation is less than or equal to the threshold, the step of determining the applied sound effects of the audio file to be processed based on the timbre brightness, the timbre deviation and / or the instrument type is performed.

4. The sound effect adjustment method according to claim 2, characterized in that: After the step of determining whether the timbre brightness is within a preset interval and / or determining whether the timbre deviation is less than or equal to a preset threshold, the method further comprises: If the timbre brightness is outside the interval, adjusting the timbre brightness to be within the interval, and / or if the timbre deviation is greater than the threshold, adjusting the timbre deviation to be less than or equal to the threshold; The step of determining the applied sound effects of the audio file to be processed according to the timbre brightness, the timbre deviation and / or the instrument type is performed.

5. The sound effect adjustment method according to claim 1, characterized in that: Before the step of determining the sound effect to be applied corresponding to the audio file to be processed, the method includes: Based on a spectrum analysis algorithm, determining the fundamental frequency and the overtone frequency in the audio file to be processed; The step of determining the sound effect to be applied corresponding to the audio file to be processed comprises: The sound effect to be applied to the audio file to be processed is determined according to the fundamental frequency and the overtone frequency.

6. The sound effect adjustment method according to claim 1, characterized in that: Before the step of determining the sound effect to be applied corresponding to the audio file to be processed, the method includes: Determine the timbre brightness, instrument type and / or sound source position in the audio file to be processed based on a fully connected neural network analysis algorithm; The step of determining the sound effect to be applied corresponding to the audio file to be processed comprises: The sound effect to be applied corresponding to the audio file to be processed is determined according to the timbre brightness, the instrument type and / or the sound source position.

7. An audio playback device, characterized in that: The audio playback device includes: a memory, a processor, and a sound effect adjustment program stored in the memory and executable on the processor. When the sound effect adjustment program is executed by the processor, the steps of the sound effect adjustment method as described in any one of claims 1 to 6 are implemented.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a sound effect adjustment program, and when the sound effect adjustment program is executed by the processor, the steps of the sound effect adjustment method according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Sound effect processing method and mobile terminal

    WO2017215635A1

  • Processing method, apparatus and device

    WO2020177190A1