Audio track gain adjustment method, device, intelligent terminal and storage medium

By judging the audio gain value, and automatically adjusting the audio track gain of singers and users during the karaoke process, the problem of unable to automatically adjust the audio track gain in the existing technology is solved, and real-time auxiliary reminders and audio processing during the karaoke process is realized , improves the user experience.

CN114428600BActive Publication Date: 2024-11-22SHENZHEN TCL NEW-TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011178759.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-29
Publication Date
2024-11-22
Estimated Expiration
2040-10-29

AI Technical Summary

Technical Problem

Existing karaoke software or devices cannot automatically make appropriate gain adjustments to singer tracks and user tracks, resulting in users not being able to automatically receive reminders or assistance during karaoke.

Method used

By obtaining the audio data to be processed, we can determine whether the audio gain value of the user's initial track data meets the preset participation rules. If it is matched, the user's initial track data and singer's initial track data will be gained to generate the user's target track Data and singer target track data for automatic gain adjustment.

Benefits of technology

During the karaoke process, determine whether the user participates in singing based on the audio gain value, thereby automatically adjusting the gain of the singer and user's audio tracks, providing real-time auxiliary reminders and audio processing, and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114428600B_ABST
    Figure CN114428600B_ABST
Patent Text Reader

Abstract

The present invention discloses a method, device, intelligent terminal and storage medium for adjusting track gain, the method comprising: obtaining audio data to be processed, the audio data comprising singer initial track data and user initial track data; when the audio gain value of the user initial track data meets the preset participation rules, performing gain processing on the user initial track data and the singer initial track data to generate user target track data and singer target track data. The present invention can automatically determine whether the user is singing karaoke according to the user initial track data, thereby adjusting the track gain according to whether the user is singing karaoke during the karaoke process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and device for adjusting track gain, an intelligent terminal and a storage medium. Background Art

[0002] With the popularization of the Internet and the improvement of network bandwidth, various terminals have the function of adjusting the gain of audio tracks, such as smart phones and smart TVs. At present, there are at least two common modes for adjusting the gain of audio tracks, one is the accompaniment mode and the other is the sing-along mode. In the audio finally output by the accompaniment mode, the vocal part is mainly the user's voice, which is mainly suitable for users who are familiar with the song. It is achieved by weakening the gain of the singer's audio track and enhancing the gain of the user's audio track; while in the audio finally output by the normal mode, the vocal part is the singer's voice, which is mainly suitable for users who are not very familiar with the song. It is achieved by enhancing the gain of the singer's audio track and weakening the gain of the user's audio track.

[0003] The two modes can be switched freely, but the current switching method on the market requires users to switch and choose. When users are busy with other things, the mode is fixed. For example, when a user is singing halfway and suddenly forgets the lyrics, he wants to switch to the sing-along mode to listen to the singer's voice to get a reminder. He needs to stop what he is doing and switch the mode on the terminal. Therefore, the current karaoke software or equipment cannot automatically make appropriate gains for the singer's audio track and the user's audio track. Summary of the invention

[0004] The main purpose of the present invention is to provide a method, device, intelligent terminal and storage medium for adjusting the gain of a track, aiming to solve the problem in the prior art that it is not possible to automatically perform appropriate gain on the singer's track and the user's track during karaoke.

[0005] To achieve the above object, the present invention provides a method for adjusting the gain of an audio track, comprising:

[0006] Acquire the audio data to be processed, the audio data including the singer's initial audio track data and the user's initial audio track data;

[0007] When the audio gain value of the user's initial audio track data meets the preset participation rules, the user's initial audio track data and the singer's initial audio track data are gain processed to generate user target audio track data and singer target audio track data.

[0008] In addition, to achieve the above object, the present invention also provides a track gain adjustment device, comprising:

[0009] An acquisition unit, used for acquiring audio data to be processed, the audio data including singer's initial audio track data and user's initial audio track data;

[0010] The adjustment unit is used to perform gain processing on the user's initial audio track data and the singer's initial audio track data to generate user target audio track data and singer target audio track data when the audio gain value of the user's initial audio track data meets the preset participation rules.

[0011] In addition, to achieve the above-mentioned purpose, the present invention also provides an intelligent terminal, which includes a memory, a processor, and an audio track gain adjustment program stored in the memory and executable on the processor. When the processor executes the audio track gain adjustment program, the steps of the above audio track gain adjustment method are implemented.

[0012] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, which stores a track gain adjustment program. When the track gain adjustment program is executed by a processor, the steps of the above track gain adjustment method are implemented.

[0013] In the present invention, the audio data to be processed is first obtained, and then it is determined whether the audio gain value of the user's initial audio track data meets the preset participation rules. If the audio gain value of the user's initial audio track data meets the preset participation rules, it means that the user is participating in karaoke, so the user's initial audio track data and the singer's initial audio track data are subjected to gain processing. Therefore, through the present invention, during the karaoke process, it can be determined whether the user participates in karaoke according to the audio gain value, so that the user's initial audio track data and the singer's initial audio track data are automatically subjected to adaptive audio track gain adjustment processing to achieve automatic gain during the karaoke process. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a flow chart of a preferred embodiment of the method for adjusting the gain of an audio track provided by the present invention;

[0015] Figure 2 is a flow chart of step S200 in a preferred embodiment of the method for adjusting the gain of an audio track of the present invention;

[0016] Figure 3 It is a schematic diagram of the functional units of the audio track gain adjustment device of the present invention;

[0017] Figure 4 Schematic diagram of the operating environment of a preferred embodiment of the intelligent terminal of the present invention. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0019] The track gain adjustment method of the preferred embodiment of the present invention is as follows: Figure 1As shown, the track gain adjustment method includes the following steps:

[0020] Step S100: the intelligent terminal obtains the audio data to be processed, where the audio data includes the singer's initial audio track data and the user's initial audio track data.

[0021] Specifically, in this embodiment, the intelligent terminal includes a smart TV and a smart range hood. With the advancement of intelligence, home appliances are also further developing towards intelligence, such as smart effects that can automatically play music, and smart air conditioners that automatically adjust the air temperature according to the user's body temperature. Among them, range hoods are also developing towards intelligence. Today's smart range hoods are rich in functions, with large interactive screens for interacting with users, and also have functions such as intelligent adjustment of wind speed levels, remote control, delayed ventilation, and variable lighting. In addition to interacting with users, the interactive screen can also provide weather and time displays, and even provide entertainment resources such as music, television, news resources, and singing. For ease of description, the subsequent embodiments are described with smart range hoods.

[0022] When the user is cooking, he / she can select the song he / she wants by voice or by pressing a button, and turn on the singing mode of the smart range hood. When entering the singing mode, the smart range hood turns on the microphone, obtains the user's voice, and saves it as the user's initial audio track data. At the same time, the vocal track of the song selected by the user is obtained as the singer's initial audio track data. The user's initial audio track data and the singer's initial audio track data are saved as audio data to be gained. Then the audio track gain adjustment program in the smart range hood continuously or periodically obtains the locally saved audio data to be gained.

[0023] The audio data also includes background audio track data, and the data types of the audio data include mixed audio data and independent audio data, wherein the independent audio data is audio track data that exists independently of the singer's initial audio track data, the background audio track data, and the user's initial audio track data, and the mixed audio data includes audio track data mixed by the singer's initial audio track data, the background audio track data, and the user's initial audio track data.

[0024] Specifically, in addition to the singer's vocals, a general song also includes background music, such as guitar sounds and piano sounds. In this embodiment, the audio data to be processed includes background track data.

[0025] In addition, in this embodiment, the audio data acquired by the smart range hood includes two data types, one is mixed audio data and the other is independent audio data. Mixed audio data refers to audio data with mixed tracks. For example, in many song libraries, the vocal part and the background music part of the song are mixed together. For example, in order to unify the relative gain of each track, the singer's initial track data, the background track data and the user's initial track data may also be mixed.

[0026] Furthermore, in order to be able to process different types of audio data, after obtaining the audio data to be processed, the method further includes:

[0027] Step S110, when the audio data is mixed audio data, the intelligent terminal splits the audio data according to the frequency of the audio data and the gain value of each sampling point to generate singer's initial audio track data, background audio track data and user's initial audio track data.

[0028] Specifically, if the audio data is independent audio data, the number of tracks in the audio data is 3; if the audio data is mixed audio data in which the singer's initial track data and background track data are mixed, and the user's initial track data is independent, the number of tracks is 2; if the audio data is mixed audio data in which the singer's initial track data, background track data, and user's initial track data are mixed, the number of tracks is 1. Therefore, according to the number of tracks in the audio data, it can be determined whether the audio data is mixed audio data.

[0029] Generally, users need the singer's voice to become smaller and the background sound to be inconvenient, so as to get their own. Therefore, in order to better achieve the singing effect, each track data needs to be processed separately. If the audio data is independent audio data, the singer's initial track data and the user's initial track data can be directly processed. If the track data is mixed audio data, the mixed audio data needs to be split to obtain the singer's initial track data, the background track data and the user's initial track data, and then the singer's initial track data and the user's initial track data are gain processed respectively. The low-frequency area in the audio is 40Hz-80Hz, the mid-frequency area is 160Hz-1280Hz, and the high-frequency area is 2560Hz-5120Hz. Since the human voice is generally located in the low-frequency area and mid-frequency area of ​​the audio data, and the background sound, such as various musical instruments, is located in the high-frequency area, the human voice of the song and the human voice of the user, due to the difference in recording quality, the two are reflected in the audio as different gain values. Therefore, the mixed audio data can be split according to the frequency of the audio data and the gain value of the sampling point to generate the singer's initial audio track data, background audio track data and user's initial audio track data.

[0030] Furthermore, in order to ensure the quality of the split audio track and improve the splitting efficiency, the splitting steps include:

[0031] In step S111, the intelligent terminal calculates a first difference between a maximum gain value in a mid-frequency region and a minimum gain value in a low-frequency region of the audio data, and uses the first difference as a gain value range of the singer's initial audio track data.

[0032] Specifically, since the vocals of a song are generally recorded in a recording studio, the gain value is generally large. First, the mid-frequency area, low-frequency area and high-frequency area in the audio data are divided to separate the vocals from the background sound, and then the difference between the maximum gain value of the mid-frequency area and the minimum gain value of the low-frequency area is calculated, and this difference range is used as the gain value range of the singer's initial track data.

[0033] In step S112, the intelligent terminal calculates a second difference between the intermediate gain value and the minimum gain value in the intermediate frequency region of the audio data, and uses the second difference as the gain value range of the user's initial audio track data.

[0034] Specifically, when a user sings while cooking, due to the poor sound insulation of the kitchen, the sound reception effect of the smart range hood is worse than that of professional equipment. Therefore, the gain value of the user's audio collected by the microphone is small. Therefore, the second difference between the intermediate gain value of the separated intermediate frequency area and the minimum gain value of the low frequency area is calculated and used as the gain value range of the user's initial track data. Among them, the intermediate gain value can be the average value of each sampling point in the intermediate frequency area, or the median of the gain values ​​of each sampling point, as long as the singer's track data and the user's track data can be distinguished.

[0035] Step S113: The intelligent terminal calculates a third difference between the maximum gain value and the minimum gain value in the high-frequency region of the audio data, and uses the third difference as the gain value range of the background audio track data.

[0036] Specifically, although the audio span of the background sound is extremely large, existing from the high-frequency area to the low-frequency area, in order to better distinguish the background sound from the human voice, the sound quality between the background audio track data and the singer audio track data and the user audio track data is cleaner. Only the third difference between the maximum gain value and the minimum gain value in the high-frequency area is calculated and used as the gain value range of the background audio track data.

[0037] Step S114, the intelligent terminal splits the audio data according to the singer's initial audio track data gain value range, the background audio track data gain value range and the user's initial audio track data gain value range, and generates the singer's initial audio track data, the background audio track data and the user's initial audio track data respectively.

[0038] Specifically, finally according to the gain value range of the singer's initial audio track data, the gain value range of the user's initial audio track data, the gain value range of the background audio track data, and the gain value of each sampling point in the audio data, it is split into three audio data, and each audio data is saved as a separate audio track data, that is, the singer's initial audio track data, background audio track data and user's initial audio track data are generated.

[0039] Step S200, when the audio gain value of the user's initial audio track data meets the preset participation rules, the intelligent terminal performs gain processing on the user's initial audio track data and the singer's initial audio track data to generate user target audio track data and singer target audio track data.

[0040] Specifically, a participation rule is preset to determine whether the user participates in karaoke. In the first implementation, the participation rule may include an audio gain value threshold. If it is less than the audio gain value threshold, it is determined that the user does not participate in singing; if it is greater than or equal to the audio gain threshold, it is determined that the user participates in singing, so it is necessary to perform gain processing on the user's audio track data and the singer's audio track data. In addition to the above-mentioned participation rules, in the second implementation, the participation rule may also be to determine the difference between the gain values ​​of each sampling point in this section of the user's initial audio track data and the gain values ​​of each sampling point in the singer's initial audio track data. If the difference is large, it is determined that the user is not singing but talking, or is not making a sound and is not participating in singing; if the difference is small, it is determined that the user is participating in singing.

[0041] If the audio gain value of the user's initial audio track data does not meet the preset participation rules, which means that the user did not participate in singing, the audio data will no longer be processed and will be output directly.

[0042] Based on the second implementation method, it is also possible to further determine whether the user is speaking or not speaking. If the user is speaking, the volume can be automatically lowered; if not, the sound can be directly output.

[0043] When the audio gain value of the user's initial audio track data meets the participation rule, it means that the user is participating in singing, so it is necessary to perform gain processing on the user's initial audio track data and the singer's initial audio track data. In this embodiment, the first gain method is to preset a first gain rule for user singing. According to the first gain rule, the gain value of each sampling point in the user's initial audio track data is increased, and the gain value of each sampling point in the singer's initial audio track data is reduced. The specific gain value increase or decrease method can be to directly increase the gain value of each sampling point in the user's initial audio track data by a certain value, while the gain value of each sampling point in the singer's initial audio track data is reduced by a certain value, or according to the current gain value of each sampling point in the user's initial audio track data, increase a certain proportion, such as increase by 10%, and the gain value of each sampling point in the singer's initial audio track data is correspondingly reduced, etc. Since there are many ways to increase or decrease, they will not be repeated here.

[0044] Further, see Figure 2 In the second implementation provided in this embodiment, step S200 includes:

[0045] In step S210, the intelligent terminal calculates the average gain value of the user corresponding to the initial audio track data of the user, and the average gain value of the singer corresponding to the initial audio track data of the singer.

[0046] Specifically, if the audio gain value of the user's initial audio track data meets the participation rules, the user's average gain value corresponding to the user's initial audio track data and the singer's average gain value corresponding to the singer's initial audio track data are first calculated. The calculation method can use the gain value of each sampling point in each audio track to calculate the corresponding average value, which is used as the user's average gain value and the singer's average gain value. It is also possible to use the maximum and minimum values ​​of the gain values ​​in each audio track data to calculate the corresponding average value, and use them as the user's average gain value and the singer's average gain value.

[0047] Furthermore, since it is necessary to perform gain according to the average gain value of the user and the average gain value of the singer in the subsequent step, if the conventional method of calculating the gain value of each sampling point is used to calculate the average value, the calculation efficiency is low, and the maximum gain value and the minimum gain value are easily ignored. Therefore, in this embodiment, step S310 includes:

[0048] Step S211: The intelligent terminal calculates the average of the maximum gain value and the minimum gain value of the user's initial audio track data, and generates a user average gain value corresponding to the user's initial audio track data.

[0049] Specifically, for example, the maximum gain value of the user's initial audio track data is 10, and the minimum gain value is 2. If the audio gain value of the user's initial audio track data meets the participation rules, the average of the maximum gain value of the user's initial audio track data and the minimum gain value of the user's initial audio track data is calculated, that is, (10+2) / 2=6, to generate the user's average gain value corresponding to the user's initial audio track data, which is 6.

[0050] Step S212, the intelligent terminal calculates the average of the maximum gain value and the minimum gain value of the singer's initial audio track data, and generates an average gain value of the singer corresponding to the singer's initial audio track data.

[0051] Specifically, for example, the maximum gain value of the singer's initial audio track data is 15, and the minimum gain value is 9. If the audio gain value of the singer's initial audio track data meets the preset participation rules, the average of the maximum gain value of the singer's initial audio track data and the minimum gain value of the singer's initial audio track data is calculated, that is, (15+9) / 2=12, to generate the singer's average gain value corresponding to the singer's initial audio track data, which is 12.

[0052] Step S220, when the user average gain value is greater than or equal to the singer average gain value, the intelligent terminal performs gain reduction on the singer's initial audio track data to generate the singer's target audio track data; and performs gain enhancement on the user's initial audio track data to generate the user's target audio track data.

[0053] Specifically, the user average gain value and the singer average gain value are compared to determine whether the user average gain value is greater than or equal to the singer average gain value. If the user average gain value is greater than or equal to the singer average gain value, it means that the user is very likely singing, so the singer's initial audio track data is gain attenuated, and the user's initial audio track data is gain weakened, thereby enhancing the gain value of the user's audio track data in the output audio and weakening the gain value of the singer's audio track data in the output audio, so that the user can hear his or her own singing voice.

[0054] Further, step S220 includes:

[0055] Step S221, according to the user average gain value and the preset main track gain value, the intelligent terminal increases the gain value of each sampling point in the user track data frame by frame to generate the user target track data.

[0056] Specifically, if the user average gain value is greater than or equal to the singer average gain value, it means that the user is singing loudly. The gain method adopted in the second implementation mode of this embodiment is to perform gain according to the preset main track gain value, wherein the main track gain value refers to the average gain value of the main vocal track in the output data finally output. When the user is singing loudly, it is assumed that the main vocal track in the output data output later is the user track.

[0057] According to the user average gain value and the main audio track gain value in the currently processed user audio track data, the gain value of each sampling point in the user audio track data is increased frame by frame. The frame-by-frame increase method can be to calculate the difference between the current user average gain value and the main audio track gain value as the dividend, and use the number of a certain number of audio frames in the user audio track data as the divisor, calculate the corresponding quotient, and then use the quotient as the gain value increased by each audio frame compared with the previous frame, until the gain value of the current audio frame is equal to the gain value of the main audio track.

[0058] Step S222, based on the singer's average gain value and the preset sub-track gain value, the intelligent terminal reduces the gain value of each sampling point in the singer's track data frame by frame to generate the singer's target track data.

[0059] Specifically, the sub-track gain adjustment value refers to the average gain value of the secondary vocal track in the final output data. If the user average gain value is greater than or equal to the singer average gain value, the singer track data is the secondary track in the subsequent output data. According to the singer average gain value and the sub-track gain value in the currently processed singer track data, the gain value of each sampling point in the singer track data is reduced frame by frame. The frame-by-frame reduction method can be to calculate the difference between the current singer average gain value and the sub-track gain value as the dividend, and use the number of a certain number of audio frames in the singer track data as the divisor, calculate the corresponding quotient, and then use the quotient as the gain value of each audio frame reduced from the previous frame, until the gain value of the current audio frame is equal to the sub-track gain value.

[0060] Step S230, when the user average gain value is less than the singer average gain value, the intelligent terminal performs gain enhancement on the singer's initial audio track data to generate the singer's target audio track data; and performs gain reduction on the user's initial audio track data to generate the user's target audio track data.

[0061] Specifically, if the average gain value of the user is less than the average gain value of the singer, it means that the user is not singing loudly, but may just be humming or forgetting the lyrics. Therefore, the main track in the output data output thereafter is the singer's track data, and the singer's initial track data is gain enhanced, while the user's initial track data is gain weakened. Therefore, it is necessary to gain enhance the singer's initial track data and gain weaken the user's initial track data. In this embodiment, the method of gain enhancing the singer's initial track data and gain weakening the user's initial track data is similar to the above-mentioned method of gain weakening the singer's initial track data and gain weakening the user's initial track data, except that the processing objects are different.

[0062] Further, step S230 includes:

[0063] In step S231, according to the user average gain value and the preset main track gain value, the intelligent terminal increases the gain value of each sampling point in the user track data frame by frame to generate the user target track data.

[0064] Step S232, according to the singer's average gain value and the preset sub-track gain value, the intelligent terminal reduces the gain value of each sampling point in the singer's track data frame by frame to generate the singer's target track data.

[0065] Since the steps are similar to the above-mentioned steps S331 and S332, except that the gain enhancement object is changed from the user audio track data to the singer's average gain value, and the gain reduction object is changed from the singer's average gain value to the user audio track data, they will not be described here again.

[0066] Furthermore, after step S200, the following steps are further included:

[0067] The intelligent terminal mixes the singer's target track data, the user's target track data and the background track data, generates output data and outputs it.

[0068] Specifically, after obtaining the singer's target track data and the user's target track data, the singer's target track data, the user's target track data and the background track data are mixed according to the time of each track to generate output data, and finally the output data is transmitted to the audio system so that the audio system can play music according to the output data.

[0069] Furthermore, if Figure 3 As shown, based on the above-mentioned track gain adjustment method, the present invention also provides a track gain adjustment device 100, and the track gain adjustment device 100 includes:

[0070] An acquisition unit 110 is used to acquire audio data to be processed, where the audio data includes singer's initial audio track data and user's initial audio track data;

[0071] The adjustment unit 120 is used to perform gain processing on the user's initial audio track data and the singer's initial audio track data to generate user's target audio track data and singer's target audio track data when the audio gain value of the user's initial audio track data meets the preset participation rules.

[0072] Among them, the audio data also includes background audio track data, and the data type of the audio data includes mixed audio data and independent audio data, wherein the independent audio data is audio track data that exists independently of the singer's initial audio track data, the background audio track data and the user's initial audio track data, and the mixed audio data includes audio track data mixed by the singer's initial audio track data, the background audio track data and the user's initial audio track data.

[0073] Among them, the audio track gain adjustment device 100 also includes a splitting unit, which is used to split the audio data according to the frequency of the audio data and the gain value of each sampling point when the audio data is mixed audio data, so as to generate the singer's initial audio track data, background audio track data and user's initial audio track data.

[0074] The splitting unit includes:

[0075] A first calculation subunit is used to calculate a first difference between a maximum gain value in a mid-frequency region and a minimum gain value in a low-frequency region of the audio data, and use the first difference as a gain value range of the singer's initial audio track data; and

[0076] Calculating a second difference between the middle gain value of the mid-frequency region of the audio data and the minimum gain value of the low-frequency region, and using the second difference as the gain value range of the user's initial audio track data; and

[0077] Calculate a third difference between the maximum gain value in the high frequency region of the audio data and the minimum gain value in the high frequency region, and use the third difference as the gain value range of the background audio track data;

[0078] The splitting subunit is used to split the audio data according to the gain value range of the singer's initial audio track data, the gain value range of the background audio track data and the gain value range of the user's initial audio track data, and generate the singer's initial audio track data, the background audio track data and the user's initial audio track data respectively.

[0079] The adjustment unit 120 includes:

[0080] The second calculation subunit is used to calculate the user average gain value corresponding to the user's initial track data and the singer average gain value corresponding to the singer's initial track data;

[0081] The first adjustment subunit is used to reduce the gain of the singer's initial track data to generate the singer's target track data when the user's average gain value is greater than or equal to the singer's average gain value; and to increase the gain of the user's initial track data to generate the user's target track data; or

[0082] The second adjustment subunit is used to enhance the gain of the singer's initial audio track data to generate the singer's target audio track data when the user's average gain value is less than the singer's average gain value; and to reduce the gain of the user's initial audio track data to generate the user's target audio track data.

[0083] The second computing subunit is specifically used for:

[0084] Calculating the average of the maximum gain value and the minimum gain value of the user's initial audio track data to generate a user average gain value corresponding to the user's initial audio track data; and

[0085] Calculate the average of the maximum gain value and the minimum gain value of the singer's initial track data to generate the singer's average gain value corresponding to the singer's initial track data.

[0086] The first adjustment subunit is specifically used for:

[0087] According to the user average gain value and the preset main track gain value, the gain value of each sampling point in the user track data is increased frame by frame to generate the user target track data; and

[0088] According to the singer's average gain value and the preset sub-track gain value, the gain value of each sampling point in the singer's track data is reduced frame by frame to generate the singer's target track data.

[0089] The second adjustment subunit is specifically used for:

[0090] According to the user average gain value and the preset sub-track gain value, the gain value of each sampling point in the user track data is reduced frame by frame to generate the user target track data; and

[0091] According to the singer's average gain value and the preset main track gain value, the gain value of each sampling point in the singer's track data is increased frame by frame to generate the singer's target track data.

[0092] Furthermore, if Figure 4 As shown, based on the above-mentioned audio track gain adjustment method, the present invention also provides a smart terminal accordingly, and the smart terminal includes a processor 10, a memory 20 and a display 30. Figure 4 Only some components of the smart terminal are shown, but it should be understood that it is not required to implement all the components shown, and more or fewer components may be implemented instead.

[0093] In some embodiments, the memory 20 may be an internal storage unit of the intelligent terminal, such as a hard disk or memory of the intelligent terminal. In other embodiments, the memory 20 may also be an external storage device of the intelligent terminal, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the intelligent terminal. Further, the memory 20 may also include both an internal storage unit of the intelligent terminal and an external storage device. The memory 20 is used to store application software and various types of data installed in the intelligent terminal, such as program codes for installing the intelligent terminal. The memory 20 may also be used to temporarily store data that has been output or is to be output. In one embodiment, a track gain adjustment program 40 is stored on the memory 20, and the track gain adjustment program 40 may be executed by the processor 10, thereby realizing the track gain adjustment method in the present application.

[0094] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor or other data processing chip, which is used to run the program code stored in the memory 20 or process data, such as executing the audio track gain adjustment method.

[0095] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 30 is used to display information on the smart terminal and to display a visual user interface. The components 10-30 of the smart terminal communicate with each other through a system bus.

[0096] In one embodiment, when the processor 10 executes the track gain adjustment program 40 in the memory 20, the following steps are implemented:

[0097] Acquire the audio data to be processed, the audio data including the singer's initial audio track data and the user's initial audio track data;

[0098] When the audio gain value of the user's initial audio track data meets the preset participation rules, the user's initial audio track data and the singer's initial audio track data are gain processed to generate user target audio track data and singer target audio track data.

[0099] Among them, the audio data also includes background audio track data, and the data type of the audio data includes mixed audio data and independent audio data, wherein the independent audio data is audio track data that exists independently of the singer's initial audio track data, the background audio track data and the user's initial audio track data, and the mixed audio data includes audio track data mixed by the singer's initial audio track data, the background audio track data and the user's initial audio track data.

[0100] After obtaining the audio data to be processed, the method further includes:

[0101] When the audio data is mixed audio data, the audio data is split according to the frequency of the audio data and the gain value of each sampling point to generate singer's initial audio track data, background audio track data and user's initial audio track data.

[0102] According to the frequency of the audio data and the gain value of each sampling point, the audio data is split to generate the singer's initial track data, the background track data and the user's initial track data, including:

[0103] Calculating a first difference between a maximum gain value in a mid-frequency region and a minimum gain value in a low-frequency region of the audio data, and using the first difference as a gain value range of the singer's initial audio track data; and

[0104] Calculating a second difference between the middle gain value of the mid-frequency region of the audio data and the minimum gain value of the low-frequency region, and using the second difference as the gain value range of the user's initial audio track data; and

[0105] Calculate a third difference between the maximum gain value in the high frequency region of the audio data and the minimum gain value in the high frequency region, and use the third difference as the gain value range of the background audio track data;

[0106] According to the gain value range of the singer's initial audio track data, the gain value range of the background audio track data and the gain value range of the user's initial audio track data, the audio data is split to generate the singer's initial audio track data, the background audio track data and the user's initial audio track data respectively.

[0107] The gain processing is performed on the user's initial audio track data and the singer's initial audio track data, including:

[0108] Calculate the average gain value of the user corresponding to the user's initial track data, and the average gain value of the singer corresponding to the singer's initial track data;

[0109] When the user average gain value is greater than or equal to the singer average gain value, the singer's initial track data is gain-reduced to generate the singer's target track data; and the user's initial track data is gain-enhanced to generate the user's target track data; or,

[0110] When the user average gain value is less than the singer average gain value, the singer's initial track data is gain enhanced to generate the singer's target track data; and the user's initial track data is gain weakened to generate the user's target track data.

[0111] The calculation of the average user gain value corresponding to the user's initial track data and the average singer gain value corresponding to the singer's initial track data includes:

[0112] Calculate the average value of the minimum gain value of the maximum gain value of the user's initial audio track data to generate a user average gain value corresponding to the user's initial audio track data; and

[0113] Calculate the average of the maximum gain value and the minimum gain value of the singer's initial track data to generate the singer's average gain value corresponding to the singer's initial track data.

[0114] The singer's initial audio track data is gain-reduced, and the user's initial audio track data is gain-enhanced, and the singer's target audio track data and the user's target audio track data are generated respectively, including:

[0115] According to the user average gain value and the preset main track gain value, the gain value of each sampling point in the user track data is increased frame by frame to generate the user target track data; and

[0116] According to the singer's average gain value and the preset sub-track gain value, the gain value of each sampling point in the singer's track data is reduced frame by frame to generate the singer's target track data.

[0117] The singer's initial audio track data is gain-enhanced, and the user's initial audio track data is gain-reduced, and the singer's target audio track data and the user's target audio track data are generated respectively, including:

[0118] If the user average gain value is less than the singer average gain value, then according to the user average gain value and the preset sub-track gain adjustment value, the gain value of each sampling point in the user track data is reduced frame by frame to generate the user target track data; and

[0119] According to the singer's average gain value and the preset main track gain adjustment value, the gain value of each sampling point in the singer's track data is increased frame by frame to generate the singer's target track data.

[0120] The present invention also provides a computer-readable storage medium, which stores a track gain adjustment program. When the track gain adjustment program is executed by a processor, the steps of the above track gain adjustment method are implemented.

[0121] Of course, those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware (such as a processor, a controller, etc.) through a computer program, and the program can be stored in a computer-readable storage medium that can be read by a computer, and the program can include the processes in the above-mentioned method embodiments when executed. The computer-readable storage medium can be a memory, a disk, an optical disk, etc.

[0122] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A method for adjusting track gain, characterized in that: include: Acquire audio data to be processed, wherein the audio data includes singer initial audio track data and user initial audio track data; The data type of the audio data includes mixed audio data; Calculate a first difference between a maximum gain value in a mid-frequency region and a minimum gain value in a low-frequency region of the audio data, and use the first difference as a gain value range of the singer's initial audio track data; as well as Calculate a second difference between the middle gain value in the mid-frequency region and the minimum gain value in the low-frequency region of the audio data, and use the second difference as the gain value range of the user's initial audio track data; as well as Calculate a third difference between the maximum gain value in the high frequency region of the audio data and the minimum gain value in the high frequency region, and use the third difference as the gain value range of the background track data; Splitting the audio data according to the gain value range of the singer's initial audio track data, the gain value range of the background audio track data and the gain value range of the user's initial audio track data, and generating the singer's initial audio track data, the background audio track data and the user's initial audio track data respectively; When the audio gain value of the user's initial audio track data meets the preset participation rules, the user's initial audio track data and the singer's initial audio track data are subjected to gain processing to generate user target audio track data and singer target audio track data; The step of performing gain processing on the user's initial audio track data and the singer's initial audio track data to generate user's target audio track data and singer's target audio track data includes: Calculate the user average gain value corresponding to the user's initial audio track data, and the singer average gain value corresponding to the singer's initial audio track data; When the user average gain value is greater than or equal to the singer average gain value, the singer's initial track data is gain-reduced to generate the singer's target track data, and the user's initial track data is gain-enhanced to generate the user's target track data; or, When the user average gain value is less than the singer average gain value, the singer's initial audio track data is gain enhanced to generate singer's target audio track data, and the user's initial audio track data is gain weakened to generate user's target audio track data.

2. The method according to claim 1, characterized in that The audio data also includes background audio track data, and the data type of the audio data includes independent audio data, wherein the independent audio data is audio track data that exists independently of the singer's initial audio track data, the background audio track data, and the user's initial audio track data, and the mixed audio data includes audio track data mixed by the singer's initial audio track data, the background audio track data, and the user's initial audio track data.

3. The method according to claim 2, characterized in that After obtaining the audio data to be processed, the method further includes: When the audio data is the mixed audio data, the audio data is split according to the frequency of the audio data and the gain value of each sampling point to generate the singer's initial audio track data, the background audio track data and the user's initial audio track data.

4. The method according to claim 1, characterized in that: The calculating the user average gain value corresponding to the user's initial audio track data and the singer average gain value corresponding to the singer's initial audio track data includes: Calculating the average of the maximum gain value and the minimum gain value of the user's initial audio track data to generate a user average gain value corresponding to the user's initial audio track data; and The average value of the maximum gain value and the minimum gain value of the singer's initial audio track data is calculated to generate the singer's average gain value corresponding to the singer's initial audio track data.

5. The method according to claim 1, characterized in that The step of performing gain reduction on the singer's initial audio track data to generate singer's target audio track data, and performing gain enhancement on the user's initial audio track data to generate user's target audio track data, comprises: According to the user average gain value and the preset main track gain value, increasing the gain value of each sampling point in the user track data frame by frame to generate the user target track data; and According to the singer's average gain value and the preset sub-track gain value, the gain value of each sampling point in the singer's track data is reduced frame by frame to generate the singer's target track data.

6. The method according to claim 1, characterized in that The step of performing gain enhancement on the singer's initial audio track data to generate singer's target audio track data, and performing gain reduction on the user's initial audio track data to generate user's target audio track data, comprises: According to the user average gain value and the preset sub-track gain value, the gain value of each sampling point in the user track data is reduced frame by frame to generate the user target track data; and According to the singer's average gain value and the preset main track gain value, the gain value of each sampling point in the singer's track data is increased frame by frame to generate the singer's target track data.

7. A track gain adjustment device, characterized in that: include: An acquisition unit, used for acquiring audio data to be processed, wherein the audio data includes singer's initial audio track data and user's initial audio track data; The data type of the audio data includes mixed audio data; Calculate a first difference between a maximum gain value in a mid-frequency region and a minimum gain value in a low-frequency region of the audio data, and use the first difference as a gain value range of the singer's initial audio track data; as well as Calculate a second difference between the middle gain value in the mid-frequency region and the minimum gain value in the low-frequency region of the audio data, and use the second difference as the gain value range of the user's initial audio track data; as well as Calculate a third difference between the maximum gain value in the high frequency region of the audio data and the minimum gain value in the high frequency region, and use the third difference as the gain value range of the background track data; Splitting the audio data according to the gain value range of the singer's initial audio track data, the gain value range of the background audio track data and the gain value range of the user's initial audio track data, and generating the singer's initial audio track data, the background audio track data and the user's initial audio track data respectively; An adjustment unit, configured to perform gain processing on the user's initial audio track data and the singer's initial audio track data to generate user's target audio track data and singer's target audio track data when the audio gain value of the user's initial audio track data meets a preset participation rule; The step of performing gain processing on the user's initial audio track data and the singer's initial audio track data to generate user's target audio track data and singer's target audio track data includes: Calculate the user average gain value corresponding to the user's initial audio track data, and the singer average gain value corresponding to the singer's initial audio track data; When the user average gain value is greater than or equal to the singer average gain value, the singer's initial track data is gain-reduced to generate the singer's target track data, and the user's initial track data is gain-enhanced to generate the user's target track data; or, When the user average gain value is less than the singer average gain value, the singer's initial audio track data is gain enhanced to generate singer's target audio track data, and the user's initial audio track data is gain weakened to generate user's target audio track data.

8. An intelligent terminal, characterized in that: The intelligent terminal includes a memory, a processor, and a track gain adjustment program stored in the memory and executable on the processor. When the processor executes the track gain adjustment program, the steps of the track gain adjustment method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a track gain adjustment program, and when the track gain adjustment program is executed by a processor, the steps of the track gain adjustment method according to any one of claims 1 to 6 are implemented.