Fitting system and method of original singing audio information, and computer storage medium

Abstract

The invention provides an original singing audio information fitting system and method and a computer storage medium, and relates to the technical field of audio processing, and the method comprises the steps: obtaining selected song information, and obtaining a standard pitch sequence of a song based on the selected song; generating a pitch safety interval changing along with the standard pitch sequence based on the standard pitch sequence; obtaining the original audio of the user, and comparing the real-time pitch of the original audio with the corresponding pitch safety interval; and correcting the notes of which the original audio exceeds the pitch safety interval. According to the original singing audio information fitting method provided by the embodiment of the invention, the offset of the pitch value of each note of the song sung by the user relative to the standard pitch sequence can be kept within a certain range, so that the song sung by the user can be effectively taken out; the purpose of improving the presentation effect of the final singing work is achieved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of audio processing, in particular to a fitting system and method for original singing audio information and a computer storage medium. BACKGROUND

[0002] Since the appearance of the karaoke machine, it has been more and more popular with users. For ordinary users, when singing with the karaoke machine, because of their poor control, the pitch of the singing is often difficult to match the standard pitch of the song, especially in the bass or treble part, the user needs to have higher control of the sound to get a good effect. However, in actual situations, in the bass or treble part, the user wants to better match the standard pitch, but because of their poor control, the pitch of the bass or treble part is seriously deviated, which makes the final singing work not ideal. SUMMARY

[0003] The fitting system and method for original singing audio information and the computer storage medium provided by the present application can correct the user's voice and improve the presentation effect of the final singing work.

[0004] The specific technical solutions of the present application are as follows:

[0005] On the one hand, the present application provides a fitting method for original singing audio information, comprising the following steps:

[0006] S10, obtaining selected song information, and based on the selected song, obtaining a standard pitch sequence of the song;

[0007] S20, generating a pitch safety interval that changes with the standard pitch sequence based on the standard pitch sequence, wherein the pitch safety interval includes an upper threshold value and a lower threshold value of the allowed deviation determined on each note of the standard pitch sequence;

[0008] S30, obtaining the original singing audio of the user, and comparing the real-time pitch of the original singing audio with the corresponding pitch safety interval;

[0009] S40, correcting the notes of the original singing audio that exceed the pitch safety interval, including correcting the pitch value that exceeds the upper threshold value of the pitch safety interval to the upper threshold value, and correcting the pitch value that is lower than the lower threshold value of the pitch safety interval to the lower threshold value.

[0010] In some embodiments, generating a pitch safety interval that changes with the standard pitch sequence based on the standard pitch sequence comprises the following steps:

[0011] S201, determining whether the pitch value of each note in the standard pitch sequence is above a preset pitch median value;

[0012] S202, when determining that the pitch value of the note is above the pitch center value, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is greater than the offset of the lower limit threshold;

[0013] S203, when determining that the pitch value of the note is below the pitch center value, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is less than the offset of the lower limit threshold.

[0014] In some embodiments, after determining whether the pitch value of the note is above the preset pitch center value, the method further comprises the following steps:

[0015] S204, when determining that the pitch value of the note is equal to the pitch center value, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is equal to the offset of the lower limit threshold.

[0016] In some embodiments, the pitch safety interval varying with the standard pitch sequence is generated based on the standard pitch sequence, comprising the following steps: based on each note in the standard pitch sequence, setting the upper limit threshold and the lower limit threshold with the same offset.

[0017] In some embodiments, based on each note in the standard pitch sequence, the offset of the upper limit threshold and the lower limit threshold is set to at least one specific value.

[0018] In some embodiments, the offset of the upper limit threshold and the lower limit threshold is set to a specific value based on the user's selection.

[0019] In some embodiments, after correcting the note of the original singing audio exceeding the pitch safety interval, the method further comprises the following steps:

[0020] S50, performing secondary correction on the original singing audio of the user.

[0021] In some embodiments, the secondary correction on the original singing audio of the user comprises the following steps:

[0022] S501, obtaining a first difference value between a first pitch value in the standard pitch sequence where the previous note is located and a second pitch value corresponding to the user;

[0023] S502, obtaining a second difference value between a third pitch value in the standard pitch sequence where the current note is located and a fourth pitch value corresponding to the user;

[0024] S503, determining whether the second difference value is greater than the first difference value;

[0025] S504, when determining that the second difference value is greater than the first difference value, offsetting the fourth pitch value towards the third pitch value by at least part;

[0026] S505, when determining that the second difference is not greater than the first difference, then ending.

[0027] In another aspect, the embodiment of the present application provides a fitting system of original audio information, comprising a memory and a processor, the memory stores a computer program, and the processor executes the computer program to realize the fitting method of original audio information of any one of the above embodiments.

[0028] The embodiment of the present application also provides a computer storage medium, which stores a computer program, and the computer program is driven to execute the fitting method of original audio information of any one of the above embodiments.

[0029] Compared with the prior art, the embodiment of the present application has the following beneficial effects:

[0030] The fitting method of original audio information provided by the embodiment of the present application can keep the offset of the pitch value of each note of the song sung by the user within a certain range for the standard pitch sequence, and can effectively bottom out the song sung by the user, so as to reduce the case that the user breaks the note (extremely high) or falls into the pit (extremely low) in singing the work, and achieve the purpose of improving the presentation effect of the final singing work. BRIEF DESCRIPTION OF DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained according to these drawings without creative labor.

[0032] Figure 1 is a flowchart of the fitting method of original audio information provided by some embodiments of the present application;

[0033] Figure 2 is a flowchart of the fitting method of original audio information provided by some other embodiments of the present application. DETAILED DESCRIPTION

[0034] With reference to the drawings and the descriptions of embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments of the present application, any person skilled in the art can obtain all other embodiments without creative work, which are within the scope of protection of the present application.

[0035] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer" and the like indicate the orientation or positional relationship shown in the drawings, which are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first", "second" are only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined as "first", "second" can explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "multiple" is two or more, unless otherwise specifically limited.

[0036] The use of "adapted for" or "configured for" in the present application means open and inclusive language that does not exclude devices adapted for or configured for performing additional tasks or steps. In addition, the use of "based on" means open and inclusive, because the process, step, calculation or other action "based on" one or more stated conditions or values can be based on additional conditions or values beyond those stated in practice.

[0037] In the present application, the word "exemplary" is used to mean "serving as an example, instance, or illustration." Any implementation described as "exemplary" in the present application is not necessarily to be construed as preferred or advantageous over other implementations. The following description is presented to enable any person skilled in the art to make and use the present application. In the following description, for the purposes of explanation, details are set forth in order to provide a thorough understanding of the present application. It should be apparent to one skilled in the art that the present application can be practiced without the use of these specific details. In other instances, well-known structures and processes are not described in detail in order to avoid obscuring the description of the present application. Thus, the present application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

[0038] In one aspect, see Figure 1 and Figure 2 , Figure 1is a flowchart of a fitting method of original singing audio information provided by some embodiments of the present application; Figure 2 is a flowchart of a fitting method of original singing audio information provided by some embodiments of the present application. The embodiments of the present application provide a fitting method of original singing audio information, comprising the following steps:

[0039] S10, obtaining selected song information, and obtaining a standard pitch sequence of the song based on the selected song.

[0040] In S10, based on the song selected by the user, the music library is automatically retrieved to obtain the standard pitch sequence of the original song. For different singers of the original song, the standard pitch sequence of the song may be different. Pitch refers to the pitch, i.e., the frequency of the sound, which is one of the three main subjective attributes of sound, indicating the degree of human auditory perception of the pitch of a sound. The standard pitch sequence of the song refers to a sequence set including multiple pitches of the original song.

[0041] S20, generating a pitch safety interval that changes with the standard pitch sequence based on the standard pitch sequence. The pitch safety interval includes an upper threshold value and a lower threshold value of the allowed deviation determined on each note of the standard pitch sequence.

[0042] In S20, for notes of different pitches, different upper threshold values and lower threshold values can be set, or the same upper threshold value and lower threshold value can be set; for notes of the same pitch, different upper threshold values and lower threshold values can be set, or the same upper threshold value and lower threshold value can be set, and then the pitch safety interval is formed through the setting of multiple notes. The deviation of each note based on the standard pitch can be set as a fixed value or a fixed ratio. The deviation of the upper threshold value and the deviation of the lower threshold value can be the same or different.

[0043] S30, obtaining the original singing audio of the user, and comparing the real-time pitch of the original singing audio with the corresponding pitch safety interval.

[0044] In S30, the real-time pitch of the original singing audio refers to the pitch of the current note when the user sings the song. The real-time pitch of the original singing audio is compared with the upper threshold value and the lower threshold value of the pitch safety interval.

[0045] S40, correcting the notes of the original singing audio that exceed the pitch safety interval, including correcting the pitch value that exceeds the upper threshold value of the pitch safety interval to the upper threshold value, and correcting the pitch value that is lower than the lower threshold value of the pitch safety interval to the lower threshold value.

[0046] In the above embodiments, for each real-time note sung by the user, when the pitch value of the note is higher than the upper limit threshold of the pitch safety range, the pitch value of the note is corrected to the upper limit threshold of the pitch safety range; when the pitch value of the note is lower than the lower limit threshold of the pitch safety range, the pitch value of the note is corrected to the lower limit threshold of the pitch safety range.

[0047] By setting up the above embodiments, the pitch value of each note in the user's song can be kept within a certain range relative to the standard pitch sequence. This effectively provides a safety net for the user's singing, reducing the chances of the user cracking (very high) or falling into a pit (very low) during the performance, thereby improving the final presentation of the performance.

[0048] In some embodiments, step S20, generating a pitch safety range that varies with the standard pitch sequence based on the standard pitch sequence, includes the following steps:

[0049] S201. Based on each note in the standard pitch sequence, determine whether the pitch value of the note is above the preset pitch value.

[0050] In S201, the preset pitch value is a fixed value that can be set based on a sequence of marked pitch values ​​for common songs, or based on a standard pitch sequence for a specific selected song. In some examples, the pitch value can be a pitch value in the middle, or another pitch value near the middle.

[0051] S202. When it is determined that the pitch value of the note is above the middle pitch value, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is greater than the offset of the lower limit threshold.

[0052] In S202, the pitch value of this note refers to the pitch value of the note corresponding to the standard pitch sequence in the original song.

[0053] S203. When it is determined that the pitch value of the note is below the middle pitch value, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is less than the offset of the lower limit threshold.

[0054] When determining that the pitch value of a note is equal to the pitch midpoint, it can be that the offset of the upper threshold of the pitch safety interval corresponding to the note is greater than the offset of the lower threshold, the offset of the upper threshold of the pitch safety interval corresponding to the note is less than the offset of the lower threshold, or the offset of the upper threshold of the pitch safety interval corresponding to the note is equal to the offset of the lower threshold.

[0055] In a specific application scenario, when the pitch value of a note is above the pitch median value, the user will try to use high pitch when singing the song, and thus is more likely to deviate to a higher pitch value; when the pitch value of a note is below the pitch median value, the user will try to use low pitch when singing the song, and thus is more likely to deviate to a lower pitch value.

[0056] Therefore, by the above-mentioned embodiments, when the pitch value of a note is above the pitch median value, the upper limit threshold of the pitch safety interval corresponding to the note is set to an offset greater than the lower limit threshold; when the pitch value of a note is below the pitch median value, the upper limit threshold of the pitch safety interval corresponding to the note is set to an offset less than the lower limit threshold, which can reduce the pitch value to be reduced in the pitch correction process when the pitch value of the user's voice exceeds the pitch safety interval, and thus makes the user's voice and the finally presented voice more consistent, so as to reduce the situation that the pitch correction effect is too obvious, and to make the finally presented voice more natural.

[0057] In some embodiments, after determining whether the pitch value of the note is above the preset pitch median value in S201, the method further includes the following steps:

[0058] S204, when it is determined that the pitch value of the note is equal to the pitch median value, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is equal to the offset of the lower limit threshold.

[0059] By the above-mentioned embodiments, different user groups can be better dealt with, so that the notes with a pitch value at the pitch median value can be more stable, and on the basis of such detailed setting of the pitch safety interval, subsequent processing of the original singing audio is also more targeted and scientific.

[0060] In some embodiments, in S20, based on the standard pitch sequence, the pitch safety interval varying with the standard pitch sequence is generated, including the following steps:

[0061] Based on each note in the standard pitch sequence, the upper limit threshold and the lower limit threshold with the same offset are set.

[0062] By the above-mentioned embodiments, the threshold setting with the same offset is adopted, which is simpler in operation, more efficient in processing, requires less data of the program for automatic processing, and has lower preparation and maintenance costs and better economic efficiency, compared with the threshold setting without fixed offset.

[0063] In some embodiments, in S20, based on each note in the standard pitch sequence, the offset of the upper limit threshold and the lower limit threshold is set to at least one specific value.

[0064] The offset of the upper threshold and the offset of the lower threshold can be the same or different. When they are the same, the offset of the upper threshold and the offset of the lower threshold are set to a specific value. When they are different, the offset of the upper threshold and the offset of the lower threshold are set to two specific values.

[0065] In some examples, when the offset of the upper threshold and the offset of the lower threshold of the pitch value of the target note are different, the offset of the upper threshold and the offset of the lower threshold are set to two specific values in the steps S201-S203.

[0066] Through the setting of the above-mentioned embodiments, higher-order pitch correction settings can be provided for some more basic users, and more personalized singing works can be obtained.

[0067] In some of the embodiments, the offset of the upper threshold and the offset of the lower threshold are set to specific values based on the user's selection.

[0068] In the above-mentioned embodiments, the user can customize the offset of the upper threshold and the offset of the lower threshold to obtain a setting effect that is more in line with their own needs.

[0069] In some examples, when the user customizes the upper threshold and the lower threshold, the user can set the offset value by a simple setting method, such as directly inputting an offset value, which is the offset value of the upper threshold and the lower threshold of the entire song or all music works within a period of time. This is suitable for some users who have some knowledge of the pitch correction method but are not familiar with it.

[0070] In other examples, the user can input two offset values, one offset value as the offset of the upper threshold of the entire song or all music works within a period of time, and the other offset value as the offset of the lower threshold of the entire song or all music works within a period of time.

[0071] In yet other examples, the user can set the offset of the upper threshold and the offset of the lower threshold for each note. This setting method is time-consuming, but the customized effect of the singing work obtained after the setting is more obvious, and is more suitable for professional use.

[0072] In some of the embodiments, after the step S40 of correcting the notes of the original singing audio that exceed the pitch safe interval, the following steps are further included:

[0073] S50, performing secondary correction on the original singing audio of the user.

[0074] In the above embodiments, the secondary modification can be performed in a conventional manner, such as fine-tuning the pitch of the audio using a pitch adjustment algorithm to make it more accurately conform to the expected pitch range. The timbre of the audio can also be optimized through filtering processing to remove unnecessary noise and interference, making the sound purer. Equalizing the volume of the audio is also a common secondary modification method to ensure that the volume of each note and paragraph remains balanced, avoiding large and small volume situations.

[0075] In some embodiments, the secondary modification of the user's original singing audio in step S50 includes the following steps:

[0076] S501, obtaining a first difference value between a first pitch value in a standard pitch sequence in which the previous note is located and a corresponding second pitch value of the user.

[0077] In S501, the previous note is with respect to the current real-time note, the first pitch value is the pitch value in the standard pitch sequence in which the previous note is located, the second pitch value is the pitch value of the audio sung by the user at the previous note, and the first difference value is the difference between the two.

[0078] S502, obtaining a second difference value between a third pitch value in a standard pitch sequence in which the current note is located and a corresponding fourth pitch value of the user.

[0079] In S502, the current fourth pitch value can be understood as the pitch value of the current note to be processed.

[0080] S503, determining whether the second difference value is greater than the first difference value.

[0081] S504, when the difference value is greater than the first difference value, the fourth pitch value is shifted at least partially towards the third pitch value.

[0082] In S504, the third pitch value is the value in the standard pitch sequence, and the part of the shift can be shifted based on a pre-set value.

[0083] S505, when the second difference value is not greater than the first difference value, then end.

[0084] In the above embodiments, the pitch of the note sung by the user is compared with the standard pitch sequence, and compared with the previous note, which can make the song sung by the user gradually converge, and the pitch correction can be more smooth, and the pitch correction effect can be more natural, and the final display effect is better.

[0085] In another aspect, an embodiment of the present application provides a fitting system of original audio information, comprising a memory and a processor, the memory stores a computer program, and the processor executes the computer program to implement the fitting method of original audio information of any of the above embodiments.

[0086] An embodiment of the present application further provides a computer storage medium, which stores a computer program, and the computer program is driven to execute the fitting method of original audio information of any of the above embodiments.

[0087] The principles and implementation manners of the present application are described by using specific examples in the present application, and the above embodiment descriptions are only used to help understand the method and its core idea of the present application; meanwhile, for those skilled in the art, the specific implementation manners and application ranges will be changed according to the idea of the present application, and in summary, the content of the present description should not be understood as a limitation of the present application.

Claims

1. A method for fitting original vocal audio information, characterized in that, include: S10. Obtain the selected song information and, based on the selected song, obtain the standard pitch sequence of the song; S20. Based on the standard pitch sequence, generate a pitch safety range that varies with the standard pitch sequence, wherein the pitch safety range includes an upper limit threshold and a lower limit threshold for allowed offsets determined for each note in the standard pitch sequence; S30. Obtain the user's original audio recording and compare the real-time pitch of the original audio recording with the corresponding pitch safety range; S40. Correcting notes in the original vocal audio that exceed the pitch safety range, including correcting pitch values ​​that exceed the upper limit threshold of the pitch safety range to the upper limit threshold, and correcting pitch values ​​that are below the lower limit threshold of the pitch safety range to the lower limit threshold.

2. The method for fitting original audio information as described in claim 1, characterized in that, Generating a pitch safety range that varies with the standard pitch sequence based on the standard pitch sequence includes the following steps: S201. Based on each note in the standard pitch sequence, determine whether the pitch value of the note is above the preset pitch value. S202. When it is determined that the pitch value of the note is above the pitch value, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is greater than the offset of the lower limit threshold. S203. When it is determined that the pitch value of the note is below the middle pitch value, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is less than the offset of the lower limit threshold.

3. The method for fitting original audio information as described in claim 2, characterized in that, After determining whether the pitch of the note is above the preset pitch value, the following steps are also included: S204. When the pitch value of the note is determined to be equal to the pitch midpoint, the offset of the upper limit threshold of the pitch safety interval corresponding to the note is equal to the offset of the lower limit threshold.

4. The method for fitting original audio information as described in claim 1, characterized in that, Generating a safe pitch range that varies with the standard pitch sequence based on the standard pitch sequence includes the following steps: setting an upper limit threshold and a lower limit threshold with the same offset for each note in the standard pitch sequence.

5. The method for fitting original audio information as described in any one of claims 1-4, characterized in that, For each note in the standard pitch sequence, the offsets of the upper and lower thresholds are set to at least one specific value.

6. The method for fitting original audio information as described in claim 5, characterized in that, The offsets between the upper and lower thresholds are set to specific values ​​based on the user's selection.

7. The method for fitting original audio information as described in claim 1, characterized in that, After correcting the notes in the original vocal audio that exceed the pitch safety range, the method further includes the following steps: S50: Perform secondary corrections on the user's original audio recording.

8. The method for fitting original audio information as described in claim 7, characterized in that, The secondary correction of the user's original audio includes the following steps: S501. Obtain the first difference between the first pitch value in the standard pitch sequence where the previous note is located and the corresponding second pitch value of the user. S502, Obtain the second difference between the third pitch value in the standard pitch sequence where the current note is located and the corresponding fourth pitch value of the user; S503. Determine whether the second difference is greater than the first difference; S504. When it is determined that the second difference is greater than the first difference, the fourth pitch value is shifted towards the third pitch value by at least a portion. S505. When it is determined that the second difference is not greater than the first difference, the process ends.

9. A system for fitting original vocal audio information, characterized in that, The device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the method for fitting original audio information as described in any one of claims 1-8.

10. A computer storage medium, characterized in that, It contains a computer program that is driven to perform the fitting method for the original audio information as described in any one of claims 1-8.

Images