Method, device, equipment and storage medium for displaying range matching information

Abstract

The present application discloses a method, device, equipment and storage medium for displaying range matching information, and belongs to the field of computer technology. The method includes: obtaining the user dry voice audio and the corresponding original singer dry voice audio; obtaining the first fundamental frequency sequence corresponding to the user dry voice audio, and obtaining the second fundamental frequency sequence corresponding to the original singer dry voice audio; determining the first median and the first mean of the first fundamental frequency sequence, and the second median and the second mean of the second fundamental frequency sequence; determining the range matching information of the user dry voice audio relative to the original singer dry voice audio based on the first median, the second median, the first mean and the second mean; and displaying the range matching information. The present application can improve the effectiveness of the determined range matching information.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device, equipment and storage medium for displaying range matching information. Background Art

[0002] With the rapid development of terminal technology, users' home terminals (such as mobile phones, home computers, etc.) can all realize the karaoke function. Singing karaoke through terminals has become a very common entertainment method for people.

[0003] After the user sings using the karaoke application, the karaoke application can calculate the range matching information between the user's dry voice audio and the original singer's dry voice audio from the perspective of the range, and present it to the user to indicate whether the user's range expression is consistent with the corresponding song. The range matching information is generally calculated based on the matching degree of the fundamental frequency upper and lower limits of the user's dry voice audio and the original singer's dry voice audio.

[0004] In the process of implementing this application, the inventors found that the related technology has at least the following problems:

[0005] The fundamental frequency sequence corresponding to the dry audio extracted using the fundamental frequency detection algorithm will be unstable, that is, the fundamental frequency at a certain time point in the extracted fundamental frequency sequence will have an octave deviation. Taking this into account, when calculating the range matching information based on the above method, the octave deviation will cause a large change in the upper and lower limits of the fundamental frequency, resulting in poor effectiveness of the calculated range matching information. Summary of the invention

[0006] The embodiments of the present application provide a method, device, equipment and storage medium for displaying vocal range matching information, which can solve the problem of poor effectiveness of vocal range matching information. The technical solution is as follows:

[0007] In a first aspect, a method for displaying range matching information is provided, the method comprising:

[0008] Obtain the user's dry voice audio and the corresponding original singer's dry voice audio;

[0009] Acquire a first fundamental frequency sequence corresponding to the user dry voice audio, and acquire a second fundamental frequency sequence corresponding to the original singer dry voice audio;

[0010] Determine a first median and a first mean of the first fundamental frequency sequence, and a second median and a second mean of the second fundamental frequency sequence;

[0011] Determine, according to the first median, the second median, the first mean, and the second mean, the range matching information of the user dry voice audio relative to the original singer dry voice audio;

[0012] The range matching information is displayed.

[0013] In a possible implementation manner, obtaining a first fundamental frequency sequence corresponding to the user dry voice audio includes:

[0014] Based on a preset unit time length, extract the fundamental frequency corresponding to each unit time length period in the user dry audio to obtain an initial fundamental frequency sequence;

[0015] Determine the vocal singing time period according to the lyrics information corresponding to the user's dry voice audio;

[0016] The fundamental frequency sequence segment corresponding to the vocal singing period is obtained in the initial fundamental frequency sequence to obtain a first fundamental frequency sequence corresponding to the user dry voice audio.

[0017] In a possible implementation, determining the range matching information of the user dry voice audio relative to the original singer dry voice audio according to the first median, the second median, the first mean, and the second mean includes:

[0018] determining a first difference between the first median and the second median, and a second difference between the first mean and the second mean;

[0019] determining an absolute value of a difference between the first difference and the second difference;

[0020] According to at least one difference between the first difference and the second difference, and the absolute value of the difference, the range matching information of the user dry voice audio relative to the original singer's dry voice audio is determined.

[0021] In a possible implementation, determining, according to at least one difference between the first difference and the second difference and the absolute value of the difference, the range matching information of the user dry voice audio relative to the original singer dry voice audio includes:

[0022] If the absolute value of the difference is greater than or equal to a first threshold, determining that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a first result value; and / or

[0023] If the absolute value of the difference is less than a first threshold, and the first difference is greater than or equal to a second threshold and is not 12 semitones, then the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined to be a second result value, wherein the second threshold is less than 12 semitones; and / or

[0024] If the absolute value of the difference is less than a first threshold value, and the first difference is 12 semitones, determining that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a third result value; and / or

[0025] If the absolute value of the difference is less than the first threshold, and the first difference is less than the second threshold, it is determined that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a fourth result value.

[0026] In a possible implementation, the method further includes:

[0027] Determine, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence, and obtain a first corresponding relationship between the base frequency and the cumulative duration; determine, according to the second base frequency sequence, a cumulative duration corresponding to each base frequency in the second base frequency sequence, and obtain a second corresponding relationship between the base frequency and the cumulative duration;

[0028] Determine the difference between the first corresponding relationship and the second corresponding relationship in the bass range, the middle range, and the treble range respectively;

[0029] Determine bass range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the bass range, determine mid-range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the mid-range, and determine treble range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the treble range;

[0030] The bass range matching information, the middle range matching information and the treble range matching information are displayed.

[0031] In a possible implementation manner, before determining the difference between the first corresponding relationship and the second corresponding relationship in the bass range, the middle range, and the treble range, the method further includes:

[0032] According to the second corresponding relationship between the fundamental frequency and the cumulative duration, the bass range, the middle range and the treble range are determined, wherein the bass range is adjacent to the middle range, the middle range is adjacent to the treble range, and the sum of the cumulative durations of the fundamental frequencies in the bass range, the sum of the cumulative durations of the fundamental frequencies in the middle range, and the sum of the cumulative durations of the fundamental frequencies in the treble range are equal.

[0033] In a possible implementation manner, determining, according to the first fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the first fundamental frequency sequence, and obtaining a first corresponding relationship between the fundamental frequency and the cumulative duration includes:

[0034] Determine, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence;

[0035] In the accumulated duration corresponding to each fundamental frequency in the first fundamental frequency sequence, a first corresponding relationship between the fundamental frequency and the accumulated duration is established according to the accumulated duration greater than the duration threshold and the corresponding fundamental frequency.

[0036] In a possible implementation manner, determining, according to the second base frequency sequence, a cumulative duration corresponding to each base frequency in the second base frequency sequence, and obtaining a second corresponding relationship between the base frequency and the cumulative duration includes:

[0037] Determine, according to the second fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the second fundamental frequency sequence, and obtain an initial corresponding relationship between the fundamental frequency and the cumulative duration;

[0038] The first difference is added to each fundamental frequency in the initial corresponding relationship to obtain a second corresponding relationship between the fundamental frequency and the accumulated duration.

[0039] In a possible implementation, after the bass range matching information is determined according to the difference between the first corresponding relationship and the second corresponding relationship in the bass range, the mid-range matching information is determined according to the difference between the first corresponding relationship and the second corresponding relationship in the mid-range, and the treble matching information is determined according to the difference between the first corresponding relationship and the second corresponding relationship in the treble, the method further includes:

[0040] Obtaining an adjustment coefficient corresponding to the original singer's dry voice audio, wherein the adjustment coefficient is positively correlated with the fundamental frequency span value corresponding to the original singer's dry voice audio, and the adjustment coefficient is greater than 1;

[0041] Determine the product of the sum of the bass range matching information, the middle range matching information, and the treble range matching information and the adjustment coefficient to obtain total range matching information;

[0042] Determine the sum of the total matching information of the vocal range and the matching information of the vocal range to obtain comprehensive matching information;

[0043] The comprehensive matching information is displayed.

[0044] In a possible implementation, the method further includes:

[0045] Determine, according to the first fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the first fundamental frequency sequence, and obtain a first corresponding relationship between the fundamental frequency and the cumulative duration;

[0046] Determine the target account to which the user's dry voice audio belongs;

[0047] According to the first correspondence between the fundamental frequency and the accumulated duration corresponding to the dry voice audio of all users of the target account, the accumulated duration of each fundamental frequency is accumulated to obtain a third correspondence between the fundamental frequency and the total accumulated duration corresponding to the target account;

[0048] In the second correspondence between the fundamental frequencies and the accumulated durations corresponding to the multiple original singer dry voice audios, determine a second correspondence that satisfies a similar condition to the third correspondence;

[0049] Determine the target original singer's dry voice audio belonging to the second corresponding relationship that meets the similarity condition with the third corresponding relationship, and send a singing recommendation message corresponding to the target original singer's dry voice audio to the target account.

[0050] In a second aspect, a device for displaying range matching information is provided, the device comprising:

[0051] The first acquisition module is used to acquire the user's dry voice audio and the corresponding original singer's dry voice audio;

[0052] A second acquisition module is used to acquire a first fundamental frequency sequence corresponding to the user dry voice audio, and acquire a second fundamental frequency sequence corresponding to the original singer dry voice audio;

[0053] A first determining module, configured to determine a first median and a first mean of the first base frequency sequence, and a second median and a second mean of the second base frequency sequence;

[0054] A second determination module is used to determine the range matching information of the user dry voice audio relative to the original singer dry voice audio according to the first median, the second median, the first mean and the second mean;

[0055] A display module is used to display the range matching information.

[0056] In a possible implementation, the second acquisition module is used to:

[0057] Based on a preset unit time length, extract the fundamental frequency corresponding to each unit time length period in the user dry audio to obtain an initial fundamental frequency sequence;

[0058] Determine the vocal singing time period according to the lyrics information corresponding to the user's dry voice audio;

[0059] The fundamental frequency sequence segment corresponding to the vocal singing period is obtained in the initial fundamental frequency sequence to obtain a first fundamental frequency sequence corresponding to the user dry voice audio.

[0060] In a possible implementation manner, the second determining module is configured to:

[0061] determining a first difference between the first median and the second median, and a second difference between the first mean and the second mean;

[0062] determining an absolute value of a difference between the first difference and the second difference;

[0063] According to at least one difference between the first difference and the second difference, and the absolute value of the difference, the range matching information of the user dry voice audio relative to the original singer's dry voice audio is determined.

[0064] In a possible implementation manner, the second determining module is configured to:

[0065] If the absolute value of the difference is greater than or equal to a first threshold, determining that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a first result value; and / or

[0066] If the absolute value of the difference is less than a first threshold, and the first difference is greater than or equal to a second threshold and is not 12 semitones, then the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined to be a second result value, wherein the second threshold is less than 12 semitones; and / or

[0067] If the absolute value of the difference is less than a first threshold value, and the first difference is 12 semitones, determining that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a third result value; and / or

[0068] If the absolute value of the difference is less than the first threshold, and the first difference is less than the second threshold, it is determined that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a fourth result value.

[0069] In a possible implementation manner, the apparatus further includes a third determining module, configured to:

[0070] Determine, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence, and obtain a first corresponding relationship between the base frequency and the cumulative duration; determine, according to the second base frequency sequence, a cumulative duration corresponding to each base frequency in the second base frequency sequence, and obtain a second corresponding relationship between the base frequency and the cumulative duration;

[0071] Determine the difference between the first corresponding relationship and the second corresponding relationship in the bass range, the middle range, and the treble range respectively;

[0072] Determine bass range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the bass range, determine mid-range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the mid-range, and determine treble range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the treble range;

[0073] The display module is also used for:

[0074] The bass range matching information, the middle range matching information and the treble range matching information are displayed.

[0075] In a possible implementation manner, the third determining module is further configured to:

[0076] Before determining the difference between the first correspondence and the second correspondence in the bass range, middle range, and treble range respectively, the bass range, middle range, and treble range are determined according to the second correspondence between the fundamental frequency and the cumulative duration, wherein the bass range is adjacent to the middle range, the middle range is adjacent to the treble range, and the sum of the cumulative durations of the fundamental frequencies in the bass range, the sum of the cumulative durations of the fundamental frequencies in the middle range, and the sum of the cumulative durations of the fundamental frequencies in the treble range are equal.

[0077] In a possible implementation manner, the third determining module is configured to:

[0078] Determine, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence;

[0079] In the accumulated duration corresponding to each fundamental frequency in the first fundamental frequency sequence, a first corresponding relationship between the fundamental frequency and the accumulated duration is established according to the accumulated duration greater than the duration threshold and the corresponding fundamental frequency.

[0080] In a possible implementation manner, the third determining module is configured to:

[0081] Determine, according to the second fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the second fundamental frequency sequence, and obtain an initial corresponding relationship between the fundamental frequency and the cumulative duration;

[0082] The first difference is added to each fundamental frequency in the initial corresponding relationship to obtain a second corresponding relationship between the fundamental frequency and the accumulated duration.

[0083] In a possible implementation manner, the third determining module is further configured to:

[0084] Obtaining an adjustment coefficient corresponding to the original singer's dry voice audio, wherein the adjustment coefficient is positively correlated with the fundamental frequency span value corresponding to the original singer's dry voice audio, and the adjustment coefficient is greater than 1;

[0085] Determine the product of the sum of the bass range matching information, the middle range matching information, and the treble range matching information and the adjustment coefficient to obtain total range matching information;

[0086] Determine the sum of the total matching information of the vocal range and the matching information of the vocal range to obtain comprehensive matching information;

[0087] The display module is also used

[0088] The comprehensive matching information is displayed.

[0089] In a possible implementation manner, the device further includes a recommendation module, which is used to:

[0090] Determine, according to the first fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the first fundamental frequency sequence, and obtain a first corresponding relationship between the fundamental frequency and the cumulative duration;

[0091] Determine the target account to which the user's dry voice audio belongs;

[0092] According to the first correspondence between the fundamental frequency and the accumulated duration corresponding to the dry voice audio of all users of the target account, the accumulated duration of each fundamental frequency is accumulated to obtain a third correspondence between the fundamental frequency and the total accumulated duration corresponding to the target account;

[0093] In the second correspondence between the fundamental frequencies and the accumulated durations corresponding to the multiple original singer dry voice audios, determine a second correspondence that satisfies a similar condition to the third correspondence;

[0094] Determine the target original singer's dry voice audio belonging to the second corresponding relationship that meets the similarity condition with the third corresponding relationship, and send a singing recommendation message corresponding to the target original singer's dry voice audio to the target account.

[0095] According to a third aspect, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the operation performed by the method for displaying vocal range matching information as described in the first aspect.

[0096] According to a fourth aspect, a computer-readable storage medium is provided, wherein the storage medium stores at least one instruction, and the at least one instruction is loaded and executed by a processor to implement the operations performed by the method for displaying vocal range matching information according to the first aspect.

[0097] The beneficial effects of the technical solution provided by the embodiment of the present application are:

[0098] In an embodiment of the present application, a first median and a first mean of a first fundamental frequency sequence of the user's dry voice audio are determined, and a second median and a second mean of a second fundamental frequency sequence of the original singer's dry voice audio are determined, and based on a comparison of the mean and the median, the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined. In this way, even if there is an octave deviation of individual fundamental frequencies in the process of extracting the fundamental frequency sequence, the impact on the mean and the median is very small, and the determined range matching information is less affected by the octave deviation of individual fundamental frequencies in the fundamental frequency sequence, thereby improving the effectiveness of the determined range matching information. BRIEF DESCRIPTION OF THE DRAWINGS

[0099] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0100] Figure 1 is a flow chart of a method for displaying range matching information provided by an embodiment of the present application;

[0101] Figure 2 is a schematic diagram of a fundamental frequency-time curve provided in an embodiment of the present application;

[0102] Figure 3 is a schematic diagram of a fundamental frequency-time curve provided in an embodiment of the present application;

[0103] Figure 4 is a schematic diagram of a fundamental frequency-time curve provided in an embodiment of the present application;

[0104] Figure 5 is a schematic diagram of a fundamental frequency-time curve provided in an embodiment of the present application;

[0105] Figure 6 is a flow chart of a method for displaying range matching information provided by an embodiment of the present application;

[0106] Figure 7 is a schematic diagram of a fundamental frequency-cumulative duration curve provided in an embodiment of the present application;

[0107] Figure 8 is a schematic diagram of a fundamental frequency-cumulative duration curve provided in an embodiment of the present application;

[0108] Fig. 9 is a schematic diagram of a fundamental frequency-cumulative duration curve provided in an embodiment of the present application;

[0109] Fig.10 is a schematic diagram of a fundamental frequency-cumulative duration curve provided in an embodiment of the present application;

[0110] Fig.11 is a schematic diagram of a fundamental frequency-cumulative duration curve provided in an embodiment of the present application;

[0111] Fig.12 is a flow chart of a method for displaying range matching information provided by an embodiment of the present application;

[0112] Fig.13 It is a schematic diagram of the interface display provided in the embodiment of the present application;

[0113] Fig.14 is a flow chart of a method for displaying range matching information provided by an embodiment of the present application;

[0114] Fig.15 is a schematic diagram of the structure of a device for displaying range matching information provided in an embodiment of the present application;

[0115] Fig.16 is a schematic diagram of the structure of a terminal provided in an embodiment of the present application;

[0116] Fig.17 It is a schematic diagram of the structure of the server provided in the embodiment of the present application. DETAILED DESCRIPTION

[0117] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0118] The method for displaying the vocal range matching information provided in the embodiment of the present application can be implemented by a computer device, which can be a terminal such as a mobile phone, a tablet computer, a desktop computer, a laptop computer, etc. The computer device can also be a server.

[0119] The terminal may be installed with a karaoke application. The terminal may include a processor, a memory, an audio collection component, and an audio output component. The processor may be a CPU (Central Processing Unit), which may be used for various processes in the karaoke process, various processes in the process of determining the range matching information, and the like. The memory may be various volatile memories or non-volatile memories, which may be used to store pre-stored data, intermediate data, and result data in the process of determining and displaying the range matching information, for example, the execution code data of the baseband detection algorithm, various thresholds required in the process, the range matching information, and the like. The audio collection component may be a microphone, which is used to collect the dry sound audio (which may be referred to as the user dry sound audio) of the user singing. The audio output component may be a headset, a speaker, etc., which may be used to play audio, such as accompaniment audio, original song audio, and the like. The terminal may also include a communication component, a display component, an input component, and the like. The communication component may include a WiFi (Wireless Fidelity) module, a Bluetooth module, a cellular network module, a network card, and the like. The display component may be a display screen, a display, and the like. The input component may be a touch screen, a touch pad, a keyboard, a mouse, and the like.

[0120] The server can be a background server of a karaoke application, a separate server, or a server group consisting of multiple servers. The server can include a processor, a memory, a communication component, etc. The relevant introduction is similar to that of the terminal, and can be referred to the above content.

[0121] Karaoke applications generally have a karaoke scoring function. In the embodiment of the present application, the karaoke application is provided with a function of determining and displaying the range matching information based on the karaoke scoring function. The range matching information is used to indicate whether the user's range expression is consistent with the corresponding song, which can be a score, rating, description information, etc.

[0122] When the terminal is the execution subject, the terminal obtains the user's dry voice audio recorded by the user during the karaoke process, further determines the sound range matching information, and displays it. When the server is the execution subject, the server obtains the user's dry voice audio recorded by the user during the karaoke process uploaded by the terminal, further determines the sound range matching information, and then sends the sound range matching information to the terminal for display. This embodiment takes the terminal as the execution subject as an example to elaborate on the scheme in detail. Other situations are similar and will not be repeated in this embodiment.

[0123] Figure 1 is a flow chart of a method for displaying range matching information provided by an embodiment of the present application. Figure 1 , the embodiment comprises:

[0124] 101. Obtain the user's dry voice audio and the corresponding original singer's dry voice audio.

[0125] The user dry voice audio is the vocal audio sung by the user without accompaniment, and the original singer dry voice audio is the vocal audio sung by the original singer of the song without accompaniment.

[0126] In practice, when a user wants to sing karaoke, he can run a karaoke application on the terminal and select the karaoke option in the karaoke application. The terminal will display a song list, which includes a large number of song options for the user to choose from. The user can select the target song he wants to sing and click the option of the target song. The karaoke application will obtain the original song audio and accompaniment audio of the target song. If it is already stored locally, it will be directly obtained locally. If it is not stored locally, it can be downloaded from the server. Among them, the original song audio is a mixed audio of the vocal audio sung by the original singer of the song and the accompaniment audio.

[0127] Then, the karaoke application can enter the karaoke interface, start playing the accompaniment audio, and start the audio acquisition component to start audio recording. If the user clicks the original singer option, the karaoke application will switch to playing the original singer's song audio. After the user clicks the end option, the karaoke application enters the recording completion interface, which has functions such as tuning, audition, and displaying scores.

[0128] At this time, the terminal can obtain the recorded user dry voice audio. At the same time, the original singer's dry voice audio of the target song can be obtained. There are many ways to obtain the original singer's dry voice audio, and several possible methods are given below. Method 1, input the original song audio into the vocal extraction model, and output the original singer's dry voice audio of the target song. Method 2, the server inputs the original song audio into the vocal extraction model, outputs the original singer's dry voice audio of the target song, and sends the original singer's dry voice audio to the terminal. Method 3, the server obtains the original singer's dry voice audio from the song producer in advance, and sends the original singer's dry voice audio to the terminal.

[0129] 102, obtaining a first fundamental frequency sequence corresponding to the user's dry voice audio, and obtaining a second fundamental frequency sequence corresponding to the original singer's dry voice audio.

[0130] Among them, the fundamental frequency sequence is a sequence composed of fundamental frequencies corresponding to different time points in the audio. When extracting the fundamental frequency, a unit duration is set. It can be considered that each fundamental frequency corresponds to a time period of the corresponding unit duration, or it can be considered that each fundamental frequency corresponds to the starting time point of the time period. This unit duration can reflect the accuracy of fundamental frequency extraction. The audio signal of any time period is composed of the superposition of multiple sinusoidal signals, and the lowest frequency among the frequencies of these sinusoidal signals is the fundamental frequency.

[0131] In implementation, after obtaining the user's dry voice audio, the first fundamental frequency sequence corresponding to the user's dry voice audio can be extracted through a specified fundamental frequency detection algorithm. There are various ways to obtain the second fundamental frequency sequence corresponding to the original singer's dry voice audio, and several possible methods are given below. Method 1, execute the specified fundamental frequency detection algorithm on the terminal to extract the second fundamental frequency sequence corresponding to the original singer's dry voice audio. Method 2, the server pre-executes the specified fundamental frequency detection algorithm on the original singer's dry voice audio of each song in the audio library, extracts the second fundamental frequency sequence corresponding to the original singer's dry voice audio, and sends it to the terminal. Method 3, when the server sends the accompaniment audio to the terminal, it executes the specified fundamental frequency detection algorithm on the original singer's dry voice audio, extracts the second fundamental frequency sequence corresponding to the original singer's dry voice audio, and sends it to the terminal.

[0132] The fundamental frequency detection algorithm may be a YIN (a name of a fundamental frequency detection algorithm) algorithm or a PYIN (a name of a fundamental frequency detection algorithm) algorithm, etc.

[0133] Optionally, for the user dry voice audio, when extracting the fundamental frequency, the fundamental frequency of the non-singing part can be filtered out, and the corresponding processing can be as follows: based on the preset unit time length, extract the fundamental frequency corresponding to each unit time length of the user dry voice audio, and obtain an initial fundamental frequency sequence; determine the vocal singing time period according to the lyrics information corresponding to the user dry voice audio; obtain the fundamental frequency sequence segment corresponding to the vocal singing time period in the initial fundamental frequency sequence, and obtain the first fundamental frequency sequence corresponding to the user dry voice audio.

[0134] The lyrics information may include the start time and end time of each lyric sentence.

[0135] In implementation, when performing fundamental frequency detection, the user's dry voice audio and the preset unit duration can be used as input to execute the fundamental frequency detection algorithm. The unit duration is related to the detection accuracy and can be set manually, such as 5 milliseconds. It can be considered that the total duration of the user's dry voice audio is divided into multiple unit duration periods. The fundamental frequency corresponding to each period can be obtained through the fundamental frequency detection algorithm. These fundamental frequencies are arranged in sequence to form a sequence, which is the initial fundamental frequency sequence. In addition, the lyrics information of the target song can be obtained, the start time and end time of each lyric sentence can be obtained, the singing period of each lyric sentence can be obtained, the union of the singing period of each lyric sentence can be determined, and the vocal singing period of the target song can be obtained. The vocal singing period can be a single continuous period or a combination of multiple incoherent periods. Then, in the initial fundamental frequency sequence, the fundamental frequency of the corresponding period in the vocal singing period can be selected, and the arrangement can be kept in chronological order to obtain a new sequence, which is the first fundamental frequency sequence corresponding to the user's dry voice audio.

[0136] When determining the vocal singing period, other methods may also be used, such as identifying the vocal audio frames in the original dry voice audio, and determining the period composed of all the vocal audio frames as the vocal singing period.

[0137] For the original dry voice audio, the same method as above can also be used to determine the second fundamental frequency sequence. Alternatively, when extracting the fundamental frequency sequence, the fundamental frequency with a value of 0 can be directly removed to obtain the second fundamental frequency sequence.

[0138] 103. Determine a first median and a first mean of the first fundamental frequency sequence, and a second median and a second mean of the second fundamental frequency sequence.

[0139] 104. Determine the range matching information of the user's dry voice audio relative to the original singer's dry voice audio according to the first median, the second median, the first mean, and the second mean.

[0140] In implementation, a first difference between the first median and the second median, and a second difference between the first mean and the second mean are determined, and an absolute value of the difference between the first difference and the second difference is determined. According to at least one difference between the first difference and the second difference, and the absolute value of the difference, the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined. The first median is denoted as M1, the first mean is denoted as A1, the second median base is M2, the second mean is denoted as A2, and the first difference is denoted as D M , the second difference is recorded as D A , the absolute value of the difference is recorded as D, and the following calculation formula can be obtained.

[0141] D M =M1-M2, DA =A1-A2, D=|D M -D A |

[0142] The range matching information can be further determined in the following ways, which are divided into four cases:

[0143] In case one, if the absolute value of the difference is greater than or equal to the first threshold, the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined to be the first result value.

[0144] Case 2: If the absolute value of the difference is less than the first threshold, and the first difference is greater than or equal to the second threshold and is not 12 semitones, then the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined to be the second result value.

[0145] Case three, if the absolute value of the difference is less than the first threshold, and the first difference is 12 semitones, then the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined to be the third result value.

[0146] Case four, if the absolute value of the difference is less than the first threshold, and the first difference is less than the second threshold, then the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined to be the fourth result value.

[0147] The first result value, the second result value, the third result value and the fourth result value may be different scores, such as 4, 6, 8, 10, or different grading systems or different description information, etc. The second threshold is less than 12 semitones, such as 1 semitone or 2 semitones, etc.

[0148] When D is greater than or equal to a certain threshold (i.e., the first threshold), such as two semitones, the user's dry voice audio is likely to have inconsistent octaves, that is, the user's dry voice audio and the original singer's dry voice audio differ in the number of semitones at different positions. Figure 2 In the verse part, the user's pitch is an octave higher than the original singer, and in the chorus part, the user's pitch matches the original singer. In this case, when the user reaches the chorus and cannot sing any further, he lowers the pitch by an octave and continues singing.

[0149] When D is less than the first threshold, it means that the user's dry audio is unlikely to have the above-mentioned problem. M If it is equal to 12, it means that the range of the user's dry voice audio and the original singer's dry voice audio is an octave deviation, which means that the user raised or lowered the octave of singing. Figure 3 If D M If the value is less than the second threshold, it means that the user's singing range is relatively accurate and basically consistent with the original singer. Figure 4 If D MIf the value is greater than or equal to the second threshold and not equal to 12, it means that the range deviation between the user's dry voice audio and the original singer's dry voice audio is not an octave, which may be due to the user using the up / down function, such as Figure 5 shown.

[0150] 105, displaying the range matching information.

[0151] The range matching information can be displayed in the completion interface. After the user saves or uploads the work, the range matching information can be stored. When the user clicks the option of the work in the work column, the work interface will be entered, in which the audio matching information can be displayed.

[0152] The present application embodiment provides a method for evaluating the performance of a user in different voice zones, such as Figure 6 As shown, the following steps may be included:

[0153] 601. Determine, according to a first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence, and obtain a first corresponding relationship between the base frequency and the cumulative duration.

[0154] 602. Determine, according to the second base frequency sequence, a cumulative duration corresponding to each base frequency in the second base frequency sequence, and obtain a second corresponding relationship between the base frequency and the cumulative duration.

[0155] Among them, the first corresponding relationship, the second corresponding relationship, and each corresponding relationship mentioned in the following content can be a plurality of key-value pairs of base frequency-cumulative duration, or can also be a curve of base frequency-cumulative duration. This embodiment takes the curve of base frequency-cumulative duration as an example to explain the scheme in detail, and other situations are similar and will not be repeated.

[0156] In implementation, the number of occurrences of each base frequency in the first base frequency sequence and the second base frequency sequence can be counted respectively, and the cumulative duration of each base frequency can be obtained by multiplying the number of occurrences by the above-mentioned unit duration. The calculation formula can be: T 1i =K 1i *t,T 2i =K 2i *t. Among them, K 1i is the number of occurrences of the fundamental frequency numbered i in the first fundamental frequency sequence, K 2i is the number of occurrences of the fundamental frequency numbered i in the second fundamental frequency sequence, T 1i is the cumulative duration of the fundamental frequency numbered i in the first corresponding relationship, T 2i is the cumulative duration corresponding to the fundamental frequency numbered i in the second corresponding relationship, and t is the unit duration. The fundamental frequency number here does not represent the magnitude of the fundamental frequency value. The obtained fundamental frequency-cumulative duration curve can be shown as Figure 7 shown.

[0157] Optionally, fundamental frequencies with too short cumulative durations may be removed, and accordingly, the processing of step 601 may be as follows: according to the first fundamental frequency sequence, the cumulative duration corresponding to each fundamental frequency in the first fundamental frequency sequence is determined; among the cumulative durations corresponding to each fundamental frequency in the first fundamental frequency sequence, a first corresponding relationship between the fundamental frequency and the cumulative duration is established according to the cumulative duration greater than the duration threshold and the corresponding fundamental frequency.

[0158] In implementation, after calculating the cumulative duration corresponding to each fundamental frequency based on the first fundamental frequency sequence, if there is a fundamental frequency corresponding to a cumulative duration that is less than the duration threshold, the fundamental frequency and the corresponding cumulative duration can be deleted, and based on deleting the remaining fundamental frequencies and cumulative durations, a first corresponding relationship between the fundamental frequencies and the cumulative durations is established. Because when an error occurs in the fundamental frequency detection algorithm, the cumulative duration corresponding to the wrong fundamental frequency will be very short, so this processing can remove the wrong fundamental frequency and improve the accuracy of subsequent processing.

[0159] Optionally, for the above-mentioned cases of octave deviation and non-octave deviation, the fundamental frequency-cumulative duration curve of the original singer's dry voice audio can be shifted to the fundamental frequency-cumulative duration curve of the user's dry voice audio to make it more comparable. The corresponding processing of step 602 can be as follows: according to the second fundamental frequency sequence, determine the cumulative duration corresponding to each fundamental frequency in the second fundamental frequency sequence to obtain an initial correspondence between the fundamental frequency and the cumulative duration; increase the first difference value to each fundamental frequency in the initial correspondence to obtain a second correspondence between the fundamental frequency and the cumulative duration.

[0160] In implementation, first, after the above processing, the cumulative duration corresponding to each fundamental frequency is calculated based on the second fundamental frequency sequence to obtain an initial curve of fundamental frequency-cumulative duration. In addition, the cumulative duration corresponding to each fundamental frequency is calculated based on the first fundamental frequency sequence to obtain a first curve of fundamental frequency-cumulative duration. The position relationship diagram of the first curve and the initial curve can be shown as follows: Figure 8 Then, the first difference is added to each fundamental frequency in the initial curve, that is, the initial curve is translated, and the translation distance is the first difference, to obtain a second curve of fundamental frequency-accumulated duration. The position relationship diagram of the second curve and the first curve can be shown as Fig. 9 shown.

[0161] It should be noted that there is no necessary order in which steps 601 and 602 are executed.

[0162] 603, determine the bass range, middle range and treble range.

[0163] In an embodiment, the three sound zones may be pre-set, or the sound zones may be divided based on the second corresponding relationship. The process of dividing the sound zones based on the second corresponding relationship may be as follows: according to the second corresponding relationship between the fundamental frequency and the cumulative duration, the bass zone, the middle zone and the treble zone are determined, and the sum of the cumulative durations of the fundamental frequencies in the bass zone, the sum of the cumulative durations of the fundamental frequencies in the middle zone, and the sum of the cumulative durations of the fundamental frequencies in the treble zone are equal.

[0164] Among them, the bass area is adjacent to the middle area, and the middle area is adjacent to the treble area.

[0165] In implementation, the accumulated duration corresponding to each fundamental frequency in the second corresponding relationship may be normalized first, and the calculation formula may be: 2i '=T 2i / ∑T 2i ,T 2i ' is the normalized cumulative duration in the second corresponding relationship. In this way, the area under the normalized fundamental frequency-cumulative duration curve can be considered to be 1, and then two vertical lines L1 and L2 are calculated to divide the area under the curve into three equal parts. L1 is the dividing line between the bass area and the middle area, and L2 is the dividing line between the middle area and the high area. Fig.10 shown.

[0166] The above-mentioned process of dividing the sound zones can be performed by the server when the terminal downloads the accompaniment audio, or it can be performed in advance by the server to determine the second corresponding relationship between the fundamental frequency corresponding to the original singer's dry voice audio and the cumulative duration, and the sound zones are divided based on the second corresponding relationship to determine the bass zone, the middle zone and the treble zone, and the way of dividing the sound zones is sent to the terminal when the user downloads the accompaniment audio.

[0167] 604 , determining the difference between the first corresponding relationship and the second corresponding relationship in the bass range, the middle range, and the treble range, respectively.

[0168] 605. Determine the bass range matching information according to the difference between the first correspondence and the second correspondence in the bass range, determine the mid-range matching information according to the difference between the first correspondence and the second correspondence in the mid-range, and determine the treble matching information according to the difference between the first correspondence and the second correspondence in the treble.

[0169] Among them, the bass range matching information, the middle range matching information and the treble range matching information are used to identify the user's singing performance ability in different ranges, which can be scores, ratings or description information, etc.

[0170] In implementation, the accumulated duration corresponding to each fundamental frequency in the first corresponding relationship may be normalized, and the calculation formula may be T 1i '=T 1i / ∑T 1i , where T1i ' is the normalized cumulative duration in the first corresponding relationship. For the normalized fundamental frequency-cumulative duration curve, the area under the curve in the bass range is calculated as the weighting coefficient w1 of the bass range, the area under the curve in the middle range is calculated as the weighting coefficient w2 of the middle range, and the area under the curve in the treble range is calculated as the weighting coefficient w3 of the treble range.

[0171] Then, the difference between the normalized fundamental frequency-cumulative duration curve of the user and the normalized fundamental frequency-cumulative duration curve of the original singer can be calculated in the bass range, the middle range, and the treble range, respectively. The difference can be determined based on the Euclidean distance, and the calculation formula can be as follows:

[0172]

[0173]

[0174]

[0175] Among them, d1 is the difference corresponding to the bass area, d2 is the difference corresponding to the middle area, d3 is the difference corresponding to the treble area, min is the number corresponding to the fundamental frequency with the lowest pitch, max is the number corresponding to the fundamental frequency with the highest pitch, a is the number of the fundamental frequency corresponding to L1, and b is the number of the fundamental frequency corresponding to L2.

[0176] The bass range matching information, the middle range matching information, and the treble range matching information may be determined based on the following formula.

[0177] S1=λ*ω1*(1-d1 / dmax)

[0178] S2=λ*w2*(1-d2 / dmax)

[0179] S3=λ*w3*(1-d3 / dmax)

[0180] Among them, S1 is the bass matching information, S2 is the middle matching information, S3 is the treble matching information, λ is the preset full score value, and dmax is the maximum value among d1, d2, and d3.

[0181] 606, displaying bass range matching information, middle range matching information and treble range matching information.

[0182] The bass matching information, the middle range matching information, and the high range matching information may be displayed in the completion interface. After the user saves or uploads the work, the bass matching information, the middle range matching information, and the high range matching information may be stored. When the user clicks on the option of the work in the work column, the work interface will be entered, in which the bass matching information, the middle range matching information, and the high range matching information may be displayed.

[0183] Optionally, evaluation information corresponding to different bass area matching information, middle area matching information and treble area matching information may be pre-stored. For example, the evaluation information corresponding to the value range of the bass area matching information below the preset threshold is "Keep up the bass!", and for another example, the evaluation information corresponding to the value range of the treble area matching information above the preset threshold is "Perfect treble!". After determining the bass area matching information, the middle area matching information and the treble area matching information, the corresponding evaluation information may be determined based on one or more of them and displayed. The specific display method may be that when displaying the bass area matching information, the middle area matching information and the treble area matching information, the corresponding detail options may be displayed, and the user clicking the detail option may trigger the display of the user's normalized fundamental frequency-cumulative duration curve and the original singer's normalized fundamental frequency-cumulative duration curve, and display the division of the bass area, middle area and treble area, and display the evaluation information in the corresponding sound area, such as Fig.11 shown.

[0184] The embodiment of the present application provides a method for comprehensively evaluating the user's vocal range performance and performance in different vocal ranges in combination with the difficulty of the song, such as Fig.12 As shown, the following steps may be included:

[0185] 1201, obtain the adjustment coefficient corresponding to the original singer's dry voice audio.

[0186] Among them, the adjustment coefficient is positively correlated with the fundamental frequency span value corresponding to the original singer's dry voice audio, and the adjustment coefficient is greater than 1.

[0187] In implementation, the server can pre-store the adjustment coefficient of each song, and the adjustment coefficient corresponding to the original singer's dry voice audio is the adjustment coefficient of the target song to which the original singer's dry voice audio belongs. The fundamental frequency span value of the original singer's dry voice audio determines the size of the adjustment coefficient. The fundamental frequency span value is the difference between the maximum fundamental frequency and the minimum fundamental frequency of the original singer's dry voice audio. The larger the fundamental frequency span value, the greater the difficulty of singing the corresponding song. When the user sings the target song, the server can obtain the adjustment coefficient of the target song and send it to the terminal.

[0188] Alternatively, the server can pre-store adjustment coefficients corresponding to different fundamental frequency span values. When the user sings a target song, the server can determine the fundamental frequency span value of the original dry voice audio of the target song, find the adjustment coefficient corresponding to the fundamental frequency span value, and send it to the terminal.

[0189] 1202, determine the product of the sum of the bass range matching information, the middle range matching information, and the treble range matching information and the adjustment coefficient to obtain the total range matching information.

[0190] 1203, determine the sum of the total zone matching information and the range matching information to obtain comprehensive matching information.

[0191] The calculation formula of comprehensive matching information can be as follows:

[0192] S=S0+(S1+S2+S3)*α

[0193] Among them, S is the comprehensive matching information, S0 is the range matching information, and α is the adjustment coefficient.

[0194] 1204, display comprehensive matching information.

[0195] The comprehensive matching information can be displayed in the completion interface. After the user saves or uploads the work, the comprehensive matching information can be stored. When the user clicks the option of the work in the work column, the work interface will be entered, in which the comprehensive matching information can be displayed. The display format of the comprehensive matching information, the range matching information, the bass matching information, the middle matching information, and the treble matching information can be as follows: Fig.13 As shown, the range matching information (i.e., the octave uniformity score in the figure), the bass matching information (i.e., the bass score in the figure), the middle range matching information (i.e., the middle range score in the figure), and the high range matching information (i.e., the high range score in the figure) correspond to a vertex of the square respectively. For any of these four items, the lower the corresponding score, the closer the corresponding vertex is to the center of the circle, and the higher the corresponding score, the farther the corresponding vertex is from the center of the circle and closer to the circumference. The comprehensive matching information (i.e., the range score in the figure) is displayed at the center of the circle. The difficulty coefficient in the figure is the above-mentioned adjustment coefficient.

[0196] The present application also provides a method for recommending songs to users. Fig.14 As shown, the process includes the following steps. This process flow is described by taking the execution subject as a server as an example.

[0197] 1401. Determine, according to a first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence, and obtain a first corresponding relationship between the base frequency and the cumulative duration.

[0198] In practice, the processing of this step is the same as step 601, and the corresponding description above can be referred to. The processing flow of the server is similar to that of the terminal, and will not be repeated here.

[0199] 1402. Determine a target account to which the user's dry audio belongs.

[0200] In implementation, the server may determine the target account that the terminal is currently logged into.

[0201] 1403. According to the first correspondence between the fundamental frequency corresponding to the dry voice audio of all users of the target account and the cumulative duration, the cumulative duration of each fundamental frequency is accumulated to obtain a third correspondence between the fundamental frequency corresponding to the target account and the total cumulative duration.

[0202] In implementation, when a user logs in to his or her account to sing karaoke, the server can store the user's dry voice audio of the karaoke, so that the server stores one or more user dry voice audios for each account that has performed karaoke. For each user's dry voice audio of karaoke, the server can determine the first corresponding relationship between the fundamental frequency corresponding to the user's dry voice audio and the accumulated duration according to the method above in this embodiment, and store it.

[0203] The server may obtain all first correspondences stored under the target account, and then add up multiple accumulated durations corresponding to the same base frequency in these first correspondences to obtain a total accumulated duration corresponding to each base frequency, that is, a third correspondence.

[0204] 1404. Determine, among the second correspondences between the fundamental frequencies and the accumulated durations corresponding to the plurality of original singer's dry voice audios, a second correspondence that satisfies a similar condition to the third correspondence.

[0205] In implementation, the server can extract the original singer's dry voice audio from a large number of songs in the audio library, and then determine the second corresponding relationship between the fundamental frequency and the cumulative duration corresponding to the original singer's dry voice audio based on the method above in this embodiment.

[0206] 1405, determine the target original singer's dry voice audio belonging to the second corresponding relationship that meets the similarity condition with the third corresponding relationship, and send a singing recommendation message corresponding to the target original singer's dry voice audio to the target account.

[0207] In implementation, the server normalizes the cumulative duration in the third correspondence to obtain the normalized third correspondence, and normalizes the cumulative duration in the second correspondence of the songs in the audio library to obtain the normalized second correspondence. Calculate the similarity between all normalized second correspondences and the normalized third correspondence. Determine the target original singer's dry voice audio to which the N second correspondences with the greatest similarity belong, where N is a preset natural number, such as 1. Or determine the target original singer's dry voice audio to which the second correspondence with a similarity greater than a preset threshold belongs. Then determine the song information of the song to which the target original singer's dry voice audio belongs, such as the song name, singer name, album name, etc. Send a singing recommendation message carrying the song information of one or more songs to the terminal currently logged in by the target account.

[0208] When the terminal receives the singing recommendation message, it can display a recommendation window, in which the corresponding song options and corresponding song information are displayed. When the user clicks on one of the song options, the terminal will be triggered to perform the karaoke processing of the song. A cancel option can also be displayed in the recommendation window, and the user can close the recommendation window by clicking the cancel option without performing the corresponding karaoke.

[0209] In an embodiment of the present application, a first median and a first mean of a first fundamental frequency sequence of the user's dry voice audio are determined, and a second median and a second mean of a second fundamental frequency sequence of the original singer's dry voice audio are determined, and based on a comparison of the mean and the median, the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined. In this way, even if there is an octave deviation of individual fundamental frequencies in the process of extracting the fundamental frequency sequence, the impact on the mean and the median is very small, and the determined range matching information is less affected by the octave deviation of individual fundamental frequencies in the fundamental frequency sequence, thereby improving the effectiveness of the determined range matching information.

[0210] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, and will not be described in detail here.

[0211] The present application also provides a device for displaying range matching information, such as Fig.15 As shown, the device comprises:

[0212] The first acquisition module 1501 is used to acquire the user's dry voice audio and the corresponding original singer's dry voice audio;

[0213] The second acquisition module 1502 is used to acquire a first fundamental frequency sequence corresponding to the user dry voice audio, and acquire a second fundamental frequency sequence corresponding to the original singer dry voice audio;

[0214] A first determining module 1503 is configured to determine a first median and a first mean of the first base frequency sequence, and a second median and a second mean of the second base frequency sequence;

[0215] A second determination module 1504 is used to determine the range matching information of the user dry voice audio relative to the original singer dry voice audio according to the first median, the second median, the first mean and the second mean;

[0216] The display module 1505 is used to display the range matching information.

[0217] In a possible implementation, the second obtaining module 1502 is configured to:

[0218] Based on a preset unit time length, extract the fundamental frequency corresponding to each unit time length period in the user dry audio to obtain an initial fundamental frequency sequence;

[0219] Determine the vocal singing time period according to the lyrics information corresponding to the user's dry voice audio;

[0220] The fundamental frequency sequence segment corresponding to the vocal singing period is obtained in the initial fundamental frequency sequence to obtain a first fundamental frequency sequence corresponding to the user dry voice audio.

[0221] In a possible implementation, the second determining module 1504 is configured to:

[0222] determining a first difference between the first median and the second median, and a second difference between the first mean and the second mean;

[0223] determining an absolute value of a difference between the first difference and the second difference;

[0224] According to at least one difference between the first difference and the second difference, and the absolute value of the difference, the range matching information of the user dry voice audio relative to the original singer's dry voice audio is determined.

[0225] In a possible implementation, the second determining module 1504 is configured to:

[0226] If the absolute value of the difference is greater than or equal to a first threshold, determining that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a first result value; and / or

[0227] If the absolute value of the difference is less than a first threshold, and the first difference is greater than or equal to a second threshold and is not 12 semitones, then the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined to be a second result value, wherein the second threshold is less than 12 semitones; and / or

[0228] If the absolute value of the difference is less than a first threshold value, and the first difference is 12 semitones, determining that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a third result value; and / or

[0229] If the absolute value of the difference is less than the first threshold, and the first difference is less than the second threshold, it is determined that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a fourth result value.

[0230] In a possible implementation manner, the apparatus further includes a third determining module, configured to:

[0231] Determine, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence, and obtain a first corresponding relationship between the base frequency and the cumulative duration; determine, according to the second base frequency sequence, a cumulative duration corresponding to each base frequency in the second base frequency sequence, and obtain a second corresponding relationship between the base frequency and the cumulative duration;

[0232] Determine the difference between the first corresponding relationship and the second corresponding relationship in the bass range, the middle range, and the treble range respectively;

[0233] Determine bass range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the bass range, determine mid-range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the mid-range, and determine treble range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the treble range;

[0234] The display module 1505 is also used for:

[0235] The bass range matching information, the middle range matching information and the treble range matching information are displayed.

[0236] In a possible implementation manner, the third determining module is further configured to:

[0237] Before determining the difference between the first correspondence and the second correspondence in the bass range, middle range, and treble range respectively, the bass range, middle range, and treble range are determined according to the second correspondence between the fundamental frequency and the cumulative duration, wherein the bass range is adjacent to the middle range, the middle range is adjacent to the treble range, and the sum of the cumulative durations of the fundamental frequencies in the bass range, the sum of the cumulative durations of the fundamental frequencies in the middle range, and the sum of the cumulative durations of the fundamental frequencies in the treble range are equal.

[0238] In a possible implementation manner, the third determining module is configured to:

[0239] Determine, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence;

[0240] In the accumulated duration corresponding to each fundamental frequency in the first fundamental frequency sequence, a first corresponding relationship between the fundamental frequency and the accumulated duration is established according to the accumulated duration greater than the duration threshold and the corresponding fundamental frequency.

[0241] In a possible implementation manner, the third determining module is configured to:

[0242] Determine, according to the second fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the second fundamental frequency sequence, and obtain an initial corresponding relationship between the fundamental frequency and the cumulative duration;

[0243] The first difference is added to each fundamental frequency in the initial corresponding relationship to obtain a second corresponding relationship between the fundamental frequency and the accumulated duration.

[0244] In a possible implementation manner, the third determining module is further configured to:

[0245] Obtaining an adjustment coefficient corresponding to the original singer's dry voice audio, wherein the adjustment coefficient is positively correlated with the fundamental frequency span value corresponding to the original singer's dry voice audio, and the adjustment coefficient is greater than 1;

[0246] Determine the product of the sum of the bass range matching information, the middle range matching information, and the treble range matching information and the adjustment coefficient to obtain total range matching information;

[0247] Determine the sum of the total matching information of the vocal range and the matching information of the vocal range to obtain comprehensive matching information;

[0248] The display module 1505 is also used

[0249] The comprehensive matching information is displayed.

[0250] In a possible implementation manner, the device further includes a recommendation module, which is used to:

[0251] Determine, according to the first fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the first fundamental frequency sequence, and obtain a first corresponding relationship between the fundamental frequency and the cumulative duration;

[0252] Determine the target account to which the user's dry voice audio belongs;

[0253] According to the first correspondence between the fundamental frequency and the accumulated duration corresponding to the dry voice audio of all users of the target account, the accumulated duration of each fundamental frequency is accumulated to obtain a third correspondence between the fundamental frequency and the total accumulated duration corresponding to the target account;

[0254] In the second correspondence between the fundamental frequencies and the accumulated durations corresponding to the multiple original singer dry voice audios, determine a second correspondence that satisfies a similar condition to the third correspondence;

[0255] Determine the target original singer's dry voice audio belonging to the second corresponding relationship that meets the similarity condition with the third corresponding relationship, and send a singing recommendation message corresponding to the target original singer's dry voice audio to the target account.

[0256] In an embodiment of the present application, a first median and a first mean of a first fundamental frequency sequence of the user's dry voice audio are determined, and a second median and a second mean of a second fundamental frequency sequence of the original singer's dry voice audio are determined, and based on a comparison of the mean and the median, the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined. In this way, even if there is an octave deviation of individual fundamental frequencies in the process of extracting the fundamental frequency sequence, the impact on the mean and the median is very small, and the determined range matching information is less affected by the octave deviation of individual fundamental frequencies in the fundamental frequency sequence, thereby improving the effectiveness of the determined range matching information.

[0257] It should be noted that: the device for displaying the range matching information provided in the above embodiment only uses the division of the above functional modules as an example when displaying the range matching information. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device for displaying the range matching information provided in the above embodiment and the method embodiment for displaying the range matching information belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0258] Fig.16 The block diagram of the structure of an electronic device 1600 provided by an exemplary embodiment of the present application is shown. The electronic device 1600 may be a portable mobile terminal, such as a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The electronic device 1600 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0259] Typically, the electronic device 1600 includes a processor 1601 and a memory 1602 .

[0260] The processor 1601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU; the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1601 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0261] The memory 1602 may include one or more computer-readable storage media, which may be non-transitory. The memory 1602 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1602 is used to store at least one instruction, which is used to be executed by the processor 1601 to implement the method for displaying the range matching information provided in the method embodiment of the present application.

[0262] In some embodiments, the electronic device 1600 may further optionally include: a peripheral device interface 1603 and at least one peripheral device. The processor 1601, the memory 1602 and the peripheral device interface 1603 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1603 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1604, a display screen 1605, a camera assembly 1606, an audio circuit 1607, a positioning assembly 1608 and a power supply 1609.

[0263] The peripheral device interface 1603 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1601 and the memory 1602. In some embodiments, the processor 1601, the memory 1602, and the peripheral device interface 1603 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1601, the memory 1602, and the peripheral device interface 1603 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0264] The radio frequency circuit 1604 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1604 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1604 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1604 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 1604 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi network. In some embodiments, the radio frequency circuit 1604 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0265] Display screen 1605 is used to display UI (User Interface). The UI may include graphics, text, icons, videos and any combination thereof. When display screen 1605 is a touch display screen, display screen 1605 also has the ability to collect touch signals on the surface or above the surface of display screen 1605. The touch signal can be input to processor 1601 as a control signal for processing. At this time, display screen 1605 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, display screen 1605 can be one, set on the front panel of electronic device 1600; in other embodiments, display screen 1605 can be at least two, respectively set on different surfaces of electronic device 1600 or in a folding design; in other embodiments, display screen 1605 can be a flexible display screen, set on a curved surface or a folding surface of electronic device 1600. Even, display screen 1605 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1605 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0266] The camera assembly 1606 is used to capture images or videos. Optionally, the camera assembly 1606 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1606 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0267] The audio circuit 1607 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1601 for processing, or input them into the radio frequency circuit 1604 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the electronic device 1600. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1601 or the radio frequency circuit 1604 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1607 may also include a headphone jack.

[0268] The positioning component 1608 is used to locate the current geographic location of the electronic device 1600 to implement navigation or LBS (Location Based Service). The positioning component 1608 can be a positioning component based on the US GPS (Global Positioning System), China's Beidou system or Russia's Galileo system.

[0269] The power supply 1609 is used to power various components in the electronic device 1600. The power supply 1609 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1609 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0270] In some embodiments, the electronic device 1600 further includes one or more sensors 1610 , including but not limited to: an acceleration sensor 1611 , a gyroscope sensor 1612 , a pressure sensor 1616 , a fingerprint sensor 1614 , an optical sensor 1615 , and a proximity sensor 1616 .

[0271] The acceleration sensor 1611 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the electronic device 1600. For example, the acceleration sensor 1611 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 1601 can control the display screen 1605 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 1611. The acceleration sensor 1611 can also be used for collecting game or user motion data.

[0272] The gyro sensor 1612 can detect the body direction and rotation angle of the electronic device 1600, and the gyro sensor 1612 can cooperate with the acceleration sensor 1611 to collect the user's 3D actions on the electronic device 1600. The processor 1601 can implement the following functions based on the data collected by the gyro sensor 1612: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0273] The pressure sensor 1613 can be set on the side frame of the electronic device 1600 and / or the lower layer of the display screen 1605. When the pressure sensor 1613 is set on the side frame of the electronic device 1600, it can detect the user's holding signal of the electronic device 1600, and the processor 1601 performs left and right hand recognition or shortcut operations according to the holding signal collected by the pressure sensor 1613. When the pressure sensor 1613 is set on the lower layer of the display screen 1605, the processor 1601 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 1605. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0274] The fingerprint sensor 1614 is used to collect the user's fingerprint, and the processor 1601 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 1614, or the fingerprint sensor 1614 identifies the user's identity based on the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 1601 authorizes the user to perform relevant sensitive operations, which include unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 1614 can be set on the front, back, or side of the electronic device 1600. When a physical button or a manufacturer logo is set on the electronic device 1600, the fingerprint sensor 1614 can be integrated with the physical button or the manufacturer logo.

[0275] The optical sensor 1615 is used to collect the ambient light intensity. In one embodiment, the processor 1601 can control the display brightness of the display screen 1605 according to the ambient light intensity collected by the optical sensor 1615. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1605 is increased; when the ambient light intensity is low, the display brightness of the display screen 1605 is reduced. In another embodiment, the processor 1601 can also dynamically adjust the shooting parameters of the camera component 1606 according to the ambient light intensity collected by the optical sensor 1615.

[0276] The proximity sensor 1616, also called a distance sensor, is usually disposed on the front panel of the electronic device 1600. The proximity sensor 1616 is used to collect the distance between the user and the front of the electronic device 1600. In one embodiment, when the proximity sensor 1616 detects that the distance between the user and the front of the electronic device 1600 is gradually decreasing, the processor 1601 controls the display screen 1605 to switch from the screen-on state to the screen-off state; when the proximity sensor 1616 detects that the distance between the user and the front of the electronic device 1600 is gradually increasing, the processor 1601 controls the display screen 1605 to switch from the screen-off state to the screen-on state.

[0277] Those skilled in the art will understand that Fig.16 The structure shown in the figure does not constitute a limitation on the electronic device 1600, and may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0278] Fig.171 is a schematic diagram of the structure of a server provided in an embodiment of the present application. The server 1700 may have relatively large differences due to different configurations or performances, and may include one or more processors (central processing units, CPU) 1701 and one or more memories 1702, wherein the memory 1702 stores at least one instruction, and the at least one instruction is loaded and executed by the processor 1701 to implement the methods provided in the above-mentioned various method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output, and the server may also include other components for implementing device functions, which will not be described in detail here.

[0279] In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory including instructions, and the instructions can be executed by a processor in a terminal to complete the method of displaying the range matching information in the above embodiment. The computer-readable storage medium can be non-transitory. For example, the computer-readable storage medium can be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0280] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0281] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A method for displaying range matching information, characterized in that: The method comprises: Obtain the user's dry voice audio and the corresponding original singer's dry voice audio; Obtain a first fundamental frequency sequence corresponding to the user dry voice audio, and obtain a second fundamental frequency sequence corresponding to the original singer dry voice audio; Determine a first median and a first mean of the first fundamental frequency sequence, and a second median and a second mean of the second fundamental frequency sequence; determining a first difference between the first median and the second median, and a second difference between the first mean and the second mean; determining an absolute value of a difference between the first difference and the second difference; Determine, according to at least one of the first difference and the second difference, and the absolute value of the difference, the range matching information of the user dry voice audio relative to the original singer dry voice audio; The vocal range matching information is displayed, where the vocal range matching information is used to indicate whether the user's vocal range expression is consistent with the corresponding song.

2. The method according to claim 1, characterized in that The obtaining of a first fundamental frequency sequence corresponding to the user dry audio includes: Based on a preset unit time length, extract the fundamental frequency corresponding to each unit time length period in the user dry audio to obtain an initial fundamental frequency sequence; Determine the vocal singing time period according to the lyrics information corresponding to the user's dry voice audio; The fundamental frequency sequence segment corresponding to the vocal singing period is obtained in the initial fundamental frequency sequence to obtain a first fundamental frequency sequence corresponding to the user dry voice audio.

3. The method according to claim 1, characterized in that The determining, according to at least one difference between the first difference and the second difference and the absolute value of the difference, the range matching information of the user dry voice audio relative to the original singer dry voice audio includes: If the absolute value of the difference is greater than or equal to a first threshold, determining that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a first result value; and / or If the absolute value of the difference is less than a first threshold, and the first difference is greater than or equal to a second threshold and is not 12 semitones, then the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is determined to be a second result value, wherein the second threshold is less than 12 semitones; and / or If the absolute value of the difference is less than a first threshold value, and the first difference is 12 semitones, determining that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a third result value; and / or If the absolute value of the difference is less than the first threshold, and the first difference is less than the second threshold, it is determined that the range matching information of the user's dry voice audio relative to the original singer's dry voice audio is a fourth result value.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: Determine, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence, and obtain a first corresponding relationship between the base frequency and the cumulative duration; determine, according to the second base frequency sequence, a cumulative duration corresponding to each base frequency in the second base frequency sequence, and obtain a second corresponding relationship between the base frequency and the cumulative duration; Determine the difference between the first corresponding relationship and the second corresponding relationship in the bass range, the middle range, and the treble range respectively; Determine bass range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the bass range, determine mid-range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the mid-range, and determine treble range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the treble range; The bass range matching information, the middle range matching information and the treble range matching information are displayed.

5. The method according to claim 4, characterized in that Before determining the difference between the first corresponding relationship and the second corresponding relationship in the bass range, the middle range, and the treble range, the method further includes: According to the second corresponding relationship between the fundamental frequency and the cumulative duration, the bass range, the middle range and the treble range are determined, wherein the bass range is adjacent to the middle range, the middle range is adjacent to the treble range, and the sum of the cumulative durations of the fundamental frequencies in the bass range, the sum of the cumulative durations of the fundamental frequencies in the middle range, and the sum of the cumulative durations of the fundamental frequencies in the treble range are equal.

6. The method according to claim 4, characterized in that The step of determining, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence, and obtaining a first corresponding relationship between the base frequency and the cumulative duration includes: Determine, according to the first base frequency sequence, a cumulative duration corresponding to each base frequency in the first base frequency sequence; In the accumulated duration corresponding to each fundamental frequency in the first fundamental frequency sequence, a first corresponding relationship between the fundamental frequency and the accumulated duration is established according to the accumulated duration greater than the duration threshold and the corresponding fundamental frequency.

7. The method according to claim 4, characterized in that The step of determining, according to the second base frequency sequence, a cumulative duration corresponding to each base frequency in the second base frequency sequence, and obtaining a second corresponding relationship between the base frequency and the cumulative duration includes: Determine, according to the second fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the second fundamental frequency sequence, and obtain an initial corresponding relationship between the fundamental frequency and the cumulative duration; The first difference is added to each fundamental frequency in the initial corresponding relationship to obtain a second corresponding relationship between the fundamental frequency and the accumulated duration.

8. The method according to claim 4, characterized in that After determining the bass range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the bass range, determining the mid-range matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the mid-range, and determining the treble matching information according to the difference between the first corresponding relationship and the second corresponding relationship in the treble range, the method further includes: Obtaining an adjustment coefficient corresponding to the original singer's dry voice audio, wherein the adjustment coefficient is positively correlated with the fundamental frequency span value corresponding to the original singer's dry voice audio, and the adjustment coefficient is greater than 1; Determine the product of the sum of the bass range matching information, the middle range matching information, and the treble range matching information and the adjustment coefficient to obtain total range matching information; Determine the sum of the total matching information of the vocal range and the matching information of the vocal range to obtain comprehensive matching information; The comprehensive matching information is displayed.

9. The method according to claim 1, characterized in that: The method further comprises: Determine, according to the first fundamental frequency sequence, a cumulative duration corresponding to each fundamental frequency in the first fundamental frequency sequence, and obtain a first corresponding relationship between the fundamental frequency and the cumulative duration; Determine the target account to which the user's dry voice audio belongs; According to the first correspondence between the fundamental frequency and the accumulated duration corresponding to the dry voice audio of all users of the target account, the accumulated duration of each fundamental frequency is accumulated to obtain a third correspondence between the fundamental frequency and the total accumulated duration corresponding to the target account; In the second correspondence between the fundamental frequencies and the accumulated durations corresponding to the multiple original singer dry voice audios, determine a second correspondence that satisfies a similar condition to the third correspondence; Determine the target original singer's dry voice audio belonging to the second corresponding relationship that meets the similarity condition with the third corresponding relationship, and send a singing recommendation message corresponding to the target original singer's dry voice audio to the target account.

10. A device for displaying range matching information, characterized in that: The device comprises: The first acquisition module is used to acquire the user's dry voice audio and the corresponding original singer's dry voice audio; A second acquisition module is used to acquire a first fundamental frequency sequence corresponding to the user dry voice audio, and acquire a second fundamental frequency sequence corresponding to the original singer dry voice audio; A first determining module, configured to determine a first median and a first mean of the first base frequency sequence, and a second median and a second mean of the second base frequency sequence; A second determination module is used to determine a first difference between the first median and the second median, and a second difference between the first mean and the second mean; determine an absolute value of a difference between the first difference and the second difference; and determine a range matching information of the user dry voice audio relative to the original singer dry voice audio based on at least one difference between the first difference and the second difference, and the absolute value of the difference; The display module is used to display the vocal range matching information, and the vocal range matching information is used to indicate whether the user's vocal range expression is consistent with the corresponding song.

11. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the operation performed by the method for displaying vocal range matching information according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The storage medium stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the operation performed by the method for displaying the vocal range matching information according to any one of claims 1 to 9.

Images