Karaoke program, karaoke equipment, and karaoke scoring method

Abstract

The purpose is to appropriately evaluate voice-changed audio. [Solution] The system performs a playback process that plays music based on music information, a voice-changed audio acquisition process that acquires voice-changed audio information, a voice-changed audio scoring process that scores based on the voice-changed audio information, and a display process that displays a scoring index based on the voice-changed audio scoring process.

Description

Technical Field

[0001] The present invention relates to a karaoke device that allows a user to sing along with a music piece to be played, an information processing device, a karaoke program for realizing the functions of the karaoke device, and a karaoke scoring method for evaluating singing performance.

Background Art

[0002] Conventionally, karaoke, in which people enjoy singing along with accompaniment, is practiced in social settings and the like. Some karaoke devices are equipped with a function that converts the singing voice into a voice different from the singer's original voice quality.

[0003] Patent Document 1 discloses a karaoke device that converts a singer's singing voice into the singing style of the original singer and outputs the converted voice. In the karaoke device of Patent Document 1, an object that models the original singer's voice quality and singing method is stored as a singing parameter, and the singing parameter is read out during karaoke performance to convert the singing voice. With this configuration, even if the singer's singing is flat, the karaoke device of Patent Document 1 imparts singing techniques such as kobushi (vocal flourishes) and groans in accordance with the original singer's singing style, so that the singing sounds well-executed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0005] Some karaoke systems have a scoring function for evaluating singing performance. In conventional karaoke devices with a voice change function as described in Patent Document 1, the unmodified singing voice that has not undergone voice change is used for scoring, which may cause a discrepancy between the subjective evaluation of the listener who hears the voice-changed singing voice or the singer, and the calculated scoring result.

[0006] This invention takes these circumstances into consideration and aims to reduce the discrepancy between the subjective evaluation of the listener and the actual singing voice by using voice-changed singing voices for scoring, thereby improving the satisfaction of both the listener and the singer with the scoring results. [Means for solving the problem]

[0007] Therefore, the karaoke program according to the present invention is A karaoke program executable on an information processing device, A playback process that plays the music based on the music information, Voice-changed voice acquisition process to acquire voice information that has been processed with a voice changer, Voice-changing voice scoring process, which scores based on voice-changed voice information, The system executes a display process that shows scoring indicators based on voice-changing voice scoring processing.

[0008] Furthermore, in the karaoke program according to the present invention, A raw audio acquisition process that obtains audio information that has not been subjected to voice change processing, The system performs a raw voice scoring process that scores based on audio information that has not undergone voice change processing, and The display process shows scoring indicators based on voice-changed audio scoring and scoring indicators based on raw audio scoring.

[0009] Furthermore, in the karaoke program according to the present invention, A raw audio acquisition process that obtains audio information that has not been subjected to voice change processing, Raw voice scoring process that scores based on audio information that has not undergone voice change processing, The system performs a process to calculate a comprehensive score index using a scoring index based on voice-changed audio scoring and a scoring index based on raw audio scoring.

[0010] Furthermore, in the karaoke program according to the present invention, The display process shows scoring indicators based on voice-changed audio scoring, scoring indicators based on raw audio scoring, and overall scoring indicators based on overall indicator calculation.

[0011] Furthermore, the karaoke program according to the present invention is The process to obtain parameter-related information is executed to obtain parameter-related information regarding the parameters used in the voice change process. The display process shows the scoring indicators based on the voice-changing audio scoring process, along with the acquired parameter-related information.

[0012] Furthermore, the karaoke program according to the present invention is Executes a memory process to store parameter-related information.

[0013] Furthermore, the karaoke program according to the present invention is A parameter setting process that sets stored parameter-related information for the voice change process, A second voice-changed voice acquisition process acquires voice information that has been voice-changed based on the parameter-related information set in the parameter setting process, The second voice changer executes an audio output process that outputs audio based on the audio information acquired in the audio acquisition process.

[0014] Furthermore, the karaoke program according to the present invention is The system performs a voice change process to alter the voice information.

[0015] Furthermore, the karaoke program according to the present invention is This process allows you to adjust the parameters used in the voice change process.

[0016] Furthermore, the karaoke program according to the present invention is A selection process is executed to accept the selection of the voice change type. The adjustment process allows you to adjust parameters corresponding to the selected voice change type.

[0017] Further, the karaoke device according to the present invention a reproduction process for reproducing music sound based on music information; a voice-changed voice acquisition process for acquiring voice information that has been subjected to voice change processing; a voice-changed voice scoring process for scoring based on the voice information that has been subjected to voice change processing; and a display process for displaying a scoring index based on the voice-changed voice scoring process.

[0018] Further, the karaoke scoring method according to the present invention a reproduction process for reproducing music sound based on music information; a voice-changed voice acquisition process for acquiring voice information that has been subjected to voice change processing; a voice-changed voice scoring process for scoring based on the voice information that has been subjected to voice change processing; and a display process for displaying a scoring index based on the voice-changed voice scoring process. [Advantageous Effects of Invention]

[0019] According to the karaoke program, the karaoke device, and the karaoke scoring method of the present invention, it is possible to reduce the difference between the scoring result when singing with voice change processing performed and the subjective evaluation of the listener or the singer, and to improve the sense of satisfaction of the listener or the singer with the scoring result. [Brief Description of Drawings]

[0020] [Figure 1] Figure showing the system configuration of the present embodiment [Figure 2] External view of the mobile terminal of the present embodiment [Figure 3] Block diagram showing the configuration of the mobile terminal of the present embodiment [Figure 4] Diagram for explaining the configuration of the present embodiment [Figure 5] Diagram showing the voice change table of the present embodiment [Figure 6] Diagram showing various screens on the mobile terminal of the present embodiment [Figure 7] Diagram showing various screens in the mobile terminal of this embodiment. [Figure 8] Diagram showing various screens in the mobile terminal of this embodiment. [Figure 9] Diagram showing various screens in the mobile terminal of this embodiment. [Figure 10] Diagram showing various screens in the mobile terminal of this embodiment. [Figure 11] Flowchart showing the parameter adjustment process of this embodiment [Figure 12] Flowchart showing the distribution process of this embodiment [Figure 13] Figure illustrating the configuration of other embodiments. [Modes for carrying out the invention]

[0021] Figure 1 shows the system configuration of this embodiment. This embodiment is a system that enables karaoke by communicating between mobile terminals 6. Figure 1 shows various examples of communication configurations between mobile terminals 6. For example, in a private home, a router 12a connected to the internet is provided, and a wireless router 12b is connected to the router 12a. Mobile terminals 6 can connect to the internet via the wireless router 12b.

[0022] In addition to these communication methods, it is also possible to communicate with the Internet using a mobile communication network. A mobile communication network is a communication method that connects the mobile terminal 6 to the Internet by performing wireless communication between the mobile terminal 6 and the wireless base station 13.

[0023] By using these various communication methods, the mobile terminal 6 can connect to the internet. Furthermore, a management server 11 for managing the karaoke system is connected to the internet. Once the karaoke program is installed and the mobile terminal 6 is connected to the internet, it can communicate with this management server 11 to distribute songs sung between the mobile terminals 6.

[0024] In this embodiment, we will describe a configuration in which karaoke is performed using a mobile terminal 6 as the terminal device. Note that, in addition to the mobile terminal 6, a home game console, a personal computer, or a dedicated karaoke machine may also be used as the terminal device. Furthermore, terminal devices with the karaoke program installed will function as karaoke machines.

[0025] Figure 2 is a diagram showing the external appearance (front view) of a mobile terminal 6 according to an embodiment of the present invention, and Figure 3 is a block diagram showing the configuration of the mobile terminal 6 according to an embodiment of the present invention. This mobile terminal 6 can be a smartphone, tablet terminal, mobile phone, etc. By installing a karaoke program on this mobile terminal 6, it becomes possible to perform karaoke between the mobile terminals 6.

[0026] The mobile terminal 6 of this embodiment has a control means comprising a CPU 60, RAM 74, storage unit 75, image processing unit 64, and sound processing unit 66. The storage unit 75 can employ a non-volatile storage means such as NAND flash memory. The program of this embodiment, as well as various data used by the program, are stored in this storage unit 75.

[0027] The CPU 60 is a means of controlling the entire mobile terminal 6 and performs various controls based on the programs and data stored in the memory unit 75. The RAM 74 temporarily stores the data generated by the control of the CPU 60.

[0028] The sound processing unit 66 is a means for handling audio-related input and output of the mobile terminal 6. It emits sound from the speaker 67a under the control of the CPU 60. The sound processing unit 66 is also connected to the microphone 67b, and can pick up call audio and ambient sounds from the microphone 67b. External devices such as a headset may be used for the speaker 67a and microphone 67b.

[0029] The touch panel display unit 68 comprises a display unit 68y for displaying images and a touch panel 68x disposed on its front or back surface. The touch panel 68n can employ various types, such as a capacitive touch panel, that can recognize the user's touch position. The CPU 60 displays an image on the display unit 68y and can also determine which part of the displayed image has been touched based on the touch input from the touch panel 68x.

[0030] The image processing unit 64 is a means for inputting and outputting image-related information from the mobile terminal 6. The image processing unit 64 outputs the image formed by the CPU 60 to the display unit 68y. It also has the function of capturing images, or if it is video, video, from the front camera 65F located on the front of the mobile terminal 6 (on the side of the touch panel display unit 68), or from the rear camera 65R located on the back of the mobile terminal 6, and storing the image or video information in the storage unit 7.

[0031] The mobile terminal 6 of this embodiment includes a first communication unit 69a and a second communication unit 69b as communication means for communicating with the outside world. The first communication unit 69a is a communication means for connecting to a mobile communication network, and by wirelessly connecting to a mobile base station 140, it is possible to perform various communications via the Internet network using the communication lines of the mobile communication network. The second communication unit 69b is a communication means for Wi-Fi connection. The mobile terminal 6 can use the second communication unit 69b to wirelessly connect to an access point 110 and communicate with the local area network to which the access point 110 participates. In addition to the first communication unit 69a and the second communication unit 69b, the mobile terminal 6 may also be provided with other means of communication, such as an infrared communication unit or short-range communication means such as Bluetooth®.

[0032] The portable terminal 6 of this embodiment is configured to include input switches 70 in addition to the touch panel 68n as an input means. Various types of switches can be provided for these input switches 70 (input switches 70a, 70b, etc. in Figure 2), such as a power switch, a volume control switch, and a switch whose input function is changed according to the program.

[0033] Furthermore, the mobile terminal 6 of this embodiment has a vibration unit 72 and an LED 73 to provide various notifications to the user holding the mobile terminal 6. The vibration unit 72 is a component formed by attaching an eccentric weight to the shaft of a motor. By rotating the motor, it is possible to transmit vibrations that can be felt by the user. The LED 73 is positioned on the upper front of the mobile terminal 6 as shown in Figure 2, and can provide various notifications to the user by flashing.

[0034] In this embodiment, by installing a karaoke program on such a mobile terminal 6, it becomes possible to distribute songs sung in karaoke between the mobile terminals 6.

[0035] Here, the problems of the present invention and the configuration for solving those problems will be described. In karaoke, voice-changing processing, which alters singing voices for added enjoyment, is well-known. Voice-changing processing can, for example, raise the pitch of a voice to convert a male voice to a female voice, or vice versa to convert a female voice to a male voice. Alternatively, various filtering techniques, such as distorting the voice rather than just changing the pitch, can be used to enjoy a wide variety of vocal styles.

[0036] On the other hand, some karaoke machines have a scoring function that evaluates singing performance with a score. By using the scoring function, users can numerically recognize whether their singing is good or bad. However, when the voice-changing process mentioned earlier is performed, scoring is usually done using the voice before the voice change. Therefore, there may be discrepancies between the subjective evaluation of the voice-changed singing voice by the listener or the singer, and the calculated scoring result.

[0037] In situations where voice-changing processing is performed in the same space as the singer and listener, such as in a karaoke box, both the singer and listener hear both the pre- and post-voice-changing audio. Therefore, when scoring is based on the pre-voice-changing audio, there is little discrepancy between the subjective evaluation of the listener or singer and the calculated score. On the other hand, when a song sung in karaoke is distributed, the listener does not hear the pre-voice-changing audio, only the post-voice-changing audio. Similarly, when the singer checks the data to be used for distribution, they do not hear the pre-voice-changing audio, only the post-voice-changing audio. Therefore, there is a possibility that listeners or singers may perceive a discrepancy between their subjective evaluation of the voice-changed singing audio and the calculated score.

[0038] This invention takes these circumstances into consideration and aims to reduce the discrepancy between the subjective evaluation of the listener and the actual singing voice by using voice-changed singing voices for scoring, thereby improving the satisfaction of both the listener and the singer with the scoring results.

[0039] Figure 4 is a diagram illustrating the configuration of this embodiment. In this embodiment, the scoring application 61 (corresponding to the "karaoke program") installed on the mobile terminal 6a includes a voice changer 61g. The voice changer 61g processes the input voice information based on the set voice change type and outputs it. The parameters set for the voice changer 61g (including the voice change type and detailed parameters) are stored in the parameter storage unit 613 and used for voice changing. The audio information output from the voice changer 61g is added to the music played by the music playback unit 61a by the addition unit 61c and stored as recorded singing audio information in the save output unit 61d. The recorded singing audio information stored in the save output unit 61d can be distributed via the distribution application 62.

[0040] The distribution application 62 records the recorded audio information in the distribution unit 11a of the management server 11 during distribution. The distribution unit 11a then distributes the recorded audio information to the mobile terminal 6b that requested distribution. The playback unit 76 of the mobile terminal 6b plays the recorded audio information, allowing listeners to hear it.

[0041] In this embodiment, the user can set a voice change type for the voice changer 61g. Figure 5 shows the voice change table of this embodiment. The voice change table stores the voice change type and pitch difference in association. The pitch difference is the difference between the pitch of the singing voice after voice change and the pitch of the singing voice before voice change. The correction unit 61b performs correction based on the pitch difference determined by referring to the voice change table 61f, for setting keys set on the singer's mobile terminal 6a.

[0042] For example, if "Anime (Female Voice)" is selected and the setting key is set to standard, the song playback unit 61a on the singer's side will play the song in the standard key. The correction unit 61b corrects the song, which was played at a key of +4, by correcting it with the pitch difference corresponding to "Anime (Female Voice)". Also, if "Anime (Male Voice)" is selected and the setting key is set to +1, the song playback unit 61a on the singer's side will play the song at a key of +1. The correction unit 61b corrects it with the pitch difference corresponding to "Anime (Male Voice)", and the song is played at a key of +1-4=-3.

[0043] In the example described above, if "Anime (female voice)" is selected, the singing voice information corrected by the correction unit 61b is output with a pitch difference of +4 compared to the original singing voice information. Therefore, on the listener's mobile device 6b, both the music and the voice-changed singing voice will be at a key of +4, resulting in a matching pitch for both. Thus, the listener can hear the music and the voice-changed singing voice with their pitches matched.

[0044] Next, the scoring performed by the scoring application 61 will be explained. The scoring unit 61h of this embodiment comprises a first scoring unit 611 and a second scoring unit 612. The first scoring unit 611 scores the voice-changed audio information and outputs a post-voice-change scoring index. When scoring in the first scoring unit 611, it refers to the voice-change table 61f and performs key correction according to the set voice-change type. The second scoring unit 612 scores the un-voice-changed audio information (raw sound) and outputs a scoring index. The first scoring unit 611 and the second scoring unit 612 can output scoring indexes for each evaluation item. Here, evaluation items are, for example, pitch, volume, and technique (stability, intonation, long tone, scooping, etc.). The scoring index is an index for evaluating the quality of each evaluation item, and various evaluation forms such as scores and graded evaluations can be adopted. The scoring index can also be called the scoring result.

[0045] The scoring management unit 61i can display and output the scoring indicators obtained from the first scoring unit 611 and the second scoring unit 612 to the touch panel display unit 68. It can also combine the evaluation items from the first scoring unit 611 and the second scoring unit 612 to calculate an evaluation indicator for listening (an evaluation indicator for display on the mobile terminal 6b in the example in Figure 4). The scoring indicators calculated by the scoring management unit 61i are recorded together with the recorded singing audio information by the storage output unit 61d.

[0046] Next, we will explain the process performed on the mobile device 6a (singer's side). A user who wants to sing searches for a song using the song search screen shown in Figure 6(A) (S101). The song search screen is provided with a search category selection field 68a and a song selection field 68b. The search category selection field offers search categories such as "Favorites," "Songs," "Artists," and "Albums." Users can select one of these categories to perform a music search based on their chosen category. Figure 10(A) shows the state when "Songs" is selected as the search category, and the music selection field 68b is displayed in alphabetical order (Japanese alphabetical order).

[0047] The song selection field 68b displays an icon (album art, etc.), song title, and artist name for each song. When a user selects a song from the song selection field 68b, a song confirmation screen for that song is displayed.

[0048] Figure 6(B) shows the song confirmation screen of this embodiment. The song confirmation screen displays the song confirmation field 68c. The song confirmation field 68c displays the icon (album art, etc.), song title, and artist name for the selected song. The song confirmation field 68c also contains a reservation button 681, a parameter adjustment button 682, a distribution button 683, and another reservation button 681. The reservation button 681 is used to reserve a song for singing along to the music, as is done in regular karaoke.

[0049] The parameter adjustment button 682 is used to adjust the detailed parameters used in the voice change processing. The "VC" indicated on the parameter adjustment button 682 is an abbreviation for "voice change" and will be used on other screens as well. The distribution button 683 is used to distribute the recorded singing audio information to other mobile devices 6. The back button 684 closes the song confirmation screen and returns to the song search screen shown in Figure 6(A).

[0050] Figure 11 is a flowchart showing the parameter adjustment process of this embodiment. The parameter adjustment process is started when the parameter adjustment button 682, described in Figure 6(B), is operated. When the parameter adjustment process starts, the parameter setting screen shown in Figure 7(C) is displayed (S101). The parameter setting screen is a screen in which parameters used for the voice change process (including voice change type and detailed parameters) can be set. In this embodiment, these can be set using the type setting field 68d and the parameter setting bar 68e.

[0051] The Type Setting field 68d is an operator that allows you to select the voice change type to be used for the voice change processing from the voice change types explained in Figure 5. The Parameter Setting Bar 68e allows you to adjust each detailed parameter item by operating the operator displayed as a black circle. In this embodiment, "Anime (Female Voice)" is selected as the voice change type, and the adjustable detailed parameters A, C, and F can be adjusted using the Parameter Setting Bar 68e. Examples of what can be adjusted with detailed parameters A, C, and F include adjusting the pitch of the formant (voice quality), adjusting the pitch of the voice, and adjusting the volume of a specific frequency band. Note that the content that can be adjusted with detailed parameters A, C, and F is not limited to these.

[0052] Furthermore, the detailed parameters that the user can set and their adjustable ranges may differ for each type of voice changer. Additionally, the system may perform voice change processing based on the set parameters (including the voice changer type and detailed parameters), and allow the user to listen to the processed voice.

[0053] On the parameter setting screen, the voice change type and the set detailed parameters are configured (S101). When the play button 685 is operated (S102: Yes), the song selected in Figure 6(B) is played (S103). Figure 7(D) shows the parameter setting singing screen in this embodiment. This parameter setting singing screen is displayed when playing a song (S103). The parameter setting singing screen is divided into an upper display area 68h and a lower display area 68j. The upper display area 68h is used as a singing assistance display area 686, and displays lyrics to assist singing and a progress bar 687 that shows the progress of song playback. The lower display area 68j is provided with a play stop button 688, which makes it possible to stop song playback (S103) during parameter adjustment processing.

[0054] When a song is played (S103), singing voice information input from the microphone 67b of the mobile terminal 6 is acquired (S104). The singing voice information input from the microphone 67b of the mobile terminal 6 is the voice information before voice change. The acquired singing voice information is temporarily recorded and saved on the mobile terminal 6 (S106). When song playback is complete, voice change processing (S107) is performed on the recorded singing voice information. The voice change type and detailed parameters set in S102 are used for this voice change processing (S107). The first scoring unit 611 scores the singing voice information after the voice change processing (S107) and calculates a post-voice change scoring index (S108, corresponding to "voice change voice scoring processing"). The second scoring unit 612 scores the singing voice information (raw sound) before the voice change processing (S107) and calculates a pre-voice change scoring index (corresponding to S109, "raw sound scoring processing").

[0055] Once the scoring in S108 and S109 is complete, the scoring management unit 61i displays the parameter setting evaluation screen on the touch panel display unit 68 (corresponding to S110, "Parameter-related information acquisition process" and "Display process"). Figure 8(E) shows the parameter setting evaluation screen of this embodiment. The upper display area 68h of the parameter setting evaluation screen displays information about the music used (artist name, song title), voice change type, pre-voice change scoring index, and post-voice change scoring index. Note that the display of the pre-voice change scoring index may be omitted.

[0056] The user who has performed the song checks the pre-voice change scoring index and post-voice change scoring index obtained from the set voice change type and detailed parameters on this parameter setting evaluation screen, and decides whether or not to save the set voice change type and detailed parameters. For this reason, a save button 689 is provided in the lower display area 68j of the parameter setting evaluation screen. If the save button 689 is operated (S111: Yes), the parameters (including the voice change type and detailed parameters) are saved to the parameter storage unit 613 (S112, corresponding to "storage processing")). The saved parameters can be read from the parameter selection screen of the distribution processing, which will be explained later.

[0057] Furthermore, the user can reset the parameters. For this reason, a reset button 690 is provided in the lower display area 68j. When the reset button 690 is operated (S113:Yes), a setting screen similar to the parameter setting screen explained in Figure 7(C) is displayed, and the user's parameters are accepted (S114). Once the parameter acceptance is complete (S114:Yes), the parameters are set (S115), and the processes from S107 to S109 are performed to calculate the scoring index before voice change and the scoring index after voice change, which are displayed in the form shown in Figure 8(E) (S110).

[0058] In this way, users can reset parameters and check the pre-voice change scoring index and post-voice change scoring index based on the parameter changes. Users can understand the impact of the voice change process on the scoring index, which can improve their satisfaction. Parameters that are judged to have good pre-voice change and post-voice change scoring index can be saved and used in subsequent distribution processing. In addition, regardless of whether the pre-voice change and post-voice change scoring index are good or not, users can select parameters with an understanding of the impact of the voice change process on the scoring index. They can also select parameters that are suitable for their voice quality. Furthermore, this can contribute to learning singing methods that result in good pre-voice change and post-voice change scoring index. If the exit button 691 displayed on the parameter setting evaluation screen is operated (S116: Yes), the parameter adjustment process is terminated.

[0059] The user can perform a singing performance using the parameters set in the parameter adjustment process and then perform a distribution process to create data for distributing the recorded singing audio information. The distribution process is started by operating the distribution button 683 displayed on the song confirmation screen as described in Figure 6(B). When the distribution process starts, the parameter selection screen shown in Figure 8(F) is displayed on the touch panel display unit 68 (S201). The parameter selection screen is a screen that allows the user to read the parameters saved in the parameter adjustment process, and a related information display field 68k that displays various information about the saved parameters is displayed.

[0060] The related information display field 68k displays the save date and time, the artist name of the song used, the song title, the type of voice change used, the scoring index before voice change, the scoring index after voice change, and the selection button 692. When the user selects a desired related information display field 68k and operates the selection button 692 (S202: Yes), the parameters corresponding to the operated related information display field 68k are set in the voice changer 61g (S203, equivalent to "parameter setting process"), and the song used when the parameters were saved is played (S204).

[0061] Figure 9(G) shows the streaming singing screen of this embodiment. The upper display area 68h of the streaming singing screen displays the singing assistance display area 686, similar to the singing during the parameter adjustment process described in Figure 7(D). The lower display area 68j displays the re-sing button 694 and the play stop button 695. When the re-sing button 694 is operated, the playback of the song is restarted. When the play stop button 695 is operated, the playback of the song is stopped and the user returns to the parameter selection screen. As the song plays, singing voice information input from the microphone 67b is acquired (S205), voice change processing is performed (S206), and recording and saving are performed by the save output unit 61d (S207).

[0062] Furthermore, the first scoring unit 611 scores the voice-changed audio information and outputs a post-voice-change scoring index (S208). The second scoring unit 612 scores the audio information before voice-change processing (raw sound) and outputs a pre-voice-change scoring index (S209). When singing is complete, the scoring management unit 61i displays the pre-voice-change scoring index, the post-voice-change scoring index, and the listening scoring index on the streaming singing evaluation screen (S210). Note that the display of at least one of the post-voice-change scoring index and the listening scoring index may be omitted.

[0063] Here, the listening score index (corresponding to the "overall score index") is an evaluation index calculated by combining the scoring items of the first scoring unit 611 and the scoring items of the second scoring unit 612 (corresponding to the "overall score index calculation process"). For example, for evaluation items such as pitch, intonation, and technique, the scoring index from the first scoring unit 611 is adopted, while for evaluation items such as stability and long tone, the scoring index from the second scoring unit 612 is adopted. However, the listening score index is not limited to this; it may also adopt only the scoring index from the first scoring unit 611 or only the scoring index from the second scoring unit 612. The user can decide whether or not to save and distribute the recorded singing information by referring to the listening score index in addition to the pre-voice change scoring index and post-voice change scoring index.

[0064] Figure 9(H) shows the streaming singing evaluation screen of this embodiment. The upper display area 68h of the streaming singing evaluation screen displays information about the sung song (artist name, song title), the type of voice change used, the scoring index before voice change, the scoring index after voice change, and the listening scoring index. The lower display area 68j displays a save button, a re-sing button 697, and an exit button 698. The user operates the save button 696 to save the recorded singing information. If the re-sing button 697 is operated, the song playback is restarted. If the exit button 698 is operated, the streaming process is terminated.

[0065] If the save button 696 is pressed (S211: Yes), the recorded audio information, pre-voice change scoring index, post-voice change scoring index, and listening scoring index are saved (S212), and then the distribution selection screen is displayed (S213). Figure 10(I) shows the distribution selection screen of this embodiment. On the distribution selection screen, the save-related display field 68m is displayed for the recorded audio information saved so far. The save-related display field 68m displays the recording date and time, information about the song sung (artist name, song title), the type of voice change used, pre-voice change scoring index, post-voice change scoring index, listening scoring index, and the distribution button 699.

[0066] The user checks the save-related display field 68m and then operates the distribution button 699 for the save-related display field 68m they wish to distribute. If the distribution button 699 is operated (S214: Yes), a file is created containing the recorded audio information corresponding to the save-related display field 68m, information about the sung song, listening scoring indicators, etc. The file is then sent to the distribution application 62, which in turn sends the file to the management server 11. The distribution unit 11a of the management server 11 distributes the file containing the recorded audio information to the mobile terminal 6b that requested distribution. The mobile terminal 6b that receives the file plays the recorded audio information using the playback unit 76 and allows the listener to listen to it.

[0067] Furthermore, the files sent to the mobile terminal 6b only need to include listening scoring indicators; it is not necessary to include pre-voice change scoring indicators and post-voice change scoring indicators. When playing the file on the mobile terminal 6b, displaying information about the sung song (artist name, song title), listening scoring indicators, etc., can enhance the listening experience. Additionally, the file may include user identification information of the user who distributed it (username, etc.).

[0068] The karaoke program of this embodiment has been described above using a mobile device 6 as an example. However, according to the karaoke program of this embodiment, by displaying scoring indicators based on voice-changed audio information, it is possible to reduce the difference with the subjective evaluation of the listener and improve the listener's and singer's satisfaction with the scoring results. It should be noted that the present invention is not limited to the embodiments described above, and various modifications can be adopted. Various modifications that the present invention can take will be described below.

[0069] [First variation] In the above-described embodiment, the voice changer 61g was integrated into the scoring application 61, as explained in Figure 4. However, the voice changer 61g may be independent of the scoring application 61. Figure 13 is a diagram illustrating the configuration of another embodiment (first modified example). In this first modified example, the scoring application 61 and the voice change application 63 are independent applications.

[0070] The user can determine suitable parameters by inputting information about the parameters set in the voice change app 63 into the scoring app 61, while checking the scoring indicators before voice change, after voice change, etc., as in the embodiment described above. In this modified example, the processes S101, S102, S106, S017, S111, S112, S113, and S114 may be omitted in the parameter adjustment process. In this case, the process in S104 acquires the singing voice information before voice change and the singing voice information after voice change.

[0071] [Second variation] In the embodiment described above, after selecting a song on the song confirmation screen, parameter adjustment processing and distribution processing were performed. Therefore, the parameters saved in the parameter adjustment processing were linked to the song used. However, the system is not limited to this form, and the parameters saved in the parameter adjustment processing may not be linked to a song. In this case, it is possible to use different songs for the parameter adjustment processing and the distribution processing. Furthermore, the parameters set in the parameter adjustment processing can also be used for various songs in the distribution processing.

[0072] [Third variation] In the embodiment described above, during the parameter adjustment process, voice change processing (S107) was performed on the recorded singing voice information once music playback was complete. However, the system is not limited to this form, and voice change processing may be performed at any time in conjunction with music playback. In this case, processing S108, S107, and S110 may also be performed in conjunction with music playback. In this case, the scoring index before voice change and the scoring index after voice change may be displayed on the parameter setting singing screen in Figure 7(D).

[0073] [Fourth variation] In the embodiment described above, parameter adjustment processing was performed. However, the system is not limited to this form, and parameter adjustment processing may be omitted. In this case, in the distribution process, processing S101 and S102 may be performed instead of S201 and S202. Also, S201 and S202 may be omitted in the distribution process. Even in this case, by displaying the pre-voice change scoring index, the post-voice change scoring index, and the listening scoring index, singers can understand the effect of the voice change processing on the scoring index, thereby improving their satisfaction. Note that the display of at least one of the pre-voice change scoring index and the listening scoring index may be omitted.

[0074] The karaoke program used in the mobile terminal 6 of this embodiment has been described above, but the present invention is not limited to karaoke programs, and also includes karaoke devices equipped with karaoke programs, or karaoke scoring methods. [Explanation of symbols]

[0075] 6(6a, 6b): Mobile device; 68n: Touch panel 7: Memory unit 68x: Touch panel 11: Management Server 68y: Display Unit 11a: Distribution Department 69a: First Communications Department 12a: Router 69b: Second Communications Unit 12b: Wireless router 70 (70a, 70b): Input switch 13: Wireless base station 72: Vibration unit 60:CPU 73:LED 61: Scoring app 74: RAM 61a: Music playback unit 75: Memory unit 61b: Correction section 76: Playback section 61c: Addition unit 110: Access point 61d: Storage output unit 140: Mobile base station 61f: Voice Change Table 611: First Scoring Section 61g: Voice changer 612: Second scoring section 61h: Scoring section 613: Parameter storage section 61i: Scoring Management Department 681: Reservation Button 62: Streaming app 682: Parameter adjustment button 63: Voice changer app 683: Streaming button 64: Image processing unit 684: Button 65F: Front camera 685: Play button 65R: Rear camera 686: Singing assistance display area 66: Acoustic processing unit 687: Progress bar 67a: Speaker 688: Stop playback button 67b: Microphone 689: Save button 68: Touch panel display 690: Reset button 68a: Search category selection field 691: Exit button 68b: Song selection field 692: Select button 68c: Song confirmation section 694: Re-sing button 68d: Type setting field 695: Play / Stop button 68e: Parameter setting bar 696: Save button 68h: Top display area 697: Re-sing button 68j: Bottom display area 698: Exit button 68k: Related information display area 699: Stream button 68m: Save-related display field

Claims

1. A karaoke program executable on an information processing device, A playback process that plays the music based on the music information, Voice-changed voice acquisition process to acquire voice information that has been processed with a voice changer, Voice-changing voice scoring process, which scores based on voice-changed voice information, The system executes a display process that shows scoring indicators based on voice-changing audio scoring processing. A program for karaoke.

2. A raw audio acquisition process that obtains audio information that has not been subjected to voice change processing, The system performs a raw voice scoring process that scores based on audio information that has not undergone voice change processing, and The display process shows scoring indicators based on voice-changed audio scoring and scoring indicators based on raw audio scoring. The karaoke program according to claim 1.

3. A raw audio acquisition process that obtains audio information that has not been subjected to voice change processing, Raw voice scoring process that scores based on audio information that has not undergone voice change processing, The process executes a comprehensive score calculation process that calculates a score index based on a voice-changed voice scoring process and a score index based on a raw voice scoring process. The karaoke program according to claim 1.

4. The display process shows scoring indicators based on voice-changed audio scoring, scoring indicators based on raw audio scoring, and overall scoring indicators based on overall indicator calculation. The karaoke program according to claim 3.

5. The process to obtain parameter-related information is executed to obtain parameter-related information regarding the parameters used in the voice change process. The display process shows the scoring index based on the voice change voice scoring process, along with the acquired parameter-related information. The karaoke program according to claim 1.

6. Execute a memory process to store parameter-related information. The karaoke program according to claim 5.

7. A parameter setting process that sets stored parameter-related information for the voice change process, A second voice-changed voice acquisition process acquires voice information that has been voice-changed based on the parameter-related information set in the parameter setting process, The second voice changer executes an audio output process that outputs audio based on the audio information acquired in the audio acquisition process. The karaoke program according to claim 6.

8. Perform a voice change process to apply a voice alteration to the audio information. The karaoke program according to claim 1.

9. Performs an adjustment process that allows you to adjust the parameters used in the voice change process. The karaoke program according to claim 8.

10. A selection process is executed to accept the selection of the voice change type. The adjustment process allows you to adjust the parameters corresponding to the selected voice change type. The karaoke program according to claim 9.

11. A playback process that plays the music based on the music information, Voice-changed voice acquisition process to acquire voice information that has been processed with a voice changer, Voice-changing voice scoring process, which scores based on voice-changed voice information, The system executes a display process that shows scoring indicators based on voice-changing audio scoring processing. Karaoke machine.

12. A playback process that plays the music based on the music information, Voice-changed voice acquisition process to acquire voice information that has been processed with a voice changer, Voice-changing voice scoring process, which scores based on voice-changed voice information, The system executes a display process that shows scoring indicators based on voice-changing audio scoring processing. Karaoke scoring method.

Images