Karaoke system and karaoke device

Abstract

To provide a method for enabling performance of various functions in a Karaoke system and a Karaoke device and improving convenience and entertainment for a user.SOLUTION: A method performs: performance processing S201 for performing music based on music data; input reception processing S207 for receiving input from a user when performance processing is performed; storage processing for storing first data inputted from the user in input reception processing; generation processing S202 for generating second data when performance processing is performed; and image generation processing S219 for generating a result image for the performed music based on first data and second data after termination S216 of performance processing.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to a karaoke system for playing music data and a karaoke device.

Background Art

[0002] Karaoke has long been widely enjoyed as an entertainment for enjoying singing in accordance with a performance.

[0003] Patent Document 1 discloses a karaoke performance reservation system that displays a music reservation in a karaoke device and a plurality of remote control devices. In this karaoke performance reservation system, when a music is reserved by a remote control device, the latest reservation status information is created by the karaoke device and displayed on the plurality of remote control devices.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Currently, the remote control function used in a karaoke system can use not only a dedicated remote control device but also a mobile terminal such as a smartphone owned by a user, and the range of input to the karaoke system for the user has widened. Thus, in recent years, karaoke is required to realize various functions that take advantage of the wide range of input, not only functions such as music reservation and display of music reservation disclosed in Patent Document 1.

[0006] The present invention is made in view of such a situation, and one object thereof is to enable various functions to be executed in karaoke and to improve convenience and entertainment for the user.

Means for Solving the Problems

[0007] Therefore, the karaoke system according to the present invention adopts the following configuration. Performance processing for performing a piece of music based on music data, Input reception processing for receiving an input from a user when the performance processing is performed, Storage processing for storing first data input from the user in the input reception processing, Generation processing for generating second data when the performance processing is performed, After the end of the performance processing, image generation processing for generating a result image for the performed piece of music based on the first data and the second data is executed.

[0008] Furthermore, in the karaoke system according to the present invention, The input reception processing is executed during the performance processing.

[0009] Furthermore, in the karaoke system according to the present invention, The generation processing is executed after the end of the performance processing.

[0010] Furthermore, the karaoke system according to the present invention, Comprises processing executed by a karaoke device and a mobile terminal communicatively connected to the karaoke device.

[0011] Furthermore, in the karaoke system according to the present invention, The karaoke device includes a storage unit, The performance processing, the storage processing, the generation processing, and the image generation processing are executed by the karaoke device, The input reception processing is executed by the mobile terminal, The storage processing stores the first data in the storage unit.

[0012] Furthermore, in the karaoke system according to the present invention, There are a plurality of mobile terminals, The karaoke device is communicatively connected to a plurality of the mobile terminals, The image generation process generates a plurality of the resultant images corresponding to each of the plurality of the mobile terminals.

[0013] Furthermore, in the karaoke system according to the present invention, The image generation process generates a plurality of the resultant images including a device resultant image displayed on the karaoke device and a terminal resultant image different from the device resultant image and displayed on the mobile terminal.

[0014] Furthermore, in the karaoke system according to the present invention, The first data is evaluation prediction data indicating a predicted value predicted by the user for an evaluation value of singing voice or musical instrument performance, The second data is evaluation data indicating the evaluation value, The image generation process generates the resultant image indicating the propriety of the prediction based on the evaluation prediction data and the evaluation data.

[0015] Furthermore, in the karaoke system according to the present invention, The input reception process closes the reception of the first data at a predetermined first timing during the performance process.

[0016] Furthermore, the karaoke system according to the present invention executes a message input reception process for receiving an input of a message and a message display process for displaying the message received by the message input reception process. The karaoke system according to claim 1. The karaoke system according to claim 1.

[0017] Furthermore, the karaoke system according to the present invention is configured to include a process executed by a karaoke device connected to a display unit, The message display process displays the message on the display unit.

[0018] Furthermore, in the karaoke system according to the present invention, the message input reception process can be started from a predetermined second timing during the performance process.

[0019] Also, the karaoke apparatus according to the present invention includes a storage unit, a performance process for performing a music based on music data, a storage process for storing first data input from a user in the storage unit when the performance process is performed, a generation process for generating second data when the performance process is performed, and an image generation process for generating a result image for the performed music based on the first data and the second data after the end of the performance process.

Advantages of the Invention

[0020] According to the karaoke system and the karaoke apparatus of the present invention, various functions can be executed in karaoke, and it is possible to improve the convenience and entertainment for the user.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Mode for Carrying Out the Invention

[0022] FIG. 1 is a diagram showing the configurations of the remote control device 1 and the karaoke device 2 (sometimes referred to as a commander) in the karaoke system of the present embodiment. The karaoke device 2 and the remote control device 1 are communicatively connected to form a network using the LAN 100 and the access point 130. Note that the karaoke system may be configured to include at least one of a program executed by the karaoke device 2 and a terminal program executed by the mobile terminal 6.

[0023] The karaoke device 2 installed in a store such as a karaoke box includes an acoustic control unit 25 as a performance sound reproduction unit for playing music. The karaoke device 2 also includes an operation unit 21 for receiving various inputs from the user. The karaoke device 2 includes an operation processing unit 22 that interprets the input from the operation unit 21 and transmits it to the CPU 30. The karaoke device 2 also includes a hard disk 32 as a storage unit for storing various information. The karaoke device 2 includes a LAN communication unit 24a as a communication means for connecting to the LAN 100 and joining the network. Further, the karaoke device 2 of the present embodiment also includes a wireless LAN communication unit 24b, and it is also possible to perform a wireless network connection using the wireless LAN communication unit 24b instead of the wired network connection using the LAN communication unit 24a.

[0024] In addition, the karaoke device 2 includes a video playback unit that causes the monitor 41 to display lyrics videos, background videos, and the like. This video playback unit includes a video formation unit 29 that plays back videos based on video data, a video RAM 28 that temporarily stores the videos to be played back, and a video control unit 31 that superimposes lyrics videos on the played-back videos and applies video effects and the like.

[0025] Furthermore, in this karaoke device 2, in addition to the monitor 41 connected externally, it is possible to display various information on the touch panel monitor 33. The touch panel monitor 33 is configured by superimposing a display unit 35 that displays the video input from the video control unit 31 and a touch panel 34 that outputs the position of the touch input to the operation processing unit 22. This touch panel monitor 33 is arranged on the front surface of the housing of the karaoke device 2 and functions as an input unit, similar to the operation unit 21 of the karaoke device 2 or the touch panel monitor 11 of the remote control device 1. The user can perform various operations on the karaoke device 2, such as directly reserving a song on the karaoke device 2 by selecting a song on the touch panel monitor 33.

[0026] Furthermore, the karaoke device 2 is configured to include a control unit including a CPU 30 for overall control of each component and a memory 27 for temporarily storing information necessary for executing various programs.

[0027] With such a configuration, the karaoke device 2 will execute various processes. As the main functions of the karaoke device 2, it can execute processes such as music reservation processing and music playback processing. The music reservation processing is a process for designating and reserving a music based on a designation from the user, and is executed in cooperation with the remote control device 1. The reservation information formed by the music selection processing of the remote control device 1 is transmitted to the karaoke device 2. The karaoke device 2 registers the received reservation information in the reservation table in the memory 27. The music playback processing is a process for playing back the reserved music, and is a process in which the performance processing, the lyrics display processing, and the background video display processing are executed synchronously.

[0028] The performance processing is a process for causing the acoustic control unit 25 to perform a performance based on the performance sound data included in the music data. The music performed by the acoustic control unit 25 is emitted from the speaker 42 together with the singing voice signals input from the microphones 43a and 43b. The lyrics display processing is a process for assisting singing by displaying a lyrics video based on the lyrics data included in the music data on the monitor 41. It is also possible to execute the background video display processing for superimposing and displaying the lyrics video displayed in this lyrics display processing on the background video.

[0029] On the other hand, the remote control device 1 can execute a music selection process for searching for a music based on an instruction from the user and transmitting reservation information for the music with a playback instruction to the karaoke device 2. Further, the remote control device 1 can receive various information from the karaoke device 2 or the server device 5 connected to the Internet and execute various processes. In the present embodiment, as a user interface for receiving various instructions from the user, it includes an operation unit 17 and a touch panel monitor 11. The touch panel monitor 11 is configured to have a display unit 11a and a touch panel 11b, and while displaying various information on the display unit 11a, it can receive touch inputs from the user.

[0030] Furthermore, the remote control device 1 includes a memory 14 as a storage unit that stores a database, various programs, and various information generated during program execution, which are required for the music selection process, and a remote control side control unit for comprehensively controlling these components. The remote control side control unit includes a CPU 15, a video control unit 13 that forms a video to be displayed on the touch panel monitor 11, a video RAM 12 that temporarily stores the video data of the displayed video, and an operation processing unit 18 that interprets the input from the touch panel monitor 11 or the operation unit 17 and transmits it to the CPU 15.

[0031] The remote control device 1 is wirelessly connected to the access point 130 by the wireless LAN communication unit 16 and thus connected to the network constituted by the LAN 100. Each remote control device 1 is pre-associated with a specific karaoke device 2. Various commands transmitted from the remote control device 1 are received by the associated karaoke device 2.

[0032] With such a configuration of the remote control device 1, various inputs from the user are received from the touch panel monitor 11 or the operation unit 17, and various information is provided through the display of the touch panel monitor 11, enabling various processes such as a music selection process for transmitting reservation information to the karaoke device 2.

[0033] Figure 2 is a flowchart showing the music playback process executed by the karaoke device 2. The karaoke device 2 reserves a music based on an operation on an input unit such as the remote control device 1 or the touch panel monitor 33. When a music reservation is made, reservation information including a music ID for identifying the music data and a user ID of the reserving user is registered in a reservation table stored and managed in the memory 27 of the karaoke device 2.

[0034] In the music playback process, the reservation table is checked (S101). If there is a music piece to be played next (S102: Yes), music playback based on the music data is executed (S103). In music playback, the performance process, the lyric display process, and the background video display process are executed synchronously. When the music playback ends (S104: Yes), in order to check for the existence of the next music piece to be played, the reservation table is checked (S101).

[0035] In this way, the karaoke device 2 of the present embodiment can enjoy karaoke by playing the corresponding music data for the music pieces reserved by the user. Further, the karaoke device 2 of the present embodiment can use the additional functions by cooperating with the mobile terminal 6 possessed by the user.

[0036] FIG. 3 is a diagram showing the appearance (front view) of the mobile terminal 6 according to the embodiment of the present invention, and FIG. 4 is a block diagram showing the configuration of the mobile terminal 6 according to the embodiment of the present invention. As the mobile terminal 6, a smartphone, a tablet terminal, a mobile phone, etc. can be adopted. By installing a terminal program in this mobile terminal 6, it becomes possible to use various functions in which the mobile terminal 6 and the karaoke device 2 cooperate with each other.

[0037] The mobile terminal 6 of the present embodiment has control means including a CPU 61, a RAM 62, a storage unit 63, an image processing unit 64, and an acoustic processing unit 66. As the storage unit 63, non-volatile storage means such as a NAND type flash memory can be adopted. In this storage unit 63, the program of the present embodiment and various data used in the program are stored.

[0038] The CPU 61 is means for overall control of the mobile terminal 6, and executes various controls based on the programs and data stored in the storage unit 63. In the RAM 62, the data generated under the control of the CPU 61 is temporarily stored.

[0039] The audio processing unit 66 is a means for inputting and outputting audio related to the mobile terminal 6. The audio processing unit 66 causes sound to be emitted from the speaker 67a under the control of the CPU 61. Also, the audio processing unit 66 is connected to the microphone 67b and enables the capture of call voices and ambient voices from the microphone 67b. For the speaker 67a and the microphone 67b, external devices such as a headset may be used.

[0040] The touch panel display unit 68 is configured to include a display unit 681 for displaying an image and a touch panel 682 disposed on the front or back surface thereof. The touch panel 682 can adopt various types that enable recognition of the touch position of the user, such as the capacitance method. The CPU 61 can display on the display unit 681 and determine which part of the displayed image has been touched based on the touch input from the touch panel 682.

[0041] The image processing unit 64 is a means for inputting and outputting image related to the mobile terminal 6. The image processing unit 64 displays and outputs the image formed under the control of the CPU 61 to the display unit 681. The mobile terminal 6 has a function of capturing an image or a video from the front camera 65F disposed on the front surface (touch panel display unit 68 side) of the mobile terminal 6 or the rear camera 65R disposed on the back surface of the mobile terminal 6 and storing it in the storage unit 63 as image data or video data.

[0042] The mobile terminal 6 of this embodiment includes a first communication unit 69a and a second communication unit 69b as communication means for communicating with the outside. The first communication unit 69a is communication means for connecting to a mobile communication network, and can perform various communications via the Internet network through a communication line of the mobile communication network by wirelessly connecting to a mobile base station. The second communication unit 69b is communication means for connecting to a wireless LAN. The mobile terminal 6 can use the second communication unit 69b to wirelessly connect to the access point 130 and communicate with a local area network in which the access point 130 participates. In addition, as communication means of the mobile terminal 6, in addition to the first communication unit 69a and the second communication unit 69b, short-range communication means such as an infrared communication unit and Bluetooth (registered trademark) may be provided.

[0043] The mobile terminal 6 of this embodiment is configured to include an input switch 70 in addition to the touch panel 682 as input means. Various switches such as a power switch, a volume adjustment switch, and a switch whose input use is changed according to a program can be provided for this input switch 70 (input switches 70a, 70b, etc. in FIG. 3).

[0044] Furthermore, the mobile terminal 6 of this embodiment has a vibration unit 72 and an LED 73 in order to give various notifications to the user who holds the mobile terminal 6. The vibration unit 72 is a member configured by attaching a weight eccentric to the shaft of a motor. By rotationally driving the motor, it is possible to transmit vibrations that can be sensed by the user. The LED 73 is arranged above the front of the mobile terminal 6 as shown in FIG. 3, and can give various notifications to the user by lighting up.

[0045] In this embodiment, by installing a terminal program in such a mobile terminal 6, it becomes possible to use various functions in which the mobile terminal 6 and the karaoke device 2 are linked. Next, the cooperation process of using the mobile terminal 6 and the karaoke device 2 in cooperation will be described.

[0046] FIG. 5 is a flowchart showing the cooperation process executed in the karaoke system of the present embodiment. The cooperation process of the present embodiment is performed using the remote control device 1, the karaoke device 2, and the mobile terminals 6 (6a, 6b) owned by the user. Here, the cooperation process when cooperating with the karaoke device 2 using the mobile terminal 6a owned by user a and the mobile terminal 6b owned by user b will be described. Also, as a function using the cooperation of both, the karaoke score prediction function will be described here.

[0047] First, using the remote control device 1, an activation operation of the score prediction function is performed on the karaoke device 2 (S01). Based on the activation operation, the remote control device 1 transmits a program activation request to the karaoke device 2 (S02). The karaoke device 2 that has received the program activation request causes the two-dimensional code 41a to be displayed on the monitor 41 or the touch panel monitor 11 (S21). FIG. 11(A) shows the state of the monitor 41 on which the two-dimensional code 41a is displayed. The two-dimensional code 41a contains communication environment information for communicating and connecting the mobile terminal 6 (6a, 6b) to the karaoke device 2.

[0048] Also, user a who starts using the score prediction function activates the terminal program using the mobile terminal 6a (S11a). FIG. 8(a) shows the start screen at the time of activating the terminal program displayed on the touch panel display unit 68a of the mobile terminal 6a. The title of the terminal program (in this example, "Score Prediction App") and the code reading button 61a are displayed on the start screen. When the code reading button 61a is operated by user a, the code reading screen shown in FIG. 8(b) is displayed.

[0049] On the code reading screen, a shooting display column 61b is provided, and the video captured by the rear camera 65R of the mobile terminal 6 is displayed in real time. The user positions the mobile terminal 6a so that the monitor 41 or the two-dimensional code 41a displayed on the touch panel monitor 11 is captured within the shooting display column 61b, thereby reading the two-dimensional code 41a (S12a). When the two-dimensional code 41a is read, communication using the wireless LAN is started between the mobile terminal 6a and the karaoke device 2 using the communication environment information contained therein (S13a, S22). Note that the communication using the wireless LAN may be performed using the wireless LAN communication unit 24b provided in the karaoke device 2, or may be performed via the access point 130. Alternatively, the communication between the mobile terminal 6 and the karaoke device 2 may be performed via the mobile communication network using the first communication unit 69a of the mobile terminal 6.

[0050] The mobile terminal 6a that first starts communication with the karaoke device 2 transmits the material data required to implement the score prediction function to the karaoke device 2 (S14a). The material data is data (image data, video data, audio data, layout data, etc.) required to execute a program for the score prediction function in the karaoke device 2. By transmitting the material data from the mobile terminal 6a to the karaoke device 2, it is not necessary to previously store in the karaoke device 2 the data required for the program for the score prediction function.

[0051] The mobile terminal 6b that second starts the terminal program (S11b) reads the two-dimensional code 41a shown in FIG. 11(A) (S12b) in the same manner as the mobile terminal 6a. Then, communication using the wireless LAN is started between the mobile terminal 6b and the karaoke device 2 using the communication environment information contained in the two-dimensional code 41a (S13b, S24). Note that since the material data has already been transmitted to the karaoke device 2, the mobile terminal 6b that starts communication with the karaoke device 2 after the second time does not transmit the material data.

[0052] When the cooperation process is completed, the mobile terminals 6a and 6b and the karaoke device 2 start a substantial score prediction function by executing an operation process. FIG. 6 is a flowchart showing the operation process according to the present embodiment (mobile terminals 6a and 6b, described mainly with the mobile terminal 6a here), and FIG. 7 is a flowchart showing the operation process according to the present embodiment (karaoke device 2).

[0053] In the mobile terminal 6a, after starting communication with the karaoke device 2 (S13a), a music-related data request is transmitted to the karaoke device 2 (S101). Then, an input operation screen shown in FIG. 8(c) is displayed on the touch panel display unit 68a of the mobile terminal 6a (S102). The input operation screen displays a back button 61c, a music name display column 61d, a user name input column 61e, a predicted score input column 61f, a display setting switch 61g, and a send button 61h. The input operation screen shown in FIG. 8(c) is in a state before receiving music-related data. The music name display column 61d is not displayed, the user name input column 61e and the predicted score input column 61f are not input, and the display setting switch 61g is in the on state.

[0054] After starting music playback (S201), the karaoke device 2 starts singing evaluation processing (S202). The singing evaluation processing (S202) is a process of evaluating the singing ability of a singer by comparing the singing voice signals input to the microphones 43a and 43b with the melody data included in the music data. In the present embodiment, a score is used as the evaluation result of the singing evaluation processing, but the evaluation result may be adopted in an appropriate form such as a rank format. In the karaoke device 2, after starting music playback, a preparation screen is displayed on the monitor 41.

[0055] FIG. 11(B) is a diagram showing a preparation screen displayed on the monitor 41 immediately after music playback. On the preparation screen, a music name display column 41b, a status display column 41c, and a music title 41d are displayed. The music name display column 41b and the status display column 41c are information displayed by the program of the score prediction function, and are information that is overlaid and displayed on the background video (not shown), the music title 41d, and the lyrics 41e that are displayed in the normal music playback process. In this embodiment, images such as the music name display column 41b and the status display column 41c are formed on the mobile terminal 6a side, received by the karaoke device 2, and overlaid and displayed. Therefore, the karaoke device 2 only needs to display the image formed by the mobile terminal 6a. Thus, an increase in the processing of the karaoke device 2 due to the addition of functions in the cooperation with the mobile terminals 6a and 6b is suppressed.

[0056] When the karaoke device 2 receives a music-related data request from the mobile terminal 6a (S204: Yes), it transmits music-related data including the music name of the currently playing music to the mobile terminal 6a (S205). Then, it switches the preparation screen to a prediction screen and displays it (S206). FIG. 12(C) is a diagram showing the prediction screen according to this embodiment. In the music name display column 41b, the music name of the currently playing music is displayed. Also, in the status display column 41c, a message "Receiving evaluation result prediction" is displayed. During the period when the above message is displayed in the status display column 41c, input and transmission of the predicted score can be performed on the input operation screens of the mobile terminals 6a and 6b.

[0057] After receiving the music-related data (S103: Yes), the mobile terminal 6a updates the input operation screen. FIG. 9(d) is a state of the input operation screen displayed on the mobile terminal 6a. Based on the music-related information received from the karaoke device 2, the music name (in this example, "Sozan") is displayed in the music name display column 61d on the input operation screen. In this embodiment, the user inputs the user name in the user name input column 61e in the input operation screen and inputs the predicted score (corresponding to "First Data") in the predicted score input column 61f. Also, the user can switch the display and non-display of the predicted score on the monitor 41 by operating the display setting switch 61g.

[0058] The user who operates the mobile terminal 6a makes various operation inputs to the input operation screen (S104). The operation inputs on the input operation screen include the input to the predicted score input field 61f, the input to the user name input field 61e, and the operation of the display setting switch 61g. FIG. 9(e) shows an input operation screen of the mobile terminal 6a in a state where the user name input field 61e and the predicted score input field 61f are input. In the input operation screen of FIG. 9(e), the user name "USER1" and the predicted score "80.050" are input. Also, the display setting switch 61g remains in the default on state.

[0059] The user who has finished the operation input operates the send button 61h. When the send button 61h is operated (S106: Yes), the prediction data including the various input data is sent to the karaoke device 2 (S107).

[0060] When the karaoke device 2 receives the prediction data (S207: Yes), it updates the prediction screen (S208). FIG. 12(D) is a prediction screen showing the state when the prediction data is received from the mobile terminal 6a. On the prediction screen, the user-specific information display column 41f is displayed. In the user-specific information display column 41f, the user name and the predicted score input by the mobile terminal 6a are displayed. The user can update the predicted score by operating the input operation screen during the evaluation result prediction reception period. In this embodiment, the configuration is such that the predicted score is input and the prediction data is transmitted and received during the performance of the music, but the predicted score may be input and the prediction data may be transmitted and received before the performance of the music.

[0061] Even in the mobile terminal 6b, it is possible to perform input using the input operation screen in the same manner as in the mobile terminal 6a. FIG. 9(f) is an input operation screen displayed on the touch panel display unit 68b of the mobile terminal 6b. In the input operation screen of FIG. 9(f), the user name "USER2" and the predicted score "75.235" are input. Also, in the input operation screen of FIG. 9(f), the display setting switch 61g is switched to the off state. When the send button 61h is operated in this state, the prediction data is sent to the karaoke device 2.

[0062] The karaoke device 2 that has received the prediction data performs display of the prediction screen based on the received prediction data. FIG. 13(E) is a prediction screen according to the present embodiment, in which a user-specific information display column 41f regarding "USER2" is additionally displayed. Regarding "USER2", since the display setting switch 61g is set to the off state, the predicted score is displayed in the state of "??.???", and the predicted score is not displayed.

[0063] In the present embodiment, a deadline is provided for sending the prediction data. In the karaoke device 2, when the first predetermined time has elapsed (S209: Yes), a countdown display is started in the status display column 41c (S210). The first predetermined time is a predetermined time set somewhere until the end of the music playback, and is determined based on the total time length of the music and the playback elapsed time. For example, the first predetermined time may be set n seconds before the second predetermined time (corresponding to the "first timing") described later. FIG. 13(F) is a prediction screen according to the present embodiment, and the status display column 41c is in a countdown display state indicating how many seconds before the prediction deadline (the state in FIG. 13(F) is 4 seconds before). The users who send the prediction data using the mobile terminals 6a and 6b can confirm the transmission deadline of the predicted score based on the display in the status display column 41c.

[0064] Furthermore, when a second predetermined time (the second predetermined time > the first predetermined time) has elapsed, the karaoke device 2 notifies that the transmission of the predicted score has been closed using the status display column 41c of the prediction screen (S212). Note that the second predetermined time, like the first predetermined time, is a predetermined time set somewhere until the end of the music playback, and is determined based on the total time length of the music and the elapsed playback time. For example, the second predetermined time may be set at the time when the refrain of the music ends or one minute before the end of the music. FIG. 14(G) is a prediction screen in a state where the transmission of the predicted score has been closed, and a message "Prediction reception ended" is displayed in the status display column 41c. After that, the karaoke device 2 transmits a deadline notice to the mobile terminals 6a and 6b (S213). When the mobile terminals 6a and 6b receive the deadline notice (S108: Yes), they switch the display of the touch panel display unit 68 from the input operation screen to the message input screen (S109).

[0065] FIG. 10(g) is a diagram showing a message input screen according to the present embodiment. On the message input screen, a music name display column 61d, a message selection button 61i, a message input column 61j, and a transmission button 61k are provided. The music name of the currently played music is displayed in the music name display column 61d. Messages are displayed on the message selection button 61i, and when an operation is performed (S110: Yes), a message is transmitted to the karaoke device 2 (S111). Also, in the present embodiment, a message input column 61j is provided, and it is possible to input a free message using a soft keyboard (not shown). After inputting a message into the message input column 61j, by operating the transmission button 61k (S110: Yes), a message is transmitted to the karaoke device 2 (S111).

[0066] When the karaoke device 2 receives a message (S214: YES), it displays the user-specific information display column 41f displayed on the prediction screen (S215). Also, when the karaoke device 2 does not receive a message (S214: NO), it does not display the message and proceeds to S216 for processing. FIG. 14(G) shows an expected screen when a message according to this embodiment is received. In the expected screen, in the user-specific information display column 41f of "USER1", instead of the expected score, the message received from the mobile terminal 6a is displayed. Note that the message may be displayed for a predetermined time, and after the predetermined time has elapsed, the expected score may be displayed again instead of the message.

[0067] As described above, in this embodiment, after the elapse of the second predetermined time (corresponding to "the second timing"), by causing the mobile terminals 6a and 6b to display the message input screen, it is possible to cause the monitor 41 to display a message by the user. That is, in this embodiment, the first timing, which is the timing of the deadline for transmitting the expected score, and the second timing, which is the timing of displaying the message input screen, are after the elapse of the second predetermined time and are equivalent. For example, the first timing and the second timing may be different, such as being able to switch to the message input screen before the deadline for transmitting the expected score, or displaying the message input screen after a predetermined time has elapsed after the deadline for transmitting the expected score.

[0068] When it is determined that the reproduction of the music has ended in the karaoke device 2 (S216: Yes), in the karaoke device 2, based on the singing evaluation process, result data (corresponding to "the second data") is calculated (S217). The result data of this embodiment includes the actual scoring points in the singing evaluation process, the point difference between the actual scoring points and the user's expected score, and the rank based on the point difference. The result data is transmitted to the mobile terminals 6a and 6b as result notification data (S218). The karaoke device 2 generates a device result image as a result image based on the result data (corresponding to "image generation process"). The karaoke device 2 displays the generated device result image on the monitor 41 as a result notification screen (S219).

[0069] The mobile terminals 6a and 6b that have received the result notification data (S112: Yes) generate terminal result images as result images based on the result notification data (corresponding to "image generation process"). The mobile terminals 6a and 6b display the generated terminal result images on the display unit 681 as result notification screens (S113). That is, in the present embodiment, the image generation process is executed by each of the karaoke device 2 and the mobile terminals 6a and 6b. The device result image and the terminal result image may be different result images or the same result image.

[0070] The configuration may be such that the image generation process is executed by either the karaoke device 2 or one of the mobile terminals 6a and 6b. For example, in the karaoke device 2, a configuration may be adopted in which device result images and terminal result images are generated. In that case, instead of the result notification data, the karaoke device 2 may transmit the terminal result images to the mobile terminals 6a and 6b, and the mobile terminals 6a and 6b may display the received mobile terminal images on the display unit 681. Alternatively, a configuration may be adopted in which the device result images and the terminal result images are generated in the mobile terminals 6a and 6b based on the result notification data. In that case, the mobile terminals 6a and 6b may transmit the device result images to the karaoke device 2, and the karaoke device 2 may display the received device terminal images on the monitor 41. In particular, when the image generation process is performed by the mobile terminals 6a and 6b, the karaoke device 2 side only needs a general-purpose function of displaying the images received from the mobile terminals 6a and 6b, so it is possible to suppress modifications and repairs on the karaoke device 2 side and reduce the development cost and period.

[0071] FIG. 10(h) shows the result notification screen displayed on the mobile terminal 6a. The result notification screen displays the scoring points 61l that are the actual points in the singing evaluation process, the predicted points 61m input in the mobile terminal 6a, the point difference 61n from the result, the user's rank 61o, and the return button 61p. The user can confirm the result based on his / her predicted points through the result notification screen. Also, by operating the return button 61p (S114: Yes), it is possible to start the operation process from the beginning and resume the point prediction function.

[0072] In addition, based on the calculated result data, the karaoke device 2 displays a result notification screen on the monitor 41 (S219). FIG. 14(H) is a diagram showing the result notification screen according to this embodiment. On the result notification screen, the actual scoring points in the singing evaluation process and user-specific result information 41h for each user (in this example, two users using the mobile terminals 6a and 6b) are displayed. In the user-specific result information 41h, the ranking based on the point difference, the user name, the predicted points, and the point difference between the actual scoring points and the user's predicted points are displayed. Also, in the example of FIG. 14(H), for the user "USER1", based on the fact that the point difference was "0.000", a message of "Perfect Award" is attached. In this way, the user using the karaoke device 2 can confirm the result of the point prediction on the result notification screen displayed on the monitor 41.

[0073] The result data may include the actual scoring points and the predicted points of all users. In that case, in the mobile terminals 6a and 6b that have received the result notification data, by calculating the point difference of the user's predicted points and the ranking based on the point difference, a terminal result image may be generated and displayed on the display unit 681 as a result notification screen. In this embodiment, the result is displayed based on points, but the number of scoring items and the degree of pitch match (n%) may be predicted and the result may be displayed. In that case, the result data only needs to include the number of scoring items other than the scoring points and the degree of pitch match. Also, a configuration in which a plurality of elements such as points and the number of scoring items are predicted and a result image is displayed may be used. In this embodiment, the evaluation result based on the singing voice is predicted, but the evaluation result based on the musical instrument performance may also be predicted. In this embodiment, the point prediction function is exemplified, but it may be executed by another function in which the karaoke device 2 and the mobile terminals 6a and 6b are interlocked.

[0074] As described above, according to the karaoke system and the karaoke device of this embodiment, various functions can be executed in karaoke, and it is possible to improve the convenience and entertainment for the user.

[0075] Hereinafter, the relationship between the above embodiment and the present invention will be described. The invention of the present application includes performance processing for performing a piece of music based on music data, input reception processing for receiving an input from a user when the performance processing is performed (input to the input operation screen of the mobile terminal 6), storage processing for storing the first data (predicted score) input by the user in the input reception processing, generation processing for generating second data (result data calculated in the singing evaluation processing) when the performance processing is performed, and image generation processing for generating a result image (device result image or terminal result image) for the performed piece of music based on the first data and the second data after the performance processing is completed.

[0076] In the above-described embodiment, a karaoke system including a karaoke device 2 and a terminal program executed on a mobile terminal 6 has been described. However, a program executed on the karaoke device 2 (or another information processing device) and a terminal program executed on a mobile terminal also belong to the scope of the present invention.

Explanation of Reference Numerals

[0077] 1: Remote control device 42: Speaker 2: Karaoke device 43a, 43b: Microphone 5: Server device 61: CPU 6(6a, 6b): Mobile terminal 61a: Code reading button 11: Touch panel monitor 61b: Shooting display column 11a: Display unit 61c: Button 11b: Touch panel 61d: Music title display column 12: Video RAM 61e: User name input column 13: Video control unit 61f: Predicted score input column 14: Memory 61g: Display setting switch 15: CPU 61h: Transmission button 16: Wireless LAN communication unit 61i: Message selection button 17: Operation unit 61j: Message input column 18: Operation processing unit 61k: Sending button 21: Operation unit 61l: Number of inspection points 22: Operation processing unit 61m: Predicted score 24a: LAN communication unit 61n: Score difference 24b: Wireless LAN communication unit 61o: Rank 25: Audio control unit 61p: Return button 27: Memory 62: RAM 28: Video RAM 63: Storage unit 29: Image forming unit 64: Image processing unit 30: CPU 65F: Front camera 31: Video control unit 65R: Rear camera 32: Hard disk 66: Audio processing unit 33: Touch panel monitor 67a: Speaker 34: Touch panel 67b: Microphone 35: Display unit 68(68a, 68b): Touch panel display unit 41: Monitor 681: Display unit 41a: Two-dimensional code 682: Touch panel 41b: Music name display column 69a: First communication unit 41c: Status display column 69b: Second communication unit 41d: Music title 70(70a, 70b): Input switch 41e: Lyrics 72: Vibration unit 41f: User-specific information display column 73: LED 41h: User-specific result information 130: Access point

Claims

1. Performance processing for performing a piece of music based on music data, Input reception processing for receiving an input from a user when the performance processing is performed, Storage processing for storing first data input from the user in the input reception processing, Generation processing for generating second data when the performance processing is performed, Image generation processing for generating a result image for the performed piece of music based on the first data and the second data after the performance processing ends, characterized by A karaoke system.

2. The input reception processing is executed during the performance processing The karaoke system according to claim 1.

3. The generation processing is executed after the performance processing ends The karaoke system according to claim 1.

4. A karaoke system comprising processing executed by a karaoke device and a mobile terminal communicatively connected to the karaoke device The karaoke system according to claim 1.

5. The karaoke device includes a storage unit, The performance processing, the storage processing, the generation processing, and the image generation processing are executed by the karaoke device, The input reception processing is executed by the mobile terminal, The storage processing stores the first data in the storage unit The karaoke system according to claim 4.

6. There are a plurality of the mobile terminals, The karaoke device is communicatively connected to the plurality of mobile terminals, The image generation processing generates a plurality of the result images corresponding to the respective plurality of mobile terminals The karaoke system according to claim 4.

7. The image generation processing generates a plurality of the result images including a device result image displayed on the karaoke device and a terminal result image different from the device result image and displayed on the mobile terminal The karaoke system according to claim 4.

8. The first data is evaluation prediction data indicating a predicted value predicted by the user for an evaluation value of singing voice or musical instrument performance, The second data is evaluation data indicating the evaluation value, The image generation processing generates the result image indicating the appropriateness of the prediction based on the evaluation prediction data and the evaluation data The karaoke system according to claim 1.

9. The input reception processing closes the reception of the first data at a predetermined first timing during the performance processing The karaoke system according to claim 1.

10. Message input reception processing for receiving input of a message, Execute message display processing for displaying the message received in the message input reception processing The karaoke system according to claim 1

11. Comprising a process executed by a karaoke device connected to a display unit The message display processing causes the display unit to display the message The karaoke system according to claim 10

12. The message input reception processing can be started from a predetermined second timing during the performance processing The karaoke system according to claim 10

13. Equipped with a storage unit Performance processing for performing a music based on music data Storage processing for storing first data input from a user in the storage unit when the performance processing is performed Generation processing for generating second data when the performance processing is performed After the end of the performance processing, an image generation processing for generating a result image for the performed music based on the first data and the second data is executed, characterized in that Karaoke device

Images