Karaoke equipment and karaoke programs

Abstract

The present invention provides a karaoke machine and karaoke program that can display lyrics as subtitles even when the karaoke machine at the second location does not have the lyric data corresponding to the karaoke performance sound stored in its memory. [Solution] The karaoke machine is capable of communicating with other karaoke machines and includes a processor and an HDD. The processor receives singing sounds and instrumental sounds from other karaoke machines and plays the received singing sounds and instrumental sounds (S104, S110, S113). If lyric data for displaying the lyrics of a song corresponding to the instrumental sound is stored in the HDD (S101: YES), the processor performs a first display process (S113) to display the lyrics based on the lyric data, and if lyric data for a song corresponding to the instrumental sound is not stored in the storage unit (S111: NO), the processor performs a second display process (S113) to display the lyrics based on alternative lyric data that replaces the lyric data.

Description

Technical Field

[0001] The present invention relates to a karaoke device and a karaoke program.

Background Art

[0002] The karaoke device at the first base described in Patent Document 1 transmits, to the karaoke device at the second base, a mixed sound signal obtained by mixing the singing sound signal and the performance sound signal from the karaoke device at the first base. The karaoke device at the second base reproduces the singing sound and the performance sound based on the received mixed sound signal. The karaoke device at the second base displays lyrics telop based on stored lyrics data.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0004] The invention disclosed in Patent Document 1 has a problem that the lyrics telop cannot be displayed when the karaoke device at the second base does not store the lyrics data corresponding to the karaoke performance sound.

[0005] An object of the present invention is to provide a karaoke device and a karaoke program capable of displaying a telop even when lyrics data corresponding to performance sound received from another device is not stored.

Means for Solving the Problems

[0006] A karaoke device according to a first aspect of the present invention is a karaoke device capable of communicating with other karaoke devices via a network, and comprises a control unit and a storage unit. The control unit performs a performance sound reception process for receiving performance sounds from the other karaoke device, and a performance sound playback process for playing the performance sounds received in the performance sound reception process. The control unit also performs a singing sound reception process for receiving singing sounds from the other karaoke device, and a singing sound playback process for playing the singing sounds received in the singing sound reception process. Furthermore, if lyric data for displaying lyrics of a song corresponding to the performance sound is stored in the storage unit, the control unit performs a first display process for displaying the lyrics based on the lyric data. Furthermore, if the lyric data for the song corresponding to the performance sound is not stored in the storage unit, the control unit performs a second display process for displaying the lyrics based on alternative lyric data that replaces the lyric data.

[0007] In some cases, the lyric data for a song corresponding to the performance sound received from another karaoke machine may not be stored in the memory unit. In the first embodiment, the lyrics are displayed as subtitles based on alternative lyric data. Therefore, the possibility of being unable to display the lyrics subtitles can be reduced.

[0008] A karaoke program according to a second aspect of the present invention is a karaoke program executed by the processor of a karaoke device comprising a processor and a storage unit, and capable of communicating with other karaoke devices via a network. The karaoke program performs a performance sound reception process for receiving performance sounds from the other karaoke device, and a performance sound playback process for playing the performance sounds received in the performance sound reception process. It also performs a singing sound reception process for receiving singing sounds from the other karaoke device, and a singing sound playback process for playing the singing sounds received in the singing sound reception process. Furthermore, if lyric data for displaying subtitles of the lyrics of a song corresponding to the performance sound is stored in the storage unit, a first display process is executed. In the first display process, the subtitles are displayed based on the lyric data. In the second display process, if the lyric data for the song corresponding to the performance sound is not stored in the storage unit, the subtitles are displayed based on alternative lyric data that replaces the lyric data.

[0009] In some cases, the song lyrics data corresponding to the performance sound received from another karaoke machine may not be stored in the memory unit. The karaoke program according to the second embodiment can display lyrics as subtitles based on alternative lyrics data. Therefore, the possibility of not being able to display the lyrics as subtitles can be reduced. [Brief explanation of the drawing]

[0010] [Figure 1] This is a diagram showing the configuration of karaoke system 2. [Figure 2] This is a functional block diagram of the karaoke system 2. [Figure 3] This is a flowchart of the server processing. [Figure 4] This is a flowchart for the scheduled playback process. [Figure 5] This is a timing chart for a specific example. [Figure 6] This is a timing chart for a specific example. [Figure 7] This is a flowchart for audio processing by other devices. [Figure 8]This is an explanatory diagram of the misalignment adjustment process. [Figure 9] This is an explanatory diagram illustrating a modified example of the misalignment adjustment process. [Modes for carrying out the invention]

[0011] The karaoke system 2 shown in Figure 1 is, for example, a commercial karaoke system 2 installed in a karaoke establishment. The karaoke system 2 has the function of playing karaoke songs (hereinafter simply referred to as songs) selected by the user of the karaoke system 2, along with a video that includes lyrics.

[0012] The karaoke system 2 comprises multiple karaoke devices 1 and a server 7. The karaoke devices 1 and the server 7 are connected to each other via an access point 5 and a LAN 10, forming a network. The karaoke devices 1 are connected to a network 9 via the LAN 10 and a router 6, and can send and receive data with the server 7. Each of the multiple karaoke devices 1 comprises a main unit 4 and a remote control device 3. The main unit 4 and the remote control device 3 of the karaoke device 1 are connected to each other via an access point 5 and a LAN 10, forming a network.

[0013] Karaoke device 1 is a device that plays songs according to reservation information received from remote control device 3, based on song data, in conjunction with video including lyrics. The song data includes MIDI (Musical Instrument Digital Interface) data, lyric data, and video data.

[0014] MIDI data is data that represents the musical score of a song according to the MIDI standard. MIDI data specifies, at a minimum, the pitch and the duration for which the MIDI sound source outputs the sound for each individual note output from the MIDI sound source. The pitch is what is known as the note number. Lyrics data is data related to the lyrics of the song, including the characters that make up the lyrics and the timing for outputting those characters. Video data represents the background video that is displayed in sync with the playback of the song.

[0015] The main body 4 of the karaoke apparatus 1 includes a first SoC 40, a second SoC 50, a microcomputer 60, a switch 21, an effect mixing unit 12, and an interface 15. The main body 4 further includes an infrared communication unit 16, a wireless LAN communication unit 17, a LAN communication unit 18, an operation unit 19, and a hard disk drive (HDD) 20. Each of the first SoC 40, the second SoC 50, and the microcomputer 60 is a SoC (System on a Chip) having a CPU as a control unit and a memory. Each of the first SoC 40, the second SoC 50, and the microcomputer 60 is a chip integrating functions necessary for controlling the karaoke apparatus 1.

[0016] The first SoC 40 includes a first CPU 41, a first storage unit 42, and a first RAM 43. The second SoC 50 includes a second CPU 51, a second storage unit 52, and a second RAM 53. The first SoC 40, the second SoC 50, and the microcomputer 60 are each connected to the effect mixing unit 12, the infrared communication unit 16, the wireless LAN communication unit 17, the LAN communication unit 18, the operation unit 19, and the HDD 20 via the interface 15. The first SoC 40, the second SoC 50, and the microcomputer 60 can communicate with each other via the interface 15.

[0017] Each of the first SoC 40 and the second SoC 50 of the present embodiment has a video output function. The OS (Operating System) booted on the first SoC 40 is a first OS, and the OS booted on the second SoC 50 is a second OS different from the first OS. The first OS of the present embodiment is Linux (registered trademark). Linux (registered trademark) is an OS that has been used in karaoke apparatuses for many years, and legacy application programs for karaoke apparatuses are created to operate on the first OS. Hereinafter, the application program is simply referred to as "app".

[0018] The second OS of the present embodiment is Android (registered trademark). Android is an operating system on which numerous applications have been developed and are used along with the distribution of smartphones and the like. The karaoke device 1 of the present embodiment switches between causing the first SoC 40 to display an image and causing the second SoC 50 to display an image in accordance with the application to be used, in order to make use of the characteristics of both operating systems. When the first CPU 41 and the second CPU 51 are not distinguished, they are also referred to as the processor 11. When the first storage unit 42 and the second storage unit 52 are not distinguished, they are also referred to as the storage unit 14. The storage unit 14 stores settings necessary for executing various processes executed by the karaoke device 1.

[0019] The switch 21 is connected to each of the first SoC 40 and the second SoC 50. The switch 21 outputs, to the display device 22, an image based on the image data output from the first SoC 40 or the second SoC 50. Which of the first SoC 40 and the second SoC 50 outputs the image data to the switch 21 is switched by the first SoC 40 or the second SoC 50.

[0020] The effect mixing unit 12 mixes, on the basis of MIDI data, the music reproduced by the first SoC 40 or the second SoC 50 and the voice input from the microphone 23. The effect mixing unit 12 outputs the mixed sound to the speaker 24. The effect mixing unit 12 may have a function of imparting effects such as echo to the reproduced music and voice.

[0021] The infrared communication unit 16, the wireless LAN communication unit 17, and the LAN communication unit 18 function as a communication unit of the karaoke device 1, and can communicate with various configurations external to the karaoke device 1. The karaoke device 1 of the present embodiment uses the infrared communication unit 16 to communicate with the remote control device 3 and receives reservation information from the remote control device 3. The karaoke device 1 uses the LAN communication unit 18 to be wired-connected to the LAN 10 and connected to the network 9. When the LAN 10 is not available, the karaoke device 1 can connect to the network 9 using the wireless LAN communication unit 17.

[0022] The operation unit 19 can accept various inputs from the user. Requests received from the operation unit 19 are used for various processes of the first SoC 40 or the second SoC 50. The HDD 20 is a non-volatile storage device that stores various information such as information downloaded from the server 7, lyrics data, background video, contract information, and multiple applications that can be executed on the karaoke device 1.

[0023] The remote control device 3 receives song selections from the user and transmits reservation information specifying the selected song to the main unit 4 of the karaoke machine 1. The remote control device 3 can receive various information from the karaoke machine 1, the server 7, or the external device 8 and execute various processes. The remote control device 3 comprises a control unit 31, a storage unit 32, a wireless LAN communication unit 33, an infrared communication unit 34, an operation unit 35, an operation processing unit 36, a video RAM 37, a video control unit 38, a touch panel 39, and an image sensor 30. The control unit 31 is responsible for the various processes of the remote control device 3. The storage unit 32 stores the database required for song selection processing, various programs, and various information generated in conjunction with program execution.

[0024] The wireless LAN communication unit 33 and the infrared communication unit 34 each function as communication units for the remote control device 3 and can communicate with various external components of the remote control device 3. The wireless LAN communication unit 33 connects wirelessly to the access point 5. The remote control device 3 is pre-associated with a specific karaoke machine 1. Various commands output from the remote control device 3 are received by the associated karaoke machine 1. The remote control device 3 can transmit reservation information and other data to the karaoke machine 1 using the infrared communication unit 34.

[0025] The control unit 35 and the touch panel 39 are user interfaces that receive various instructions from the user. The touch panel 39 has a display unit and a touch screen. The touch panel 39 displays various interfaces on its display unit and can also receive touch input from the user.

[0026] The video control unit 38 forms the image to be displayed on the touch panel 39. The video RAM 37 temporarily stores the video information to be displayed on the touch panel 39. The operation processing unit 36 ​​outputs a signal to the control unit 31 in response to input from the touch panel 39 or the operation unit 35. The image sensor 30 is a digital camera equipped with an image sensor such as a CCD or CMOS and an imaging lens. The image sensor 30 is used, for example, to photograph a two-dimensional code. The two-dimensional code may be appropriately selected from QR code (registered trademark), VeriCode, CP code, AztecCode, and PDF417, etc. In this embodiment, the two-dimensional code is a QR code.

[0027] Server 7 is a server capable of communicating with at least the karaoke machine 1. Server 7 may be provided with physical hardware. Server 7 may be implemented using a cloud service from a third party different from the vendor of the karaoke machine 1, or a combination of both. Server 7 may also be a cloud service provided by the vendor of the karaoke machine 1. Server 7 comprises a CPU 71, ROM 72, RAM 73, memory 74, communication unit 75, and input / output (I / O) interface 77. The CPU 71 is electrically connected to the ROM 72, RAM 73, memory 74, communication unit 75, and I / O interface 77 via a bus 76.

[0028] The CPU 71 controls the server 7. The ROM 72 stores the boot program and BIOS, etc. The CPU 71 stores temporary data in the RAM 73. The memory 74 is a non-volatile memory device that stores the transmission list 741 and the server reservation list 742, which are updated in response to requests sent from the karaoke machine 1.

[0029] The transmission list 741 stores information for each virtual room that identifies the karaoke machine 1 to which the server reservation list 742 is to be sent. The information that identifies the karaoke machine 1 in this embodiment is a user ID that identifies the user using the karaoke machine 1. The user ID does not have to identify the individual user using the karaoke machine 1. The user ID only needs to be able to identify the karaoke machine 1. A virtual room is a karaoke room that is created virtually. By registering their user ID in the virtual room, a user of the karaoke machine 1 can share audio and video with other users of the karaoke machine 1 registered in the virtual room via the server 7 and perform karaoke.

[0030] The server reservation list 742 registers reservation information transmitted from the karaoke machine 1 corresponding to the user ID registered in the virtual room in the order it is received. The reservation information in this embodiment includes the song ID and the user ID of the user who will sing the song indicated by the song ID. The song ID is identification information that indicates the song to be played.

[0031] The communication unit 75 is an interface for connecting the server 7 to the network 9. The CPU 71 can send and receive data to and from other devices connected to the network 9, such as the karaoke machine 1, via the communication unit 75. When the server 7 receives a start request from the karaoke machine 1, it registers the user ID of the karaoke machine 1 in the transmission list 741.

[0032] When Server 7 receives a stop request from Karaoke Machine 1, it removes the user ID of Karaoke Machine 1 from the transmission list 741. When Server 7 receives an add request from Karaoke Machine 1, it registers the reservation information sent from Karaoke Machine 1 in the server reservation list 742. When Server 7 receives a delete request from Karaoke Machine 1, it removes the reservation information sent from Karaoke Machine 1 from the server reservation list 742.

[0033] The karaoke device 1 of the karaoke system 2 receives a mode change instruction from the remote control device 3, which indicates how the karaoke device 1 is being used. The karaoke device 1 can perform the process of playing songs in both the first mode and the second mode. The first mode is a mode in which songs are played on a single karaoke device 1. In the second mode, reservation information is shared with other karaoke devices 1 registered in the virtual room via the server 7, using the server reservation list 742 transmitted from the server 7. The second mode is a mode in which songs are played according to the server reservation list 742.

[0034] As shown in Figure 2, the first CPU 41 of the karaoke device 1 functions as a performance control unit 113, a reservation / status control unit 114, a communication unit for the second mode 116, and an application control unit 117. IF 15 functions as a song reservation IF 111, an application launch IF 112, and a second mode change IF 115. The second CPU 51 functions as a request transfer unit 118, a PF communication unit 119, and a server communication unit 120. The control unit 31 of the remote control device 3 functions as the main processing unit 311. The server 7 functions as a periodic execution unit 711, a processing unit 712, and a server usage authentication unit 713.

[0035] The remote control device 3 displays a settings screen (not shown) and inputs a command to the main unit 4 of the karaoke device 1 to start or stop the app. If the app start IF 112 receives a command to start the app, the app control unit 117 starts the second mode app. The started second mode app sends a command to the second mode change IF 115 to set the mode to second mode. The second mode change IF 115 instructs the reservation / status control unit 114 to set the mode to second mode. If the app start IF 112 receives a command to stop the app, the second mode app sends a command to the second mode change IF 115 to set the mode to first mode. The second mode change IF 115 instructs the reservation / status control unit 114 to set the mode to first mode. The app control unit 117 then stops the second mode app.

[0036] This section outlines the process of playing a song in the first mode, which is executed on the karaoke machine 1. The remote control device 3 provides various information by displaying video information on the touch panel 39. The remote control device 3 receives various inputs from the user via the touch panel 39 or the operation unit 35 and transmits song reservation information to the karaoke machine 1.

[0037] When the karaoke machine 1 receives reservation information from the main processing unit 311 of the remote control device 3 via the song reservation IF 111, it registers the song reservation information specified in the received reservation information into the device reservation list 421.

[0038] When the performance control unit 113 receives reservation information from the remote control device 3, it retrieves the reservation information registered in the device reservation list 421 from the external device 8 or HDD 20 in the order of registration and plays it back. The performance control unit 113 mixes the music played back based on the MIDI data with the vocal sound input from the microphone 23 in the effects mixing unit 12. The performance control unit 113 outputs the mixed sound from the speaker 24. Based on the lyrics data and video data, the performance control unit 113 displays the lyrics of the music and the video overlaid on the background video on the display device 22 in synchronization with the playback of the music.

[0039] This section outlines the process of playing songs in the second mode, which is executed on the karaoke machine 1. The remote control device 3 provides various information by displaying video information on the touch panel 39. The main processing unit 311 of the remote control device 3 receives various inputs from the user via the touch panel 39 or the operation unit 35 and transmits song reservation information to the karaoke machine 1.

[0040] When the reservation / status control unit 114 receives reservation information from the remote control device 3 via the song reservation IF 111, it does not register the song specified in the received reservation information in the device reservation list 421. The reservation / status control unit 114 forwards the request to the request forwarding unit 118 of the second mode application via the second mode communication unit 116. The request forwarding unit 118 transmits the request to the server 7 via the server communication unit 120. When the communication unit 75 of the server 7 receives an additional request from the karaoke device 1, the server usage authentication unit 713 performs authentication, and the processing unit 712 adds the additional request to the server reservation list 742.

[0041] The communication unit 75 of server 7 transmits the modified server reservation list 742 to all karaoke devices 1 registered in the transmission list 741. When the server communication unit 120 of karaoke device 1 receives the server reservation list 742 transmitted from server 7, it forwards the server reservation list 742 to the second mode change IF 115 via the PF communication unit 119.

[0042] The reservation / status control unit 114 registers the reservation information for a song to be sung on the karaoke machine 1 in the device reservation list 421 if the reservation information registered in the server reservation list 742 is for a song to be sung on the karaoke machine 1. The performance control unit 113 of the karaoke machine 1 receives the song from the device reservation list 421 via the external device 8 and plays it using the song data stored on the HDD 20. The performance control unit 113 mixes the song played based on the MIDI data with the singing sound input from the microphone 23 in the effects / mixing unit 12. The performance control unit 113 outputs the mixed sound from the speaker 24.

[0043] The performance control unit 113 transmits the mixed playback sound and vocal sound of the song to the other karaoke device 1 via the server 7 through the second mode communication unit 116, the request transfer unit 118, and the server communication unit 120. If the reservation information registered in the server reservation list 742 transmitted from the server 7 is for a playback song that will be sung on the other karaoke device 1, rather than a song to be sung, the karaoke device 1 does not register the playback song reservation information in the device reservation list 421. In this case, the karaoke device 1 plays the playback sound and vocal sound of the song that has been mixed by the other karaoke device 1 and transmitted from the other karaoke device 1 to the karaoke device 1. In other words, in the karaoke system 2 of this embodiment 1, when the mode of the karaoke device 1 is the second mode, singing is possible on only one of the multiple karaoke devices 1 registered in the virtual room.

[0044] <Server Processing> Referring to Figure 3, the server processing performed on server 7 will be explained. Server 7 performs server processing when it is started. When server 7 starts, the CPU 71 of server 7 reads a program for performing server processing from memory 74. The CPU 71 performs the following steps according to the instructions contained in the program. The program contains instructions for the CPU 71 to perform the following processes. Various data obtained during the server processing are stored in a temporary area of ​​RAM 73.

[0045] As shown in Figure 3, the CPU 71 of the server 7 determines whether or not it has received a start request sent from the karaoke machine 1 connected via the network 9 (S1). The start request is a request to start subscribing in order to receive the server reservation list 742 from the server 7. The server reservation list 742 is a list that stores reservation information sent by the karaoke machine 1 to the server 7 and reservation information sent by other karaoke machines 1 to the server 7. In this embodiment, the start request includes a user ID as information that identifies the karaoke machine 1 to subscribe to the server reservation list 742, and a room ID as information that identifies the virtual room. The start request does not have to include a user ID, and may include other information, such as the address information of the karaoke machine 1, as information that identifies the karaoke machine 1 to subscribe to the server reservation list 742.

[0046] If a start request is received (S1: YES), the CPU 71 adds the user ID of the karaoke machine 1 that sent the start request to the transmission list 741 in memory 74 (S2). Once the user ID of the karaoke machine 1 is added to the transmission list 741, registration to the virtual room is completed. This initiates a subscription process that sends the server reservation list 742 to the karaoke machine 1 that sent the start request whenever there are changes to the server reservation list 742. The CPU 71 then performs the process in S5.

[0047] If no start request has been received (S1:NO), the CPU 71 performs the process in S3. The CPU 71 determines whether or not it has received a stop request sent from the karaoke machine 1 connected via the network 9 (S3). A stop request is a request to the server 7 to stop the subscription. The stop request includes information to identify the karaoke machine 1 whose subscription is to be stopped, and information to identify the virtual room. In this embodiment, the stop request includes the room ID and user ID of the karaoke machine 1.

[0048] If a stop request is received (S3:YES), the CPU 71 removes the user ID of the karaoke machine 1 that sent the stop request from the transmission list 741 (S4). Once the user ID of karaoke machine 1 is removed from the transmission list 741, registration to the virtual room is completed. The user ID of karaoke machine 1 may be removed from the transmission list 741. In this case, even if there is a change in the server reservation list 742, the server reservation list 742 will not be sent to the karaoke machine 1 that sent the deletion request. The CPU 71 then performs the processing in S5.

[0049] If no stop request has been received (S3:NO), the CPU 71 performs the process in S5. The CPU 71 determines whether or not it has received an additional request sent from the karaoke machine 1 connected via the network 9 (S5). The additional request is a request to register reservation information, which includes information identifying the song reserved on the karaoke machine 1, in the server reservation list 742. The additional request includes the reservation information and the user ID of the user who will sing the song indicated in the reservation information.

[0050] If an additional request is received (S5:YES), the CPU 71 determines whether the number of reservation information stored in the server reservation list 742 has reached the maximum number (S9). The maximum number can be set as appropriate, and may be set by the user of the karaoke machine 1 or set in advance by the server 7. If a usage period for the virtual room is set, the server 7 may set the maximum number according to the usage period, such as the number that fits within the usage period.

[0051] If the maximum number of reservation information has been reached (S9: YES), the CPU 71 does not store the reservation information specified in the additional request in the server reservation list 742. The CPU 71 sends a notification to the karaoke machine 1 that sent the additional request (S10). The notification in S10 indicates that the number of reservation information stored in the server reservation list 742 has reached the maximum number, and that the reservation information could not be added to the server reservation list 742 in response to the additional request. The CPU 71 returns processing to S1.

[0052] If the number of reservations has not reached the maximum number (S9:NO), the CPU 71 adds the reservation information specified in the additional request to the server reservation list 742 (S11). The CPU 71 sends the updated server reservation list 742 from S4 to all karaoke machines 1 registered in the transmission list 741 (S12). The CPU 71 returns to processing S1.

[0053] If no additional requests have been received (S5: NO), the CPU 71 performs the process in S6. The CPU 71 determines whether or not it has received a deletion request from the karaoke machine 1 connected via the network 9 (S6). A deletion request is a request to delete the reservation information specified in the deletion request from the server reservation list 742. The deletion request includes the reservation information and the user ID of the user who will sing the song indicated in the reservation information. If a deletion request has been received (S6: YES), the CPU 71 deletes the reservation information specified in the deletion request from the server reservation list 742 (S7).

[0054] The CPU 71 sends a notification to the karaoke machine 1 that sent the deletion request, indicating that the reservation information stored in the server reservation list 742 has been deleted (S8). The CPU 71 sends the updated server reservation list 742 from S7 to all karaoke machines 1 registered in the transmission list 741 (S12). If no deletion request has been received (S6:NO), or immediately after S12, the CPU 71 returns to processing S1.

[0055] <Scheduled Playback Processing> Referring to Figures 4 to 6, the reserved playback process performed by karaoke machine 1 will be explained. Karaoke machine 1 starts the reserved playback process when it is started up. As a concrete example of the reserved playback process, we will use the case shown in Figures 5 and 6, where karaoke machine 1A and karaoke machine 1B each register in a virtual room and reserve and play songs. At timing T1, karaoke machine 1A sends a start request to server 7 and registers in the virtual room. Of karaoke machine 1A and karaoke machine 1B, the machine that performs the reserved playback process is also called "its own machine," and the other karaoke machine 1 is also called "the other machine." The following will explain the case where the reserved playback process is performed by karaoke machine 1A.

[0056] In the transmission list 741 in Figure 5, and the server reservation list 742 in Figures 5 and 6, "A" indicates the user ID of karaoke machine 1A, and "B" indicates the user ID of karaoke machine 1B. In the server reservation list 742 in Figure 5, song X, song Y, and song Z each indicate the song ID. In the transmission list 741 and server reservation list 742 in Figures 5 and 6, the room ID is not shown. In the server reservation list 742 in Figures 5 and 6, the top row of the server reservation list 742 is the beginning of the server reservation list 742.

[0057] When the karaoke machine 1 is started up, the processor 11 of the karaoke machine 1 reads a program for executing the reserved playback process from the storage unit 14. The processor 11 executes the following steps according to the instructions contained in the program. The program includes instructions for the processor 11 to perform the following processes. Various data obtained during the mode setting process are stored in the temporary area of ​​the first RAM 43 or the second RAM 53.

[0058] As shown in Figure 4, the processor 11 determines whether or not reservation information has been detected based on the signal transmitted from the remote control device 3 (S61). The remote control device 3 transmits the reservation information to the server 7 either via wireless communication using the wireless LAN communication unit 17 or via infrared communication using the infrared communication unit 16. The process in S61 is a reservation acceptance process that accepts the reservation of a song.

[0059] In the reservation acceptance process of S61, the processor 11 communicates with the remote control device 3 using a wireless communication method, receives data that does not include mode information, and accepts the reservation of a song. The processor 11 may also be configured to communicate with the remote control device 3 using an infrared communication method, receive data that does not include mode information, and accept the reservation of a song.

[0060] If no reservation information is detected from the remote control device 3 (S61: NO), the processor 11 performs the process in S90. The processor 11 determines whether the mode stored in the memory unit 14 is the second mode (S90). If the mode is not the second mode (S90: NO), the processor 11 performs the process in S93, which will be described later. If the mode is the first mode (S90: YES), the processor 11 performs the process in S66, which will be described later.

[0061] If reservation information is detected (S61: YES), the processor 11 determines whether the mode is the second mode or not (S62). If a song reservation is received during the period when the mode is the first mode (S62: NO), the processor 11 performs the process in S91. The processor 11 performs the first mode addition process, which adds the song reservation information transmitted from the remote control device 3 to the device reservation list 421 (S91). The processor 11 displays the reservation result on the screen of the touch panel 39 of the remote control device 3 or on the display device 22 (S92).

[0062] The processor 11 determines whether it is time to start playing a song based on the reservation information registered in the device reservation list 421 (S93). The timing to start playing a song is, for example, when reservation information is registered in the device reservation list 421, no other songs are being played, and a playback start instruction has been detected. If it is time to start playing a song (S93: YES), the processor 11 performs the process in S94.

[0063] When the mode is the first mode, the processor 11 performs first-mode playback processing to play the music from the reserved information stored in the device reservation list 421 (S94). Specifically, the processor 11 starts playing the music from the reserved information registered in the device reservation list 421 that is next in registration order (S94). The registration order defines the playback order of the music.

[0064] The processor 11 mixes the music played based on MIDI data with the vocal sound input from the microphone 23 in the effects mixing unit 12. The mixed sound is output from the speaker 24. Based on the lyrics data and video data, the processor 11 displays the lyrics of the music on the display device 22, overlaid on the background video, in synchronization with the playback of the music. The processor 11 then performs the processing described in S98.

[0065] If it is not time to start playing the music (S93: NO), the processor 11 determines whether it is time to end music playback (S95). The processor 11 determines that it is time to end music playback, for example, when the playback of music according to MIDI data has finished. If it is time to end music playback (S95: YES), the processor 11 ends music playback (S96). The processor 11 removes the reservation information of the music that has finished playing from the device reservation list 421 (S97). If it is not time to end music playback (S95: NO), or after S97, the processor 11 performs the process in S98.

[0066] If the processor 11 receives a reservation for a song while the mode is in the second mode (S61:YES, S62:YES), it executes the process in S63. The processor 11 executes the server transmission process to send the reservation information to the server 7 (S63). In the specific example shown in Figure 11, the processor 11 does not add the reservation information for song X, which was reserved at timing T2, to the device reservation list 421. The processor 11 sends an add request to the server 7 requesting that the reservation information for song X be added to the server reservation list 742 (S63).

[0067] In response to the additional request, the processor 11 determines in processing S10 whether or not it has received a notification from the server 7 (S64). If a notification is received (S64: YES), the processor 11 displays the reservation result on the touch panel 39 screen or the display device 22 based on the received notification (S65). For example, the processor 11 displays a message as the reservation result on the touch panel 39 screen or the display device 22, such as "Reservations cannot be made because the maximum number of reservations has been reached."

[0068] If no notification is received (S64:NO), or after processing S65, the processor 11 performs the processing in S66. The processor 11 performs a receive process to receive the server reservation list 742 from the server 7 (S66). The server reservation list 742 stores the reservation information sent by karaoke device 1 to the server 7 and the reservation information sent by other karaoke devices 1 to the server 7. If the server reservation list 742 is not received (S66:NO), the processor 11 performs the processing in S98.

[0069] In response to sending an additional request to the server 7 at timing T2 of the specific example requesting that the reservation information for song X be added to the server reservation list 742, the processor 11 receives the server reservation list 742 sent from the server 7 at timing T3 (S66:YES).

[0070] The processor 11 determines whether the server reservation list 742 received in S66 is empty (S67). If no reservation information is registered in the server reservation list 742, it determines that the server reservation list 742 is empty. If the server reservation list 742 is empty (S67: YES), the processor 11 clears the currently playing reservation information stored in the storage unit 14 (S68).

[0071] The "Playback Reservation Information" is a state variable that indicates whether the song to be sung is currently being played or not being played on the karaoke machine 1. If reservation information for a song to be sung is set in the "Playback Reservation Information," then the "Playback Reservation Information" indicates that the song to be sung is currently being played on the karaoke machine 1. If no reservation information is set in the "Playback Reservation Information" and it is cleared, then the "Playback Reservation Information" indicates that the song to be sung is not being played on the karaoke machine 1. The process of S68, when executed after S88, is a variable setting process that changes the state variable indicating whether the song to be sung is currently being played or not being played on the karaoke machine 1 to "not being played." After the process of S68, the processor 11 performs the process of S98.

[0072] The processor 11 determines that the server reservation list 742 sent from the server 7 at timing T3 contains reservation information for song X and that the server reservation list 742 is not empty (S67: NO). In this case, the processor 11 determines whether the first reservation information among the reservation information registered in the server reservation list 742 is reservation information for a song to be sung by the karaoke machine 1A, that is, by the machine itself (S71).

[0073] The first reservation information is the reservation information with the lowest registration order among the reservation information registered in the server reservation list 742. The processor 11 determines that the reservation is for the local device if the user ID included in the first reservation information among the reservation information registered in the server reservation list 742 is a user ID registered in the local device. If the user ID included in the first reservation information is a user ID registered in the local device, it means that the song indicated by the song ID included in the first reservation information is to be sung on the local device. In the specific example, the first reservation information in the server reservation list 742 sent from the server 7 at timing T3 is the reservation information for a song to be sung (S71: YES). In this case, the processor 11 determines whether the song with the first reservation information among the reservation information registered in the server reservation list 742 is currently being played (S72). In S72, the determination is made based on whether or not reservation information is set in the currently playing reservation information. Specifically, if a song is scheduled to be played in the currently playing reservation information, it is determined that the song is currently playing. If no song is scheduled to be played in the currently playing reservation information, it is determined that the song is not currently playing.

[0074] If the song listed as the first reservation is not currently playing (S72: NO), the processor 11 performs the process in S74 if the first reservation in the server reservation list 742 is a song reservation (S71: YES). At timing T4, the processor 11 performs a second mode addition process to add the reservation information to the device reservation list 421 (S74).

[0075] Processor 11 determines whether the reservation was successful or not (S75). If the first reservation information from the reservation information registered in the server reservation list 742 is added to the device reservation list 421, processor 11 determines that the reservation was successful. If the reservation was successful (S75: YES), processor 11 sets the reservation information registered in the device reservation list 421 to the currently playing reservation information (S76). As a result of the process in S76, the currently playing reservation information indicates that a song is currently being played on the karaoke device 1. At timing T5, processor 11 starts playing the song indicated by the reservation information registered in the device reservation list 421 by the same process as in S94 (S77).

[0076] At timing T6, processor 11 starts the process of sending the singing sound to another karaoke device 1B, i.e., another device (S78). In this embodiment, processor 11 sends the playback sound of the song and the singing sound of karaoke device 1 to other karaoke device 1. Processor 11 also sends information to other karaoke device 1 indicating the start of playback, information indicating the progress during playback, and information indicating the end of playback. More specifically, karaoke device 1 sends a sound to other karaoke device 1 that is a combination of the singing sound and the playback sound of the song. As a result of this process, karaoke device 1B plays a sound in which the singing sound of karaoke device 1A and the playback sound of the song are mixed. In this embodiment, processor 11 sends the singing sound to other karaoke device 1B via server 7. Through the processing in S77 and S78, processor 11 performs a first playback process in which it plays the song and sends the singing sound of karaoke device 1 to other karaoke device 1.

[0077] If the reservation is unsuccessful (S75: NO), processor 11 performs the process in S79. Processor 11 sends a delete request to server 7 requesting that the reservation information for which the reservation was unsuccessful be removed from the server reservation list 742 (S79). After S78 or S79, processor 11 performs the process in S98.

[0078] While the song indicated by song X, which was started at timing T5, is playing, an additional request is sent from the karaoke device 1B to the server 7. The processor 11 receives the server reservation list 742 at timing T7 shown in Figure 11 and timing T8 shown in Figure 6 (S66: YES, S67: NO, S71, S72: YES). In this case, the processor 11 determines in S72 that the song with the first reservation information in the server reservation list 742 is currently playing (S72: YES).

[0079] The reservation information indicated in the server reservation list 742 received from server 7 may be reservation information for a song to be sung. In this case, processor 11 does not change the device reservation list 421 while the first playback process is being executed (S72:YES). Processor 11 then decides whether or not to terminate playback of the song, similar to S96 (S84). If playback of the song is not to be terminated (S84:NO), processor 11 performs the process in S98.

[0080] If it is determined that playback of the song indicated by song X should be terminated (S84: YES), the processor 11 performs the process in S85. At timing T9, the processor 11 terminates the song playback started in the process in S77 and the vocal sound transmission started in the process in S78 (S85). The processor 11 deletes the reservation information for song X, which has been terminated, from the device reservation list 421 (S86). At timing T10, the processor 11 executes a deletion request transmission process to send a deletion request to the server 7 if the song playback has been terminated in the first playback process (S87). The deletion request is a request to delete the reservation information for the vocal song from the server reservation list 742 stored in the server 7.

[0081] Processor 11 determines whether it has received a success notification from server 7 in response to sending a deletion request to server 7 (S88). Processor 11 waits in S88 until it receives a success notification (S88:NO). If it receives a success notification (S88:YES), processor 11 performs the process in S98.

[0082] In this embodiment, the processor 11 receives a success notification from the server 7 that received the deletion request, indicating that the song to be sung has been deleted from the server reservation list 742 (S88:YES). Subsequently, the processor 11 executes the process in S82 in response to receiving the server reservation list 742 from which the song to be sung has been deleted in response to the deletion request (S66:YES). The processor 11 performs a deletion process to remove the reservation information of the song to be sung from the currently playing reservation information (S82). The process in S82, when executed after S88, is a variable setting process that changes the state variable indicating whether the song to be sung is currently being played or not being played on the karaoke device 1 to not being played.

[0083] In response to a deletion request sent from the karaoke device 1A to the server 7 at timing T10 (S87), the processor 11 receives the server reservation list 742 at timing T11 (S66: YES, S67: NO). At S71, the processor 11 determines that it is not reservation information for a song to be sung (S71: NO). In this case, at timing T12, the processor 11 deletes the reservation information for the song to be sung from the currently playing reservation information stored in the memory unit 14 (S82).

[0084] <Sound playback processing by other devices> At timing T13, processor 11 starts the other-device sound playback process to play back the singing and playing sounds transmitted from the other karaoke device 1A (S83). The process in S83 is the second playback process, which plays back the singing and playing sounds received from the other karaoke device 1A, in the second mode. The process in S83 is executed when the reservation information received from server 7 is reservation information for a playback song, which is a song to be sung on the other karaoke device 1A. As a result of the process in S83, the playback sound and singing sound of the song indicated by song Y, transmitted from karaoke device 1A, are also played back on karaoke device 1B. During the period when the mode is the second mode, processor 11 executes the first playback process (S77, S78) and the second playback process (S83).

[0085] The processor 11 performs the sound playback processing for other devices (S83) according to the flowchart of the sound playback processing for other devices shown in Figure 7. The processor 11 determines whether there is lyric data for the reserved song corresponding to the reservation information received from the server 7 (S101). If the song ID included in the reservation information is a song ID for which there is lyric data, the processor 11 determines that there is lyric data (S101: YES). Next, the processor 11 determines whether the lyric data has already been stored in the HDD 20 (S111). If the processor 11 does not determine that the lyric data has already been stored in the HDD 20 (S111: NO), it sends a request to the server 7 to acquire the lyric data and acquires the lyric data from the server 7 (S112).

[0086] If processor 11 obtains lyric data from server 7 (S112), it displays the lyric caption based on the lyric data (S113). Processor 11 plays back the singing and instrumental sounds received from the karaoke machine 1A, which is the singer's base (S113). However, the instrumental sounds may not be received from the karaoke machine 1A, and processor 11 may play them based on instrumental sound data. If lyric data is already stored (S111: YES), processor 11 displays the lyric caption based on the lyric data (S113). Processor 11 plays back the singing and instrumental sounds received from the karaoke machine 1A, which is the singer's base (S113). In S113, processor 11 displays the lyric caption using information received from the karaoke machine 1A, which is the singer's base, indicating the start of the performance, information indicating the progress during the performance, and information indicating the end of the performance.

[0087] If the song ID included in the reservation information is a song ID for which there is no lyrics data, the processor 11 determines that there is no lyrics data (S101: NO). Next, the processor 11 determines whether the reserved song is a special song (S102). A special song is a special song that is different from the regular songs normally used in the karaoke machine 1. An example of a special song is a song from a promotional video. Hereafter, a promotional video will also be referred to as a "PV". In the case of songs from promotional videos, the lyrics data may be included in the video data used as background footage, and the lyrics data may not be provided independently of the background footage.

[0088] If processor 11 determines that the reserved song is a special song (S102:YES), it determines whether its karaoke machine 1B has a contract that allows it to reserve special songs (S103). Depending on the contract with the company providing the karaoke service, karaoke machine 1B may only be able to play regular songs or it may also be able to play special songs. Therefore, if the contract does not allow it to reserve special songs (S103:NO), karaoke machine 1B cannot play special songs. Contract information indicating whether or not it has a contract that allows it to reserve special songs is stored on the HDD20 as an example. If processor 11 determines that its karaoke machine 1B has a contract that allows it to reserve special songs (S103:YES), it displays the background video and captions for the special song (S104). Note that there may be a contract that allows it to reserve some of the special songs out of several, in which case, in S103, it may be determined whether or not the contract allows it to reserve the song IDs included in the reservation information. Furthermore, in S103, instead of determining whether the karaoke machine 1B has a contract that allows it to reserve special songs, it may be determined whether it can reserve the song ID included in the reservation information.

[0089] The music video for the PV has lyrics embedded as images. Therefore, if the music video for the PV is displayed as the background image, the lyrics will be displayed. The processor 11 plays back the singing sound and playback sound received from the karaoke machine 1A, which is the singer's base (S104). In S104, the processor 11 uses the information received from the karaoke machine 1A, which is the singer's base, to indicate the start of the performance, the progress during the performance, and the end of the performance, and displays the video as the background image.

[0090] If the karaoke machine 1 does not have a contract that allows the reservation of special songs (S103: NO), the processor 11 determines whether there is a regular song that corresponds to the special song (S105). Information on whether there is a regular song that corresponds to the special song is stored in the HDD 20, for example. If the processor 11 determines that there is a regular song that corresponds to the special song (S105: YES), it obtains information on the regular song associated with the song ID of the special song (S107). An example of regular song information is the song ID. The processor 11 obtains the caption information corresponding to the song ID, which is the regular song information obtained in S107, from the HDD 20 (S108).

[0091] <Misalignment adjustment process> Next, processor 11 performs a timing adjustment process (S109). The timing adjustment process will be explained with reference to Figure 8. In the example shown in Figure 8, an example of a song for a promotional video is PV song M. The regular song corresponding to PV song M is regular song M'. For PV song M, the start timing of the song is T0, the start timing of playback is T1, and the end timing of playback is T2. In PV song M, there may be PV-specific video or audio between timings T0 and T1. For regular song M', the start timing of the song and the start timing of playback is T3, and the end timing of playback is T4.

[0092] In this case, if processor 11 starts displaying the text overlay for normal song M' from timing T0, it will be out of sync with the actual performance of PV song M. Therefore, processor 11 sets the start of displaying the text overlay for normal song M' to be delayed by a time of T0 to T1, shifting it to T1. The information for setting the start of displaying the text overlay for normal song M' to be delayed by T0 to T1 is stored in HDD 20 in advance.

[0093] Furthermore, as shown in Figure 9, the timing adjustment process may be performed by the processor 11 measuring the audio waveforms of PV song M and regular song M' to measure the amount of timing difference in the start of playback. Based on the measured amount of timing difference, the start timing of the text overlays for PV song M and regular song M' may be adjusted.

[0094] Following the timing adjustment process (S109), the processor 11 displays the title of the song M' as a caption (S110). The processor 11 plays back the vocal and playback sounds received from the karaoke machine 1A, which is the singer's base (S110). In S110, the processor 11 uses the information received from the karaoke machine 1A, which is the singer's base, to display the lyrics as captions. Furthermore, if the processor 11 does not determine that there is a regular song corresponding to the special song (S105: NO), it will not display the substituting lyrics data, which is the lyrics data of a regular song, instead of the substituting lyrics data of the PV song (S106). The substituting lyrics data is other lyrics data that replaces the lyrics data corresponding to the performance sound received from the karaoke machine 1A, which is the singer's base. In this embodiment, it is video information with embedded lyrics subtitles for the special song, or subtitle information for the corresponding regular song. If there is no regular song corresponding to the PV song, the substituting lyrics data cannot be displayed.

[0095] Processor 11 determines whether the music playback has ended after processing S104, S110, or S113 (S114). If processor 11 does not determine that the music playback has ended (S114: NO), it continues the determination process in S114. If processor 11 determines that the music playback has ended (S114: YES), it proceeds to S98 of the reserved playback process in Figure 4.

[0096] The processor 11 determines whether or not it has detected an instruction to terminate the scheduled playback process (S98). For example, the processor 11 determines that it has detected an instruction to terminate the scheduled playback process when it detects an instruction to turn off the power of the karaoke machine 1. If no instruction to terminate the scheduled playback process has been detected (S98: NO), the processor 11 returns to processing S61. If an instruction to terminate the scheduled playback process has been detected (S98: YES), the processor 11 terminates the scheduled playback process.

[0097] <Effects of the Embodiment> In the karaoke device 1 of the above embodiment, karaoke device 1A and karaoke device 1B can communicate via network 9. Karaoke device 1B receives performance sound and singing sound from the other karaoke device 1A and plays the received performance sound and singing sound (S103). If lyric data for displaying subtitles corresponding to the performance sound is stored (S101:YES), the processor 11 displays subtitles of the lyrics based on the lyric data (S113). If lyric data for displaying subtitles corresponding to the performance sound is not stored (S101:NO), the processor 11 displays subtitles of the lyrics based on alternative lyric data that replaces the lyric data (S104, S110, S113).

[0098] Therefore, if the lyrics data for a song corresponding to the performance sound received from another karaoke device 1 is not stored in a storage unit such as the HDD 20, the lyrics can be displayed as subtitles based on alternative lyrics data. Thus, the possibility of being unable to display the lyrics subtitles can be reduced.

[0099] Furthermore, in karaoke device 1, if the song ID, which is the identification information of the song corresponding to the sound played, is not associated with the lyrics data, which is the text data of the lyrics (S101:NO), the karaoke device 1 displays the lyrics as subtitles based on alternative lyrics data (S104, S110). Therefore, if the song identification information corresponding to the sound played, received from another karaoke device 1A, is not associated with the lyrics text data (S101:NO), the lyrics can be displayed as subtitles based on alternative lyrics data. Thus, the possibility of not being able to display the lyrics as subtitles can be reduced.

[0100] Furthermore, in karaoke device 1, the correspondence between song IDs for different versions of the same song is stored in HDD 20. The processor 11 displays subtitles as alternative lyric data based on the lyric data associated with the song ID of a different version of the same song that corresponds to the performance sound. Therefore, if the lyric data for the song corresponding to the performance sound received from another karaoke device 1A is not stored in HDD 20, the subtitles can be displayed based on the lyric data associated with the song ID of a different version of the same song. Thus, the possibility of being unable to display the subtitles is reduced.

[0101] Furthermore, the music video for the PV (promotional video) has lyrics embedded as images. Therefore, the processor 11 can display the lyrics based on the lyrics data embedded in the music video for the PV, which corresponds to the song identification information corresponding to the performance sound, as alternative lyric data. Thus, the possibility of being unable to display the lyrics can be reduced.

[0102] Furthermore, if the processor 11 does not have lyric data stored in the HDD 20, it may obtain alternative lyric data from another karaoke device 1A. In this case, the processor 11 can display lyric subtitles based on the alternative lyric data obtained from the other karaoke device 1A. Therefore, the possibility of being unable to display lyric subtitles can be reduced.

[0103] If the processor 11 cannot obtain video data corresponding to the song ID of the song corresponding to the sound being played under contract (S103: NO), it displays subtitles based on alternative lyric data (S110). The alternative lyric data is lyric data associated with the song ID of a different version of the same song as the song corresponding to the sound being played. Therefore, the possibility of not being able to display the lyrics subtitles can be reduced.

[0104] The processor 11 can receive song IDs, which are song reservation information, from other karaoke devices 1 via the server 7 connected to the network 9 (S66). Therefore, the processor 11 can determine, based on the received song ID, whether the lyrics data for the song corresponding to the sound being played is stored in the HDD 20 (S101).

[0105] Processor 11 can perform a timing adjustment process to correct the timing of the start of the subtitle display in order to eliminate the timing discrepancy in the start of the song's vocal performance (S109). In PV songs, there may be data at the beginning of the song that is different from the song's performance, or the time between the first and second verses may differ. However, by performing a timing adjustment process to correct the start of the subtitle display for the alternative song, the timing discrepancy in the start of the vocal performance can be eliminated.

[0106] In the above embodiment, the HDD 20 is an example of the "storage unit" of the present invention. The processor 11 is an example of the "control unit" of the present invention. S104, S110, and S113 are examples of the "performance sound reception processing," "performance sound playback processing," "singing sound reception processing," and "singing sound playback processing" of the present invention. The processing in S113 is an example of the "first display processing" of the present invention. The processing in S104 and S110 are examples of the "second display processing" of the present invention. The processing in S109 is an example of the "screencap display adjustment processing" of the present invention.

[0107] <Variation> The above modifications may be combined as appropriate, provided they are not contradictory. In addition to the combinations exemplified in the claims, the applicant intends to obtain patent rights for embodiments that combine each other in a manner that does not depart from the spirit of the present invention and is not contradictory.

[0108] If the processor 11 cannot obtain video data corresponding to the song ID of the song corresponding to the sound being played from the HDD 20, it may obtain the video data from another karaoke device 1A. In this case, subtitles can be displayed based on the lyrics data embedded in the obtained video data. Therefore, the possibility of not being able to display the lyrics subtitles can be reduced. Also, even if S103 is NO, the processor 11 may obtain video data corresponding to the song ID of the song corresponding to the sound being played from another karaoke device 1A.

[0109] If the processor 11 has a song ID for a song corresponding to the sound being played that is associated with text data of lyrics, and the lyrics data for the song corresponding to the sound being played is not stored in the HDD 20, it may retrieve the lyrics data from the server 7 connected to the network 9. In this case, the subtitles can be displayed based on the retrieved lyrics data. Therefore, the possibility of being unable to display the lyrics subtitles can be reduced.

[0110] In the misalignment adjustment process (S109), the processor 11 may not change the color of the text in the subtitles and may leave the single line of lyrics displayed. Alternatively, it may leave multiple lines of subtitles displayed. In this case, a simple method can be used to prevent the subtitles of the alternative song from becoming misaligned. [Explanation of Symbols]

[0111] 1, 1A, 1B: Karaoke equipment 7: Server 9: Network 11: Processor 14: Storage part 18: LAN Communications Department 20: HDD 22:Display device 41:First CPU 42:First memory section 51:Second CPU 52:Second memory section 421: Equipment Reservation List 742: Server Reservation List

Claims

1. A karaoke device that can communicate with other karaoke devices via a network, Control unit and Equipped with a memory unit, The control unit, A sound reception process that receives sound from the aforementioned other karaoke device, A performance sound playback process that plays back the performance sound received in the performance sound reception process, A singing sound reception process that receives singing sounds from the aforementioned other karaoke device, A singing sound playback process that plays back the singing sound received in the singing sound reception process, If lyric data for displaying the lyrics of a song corresponding to the sound of the performance is stored in the storage unit, a first display process is performed to display the lyrics based on the lyric data, If the lyrics data for the song corresponding to the sound of the performance is not stored in the storage unit, a second display process is performed to display the caption based on alternative lyrics data that replaces the lyrics data. A karaoke device characterized by performing the following actions.

2. The karaoke apparatus according to claim 1, characterized in that the control unit performs the second display process based on the alternative lyric data if the text data of the lyrics is not associated with the identification information of the song corresponding to the sound played.

3. The karaoke apparatus according to claim 1, characterized in that the control unit performs the second display process based on lyric data which, as alternative lyric data, is associated with identification information of a different version of the same song as the song corresponding to the performance sound.

4. The karaoke apparatus according to claim 1, characterized in that the control unit performs the second display process based on lyric data embedded in video data corresponding to the identification information of the song corresponding to the performance sound, as the alternative lyric data.

5. The karaoke apparatus according to claim 1, characterized in that the control unit acquires the alternative lyrics data from the other karaoke apparatus and performs the second display process based on the acquired alternative lyrics data.

6. The karaoke apparatus according to claim 1, characterized in that, if the control unit cannot obtain video data corresponding to the identification information of the song corresponding to the performance sound under contract, it performs the second display process based on lyric data associated with the identification information of a different version of the same song as the song as the alternative lyric data.

7. The karaoke apparatus according to claim 1, characterized in that, if the control unit cannot acquire video data corresponding to the identification information of the song corresponding to the sound played, it acquires the video data from another karaoke apparatus and performs the second display process based on the lyrics data embedded in the acquired video data.

8. The karaoke apparatus according to claim 1, wherein, if the control unit has associated the text data of the lyrics with the identification information of the song corresponding to the sound played, and the lyric data of the song corresponding to the sound played is not stored in the storage unit, the control unit obtains the lyric data from a server connected to the network and performs the second display process based on the obtained lyric data.

9. The karaoke apparatus according to claim 1, characterized in that the control unit receives reservation information from other karaoke machines via a server connected to the network, and performs a determination process based on the reservation information to determine whether the lyrics data for the song corresponding to the sound played is stored in the storage unit.

10. The karaoke apparatus according to any one of claims 1 to 9, characterized in that the control unit performs adjustment processing of the display of the subtitles in order to eliminate the timing discrepancy of the start of singing of the song in the second display processing.

11. A karaoke program executed by the processor of a karaoke device comprising a processor and a memory unit, and capable of communicating with other karaoke devices via a network, A sound reception process that receives sound from the aforementioned other karaoke device, A performance sound playback process that plays back the performance sound received in the performance sound reception process, A singing sound reception process that receives singing sounds from the aforementioned other karaoke device, A singing sound playback process that plays back the singing sound received in the singing sound reception process, If lyric data for displaying the lyrics of a song corresponding to the sound of the performance is stored in the storage unit, a first display process is performed to display the lyrics based on the lyric data, If the lyrics data for the song corresponding to the sound of the performance is not stored in the storage unit, a second display process is performed to display the caption based on alternative lyrics data that replaces the lyrics data. A karaoke program that includes instructions for execution.

Images