Mobile device programs and karaoke systems

Abstract

To provide a new way of enjoying by linking a Karaoke device and a portable terminal.SOLUTION: A program for a portable terminal in accordance with the present invention causes the terminal to execute: a correspondence process for communicatively correspondence with a Karaoke device; a music determination process for determining whether or not the Karaoke music being played on the Karaoke device is an application-related music; and an application process in which an operation of the application is performed when a Karaoke music being played on the Karaoke device is determined to be an application-related music in the music determination process, and the operation of the application is not performed when the Karaoke music being played on the Karaoke device is determined not to be an application-related music.SELECTED DRAWING: Figure 9

Description

【Technical Field】 【0001】 The present invention relates to a program for a mobile terminal that operates in cooperation with a karaoke device that performs a performance for singing, and a karaoke system including the karaoke device and the program for the mobile terminal. 【Background Art】 【0002】 Karaoke, where one enjoys singing along with the played accompaniment, is popular among many users. Karaoke devices have become capable of playing a very large number of music pieces through music distribution using communication. In order to improve the playability of karaoke devices, not only the basic music playback function but also the addition of new functions is required. 【0003】 Patent Document 1 discloses a singing assistance system that performs an appropriate sound effect production method according to whether the number of users of a karaoke system is single or plural. According to the singing assistance system described in Patent Document 1, when the user is single, the pronunciation data of the sound effect is output for pronunciation, and when the user is plural, the display data of the sound effect is output for display, so that an appropriate sound effect production method can be efficiently led according to the karaoke usage mode. 【Prior Art Documents】 【Patent Documents】 【0004】 【Patent Document 1】 Japanese Unexamined Patent Application Publication No. 2008 - 76677 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0005】 The singing assistance system described in Patent Document 1 aims to enhance the music playback function, which is a basic function of karaoke machines. One objective of the present invention is to provide a new way to enjoy karaoke by linking a karaoke machine with a mobile device owned by the user. Another objective of the present invention is to reduce the processing and development burden on the karaoke machine when linking the karaoke machine with the mobile device. [Means for solving the problem] 【0006】 Therefore, the program for a mobile terminal according to the present invention is A mapping process that establishes a communication-enabled association with the karaoke machine, The registration process involves registering the song identification information of songs reserved for the game into the app-related song table. The system receives playback status information, including song identification information, for the song that has started playing from the karaoke machine. Based on this playback status information and the app-related song table, it checks whether the song identification information for the played song exists in the app-related song table. A music judgment process to determine whether or not, In the song recognition process, playback on the karaoke machine The music has started. The song, It exists in the app-related music table. If it is determined that, the app will perform its actions. Playback on karaoke machine The music has started. The song, Not present in the app-related music table If this is determined, the app will execute an application process that does not run, and the mobile device will be instructed to do so. 【0007】 Furthermore, in the mobile terminal program according to the present invention, In the application processing, during the music judgment process, Not present in the app-related music table If this is determined, the app will temporarily suspend its operation. It exists in the app-related music table. If this is determined, the app will resume operation. 。 【0009】 Furthermore, the program for mobile terminals according to the present invention is easy The song selection process involves selecting songs, The songs selected during the song selection process easy The process of reserving a song on the karaoke machine is executed. The registration process was scheduled in the reservation process. easy Song Song Identification information of Register the music in the app's related tracks table. 【0011】 Furthermore, the program for a mobile terminal according to the present invention includes an event detection process for detecting the occurrence of a predetermined event in application processing, and when the occurrence of a predetermined event is detected by the event detection process, a pause process is executed to send a pause instruction for music playback to the karaoke device. easy 【0012】 Furthermore, in the program for a mobile terminal according to the present invention, the predetermined event detected by the event detection process is that Songs reserved for the game a predetermined song has been played to completion. 【0013】 Furthermore, the program for a mobile terminal according to the present invention executes a resume process to send a resume instruction for music playback to the karaoke device. easy 【0014】 Furthermore, in the program for a mobile terminal according to the present invention, case the event detection process determines whether all the Song identification information registered in the application-related music table has been played on the karaoke device, and when it is determined in the pause process that all the Song identification information registered in the application-related music table has been played on the karaoke device, a pause instruction is sent to the karaoke device. 【0015】 Furthermore, the program for a mobile terminal according to the present invention executes an application image transmission process to transmit an application image formed in the application processing to the karaoke device. 【0016】 <00​​​​​​​​​ The registration process involves registering the song identification information of songs reserved for the game into the app-related song table. The system receives playback status information, including song identification information, for the song that has started playing from the karaoke machine. Based on this playback status information and the app-related song table, it checks whether the song identification information for the played song exists in the app-related song table. A music determination process for making a determination, and In the music determination process, when the music played on the karaoke device The music has started. is It exists in the app-related music table. determined to be, the application is operated, When the music played on the karaoke device The music has started. is The music is present in the app-related music table. determined not to be, an application process that does not operate the application is executed on the mobile terminal. 【Advantages of the Invention】 【0017】 According to the program for a mobile terminal and the karaoke system according to the present invention, it becomes possible to provide a new way of enjoying by linking the karaoke device and the mobile terminal possessed by the user. Further, when linking the karaoke device and the mobile terminal, it becomes possible to suppress the processing load and the development load in the karaoke device. 【Brief Description of the Drawings】 【0018】 [Figure 1] A diagram showing the karaoke device according to the present embodiment and its peripheral configuration [Figure 2] A flowchart showing the music playback process according to the present embodiment [Figure 3] A flowchart showing the game process according to the present embodiment [Figure 4] A flowchart showing the preparation process according to the present embodiment [Figure 5] A flowchart showing the process during playback according to the present embodiment [Figure 6] A flowchart showing the vote reception / result process according to the present embodiment [Figure 7] A diagram for explaining the reservation table and the application-related music table according to the present embodiment [Figure 8] A diagram for explaining the reservation table and the application-related music table according to the present embodiment [Figure 9] A diagram showing the situation during game use according to the present embodiment [Figure 10]This diagram shows various screens displayed on the mobile device according to this embodiment. [Figure 11] This diagram shows various screens displayed on the mobile device according to this embodiment. [Figure 12] This diagram shows various screens displayed on the mobile device according to this embodiment. [Figure 13] This diagram shows various screens displayed on the mobile device according to this embodiment. [Figure 14] This diagram shows various screens displayed on the mobile device according to this embodiment. [Figure 15] This figure shows various screens displayed on the remote control device according to this embodiment. [Figure 16] This figure shows various screens displayed on the monitor according to this embodiment. [Figure 17] This figure shows various screens displayed on the monitor according to this embodiment. [Figure 18] Flowchart showing playback processing according to another embodiment [Modes for carrying out the invention] 【0019】 Figure 1 shows the karaoke device and its surrounding configuration according to this embodiment. The karaoke device 2 (sometimes referred to as "Commander") in this embodiment has a remote control device 1 as part of its surrounding configuration. The karaoke device 2 and the remote control device 1 are communicated together to form a network using a LAN 100 and an access point 110. 【0020】 The karaoke machine 2, installed in karaoke boxes and the like, includes an audio control unit 25 as a performance unit for playing songs. The karaoke machine 2 also includes an operation unit 21 that receives various inputs from the user. The karaoke machine 2 includes an operation processing unit 22 that interprets the input from the operation unit 21 and transmits it to the control unit 30. The karaoke machine 2 also includes a hard disk 32 as a storage unit for storing various information. The karaoke machine 2 includes a LAN communication unit 24a as a means of communication for connecting to the LAN 100 and joining the network. Furthermore, the karaoke machine 2 of this embodiment includes a wireless LAN communication unit 24b. It is also possible to perform network communication using this wireless LAN communication unit 24b. 【0021】 Furthermore, the karaoke device 2 is equipped with a video playback means for displaying lyrics and background images on the monitor 41. The video playback means comprises a video playback unit 29 that plays back images based on video information, a video RAM 28 that temporarily stores the images to be played back, and a video control unit 31 that overlays lyrics onto the played back images, adds video effects, and so on. 【0022】 Furthermore, the karaoke device 2 is capable of displaying various information on a touch panel monitor 33 in addition to the externally connected monitor 41. The touch panel monitor 33 is composed of a display unit 33a that displays video information input from the video control unit 31 and a touch panel 33b that outputs the touch input position to the operation processing unit 22. 【0023】 The touch panel monitor 33 is located on the front of the karaoke machine 2's casing and functions as an input unit. By selecting songs on the touch panel monitor 33, users can directly reserve songs on the karaoke machine 2 and perform various operations on the karaoke machine 2. 【0024】 Furthermore, the karaoke device 2 is configured to include a control unit 30 for overall control of each component, and a control unit 27 for temporarily storing information necessary for executing various programs. 【0025】 In this configuration, the karaoke device 2 performs various processes. The main processes of the karaoke device 2 include song reservation processing and song playback processing. Song reservation processing is the process of specifying and reserving a song based on user instructions, and is performed in cooperation with the remote control device 1. Reservation information, including song identification information (song identification information) formed by the song instruction processing of the remote control device 1, is transmitted to the karaoke device 2. The karaoke device 2 registers the received reservation information in the reservation table in memory 27. Song playback processing is the process of playing a song based on the reservation information registered in the reservation table, and is a process in which the song playback processing and the lyrics display processing are executed synchronously. 【0026】 The music playback process reads music information based on music identification information in the reservation information registered in the reservation table, and instructs the sound control unit 25 to perform playback based on the performance information contained in the music information. The music played by the sound control unit 25 is emitted from the speaker 42 along with the singing voice input from the singing microphones 44a and 44b. The lyrics display process assists singing by displaying the lyrics information contained in the music information on the monitor 41. Alternatively, a background video display process may be performed to superimpose the lyrics displayed in this lyrics display process onto the background video. 【0027】 The remote control device 1 is capable of performing reservation instruction processing, such as searching for songs based on user operation instructions, and transmitting reservation information to the karaoke device 2 for selected and reserved songs. The remote control device 1 is also capable of receiving various information from the karaoke device 2 or a server device connected to the internet and performing various processes. In this embodiment, the user interface for receiving various operation instructions from the user is provided as an operation unit 17 and a touch panel monitor 11. The touch panel monitor 11 is composed of a display unit 111 and a touch panel 112, and displays various interfaces on the display unit 111 and can receive touch input from the user using the touch panel 112. 【0028】 Furthermore, the remote control device 1 is configured to include a memory 14 as a storage unit for storing a database necessary for searching for music, various programs, and various information generated in conjunction with program execution, and a remote control unit for comprehensively controlling these components. The remote control unit includes a control unit 15, a video control unit 13 that forms the image to be displayed on the touch panel monitor 11, a video RAM 12 that temporarily stores the video information to be displayed, and an operation processing unit 18 that interprets input from the touch panel monitor 11 or the operation unit 17 and transmits it to the control unit 15. 【0029】 The remote control device 1 is connected to the network configured by the LAN 100 by wirelessly connecting to the access point 110 via the wireless LAN communication unit 16. Using the wireless LAN communication unit 16, the remote control device 1 and the karaoke device 2 can communicate bidirectionally. Each remote control device 1 can be associated with a specific karaoke device 2 at any time. Various commands output from the remote control device 1 are received by the associated karaoke device 2, enabling remote control of the karaoke device 2. 【0030】 Furthermore, the remote control device 1 can also communicate using the infrared communication unit 19. When communicating using the infrared communication unit 19, communication between the remote control device 1 and the karaoke device is unidirectional (from the remote control device 1 to the karaoke device 2). In this embodiment, communication using the infrared communication unit 19 is performed when communication using the wireless LAN communication unit 16 is not possible, etc. 【0031】 With this configuration of the remote control device 1, it is possible to receive various inputs from the user via the touch panel monitor 11 or the operation unit 17, and to perform various processes such as sending reservation instructions to the karaoke machine 2 by providing the user with various information through the display on the touch panel monitor 11. 【0032】 Figure 2 is a flowchart showing the music playback process according to this embodiment. The karaoke device 2 executes this music playback process for reserved songs. The music playback process checks the reservation table (S001). If there is a song to be played next in the reservation table (S002: Yes), the device reads the song information corresponding to the song identification information contained in the reservation information and starts playing the song (S003). 【0033】 Then, if there is a mobile terminal 6 connected to the karaoke machine 2 (S003: Yes), playback status information is sent to the mobile terminal 6 (S004). The communication connection with the mobile terminal 6 and the playback status information sent to the mobile terminal 6 will be described later. When the playback of a song ends (S005: Yes), if there is a mobile terminal 6 connected to the karaoke machine 2 (S006: Yes), playback status information is sent to the mobile terminal 6 (S007). Then, the process returns to the beginning of the song playback process, the reservation table is checked (S001), and the next song is played. 【0034】 The karaoke device 2 of this embodiment can provide services such as games in cooperation with a mobile device 6, such as a smartphone or tablet, owned by the user. The mobile device 6 operates an application program, which enables the karaoke device 2 to cooperate. In this embodiment, a game will be used as an example to describe the services provided through the cooperation between the karaoke device 2 and the mobile device 6. The game played in this embodiment is a game in which players guess who is having their singing interrupted by interfering sounds while a song is playing. The karaoke system according to the present invention consists of the karaoke device 2 and a mobile device program that runs on the mobile device 6. 【0035】 Figure 9 shows the situation when the game is in use. The karaoke machine 2 and the mobile terminal 6 are connected to the karaoke machine 2 in a state where communication is possible. Figure 9 shows four users 7A to 7D participating in the game, with user 7A singing. User 7A, who is singing, is wearing headphones 65 that are wirelessly (or wired) connected to the mobile terminal 6. 【0036】 Users 7A to 7D are assigned a role (Noisy, DC, Normal). While singing a song, an operable button (Obstruction Button) is displayed on the touch panel monitor 61 of the mobile device 6, and users other than the singing user (in this case, users 7B to 7D) operate it. If the singing user's role is "Noisy," an obstruction sound is output from the headphones 65 when the Obstruction Button is pressed. On the other hand, if the singing user's role is anything other than "Noisy," no obstruction sound is output even if the Obstruction Button is pressed. 【0037】 For users assigned the "Noisy" role, the victory condition is to prevent others from discovering that their assigned role is "Noisy." For users assigned the "Normal" role, the victory condition is to guess which user has been assigned the "Noisy" role. For users assigned the "DC" role, the victory condition is to be perceived as "Noisy." In this embodiment of the game, after all users 7A to 7D have sung in turn, a vote is held to determine which group of roles (faction) has won. 【0038】 Figure 3 is a flowchart showing the game processing according to this embodiment. The game processing is executed in the following order: preparation processing (S100), playback processing (S200), and vote acceptance and result processing (S300). First, the preparation processing (S100) will be explained. 【0039】 Figure 4 is a flowchart showing the preparation process (S100) according to this embodiment. The user launches an application (application program) on the mobile terminal 6, or selects a game from the application's menu. Figure 10(a) is the start screen displayed on the touch panel monitor 61 of the mobile terminal 6. The start screen displays a start button 61a, and when the start button 61a is pressed (S101: Yes), the code reading screen shown in Figure 10(b) is displayed (S102). The code reading screen is provided with a capture display area 61b that displays the image captured by the rear camera of the mobile terminal 6. 【0040】 Furthermore, the user uses the remote control device 1 to start the game function on the karaoke machine 2. Figure 15(A) shows the start screen displayed on the touch panel monitor 11 of the remote control device 1. After displaying the start screen, the touch panel monitor 11 displays the code display screen shown in Figure 15(B). The code display screen displays a QR code (registered trademark) as code information 11a. The code information 11a includes connection information for establishing a communication connection between the mobile terminal 6 and the karaoke machine 2, such as identification information for the karaoke machine 2. The mobile terminal 6 reads the connection information of the code information 11a by taking a picture so that the code information 11a is positioned within the shooting display area 61b described in Figure 10(b). 【0041】 If connection information is read by the mobile terminal 6 (S103: Yes), the mobile terminal 6 performs an mapping process to establish a communication connection with the karaoke machine 2 using the mobile terminal network or the wireless LAN used in the store (S104). From this point onward, the mobile terminal 6 and the karaoke machine 2 can send and receive information via communication. 【0042】 After the communication connection is established, the mobile terminal 6 displays the participant input screen shown in Figure 10(c) (S105). The participant input screen is for entering the number of people participating in the game, and displays the participant input field 61c, the number of assigned people 61d, and the confirm button 61e. The user enters the number of people participating in the game into the participant input field 61c using a software keyboard (not shown) or the like. If the number of participants has been entered (S106: Yes), the mode assignment process is executed to assign roles to each participant. The number of assigned people 61d displays the number of people assigned to each role (Noisy, DC, Normal) (S107). In this embodiment, the mobile terminal 6 determines the number of assigned people, but it may be possible for the user to set this. After entering the number of participants, the character notification screen is displayed by operating the confirm button 61e (S108: Yes) (S109). 【0043】 In this embodiment, an identification information assignment process is performed in which each user is assigned a character 7a to 7d so that they can easily play the game. Users can then use the characters 7a to 7d assigned by the identification information assignment process to confirm things like song performances and vote acceptance. Alternatively, a mode assignment process may be performed to assign either a first mode or a second mode to the characters 7a to 7d that have undergone the identification information assignment process. 【0044】 In this embodiment, since the game is played using one mobile terminal 6, users 7A to 7D pass the mobile terminal 6 to each other in turn to confirm the characters 7a to 7d assigned to them, the roles assigned to them, and to select music. To simplify the explanation, the subscript letters will be aligned, with user 7A being assigned character 7a, user 7B being assigned character 7b, and so on. 【0045】 Figure 11(d) shows the character notification screen of this embodiment. The character notification screen (S109) displays character 7a (a dog character) and character confirmation button 6f. User 7A, who first receives the mobile terminal 6, confirms the character 7a assigned to him on the character notification screen shown in Figure 10(d). After confirmation, the user operates the role confirmation button 61f (S110: Yes) to display the next role notification screen (S111). 【0046】 Figure 10(e) shows the role notification screen of this embodiment. The role notification screen displays a role display field 61g and a song selection start button 61h. The role display field 61g displays the role required for the game assigned by the mode assignment process, and the victory conditions for that role. In Figure 10(e), it is shown that user 7A's character 7a has been assigned the role "Noisy". The victory condition for the role "Noisy" is to not let other users know that you are "Noisy". Note that when playing the game, it is necessary not to show the role notification screen to other users. 【0047】 User 7A, having confirmed their role, starts the song selection process (S113) by operating the song selection start button 61h (S112: Yes). Figure 11(i) shows the song selection screen of this embodiment. The song selection screen displays the search item specification field 61i, allowing the user to select songs by song, artist (singer), or album. 【0048】 Figure 11(i) shows the state where songs are being selected individually, and the screen displays song-related information fields 61j for each song (in alphabetical order). The song-related information fields 61j display the song title, artist name, and icon, and the user selects a song by manipulating the song-related information fields 61j. Once a song is selected, a song confirmation screen (not shown) showing the song details is displayed, and user 7A confirms the song (S114: Yes). 【0049】 Once the song selection is confirmed (S114: Yes), the mobile terminal 6 is handed over to the next user 7B, who then displays the character notification screen (not shown) (S109), the role notification screen (S111), and performs the song selection process (S113). Figure 10(f) shows the role notification screen for user 7B. The role notification screen displays the character 7b (a cat character) assigned to user 7B, and the assigned role "DC" is displayed in the role display field 61g. The processing condition for the role "DC" is that it is thought to be "noisy". 【0050】 Once user 7B confirms their song selection (S114: Yes), the mobile terminal 6 is handed over to the next user 7C, who then displays a character notification screen (not shown) (S109), a role notification screen (S111), and performs the song selection process (S113). Figure 12(g) shows the role notification screen for user 7C. The role notification screen displays character 7c (a squirrel character) assigned to user 7C, and the assigned role "Normal" is displayed in the role display field 61g. The processing condition for the role "Normal" is to apply "Noisy". 【0051】 Once user 7C confirms their song selection (S114: Yes), the mobile terminal 6 is handed over to the next user 7D, who then displays a character notification screen (not shown) (S109), a role notification screen (S111), and performs the song selection process (S113). Figure 12(h) shows the role notification screen for user 7D. The role notification screen displays character 7d (a rabbit character) assigned to user 7D, and the assigned role "Normal" is displayed in the role display field 61g. 【0052】 Once all users 7A to 7D have confirmed their characters, roles, and selected songs (S115: Yes), the touch panel monitor 61 of the mobile terminal 6 displays a screen confirming all song selections (S116). Figure 13(j) shows the full song selection confirmation screen of this embodiment. On the full song selection confirmation screen, a song selection content display field 61k and a play start button 61l are displayed for each character 7a to 7d. Users 7A to 7D can confirm the selected song and artist using the song selection content display field 61k. 【0053】 As can be seen from the full song selection confirmation screen, each character 7a-7d (identification information indicating users 7A-7D) is assigned a selected song. Furthermore, since each character 7a-7d is assigned a role, the selected song is assigned either a first mode that outputs disruptive sounds (role "Noisy") or a second mode that does not output disruptive sounds (role "DC" or "Normal"). 【0054】 After confirming the song, when the play start button 61l is operated (S117: Yes), the mobile terminal 6 executes a registration process (S118) in which the song identification information of the song reserved for the game is registered in the app-related song table as a song reserved for the game application (hereinafter referred to as "app-related song"). In the registration process (S118), the song identification information of the reserved song is registered in the app-related song table as identification information indicating an app-related song. In addition, in the registration process (S118) of this embodiment, the character and role are registered in association with the registered song identification information. 【0055】 The mobile terminal 6 performs a reservation process (S119) in which it sends reservation information, including song identification information of the selected song, to the karaoke machine 2. When a reservation is made (S119), information indicating the characters 7a to 7d assigned to each song may also be sent to the karaoke machine 2. The karaoke machine 2 registers the song identification information of songs reserved for this game in the reservation table, just like regular songs, and manages the playback of the songs. Therefore, the karaoke machine 2 cannot determine whether or not a song has been reserved for the game. 【0056】 In this embodiment, the karaoke device 2 transmits playback status information, including song identification information of the song that has started (or finished) playback, to the mobile terminal 6 at an appropriate timing. Therefore, the mobile terminal 6 can understand the playback status of the application-related songs based on the playback status information received from the karaoke device 2 and control the progress of the game application. With this configuration, processing related to the game application can be mainly performed on the mobile terminal 6 side, which reduces the processing burden on the karaoke device 2, as well as the burden and changes during development. In addition to the song identification information of the song that has started (or finished) playback, the playback status information can also include various types of information indicating the status of song playback, such as transmitting the song identification information of the song currently being played at an appropriate timing. 【0057】 Karaoke device 2 registers the song identification information of the songs included in the reservation information into the reservation table and starts the song playback process based on the reservation table. 【0058】 Figures 7 and 8 illustrate the reservation table and the app-related music table according to this embodiment. Figure 7(A) shows the state immediately after the start playback button 61l is pressed on the all-song confirmation screen explained in Figure 13(j). Song identification information indicating songs A to D is registered in the app-related song table of the mobile terminal 6, and the reservation information is sent to the karaoke machine 2. When the karaoke machine 2 receives the reservation information from the mobile terminal 6, it registers the song identification information included in the reservation information in the reservation table (Figure 7(B)). The karaoke machine 2 starts playing song A according to the reservation table. In Figures 7 and 8, the black arrows shown to the left of the reservation table and the app-related music table indicate the currently playing song. When music A starts playing, playback status information is sent to the mobile device (Figure 7(C)). By receiving the playback status information, the mobile device 6 can determine that music A is currently playing. 【0059】 The karaoke device 2 of this embodiment is equipped with an interrupt reservation function. The interrupt reservation function reserves the next song to be played, regardless of the reservation table. Interrupt reservations can be made using the remote control device 1, the touch panel monitor 33 of the karaoke device 2, or the mobile terminal 6. By using this interrupt reservation function, it is possible to sing songs other than those related to the app, even while playing a game. 【0060】 Figure 7(D) shows a situation where song W is reserved as an interruption while song A is playing. In the reservation table managed by the karaoke machine 2, song W, which was reserved as an interruption, is registered as the song to be played after song A. Note that in the reservation table shown from Figure 7(D) onward, song W is surrounded by diagonal lines for ease of understanding, but the karaoke machine 2 treats song W in the same way as songs A to D. When the playback of song A ends and the playback of the reserved song W begins, the karaoke machine 2 sends playback status information, including the song identification information of song W, to the mobile terminal 6 (Figure 7(E)). Upon receiving the playback status information, the mobile terminal 6 performs a song determination process to determine whether or not song identification information for song W exists in the application-related song table. If the song determination process determines that song identification information for song W does not exist in the application-related song table, the application process does not run the game application. 【0061】 When the playback of song W ends and the playback of the next song B begins in the karaoke device 2, the karaoke device 2 sends playback status information, including the song identification information of song B, to the mobile terminal 6 (Figure 7(F)). Upon receiving the playback status information, the application processing of the mobile terminal 6 resumes the operation of the game application, which had stopped, because the song identification information of song B is registered in the application-related song table (Figure 7(F)). 【0062】 Figure 8(G) shows the situation in karaoke device 2 where song playback has progressed and song D has started playing. When song D starts playing, karaoke device 2 transmits playback status information, including song identification information for song D, to mobile terminal 6. Upon receiving the playback status information, mobile terminal 6 refers to the app-related song table and recognizes that song D, as an app-related song, has started playing. Furthermore, when song D finishes playing, mobile terminal 6 can recognize, based on the app-related song table, that all app-related songs have been played. 【0063】 As explained above, in this embodiment, the karaoke device 2 only needs to adopt a simple configuration that transmits playback status information. Furthermore, the mobile terminal 6 can understand the playback status of the app-related songs based on the playback status information indicating the status of song playback received from the karaoke device 2 and the app-related song table, and control the progress of the game application. 【0064】 Next, we will explain how the game progresses during music playback. Before starting the music playback process, the karaoke device 2 displays the character display screen shown in Figure 16(a) on the monitor 41. In this embodiment, the mobile terminal 6 executes application processing to form the screen to be displayed on the monitor 41 of the karaoke device 2. The mobile terminal 6 executes application image transmission processing to form the application image to be displayed on the monitor 41 and send it to the karaoke device 2. The karaoke device 2 displays the received application image on the monitor 41. The application image is assigned a flag that indicates the display format. If the flag is "0", the karaoke device 2 displays only the received application image on the monitor 41. If the flag is "1", the karaoke device 2 combines the received application image with an image formed by the karaoke device 2 and displays it on the monitor 41. 【0065】 Furthermore, the mobile terminal 6 may also specify the display period for the application image. This display period may include specifying the start and end times, or it may include specifying the start time and duration. In this way, the karaoke machine 2 receives the application image created by the mobile terminal 6 and displays it on the monitor 41, thereby reducing the processing load on the karaoke machine 2. Additionally, it eliminates the need for significant modifications to the karaoke machine 2 each time an application is added, thus reducing the development burden. The images (application images) that the karaoke machine 2 displays on the monitor 41 in conjunction with application execution, as described below, are created by the mobile terminal 6. 【0066】 The character display screen shown in Figure 16(a) displays the selected characters 7a to 7d, allowing the user to confirm their character. Meanwhile, the mobile terminal 6 performs playback processing (S200) while the karaoke machine 2 is playing a song. 【0067】 Figure 5 is a flowchart showing the playback processing (S200) according to this embodiment. The mobile terminal 6 receives playback status information, including song identification information of the song being played on the karaoke machine 2 (S201). Based on the received playback status information and the app-related song table, the mobile terminal 6 performs a song determination process to determine whether or not the song is an app-related song (S202). If the song is not an app-related song (S202: No), the mobile terminal 6 performs an app process to temporarily suspend the operation of the game app (S203). Therefore, for example, as explained in Figures 7 and 8, when an interrupt song (song W) reserved independently of the app is played, the operation of the game app is temporarily suspended. 【0068】 On the other hand, in the song determination process (S202), if it is determined that the song is related to the app (S202:Yes), the mobile terminal 6 compares the song identification information contained in the received playback status information with the app-related song table to determine which user 7A~D (actually, the assigned characters 7a~7d) selected the song and their role (S204). Also, if it is determined that the song is related to the app (S202:Yes), the song identification information determined to be related to the app is recorded as having been played in the app-related song table stored and managed by the mobile terminal 6. 【0069】 In the app-related music table, music identification information that has been deemed to have been played will be judged as not being an app-related music in subsequent music determination processes (S202). In the app-related music table, various forms can be used to indicate that a song has been played, such as deleting the music identification information or adding a played flag to the music identification information. If the same music identification information is registered multiple times in the app-related music table, the music identification information located earlier will be considered to have been played based on the order (song order) of the music identification information registered in the app-related music table. 【0070】 If the song identification information included in the playback status information is not registered in the app-related song table, the mobile terminal 6 may either not execute the game function or temporarily suspend the game function. Next, the mobile terminal 6 displays an obstacle screen showing one of the characters 7a to 7d based on the identified characters 7a to 7d (S205). Figure 13(k) shows the interruption screen of this embodiment. The interruption screen displays a character 7a corresponding to the currently playing song identification information and an interruption button 61m. Figure 13(k) shows the case where user 7A is singing, as described in Figure 9. 【0071】 As shown in Figure 9, user 7A sings while wearing headphones 65. The sound of the music played by the karaoke machine 2 is emitted from speaker 42, and because the volume is loud, user 7A can hear the music even while wearing headphones 65. To ensure good audibility of the music, headphones 65 may be worn on only one ear. 【0072】 While a song is playing, the monitor 41 connected to the karaoke device 2 displays the singing screen shown in Figure 16(i). The singing screen displays lyrics 41c to assist with singing, as well as the character 7a assigned to the song being played and the interruption button notification area 41b. 【0073】 Users 7B to 7D, other than the singing user 7A, operate the "Obstruction Button" 61m displayed on the touch panel monitor 61 (interface) of the mobile terminal 6 shown in Figure 9 at the timing when they want to output interference sounds. When the interference button 61m shown in Figure 13(k) is operated (S207: Yes), the mobile terminal 6 transmits operation information to the karaoke device 2 indicating that the interference button 61m has been operated (S208). Upon receiving the operation information, the karaoke device 2 executes an operation display process that shows in the interference button notification field 41b that the interference button 61m has been operated. Operation display processing that shows that the interference button 61m has been operated may also be executed on the interface of the mobile terminal 6. 【0074】 Notifications to the "Obstacle Button" notification area 41b via operation display processing can take various forms, such as switching the display of the "Obstacle Button" notification area 41b or changing the message displayed in the "Obstacle Button" notification area 41b. In this embodiment, the operation of the "Obstacle Button" 61m is notified by display, but it may also be notified by sound. In that case, when the "Obstacle Button" 61m is operated, a notification sound is emitted from the speaker 42, and all users 7A to 7D can confirm that the "Obstacle Button" 61m has been operated. 【0075】 Next, the mobile terminal 6 checks whether the role corresponding to the song identification information being played in S204 is "noisy" (S209). If the role is "noisy" (S209: Yes), the mobile terminal 6 performs an interference sound output process that outputs an interference sound to the headphones 65 worn by the singing user 7A (S210). The interference sound output by the interference sound output process uses noise lasting several seconds, conversation, music unrelated to the song, etc. If the singing user's role is "noisy," this interference sound makes singing difficult. 【0076】 User 7A, whose role is "noisy," acts as if they are not hearing any interfering sounds to demonstrate that their role is not "noisy." Meanwhile, the other users 7B-7D observe User 7A's reactions by operating the interference button 61m, and try to deduce whether User 7A's role is "noisy" or not. 【0077】 On the other hand, for users 7B-7D whose role is not "Noisy" (S209: No), no interference sound is output even if the interference button 61m is pressed (S207: Yes). For users 7C and 7D whose role is "Normal," no interference sound is output, so they can sing without being interrupted by interference sounds. On the other hand, for user 7B whose role is "DC," no interference sound is output. However, since the victory condition is to appear "Noisy," they will behave as if they are being interrupted by interference sounds. 【0078】 Any of the users 7A-7D can confirm that an action has been taken on the Obstacle Button 61m by looking at the Obstacle Button notification area 41b displayed on the monitor 41. When singing, each user 7A-7D expresses whether or not they are being interfered with by disruptive sounds through their singing or attitude in a way that leads to their victory conditions. Furthermore, the users 7A-7D observing the singing situation and attitude of the singing users 7A-7D can deduce which user 7A-7D has been assigned the role of "Noisy". 【0079】 The karaoke machine 2 plays the songs selected by each user 7A to 7D, and the mobile terminal 6 executes the processes S201 to S210 in Figure 5 for each user 7A to 7D. When playback of a song is finished in the karaoke machine 2, the karaoke machine 2 notifies the mobile terminal 6 of the completion of playback, including the song identification information of the song that has finished playing (Figure 2, S007). 【0080】 As mentioned above, the mobile terminal 6 manages song identification information as app-related songs on the app-related song table. Therefore, the mobile terminal 6 can grasp the playback status of app-related songs based on the playback status information received from the karaoke machine 2. In the event detection process that detects a predetermined event, the mobile terminal 6 receives a notification that song playback has finished in S206, determines whether all app-related songs have been played, and, on the condition that it has detected that all app-related songs have been played (S211: Yes), terminates the playback processing (S200) and executes the next voting / results processing (S300). 【0081】 Figure 6 is a flowchart showing the vote acceptance and result processing (S300) according to this embodiment. The vote acceptance and result processing (S300) involves accepting votes from each user 7A to 7D on who has the role "noisy" and announcing the results. In the vote acceptance and result processing (S300), if the event detection process of the mobile terminal 6 detects that playback of all application-related songs has been completed, it executes a temporary pause process (S301) that sends a temporary stop instruction to the karaoke device 2. Upon receiving the pause instruction, the karaoke device 2 temporarily pauses the song playback process. 【0082】 Figure 13(I) shows the discussion time display screen according to this embodiment. In the voting acceptance and result processing (S300), a time for discussion among users 7A to 7D is provided before voting takes place (discussion time). The discussion time display screen shows a remaining time display field 61n, an extend button 61o, and an end button 61p. 【0083】 In this embodiment, the discussion time (S302) has a time limit, and the remaining time is displayed as a countdown in the remaining time display field 61n. The extend button 61o is an operator for extending the discussion time. The end button 61p is an operator for ending the discussion time. When the discussion time runs out or the end button 61p is operated, ending the discussion time (S303: Yes), one of the characters 7a to 7d is identified (S304). Then, a voting acceptance process is executed for the identified character 7a to 7d, which displays the voting screen (S305). 【0084】 Figure 14(m) shows the voting screen of this embodiment. Figure 14(m) is the voting screen when character 7a is identified in S304 of Figure 6. The voting screen is provided with a voting field 61q and a voting button 61s. The voting field 61q is provided for each character 7a to 7d, with fields for the selected song title, artist name, and a voting check box 61r. User 7A, corresponding to character 7a, selects one of the characters 7a to 7d of users 7A to 7D who are estimated to have the role "Noisy" by touching the voting check box 61r. 【0085】 In this embodiment, it is also possible to select the character 7a assigned to user 7A when voting. After selecting characters 7a to 7d, the vote is completed by operating the vote button 61s (S306: Yes). Once user 7A has finished voting, the characters 7b to 7d corresponding to the next users 7B to 7D who have not yet voted are identified (S304), and voting is performed using the voting screen. 【0086】 Once all characters 7a-7d have been identified (S307: Yes), that is, once all users 7A-7D have finished voting, a vote counting process (S308) is performed based on the votes received by the vote acceptance process. In the vote counting process, the number of votes received for each character 7a-7d is tallied, and the winning faction (the winning group of roles) is determined based on the counting results. Then, a result notification process is performed (S309) based on the vote counting process (S308) to display the results on the results screen. 【0087】 Figure 14(n) shows the results screen of this embodiment. The results screen generated by the results notification process includes a Noisy display area 61t, a DC display area 61u, a winning faction display area 61v, a summary result display area 61w, a restart button 61x, and an exit button 61y. The Noisy display area 61t displays the character 7a assigned to the role "Noisy". 【0088】 The DC display area 61u shows character 7d, who is assigned the role "DC". The tally result display area 61w shows the number of votes for each character 7a to 7d. In Figure 14(n), character 7a has the role "Noisy", and character 7a has received the most votes for the role "Noisy", so the winning faction is the role "Normal". Therefore, the name of the role "Normal" is displayed in the winning faction display area 61v. 【0089】 In this embodiment, the results screen is also displayed on the monitor 41 connected to the karaoke machine 2. The mobile terminal 6 transmits the images constituting the results screen formed by the application processing to the karaoke machine 2 during the application image transmission process, thereby displaying the results screen on the monitor 41. Figure 17(e) shows the results screen displayed on the monitor 41. The results screen displays the same noisy display area 41e, DC display area 41f, and voting content display area 41h as the results screen of the mobile terminal 6. The winning faction display area 41g shows the name of the winning faction (role "Normal") as well as the characters 7b and 7c belonging to the winning faction. 【0090】 Users 7A-7D can check which users were assigned the roles "Noisy" and "DC," and which role was assigned to the winning side, on the results screen displayed on the mobile device 6 (or monitor 41). This completes one round of the game, but users 7A-7D can use the results screen on the mobile device 6 to choose to resume or end the game. 【0091】 If the restart button 61x in Figure 14(n) is pressed (S310: Yes), the process returns to the preparation stage (S100) (S311), and the game is restarted. When restarting the game, the assignment of characters 7a to 7d to users 7A to 7D may be the same as the assignment from the previous game. If the end button 61y is pressed (S312: Yes), the game is terminated (S313). 【0092】 Subsequently, the mobile terminal 6 performs a restart process, sending a restart instruction to the karaoke machine 2 (S314). Upon receiving the restart instruction, the karaoke machine 2 resumes the song playback process based on the reservation table. 【0093】 As described above, the karaoke system of this embodiment makes it possible to perform processing that links the karaoke device 2 with an application (mobile device program) running on the mobile terminal 6. In particular, since the karaoke device 2 only requires simple processing to link with the application running on the mobile terminal 6, it is possible to reduce the processing burden on the karaoke device 2, as well as the burden and modifications during the development of the karaoke device 2. The karaoke system according to the present invention is not limited to the above-described form, and various modifications can be adopted. Various modifications are described below. 【0094】 [First variation] Figure 18 is a flowchart showing the playback processing according to another embodiment. The same reference numerals are used for the same processes as in the flowchart of the playback processing (S200) described in the above embodiment (Figure 5). The first modified example differs from the playback processing described in Figure 5 in that the intermediate voting processing (S214) and intermediate voting result display processing (S215) shown in Figure 18 are performed. In the playback processing of Figure 18, when the event detection process detects that the playback of a predetermined number of app-related songs has finished (S212: Yes), the pause processing (S213), intermediate voting processing (S214), intermediate voting result display processing (S215), and resume processing (S216) are executed. 【0095】 Here, the timing at which a predetermined number of app-related songs have finished refers to, for example, when four users 7A to 7D are participating in the game, the event detection process detects that two users have sung, which is the midpoint. When the event detection process detects that a predetermined number of app-related songs have finished (S212: Yes), the mobile terminal 6 executes a pause process (S213) by sending a pause instruction to the karaoke machine 2. Upon receiving the pause instruction, the karaoke machine 2 pauses the song playback process. Next, the mobile terminal 6 executes an intermediate voting process (S214). The intermediate voting process (S214) is a process in which the user votes for the role "Noisy" at the point in time, similar to the voting screen explained in Figure 14(m). 【0096】 The results of the interim voting process (S214) are displayed on the touch panel monitor 61 or monitor 41 of the mobile terminal 6 during the interim voting results display process (S215). After the completion of the interim voting results display process (S215), the mobile terminal 6 performs a restart process (S216) by sending a restart instruction to the karaoke machine 2. Upon receiving the restart instruction, the karaoke machine 2 resumes the music playback process. In this way, by performing the interim voting process (S214) and the interim voting results display process (S215) in the middle of the game, it is possible to improve the gameplay experience. 【0097】 [Second variation] In the above-described embodiment, when the event detection process detected that the voting acceptance and result processing (S300) had started, the mobile terminal 6 executed a pause process to send a pause instruction to the karaoke machine 2, thereby temporarily halting the music playback process. Furthermore, when the event detection process detected that the voting acceptance and result processing (S300) had ended, the mobile terminal 6 executed a restart process to send a restart instruction to the karaoke machine 2, thereby restarting the music playback process. 【0098】 Furthermore, in the first modified example, the mobile terminal 6, on the condition that the event detection process detected the occurrence of an event where a predetermined number of app-related songs had been played, executed a pause process to send a pause instruction to the karaoke machine 2, thereby temporarily halting the song playback process. Also, on the condition that the event detection process detected the occurrence of an event where the intermediate voting results display process had ended, the mobile terminal 6, on the condition that the resume process to send a resume instruction to the karaoke machine 2, resumed the song playback process. 【0099】 The events that trigger the pause or restart are not limited to the forms described above, and various forms can be adopted. For example, in the karaoke machine 2, the event detection process may be triggered to execute a pause process when it detects that the app-related song has been played for a predetermined period (e.g., 3 seconds). In this case, the karaoke machine 2 needs to send information indicating the current playback time as playback status information to the mobile terminal 6. In this way, by pausing the app-related song after it has been played for a predetermined period (e.g., 3 seconds), it becomes possible to implement an intro-guessing quiz by linking the karaoke machine 2 and the app on the mobile terminal 6. 【0100】 [Third variation] In the above-described embodiment, an interference sound output process was performed by operating the interference button 61m, which served as an interface, to output an interference sound. The interference sound output process may also be performed by randomly outputting interference sounds during music playback, instead of operating the user interface such as the interference button 61m. In addition, in the above-described embodiment, when the role was set to "noisy," an interference sound was always output when the interference button 61m was operated. 【0101】 In addition to this configuration, the interference sound output processing may also be configured to either output interference sounds or not output them when the "noisy" role is activated, even if the interference button 61m is pressed. This can improve the gameplay experience when using the game. 【0102】 [Fourth variation] In the above-described embodiment, headphones 65 were used as an output unit that allowed only users 7A to 7D singing to hear the interfering sound. However, earphones may be used as the output unit instead of headphones 65. Alternatively, various configurations can be employed, such as using a parametric speaker with enhanced directivity by using ultrasound as the carrier wave. Furthermore, while the above-described embodiment outputs the interfering sound from the mobile terminal 6, the karaoke machine 2 may also output the interfering sound. 【0103】 In this embodiment, a karaoke system comprising a karaoke device 2 and a mobile terminal program executed on a mobile terminal 6 has been described. The present invention is not limited to such a karaoke system, but also includes the karaoke device 2, the karaoke program executed on the karaoke device 2, or the mobile terminal program executed on the mobile terminal 6, which constitute a part of the system. [Explanation of Symbols] 【0104】 1: Remote control device 41h: Voting content display field 2: Karaoke machine 42: Speakers 6: Mobile device 44a, 41b: Singing microphone 7A~7D: User 61: Touch Panel Monitor 11: Touchscreen monitor 61a: Start button 11a: Code information 61b: Shooting display area 12: Video RAM 61c: Input field for the number of participants 13: Video control unit 61d: Number of assigned people 14: Memory 61e: Select button 15: Control Unit 61f: Role Confirmation Button 16: Wireless LAN communication unit 61g: Role display field 17: Control panel 61h: Start track selection button 18: Operation processing unit 61i: Search item specification field 19: Infrared communication unit 61j: Music-related information display area 21: Operation section 61k: Song selection content display field 22: Operation processing unit 61l: Playback start button 24a: LAN communication unit 61m: Interruption button 24b: Wireless LAN communication section 61n: Time display column 25: Acoustic control unit 61o: Extension button 27: Memory 61p: Exit button 28: Video RAM 61q: Voting section 29: Video playback section 61r: Voting check box 30: Control Unit 61s: Voting Button 31: Video control unit 61t: Noise display area 32: Hard disk 61u: DC display area 33: Touch panel monitor 61v: Winning faction display area 33a: Display section 61w: Summary result display section 33b: Touch panel 61x: Resume button 41: Monitor 61y: Exit button 41b: Notification box for the "Obstacle" button 65: Headphones 41c: Lyrics 110: Access point 41e: Noise display area 111: Display section 41f: DC display area 112: Touch panel 41g: Winning faction display section

Claims

[Claim 1] A mapping process that establishes a communication-enabled association with the karaoke machine, The registration process involves registering the song identification information of songs reserved for the game into the app-related song table. The karaoke machine receives playback status information, including song identification information, for the song that has started playing. Based on this playback status information and the app-related song table, it performs a song determination process to determine whether or not the song identification information for the played song exists in the app-related song table. In the song detection process, if it is determined that a song started playing on the karaoke machine exists in the app's related song table, the app will perform its actions. If the karaoke machine determines that a song has been started playing and does not exist in the app's related song table, the app will perform an action on the mobile device that prevents the app from running. A program for mobile devices. [Claim 2] The app's processing, during the music selection process, pauses the app's operation if it determines that the music does not exist in the app's associated music table, and resumes operation if it determines that the music does exist in the app's associated music table. The program for a mobile terminal according to claim 1. [Claim 3] A song selection process for selecting songs, The song selection process involves a reservation process that reserves the selected song on the karaoke machine. The registration process registers the song identification information of the song reserved in the reservation process into the app-related song table. The program for a mobile terminal according to claim 1. [Claim 4] Event detection processing for detecting the occurrence of a predetermined event in application processing, If the event detection process detects the occurrence of a predetermined event, it executes a pause process that sends a command to the karaoke machine to pause music playback. The program for a mobile terminal according to claim 1. [Claim 5] The predetermined event detected by the event detection process is that a song reserved for a specific game has finished playing. The program for a mobile terminal according to claim 4. [Claim 6] The system executes a restart process that sends a command to the karaoke machine to resume music playback. The program for a mobile terminal according to claim 4. [Claim 7] The event detection process determines whether all song identification information registered in the application-related song table has been played on the karaoke machine, The pause process sends a pause command to the karaoke machine when the event detection process determines that all song identification information registered in the app-related song table has been played on the karaoke machine. The program for a mobile terminal according to claim 4. [Claim 8] The app image transmission process is executed to send the app image, which was formed during the app processing, to the karaoke machine. The program for a mobile terminal according to claim 1. [Claim 9] A karaoke system comprising a karaoke device and a mobile device program executed on a mobile device, The mobile device program is A mapping process that establishes a communication-enabled association with the karaoke machine, The registration process involves registering the song identification information of songs reserved for the game into the app-related song table. The system receives playback status information, including song identification information, for songs that have started playing from the karaoke machine, and performs a song determination process that determines whether the song identification information for the played song exists in the app-related song table, based on the playback status information and the app-related song table. In the song detection process, if it is determined that a song started playing on the karaoke machine exists in the app's related song table, the app will perform its actions. If the karaoke machine determines that a song has been started playing and does not exist in the app's related song table, the app will perform an action on the mobile device that prevents the app from running. Karaoke system.

Images