Program for portable terminal and karaoke system

Abstract

To provide a new way of enjoying by linking a Karaoke device and a portable terminal.SOLUTION: A program for a portable terminal in accordance with the present invention causes the terminal to execute: a correspondence process for communicatively correspondence with a Karaoke device; a music determination process for determining whether or not the Karaoke music being played on the Karaoke device is an application-related music; and an application process in which an operation of the application is performed when a Karaoke music being played on the Karaoke device is determined to be an application-related music in the music determination process, and the operation of the application is not performed when the Karaoke music being played on the Karaoke device is determined not to be an application-related music.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to a program for a portable terminal that operates in conjunction with a karaoke device that performs music for singing, and to a karaoke system that includes the karaoke device and the program for a portable terminal. [Background technology]

[0002] Karaoke, where people enjoy singing along to the music being played, has become popular among many users. Karaoke machines can now play a huge number of songs thanks to music distribution via communication. To improve the playability of karaoke machines, there is a demand for adding new functions in addition to the basic music playback function.

[0003] Patent Document 1 discloses a singing assistance system that performs an appropriate sound effect production method depending on whether the user of the karaoke system is single or multiple. According to the singing assistance system described in Patent Document 1, if there is a single user, sound effect pronunciation data is output as sound, and if there are multiple users, display data of the sound effect is output as display, making it possible to efficiently derive an appropriate sound effect production method depending on the karaoke usage mode. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2008-76677 A Summary of the Invention [Problem to be solved by the invention]

[0005] The singing assistance system described in Patent Document 1 aims to strengthen the music playback function, which is a basic function of a karaoke machine. One of the objects of the present invention is to provide a new way of enjoying karaoke by linking the karaoke machine with a mobile terminal carried by the user. Another object of the present invention is to reduce the processing load and development load on the karaoke machine when linking the karaoke machine with the mobile terminal. [Means for solving the problem]

[0006] Therefore, the program for a mobile terminal according to the present invention is a correspondence process for corresponding the karaoke device so that the karaoke device can communicate with the karaoke device; a song determination process for determining whether a karaoke song being played on the karaoke device is an application-related song; In the song determination process, when it is determined that the karaoke song being played on the karaoke device is an application-related song, the application is operated, When it is determined that the karaoke piece being reproduced by the karaoke device is not an application-related piece, the mobile terminal is caused to execute application processing that does not operate the application.

[0007] Furthermore, in the mobile terminal program according to the present invention, In the application processing, if it is determined in the music determination processing that the music is not application-related music, the operation of the application is temporarily stopped, and if it is determined that the music is application-related music, the operation of the application is resumed. The music determination process determines whether or not a piece of music is an application-related music based on an application-related music table in which identification information indicating application-related music is registered.

[0008] Furthermore, the program for a mobile terminal according to the present invention comprises: A registration process is executed to register identification information indicating the application-related music piece in the application-related music piece table.

[0009] Furthermore, the program for a mobile terminal according to the present invention comprises: A song selection process for selecting a karaoke song; A reservation process is executed to reserve the karaoke piece selected in the song selection process in the karaoke device; In the registration process, the identification information of the karaoke song reserved in the reservation process is registered in the application-related song table as identification information indicating the application-related song.

[0010] Furthermore, the program for a mobile terminal according to the present invention comprises: In the song determination process, when it is determined that the karaoke song being played on the karaoke device has identification information indicating an application-related song, it is determined that the karaoke song corresponding to the identification information has been played.

[0011] Furthermore, the program for a mobile terminal according to the present invention comprises: An event detection process for detecting an occurrence of a predetermined event in application processing; When the occurrence of a predetermined event is detected in the event detection process, a pause process is executed in which an instruction to pause the reproduction of a karaoke piece is transmitted to the karaoke device.

[0012] Furthermore, in the mobile terminal program according to the present invention, The predetermined event detected in the event detection process is the completion of playback of a predetermined application-related music piece.

[0013] Furthermore, the program for a mobile terminal according to the present invention comprises: A restart process is executed to transmit an instruction to restart the reproduction of the karaoke piece to the karaoke device.

[0014] Furthermore, in the mobile terminal program according to the present invention, The song determination process determines whether the identification information of the reproduced karaoke song is an identification information indicating an application-related song based on an application-related song table in which identification information indicating an application-related song is registered; The event detection process includes determining whether or not identification information indicating all of the application-related songs registered in the application-related song table has been reproduced by the karaoke device; The pause process transmits a pause instruction to the karaoke device when it is determined in the event detection process that the identification information indicating all of the application-related songs registered in the application-related song table has been played by the karaoke device.

[0015] Furthermore, the program for a mobile terminal according to the present invention comprises: An application image transmission process is executed to transmit the application image formed in the application process to the karaoke device.

[0016] Further, the karaoke system according to the present invention comprises: A karaoke system including a karaoke device and a program for a portable terminal executed on a portable terminal, The mobile terminal program a correspondence process for corresponding the karaoke device so that the karaoke device can communicate with the karaoke device; a song determination process for determining whether a karaoke song being played on the karaoke device is an application-related song; In the song determination process, when it is determined that the karaoke song being played on the karaoke device is an application-related song, the application is operated, When it is determined that the karaoke piece being reproduced by the karaoke device is not an application-related piece, the mobile terminal is caused to execute application processing that does not operate the application. Effect of the Invention

[0017] The mobile terminal program and karaoke system according to the present invention provide a new way of enjoying karaoke by linking a karaoke device with a mobile terminal owned by a user. In addition, by linking a karaoke device with a mobile terminal, it is possible to reduce the processing load and development load on the karaoke device. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a diagram showing a karaoke device according to an embodiment of the present invention and its peripheral configuration. [Diagram 2] FIG. 1 is a flow diagram showing a music playback process according to an embodiment of the present invention; [Diagram 3] 1 is a flowchart showing a game process according to the present embodiment; [Figure 4] FIG. 1 is a flow diagram showing a preparation process according to the present embodiment; [Diagram 5] FIG. 11 is a flow chart showing a playback process according to the embodiment; [Figure 6] FIG. 1 is a flow diagram showing vote acceptance and result processing according to the present embodiment. [Figure 7] FIG. 1 is a diagram for explaining a reservation table and an application-related song table according to the present embodiment; [Figure 8] FIG. 1 is a diagram for explaining a reservation table and an application-related song table according to the present embodiment; [Figure 9] FIG. 1 shows a situation when a game is used according to the present embodiment. [Figure 10] 5A to 5C are diagrams showing various screens displayed on the mobile terminal according to the embodiment; [Figure 11] 5A to 5C are diagrams showing various screens displayed on the mobile terminal according to the embodiment; [Figure 12] 5A to 5C are diagrams showing various screens displayed on the mobile terminal according to the embodiment; [Figure 13] 5A to 5C are diagrams showing various screens displayed on the mobile terminal according to the embodiment; [Figure 14] 5A to 5C are diagrams showing various screens displayed on the mobile terminal according to the embodiment; [Figure 15] 5A to 5C are diagrams showing various screens displayed on the remote control device according to the embodiment; [Figure 16] 5A to 5C are diagrams showing various screens displayed on a monitor according to the embodiment; [Figure 17] 5A to 5C are diagrams showing various screens displayed on a monitor according to the embodiment; [Figure 18] FIG. 11 is a flow chart showing a playback process according to another embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] 1 is a diagram showing a karaoke device of this embodiment and its peripheral configuration. A karaoke device 2 (sometimes called a "commander") in this embodiment has a remote control device 1 as its peripheral configuration. The karaoke device 2 and the remote control device 1 are communicatively connected to form a network using a LAN 100 and an access point 110.

[0020] The karaoke device 2 installed in a karaoke booth or the like includes an audio control unit 25 as a performance unit for playing music. The karaoke device 2 also includes an operation unit 21 that accepts various inputs from the user. The karaoke device 2 also includes an operation processing unit 22 that interprets the inputs from the operation unit 21 and transmits them to the control unit 30. The karaoke device 2 also includes a hard disk 32 as a storage unit for storing various information. The karaoke device 2 also includes a LAN communication unit 24a as a communication means for connecting to the LAN 100 and joining the network. The karaoke device 2 of this embodiment also includes a wireless LAN communication unit 24b. This wireless LAN communication unit 24b can also be used to perform network communication.

[0021] The karaoke device 2 also includes a video playback means for displaying a lyric video and a background video on the monitor 41. The video playback means includes a video playback section 29 for playing back video based on video information, a video RAM 28 for temporarily storing the video to be played back, and a video control section 31 for overlaying lyric captions on the played back video, applying video effects, and the like.

[0022] Furthermore, the karaoke device 2 is capable of displaying various information on the touch panel monitor 33 in addition to the externally connected monitor 41. The touch panel monitor 33 is configured by superimposing a display section 33a for displaying video information input from the video control section 31 and a touch panel 33b for outputting a touch-input position to the operation processing section 22.

[0023] The touch panel monitor 33 is disposed on the front surface of the housing of the karaoke device 2 and functions as an input unit. By selecting a song on the touch panel monitor 33, the user can directly reserve a song on the karaoke device 2 and perform various operations on the karaoke device 2.

[0024] Furthermore, the karaoke device 2 is configured to include a control unit 30 for controlling each component in an integrated manner, and a control unit including a memory 27 for temporarily storing information required for executing various programs.

[0025] With this configuration, the karaoke device 2 executes various processes. The main processes executed by the karaoke device 2 include a song reservation process and a song playback process. The song reservation process is a process for specifying and reserving a song based on an operational instruction from the user, and is executed in cooperation with the remote control device 1. Reservation information including song identification information (song identification information) formed by the song specification process of the remote control device 1 is transmitted to the karaoke device 2. The karaoke device 2 registers the received reservation information in a reservation table in the memory 27. The song playback process is a process for playing a song based on the reservation information registered in the reservation table, and is a process in which the song performance process and the lyric display process are executed synchronously.

[0026] The music performance process is a process for reading music information based on music identification information in the reservation information registered in the reservation table, and for causing the audio control unit 25 to perform a performance based on the performance information included in the music information. The music performed by the audio control unit 25 is output from the speaker 42 together with the singing voice input from the singing microphones 44a, 44b. The lyrics display process is a process for providing singing assistance by displaying the lyrics information included in the music information on the monitor 41. A background image display process may be executed in which the lyrics displayed in the lyrics display process are superimposed on a background image.

[0027] The remote control device 1 can search for songs based on an operation instruction from a user, and execute reservation instruction processing such as transmitting reservation information for a specified and reserved song to the karaoke device 2. The remote control device 1 can also receive various information from the karaoke device 2 or a server device connected to the Internet and execute various processes. In this embodiment, the remote control device 1 includes an operation unit 17 and a touch panel monitor 11 as a user interface for receiving various operation instructions from a user. The touch panel monitor 11 includes a display unit 111 and a touch panel 112, and displays various interfaces on the display unit 111, and can receive touch input from the user using the touch panel 112.

[0028] Furthermore, the remote control device 1 is equipped with a memory 14 as a storage unit for storing a database required for searching for music, various programs, and various information generated with the execution of the programs, and a remote control control unit for controlling these components in an integrated manner. The remote control control unit includes a control unit 15, an image control unit 13 for forming an image to be displayed on the touch panel monitor 11, a video RAM 12 for temporarily storing image information to be displayed, and an operation processing unit 18 for interpreting input from the touch panel monitor 11 or the operation unit 17 and transmitting the input to the control unit 15.

[0029] The remote control device 1 is connected to a network formed by a LAN 100 by being wirelessly connected to an access point 110 via a wireless LAN communication unit 16. In communication using the wireless LAN communication unit 16, the remote control device 1 and the karaoke device 2 can perform two-way communication. Each remote control device 1 is associated with a specific karaoke device 2 at any timing. Various commands output from the remote control device 1 are received by the associated karaoke device 2, making it possible to remotely control the karaoke device 2.

[0030] The remote control device 1 can also perform communication using an infrared communication unit 19. In communication using the infrared communication unit 19, communication between the remote control device 1 and the karaoke device is one-way (from the remote control device 1 to the karaoke device 2). In this embodiment, communication is performed using the infrared communication unit 19 when communication using the wireless LAN communication unit 16 is not possible.

[0031] With such a configuration of the remote control device 1, various inputs from the user are accepted from the touch panel monitor 11 or the operation unit 17, and various information is provided to the user by the display on the touch panel monitor 11, making it possible to perform various processes, such as a reservation instruction process for transmitting reservation information to be output to the karaoke device 2.

[0032] 2 is a flow diagram showing a music playback process according to this embodiment. The karaoke device 2 executes this music playback process for reserved music. In the music playback process, the reservation table is checked (S001). If there is a next music to be played in the reservation table (S002: Yes), music information corresponding to music identification information included in the reservation information is read out, and music playback is started (S003).

[0033] Then, if there is a portable terminal 6 that is communicatively connected to the karaoke device 2 (S003: Yes), playback status information is transmitted to the portable terminal 6 (S004). The communication connection with the portable terminal 6 and the playback status information transmitted to the portable terminal 6 will be described later. When the playback of the song ends (S005: Yes), if there is a portable terminal 6 that is communicatively connected (S006: Yes), playback status information is transmitted to the portable terminal 6 (S007). Then, the process returns to the beginning of the song playback process, where the reservation table is checked (S001), and the next song is played.

[0034] The karaoke machine 2 of this embodiment can provide services such as games in cooperation with a mobile terminal 6 such as a smartphone or tablet terminal owned by a user. The mobile terminal 6 executes an app (application program) to link with the karaoke machine 2. In this embodiment, a game is used as an example to explain the service provided by the cooperation between the karaoke machine 2 and the mobile terminal 6. The game played in this embodiment is a game in which the player guesses who is being interrupted by an interfering sound while a song is being played. The karaoke system according to the present invention includes the karaoke machine 2 and a mobile terminal program executed on the mobile terminal 6.

[0035] Fig. 9 shows a situation when a game is being played. The karaoke device 2 and the mobile terminal 6 are connected in a state in which they can communicate with the karaoke device 2. Fig. 9 shows a state in which four users 7A to 7D are participating in the game, and the state in which the user 7A is singing is shown. The singing user 7A wears headphones 65 that are connected to the mobile terminal 6 via wireless communication (or wired communication).

[0036] Roles (noisy, DC, normal) are assigned to users 7A to 7D. While a song is being sung, an operable button (disturbance button) is displayed on the touch panel monitor 61 of the mobile terminal 6, and a user other than the user singing (users 7B to 7D in this case) operates the button. If the role of the singing user is "noisy," an interfering sound is output from headphones 65 when the interfering button is operated. On the other hand, if the role of the singing user is other than "noisy," no interfering sound is output even if the interfering button is operated.

[0037] The victory condition for a user assigned the role of "noisy" is to not let it be discovered that the role assigned to him / her is "noisy". The victory condition for a user assigned the role of "normal" is to guess who the user assigned the role of "noisy" is. The victory condition for a user assigned the role of "DC" is to be thought of as "noisy". In the game of this embodiment, after all users 7A to 7D take turns singing, a vote is cast to determine which group of roles (camp) will win.

[0038] 3 is a flow diagram showing the game processing according to this embodiment. The game processing is executed in the order of preparation processing (S100), playback processing (S200), and vote acceptance / result processing (S300). First, the preparation processing (S100) will be described.

[0039] FIG. 4 is a flow diagram showing preparation processing (S100) according to this embodiment. The user starts an application (application program) of the mobile terminal 6, or selects a game from a menu of the application. FIG. 10(a) shows a start screen displayed on the touch panel monitor 61 of the mobile terminal 6. A start button 61a is displayed on the start screen, and when the start button 61a is operated (S101: Yes), a code reading screen shown in FIG. 10(b) is displayed (S102). The code reading screen has a shooting display field 61b for displaying an image captured by the rear camera of the mobile terminal 6.

[0040] Also, the user uses the remote control device 1 to start a game function on the karaoke device 2 side. FIG. 15(A) shows a start screen displayed on the touch panel monitor 11 of the remote control device 1. After displaying the start screen, the touch panel monitor 11 displays a code display screen shown in FIG. 15(B). A QR code (registered trademark) is displayed on the code display screen as code information 11a. The code information 11a includes connection information for communicatively connecting the mobile terminal 6 to the karaoke device 2, such as identification information of the karaoke device 2. The mobile terminal 6 reads the connection information of the code information 11a by photographing the code information 11a so that it is located within the photographed display field 61b described in FIG. 10(b).

[0041] If the connection information is read by the mobile terminal 6 (S103: Yes), the mobile terminal 6 executes a correspondence process to connect and communicate with the karaoke device 2 using a mobile terminal network or a wireless LAN used in the store (S104). After that, the mobile terminal 6 and the karaoke device 2 can transmit and receive information via communication.

[0042] After the communication connection is completed, the mobile terminal 6 displays a number-of-participants input screen shown in FIG. 10(c) (S105). The number-of-participants input screen is a screen for inputting the number of people participating in the game, and displays a number-of-participants input field 61c, an assigned number of people 61d, and a decision button 61e. The user inputs the number of people participating in the game in the number-of-participants input field 61c using a software keyboard (not shown) or the like. When the number of participants is input (S106: Yes), a mode assignment process is executed to assign a role to each participant. The assigned number of people 61d displays the number of people assigned to each role (noisy, DC, normal) (S107). In this embodiment, the assigned number of people is determined by the mobile terminal 6, but may be set by the user. After inputting the number of participants, the decision button 61e is operated (S108: Yes) to display a character notification screen (S109).

[0043] In this embodiment, an identification information assignment process is executed to assign characters 7a to 7d to each user so that the user can easily play the game. The user can check the singing of songs by the characters 7a to 7d assigned by the identification information assignment process, the acceptance of votes, etc. Note that a mode assignment process may be executed to assign the first mode or the second mode to the characters 7a to 7d for which the identification information assignment process has been executed.

[0044] In this embodiment, the game is played using one mobile terminal 6, so the users 7A to 7D check the characters 7a to 7d and the roles assigned to them and select songs by taking turns passing the mobile terminal 6. For ease of explanation, the explanation will be given with the same alphabetical suffix, with the user 7A being assigned the character 7a, the user 7B being assigned the character 7b, and so on.

[0045] Fig. 11(d) is a diagram showing a character notification screen of this embodiment. The character notification screen (S109) displays the character 7a (dog character) and the character confirmation button 6f. The user 7A who first receives the mobile terminal 6 confirms the character 7a assigned to him / her on the character notification screen shown in Fig. 10(d). After confirming, the user operates the role confirmation button 61f (S110: Yes) to display the next role notification screen (S111).

[0046] FIG. 10(e) is a diagram showing a role notification screen of this embodiment. A role display field 61g and a music selection start button 61h are displayed on the role notification screen. The role display field 61g displays the role required in the game assigned by the mode assignment process and the victory conditions for the role. In the case of FIG. 10(e), it is displayed that the character 7a of the user 7A has been assigned the role "noisy". The victory condition for the role "noisy" is that the other users do not know that the user is "noisy". Note that, in playing the game, it is necessary that the role notification screen is not shown to other users.

[0047] After confirming his / her role, the user 7A operates the music selection start button 61h (S112: Yes) to start the music selection process (S113). Fig. 11(i) is a diagram showing the music selection screen of this embodiment. The music selection screen displays a search item specification field 61i, and the user can select music by song, artist (singer), or album.

[0048] 11(i) shows a state in which songs are selected by song, and a song-related information display field 61j is displayed on the screen by song (in alphabetical order). Song titles, artist names, and icons are displayed in the song-related information display field 61j, and the user selects a song by operating the song-related information display field 61j. When a song is selected, a song confirmation screen (not shown) showing details of the song is displayed, and the user 7A confirms the song (S114: Yes).

[0049] When the song selection is confirmed (S114: Yes), the mobile terminal 6 is handed over to the next user 7B, who displays (S109) a character notification screen (not shown), displays (S111) a role notification screen, and executes song selection processing (S113). FIG. 10(f) shows the role notification screen for user 7B. The role notification screen displays the character 7b (a cat character) assigned to user 7B, and the role display field 61g displays the assigned role "DC". The processing condition for the role "DC" is to be thought of as "noisy".

[0050] When the song selection by user 7B is confirmed (S114: Yes), the mobile terminal 6 is handed over to the next user 7C, who then displays a character notification screen (not shown) (S109), displays a role notification screen (S111), and executes song selection processing (S113). 12(g) is a role notification screen for user 7C. The role notification screen displays the character 7c (a squirrel character) assigned to user 7C, and the role display field 61g displays the assigned role "normal." The processing condition for the role "normal" is to hit "noisy."

[0051] When the song selection of user 7C is confirmed (S114: Yes), the mobile terminal 6 is handed over to the next user 7D, who then displays a character notification screen (not shown) (S109), displays a role notification screen (S111), and executes song selection processing (S113). 12(h) is a role notification screen for the user 7D. The role notification screen displays the character 7d (rabbit character) assigned to the user 7D, and the role display field 61g displays the assigned role of "normal."

[0052] When all the users 7A to 7D have confirmed their characters, roles, and selected songs (S115: Yes), an all song selection confirmation screen is displayed on the touch panel monitor 61 of the mobile terminal 6 (S116). 13(j) is a diagram showing the all song selection confirmation screen of this embodiment. On the all song selection confirmation screen, a song selection content display field 61k and a performance start button 61l are displayed for each of the characters 7a to 7d. The users 7A to 7D can check the selected songs and artists through the song selection content display field 61k.

[0053] As can be seen from the all song selection confirmation screen, the selected song is assigned to each character 7a-7d (identification information indicating the user 7A-7D). Since each character 7a-7d is assigned a role, the selected song is assigned to the first mode that outputs interference sounds (role "noisy") or the second mode that does not output interference sounds (role "DC" or "normal").

[0054] After checking the song, when the performance start button 61l is operated (S117: Yes), the mobile terminal 6 executes a registration process (S118) in which the song identification information of the song reserved for the game is registered in the application-related song table as a song reserved for the game application (hereinafter referred to as an "application-related song"). In the registration process (S118), the song identification information of the reserved song is registered in the application-related song table as identification information indicating the application-related song. In the registration process (S118) of this embodiment, a character and a role are registered in association with the registered song identification information.

[0055] The mobile terminal 6 executes a reservation process in which it transmits reservation information including the song identification information of the selected song to the karaoke device 2 (S119). When a reservation is made (S119), information indicating the characters 7a-7d assigned to each song may also be transmitted to the karaoke device 2. The karaoke device 2 registers the song identification information of songs reserved for the game in a reservation table in the same way as for normal songs, and manages the playback of the songs. Therefore, the karaoke device 2 cannot determine whether a song is reserved for a game or not.

[0056] The karaoke device 2 of this embodiment transmits playback status information including music identification information of a music piece that has started (or ended) playback to the mobile terminal 6 at an appropriate timing. Therefore, the mobile terminal 6 can grasp the playback status of the application-related music piece based on the playback status information indicating the music playback status received from the karaoke device 2, and control the progress of the game application. With this configuration, the processing related to the game application can be mainly performed on the mobile terminal 6 side, and it is possible to reduce the processing burden on the karaoke device 2, or the burden and modification during development. Note that the playback status information can be not only the music identification information of a music piece that has started (or ended) playback, but also various information indicating the music playback status, such as transmitting the music identification information of a music piece that is currently being played at an appropriate timing.

[0057] The karaoke device 2 registers the song identification information of the song included in the reservation information in a reservation table, and starts a song reproduction process based on the reservation table.

[0058] 7 and 8 are diagrams for explaining the reservation table and the application-related music table according to this embodiment. Fig. 7(A) shows the state immediately after the start playing button 61l is operated on the all songs confirmation screen described in Fig. 13(j). Song identification information indicating songs A to D is registered in the application-related song table of the mobile terminal 6, and reservation information is transmitted to the karaoke device 2. Upon receiving the reservation information from the mobile terminal 6, the karaoke device 2 registers the song identification information included in the reservation information in the reservation table (Fig. 7(B)). The karaoke device 2 starts playing song A according to the reservation table. 7 and 8, the black arrow shown on the left side of the reservation table and the application-related song table indicates the song currently being played. When playback of song A starts, playback status information is sent to the mobile terminal (FIG. 7(C)). By receiving the playback status information, the mobile terminal 6 is able to determine that song A is currently being played.

[0059] The karaoke device 2 of this embodiment has an interrupt reservation function. The interrupt reservation function is a function for reserving the next song to be played regardless of the reservation table. The interrupt reservation can be performed using the remote control device 1, the touch panel monitor 33 of the karaoke device 2, or the mobile terminal 6. By using this interrupt reservation function, it is possible to sing songs other than the app-related songs even while playing a game.

[0060] FIG. 7(D) shows a situation where a song W is reserved to interrupt while a song A is being played. In a reservation table managed by the karaoke device 2, the reserved song W is registered as the song to be played after the song A. Note that the song W in the reservation table shown in FIG. 7(D) and subsequent figures is surrounded by diagonal lines to facilitate understanding, but the karaoke device 2 treats the song W in the same way as the other songs A to D. When the playback of the song A ends and the playback of the reserved song W starts, the karaoke device 2 transmits playback status information including the song identification information of the song W to the mobile terminal 6 (FIG. 7(E)). The mobile terminal 6 that has received the playback status information executes a song determination process to determine whether or not the song identification information of the song W exists in the application-related song table. If it is determined in the song determination process that the song identification information of the song W does not exist in the application-related song table, the application process does not operate the game application.

[0061] When the karaoke device 2 finishes playing song W and starts playing the next song B, the karaoke device 2 transmits playback status information including the song identification information of song B to the mobile terminal 6 (FIG. 7(F)). The application processing of the mobile terminal 6 that has received the playback status information resumes the operation of the stopped game application because the song identification information of song B is registered in the application-related song table (FIG. 7(F)).

[0062] 8(G) is a diagram showing a situation in which music playback progresses on the karaoke device 2 and playback of song D has begun. When playback of song D begins, the karaoke device 2 transmits playback status information including song identification information of song D to the mobile terminal 6. Having received the playback status information, the mobile terminal 6 refers to the application-related song table and recognizes that playback of song D as an application-related song has begun. Furthermore, when playback of song D has finished, the mobile terminal 6 is able to recognize, based on the application-related song table, that all application-related songs have been played.

[0063] As described above, in this embodiment, the karaoke device 2 only needs to adopt a simple configuration of transmitting playback status information. Also, the mobile terminal 6 is able to grasp the playback status of the application-related music based on the playback status information indicating the music playback status received from the karaoke device 2 and the application-related music table, and control the progress of the game application.

[0064] Next, the progress of the game when playing music will be described. Before starting music playing processing, the karaoke device 2 displays a character display screen shown in Fig. 16(a) on the monitor 41. In this embodiment, the mobile terminal 6 executes application processing for forming a screen to be displayed on the monitor 41 of the karaoke device 2. The mobile terminal 6 executes application image transmission processing for forming an application image to be displayed on the monitor 41 and transmitting it to the karaoke device 2. The karaoke device 2 displays the received application image on the monitor 41. A flag indicating the display format is attached to the application image. When the flag is "0", the karaoke device 2 displays only the received application image on the monitor 41. When the flag is "1", the karaoke device 2 synthesizes the received application image with an image formed by the karaoke device 2 and displays the result on the monitor 41.

[0065] The mobile terminal 6 may also instruct the display period of the application image. The display period may be instructed not only to indicate the display start timing and end timing, but also to indicate the display start timing and display time. In this way, the karaoke device 2 receives the application image created by the mobile terminal 6 and displays it on the monitor 41, thereby reducing the processing load on the karaoke device 2 and making it unnecessary to make major modifications to the karaoke device 2 each time an application is added, thereby making it possible to reduce the development load. The image (application image) that the karaoke device 2 displays on the monitor 41 in conjunction with the execution of the application, which will be described below, is created by the mobile terminal 6.

[0066] 16(a), the selected characters 7a to 7d are displayed, and the user can check his / her own character. Meanwhile, the portable terminal 6 executes a playback process (S200) while the music is being played back on the karaoke device 2.

[0067] FIG. 5 is a flow diagram showing the playback process (S200) according to this embodiment. The mobile terminal 6 receives playback status information including music identification information of the music being played by the karaoke device 2 (S201). The mobile terminal 6 executes music determination process to determine whether the music is an application-related music based on the received playback status information and the application-related music table (S202). If the music is not an application-related music (S202: No), the mobile terminal 6 executes application process to pause the operation of the game application (S203). Therefore, for example, as described in FIG. 7 and FIG. 8, the operation of the game application is paused when an interruption music (music W) reserved without any relation to the application is played.

[0068] On the other hand, if it is determined in the song determination process (S202) that the song is an application-related song (S202: Yes), the mobile terminal 6 compares the song identification information included in the received playback status information with the application-related song table to determine which user 7A-D (actually, assigned character 7a-7d) selected the song and their role (S204). Also, if it is determined that the song is an application-related song (S202: Yes), the song identification information determined to be an application-related song in the application-related song table stored and managed by the mobile terminal 6 is considered to have been played.

[0069] In the application-related song table, song identification information that has been determined to have been played is determined not to be an application-related song in the song determination process (S202) from the next time onwards. In the application-related song table, various forms of determining that a song has been played can be adopted, such as deleting the song identification information or assigning a played flag to the song identification information. Note that if the same song identification information is registered multiple times in the application-related song table, the song identification information located first based on the order (song order) of the song identification information registered in the application-related song table is determined to have been played.

[0070] If the music identification information included in the playback status information is not registered in the application-related music table, the game function may not be executed or may be temporarily stopped on the mobile terminal 6. Next, the mobile terminal 6 displays an intrusive screen showing one of the characters 7a to 7d based on the determined character 7a to 7d (S205). Fig. 13(k) is a diagram showing the interruption screen of this embodiment. The interruption screen displays the character 7a corresponding to the music identification information being played and an interruption button 61m. Fig. 13(k) shows the case where the user 7A is singing, as in the case described in Fig. 9.

[0071] 9, user 7A sings while wearing headphones 65. The performance sounds of the music played by karaoke device 2 are emitted from speaker 42, but because the volume is high, user 7A can hear the performance sounds even while wearing headphones 65. To better hear the performance sounds, headphone 65 may be worn on only one ear.

[0072] 16(b) is displayed on the monitor 41 connected to the karaoke device 2. The singing screen also displays lyrics 41c to assist singing, as well as a character 7a assigned to the song being played and an interruption button notification area 41b.

[0073] Users 7B to 7D other than the singing user 7A operate the intrusion button 61m displayed on the touch panel monitor 61 (interface) of the portable terminal 6 shown in Fig. 9 at the timing when they wish to output an interference sound. When the intrusion button 61m shown in Fig. 13(k) is operated (S207: Yes), the portable terminal 6 transmits operation information indicating that the intrusion button 61m has been operated to the karaoke device 2 (S208). When the karaoke device 2 receives the operation information, it executes an operation display process to display in the intrusion button notification field 41b that the intrusion button 61m has been operated. Also, the interface of the portable terminal 6 may be capable of executing an operation display process to display that the intrusion button 61m has been operated.

[0074] The notification to the intrusion button notification field 41b by the operation display process can be in various forms, such as switching between displaying and hiding the intrusion button notification field 41b, changing the message displayed in the intrusion button notification field 41b, etc. In this embodiment, the operation of the intrusion button 61m is notified by display, but it may also be notified by sound. In that case, when the intrusion button 61m is operated, a notification sound is emitted from the speaker 42, so that all users 7A to 7D can confirm that the intrusion button 61m has been operated.

[0075] Next, the mobile terminal 6 checks whether the role corresponding to the song identification information being played back in S204 is "noisy" (S209). If the role is "noisy" (S209: Yes), the mobile terminal 6 executes interference sound output processing to output interference sound to the headphones 65 worn by the singing user 7A (S210). The interference sound output by the interference sound output processing uses noise, conversation, music unrelated to the song, etc., lasting for several seconds, and if the role of the singing user is "noisy," this interference sound makes it difficult for the singing user to sing.

[0076] The user 7A with the role of "noisy" behaves as if he does not hear the disturbing sound, thereby appealing that his role is not "noisy." Meanwhile, the other users 7B to 7D operate the disturbance button 61m to check the reaction of the singing user 7A, and guess whether the role of the user 7A is "noisy" or not.

[0077] On the other hand, in the case of users 7B to 7D whose role is not "noisy" (S209: No), no disruptive sound is output even if the interference button 61m is operated (S207: Yes). In the case of users 7C and 7D whose role is "normal", no disruptive sound is output, so they can sing without being disturbed by the disruptive sound. On the other hand, in the case of user 7B whose role is "DC", no disruptive sound is output. However, since the winning condition is to be thought of as "noisy", the user will behave as if he is being disturbed by the disruptive sound.

[0078] Any of the users 7A-7D can confirm that the interruption button 61m has been operated by looking at the interruption button notification field 41b displayed on the monitor 41. When singing, each of the users 7A-7D expresses whether or not they are interrupted by the interruption sound through their singing or attitude in a way that leads to their own victory condition. In addition, the users 7A-7D who are guessing this can guess which users 7A-7D have been assigned the role "noisy" by observing the singing conditions and attitudes of the singing users 7A-7D.

[0079] The karaoke device 2 plays the songs selected by each of the users 7A-7D, and the mobile terminal 6 executes the processes of S201-S210 in Fig. 5 for each of the users 7A-7D. When the karaoke device 2 finishes playing a song, it notifies the mobile terminal 6 of the end of the playback by sending playback status information including song identification information of the song that has finished playing (Fig. 2, S007).

[0080] As described above, the mobile terminal 6 manages the song identification information as an application-related song on the application-related song table. Therefore, the mobile terminal 6 can grasp the playback status of the application-related song based on the playback status information received from the karaoke device 2. In the event detection process for detecting a predetermined event, the mobile terminal 6 receives a song playback end notification in S206, determines whether or not all application-related songs have been played, and ends the playback process (S200) on the condition that it detects that all application-related songs have been played (S211: Yes), and executes the next voting result process (S300).

[0081] FIG. 6 is a flow diagram showing the vote acceptance process and result process (S300) according to this embodiment. The vote acceptance process and result process (S300) is a process for accepting votes from each of the users 7A to 7D as to who is the role "noisy" and announcing the result. In the vote acceptance process and result process (S300), when the event detection process of the mobile terminal 6 detects that the playback of all application-related songs has been completed, a pause process is executed to send a temporary pause instruction to the karaoke device 2 (S301). Upon receiving the pause instruction, the karaoke device 2 pauses the song playback process.

[0082] 13(I) shows the discussion time display screen according to this embodiment. In the vote acceptance and result process (S300), a time (discussion time) is provided for discussion among the users 7A to 7D before casting a vote. The discussion time display screen displays a remaining time display field 61n, an extension button 61o, and an end button 61p.

[0083] In this embodiment, a time limit is set for the discussion time (S302), and the remaining time of the discussion time is counted down and displayed in the remaining time display field 61n. The extension button 61o is an operator for extending the discussion time. The end button 61p is an operator for ending the discussion time. When the discussion time runs out or the end button 61p is operated to end the discussion time (S303: Yes), one of the characters 7a to 7d is identified (S304). Then, a vote acceptance process is executed to display a vote screen for the identified character 7a to 7d (S305).

[0084] Fig. 14(m) is a diagram showing a voting screen of this embodiment. Fig. 14(m) is a voting screen when the character 7a is specified in S304 of Fig. 6. The voting screen is provided with a voting column 61q and a voting button 61s. The voting column 61q is provided with the selected song name, artist name, and voting check column 61r for each of the characters 7a to 7d. The user 7A corresponding to the character 7a selects one of the characters 7a to 7d of the users 7A to 7D who are estimated to have the role "noisy" by touching the voting check column 61r.

[0085] In this embodiment, when voting, it is possible to select the character 7a assigned to the user 7A who is casting the vote. After selecting the characters 7a to 7d, the user operates the voting button 61s to complete the vote (S306: Yes). When the user 7A has completed voting, the characters 7b to 7d corresponding to the next users 7B to 7D who have not yet cast their votes are identified (S304), and the user casts the vote using the voting screen.

[0086] When all characters 7a-7d have been identified (S307: Yes), that is, when all users 7A-7D have voted, a tallying process (S308) is performed based on the votes received by the vote receiving process. In the tallying process, the number of votes cast for each character 7a-7d is tallied, and a winning camp (group of winning roles) is determined based on the tallying results. Then, a result notification process is performed (S309) to display a result screen based on the tallying process (S308).

[0087] 14(n) is a diagram showing a result screen of this embodiment. The result screen by the result notification process is provided with a noisy display field 61t, a DC display field 61u, a winning camp display field 61v, a counting result display field 61w, a resume button 61x, and an end button 61y. The noisy display field 61t displays the character 7a assigned to the role "noisy."

[0088] The DC display column 61u displays the character 7d assigned to the role "DC." The tally result display column 61w displays the number of votes for each of the characters 7a to 7d. In the case of FIG. 14(n), the character 7a has the role "noisy," and since the character 7a has been voted for the role "noisy" the most, the winning camp will be the role "normal." Therefore, the name of the role "normal" is displayed in the winning camp display column 61v.

[0089] In this embodiment, the result screen is also displayed on the monitor 41 connected to the karaoke device 2. The mobile terminal 6 transmits an image constituting the result screen formed in the application processing to the karaoke device 2 in an application image transmission processing, whereby the result screen is displayed on the monitor 41. 17(e) is a diagram showing a result screen displayed on the monitor 41. The result screen, like the result screen of the mobile terminal 6, displays a noisy display field 41e, a DC display field 41f, and a vote content display field 41h. The winning camp display field 41g displays the name of the winning camp (role "normal") as well as the characters 7b and 7c belonging to the winning camp.

[0090] Users 7A to 7D can check which users played the roles "Noisy" and "DC" and which role won the game on the result screen displayed on the mobile terminal 6 (or the monitor 41). This completes the game, but users 7A to 7D can use the result screen on the mobile terminal 6 to select whether to restart or end the game.

[0091] When the resume button 61x in Fig. 14(n) is operated (S310: Yes), the process returns to the preparation process (S100) (S311) and the game is started again. When the game is resumed, the allocation of the characters 7a to 7d to the users 7A to 7D may be the same as that of the previous game. When the end button 61y is operated (S312: Yes), the game is ended (S313).

[0092] Thereafter, the portable terminal 6 executes a restart process to transmit a restart instruction to the karaoke device 2 (S314). Upon receiving the restart instruction, the karaoke device 2 restarts the music playback process based on the reservation table.

[0093] As described above, according to the karaoke system of this embodiment, it is possible to execute processing linking the karaoke device 2 with an application (a program for a mobile terminal) executed on the mobile terminal 6. In particular, since the karaoke device 2 only requires simple processing to link with the application executed on the mobile terminal 6, it is possible to reduce the processing burden on the karaoke device 2, or the burden and modification during development of the karaoke device 2. The karaoke system according to the present invention is not limited to the above-mentioned embodiment, and various modified examples can be adopted. Various modified examples are described below.

[0094] [First Modification] Fig. 18 is a flow diagram showing playback processing according to another embodiment. The same processes as those in the flow diagram (Fig. 5) of the playback processing (S200) described in the above embodiment are given the same reference numerals. The first modified example differs from the playback processing described in Fig. 5 in that an intermediate voting process (S214) and an intermediate voting result display process (S215) in Fig. 18 are performed. In the playback processing in Fig. 18, when the event detection process detects that the playback of a predetermined number of application-related songs has ended (S212: Yes), a pause process (S213), an intermediate voting process (S214), an intermediate voting result display process (S215), and a resume process (S216) are performed.

[0095] Here, the timing when the predetermined number of application-related songs have ended refers to, for example, when four users 7A to 7D participate in a game, and the event detection process detects the timing when two users have sung, which is the midpoint. When the event detection process detects the timing when the predetermined number of application-related songs have ended (S212: Yes), the mobile terminal 6 executes a pause process to send a pause instruction to the karaoke device 2 (S213). The karaoke device 2 that has received the pause instruction pauses the song playback process. Next, the mobile terminal 6 executes an intermediate voting process (S214). The intermediate voting process (S214) is a process of voting for the role "noisy" at the time point, similar to the voting screen described in FIG. 14(m).

[0096] The counting results of the intermediate voting process (S214) are displayed on the touch panel monitor 61 or monitor 41 of the mobile terminal 6 in an intermediate voting result display process (S215). After completion of the intermediate voting result display process (S215), the mobile terminal 6 performs a resume process of sending a resume instruction to the karaoke device 2 (S216). The karaoke device 2 that has received the resume instruction resumes the music playback process. In this way, by performing the intermediate voting process (S214) and the intermediate voting result display process (S215) during the game, it is possible to improve the playability of the game.

[0097] [Second modified example] In the above embodiment, when the event detection process detects the occurrence of an event that the vote acceptance and result process (S300) has started, the portable terminal 6 executes the pause process of sending a pause instruction to the karaoke device 2 to temporarily halt the music playback process. Also, when the event detection process detects the occurrence of an event that the vote acceptance and result process (S300) has ended, the portable terminal 6 executes the resume process of sending a resume instruction to the karaoke device 2 to resume the music playback process.

[0098] In the first modified example, when the event detection process detects the occurrence of an event that a predetermined number of application-related songs have been played, the portable terminal 6 executes a pause process of sending a pause instruction to the karaoke device 2, temporarily stopping the song playback process. When the event detection process detects the occurrence of an event that the intermediate voting result display process ends, the portable terminal 6 executes a resume process of sending a resume instruction to the karaoke device 2, restarting the song playback process.

[0099] The event that is the condition for pausing or resuming is not limited to the above-mentioned form, and various forms can be adopted. For example, the karaoke device 2 may execute the pause process as a condition that the event detection process detects that the application-related music has been played for a predetermined period (e.g., 3 seconds). In this case, the karaoke device 2 needs to transmit information indicating the current playback time as playback status information to the mobile terminal 6. In this way, by pausing the music when the application-related music has been played for a predetermined period (e.g., 3 seconds), it is possible to realize an intro guessing quiz that links the karaoke device 2 and the application of the mobile terminal 6.

[0100] [Third Modification] In the above embodiment, the jamming sound output process is executed by operating the jamming button 61m as an interface. The jamming sound output process may be executed by randomly outputting jamming sound during music playback, instead of operating the jamming button 61m or other user interface. Also, in the above embodiment, in the case of the role "noisy", the jamming sound is always output when the jamming button 61m is operated.

[0101] In addition to this form, the interference sound output process may be set so that, for the role "noisy," interference sounds are output or not output even when the interference button 61m is operated. This makes it possible to improve the playability of the game.

[0102] [Fourth Modification] In the above embodiment, the headphones 65 are used as an output unit that allows only the singing users 7A to 7D to hear the interfering sound. As the output unit, not only the headphones 65 but also earphones may be used. Alternatively, various forms may be adopted, such as a parametric speaker that uses ultrasonic waves as a carrier wave to improve directivity. In the above embodiment, the interfering sound is output from the mobile terminal 6, but the interfering sound may be output from the karaoke device 2.

[0103] In this embodiment, a karaoke system including the karaoke device 2 and the program for a portable terminal executed by the portable terminal 6 has been described. The present invention not only relates to such a karaoke system, but also includes the karaoke device 2 constituting a part of the karaoke system, the karaoke program executed by the karaoke device 2, or the program for a portable terminal executed by the portable terminal 6. [Explanation of symbols]

[0104] 1: Remote control device 41h: Voting content display column 2: Karaoke equipment 42: Speaker 6: Portable terminal 44a, 41b: Singing microphone 7A~7D: User 61: Touch panel monitor 11: Touch panel monitor 61a: Start button 11a: Code information 61b: Shooting display section 12: Video RAM 61c: Number of participants input field 13: Video control unit 61d: Number of people assigned 14: Memory 61e: Decision button 15: Control unit 61f: Role confirmation button 16: Wireless LAN communication unit 61g: Role display column 17: Operation section 61h: Song selection start button 18: Operation processing section 61i: Search item specification field 19: Infrared communication section 61j: Song-related information display section 21: Operation section 61k: Song selection content display field 22: Operation processing section 61l: Playback start button 24a: LAN communication section 61m: Intrusion button 24b: Wireless LAN communication section 61n: Time display column 25: Sound control section 61o: Extension button 27: Memory 61p: Exit button 28:Video RAM 61q:Voting column 29: Video playback section 61r: Voting check box 30: Control unit 61s: Voting button 31: Video control section 61t: Noisy display section 32: Hard disk 61u: DC display column 33: Touch panel monitor 61v: Victory team display area 33a: Display section 61w: Count result display section 33b: Touch panel 61x: Resume button 41: Monitor 61y: Exit button 41b: Intrusion button notification column 65: Headphones 41c:Lyrics 110:Access Point 41e: Noisy display column 111: Display section 41f:DC display column 112:Touch panel 41g: Winning faction display column

Claims

1. a correspondence process for corresponding the karaoke device so that the karaoke device can communicate with the karaoke device; a song determination process for determining whether a karaoke song being played on the karaoke device is an application-related song; In the song determination process, when it is determined that the karaoke song being played on the karaoke device is an application-related song, the application is operated, and executing an application process in which the application is not operated when the karaoke piece being played on the karaoke device is determined to be not an application-related piece. Programs for mobile devices.

2. In the application process, if the music is determined not to be an application-related music in the music determination process, the operation of the application is paused, and if the music is determined to be an application-related music, the operation of the application is resumed. The program for a mobile terminal according to claim 1.

3. The music determination process determines whether a music piece is application-related based on an application-related music table in which identification information indicating application-related music pieces is registered. The program for a mobile terminal according to claim 1.

4. A registration process is executed to register identification information indicating the application-related music in the application-related music table. The program for a mobile terminal according to claim 1.

5. A song selection process for selecting a karaoke song; A reservation process is executed to reserve the karaoke piece selected in the song selection process in the karaoke device; The registration process registers the identification information of the karaoke song reserved in the reservation process in the application-related song table as identification information indicating the application-related song. The program for a mobile terminal according to claim 3.

6. In the song determination process, when it is determined that the karaoke song being played on the karaoke device is an identification information indicating an application-related song, it is determined that the karaoke song corresponding to the identification information has been played. The program for a mobile terminal according to claim 3.

7. An event detection process for detecting the occurrence of a predetermined event in application processing; When the occurrence of a predetermined event is detected in the event detection process, a pause process is executed to transmit an instruction to pause the reproduction of the karaoke piece to the karaoke device. The program for a mobile terminal according to claim 1.

8. The predetermined event detected in the event detection process is the completion of playback of a predetermined application-related song. The program for a mobile terminal according to claim 7.

9. Execute a restart process to transmit a restart instruction to the karaoke device to restart the karaoke piece playback The program for a mobile terminal according to claim 7.

10. The song determination process determines whether the identification information of the reproduced karaoke song is an identification information indicating an application-related song based on an application-related song table in which identification information indicating an application-related song is registered; The event detection process includes determining whether or not identification information indicating all of the application-related songs registered in the application-related song table has been reproduced by the karaoke device; The pause process transmits a pause instruction to the karaoke device when it is determined in the event detection process that the identification information indicating all the application-related songs registered in the application-related song table has been reproduced by the karaoke device. The program for a mobile terminal according to claim 7.

11. Execute an application image transmission process for transmitting an application image formed in the application process to a karaoke device. The program for a mobile terminal according to claim 1.

12. A karaoke system including a karaoke device and a program for a portable terminal executed on a portable terminal, The mobile terminal program a correspondence process for corresponding the karaoke device so that the karaoke device can communicate with the karaoke device; a song determination process for determining whether a karaoke song being played on the karaoke device is an application-related song; In the song determination process, when it is determined that the karaoke song being played on the karaoke device is an application-related song, the application is operated, and executing an application process in which the application is not operated when the karaoke piece being played on the karaoke device is determined to be not an application-related piece. Karaoke system.

Images