Karaoke system and karaoke program

Abstract

To provide a singing environment suitable for a plurality of users who sing using communication.SOLUTION: A karaoke system has a plurality of terminal devices, each comprising an input part for inputting a sound and a reproduction part for reproducing the sound, connected through a network, and the plurality of terminal devices are discriminated as a first singer terminal, a second singer terminal, and a listener terminal, wherein the listener terminal executes first singing reception processing to receive first singing data, first singing reproduction processing to reproduce the first singing data, second singing reception processing to receive second singing data, and second singing reproduction processing to reproduce the second singing data, and third accompaniment reproduction processing to reproduce accompaniment data with a delay behind first accompaniment reproduction processing executed by the first singer terminal.SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] The present invention relates to a karaoke system executable on a terminal device and a karaoke program.

Background Art

[0002] Conventionally, karaoke where singing is enjoyed in accordance with accompaniment has been held in social settings and the like. Among users who like karaoke, there are those who enjoy karaoke using online Web conferences. In karaoke using a Web conference, a user connects communicatively to a Web conference server that holds a Web conference using a personal computer owned by the user, and plays a downloaded music piece to enjoy singing.

[0003] By the way, there is a system in which users in remote locations enjoy karaoke by communicatively connecting karaoke devices. Patent Document 1 discloses an online karaoke system among a plurality of terminals connected to a network.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Patent Document 1 discloses an online karaoke system that delays and plays back a backing performance by the delay of the network between terminals when there are a plurality of singers, such as in a duet. In this online karaoke system, a singer can execute a karaoke performance with the deviation between the accompaniment and the singing voice of other singers reduced by the one-way delay of the network.

[0006] However, in the karaoke system described in Patent Document 1, listeners whose purpose is to listen to karaoke performances without singing are not assumed. Therefore, like singers, such listeners will also listen to karaoke performances in a state where there is a deviation between the accompaniment for the one-way network delay and the singing voice of the singer. Although singers can enjoy singing at least to some extent when the accompaniment is played, for listeners who want to enjoy listening to karaoke performances without singing, even a deviation between the singing voice and the accompaniment by the one-way network delay will cause a sense of discomfort and damage the feeling of being in a karaoke room.

[0007] The present invention is in view of such a situation, and in an online karaoke that forms a karaoke room online, when there are a plurality of singers and listeners, one of the purposes is to suppress the deviation between the accompaniment on the listener side and the singing voice of the singer.

Means for Solving the Problems

[0008] Therefore, the karaoke system according to the present invention adopts the following configuration. A karaoke system in which a plurality of terminal devices each having an input unit for inputting sound and a reproduction unit for reproducing sound are connected via a network, The plurality of terminal devices are classified into a first singer terminal, a second singer terminal, and a listener terminal, The first singer terminal Performs a first accompaniment reproduction process for reproducing accompaniment data and A first singing transmission process for transmitting the input first singing data, The second singer terminal A second accompaniment reproduction process for synchronously reproducing the accompaniment data with respect to the first accompaniment reproduction process executed by the first singer terminal and A second singing transmission process for transmitting the input second singing data, A third singing reception process for receiving first singing data, A third singing playback process for playing back the received first singing data, Executes The listener terminal A first singing reception process for receiving first singing data, Received A first singing playback process for playing back the first singing data, A second singing reception process for receiving second singing data, Received A second singing playback process for playing back the second singing data, With respect to the first accompaniment playback process executed on the first singer terminal, a third accompaniment playback process for delaying and playing back the accompaniment data is executed.

[0010] Furthermore, in the karaoke system according to the present invention, The first singer terminal Executes a first feedback playback process for playing back the input first singing data, The second singer terminal Executes a second feedback playback process for playing back the input second singing data.

[0011] Furthermore, in the karaoke system according to the present invention, The volume ratio of the first singing data to the accompaniment data played back on the second singer terminal is smaller than the volume ratio of the first singing data voice to the accompaniment data played back on the listener terminal.

[0012] Furthermore, in the karaoke system according to the present invention, The volume ratio of the first singing data to the accompaniment data played back on the second singer terminal is changed according to the communication time from when the first singing data is transmitted from the first singer terminal until the first singing data is received by the second singer terminal.

[0013] Furthermore, in the karaoke system according to the present invention, The third accompaniment playback process determines a delay time according to the communication time from when the first singing data is transmitted by the first singer terminal until it is received by the listener terminal, or according to the communication time from when the second singing data is transmitted by the second singer terminal until it is received by the listener terminal, and delays and plays the accompaniment data with respect to the first accompaniment playback process.

[0014] Furthermore, in the karaoke system according to the present invention, The first singer terminal and the second singer terminal are the terminal devices in which the input of sound is effectively set.

[0015] Furthermore, in the karaoke system according to the present invention, Each of the plurality of terminal devices includes an operation unit, The first singer terminal, the second singer terminal, and the listener terminal can be switched by operating the operation unit.

[0016] Furthermore, in the karaoke system according to the present invention, Each of the plurality of terminal devices, executes a reservation process for making a reservation for a music piece, The first singer terminal is the terminal device that has made a reservation for the music piece to be played.

[0017] Furthermore, in the karaoke system according to the present invention, The first singer terminal, executes a first accompaniment position transmission process for transmitting first accompaniment position data indicating the playback position of the accompaniment data being played in the first accompaniment playback process, The second singer terminal, executes a first accompaniment position reception process for receiving the first accompaniment position data, The second accompaniment playback process synchronously plays the accompaniment data with respect to the first accompaniment playback process based on the received first accompaniment position data.

[0018] Furthermore, in the karaoke system according to the present invention, In the first singing transmission process, the communication time when transmitting the first singing data to the second singer terminal is shorter than the communication time when transmitting the first singing data to the listener terminal.

[0019] Furthermore, in the karaoke system according to the present invention, the first singer terminal when the first singing data transmitted in the first singing transmission process is input, executes a second accompaniment position transmission process for transmitting second accompaniment position data indicating the reproduction position of the accompaniment data being reproduced in the first accompaniment reproduction process, the listener terminal executes a second accompaniment position reception process for receiving the second accompaniment position data, and the third accompaniment reproduction process is characterized by delaying and reproducing the accompaniment data for the first accompaniment reproduction process based on the received second accompaniment position data.

[0020] Also, the karaoke program according to the present invention A terminal device provided with an input unit for inputting sound and a playback unit for playing back sound, and a karaoke system in which a terminal device set in a first singer terminal, a terminal device set in a second singer terminal, and a terminal device set in a listener terminal are connected via a network in Executed on each terminal device is a karaoke program that The karaoke program is In the terminal device set in the first singer terminal, executes a first accompaniment reproduction process for reproducing accompaniment data and a first singing transmission process for transmitting the input first singing data, and the the In the terminal device set in the second singer terminal, the first singer terminal The terminal device set in executes Ru a second accompaniment reproduction process for synchronously reproducing the accompaniment data for the first accompaniment reproduction process, a second singing transmission process for transmitting the input second singing data, a third singing reception process for receiving the first singing data, and a third singing reproduction process for reproducing the received first singing data, and the the the In the terminal device set in the listener terminal, set in the first singer terminal Terminal executes a first singing reception process for receiving the first singing data from the terminal at the end. A first singing playback process for playing back the received first singing data, and a second singing reception process for receiving second singing data from the terminal device set in the second singer terminal, Terminal and a second singing playback process for playing back the received second singing data, and a third accompaniment playback process for delaying and playing back the accompaniment data with respect to the first accompaniment playback process executed on the first singer terminal are executed. For the first accompaniment playback process executed on the first singer terminal, The terminal device set in a third accompaniment playback process for delaying and playing back the accompaniment data is executed.

Advantages of the Invention

[0021] According to the karaoke system and the karaoke program according to the present invention, when karaoke is performed among a plurality of terminal devices (karaoke devices), when there are a plurality of singers and listeners, it is possible to suppress the deviation between the accompaniment on the listener side and the singing voices of the plurality of singers. Therefore, it is possible to provide a good acoustic environment even for listeners who want to enjoy karaoke performance without singing in online karaoke, and users can fully enjoy karaoke.

Brief Description of the Drawings

[0022]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Mode for Carrying Out the Invention

[0023] FIG. 1 is a diagram showing the system configuration of this embodiment. This embodiment is a system capable of communicating between six mobile terminals and performing karaoke. FIG. 1 shows various examples of the communication forms between six mobile terminals. For example, in the case of a private home, a router 12a connected to the Internet is provided, and a wireless router 12b is connected to the router 12a. The mobile terminal 6 can communicate with the Internet via the wireless router 12b.

[0024] In addition to such a communication form, it is also possible to communicate with the Internet using a mobile communication network. The mobile communication network is a communication form that connects the mobile terminal 6 to the Internet by performing wireless communication between the mobile terminal 6 and the radio base station 13.

[0025] By using such various communication forms, the mobile terminal 6 can communicate with the Internet. In addition, a management server 11 for managing the karaoke system is connected to the Internet for communication. A karaoke program is installed, and the mobile terminal 6 connected to the Internet for communication can perform karaoke between the mobile terminals 6 by communicating with this management server 11.

[0026] As described above, in this embodiment, a form of performing karaoke using the mobile terminal 6 as a terminal device will be described. Note that, as the terminal device, in addition to the mobile terminal 6, a home game machine, a personal computer, or a dedicated karaoke device for karaoke may be used. Further, a terminal device installed with a karaoke program will function as a karaoke device.

[0027] FIG. 2 is a diagram showing the appearance (front view) of the mobile terminal 6 according to an embodiment of the present invention, and FIG. 3 is a block diagram showing the configuration of the mobile terminal 6 according to an embodiment of the present invention. As this mobile terminal 6, a smartphone, a tablet terminal, a mobile phone, etc. can be adopted. By installing a karaoke program in this mobile terminal 6, it becomes possible to perform karaoke between the mobile terminals 6.

[0028] The mobile terminal 6 of this embodiment has control means including a CPU 61, a RAM 62, a storage unit 63, an image processing unit 64, and an audio processing unit 66. The storage unit 63 can adopt non-volatile storage means such as a NAND type flash memory. In this storage unit 63, the program of this embodiment and various data used by the program are stored.

[0029] The CPU 61 is means for overall control of the entire mobile terminal 6, and executes various controls based on the programs and data stored in the storage unit 63. The data generated under the control of the CPU 61 is temporarily stored in the RAM 62.

[0030] The audio processing unit 66 is means for performing input / output related to the audio of the mobile terminal 6. It causes sound to be emitted from the speaker 67a under the control of the CPU 61. Further, the audio processing unit 66 is connected to the microphone 67b, and enables the capture of call voices and surrounding voices from the microphone 67b. For the speaker 67a and the microphone 67b, external devices such as a headset may be used.

[0031] The touch panel display unit 68 is configured to include a display unit 68m that displays an image and a touch panel 68n disposed on the front or back surface thereof. The touch panel 68n can adopt various types that enable recognition of the user's touch position, such as a capacitance method. The CPU 61 can display on the display unit 68m and determine which part of the displayed image has been touched based on the touch input from the touch panel 68n.

[0032] The image processing unit 64 is a means for performing image-related input / output of the mobile terminal 6. The image processing unit 64 displays and outputs the image formed by the CPU 61 to the display unit 68m. Then, it has a function of capturing an image or, if it is a video, a moving image from the front camera 65F disposed on the front surface (touch panel display unit 68 side) of the mobile terminal 6 or the rear camera 65R disposed on the back surface of the mobile terminal 6 and storing it in the storage unit 63 as image or moving image information.

[0033] The mobile terminal 6 of the present embodiment includes a first communication unit 69a and a second communication unit 69b as communication means for communicating with the outside. The first communication unit 69a is communication means for connecting to a mobile communication network, and can perform various communications via the communication line of the mobile communication network and the Internet network by wirelessly connecting to the mobile base station 140. The second communication unit 69b is communication means for Wifi connection. The mobile terminal 6 can use the second communication unit 69b to wirelessly connect to the access point 110 and communicate with the local area network to which the access point 110 belongs. Note that, as communication means of the mobile terminal 6, in addition to the first communication unit 69a and the second communication unit 69b, short-range communication means such as an infrared communication unit and Bluetooth (registered trademark) may be provided.

[0034] The mobile terminal 6 of the present embodiment is configured to include an input switch 70 in addition to the touch panel 68n as input means. Various switches such as a power switch, a volume adjustment switch, and a switch whose input use is changed according to a program can be provided for this input switch 70 (input switches 70a, 70b, etc. in FIG. 2).

[0035] Furthermore, the mobile terminal 6 of the present embodiment has a vibration unit 72 and an LED 73 in order to give various notifications to the user who owns the mobile terminal 6. The vibration unit 72 is a member configured by attaching a weight eccentric to the shaft of a motor. By rotationally driving the motor, it is possible to transmit vibrations perceptible to the user. The LED 73 is disposed above the front of the mobile terminal 6 as shown in FIG. 2, and can give various notifications to the user by blinking.

[0036] In the present embodiment, by installing a karaoke program in such a mobile terminal 6, it is possible to perform karaoke between mobile terminals 6. Now, the details of various processes when performing karaoke using the mobile terminal 6 will be described.

[0037] FIG. 4 is a flowchart showing the room process of the present embodiment. Here, the case of performing karaoke using the mobile terminals 6a and 6b will be described. In the present embodiment, users gather in a virtual room, and users gathering in the same room can perform karaoke by sharing voices (which may include images).

[0038] Here, the case where the user using the mobile terminal 6a creates a room and the user using the mobile terminal 6b participates in the room will be described. It is assumed that the users using the mobile terminals 6a and 6b have accounts with the management server 11 in advance. Note that a user without an account can access the management server 11 to create a new account.

[0039] The mobile terminal 6a first gives a login instruction (S11) to the management server 11. The login instruction is given by inputting account information (user ID, password, etc.). The management server 11 that has received the login instruction (S11) executes a login process (S21). In the login process, authentication based on the account information is performed, and when the authentication is appropriate, the user can use various functions of the karaoke program.

[0040] Figure 10(A) shows the room selection screen displayed after login. On the room selection screen, a room selection column 68a and a new room creation button 68b are displayed. The room selection column 68a shows rooms that have already been created and the status of those rooms. The room selection column displays the room name, the icons of the users participating in the room, the holding status of the room ("OPEN", "preparing"), the holding date of the room, etc. Also, a room selection column 68a with a key mark displayed in the upper left indicates that the room requires a password or that only pre-invited users can participate.

[0041] The user can participate in a room by operating the room selection column 68a. Also, the new room creation button 68b is a button for creating a new room. By operating the new room creation button 68b, the mobile terminal 6a can send a room creation instruction (S12) to the management server 11. The management server 11 executes a room creation process (S22) based on the room creation instruction (S12). When the room creation process (S22) is completed, the room selection column 68a shown in Figure 7(A) is displayed.

[0042] On the other hand, with the mobile terminal 6b participating in the room, first, a login instruction (S11) is sent to the management server 11 by inputting account information. Similar to the case of the mobile terminal 6a, the management server 11 performs authentication based on the account information and, if the authentication is appropriate, allows the mobile terminal 6b to log in. The user refers to the room selection screen shown in Figure 7(A) and gives a room participation instruction (S13) by selecting the room selection column 68a they want to enter. In the example of Figure 4, it is the case of participating in a room created by the user of the mobile terminal 6a, and the management server 11 executes a user addition process (S23) to add the user of the mobile terminal 6b to the room created by the user of the mobile terminal 6a.

[0043] Once the users of the mobile terminals 6a and 6b enter the same room, it becomes possible to execute karaoke processing (S12) between the mobile terminals 6a and 6b.

[0044] The karaoke process (S12) mainly includes a reservation process and a playback process. The reservation process is a process for reserving a song to be sung, and the music playback process is a process for sequentially playing back the songs registered in the reservation list based on the reservation process.

[0045] FIG. 5 is a flowchart showing the reservation process of the present embodiment. In the reservation process, it is possible to add a song to the reservation list managed by the management server 11 by searching for a song and selecting a song to be sung. A user who wants to reserve a song searches for a song using the song search screen shown in FIG. 10(B) (S101). Note that the song search screen in FIG. 10(B) can be displayed by operating the song search button 68k shown in FIG. 11(D) which will be described later.

[0046] The song search screen is provided with a search category selection column 68c and a song selection column 68d. The search category selection column is provided with search categories such as "Favorite", "Song", "Artist", and "Album". By selecting these search categories, the user can perform a song search according to the selected search category. The state of FIG. 10(B) is the case where "Song" is selected as the search category, and the song selection column 68d is displayed in the order of a, i, u, e, o and alphabetically.

[0047] For each song, the song selection column 68d displays an icon (such as album art), the song name, and the artist name. When the user selects the desired song selection column 68d (S102: Yes), a song confirmation screen is displayed for the song (S103).

[0048] FIG. 11(C) is a diagram showing the music confirmation screen of the present embodiment. On the music confirmation screen, a music confirmation column 68e is displayed. In the music confirmation column, for the selected music, an icon (such as album art), the music name, the artist name, and a reservation button 68g and a cancel button 68f are displayed. When the user checks the information displayed on this music confirmation screen and makes a reservation, the user operates the reservation button 68g (S104: Yes) to execute the reservation of the music. When the reservation is made, the reservation information is transmitted to the management server 11. The reservation information is composed of a user ID indicating the user who made the reservation and a music ID indicating the music. The management server 11 registers the received reservation information in the reservation list.

[0049] FIG. 6 is a flowchart showing the playback process of the present embodiment. In the present embodiment, each mobile terminal 6 participating in the same room is classified as a singer or a listener. A singer is a user who sings the music to be played. In the present embodiment, the user who made the reservation of the music is identified as the main singer. Also, in the present embodiment, among the users participating in the same room, it is possible to set those other than the main singer as accompanying singers. For example, in the screen during music playback shown in FIG. 11(D), by turning on the microphone selection button 684, it is possible to participate in singing as an accompanying singer. Thus, in the present embodiment, a plurality of users can participate in singing as the main singer or the accompanying singer. A listener is a user who does not sing but listens to the singing voice of the singer. Users other than the main singer and the accompanying singer are classified as listeners.

[0050] In the playback process executed by the mobile terminal 6, based on the reservation list managed by the management server 11, it is determined whether there is a song to be played next (S201). If there is a song to be played next (S201: Yes) and the mobile terminal 6 is the one that reserved the song (S202: Yes), the mobile terminal 6 is set as the main singer (S204), and the main playback process (S210) is executed. On the other hand, when singing together (S205: Yes), for example, in the mobile terminal 6 where the microphone selection button 684 is set to on, the subordinate playback process (S220) is executed. Other mobile terminals 6 are set as listeners (S206), and the listener-side playback process (S230) is executed.

[0051] FIG. 8 is a diagram for explaining the communication time of singing voice data between the mobile terminals 6 of the present embodiment. In FIG. 8, for simplicity of explanation, a state where three people are participating in the same room is shown. Note that one or more people can participate in the room, and it is not limited to the form where these three people participate. Here, the mobile terminal 6a of the main singer A, the mobile terminal 6b of the subordinate singer B, and the mobile terminal 6c of the listener C are assigned symbols and distinguished. These symbols will also be used for distinction in the following.

[0052] FIG. 7 is a flowchart showing various playback processes of the present embodiment. FIG. 7(A) is a flowchart showing the main playback process executed by the mobile terminal 6a set as the main singer. In the main playback process, first, the playback of the music data for the reserved song is started (S211). The music data is composed of accompaniment data and lyric data. The accompaniment data is reproduced by the acoustic processing unit 66 as a playback unit, and the lyric data is reproduced by the image processing unit 64. Note that the music data will be distributed from the management server 11 or the like, and it may be distributed in either a stream format or a storage format.

[0053] After starting the playback of music data (S211), a playback synchronization signal is transmitted to the mobile terminals 6b and 6c that participate in the same room (S212). The synchronization playback signal is data for synchronizing the playback of music data among the mobile terminals 6a to 6c that participate in the same room. The other mobile terminals 6b and 6c perform the playback of music data based on this playback synchronization signal. At this time, the playback synchronization signal is the timing at which the playback of the accompaniment data is started in the mobile terminal 6a. In this embodiment, the playback timing of the accompaniment data in the other mobile terminals 6b and 6c is controlled using the playback synchronization signal. Specifically, in the mobile terminal 6b of the sub-singer B, the playback synchronization signal is used to start the playback of the accompaniment data in synchronization (substantially simultaneously) with the mobile terminal 6a. Also, in the mobile terminal 6c of the listener C, the playback synchronization signal is used to start the playback of the accompaniment data at a timing later (delayed) than the playback of the accompaniment data of the mobile terminal 6a.

[0054] In the main playback process, the singing voice data A input from the microphone 67b is transmitted to the mobile terminals 6b and 6c that participate in the same room (S213). Note that various transmission forms can be adopted for the singing voice data, such as relaying and transmitting through the management server 11, or adopting a form of direct transmission (Peer to Peer) among the mobile terminals 6a to 6c. Also, during the playback period of the music, the playback of the singing voice data B transmitted from the mobile terminal 6b of the sub-singer is performed (S214). The transmission of the singing voice data A (S213) and the reception and playback of the singing voice data B (S214) are continuously executed until the playback of the music ends (S215: Yes).

[0055] Here, it is considered that a delay due to the communication time among the mobile terminals 6a to 6c occurs in the singing voice data transmitted and received among the mobile terminals 6a to 6c. FIG. 8 shows the communication time of the singing voice data that occurs among the mobile terminals 6a to 6c. For the singing voice data A transmitted from the mobile terminal 6a of the main singer A, a communication time D_ab occurs with respect to the mobile terminal 6b of the sub-singer B. Also, for the singing voice data A, a communication time D_ac occurs with respect to the mobile terminal 6c of the listener C. On the other hand, for the singing voice data B transmitted from the mobile terminal 6b of the sub-singer B, a communication time D_ba occurs with respect to the mobile terminal 6a of the main singer A. Also, for the singing voice data B, a communication time D_bc occurs with respect to the mobile terminal 6c of the listener C.

[0056] In this embodiment, considering the delay based on the singing voice data A, for the singing voice data B, it is set to be played back immediately after reception.

[0057] FIG. 9 shows a time chart showing the accompaniment data and the singing voice data in the mobile terminals 6a to 6c of this embodiment. In the time chart, for the main singer A, the sub-singer B, and the listener C, time charts are shown for the accompaniment data, the singing voice data A, and the singing voice data B, respectively. In the figure, the accompaniment data is simply shown in the piano roll format and the singing voice data is shown in the waveform format.

[0058] As shown in FIG. 9, in the mobile terminal 6a of the main singer A, singing is performed in synchronization with the accompaniment, so no delay of the singing voice data A with respect to the accompaniment occurs. Also, for the singing voice data B transmitted from the mobile terminal 6b of the sub-singer B and received and played back by the mobile terminal 6a, as described in FIG. 8, a communication time D_ba occurs as a delay.

[0059] In this embodiment, in the mobile terminal 6a, playback is performed without considering this communication time D_ba. Therefore, it is possible to play the singing voice data B without performing complicated processing. As a result of experiments by the applicant, it has been confirmed that singing can be performed even when the communication time D_ba occurs in the singing voice data B. In addition, it has also been confirmed that effects such as an increase in the sense of unity are achieved by playing the singing voice data B of the accompanying singer B who sings together.

[0060] FIG. 7(B) is a flowchart showing the accompanying playback process (S220) executed on the mobile terminal 6b of the accompanying singer B. In the accompanying playback process, playback of the music data is started (S222) by receiving a playback synchronization signal from the mobile terminal 6a (S221). The playback synchronization signal is the timing at which playback of the accompaniment data is started in the mobile terminal 6a. In the accompanying playback process, the singing voice data B input from the microphone 67b is transmitted to other mobile terminals 6a and 6b participating in the same room (S223). Also, the singing voice data A received from the mobile terminal 6a of the main singer is played back (S224). Transmission of the singing voice data B (S223) and reception and playback of the singing voice data A (S224) are continuously executed until the playback of the music ends (S225: Yes).

[0061] As shown in FIG. 9, in the mobile terminal 6b of the accompanying singer B, the accompaniment data is played back substantially synchronously with the accompaniment data of the main singer A. Regarding the accompaniment data, it is performed based on the playback synchronization signal as in this embodiment, and the playback synchronization signal has a smaller data size than the singing voice data and can be transmitted and received without taking communication time. Therefore, the delay amount involved in that communication is considerably smaller compared to the singing voice data. Here, the delay of the accompaniment data is described while ignoring it.

[0062] In the portable terminal 6b of the secondary singer, since singing is performed in synchronization with the accompaniment, there is no delay in the singing voice data B with respect to the accompaniment. On the other hand, for the singing voice data A transmitted from the portable terminal 6a of the primary singer and received and played back by the portable terminal 6b, as described with reference to FIG. 8, the communication time D_ab occurs as a delay.

[0063] In this embodiment, also in the portable terminal 6b of the secondary singer B, similar to the portable terminal 6a of the primary singer A, it is assumed that the singing voice data A is played back without considering the communication time D_ab. As a result, the singing voice data A is played back with a delay with respect to the accompaniment data, but in the singing of the secondary singer B, no major problem that hinders singing occurs.

[0064] FIG. 7(C) is a flowchart showing the listening-side playback process (S230) executed on the portable terminal 6c of the listener C. In the listening-side playback process, first, the communication time of the singing voice data A in the portable terminal 6c from the portable terminal 6a is determined (S231). Then, based on the playback synchronization signal, the music data is played back (S233), and at that time, based on the communication time D_ac, the music data is played back with a delay. During the music playback, for the singing voice data A from the portable terminal 6a and the singing voice data B from the portable terminal 6b, reception and playback are performed (S234, S235). The reception and playback of the singing voice data A (S234) and the reception and playback of the singing voice data B (S235) are continuously executed until the playback of the music ends (S236: Yes).

[0065] As shown in FIG. 9, on the mobile terminal 6b of the listener C, the accompaniment data is reproduced with a delay of the communication time D_ac that occurs for the singing voice data A with respect to the accompaniment data of the main singer A. Specifically, using the reproduction synchronization signal transmitted from the mobile terminal 6a, the accompaniment data is reproduced with a delay of the communication time D_ac with respect to the accompaniment data of the mobile terminal 6a. As a result, the singing voice data A transmitted from the mobile terminal 6a is reproduced substantially synchronously with the accompaniment data. On the other hand, the singing voice data B is reproduced with a delay of the communication time D_bc. Here, the communication time D_ac for the singing voice data A reproduced by the mobile terminal 6c and the communication time D_bc for the singing voice data B are less likely to be significantly different. Thus, in this embodiment, the synchronous reproduction of the accompaniment data, the singing voice data A, and B is realized using the delay amount D_ac for the singing voice data A.

[0066] Next, the music playback screen on the mobile terminal 6 of this embodiment will be described. FIG. 11(D) is a music playback screen displayed during music playback on the mobile terminal 6 of this embodiment. At the upper part of the music playback screen, the room name and the music search button 68k are displayed. By operating the music search button 68k, the music search screen described in FIG. 10(B) is displayed, and it is possible to make a reservation for a music.

[0067] In addition, on the music playback screen, broadly speaking, a music-related display column 68h, an upper display column 68i, and a lower display column 68j are provided. The music-related display column 68h includes a lyrics display column 681 and a progress bar 682. In the lyrics display column 681, the lyrics to be sung for the music being played are displayed. Note that a background video may be displayed in the lyrics display column 681. The progress bar 682 indicates the progress of the music playback.

[0068] The upper display column 68i and the lower display column 68j can change the areas they occupy. Usually, it is in the state shown in FIG. 11(D), that is, the state where both the upper display column 68i and the lower display column 68j are displayed. When the comment tab 686, reservation confirmation tab 687, and remote control tab 688 provided in the lower display column 68j are operated, the display content of the lower display column 68j is changed accordingly. FIG. 11(D) shows the state where the comment tab 686 is operated.

[0069] In the upper display column 68i, a status display / selection button 683, a microphone selection button 684, and a participating user icon 685 are displayed.

[0070] The microphone selection button 684 can switch the on / off state of the microphone 67b by manual operation of the user. In this embodiment, the mobile terminal 6 of the user who has reserved the music is automatically set to on, and the mobile terminals 6 of other users are automatically set to off. Also, the mobile terminal 6 of the user who has reserved the music is recognized as the main singer, and the mobile terminals 6 of other users are recognized as listeners. Note that even for the mobile terminal 6 of a listener, it is possible to sing as a backup singer by switching the microphone selection button 684 to on.

[0071] The status display / selection button 683 is a button that indicates the status of the mobile terminal 6. When the microphone selection button 684 is on, "Singing" is marked, and when it is off, "Listening" is marked. The state in FIG. 11(D) is the state where "Singing" is marked. Also, the user can manually switch between "Singing", "Listening", and "Absent".

[0072] The participating user icons indicate all the users participating in the room. In the example of Fig. 11(D), four users are participating. The user whose icon is shown with a thick line ("JOY" in the example of Fig. 11(D)) indicates that they are singing (set to the singer mode). Also, the icon with a speaker and a cross mark ("Monkichi" in the example of Fig. 11(D)) indicates that the user is absent.

[0073] In the lower display bar 68j, three tabs (comment tab 686, reservation confirmation tab 687, remote control tab 688) are provided. The state in Fig. 11(D) is a state where the comment tab 686 is selected, and in the lower display bar 68j, a comment display column 689 and a comment input column 690 are displayed. In the comment display column 689, in addition to the user comments input by the user using the comment input column 690, system comments associated with operations related to the music playback process are displayed. In Fig. 11(D), in the comment display column 689, system comments associated with the reservation process are displayed, showing the user name and the reserved music title / artist name. In the comment display column 689, system comments and user comments are sequentially displayed in chronological order, and the user can communicate smoothly by viewing these system comments and user comments.

[0074] Next, the merits of using the playback process of this embodiment will be described. Fig. 12 is a reference example of a time chart showing the accompaniment and singing voice on the mobile terminal 6. In this reference example, on the mobile terminal 6b of the accompanying singer B, the accompaniment data and the singing voice data A are synchronized. Also, on the mobile terminal 6c of the listener C, the accompaniment data and the singing voice data A are synchronized.

[0075] In the case of lead singer A, since the lead singer sings in synchronization with the playback of the accompaniment data, the accompaniment data and the singing voice data A are synchronized. In the reference example, in the mobile terminal 6b of backup singer B, the accompaniment data is delayed by the communication time D_ab of the singing voice data A, and the accompaniment data and the singing voice data A are synchronized. Since the backup singer sings in synchronization with the played-back accompaniment data, the accompaniment data and the singing voice data B are synchronized.

[0076] In this way, in the mobile terminal 6b, by delaying the accompaniment data by the communication time D_ab, the accompaniment data and the singing voice data A are played back synchronously. On the other hand, in the mobile terminal 6c of the listener, when the accompaniment data is played back with a delay of the communication time D_ac of the singing voice data A, the singing voice data B will have the communication time D_bc from the mobile terminal 6b to the mobile terminal 6c added in addition to the communication time D_ab delayed in the mobile terminal 6b. Therefore, as can be seen from the time chart, the singing voice data B will be greatly delayed with respect to the accompaniment data and the singing voice data A. Such a large delay is inappropriate as the playback status of the mobile terminal 6c of the listener who mainly enjoys listening.

[0077] On the other hand, as described with reference to FIG. 9, since the singing voice data A and the singing voice data B in the mobile terminal 6c of the listener are the communication times of one communication path respectively, the deviation between them is small. Thus, in the present embodiment described with reference to FIG. 9 and the like, it is possible to satisfactorily play back the singing voice data A and B in the mobile terminal 6c used by the listener C.

[0078] In addition, in FIG. 12, it is also conceivable to play back the accompaniment data with a delay of the communication time (communication time D_ab + communication time D_bc) of the voice data B that is played back the latest. However, in this case, in the playback of the accompaniment data of the mobile terminal 6c of the listener, the delay becomes large with respect to the playback of the accompaniment data of the mobile terminal 6a of the lead singer A. Such an increase in delay may result in a lack of real-time performance, such as a delay in the support from the listener using chat or the like to the singer (or backup singer), and it is conceivable that the sense of unity in participating in the room will be impaired.

[0079] [First Modified Example] Next, a modified example of the karaoke system according to the present invention will be described. In the embodiment described with reference to FIG. 9 and the like, in the mobile terminal 6c of the listener C, the accompaniment data was delayed by the communication time D_ac of the singing voice data A and then reproduced. In this case, although the accompaniment data and the singing voice data A are reproduced synchronously, if the difference between the communication time D_ac and the communication time D_bc is large, there may be a sense of incongruity in the reproduced singing voice data B.

[0080] In the first modified example, it is possible to reproduce the accompaniment data, the singing voice data A, and B in synchronization. FIG. 13 is a flowchart showing the playback processing on the listener side in another embodiment, and FIG. 14 is a time chart showing the accompaniment and singing voice in the mobile terminal in another embodiment. In the mobile terminal 6c used by the listener, before starting the reproduction of the music, the communication time D_ac of the singing voice data A is measured (S241), and the communication time D_bc of the singing voice data B is measured (S242). By receiving the reproduction synchronization signal from the mobile terminal 6a, the reproduction of the music data including the accompaniment data will start. At that time, the communication time D_ac and the communication time D_bc are compared, and the reproduction of the accompaniment data is started in accordance with the larger communication time.

[0081] When the communication time D_bc > the communication time D_ac (S244: Yes), the delayed reproduction of the accompaniment data is started based on the communication time D_bc (S245). At that time, the singing voice data A is received by the mobile terminal 6c with a delay of the communication time D_ac, but by performing delayed reproduction with the communication time as D_bc (S246), the singing voice data A and the accompaniment data are synchronized. On the other hand, since the singing voice data B is received with a delay of the communication time D_bc, it is reproduced as received and is reproduced in synchronization with the reproduction of the accompaniment data (S247). Until the reproduction of the music data ends (S248: Yes), by continuing the delayed reproduction of the singing voice data A and the received reproduction of the singing voice data B, the accompaniment data, the singing voice data A, and B are reproduced in synchronization.

[0082] On the other hand, when the communication time D_bc ≤ the communication time D_ac (S244: No), the accompaniment data starts to be delayed and played based on the communication time D_ac (S249). At this time, since the singing voice data A is received with a delay of the communication time D_ac, it is played as it is received and played in synchronization with the playing of the accompaniment data (S250). On the other hand, although the singing voice data B is received at the mobile terminal 6c with a delay of the communication time D_bc, by performing delayed playback (S251) with the communication time being D_ac, the singing voice data B and the accompaniment data are synchronized. Until the playback of the music data ends (S251: Yes), by continuing the delayed playback of the singing voice data A and the received playback of the singing voice data B, the accompaniment data, the singing voice data A, and B are played synchronously.

[0083] Also in this first modification example, since the singing voice data A and B are each delayed and played by the communication time for one path (communication time D_bc or communication time D_ac), they are not significantly delayed from the accompaniment data of the main singer A or the secondary singer B and played. Also, it is possible to play the accompaniment data, the singing voice data A, and B synchronously.

[0084] [Second Modification Example] As described in the above embodiment, for example, it has been confirmed that even when the singing voice data A is played with a delay in the mobile terminal 6b of the secondary singer B, it is possible to sing on the mobile terminal 6b. However, depending on the singer, it is also conceivable that the singing voice data A played with a delay with respect to the accompaniment data may be bothersome.

[0085] In the second modification example, by reducing the volume of the singing voice data A, it is intended to suppress the sense of discomfort associated with the delay. Specifically, when the playback volume of the accompaniment data is D, the playback volume of the singing voice data A at the mobile terminal 6c of the listener C is set to βD, and the playback volume of the singing voice data A at the mobile terminal 6b of the secondary singer B is set to αD (α < β), thereby reducing the volume ratio of the singing voice data A to the accompaniment data at the mobile terminal 6b.

[0086] By reducing the volume ratio in this way, it is possible to suppress the singing voice data A reproduced on the mobile terminal 6b of the backup singer from interfering with singing. When reproducing the singing voice data B on the mobile terminal 6a of the lead singer A, the same applies. By reducing the volume ratio to be lower than that of the listener's mobile terminal 6c, an environment that is easy to sing in is provided.

[0087] The volume ratio α of the singing voice data A in the mobile terminal 6b of the backup singer B may be controlled according to the length of the communication time. For example, when the communication time D_ab of the singing voice data A in the mobile terminal 6b is short, the value of α is increased, and when the communication time D_ab is long, the value of α is decreased. When the singing voice data A is significantly delayed, by reducing its volume, it is possible to suppress it from interfering with singing. When the delay is small, by increasing its volume, it is possible to enhance the sense of unity when singing together.

[0088] [Third Modification Example] In the above-described embodiment, the reproduction synchronization signal indicates the reproduction start timing of the accompaniment data in the mobile terminal 6a. However, it is also possible to transmit the reproduction synchronization signal during music reproduction to synchronize the accompaniment data. Even when a delay occurs in the mobile terminal 6b or the mobile terminal 6c, synchronous reproduction can be achieved.

[0089] [Fourth Modification Example] In the foregoing embodiments, in the mobile terminal 6c of the listener C, the accompaniment data was delayed by the communication time D_ac, and the accompaniment data and the singing voice data A were reproduced in synchronization in the mobile terminal 6c. Instead of measuring the communication time D_ac in this way, it is also possible to associate the reproduction position (accompaniment position data) of the accompaniment data with the singing voice data A. In the mobile terminal 6c that has received the singing voice data A and the accompaniment position data, by referring to the accompaniment position data and executing the reproduction of the accompaniment data, it becomes possible to reproduce the accompaniment data and the singing voice data A in synchronization. Note that the accompaniment position data may include at least the reproduction start position of the singing voice data A. Also, by including the intermediate reproduction position of the singing voice data A, even if a deviation occurs in the reproduction of the accompaniment data and the singing voice data A during reproduction, it is possible to suppress the deviation by correcting the reproduction position of the accompaniment data. Further, when the delay times in the mobile terminals 6c of the singing voice data A and the singing voice data B are substantially the same, it becomes possible to reproduce the singing voice data A and the accompaniment data and the singing voice data B in substantially synchronization.

[0090] [Fifth Modification Example] In the foregoing embodiments, nothing was mentioned about one's own singing voice, but in the mobile terminals 6a and 6b, a feedback reproduction process for outputting one's own singing voice (singing voice data A or singing voice data B) from the speaker 67a may be executed. The lead singer or the backup singer can sing while adjusting the singing voice by having one's own singing voice fed back.

[0091] [Sixth Modification Example] As described in the foregoing embodiments, etc., for example, in the mobile terminal 6b of the secondary singer B, it is conceivable that the singing voice data A is reproduced with a delay with respect to the accompaniment data. In the mobile terminal 6c of the listener C, since the accompaniment data is synchronized with the singing voice data A for reproduction, the singing voice data A does not lag behind the accompaniment data. Therefore, it is preferable that the communication time D_ab is shorter than the communication time D_ac. In the fourth modification, for example, in the mobile terminal 6a of the main singer A, the transmission process of the singing voice data A is performed with priority given to the mobile terminal 6b of the secondary singer B, or a line with a high communication speed is preferentially used, etc. are executed. Therefore, the communication time D_ab can be made shorter than the communication time D_ac, and the delay of the singing voice data A in the mobile terminal 6b of the secondary singer B can also be reduced as much as possible.

[0092] As described above, the karaoke system of the present embodiment and the mobile terminal 6 (terminal device) used in the karaoke system have been described. However, the present invention is not limited to the karaoke system and the mobile terminal 6. For example, a karaoke program executed by an information processing device such as the mobile terminal 6 and causing the information processing device to function as a karaoke device also belongs to that scope.

Explanation of Reference Numerals

[0093] 6(6a~6c): Mobile terminal 68j: Lower display bar 11: Management server 68k: Music search button 12a: Router 68m: Display unit 12b: Wireless router 68n: Touch panel 13: Wireless base station 69a: First communication unit 61: CPU 69b: Second communication unit 62: RAM 70(70a, 70b): Input switch 63: Storage unit 70a: Input switch 64: Image processing unit 70b: Input switch 65F: Front camera 72: Vibration unit 65R: Rear camera 73: LED 66: Acoustic processing unit 110: Access point 67a: Speaker 140: Mobile base station 67b: Microphone 681: Lyrics display column 68: Touch panel display unit 682: Progress bar 68a: Room selection column 683: Selection button 68b: New room creation button 684: Microphone selection button 68c: Search category selection column 685: Participant user icon 68d: Music selection column 686: Comment tab 68e: Music confirmation column 687: Reservation confirmation tab 68f: Cancel button 688: Remote control tab 68g: Reservation button 689: Comment display column 68h: Music-related display column 690: Comment input column 68i: Upper display column

Claims

1. A karaoke system in which a plurality of terminal devices each having an input unit for inputting sound and a playback unit for playing back sound are connected via a network, wherein the plurality of terminal devices are classified into a first singer terminal, a second singer terminal, and a listener terminal, the first singer terminal executes a first accompaniment playback process for playing back accompaniment data, and a first singing transmission process for transmitting first singing data that is input, the second singer terminal executes a second accompaniment playback process for synchronously playing back accompaniment data with respect to the first accompaniment playback process executed by the first singer terminal, a second singing transmission process for transmitting second singing data that is input, a third singing reception process for receiving the first singing data, and a third singing playback process for playing back the received first singing data, the listener terminal executes a first singing reception process for receiving the first singing data, a first singing playback process for playing back the received first singing data, a second singing reception process for receiving the second singing data, a second singing playback process for playing back the received second singing data, and a third accompaniment playback process for playing back the accompaniment data with a delay with respect to the first accompaniment playback process executed by the first singer terminal, a karaoke system.

2. The first singer terminal executes a first feedback playback process for playing back the first singing data that is input, the second singer terminal executes a second feedback playback process for playing back the second singing data that is input The karaoke system according to claim 1.

3. The volume ratio of the first singing data with respect to the accompaniment data played back by the second singer terminal is smaller than the volume ratio of the first singing data audio with respect to the accompaniment data played back by the listener terminal The karaoke system according to claim 1.

4. The volume ratio of the first singing data with respect to the accompaniment data played back by the second singer terminal is changed according to the communication time from when the first singing data is transmitted by the first singer terminal until the first singing data is received by the second singer terminal The karaoke system according to claim 1.

5. The third accompaniment playback process determines a delay time according to the communication time from when the first singing data is transmitted by the first singer terminal until it is received by the listener terminal, or the communication time from when the second singing data is transmitted by the second singer terminal until it is received by the listener terminal, and delays and plays the accompaniment data with respect to the first accompaniment playback process. The karaoke system according to claim 1.

6. The first singer terminal and the second singer terminal are the terminal devices in which the input of sound is effectively set. The karaoke system according to claim 1.

7. Each of the plurality of terminal devices includes an operation unit. The first singer terminal, the second singer terminal, and the listener terminal can be switched by operating the operation unit. The karaoke system according to claim 1.

8. Each of the plurality of terminal devices executes a reservation process for reserving a music piece. The first singer terminal is the terminal device that has reserved the music piece to be played. The karaoke system according to claim 1.

9. The first singer terminal executes a first accompaniment position transmission process of transmitting first accompaniment position data indicating the playback position of the accompaniment data being played in the first accompaniment playback process. The second singer terminal executes a first accompaniment position reception process of receiving the first accompaniment position data. Based on the received first accompaniment position data, the second accompaniment playback process synchronously plays the accompaniment data with respect to the first accompaniment playback process. The karaoke system according to claim 1.

10. In the first singing transmission process, the communication time when transmitting the first singing data to the second singer terminal is shorter than the communication time when transmitting the first singing data to the listener terminal. The karaoke system according to claim 1.

11. The first singer terminal executes a second accompaniment position transmission process of transmitting second accompaniment position data indicating the playback position of the accompaniment data being played in the first accompaniment playback process when the first singing data transmitted in the first singing transmission process is input. The listener terminal executes a second accompaniment position reception process of receiving the second accompaniment position data. Based on the received second accompaniment position data, the third accompaniment playback process delays and plays the accompaniment data with respect to the first accompaniment playback process. The karaoke system according to claim 1. **Claim 12**: In a karaoke system in which a terminal device set for a first singer terminal, a terminal device set for a second singer terminal, and a terminal device set for a listener terminal are connected via a network, the terminal devices each including an input unit for inputting sound and a playback unit for playing back sound, a karaoke program executed on each terminal device, wherein the karaoke program in the terminal device set for the first singer terminal executes a first accompaniment playback process for playing back accompaniment data and a first singing transmission process for transmitting first input singing data, in the terminal device set for the second singer terminal executes a second accompaniment playback process for synchronously playing back the accompaniment data with respect to the first accompaniment playback process executed by the terminal device set for the first singer terminal, a second singing transmission process for transmitting second input singing data, a third singing reception process for receiving the first singing data, and a third singing playback process for playing back the received first singing data, in the terminal device set for the listener terminal executes a first singing reception process for receiving the first singing data from the terminal device set for the first singer terminal, a first singing playback process for playing back the received first singing data, a second singing reception process for receiving the second singing data from the terminal device set for the second singer terminal, a second singing playback process for playing back the received second singing data, and a third accompaniment playback process for playing back the accompaniment data with a delay with respect to the first accompaniment playback process executed by the terminal device set for the first singer terminal. Karaoke program.

Images