Karaoke program and karaoke device

Abstract

To provide an excellent sound volume environment for karaoke among a plurality of terminal devices.SOLUTION: A program for karaoke is executed by terminal devices that are communicably interconnected through a network to join a karaoke room formed on-line, and also each comprise an input part for inputting a sound and a reproduction for reproducing the sound, and performs voice reception processing to receive voice data from a plurality of other terminal devices joining the karaoke room, respectively, voice reproduction processing to reproduce the received voice data, and individual sound volume control processing to perform sound volume control over the voice data received from the plurality of other terminal devices and reproduced by the terminal device individually by the other terminal devices.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present invention relates to a karaoke program executable on a terminal device and a karaoke device. [Background technology]

[0002] Karaoke, where people enjoy singing along to musical accompaniment, has traditionally been performed at social gatherings. However, some karaoke lovers also enjoy karaoke via online web conferencing. In web conferencing karaoke, users connect to a web conferencing server using their personal computers, play downloaded music, and enjoy singing along.

[0003] Patent Document 1 discloses a karaoke service system that can provide karaoke services to multiple users who have registered to participate in the same room, as if they were using karaoke in a karaoke booth. In this karaoke service system, audio data of users singing along with karaoke songs is streamed over a network, and the karaoke songs and singing voices based on the audio data are reproduced and output on the terminal devices of the users participating in the room. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-197499 Summary of the Invention [Problem to be solved by the invention]

[0005] Typically, in a karaoke booth, there are singers who sing and listeners who listen. Singers sing along with the accompaniment, while listeners join in or clap to liven up the singing experience, giving the listeners the feeling that they are participating in the karaoke.

[0006] The karaoke service system described in Patent Document 1 distributes and plays back the singer's voice data, but does not take into consideration the voices of users participating in the same room. Therefore, listeners' interjections and applause cannot be conveyed to other users, which may result in a less exciting experience than karaoke in a regular karaoke booth.

[0007] As with web conferences, it is possible to consider a format in which the voices of all participating users can be played back, but if the voices of the singer and listener are played back without distinction, if the listener's voice is too loud or interferes with the singing, lowering the volume without distinction may result in the volume of the singer, which is the intended purpose, being lowered, and it may not be possible to fully enjoy the singing.

[0008] The present invention has been made in consideration of such circumstances, and has as its object to provide a good acoustic environment when communicating between terminal devices and enjoying karaoke. [Means for solving the problem]

[0009] Book The karaoke program according to the present invention comprises: A karaoke program executed on a terminal device that is connected to each other via a network, participates in a karaoke room formed online, and has an input unit for inputting sounds and a playback unit for playing sounds, a voice receiving process for receiving voice data from each of a plurality of other terminal devices participating in the karaoke room; an audio playback process for playing back the received audio data; an individual volume control process for individually controlling the volume of the audio data received from the other terminal devices and played back by the terminal device, for each of the other terminal devices; the terminal device includes a display unit for displaying an image; a main display process for displaying a main image formed including participant regions corresponding to the plurality of other terminal devices participating in the karaoke room; When the participant area is selected, a first display process is executed to display a volume adjustment operator for the other terminal device corresponding to the participant area; The individual volume control process controls the volume of the audio data received from the corresponding other terminal device based on the operation of the volume adjustment operator. The karaoke program according to the present invention also includes: A karaoke program executed on a terminal device that is connected to each other via a network, participates in a karaoke room formed online, and has an input unit for inputting sounds and a playback unit for playing sounds, a voice receiving process for receiving voice data from each of a plurality of other terminal devices participating in the karaoke room; an audio playback process for playing back the received audio data; an individual volume control process for individually controlling the volume of the audio data received from the other terminal devices and played back by the terminal device, for each of the other terminal devices; execute a mode setting process for setting the state of the terminal device to either a singing mode or a listening mode; In the individual volume control process, the volume control for the singing mode and the volume control for the listening mode are performed separately.

[0010] Furthermore, the karaoke program according to the present invention includes: an accompaniment playback process for playing back an accompaniment to a karaoke piece based on the accompaniment data; and an accompaniment volume control process for controlling the volume of the accompaniment being played.

[0011] Furthermore, the karaoke program according to the present invention includes: a feedback playback process for playing back the inputted own voice data; A feedback volume control process is executed to control the volume of the user's own voice data reproduced in the feedback reproduction process.

[0013] Furthermore, in the karaoke program according to the present invention, the terminal device includes an imaging unit that captures an image to generate a captured image, executes a captured image receiving process for receiving captured images from each of the plurality of other terminal devices participating in the karaoke room; The participant area is an area in which captured images received from the plurality of other terminal devices are displayed.

[0014] Furthermore, in the karaoke program according to the present invention, The size of the participant area is variable.

[0015] Furthermore, the karaoke program according to the present invention includes: execute a mode setting process for setting the state of the terminal device to either a singing mode or a listening mode; M In the main screen, the participant area corresponding to the other terminal device set to the singing mode is larger than the participant area corresponding to the other terminal device set to the listening mode.

[0016] Furthermore, the karaoke program according to the present invention includes: an accompaniment playback process for playing back an accompaniment to a karaoke piece based on the accompaniment data; a second display process for displaying the volume control operator and the accompaniment volume control operator of each of the other terminal devices; Accompaniment volume Adjustment The apparatus further includes an accompaniment volume control means for controlling the volume of the accompaniment being reproduced based on the operation of the operator.

[0017] Furthermore, in the karaoke program according to the present invention, The first display process displays the volume control operator at a position overlapping the selected participant area.

[0018] Furthermore, the karaoke program according to the present invention includes: execute a lyrics display process to display lyrics of a karaoke song overlaid on the main image; The first display process displays the volume control operator at a position that does not overlap with the lyrics being displayed.

[0019] Furthermore, the karaoke program according to the present invention includes: execute a playback operator display process for displaying a playback operator for instructing the start of playing a karaoke piece, superimposed on the main image; The first display process displays the volume control operator at a position where it does not overlap the playback operator.

[0020] Furthermore, in the karaoke program according to the present invention, the first display process makes a plurality of the participant areas selectable, and displays the volume adjustment operators for a plurality of the other terminal devices corresponding to the selected plurality of participant areas; The individual volume control process controls the volume of the audio data received from the selected plurality of other terminal devices based on the operation of the volume adjustment operator.

[0022] Furthermore, the karaoke program according to the present invention includes: executes an accompaniment playback process for playing back an accompaniment for the karaoke piece based on the accompaniment data; The volume of the audio data received from the other terminal device in the individual volume control is reset at a timing corresponding to the start or end of an accompaniment.

[0023] Ma The karaoke device according to the present invention comprises: A karaoke device that is communicatively connected to one another via a network, participates in a karaoke room formed online, and includes an input unit for inputting sounds and a playback unit for playing back sounds, a voice receiving process for receiving voice data from each of the plurality of other karaoke devices participating in the karaoke room; an audio playback process for playing back the received audio data; an individual volume control process for individually controlling the volume of the audio data received from the other karaoke devices and played back by the other karaoke devices; the terminal device includes a display unit for displaying an image; a main display process for displaying a main image formed including participant regions corresponding to the plurality of other terminal devices participating in the karaoke room; When the participant area is selected, a first display process is executed to display a volume adjustment operator for the other terminal device corresponding to the participant area; The individual volume control process controls the volume of the audio data received from the corresponding other terminal device based on the operation of the volume adjustment operator. The karaoke device according to the present invention also includes: A karaoke device that is communicatively connected to one another via a network, participates in a karaoke room formed online, and includes an input unit for inputting sounds and a playback unit for playing back sounds, a voice receiving process for receiving voice data from each of the plurality of other karaoke devices participating in the karaoke room; an audio playback process for playing back the received audio data; an individual volume control process for individually controlling the volume of the audio data received from the other karaoke devices and played back by the other karaoke devices; execute a mode setting process for setting the state of the terminal device to either a singing mode or a listening mode; In the individual volume control process, the volume control for the singing mode and the volume control for the listening mode are performed separately. [Effects of the Invention]

[0024] According to the karaoke program and karaoke device of the present invention, when karaoke is performed between multiple terminal devices (karaoke devices), it is possible to individually control the volume of audio data from other terminal devices, allowing users to enjoy karaoke in a suitable environment. [Brief explanation of the drawings]

[0025] [Figure 1] FIG. 1 shows a system configuration according to an embodiment of the present invention. [Figure 2] 1 is an external view of a mobile terminal according to an embodiment of the present invention; [Figure 3] 1 is a block diagram showing the configuration of a mobile terminal according to an embodiment of the present invention; [Figure 4] FIG. 1 is a flow diagram showing room processing according to an embodiment of the present invention; [Figure 5] Flow diagram showing reservation processing according to this embodiment [Figure 6] 1 is a flowchart showing processing between mobile terminals according to an embodiment of the present invention; [Figure 7] 10A to 10C are diagrams showing various screens on the mobile terminal of the present embodiment; [Figure 8] 10A to 10C are diagrams showing various screens on the mobile terminal of the present embodiment; [Figure 9] 10A to 10C are diagrams showing various screens on the mobile terminal of the present embodiment; [Figure 10] 10A to 10C are diagrams showing various screens on the mobile terminal of the present embodiment; [Figure 11] 10A to 10C are diagrams showing various screens on the mobile terminal of the present embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0026] Fig. 1 is a diagram showing the system configuration of this embodiment. In this embodiment, the system allows communication between mobile terminals 6 to perform karaoke. Fig. 1 shows various examples of communication modes between mobile terminals 6. For example, in the case of a private home, a router 12a connected to the Internet is installed, and a wireless router 12b is connected to the router 12a. The mobile terminal 6 can be connected to the Internet via the wireless router 12b.

[0027] In addition to these communication modes, it is also possible to communicate with the Internet using a mobile communication network. The mobile communication network is a communication mode in which the mobile terminal 6 is connected to the Internet by wireless communication between the mobile terminal 6 and a wireless base station 13.

[0028] By using these various communication methods, the mobile terminal 6 can be connected to the Internet. A management server 11 for managing the karaoke system is also connected to the Internet. A karaoke program is installed on the mobile terminal 6, which is connected to the Internet, and by communicating with the management server 11, it becomes possible to perform karaoke between the mobile terminals 6.

[0029] In the present embodiment, the description has been given of an embodiment in which karaoke is performed using the mobile terminal 6 as the terminal device. Note that the terminal device may be a home game machine, a personal computer, or a dedicated karaoke device, in addition to the mobile terminal 6. Furthermore, a terminal device in which a karaoke program is installed will function as a karaoke device.

[0030] Fig. 2 is a diagram showing the appearance (front view) of a mobile terminal 6 according to an embodiment of the present invention, and Fig. 3 is a block diagram showing the configuration of the mobile terminal 6 according to an embodiment of the present invention. This mobile terminal 6 can be a smartphone, a tablet terminal, a mobile phone, or the like. By installing a karaoke program in this mobile terminal 6, it becomes possible to perform karaoke between the mobile terminals 6.

[0031] The mobile terminal 6 of this embodiment has a control means configured to include a CPU 61, a RAM 62, a storage unit 63, an image processing unit 64, and an audio processing unit 66. A non-volatile storage means such as a NAND flash memory can be used for the storage unit 63. The storage unit 63 stores the program of this embodiment and various data used by the program.

[0032] The CPU 61 is a means for controlling the entire mobile terminal 6, and executes various controls based on programs and data stored in the storage unit 63. The RAM 62 temporarily stores data generated under the control of the CPU 61.

[0033] The sound processing unit 66 is a means for inputting and outputting sound related to the portable terminal 6. Sound is emitted from the speaker 67a under the control of the CPU 61. The sound processing unit 66 is also connected to the microphone 67b, and can pick up call voice and surrounding sounds from the microphone 67b. External devices such as a headset may be used for the speaker 67a and the microphone 67b.

[0034] The touch panel display unit 68 is configured to have a display unit 68m that displays an image and a touch panel 68n disposed on the front or rear surface of the display unit 68m. The touch panel 68n can be of various types that can recognize the position of a user's touch, such as a capacitance type. The CPU 61 displays on the display unit 68m and can determine, based on a touch input from the touch panel 68n, which part of the displayed image has been touched.

[0035] The image processing unit 64 is a means for inputting and outputting images related to the mobile terminal 6. The image processing unit 64 displays and outputs images formed by the CPU 61 on the display unit 68m. The image processing unit 64 also has a function of capturing images, or video if video, from the front camera 65F arranged on the front surface (the touch panel display unit 68 side) of the mobile terminal 6 or the rear camera 65R arranged on the rear surface of the mobile terminal 6, and storing the captured images or video in the storage unit 63 as image or video information.

[0036] The mobile terminal 6 of this embodiment includes a first communication unit 69a and a second communication unit 69b as communication means for communicating with the outside world. The first communication unit 69a is a communication means for connecting to a mobile communication network, and by wirelessly connecting to a mobile base station 140, it is possible to perform various communications via the Internet network using the communication lines of the mobile communication network. The second communication unit 69b is a communication means for connecting via Wi-Fi. The mobile terminal 6 can use the second communication unit 69b to wirelessly connect to an access point 110 and communicatively connect to a local area network in which the access point 110 participates. Note that, in addition to the first communication unit 69a and the second communication unit 69b, the mobile terminal 6 may also be provided with a short-range communication means such as an infrared communication unit or Bluetooth (registered trademark) as communication means.

[0037] The mobile terminal 6 of this embodiment is configured to include, as input means, an input switch 70 in addition to the touch panel 68n. This input switch 70 (input switches 70a, 70b, etc. in FIG. 2) can be provided with various switches such as a power switch, a volume adjustment switch, and a switch whose input purpose is changed depending on the program.

[0038] Furthermore, the mobile terminal 6 of this embodiment has a vibration unit 72 and an LED 73 to provide various notifications to the user who owns the mobile terminal 6. The vibration unit 72 is a member configured by attaching an eccentric weight to the shaft of a motor. By driving the motor to rotate, it is possible to transmit vibrations that can be sensed by the user. The LED 73 is located above the front of the mobile terminal 6 as shown in FIG. 2, and can provide various notifications to the user by blinking.

[0039] In this embodiment, karaoke can be performed between the mobile terminals 6 by installing a karaoke program in such mobile terminals 6. Next, various processes when performing karaoke using the mobile terminals 6 will be described in detail.

[0040] 4 is a flow diagram showing the room processing of this embodiment. Here, a case where karaoke is performed using mobile terminals 6a and 6b will be described. In this embodiment, users gather in a virtually created karaoke room (hereinafter abbreviated as "room"), and users gathered in the same room can perform karaoke by sharing audio (which may include video).

[0041] Here, a case will be described in which a user using mobile terminal 6a creates a room and a user using mobile terminal 6b participates in the room. It is assumed that the users using mobile terminals 6a and 6b already have accounts on management server 11. Note that a user who does not have an account can access management server 11 and create a new account.

[0042] First, the mobile terminal 6a issues a login instruction (S11) to the management server 11. The login instruction is issued by inputting account information (user ID, password, etc.). Upon receiving the login instruction (S11), the management server 11 executes a login process (S21). In the login process, authentication is performed based on the account information, and if the authentication is correct, the user is allowed to use various functions of the karaoke program.

[0043] FIG. 7(A) shows the room selection screen that is displayed after logging in. The room selection screen displays a room selection field 68a and a new room creation button 68b. The room selection field 68a shows rooms that have already been created, and displays the status of the rooms. The room selection field displays the room name, icons of users participating in the room, the room's opening status ("OPEN" or "In preparation"), the date the room will be opened, and so on. Furthermore, a lock mark displayed in the upper left corner of the room selection field 68a indicates a room that requires a password or a room that only users who have been invited in advance can participate in.

[0044] A user can participate in a room by operating the room selection field 68a. Furthermore, the create new room button 68b is a button for creating a new room. By operating the create new room button 68b, the mobile terminal 6a can issue a room creation instruction (S12) to the management server 11. The management server 11 executes a room creation process (S22) based on the room creation instruction (S12). When the room creation process (S22) is completed, the room selection field 68a shown in FIG. 7(A) is displayed.

[0045] On the other hand, mobile terminal 6b that wants to join the room first issues a login instruction (S11) to management server 11 by inputting account information. As in the case of mobile terminal 6a, management server 11 performs authentication based on the account information, and if the authentication is correct, allows mobile terminal 6b to log in. The user refers to the room selection screen shown in FIG. 7(A) and issues a room participation instruction by selecting the room selection field 68a that the user wants to enter (S13). In the example of FIG. 4, when the user of mobile terminal 6a wants to join a room created, management server 11 executes user addition processing (S23) that allows the user of mobile terminal 6b to join the room created by the user of mobile terminal 6a.

[0046] When the users of the mobile terminals 6a and 6b enter the same room, it becomes possible to execute the karaoke process (S12) between the mobile terminals 6a and 6b.

[0047] The karaoke process (S12) mainly comprises a reservation process and a song playback process. The reservation process is a process for reserving a song to be sung, and the song playback process is a process for playing songs registered in the reservation list in order based on the reservation process.

[0048] Fig. 5 is a flow diagram showing the reservation process of this embodiment. In the reservation process, a song is searched for and selected to be sung, and the song can be added to a reservation list managed by management server 11. A user who wants to reserve a song searches for the song using the song search screen shown in Fig. 7(B) (S101).

[0049] The song search screen has a search category selection field 68c and a song selection field 68d. The search category selection field has search categories such as "Favorites," "Songs," "Artists," and "Albums," and by selecting one of these search categories, the user can perform a song search according to the selected search category. In the state shown in Figure 7(B), "Songs" has been selected as the search category, and the song selection field 68d is displayed in alphabetical order.

[0050] The song selection field 68d displays an icon (such as jacket art), song title, and artist name for each song. When the user selects the desired song selection field 68d (S102: Yes), a song confirmation screen (not shown) for that song is displayed (S103). The user reserves the song by performing a confirmation operation related to the reservation, such as operating the reservation button displayed on this song confirmation screen (S104: Yes). Once the reservation is made, reservation information is sent to the management server 11. The reservation information includes a user ID indicating the user who made the reservation and a song ID indicating the song. The management server 11 registers the received reservation information in a reservation list.

[0051] 6 is a flow diagram showing the processing between mobile terminals in this embodiment. Here, an example will be described in which two mobile terminals 6a and 6b are in the same room. In reality, the number of mobile terminals 6 that can be in the room can be two or more.

[0052] First, the mobile terminal 6a executes the reservation process (S100) to reserve a desired song. The reservation process (S100) is as described in Fig. 5, and the mobile terminal 6a transmits reservation information to the management server 11. The management server 11, having received the reservation information, registers the reservation information in a reservation list (S201). At this time, in this embodiment, in conjunction with the reservation operation, a system comment is displayed on all mobile terminals 6a and 6b that have entered the room (S101, S151).

[0053] The management server 11 that receives the reservation information transmits a system comment to all mobile terminals 6a, 6b in the room where the user who made the reservation is currently located (S202), and the mobile terminals 6a, 6b that receive the system comment display the system comment (S101, S151). Based on this configuration, it becomes possible for users who sing karaoke at a distance to be notified of operations related to music playback processing (in this case, reservation processing). Therefore, each user can know who is performing what operation, enabling smooth communication.

[0054] The management server 11 checks the reservation list (S203), and if there is a song to be played next (S204: YES), it executes the song playback process for that song, as shown by the dashed line in Fig. 6. In the song playback process, the management server 11 first identifies the user who made the reservation as the singer based on the user ID included in the reservation information (S205). Then, it issues an instruction to change to singing mode to the mobile terminal 6a used by the user identified as the singer (S208). Upon receiving the instruction, the mobile terminal 6a changes to singing mode (S102).

[0055] On the other hand, the management server 11 identifies users other than the singer who are in the same room as the listener, and instructs the portable terminal 6b used by the identified user to change to the listening mode (S207). The portable terminal 6b that has received the change instruction changes to the listening mode (S152).

[0056] Here, the singing mode and the listening mode will be explained. In the portable terminal 6 set to the singing mode, if the microphone 67b is off, it is changed to the on state. Also, if the volume of the microphone 67b is low, it is increased to the set value to make it easier to capture the user's singing voice data. Also, in the portable terminal 6 set to the singing mode, it is set to a first communication mode which has lower delay than the communication processing in the listening mode. By setting this communication mode, the singing voice data in the portable terminal 6 set to the singing mode is transmitted to another portable terminal 6 with reduced delay.

[0057] On the other hand, the portable terminal 6 set to the listening mode is set to a second communication mode different from the singing mode. The second communication mode is a mode in which delays are greater (the possibility of delays is greater) than the first communication mode. Audio data collected by the microphone 67b of the portable terminal 6 set to the listening mode, such as conversations between users and cheers for singing, is transmitted to other portable terminals 6 using the second communication mode.

[0058] Music is played back based on music data on the mobile terminal 6 whether it is set to singing mode or listening mode. The music data in this embodiment includes accompaniment data and lyric data. Some music data also includes guide data to assist singing. In this way, it is possible to create an environment suited to each of the singing mode and listening mode.

[0059] In the flow diagram of Fig. 6, once the singing mode and listening mode settings are completed (S102, S152), the management server 11 starts transmitting music to each of the mobile terminals 6a, 6b (S208). In this embodiment, music is transmitted by streaming playback, but it is also possible to use a storage type in which music information is stored in advance in the mobile terminals 6a, 6b and played back. In either case, music playback is synchronized on each of the mobile terminals 6a, 6b.

[0060] Each of the mobile terminals 6a, 6b plays back music based on the music data (S103, S153). Then, the mobile terminal 6a, which is set to singing mode, collects singing voice data using the microphone 67b (S104). The collected singing voice data is sent to the management server 11, and the management server 11 transfers it to the other mobile terminals 6 in the same room (S209). The mobile terminal 6b, which has received the singing voice data, plays back the received singing voice data and emits it from the speaker 67a together with the music playback sound.

[0061] Furthermore, in the mobile terminal 6b set to the listening mode, the microphone 67b collects audio data (S154). The collected audio data is transmitted to the management server 11 and transferred to the other mobile terminals 6 that are in the same room (S210). The management server 11 transfers the data to the other mobile terminals 6 that are in the same room (S210). The mobile terminal 6 that has received the audio data plays the received audio data and emits it from the speaker 67a.

[0062] When the music transmission is completed (S211: Yes), the management server 11 checks the reservation list to play the next music (S203). Furthermore, with the completion of the music playback transmission, the mobile terminals 6a and 6b end the music playback (S105: Yes, S155: Yes).

[0063] 8 and 9 are diagrams showing various screens on the mobile terminal 6 of this embodiment, and are screens for explaining use by a singer. FIG. 8(C) shows the screen of the mobile terminal 6 when no music is being played. The screen is provided with a user's own user display area 68e, another user display area 68f, and various setting fields 68g. In this embodiment, a main image is formed by the images displayed in the user's own user display area 68e and the other user display area 68f.

[0064] The own user display area 68e is an area where information about the user using the mobile terminal 6 is displayed, and it is possible to display images captured using the front camera 65F or the rear camera 65R (hereinafter referred to as camera 65). The other user display area 68f is an area related to other users who have entered the same room, and is an area where images captured by the cameras 65 of the mobile terminals 6 of the other users are displayed.

[0065] In the examples from FIG. 8(C) onward, four users are shown participating in the room, and the screen is displayed divided into a user's own display area 68e and three other user display areas 68f. In this embodiment, the user's own display area 68e is displayed at the top, and the other user display areas 68f are displayed in order below it. The other user display areas 68f can be arranged in various ways, such as displaying them in the order in which they joined the room. Note that the user's own display area 68e and the other user display area 68f can be divided not only vertically as in this embodiment, but also horizontally or in a grid pattern, and various other ways can be used. Furthermore, the order of the user's own display area 68e and the other user display area 68f can be arranged in any suitable way, and the order may be changed by user operation.

[0066] The camera 65 can be set to on or off, and when it is set to off and not capturing an image, a user icon 681 is displayed instead of the captured image, making it possible to determine which user's display area it is. On the screens of the mobile terminal 6 shown in Figures 8 to 11, the cameras 65 of all users are set to off, and the own user display area 68e and other user display area 68f show a state in which the user icons 681 are displayed instead of the captured image.

[0067] The various setting field 68g is provided with a room setting icon 682, a reservation icon 683, a setting icon 684, a comment input field 685, a send button 686, and a message icon selection button 687. The room setting icon 682 is an icon that is operated when moving to the room selection screen described in FIG. 7(A) to change the room, etc. The reservation icon 683 is an icon that is used when selecting a song to sing, and when the reservation icon 683 is selected, the screen moves to the song search screen described in FIG. 7(B). The setting icon 684 is an icon for making various settings related to the karaoke app, and when operated, the screen moves to a setting screen (not shown).

[0068] The comment input field 685 is a field for inputting a comment to other participants participating in the same room. When this comment input field 685 is operated, a software keyboard is displayed, and the user can input a comment in the comment input field 685. After inputting the comment, by operating the send button 686, the input comment is sent to the other mobile terminal 6 and displayed on the screen. Furthermore, when the message icon selection button 687 is operated, a plurality of message icons are displayed so that they can be selected, and when the user selects a message icon, the message icon is displayed on the other mobile terminal 6.

[0069] On the right side of the screen of the mobile terminal 6, there are provided buttons for performing various settings (camera inversion button 688, camera setting button 689, mode setting button 690, setting button 691), and it is possible to perform various settings related to the room that the user is in. The camera setting button 689 can be used to set the camera 65 on / off. When the camera 65 is on, it is possible to switch between the front camera 65F and the rear camera 65R by operating the camera inversion button 688.

[0070] The mode setting button 690 is a button for manually switching between singing mode and listening mode. As explained in the flow diagram of FIG. 6, the mobile terminal 6a that has reserved a song is automatically set to singing mode when the reserved song is played back. On the other hand, the other mobile terminal 6b is automatically set to listening mode. For example, if the user wants to sing even with the mobile terminal 6b set to listening mode, the mode setting button 690 can be operated to change from listening mode to singing mode. Furthermore, when the mobile terminal 6b is set to singing mode, the mode setting button 690 can also be operated to change from singing mode to listening mode.

[0071] In listening mode, mode setting button 690 is displayed as a stand microphone icon as shown in Fig. 8(C), and in singing mode, mode setting button 690 is displayed as a handheld microphone icon as shown in Fig. 9(E). In this way, the user can confirm whether listening mode or singing mode is set by the display state of mode setting button 690.

[0072] The setting button 691 can be used to set various volumes when using the karaoke room. When the setting button 691 is operated, a volume setting field 68k shown in Fig. 11(K) is displayed, and various volumes such as the volume of the microphone 67b can be adjusted.

[0073] FIG. 8(D) shows a screen displayed to a user who has reserved a song before playback of the song begins. As described in FIG. 6, the mobile terminal 6 that reserved the song is set to singing mode (S102), and the mode setting button 690 is changed from the shape of a stand microphone to the shape of a handheld microphone. A song start field 68h is also displayed on the screen to accept a start instruction from the user. The song start field 68h displays the song title, artist name, and jacket art 692 of the reserved song. The user can start playback of the reserved song by operating the playback start button 693 displayed in the song start field 68h.

[0074] FIG. 9(E) is a diagram showing the screen of the mobile terminal 6 when music is being played. The user display area of ​​the user who will be singing (in this case, the user's own user display area 68e) is displayed expanded vertically. At that time, the other users (in this case, the other user display area 68f) are displayed reduced in size as the user's own user display area is expanded. Furthermore, when music is being played, the lyrics data played in the lyrics playback process is displayed in the user's own user display area 68e. The user can sing along with the accompaniment data being played while viewing the lyrics displayed in the user's own user display area 68e.

[0075] When a song is played, singing voice data input from the microphone 67b is transmitted to and played back by other mobile terminals 6 participating in the same room, but is played back on the mobile terminal 6 currently singing (feedback playback). The user can sing well by listening to and checking their own singing voice data being played back while singing.

[0076] In this embodiment, audio data input from the microphone 67b of another mobile terminal 6 participating in the same room is played back. Therefore, it is possible to chat with other users by voice, or to play back cheers while singing. However, situations may arise where the volume of such other users' voices is too high and distracts the singing user, or the volume is too low and makes it difficult to hear.

[0077] In this embodiment, in consideration of such a situation, it is possible to adjust the volume of the audio data from other participants in the same room. Also, by making it possible to individually control the volume of other users, it is possible to adjust the sound environment in the room appropriately.

[0078] FIG. 9(F) is a diagram showing a screen in which volume adjustment is being performed for another user (in this case, "Pirori"). In FIG. 9(E), if the user wants to adjust the volume of the audio data of another user (in this case, "Pirori") being played back on the user's own mobile terminal 6, the user touches the other user display area 68f of the other user (in this case, "Pirori"). When the touch operation is performed, as shown in FIG. 9(F), an other user volume setting field 68i is displayed, making it possible to adjust the volume of the other user (in this case, "Pirori"). At this time, the other user volume setting field 68i is displayed in a position that does not obstruct the visibility of the lyrics displayed in the user's own user display area 68e.

[0079] The other user volume setting field 68i displays a target user icon 694 of the other user (in this case, "Pirori") whose volume is to be adjusted, and a volume adjustment operator 695. By operating the volume adjustment operator 695, the user can adjust the volume of the voice data of the other user (in this case, "Pirori") played back on his / her mobile terminal 6.

[0080] The same applies to other users other than those mentioned above. By touching the other user display area 68f of the user for whom you want to adjust the volume, an other user volume setting field 68i for that user is displayed. In this way, in this embodiment, it is possible to adjust the volume of the volume data for each user for other participants in the same room. Furthermore, by operating the other user display area 68f, it is possible to adjust the volume easily and clearly.

[0081] Figures 10 and 11 are diagrams showing various screens on the mobile terminal 6 of this embodiment. Figures 8 and 9 explain the screens displayed when used by a singer, but Figures 10 and 11 explain the screens displayed when used by a listener. Note that explanations of points common to Figures 8 and 9 are omitted.

[0082] Fig. 10(H) is a screen of the mobile terminal 6 when no music is being played, similar to Fig. 8(C). In Fig. 10(H), the user using the mobile terminal 6 is "Monkichi," and a user icon 681 for "Monkichi" is displayed in a user's own user display area 68e displayed at the top of the screen. In addition, user icons 681 for other users are displayed in a different user display area 68f. In Figs. 10 and 11, the participants participating in the room are the same as those in Figs. 8 and 9.

[0083] Fig. 10(I) is a screen when another user is singing. The example of Fig. 10(I) is the state when the user (JOY) is singing, as described in Fig. 9(E). In this case, the other user display area 68f of the user who is singing (the other user display area 68f of "JOY") is displayed enlarged vertically, and the other other user display areas 68f and the user's own user display area 68e are displayed reduced vertically. By displaying the other user display area 68f who is singing enlarged in this way, the visibility of information about the user who is singing and the displayed lyrics is improved.

[0084] Furthermore, the user listening to the singing can also adjust the volume of the other users. In this case, when a touch operation is performed on the other user display area 68f, the other user volume setting field 68i is displayed as shown in Fig. 11(J), similar to the case of Fig. 9(F), and the volume of the other user (in this case, "Jiro") can be adjusted. In this case, the other user volume setting field 68i is displayed in a position that does not obstruct the visibility of the lyrics displayed in the other user display area 68f.

[0085] The other user volume setting field 68i displays a target user icon 694 of the other user (in this case, "Jiro") whose volume is to be adjusted, and a volume adjustment operator 695. The user can adjust the volume of the voice data of the other user (in this case, "Jiro") by operating the volume adjustment operator 695. Note that, at the time of listening, on the mobile terminal 6, it is also possible to adjust the volume of the singing voice data of the other user ("JOY" in the example of FIG. 11). In this case, too, by operating the other user display area 68f of the other user who is singing, the other user volume setting field 68i is displayed and the volume of the singing volume data can be adjusted.

[0086] The user can also adjust the various volume levels by operating a setting button 691 displayed on the screen. When the setting button 691 is operated, a volume level setting field 68k is displayed as shown in Fig. 11(K). The volume level setting field 68k is displayed in a position that does not obstruct the visibility of the lyrics displayed in the other user's display area 68f (or in the user's own display area 68e when singing).

[0087] In this embodiment, the various volume setting field 68k displays volume adjustment operators 696a to 696f for the microphone, accompaniment, guide, and user volumes. When the microphone volume adjustment operator 696a is operated, it is possible to adjust the volume of the audio data input from the microphone 67b and played back as feedback. When the accompaniment volume adjustment operator 696b is operated, it is possible to adjust the volume of the accompaniment data being played back. When the guide volume adjustment operator 696c is operated, it is possible to adjust the volume of the guide melody being played back based on the guide data.

[0088] Furthermore, for user volume, volume adjustment operators 696d-696f are displayed for each of the other participants in the room. By operating these volume adjustment operators 696d-696f, it is possible to adjust the volume of the other users' audio data, similar to the volume adjustment operator 695 described with reference to FIG. 11 and other figures. In this manner, in this embodiment, by displaying the various volume setting field 68k, the volume adjustment operators 696d-696f of the other participants in the room are displayed together, making it possible to adjust the volume of the other users. Furthermore, the various volume setting field 68k also makes it possible to adjust the volume of one's own audio data, which is feedback-played from microphone 67b, the volume of the accompaniment data being played back, and the volume of the guide melody.

[0089] The various volume setting fields 68k have been explained on the screen of the portable terminal 6 being listened to, but it is also possible to display the various volume setting fields 68k on the portable terminal 6 being sung and adjust the various volumes by operating the setting button 691.

[0090] [First Modification] Next, a modified example of the karaoke program according to the present invention will be described. In the above embodiment, the voice data input from the microphone 67b is fed back and played back. The volume of this fed-back voice data (or singing voice data) can be adjusted by operating the volume adjustment operator 696a in the various volume setting field 68k described in FIG. 11(K).

[0091] The volume of the feedback-played audio data may be adjusted not only by touching the various volume setting fields 68k but also by touching the own user display area 68e. When the own user display area 68e is touched, a own user volume setting field (not shown) similar to the other user volume setting field 68i described in Fig. 11(J) etc. is displayed, and the volume of the feedback-played audio data (or singing audio data) can be adjusted by operating a volume adjustment operator provided in the own user volume setting field.

[0092] [Second Modification] In the above-described embodiment, as described with reference to FIG. 9(F), the other user volume setting field 68i is displayed in a position that does not interfere with the visibility of lyrics displayed as music is played. In addition to this configuration, the other user volume setting field 68i may be displayed in a semi-transparent state so that at least the volume adjustment operator 695 does not overlap the display position of the lyrics. When operating the volume adjustment operator 695, the visibility of the screen is obstructed by the finger. However, by not overlapping the volume adjustment operator 695 with the display position of the lyrics, the visibility of the lyrics can be prevented from being obstructed by the finger. Furthermore, because the other user volume setting field 68i is displayed semi-transparently on the screen, it is possible to ensure the visibility of the lyrics even if it overlaps the display position of the lyrics. In this case, it is considered that the degree of freedom in the position at which the other user volume setting field 68i is displayed can be increased.

[0093] The karaoke system of this embodiment and the portable terminal 6 (corresponding to a "karaoke device") used in the karaoke system have been described above, but the present invention is not limited to karaoke systems and karaoke devices, and also includes, for example, a karaoke program that is executed on an information processing device such as the portable terminal 6 and causes the information processing device to function as a karaoke device.

[0094] [Third Modification] In the above-described embodiment, as shown in Fig. 11(K), the user can adjust the user volume displayed in the various volume setting field 68k using the volume adjustment operators 696d-696f for each individual participant. In addition to this configuration, a single volume adjustment operator for collectively adjusting the volume of the participants may be provided. By using the volume adjustment operators 696d-696f for each participant and a single volume adjustment operator for collectively adjusting the volume of the participants in combination, it becomes possible to easily adjust the volume of other participants. [Explanation of symbols]

[0095] 6 (6a, 6b): Portable terminal 68m: Display unit 11: Management server 68n: Touch panel 12a: Router 69a: First communication unit 12b: Wireless router 69b: Second communication unit 13: Wireless base station 70 (70a, 70b): Input switch 61:CPU 72:Vibration part 62:RAM 73:LED 63: Storage unit 110: Access point 64: Image processing unit 140: Mobile base station 65: Camera 606c: Volume control 65F: Front camera 681: User icon 65R: Rear camera 682: Room setting icon 66: Sound processing unit 683: Reservation icon 66b: Microphone 684: Settings icon 67a: Speaker 685: Comment input field 67b: Microphone 686: Send button 68: Touch panel display 687: Message icon selection button 68a: Room selection field 688: Camera inversion button 68b: New room creation button 689: Camera setting button 68c: Search category selection field 690: Mode setting button 68d: Song selection field 691: Settings button 68e: User display area 692: Jacket art 68f: Other users display area 693: Playback start button 68g: Settings field 694: Target user icon 68h: Song start field 695: Volume control 68i: Other users' volume setting field 696a~696f: Volume adjustment controls 68k:Volume setting field

Claims

1. A karaoke program executed on a terminal device that is connected to each other via a network, participates in a karaoke room formed online, and has an input unit for inputting sounds and a playback unit for playing sounds, a voice receiving process for receiving voice data from each of a plurality of other terminal devices participating in the karaoke room; an audio playback process for playing back the received audio data; an individual volume control process for individually controlling the volume of the audio data received from the other terminal devices and played back by the terminal device, for each of the other terminal devices; the terminal device includes a display unit that displays an image; a main display process for displaying a main image formed including participant regions corresponding to the plurality of other terminal devices participating in the karaoke room; When the participant area is selected, a first display process is executed to display a volume adjustment operator for the other terminal device corresponding to the participant area; The individual volume control process controls the volume of the audio data received from the corresponding other terminal device based on the operation of the volume adjustment operator. Karaoke program.

2. A karaoke program executed on a terminal device that is connected to each other via a network, participates in a karaoke room formed online, and has an input unit for inputting sounds and a playback unit for playing sounds, a voice receiving process for receiving voice data from each of a plurality of other terminal devices participating in the karaoke room; an audio playback process for playing back the received audio data; an individual volume control process for individually controlling the volume of the audio data received from the other terminal devices and played back by the terminal device, for each of the other terminal devices; execute a mode setting process for setting the state of the terminal device to either a singing mode or a listening mode; In the individual volume control process, the volume control for the singing mode and the volume control for the listening mode are performed separately. Karaoke program.

3. an accompaniment playback process for playing back an accompaniment to a karaoke piece based on the accompaniment data; and executing an accompaniment volume control process for controlling the volume of the accompaniment to be played.

3. The karaoke program according to claim 1 or 2.

4. a feedback playback process for playing back the inputted own voice data; a feedback volume control process for controlling the volume of the user's voice data reproduced in the feedback reproduction process; 3. The karaoke program according to claim 1 or 2.

5. the terminal device includes an imaging unit that captures an image to generate a captured image, executes a captured image receiving process for receiving captured images from each of the plurality of other terminal devices participating in the karaoke room; The participant area is an area where captured images received from the other terminal devices are displayed.

2. The karaoke program according to claim 1.

6. The size of the participant area is variable 2. The karaoke program according to claim 1.

7. execute a mode setting process for setting the state of the terminal device to either a singing mode or a listening mode; In the main screen, the participant area corresponding to the other terminal device set to the singing mode is larger than the participant area corresponding to the other terminal device set to the listening mode.

2. The karaoke program according to claim 1.

8. an accompaniment playback process for playing back an accompaniment to a karaoke piece based on the accompaniment data; a second display process for displaying the volume control operator and the accompaniment volume control operator of each of the other terminal devices; and an accompaniment volume control means for controlling the volume of the accompaniment being reproduced based on the operation of the accompaniment volume adjustment operator.

2. The karaoke program according to claim 1.

9. The first display process displays the volume control operator at a position overlapping the selected participant area.

2. The karaoke program according to claim 1.

10. execute a lyrics display process to display lyrics of a karaoke song overlaid on the main image; The first display process displays the volume control operator at a position that does not overlap with the lyrics being displayed.

2. The karaoke program according to claim 1.

11. execute a playback operator display process for displaying a playback operator for instructing the start of playing a karaoke piece, superimposed on the main image; The first display process displays the volume control operator at a position where the volume control operator does not overlap the playback operator.

2. The karaoke program according to claim 1.

12. the first display process makes a plurality of the participant areas selectable, and displays the volume adjustment operator for a plurality of the other terminal devices corresponding to the selected plurality of participant areas; The individual volume control process controls the volume of the audio data received from the selected plurality of other terminal devices based on the operation of the volume adjustment operator.

2. The karaoke program according to claim 1.

13. executes an accompaniment playback process for playing back the accompaniment of the karaoke piece based on the accompaniment data; The volume of the audio data received from the other terminal device in the individual volume control is reset at a timing corresponding to the start or end of an accompaniment.

3. The karaoke program according to claim 1 or 2.

14. A karaoke device that is communicatively connected to one another via a network, participates in a karaoke room formed online, and includes an input unit for inputting sounds and a playback unit for playing back sounds, a voice receiving process for receiving voice data from each of the plurality of other karaoke devices participating in the karaoke room; an audio playback process for playing back the received audio data; an individual volume control process for individually controlling the volume of the audio data received from the other karaoke devices and played back by the other karaoke devices; the terminal device includes a display unit that displays an image; a main display process for displaying a main image formed including participant regions corresponding to the plurality of other terminal devices participating in the karaoke room; When the participant area is selected, a first display process is executed to display a volume adjustment operator for the other terminal device corresponding to the participant area; The individual volume control process controls the volume of the audio data received from the corresponding other terminal device based on the operation of the volume adjustment operator. Karaoke equipment.

15. Karaoke rooms are connected to each other via a network and formed online. a karaoke device for participating in a karaoke session, the karaoke device comprising an input unit for inputting sounds and a playback unit for playing sounds, a voice receiving process for receiving voice data from each of the plurality of other karaoke devices participating in the karaoke room; an audio playback process for playing back the received audio data; an individual volume control process for individually controlling the volume of the audio data received from the other karaoke devices and played back by the other karaoke devices; execute a mode setting process for setting the state of the terminal device to either a singing mode or a listening mode; In the individual volume control process, the volume control for the singing mode and the volume control for the listening mode are performed separately. Karaoke equipment.

Images