Karaoke program and karaoke device

Abstract

To achieve smooth communication between users when karaoke is enjoyed between terminal devices.SOLUTION: A karaoke program according to the present invention is a karaoke program that can be executed by a terminal device, and makes processing executable including music reproduction processing that reproduces and outputs music information, acoustic processing that outputs reproduced music sound and an audio signal input from an audio input unit, communication processing that enables voice communication with other terminal devices, determination processing that determines whether a user of the terminal device is a singer or a listener, and display processing that causes a display unit to display a display based on a result of the determination processing.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to a karaoke program executable on a terminal device, and a karaoke device. [Background technology]

[0002] Traditionally, karaoke, where people enjoy singing along to musical accompaniment, has been performed in social settings. Currently, with the spread of infectious diseases, it can be difficult to gather in a karaoke booth to sing. For this reason, some karaoke lovers enjoy karaoke through online web conferences. In karaoke through web conferences, users use their personal computers to connect to a web conference server that hosts a web conference, play downloaded songs, and enjoy singing.

[0003] By the way, there is a system that allows users in different locations to enjoy karaoke together by connecting karaoke devices for communication. Patent Document 1 discloses a karaoke system that allows communication between rooms such as karaoke booths by performing link processing for mutual information communication between the rooms.

[0004] Patent Document 2 discloses a method of connecting a plurality of remote karaoke banquet halls with a video conference system and placing the karaoke machines under the control of unified synchronization information, thereby synchronizing the time series control of the performance of karaoke songs according to a queue. Specifically, a karaoke computer constituting a video conference system is connected to each of the performance terminals that play songs. After connection by the video conference system using the karaoke computer, songs requested from the karaoke computer are managed in a unified queue. Both performance terminals participating in the video conference synchronously play the same karaoke song according to the queue. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2015-184662 A [Patent Document 2] JP 2003-46967 A Summary of the Invention [Problem to be solved by the invention]

[0006] In the current COVID-19 pandemic, web conferences using personal computers are becoming more and more common in business settings. Some people even use these web conference systems to enjoy karaoke. When using a web conference system to sing karaoke, karaoke songs are played on a personal computer and users can sing along to the songs, allowing users to enjoy karaoke even when they are far apart.

[0007] When multiple people sing karaoke, they are divided into singers and listeners, but since the Web conference system is not designed for karaoke, the Web conference participants cannot distinguish between singers and listeners, making it difficult to communicate smoothly through karaoke. In addition, it is not possible to control the singing depending on whether the person is a singer or a listener.

[0008] The present invention has been made in consideration of the above circumstances, and has as its object to enable easy identification of singers and listeners when enjoying karaoke through communication between terminal devices, thereby enabling good communication between karaoke participants. [Means for solving the problem]

[0009] For this reason, the karaoke program according to the present invention employs the following configuration. A karaoke program executable on a terminal device, The device is capable of performing music playback processing, audio processing, communication processing, virtual room participation processing, setting processing, discrimination processing, and display processing; The music playback process plays and outputs music information. The audio processing unit outputs the reproduced music sound and the audio signal input from the audio input unit, The communication process enables communication with other terminal devices, The virtual room participation process includes making a user of another terminal device participate in a virtual room in which the user of the other terminal device is participating, The setting process includes a setting operation for switching from a singer to a listener or from a listener to a singer in a virtual room. and the setting operation is different from the reservation operation for reserving a song to be played in the song playback process. is acceptable, The determination process determines whether the user of the terminal device is a singer or a listener; The display process displays on the display unit whether the user of the terminal device is a listener or a singer based on the result of the determination process.

[0013] Further, in the karaoke program according to the present invention, The display process causes the display unit to display a display based on the determination result of the other terminal device.

[0014] Furthermore, the karaoke program according to the present invention includes: If the determination process determines that the user of the terminal device is a singer, permission process is executed to permit voice input from the voice input unit and to display that the input is permitted.

[0015] Furthermore, the karaoke program according to the present invention includes: When the determination process determines that the user of the terminal device is a singer, an operation management process can be executed to enable reception of operations related to music playback processing.

[0016] Further, in the karaoke program according to the present invention, When an operation related to the music playback process is performed, the operation management process transmits an operation notification to the other terminal devices.

[0017] Furthermore, the karaoke program according to the present invention includes: When an operation notification process is received, the operation notification process for notifying the user of the performed operation can be executed.

[0018] Furthermore, the karaoke program according to the present invention includes: When the determination process determines that the user of the terminal device is a listener, an operation management process can be executed to make it impossible to accept operations related to music playback processing.

[0019] Further, in the karaoke program according to the present invention, The operation management process displays the acceptance status of operations related to the music playback process on the display unit.

[0020] The karaoke device according to the present invention further comprises: A karaoke program executable on a terminal device, The device is capable of performing music playback processing, audio processing, communication processing, virtual room participation processing, setting processing, discrimination processing, and display processing; The music playback process plays and outputs music information. The audio processing unit outputs the reproduced music sound and the audio signal input from the audio input unit, The communication process enables communication with other terminal devices, The virtual room participation process includes making a user of another terminal device participate in a virtual room in which the user of the other terminal device is participating, The setting process includes a setting operation for switching from a singer to a listener or from a listener to a singer in a virtual room. and the setting operation is different from the reservation operation for reserving a song to be played in the song playback process. is acceptable, The determination process determines whether the user of the terminal device is a singer or a listener; The display process displays on the display unit whether the user of the terminal device is a listener or a singer based on the result of the determination process. Effect of the Invention

[0021] According to the karaoke program and the karaoke device of the present invention, good communication is possible when singing karaoke between a plurality of terminal devices (karaoke devices), and users can fully enjoy karaoke. [Brief description of the drawings]

[0022] [Figure 1]FIG. 1 shows a system configuration according to an embodiment of the present invention. [Diagram 2] FIG. 1 is an external view of a mobile terminal according to an embodiment of the present invention; [Diagram 3] FIG. 1 is a block diagram showing a configuration of a mobile terminal according to an embodiment of the present invention. [Figure 4] FIG. 1 is a flow diagram showing room processing according to the present embodiment. [Diagram 5] A flow diagram showing reservation processing according to the present embodiment. [Figure 6] A flow diagram showing processing between mobile terminals according to the present embodiment. [Figure 7] 1 is a diagram showing various screens of a mobile terminal according to an embodiment of the present invention; [Figure 8] 1 is a diagram showing various screens of a mobile terminal according to an embodiment of the present invention; [Figure 9] 1 is a diagram showing various screens of a mobile terminal according to an embodiment of the present invention; [Figure 10] 1 is a diagram showing various screens of a mobile terminal according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Fig. 1 is a diagram showing the system configuration of this embodiment. In this embodiment, the system allows karaoke to be performed between mobile terminals 6, and therefore communication between the mobile terminals 6 is necessary. Fig. 1 shows various examples of communication formats between the mobile terminals 6. For example, in the case of a private home, a router 12a connected to the Internet is provided, and a wireless router 12b is connected to the router 12a. The mobile terminal 6 can be connected to the Internet via the wireless router 12b.

[0024] In addition to these communication modes, it is also possible to communicate with the Internet using a mobile communication network. The mobile communication network is a communication mode in which the mobile terminal 6 is communicatively connected to the Internet by performing wireless communication between the mobile terminal 6 and a wireless base station 13.

[0025] By using these various communication formats, the mobile terminal 6 can be connected to the Internet. A management server 11 for managing the karaoke system is also connected to the Internet. A karaoke program is installed in the mobile terminal 6, which is connected to the Internet, and the mobile terminal 6 can perform karaoke between the mobile terminals 6 by communicating with the management server 11.

[0026] In the above, in this embodiment, an embodiment in which karaoke is performed using the mobile terminal 6 as a terminal device is described. Note that, in addition to the mobile terminal 6, a home game machine, a personal computer, or a karaoke device dedicated to karaoke may be used as the terminal device. Also, a terminal device in which a karaoke program is installed functions as a karaoke device.

[0027] Fig. 2 is a diagram showing the appearance (front view) of a mobile terminal 6 according to an embodiment of the present invention, and Fig. 3 is a block diagram showing the configuration of the mobile terminal 6 according to an embodiment of the present invention. A smartphone, a tablet terminal, a mobile phone, etc. can be used as the mobile terminal 6. By installing a karaoke program in the mobile terminal 6, it becomes possible to perform karaoke between the mobile terminals 6.

[0028] The mobile terminal 6 of this embodiment has a control means including a CPU 61, a RAM 62, a storage unit 63, an image processing unit 64, and an audio processing unit 66. A non-volatile storage means such as a NAND type flash memory can be adopted as the storage unit 63. The storage unit 63 stores the program of this embodiment and various data used by the program.

[0029] The CPU 61 is a means for controlling the entire mobile terminal 6, and executes various controls based on programs and data stored in the storage unit 63. The RAM 62 temporarily stores data generated under the control of the CPU 61.

[0030] The audio processing unit 66 is a means for inputting and outputting audio related information of the mobile terminal 6. It is a means for emitting sound from the speaker 67a under the control of the CPU 61. The audio processing unit 66 is also connected to a microphone 67b, and can pick up call voice and surrounding sounds from the microphone 67b. An external device such as a headset may be used for the speaker 67a and the microphone 67b.

[0031] The touch panel display unit 68 is configured with a display unit 68m that displays an image and a touch panel 68n disposed on the front or back surface of the display unit 68m. The touch panel 68n can be of various types that can recognize the touch position of the user, such as a capacitance type. The CPU 61 performs display on the display unit 68m and can determine which part of the displayed image has been touched by touch input from the touch panel 68n.

[0032] The image processing unit 64 is a means for inputting and outputting image-related data for the mobile terminal 6. The image processing unit 64 displays and outputs images formed by the CPU 61 on the display unit 68m. The image processing unit 64 has a function of capturing images or, if video, videos from the front camera 65F arranged on the front side (the touch panel display unit 68 side) of the mobile terminal 6 or the rear camera 65R arranged on the rear side of the mobile terminal 6, and storing the captured images or videos in the storage unit 63 as image or video information.

[0033] The mobile terminal 6 of this embodiment includes a first communication unit 69a and a second communication unit 69b as communication means for communicating with the outside. The first communication unit 69a is a communication means for connecting to a mobile communication network, and can perform various communications via the Internet network using a communication line of the mobile communication network by wirelessly connecting to a mobile base station 140. The second communication unit 69b is a communication means for connecting to Wifi. The mobile terminal 6 can wirelessly connect to an access point 110 using the second communication unit 69b, and can communicatively connect to a local area network in which the access point 110 participates. Note that, as communication means of the mobile terminal 6, in addition to the first communication unit 69a and the second communication unit 69b, a short-range communication means such as an infrared communication unit or Bluetooth (registered trademark) may be provided.

[0034] The mobile terminal 6 of this embodiment is configured to include an input switch 70 in addition to the touch panel 68n as an input means. The input switch 70 (input switches 70a, 70b, etc. in FIG. 2) can be provided with various switches such as a power switch, a volume adjustment switch, and a switch whose input purpose is changed depending on the program.

[0035] Furthermore, the mobile terminal 6 of this embodiment has a vibration unit 72 and an LED 73 to provide various notifications to the user who holds the mobile terminal 6. The vibration unit 72 is a member formed by attaching an eccentric weight to the shaft of a motor. By driving the motor to rotate, it is possible to transmit vibrations that can notify the user. The LED 73 is disposed above the front of the mobile terminal 6 as shown in FIG. 2, and can provide various notifications to the user by blinking.

[0036] In this embodiment, karaoke can be performed between the mobile terminals 6 by installing a karaoke program in such mobile terminals 6. Next, various processes performed when performing karaoke using the mobile terminals 6 will be described in detail.

[0037] 4 is a flow diagram showing the room processing of this embodiment. Here, a case where karaoke is performed using the mobile terminals 6a and 6b will be described. In this embodiment, by gathering in a virtually created room, users who gather in the same room can share audio (which may include video) and perform karaoke.

[0038] Here, a case will be described in which a user using the mobile terminal 6a creates a room, and a user using the mobile terminal 6b participates in the room. It is assumed that the users using the mobile terminals 6a and 6b already have accounts on the management server 11. Note that a user who does not have an account can access the management server 11 and create a new account.

[0039] First, the mobile terminal 6a issues a login instruction (S11) to the management server 11. The login instruction is issued by inputting account information (user ID, password, etc.). Upon receiving the login instruction (S11), the management server 11 executes a login process (S21). In the login process, authentication is performed based on the account information, and if the authentication is correct, the user is allowed to use various functions of the karaoke program.

[0040] FIG. 7(A) shows a room selection screen that is displayed after logging in. On the room selection screen, a room selection field 68a and a new room creation button 68b are displayed. The room selection field 68a shows a room that has already been created, and the status of the room is displayed. The room selection field displays the room name, icons of users participating in the room, the room's holding status ("OPEN", "In preparation"), the date the room is held, and the like. Also, the room selection field 68a with a lock mark displayed in the upper left corner indicates that the room requires a password or that only users who have been invited in advance can participate in the room.

[0041] A user can participate in a room by operating the room selection field 68a. The new room creation button 68b is a button for creating a new room. By operating the new room creation button 68b, the mobile terminal 6a can issue a room creation instruction (S12) to the management server 11. The management server 11 executes a room creation process (S22) based on the room creation instruction (S12). When the room creation process (S22) is completed, the room selection field 68a shown in FIG. 7(A) is displayed.

[0042] On the other hand, the mobile terminal 6b that will participate in the room first issues a login instruction (S11) to the management server 11 by inputting account information. The management server 11 performs authentication based on the account information, as in the case of the mobile terminal 6a, and if the authentication is proper, logs in the mobile terminal 6b. The user refers to the room selection screen shown in FIG. 7(A) and issues a room participation instruction by selecting the room selection field 68a that the user wants to enter (S13). In the example of FIG. 4, in the case of participating in a room created by the user of the mobile terminal 6a, the management server 11 executes a user addition process (S23) that allows the user of the mobile terminal 6b to participate in the room created by the user of the mobile terminal 6a.

[0043] As the users of the mobile terminals 6a and 6b enter the same room, it becomes possible to execute karaoke processing (S12) between the mobile terminals 6a and 6b.

[0044] The karaoke process (S12) mainly includes a reservation process and a song playback process. The reservation process is a process for reserving a song to be sung, and the song playback process is a process for playing back songs registered in a reservation list in order based on the reservation process.

[0045] Fig. 5 is a flow diagram showing the reservation process of this embodiment. In the reservation process, a song is searched for and a song to be sung is selected, so that the song can be added to a reservation list managed by the management server 11. A user who wants to reserve a song searches for a song using the song search screen shown in Fig. 7(B) (S101). The song search screen in Fig. 7(B) can be displayed by operating a song search button 68k shown in Figs. 9(D1), 9(D2), and 10(E) described later.

[0046] The song search screen has a search category selection field 68c and a song selection field 68d. The search category selection field has search categories such as "Favorites," "Songs," "Artists," and "Albums," and the user can select one of these search categories to perform a song search according to the selected search category. In the state shown in Fig. 7(B), "Songs" is selected as the search category, and the song selection field 68d is displayed in alphabetical order.

[0047] The song selection field 68d displays an icon (such as album art), song title, and artist name for each song. When the user selects the desired song selection field 68d (S102: Yes), a song confirmation screen for the selected song is displayed (S103).

[0048] FIG. 8(C) is a diagram showing a music confirmation screen of this embodiment. A music confirmation field 68e is displayed on the music confirmation screen. In the music confirmation field, an icon (such as album art), music title, artist name, a reservation button 68g, and a cancel button 68f are displayed for the selected music. The user checks the information displayed on this music confirmation screen, and when making a reservation, operates the reservation button 68g (S104: Yes) to reserve the music. When a reservation is made, reservation information is transmitted to the management server 11. The reservation information includes a user ID indicating the user who made the reservation, and a music ID indicating the music. The management server 11 registers the received reservation information in a reservation list.

[0049] 6 is a flow diagram showing the process between mobile terminals in this embodiment. Here, an example will be described in which two mobile terminals 6a and 6b are in the same room. In reality, the number of mobile terminals 6 that can be in the room can be two or more.

[0050] First, the mobile terminal 6a executes a reservation process (S100) to reserve a desired song. The reservation process (S100) is as described in FIG. 5, and the mobile terminal 6a transmits reservation information to the management server 11. The management server 11, which has received the reservation information, registers the reservation information in a reservation list (S201). At that time, in this embodiment, in conjunction with the reservation operation, a system comment is displayed on all the mobile terminals 6a and 6b that have entered the room (S101, S151).

[0051] The management server 11 that receives the reservation information transmits a system comment to all the mobile terminals 6a, 6b in the room in which the user who made the reservation is present (S202), and the mobile terminals 6a, 6b that receive the system comment display the system comment (S101, S151). Based on this configuration, it becomes possible for users who sing karaoke at a distance to be notified of operations related to music playback processing (in this case, reservation processing). Therefore, each user can know who is performing what operation, and smooth communication can be achieved.

[0052] The management server 11 checks the reservation list (S203), and if there is a song to be played next (S204), executes a song playback process for that song, as enclosed by a dashed line in Fig. 6. In the song playback process, first, the user who made the reservation is identified as the singer based on the user ID included in the reservation information (S205). Then, an instruction is given to the mobile terminal 6a used by the user identified as the singer to change to singer mode (S208). The mobile terminal 6a that has received the instruction changes to singer mode (S102).

[0053] On the other hand, the management server 11 identifies users other than the singer who are in the same room as the singer as listeners, and instructs the portable terminal 6b used by the user identified as the singer to change to listener mode (S207). The portable terminal 6a that receives the change instruction changes to the singer mode (S152).

[0054] In this embodiment, when switching between the listener mode and the singer mode, each mobile terminal 6 judges whether the user of the mobile terminal 6 is a singer or a listener, and displays a display based on the judgment result on the touch panel display unit 68 as a display unit. The display form will be described later.

[0055] Here, the singer mode and the listener mode will be explained. In the portable terminal 6 set to the singer mode, the volume of the microphone 67b is sufficiently increased to make it easier to capture the user's singing voice. In addition, in the portable terminal 6 set to the singer mode, the singing voice captured by the microphone 67b is transmitted to the network (such as the management server 11) without adding any sound effects such as echo. In addition, in the singer mode, a communication mode with lower delay than the communication processing in the listener mode is set. By setting such a communication mode, the singing voice in the singer mode is transmitted to other portable terminals 6 with reduced delay.

[0056] On the other hand, in the portable terminal 6 set to the listener mode, the microphone 67b is turned off or the volume of the microphone 67b is lowered so as not to interfere with the singing. Also, the singing voice transmitted via the network is given a sound effect by the sound processor 66 and is output from the speaker 67a. Note that music is played back in both the portable terminal 6 set to the singer mode and the listener mode.

[0057] In this way, by adjusting the volume in the singer mode and the listener mode, it is possible to create an environment that is easy to listen to. In addition, by applying sound effects to the singing voice by the sound processor 66 of the mobile terminal 6 set to the listener mode, it is possible to obtain the following effects.

[0058] In audio transmission via a network, if an acoustic environment problem occurs that causes a delay in the singer's voice, it is possible that communication between the singer and the listener will not go well. In addition, when a singing voice to which sound effects (especially delay-type sound effects such as echo, delay, and reverb) have been applied is transmitted via a network, the singing voice may be significantly degraded. In this embodiment, by applying sound effects to the singing voice by the sound processing unit 66 of the mobile terminal 6 set to the listener mode, it is possible to reproduce a high-quality singing voice and provide a good acoustic environment on the mobile terminal 6 set to the listener mode.

[0059] Returning to the flow diagram of Fig. 6, when the settings of the singer mode and the listener mode are completed, the management server 11 starts transmitting music to each of the mobile terminals 6a, 6b (S208). In this embodiment, music is transmitted by streaming playback, but it is also possible to use a storage type in which music information is stored in advance in the mobile terminals 6a, 6b and played back. In either case, music playback is synchronized in each of the mobile terminals 6a, 6b.

[0060] Each of the mobile terminals 6a, 6b plays back music (S103, S153). Then, in the mobile terminal 6a set to the singer mode, the microphone 67b collects the singing voice (S104). The collected singing voice is transmitted to the management server 11, which then transfers it to another mobile terminal 6b that is in the same room (S209). The mobile terminal 6b that receives the singing voice applies sound effects to the received singing voice in the sound processor 66 (S154), and emits the sound from the speaker 67a together with the music playback sound.

[0061] 9 and 10 show music playback screens displayed during music playback on the mobile terminal 6 of this embodiment. As shown in Fig. 9(D1), the room name and a music search button 68k are displayed at the top of the music playback screen. By operating the music search button 68k, the music search screen described in Fig. 7(B) is displayed, and it is possible to reserve a song.

[0062] In addition, the music playback screen is broadly divided into a music-related display field 68h, an upper display field 68i, and a lower display field 68j. The music-related display field 68h includes a lyrics display field 681 and a progress bar 682. The lyrics display field 681 displays lyrics to be sung for the music being played. Note that the lyrics display field 681 may also display background video. The progress bar 682 indicates the progress of music playback.

[0063] The area occupied by the upper display field 68i and the lower display field 68j can be changed. Normally, the state shown in FIG. 9(D1) and FIG. 9(D2) is displayed, that is, both the upper display field 68i and the lower display field 68j are displayed. When the comment tab 686, the reservation confirmation tab 687, and the remote control tab 688 provided in the lower display field 68j are operated, the lower display field 68j is displayed using the area where the upper display field 68i was displayed, as shown in FIG. 10(E). FIG. 10(E) shows the state where the remote control tab 688 is operated. By operating the comment tab 686, the reservation confirmation tab 687, and the remote control tab 688 again, the state returns to that shown in FIG. 9(D1) and FIG. 9(D2).

[0064] The upper display field 68i displays a status display / selection button 683, a microphone selection button 684, and participating user icons 685. The status display / selection button 683 is a button that indicates the status of the mobile terminal 6.

[0065] FIG. 9(D1) shows a case where the singer mode is set, and in this case, "singing" is marked. On the other hand, FIG. 9(D2) shows a case where the listener mode is set, and "listening" is marked. In this embodiment, the status display / selection button 683 is provided with "Away", which allows a user to temporarily leave the room. The user can manually switch between "singing", "listening", and "away". In this case, when the status is switched to "singing", the setting is changed to the singer mode, and when the status is switched to "listening" or "away", the setting is changed to the listener mode. In this embodiment, three states can be switched, but the status may be two, "singing" and "listening", and various display forms can be adopted.

[0066] The microphone selection button 684 can be manually operated by the user to switch the microphone 67b on and off. In this embodiment, when the mode is set to singer mode, it is automatically set to on, and when the mode is set to listener mode, it is automatically set to off. The participating user icons 685 indicate all users participating in the room. In the examples of Fig. 9(D1) and Fig. 9(D2), four users have participated. The user whose icon is indicated by a thick line ("JOY" in the example of Fig. 9(D1) and "Pirori" in the example of Fig. 9(D2)) indicates that he / she is singing (set to singer mode). Also, the icon with a speaker and a cross mark ("Monkichi" in the example of Fig. 9(D1)) indicates that he / she is away. These display forms are merely examples, and the status such as singing, listening, and away may be indicated by other display forms.

[0067] The lower display field 68j is provided with three tabs (a comment tab 686, a reservation confirmation tab 687, and a remote control tab 688). In the state shown in Fig. 9(D1) and Fig. 9(D2), the comment tab 686 is selected, and a comment display field 689 and a comment input field 690 are displayed in the lower display field 68j. In addition to a user comment entered by the user using the comment input field 690, the comment display field 689 displays a system comment accompanying an operation related to music playback processing.

[0068] In Fig. 9(D1), the comment display field 689 displays the system comment accompanying the reservation process, including the user name and the reserved song / artist name. Fig. 9(D2) shows the state after Fig. 9(D1), with the system comment and user comment displayed in chronological order in the comment display field 689. The user comment includes the name of the user who entered the comment and the comment text. Users can communicate smoothly by viewing these system comments and user comments.

[0069] 10(E) shows the state when the remote control tab 688 is operated. As described above, the lower display field 68j is displayed by expanding it to the area where the upper display field 68i is displayed. When the remote control tab 788 is selected, the lower display field 68j displays a singer volume 691, a speaker volume 692, a pitch change button 693, a BGM volume 694, a playback position adjustment button 695, a re-sing button 696, a pause button 697, and a performance stop button 698.

[0070] In this embodiment, the various controls and buttons displayed on the remote control tab 688 can be operated only by the mobile terminal 6 set to the singer mode. In the mobile terminal 6 set to the listener mode, the various controls and buttons that are prohibited from being operated may be grayed out, making it visible that they are not subject to operation. In this way, in this embodiment, operations related to music playback are prohibited in the mobile terminal 6 set to the listener mode, making it possible to suppress erroneous input by the listener.

[0071] The singer volume 691 is an operator for adjusting the volume of the singing voice input from the microphone 67b of the mobile terminal 6 set to the singer mode. The speaker volume 692 is an operator for adjusting the volume of the singing voice input from the microphone 67b of the mobile terminal 6 set to the listener mode. The singer volume 691 and the speaker volume 692 are set to the default state of each mode when the mobile terminal 6 is set to the singer mode or the listener mode, but can be operated only from the mobile terminal 6 set to the singer mode.

[0072] The pitch change button 693 is a button for changing the pitch of the song being played. The BGM volume 694 is an operator for adjusting the volume of the BGM played between songs. The playback position adjustment button 695 is an operator for changing the playback position. The current playback time and the total playback time are displayed to the left of the operators. The sing again button 696 can be operated to play the song being played from the beginning. The pause button 697 is a button for temporarily stopping the song being played. The performance stop button 698 is a button for stopping the song being played, and when the performance stop button 698 is operated, playback processing moves to the next reserved song.

[0073] During music playback, a user who has been set to singer mode can perform various setting operations related to music playback by using various controls and buttons displayed on the remote control tab 688 in Fig. 10(E). In the flow diagram of Fig. 6, if a setting operation is performed during music playback (S105: Yes), the mobile terminal 6a transmits a setting change instruction to the management server 11. The management server 11 executes the setting change according to the received setting change instruction (S210).

[0074] The setting change can be not only performed by the management server 11, such as changing the pitch of a song, but also can be performed on various mobile terminals 6a and 6b. For example, when the mobile terminal 6a set to the singer mode changes the sound settings of the sound effects (echo, delay, etc.) on the other mobile terminal 6b (set to the listener mode), the mobile terminal 6a set to the singer mode transmits sound setting information related to the sound effects to the management server 11 (S106). The management server 11 that has received the sound setting information transfers the sound setting information to the other mobile terminal 6b. The mobile terminal 6b that has received the sound setting information imparts sound effects to the singing voice signal or the sound of the song being played based on the received sound setting information.

[0075] The management server 11 transmits (S211) a system comment based on the setting change (S210) to each of the mobile terminals 6a, 6b. In each of the mobile terminals 6a, 6b, the system comment is displayed in the comment display field 689 described with reference to Figs. 9(D1) and 9(D2) (S107, S155). Therefore, users participating in the room can check the operation related to the music playback process from the system comment displayed in the comment display field 689. Therefore, users participating in the room can communicate smoothly by checking the system comment.

[0076] When the management server 11 completes the music transmission (S212: Yes), it checks the reservation list to play the next music (S203). In addition, with the completion of the music playback transmission, each of the mobile terminals 6a and 6b ends the music playback (S108, S156: Yes).

[0077] As described above, in this embodiment, in the portable terminal 6 (terminal device) set to the listener mode, the portable terminal 6 determines whether the user of the portable terminal 6 is a singer or a listener, and displays a display based on the determination result on the display unit, thereby making it easy to distinguish between singers and listeners, and enabling good communication between karaoke participants. [Explanation of symbols]

[0078] 6 (6a, 6b): Portable terminal (terminal device) 69a: First communication unit 11: Management server 69b: Second communication unit 12a: Router 70: Input switch 12b: Wireless router 70a: Input switch 13: Wireless base station 70b: Input switch 61:CPU 72:Vibration part 62: RAM 73: LED 63: Storage unit 110: Access point 64: Image processing unit 140: Mobile base station 65F: Front camera 681: Lyrics display 65R: Rear camera 682: Progress bar 66: Sound processing unit 683: Selection button 67a: Speaker 684: Microphone selection button 67b: Microphone 685: Participant icon 68: Touch panel display 686: Comment tab 68a: Room selection section 687: Reservation confirmation tab 68b: New room creation button 688: Remote control tab 68c: Search category selection field 689: Comment display field 68d: Song selection field 690: Comment input field 68e: Song confirmation column 691: Singer volume 68f: Cancel button 692: Speaker volume 68g: Reservation button 693: Pitch change button 68h: Music related display area 694: BGM volume 68i: Upper display area 695: Playback position adjustment button 68j: Lower display column 696: Button 68k: Song search button 697: Pause button 68m: Display 698: Playback stop button 68n:Touch panel 788:Remote control tab

Claims

1. A karaoke program executable on a terminal device, The device is capable of performing music playback processing, audio processing, communication processing, virtual room participation processing, setting processing, discrimination processing, and display processing; The music playback process plays and outputs music information. The audio processing unit outputs the reproduced music sound and the audio signal input from the audio input unit, The communication process enables communication with other terminal devices, The virtual room participation process includes making a user of another terminal device participate in a virtual room in which the user of the other terminal device is participating, the setting process is a setting operation for switching from a singer to a listener or from a listener to a singer in the virtual room, and is capable of accepting a setting operation different from a reservation operation for reserving a piece of music to be played in the music playback process; The determination process determines whether the user of the terminal device is a singer or a listener; The display process displays on the display unit whether the user of the terminal device is a listener or a singer based on the result of the discrimination process. Karaoke program.

2. The display process displays a display based on the determination result of the other terminal device on the display unit.

2. The karaoke program according to claim 1.

3. When the user of the terminal device is determined to be a singer in the discrimination process, a permission process is executed to permit voice input from the voice input unit and to display that the input is permitted.

3. The karaoke program according to claim 1 or 2.

4. When the determination process determines that the user of the terminal device is a singer, the operation management process is enabled to accept operations related to music playback process.

4. The karaoke program according to claim 1, wherein the karaoke program is a program for performing karaoke.

5. The operation management process transmits an operation notification to another terminal device when an operation related to the music playback process is performed.

5. The karaoke program according to claim 4.

6. When an operation notification process is received, the operation notification process for notifying the user of the operation that has been performed can be executed.

6. The karaoke program according to claim 5.

7. When the determination process determines that the user of the terminal device is a listener, the operation management process is enabled to not accept operations related to music playback process.

7. The karaoke program according to claim 1, wherein the karaoke program is a program for performing karaoke.

8. The operation management process displays the operation acceptance status related to the music playback process on the display unit.

8. The karaoke program according to claim 7.

9. A karaoke device capable of reproducing and outputting music information, The device is capable of performing audio processing, communication processing, virtual room participation processing, setting processing, discrimination processing, and display processing; The audio processing unit outputs the reproduced music sound and the audio signal input from the audio input unit, The communication process enables communication with other terminal devices, The virtual room participation process includes making a user of another terminal device participate in a virtual room in which the user of the other terminal device is participating, the setting process is a setting operation for switching from a singer to a listener or from a listener to a singer in the virtual room, and is capable of accepting a setting operation different from a reservation operation for reserving a piece of music to be played in the music playback process; The determination process determines whether the user of the terminal device is a singer or a listener; The display process displays on the display unit whether the user of the terminal device is a listener or a singer based on the result of the discrimination process. Karaoke equipment.

Images