Karaoke equipment and karaoke programs

Abstract

In a karaoke device that uses two-way communication, the aim is to improve the flexibility of the lyric display format and the display quality. [Solution] The system performs the following: sound signal reception processing to receive music sound and singing voice from another karaoke machine via a server; sound signal output processing to output the music sound and singing voice received in the sound signal reception processing; first lyric reading processing to read lyric information corresponding to the music sound received in the sound signal reception processing; first lyric formation processing to form a lyric video based on the lyric information read in the lyric reading processing; and first video signal output processing to output the lyric video formed in the lyric formation processing in synchronization with the music sound output by the sound signal output processing.

Description

Technical Field

[0001] The present invention relates to a karaoke device that sings in accordance with a reproduced music piece, and a karaoke program for realizing the functions of the karaoke device in an information processing device.

Background Art

[0002] Conventionally, karaoke for enjoying singing along with an accompaniment has been performed at a karaoke box, a night spot such as a snack bar, or at home. With the increasing speed and popularity of the Internet line, enjoying karaoke between remote locations is also becoming more widespread.

[0003] Patent Document 1 discloses a karaoke mediation system that performs karaoke using a Web conferencing system. The karaoke devices can perform karaoke between remote locations by transmitting and receiving audio and video to each other via a Web conferencing server connected to the Internet.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the karaoke mediation system of Patent Document 1, the karaoke device on the singing side transmits audio and video. At that time, the lyrics reproduced in synchronization with the reproduction of the music piece are also transmitted as video. Therefore, on the listening-side karaoke device, the size of the lyrics can only be changed by enlarging or reducing the video. On the listening side as well, users desire to be able to change the display form of the lyrics, such as changing the font. Also, when the line speed is slow, the quality (resolution, frame rate) of the video deteriorates, and thus the display quality of the lyrics also deteriorates.

[0006] This invention takes these circumstances into consideration and aims to improve the degree of freedom in the display format of lyrics and the display quality in a karaoke device that transmits and receives audio and video via two-way communication. [Means for solving the problem]

[0007] Therefore, the karaoke device according to the present invention is Audio signal reception processing that receives music and singing voices from other karaoke machines via a server, The audio signal receiving process outputs the music sound and vocal voice received by the audio signal receiving process, and the audio signal output process outputs the music sound and vocal voice. The first lyric reading process reads out lyric information corresponding to the music sound received in the sound signal reception process, A first lyric formation process forms a lyric video based on the lyric information read in the lyric reading process, The process then executes a first video signal output process, which outputs the lyric video formed by the lyric formation process in synchronization with the music sound output by the sound signal output process.

[0008] Furthermore, the karaoke device according to the present invention is The system performs video signal reception processing to receive captured video images taken by an imaging device connected to another karaoke machine. The first video signal output process outputs the captured video received by the video signal reception process, in addition to the lyrics video.

[0009] Furthermore, in the dish device according to the present invention, The first video signal output process outputs the received captured video to a first area of ​​the display unit and outputs the lyrics video to a second area of ​​the display unit that is different from the first area.

[0010] Furthermore, the karaoke device according to the present invention is Execute a settings process that allows you to configure the display format of the lyrics video. The first video signal output process forms the lyrics video based on the display format of the lyrics video set in the setting process.

[0011] Furthermore, the karaoke device according to the present invention is The music retrieval process retrieves music information, The music playback process plays the music based on the music information read in the music reading process, Audio signal transmission processing that sends the played music and singing voice to other karaoke machines via a server, A second lyric reading process reads the lyric information corresponding to the song information read in the song reading process, A second lyric formation process forms a lyric video based on the lyric information read in the second lyric reading process, The process then executes a second video signal output process, which outputs the lyric video formed in the second lyric formation process in synchronization with the music sound output in the music playback process.

[0012] Furthermore, the karaoke device according to the present invention is The system performs video signal reception processing to receive captured video images taken by an imaging device connected to another karaoke machine. The second video signal output process outputs the captured video received during the video signal reception process, in addition to the lyrics video.

[0013] Furthermore, the karaoke device according to the present invention is The first video output process and the second video output process output lyrics videos with different layouts.

[0014] Furthermore, the karaoke device according to the present invention is Processing is performed using the first OS and the second OS. The first lyric reading process and the first lyric formation process are executed by the first OS. The second lyric reading process and the second lyric formation process are executed on the second OS.

[0015] Furthermore, in the dish device according to the present invention, The audio signal reception and audio signal output processes are executed by the first OS.

[0016] Furthermore, in the dish device according to the present invention, The first video signal output process is executed in the first OS.

[0017] Furthermore, in the karaoke device according to the present invention, The music reading process and the music playback process are executed in the second OS.

[0018] Furthermore, in the karaoke device according to the present invention, The formation of the lyrics video in the second video signal output process is executed in the first OS.

[0019] Furthermore, in the karaoke device according to the present invention, The first lyrics reading process reads the lyrics information received from another karaoke device, The second lyrics reading process reads the lyrics information stored in the storage unit of the karaoke device.

[0020] Furthermore, in the karaoke device according to the present invention, The first lyrics reading process reads the lyrics information received from the server, The second lyrics reading process reads the lyrics information stored in the storage unit of the karaoke device.

[0021] Also, the karaoke program according to the present invention is A karaoke program executed on an information processing device, A sound signal reception process for receiving music sounds and singing voices from another karaoke device via a server, A sound signal output process for outputting the music sounds and singing voices received in the sound signal reception process, A lyrics reading process for reading lyrics information corresponding to the music sounds received in the sound signal reception process, A lyrics formation process for forming a lyrics video based on the lyrics information read in the lyrics reading process, A video signal output process for outputting the lyrics video formed in the lyrics formation process in synchronization with the music sounds output in the sound signal output process. A karaoke program.

Advantages of the Invention

[0022] According to the karaoke device and karaoke program of the present invention, in a karaoke device that performs two-way communication, it is possible to improve the degree of freedom in the display format of lyrics on the listening side, as well as improve the display quality. [Brief explanation of the drawing]

[0023] [Figure 1] Diagram illustrating the entire system of this embodiment. [Figure 2] This diagram shows the configuration of the karaoke system according to this embodiment. [Figure 3] Flowchart showing the regeneration process of this embodiment [Figure 4] This figure shows the formed image (first OS) in the singing-side karaoke device of this embodiment. [Figure 5] This figure shows the generated image (second OS) in the singing-side karaoke device of this embodiment. [Figure 6] This figure shows the display image of the singing-side karaoke device of this embodiment. [Figure 7] This figure shows the formed image (second OS) in the listening-side karaoke device of this embodiment. [Figure 8] This figure shows the display image of the listening-side karaoke device of this embodiment. [Figure 9] A diagram showing the lyrics setting screen of another embodiment. [Modes for carrying out the invention]

[0024] Figure 1 is a diagram illustrating the entire system of this embodiment. The system of this embodiment consists of a bidirectional communication server 40 (corresponding to the "server" in this invention), a management server 50, and a karaoke system installed in a karaoke establishment. The karaoke system installed in the establishment consists of karaoke devices 2 (2a, 2b) and remote control devices 1 (1a, 1b). The karaoke devices 2 installed in the karaoke establishment are connected to the internet via a router 120 and an optical modem 121, and are capable of communicating via the internet.

[0025] The bidirectional communication server 40 is a server that connects multiple karaoke devices 2 to each other for communication and enables them to send and receive audio and video. In this embodiment, the bidirectional communication server 40 is used to enable audio and video communication between karaoke devices 2 at distant locations. The management server 50 is a server that performs various management tasks of the karaoke system, such as distributing song information to the karaoke devices 2 and updating the karaoke devices 2. The management server 50 is equipped with a storage unit 51 that stores song information, lyric information, etc.

[0026] Figure 2 shows the configuration of the karaoke system of this embodiment. The karaoke system in this embodiment consists of a karaoke device 2 (sometimes called a commander) and a remote control device 1. In this embodiment, the karaoke device 2 and the remote control device 1 are connected to a LAN 100 by wired or wireless communication, forming a network.

[0027] The karaoke machine 2, installed in establishments such as karaoke boxes, is equipped with an acoustic control unit 25 that plays music (accompaniment). In this embodiment, the acoustic control unit 25 adds acoustic effects such as echo to the singing voice input from each microphone 43a, 43b, and adds the music sound played based on the music information, and outputs it to the speaker 42. In Figure 1, the speaker 42 is shown as one for convenience, but it is possible to use multiple speakers 42 and adopt various configurations such as stereo output or surround output.

[0028] The karaoke machine 2 is equipped with two control units (first SoC20a (first control unit), second SoC20b (second control unit)) as its control configuration. An SoC (System on a Chip) is a chip also called a one-chip computer, which integrates the core functions of a computer, such as the CPU, memory, video chip, and I / O (Input / Output). In addition to using such an SoC as the control configuration, the CPU, memory, video chip, etc., which are functions of the SoC, may also be provided as components.

[0029] The video control unit 28 receives video from the first SoC 20a and the second SoC 20b and displays either one of them on the monitor 41, or combines both and displays them on the monitor 41. A camera 43 is also connected to the video control unit 31, making it possible to capture images of the inside of the karaoke room, such as the appearance of the user singing. In this embodiment, the video captured by the camera 43 can be shared with other karaoke systems, making it possible to create a virtual room (corresponding to the "group" in this invention) that makes it seem as if everyone is in the same room.

[0030] The first SoC20a has a hard disk 29, which is one of its memory units, mounted on it, and the first SoC20a is responsible for controlling the reading and writing of the hard disk 29. Alternatively, the second SoC20b may also be provided with an external memory unit such as a hard disk 29, and reading and writing may be performed by the second SoC20b. The first SoC20a and the second SoC20b are connected to each other via an internal LAN hub 27 (internal LAN (Local Area Network)) so that they can communicate with each other.

[0031] In this embodiment, the first SoC20a and the second SoC20b use different types of operating systems. For various applications executed on the karaoke device 2 and for external communication control via the internet, a new first OS (in this embodiment, "Android® OS") is used. On the other hand, the second SoC20b uses the second OS (in this embodiment, "Linux®") used in the older karaoke device 2.

[0032] Thus, by using a new first OS (in this embodiment, "Android® OS"), it is possible to use existing applications or various development environments for applications executed on the karaoke machine 2 and for external communication control via the internet. Furthermore, by using the second OS, it is possible to use various programs and data that were used in the conventional karaoke machine 2, such as for playing music data.

[0033] As described above, the karaoke device 2 of this embodiment employs different first and second operating systems in its two control units, the first SoC20a and the second SoC20b. Since the first SoC20a and the second SoC20b are connected by an internal LAN hub 27, they can easily cooperate by communicating using a common communication protocol.

[0034] The second SoC20b (second control unit) is primarily responsible for functions related to music playback. Like the first SoC20a, the second SoC20b is capable of audio and video output. Audio generated by the second SoC20b is output to the sound control unit 25, and video is displayed on the monitor 41 via the video control unit 28.

[0035] In this embodiment, the second SoC20b is responsible for controlling the infrared communication unit 21, the LED 22, and the operation unit 23. The LED 22 functions as a status display unit that shows various states of the karaoke device 2. The operation unit 23 consists of switches, a touch panel, etc., and accepts various operations from the user. In this embodiment, the control of the LED 22 and the operation unit 23 by the second SoC20b is performed via the microcontroller 26.

[0036] In this configuration, the karaoke device 2 performs various processes. The main functions of the karaoke device 2 include song reservation processing and song playback processing (overall management processing, video processing, and audio processing). Song reservation processing is the process of selecting and reserving a song based on the user's specifications, and is performed in cooperation with the remote control device 1. The reservation information formed by the song selection processing of the remote control device 1 is transmitted to the karaoke device 2. The karaoke device 2 registers the received reservation information in a reservation table stored in the memory of the second SoC20b. In the song playback processing, video processing, audio processing, and lyrics display processing are performed under the overall management processing.

[0037] Audio processing is a process related to sound, and includes the process of causing the second SoC 20b to perform music based on music information (MIDI data, audio data) contained in the music data. The music played by the sound control unit 25 is mixed with audio signals input from microphones 43a and 43b and emitted from speaker 42. Lyric display processing is a process that assists singing by displaying lyric video (lyrics) based on the lyric information contained in the music data on monitor 41. By superimposing the background video played by the video playback processing onto the lyric video displayed by this lyric display processing, the atmosphere of singing is enhanced.

[0038] Meanwhile, the remote control device 1 is capable of performing song selection processing, which involves searching for songs based on user instructions and sending reservation information for the requested songs to the karaoke device 2. The remote control device 1 can receive various information from the karaoke device 2 or the management server 50 connected to the internet and perform various processes. In this embodiment, the user interface for receiving various instructions from the user includes an operation unit 17 and a touch panel monitor 11. The touch panel monitor 11 is configured to have a display unit 11a and a touch panel 11b, and displays various information on the display unit 11a and is capable of receiving touch input from the user.

[0039] Furthermore, the remote control device 1 is configured to include a memory 14 as a storage unit for storing a database, various programs, and various information generated in conjunction with program execution, which are necessary for the music selection process, and a remote control unit for comprehensively controlling these components. The remote control unit includes a CPU 15, a video control unit 13 that forms the image to be displayed on the touch panel monitor 11, a video RAM 12 that temporarily stores the video data of the image to be displayed, and an operation processing unit 18 that interprets input from the touch panel monitor 11 or the operation unit 17 and transmits it to the CPU 15.

[0040] The remote control device 1 is connected to the network configured by the LAN 100 by wirelessly connecting to the access point 130 via the wireless LAN communication unit 16. Each remote control device 1 is pre-associated with a specific karaoke machine 2. Various commands output from the remote control device 1 are received by the associated karaoke machine 2.

[0041] With this configuration of the remote control device 1, various inputs from the user are received from the touch panel monitor 11 or the operation unit 17, and various information is provided through the display on the touch panel monitor 11, enabling various processes such as song selection, which sends reservation information to be output to the karaoke device 2.

[0042] As explained in Figure 1, the karaoke device 2 of this embodiment uses different types of first and second operating systems in the first SoC20a and second SoC20b. New programs and data are processed using the first OS, while existing assets are processed using the second OS. By utilizing the first and second OS in this way, it is possible to leverage the advantages of both, thereby reducing development costs and shortening development time.

[0043] Figure 3 is a flowchart illustrating the playback process of this embodiment. As explained in Figure 1, the karaoke device 2 of this embodiment communicates with other karaoke devices 2 via a bidirectional communication server 40, enabling users to enjoy karaoke by sending and receiving audio and video signals to and from each other. While it is possible to connect two or more karaoke devices 2, the flowchart in Figure 3 will explain the communication connection between two karaoke devices 2a and 2b for the sake of clarity.

[0044] Karaoke devices 2a and 2b share processing tasks between the first SoC 20a and the second SoC 20b, and work together to perform various processes. When singing, the first SoC 20a controls communication with the other karaoke device 2b, while the second SoC 20b is responsible for playing back song data (including song information and lyrics information).

[0045] When establishing a communication connection, an instruction to start bidirectional communication is sent from an input device such as the remote control devices 1a and 1b to the first SoC 20a of the karaoke devices 2a and 2b (S101, S201). In the bidirectional communication server 40, a virtual room has been created in advance by the user, and the karaoke devices 2a and 2b, which are performing bidirectional communication, enter the same virtual room. Upon receiving the instruction to start bidirectional communication, the karaoke devices 2a and 2b establish a communication connection with the bidirectional communication server 40 (S102, S202) and begin bidirectional communication with each other (S103). The control of the bidirectional communication is performed by the first SoC 20a (first OS) of the karaoke devices 2a and 2b.

[0046] Karaoke devices 2a and 2b, which are communicating bidirectionally, can send and receive audio and video signals to and from each other. In the flowchart of Figure 3, process A, indicated by the dashed-dotted line, represents the playback of a single song. In this example, we describe a situation where a reserved song is played on karaoke device 2a, singing takes place on karaoke device 2a, and listening occurs on karaoke device 2b. Therefore, karaoke device 2a is the singing side, and karaoke device 2b is the listening side. It is also possible for karaoke device 2b to be the singing side and karaoke device 2a to be the listening side.

[0047] When a performance reservation is made for the karaoke device 2a on the singing side (S104), the second SoC20b of the karaoke device 2a on the singing side reads out song data (including song information and lyrics information). The reading of song data includes a song reading process that reads out song information, and a process that reads out lyrics information corresponding to the song information (corresponding to the "second lyrics reading process"). In this embodiment, the playback of song data in the karaoke device 2a on the singing side is performed by the second SoC20b (second OS). The second SoC20b plays back the read song information and outputs the song sound to the sound control unit 25.

[0048] The sound control unit 25 mixes the music sound output from the second SoC 20b with the singing voice input from microphones 43a and 43b and outputs it to the speaker 42. The second SoC 20b also forms a lyric video based on the read lyric information (corresponding to the "second lyric formation process") and outputs the formed lyric video in synchronization with the music sound (corresponding to the "second video signal output process").

[0049] Furthermore, the first SoC 20a transmits the played music sound and singing voice to the listening karaoke device 2b via the bidirectional communication server 40 (corresponding to "sound signal transmission processing"). Figure 4(A) shows the lyrics video 61a formed on the singing karaoke device 2a.

[0050] In this embodiment, the song information includes a guide melody, and the guide melody video 61b is formed based on the guide melody and the singing voice input to the microphone. Figure 4(B) shows the guide melody video 61b formed by the karaoke device 2a on the singing side. The formation of the guide melody video 61b in the karaoke device 2a on the singing side is performed by the second SoC20b (second OS). The guide melody video displays the pitch based on the guide melody and the pitch based on the singing voice in a comparative manner. The user singing can refer to the guide melody video 61b to check whether or not they are singing in tune.

[0051] Furthermore, in this embodiment, it is possible to confirm the appearance of users participating in karaoke using cameras 43 connected to karaoke devices 2a and 2b. Figure 5 shows the formed image (first OS) in the singing-side karaoke device of this embodiment. Figure 5(C) is the captured image 62 captured by the singing-side karaoke device 2a, and Figure 5(D) is the received images 63b and 63c captured by other karaoke devices 2b and 2c (2c is not shown) and received by the singing-side karaoke device. The output of these captured images 62 and received images 63b and 63c is performed by the first SoC 20a operating on the first OS. Specifically, the first SoC 20a combines the captured image received from the camera 43 via the image control unit 28 with the received images 63b and 63c and outputs them to the image control unit 28.

[0052] The video control unit 28 of the singing-side karaoke device 2a forms the image to be displayed on the monitor 41 by combining the images in Figures 4(A) and 4(B) formed by the second OS and the images in Figures 5(C) and 5(D) formed by the first OS. Figure 6 is a diagram showing the display image of the singing-side karaoke device 2a in this embodiment. In this embodiment, the left side of the screen displays an image in which the captured image 62 is superimposed with the lyrics image 61a and the guide melody image 61b, while the right side of the screen displays the received images 63b and 63c in separate frames.

[0053] The above describes the karaoke device 2a on the singing side; next, we will describe the karaoke device 2b on the listening side. Connecting multiple karaoke devices via communication to send and receive audio and video to each other has been proposed before. In that case, there are two possible formats for playing back song information: (1) Similar to this embodiment, the karaoke device on the singing side plays back song information and transmits the played back audio to the listening side. (2) A configuration in which the karaoke device on the listening side plays back song information in synchronization with the karaoke device on the singing side.

[0054] When considering the visual representation of lyrics, if song information is played, the lyrics information is attached to the song information. Therefore, in form (1), the visual representation of lyrics is transmitted from the karaoke machine on the singing side to the karaoke machine on the listening side. On the other hand, in form (2), since the song information is played on the karaoke machine on the listening side, the visual representation of lyrics is also formed by playing the lyrics information on the karaoke machine on the listening side.

[0055] In configuration (1), for example, even if there is a delay in the line, it is easy to synchronize the audio and video. On the other hand, in configuration (2), if there is a delay in the line, a discrepancy may occur between the audio and video. Therefore, in terms of synchronizing audio and video, configuration (1) makes it easier to achieve synchronization.

[0056] However, in configuration (1), the listening karaoke device receives the lyrics as video, and can only use the fixed video transmitted from the singing karaoke device; it cannot change the way the lyrics are displayed on the listening side. Also, if the number of simultaneously connected karaoke devices increases, the video quality may be reduced or decrease. In such cases, when transmitting lyrics as video, problems arise such as a decrease in resolution resulting in poorer image quality of the lyric video, or a decrease in frame rate resulting in less smooth rendering of the lyrics.

[0057] This embodiment takes the above matters into consideration and, in a configuration in which song information is played back by the singing karaoke device 2a and the song sound is transmitted to the listening karaoke device 2b, the listening karaoke device 2b independently plays back the lyrics information, thereby improving the synchronization of video and audio, as well as improving the quality of the lyrics video on the listening side and increasing the degree of freedom of the lyrics display format.

[0058] Furthermore, in the karaoke device 2 of this embodiment, during singing, the second SoC20b (second OS) plays back song information including lyrics, and the first SoC20a (first OS) performs communication control and video display. When this control method for singing is applied to the karaoke device 2 during listening, the second SoC20b (second OS) will play back the lyrics.

[0059] However, if lyric information is played back using the second SoC20b, the synchronization information needed for synchronization must be passed to the second OS via the communication control of the first OS, requiring additional control across the first and second OSs. This can lead to delays in lyric display and increased complexity in programming. Therefore, in this embodiment, the karaoke device 2b used for listening plays back lyric information using the first SoC20a to mitigate the aforementioned problems.

[0060] As shown in the flowchart in Figure 3, when the second SoC 20b on the singing side starts playing the song information (S105), it sends a playback start notification to the first SoC 20a which controls communication (S106). Upon receiving the playback start notification, the first SoC 20a sends a playback start notification to the karaoke device 2b (S107) and also sends the lyrics information of the song to be played (S108). Then, through bidirectional communication, it starts transmitting the video and audio (song sound, singing voice) to the karaoke device 2b on the listening side (S109).

[0061] The listening karaoke device 2b receives a playback start notification, lyric information, and audio and video transmitted from the singing karaoke device 2a via the first SoC 20a, which is responsible for communication control (corresponding to "audio signal reception processing" and "video signal reception processing"). The first SoC 20a reads the received lyric information (corresponding to "first lyric reading processing") and forms a lyric video based on the read lyric information (S203, corresponding to "first lyric formation processing"). Then, the first SoC 20a performs audio signal output processing to output the received audio (music sound and singing audio), and synthesizes the received video and the formed lyric video and displays them on the monitor 41 (corresponding to "first video signal output processing").

[0062] Figure 7(E) shows the captured image 64 taken by the listening karaoke device 2b, and Figure 7(F) shows the received images 66a and 66c taken by other karaoke devices 2a and 2c (2c is not shown) and received by the singing karaoke device. The received image 66a corresponds to the captured image 62 (Figure 5(C)) transmitted from the singing karaoke device 2a. The outputs (first video signal output processing) of these captured images 64 and received images 66a and 66c are formed by the first SoC 20a operating on the first OS.

[0063] As described above, the listening-side karaoke device 2b of this embodiment plays back the lyric information received from the karaoke device 2a. Figure 5(G) shows the lyric video 67 formed by the listening-side karaoke device 2b. The playback of the lyric information is performed by the first SoC 20a of the listening-side karaoke device 2b. Furthermore, the listening-side lyric video 67 of this embodiment differs from the lyric video 61a (Figure 4(A)) of the singing-side karaoke device 2a in terms of font type, size, and display format (the singing side displays one line, while the listening side displays two lines).

[0064] The listening karaoke device 2b forms the image to be displayed on the monitor 41b based on the images in Figures 7(E) to 7(G). Figure 8 shows the display image of the listening karaoke device 2a in this embodiment. In this embodiment, the received image 66a received from the singing karaoke device 2a is displayed in the first area in the upper left of the screen, and the received images 65a and captured images 64 of other participating users are displayed in small sizes at the bottom of the screen. In addition, the lyrics image 67 is displayed in a separate window in a second area in the upper right of the screen, which is different from the first area.

[0065] During music playback, the lyrics on the listening karaoke device 2b are updated by notification of performance progress information transmitted from the singing karaoke device 2a (S112). In the singing karaoke device 2a, the first SoC 20a, which is responsible for communication control, sends a request to the second SoC 20b, which plays the music information, to acquire the performance status (S110). Upon receiving the request to acquire the performance status, the second SoC 20b sends the current performance status response to the first SoC 20a (S111). The first SoC 20a then notifies the listening karaoke device 2b of the performance progress information (S112).

[0066] The listening karaoke device 2b receives notification of playback progress information via the first SoC 20a and performs lyric playback updates (lyric updates, color changes, etc.) (S204). During music playback, steps S110-S112 and S204 (process B) are repeatedly executed, causing the listening karaoke device 2b to sequentially perform lyric playback updates.

[0067] When the playback of song information (song playback, lyrics playback) is completed in the singing karaoke device 2a (S113), the second SoC 20b, which is responsible for playing the song information, sends a playback completion notification to the first SoC 20a (S114). Upon receiving the playback completion notification, the first SoC 20a sends a playback completion notification to the listening karaoke device 2b (S115). The listening karaoke device 2b, upon receiving the playback completion notification from the first SoC 20a, terminates the playback of the lyrics (S205).

[0068] As described above, by performing process A in Figure 3, it is possible for the singing karaoke device 2a and the listening karaoke device 2b to enjoy karaoke while viewing and listening to each other's video and audio. Note that the singing and listening roles of karaoke devices 2a and 2b can be reversed. In this case, the singing process is performed on karaoke device 2b, and the listening process is performed on karaoke device 2a.

[0069] To end karaoke and leave the virtual room, the user sends a bidirectional communication termination instruction to the karaoke machine 2 using an input means such as the remote control device 1. Figure 3 shows the process when leaving the virtual room in the karaoke machine 2a. When the karaoke machine 2a receives a bidirectional communication termination instruction from the remote control device 1a (S116), the karaoke machine 2a stops using the virtual room by disconnecting the communication connection with the bidirectional communication server 40 (S117). The same applies to the karaoke machine 2b, which can also stop using the virtual room upon receiving a bidirectional communication termination instruction from the remote control device 1b.

[0070] As described above, the karaoke device 2 of this embodiment is configured such that the karaoke device 2b receives the music and singing voice from the singing-side karaoke device 2a via the bidirectional communication server 40, and reads and plays the lyrics information on the listening-side karaoke device 2b. This makes it possible to improve the quality of the lyrics video and the flexibility of the lyrics display format on the listening-side karaoke device 2b.

[0071] [First variation] In the embodiment described above, when playback of a song begins, lyric information is transmitted from the singing karaoke device 2a to the listening karaoke device 2b. However, the reading of lyric information by the listening karaoke device 2b is not limited to this form. The singing karaoke device 2a may transmit song information or identification information indicating lyric information, and the listening karaoke device 2b may read the lyric information corresponding to the acquired identification information from the hard disk 29 or the management server 50.

[0072] In that case, if the lyrics are not stored on the hard disk 29 of the karaoke device 2b on the listening side, the management server 50 may be accessed to retrieve the lyrics information. Alternatively, if the lyrics are not stored on the hard disk 29 of the listening karaoke device 2b, a request for lyric information can be sent to the singing karaoke device 2a, which will then transmit the information.

[0073] [Second variation] As described in the above embodiment, by playing lyric information and lyric video in the singing karaoke device 2a and the listening karaoke device 2b respectively, it is possible to create lyric video with different display formats, as shown in Figures 4(A) and 7(G). Although the above embodiment does not mention changing the display format of the lyric video, it is also possible to make it possible to perform a setting process to set the display format of the lyric video during singing and listening, respectively.

[0074] Figure 9 shows the lyrics setting screen of another embodiment. The remote control device 1 can make various settings for the karaoke device 2, and in the second modified example, it is possible to set lyrics during bidirectional communication. The lyrics setting screen is provided with a singing lyrics setting field 111, a listening lyrics setting field 112, a back button 113, and a setting button 114. The user makes settings according to their preferences in these setting fields and confirms the settings by operating the setting button 114. The lyrics setting screen is also provided with a back button 113, which allows the user to return to the higher-level settings screen.

[0075] The song lyrics setting area 111 includes a font setting area 111a for setting the font type, a size setting area 111b for setting the size of the lyrics characters, a display color setting area 111c for setting the display color of the lyrics characters, and a display position setting area 111d for setting the display position of the lyrics characters. In the display position setting area 111d, it is possible to select a display mode that displays the lyrics in a separate window, as explained in Figure 8, as well as a "superimposition" mode in which the lyrics are displayed over other images such as the captured video 61, as explained in Figure 6.

[0076] On the other hand, the listening lyric setting area 112 includes a font setting area 112a for setting the font type, a size setting area 112b for setting the size of the lyric characters, a display color setting area 112c for setting the display color of the lyric characters, a display position setting area 112d for setting the display position of the lyric characters, and a display setting button 112e that can switch the display of lyrics ON / OFF. While the display of lyrics is mandatory when singing, when listening, it is possible to switch the display of lyrics (ON) or hide them (OFF) using the display setting button 112e.

[0077] In this second modified example, the specification of playing lyric information on the listening karaoke device 2b is utilized, making it possible to set the lyric display format according to the user's preference for both singing and listening.

[0078] Although various embodiments have been described above using karaoke device 2 as an example, the present invention also applies to karaoke programs executed in various information processing devices, including karaoke device 2, personal computers, game devices, and the like. [Explanation of symbols]

[0079] 1(1a, 1b): Remote control device 50: Management server 2(2a, 2b): Karaoke device 51: Memory unit 11: Touch panel monitor 61: Captured image 11a: Display unit 61a: Lyrics video 11b: Touch panel 61b: Guide melody video 12: Video RAM 62: Captured video 13: Video control unit 63b: Received video 14: Memory 63c: Received video 15: CPU 64: Captured video 16: Wireless LAN communication unit 65a: Received video 17: Control panel 66a: Received video 18: Operation processing unit 66c: Received video 20a: 1st SoC 67: Lyrics video 20b; 2nd SoC 111: Lyrics setting field when singing 21: Infrared communication unit 111a: Font setting field 22:LED 111b:Setting field 23: Operation section 111c: Display color setting field 25: Acoustic control unit 111d: Display position setting field 26: Microcontroller 112: Lyrics setting field during listening 27: Internal LAN hub 112a: Font settings field 28: Video Control Unit 112b: Settings Section 29: Hard Disk 112c: Display Color Settings 31: Video control unit 112d: Display position setting field 40: Bidirectional communication server 112e: Display settings button 41: Monitor 113: Back button 42: Speaker 114: Settings button 43: Camera 120: Router 43a: Microphone 121: Optical modem 43b: Microphone 130: Access point

Claims

1. Audio signal reception processing that receives music and singing voices from other karaoke machines via a server, The audio signal receiving process outputs the music sound and vocal voice received by the audio signal receiving process, and the audio signal output process outputs the music sound and vocal voice. The first lyric reading process reads out lyric information corresponding to the music sound received in the sound signal reception process, A first lyric formation process forms a lyric video based on the lyric information read in the lyric reading process, The process includes executing a first video signal output process, which outputs the lyric video formed by the lyric formation process in synchronization with the music sound output by the sound signal output process. Karaoke machine.

2. The system performs video signal reception processing to receive captured video images taken by an imaging device connected to another karaoke machine. The first video signal output process outputs the captured video received by the video signal reception process, in addition to the lyrics video. The karaoke apparatus according to claim 1.

3. The first video signal output process outputs the received captured video to a first area of ​​the display unit and outputs the lyrics video to a second area of ​​the display unit that is different from the first area. The karaoke apparatus according to claim 2.

4. Execute a settings process that allows you to configure the display format of the lyrics video. The first video signal output process forms the lyrics video based on the display format of the lyrics video set in the setting process. The karaoke apparatus according to claim 1.

5. The music retrieval process retrieves music information, The music playback process plays the music based on the music information read in the music reading process, Audio signal transmission processing that sends the played music and singing voice to other karaoke machines via a server, A second lyric reading process reads the lyric information corresponding to the song information read in the song reading process, A second lyric formation process forms a lyric video based on the lyric information read in the second lyric reading process, The process involves executing a second video signal output process, which outputs the lyric video formed in the second lyric formation process in synchronization with the music sound output in the music playback process. The karaoke apparatus according to claim 1.

6. The system performs video signal reception processing to receive captured video images taken by an imaging device connected to another karaoke machine. The second video signal output process outputs the captured video received by the video signal reception process, in addition to the lyrics video. The karaoke apparatus according to claim 5.

7. The first video output process and the second video output process output lyrics videos with different layouts. The karaoke apparatus according to claim 5.

8. The process is performed using the first OS and the second OS. The first lyric reading process and the first lyric formation process are executed on the first OS. The second lyric reading process and the second lyric formation process are executed by the second OS. The karaoke apparatus according to claim 5.

9. The audio signal reception processing and audio signal output processing are executed by the first OS. The karaoke apparatus according to claim 8.

10. The first video signal output processing is performed by the first OS. The karaoke apparatus according to claim 8.

11. The music retrieval and playback processes are executed by the second OS. The karaoke apparatus according to claim 5.

12. The formation of the lyrics video in the second video signal output processing is performed by the first OS. The karaoke apparatus according to claim 5.

13. The first lyric reading process reads lyric information received from another karaoke device. The second lyric retrieval process reads the lyric information stored in the memory unit of the karaoke device. A karaoke device according to claim 5.

14. The first lyric reading process reads the lyric information received from the server, The second lyric retrieval process reads the lyric information stored in the memory unit of the karaoke device. A karaoke device according to claim 5.

15. A karaoke program executed on an information processing device, Audio signal reception processing that receives music and singing voices from other karaoke machines via a server, The audio signal receiving process outputs the music sound and vocal voice received by the audio signal receiving process, and the audio signal output process outputs the music sound and vocal voice. The audio signal reception process reads out lyric information corresponding to the music sound received, A lyric formation process that forms a lyric video based on the lyric information read in the lyric reading process, This process executes a video signal output process that outputs the lyric video formed by the lyric formation process in synchronization with the music sound output by the sound signal output process. A program for karaoke.

Images