Karaoke device, karaoke playback method, and karaoke program

Abstract

To make it possible to excellently sing or continue to sing even if a reception state of a background video does not meet predetermined conditions in a Karaoke device which reproduces the background video on a streaming basis.SOLUTION: A Karaoke device is configured to reproduce a background video of Karaoke on a streaming basis, and performs video reception processing to receive background video data on a streaming basis. If a reception state of the background video data does not meet predetermined conditions in the video reception processing, a musical performance sound reproduction part is made to reproduce a musical performance sound based upon musical performance sound data included in music data stored in a storage part, and a video reproduction part is made to reproduce a video based upon alternative video data stored in the storage part.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a karaoke apparatus for singing, a karaoke reproducing method, and a karaoke program. [Background technology]

[0002] Karaoke machines that allow users to enjoy singing along with music often display background images to enhance the singing atmosphere, etc. By using background images that match the atmosphere of the music or that feature the original artist, it is possible to liven up the singing experience.

[0003] As an example of such a karaoke device that uses background video, Patent Document 1 describes a karaoke device that plays background video by streaming. In the karaoke device described in Patent Document 1, when a fragment of background video to be streamed is also used for a reserved song, the fragment is recorded, and if the fragment is recorded, the recorded one is used, and if it is not recorded, the fragment is streamed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2011-13291 A Summary of the Invention [Problem to be solved by the invention]

[0005] The karaoke device disclosed in Patent Document 1 utilizes streaming technology to obtain fragmented background video from a server and play it back when playing a performance. However, when streaming playback is performed with the karaoke device of Patent Document 1, if the data size of the background video is large or if the communication conditions between the server and the karaoke device are poor, there is a possibility that problems such as interruption of streaming playback or background video becoming choppy may occur. In some cases, it is possible that not only the playback of the background video but also the playback of the performance sound may stop.

[0006] If such a problem occurs, the background image and the musical performance sound may stop playing, causing the user to stop singing or to be unable to sing well.

[0007] The present invention has been made in consideration of the above circumstances, and aims to provide a karaoke device that reproduces background video by streaming, which allows a user to sing well or continue singing even when the reception status of the background video data does not satisfy a predetermined condition. [Means for solving the problem]

[0008] For this reason, the karaoke apparatus according to the present invention employs the following configuration. A karaoke device that reproduces karaoke background video by streaming, a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing song data including performance sound data and lyric data of karaoke songs and alternative image data; A control unit, the control unit executes a video reception process for receiving background video data in a streaming manner, and in the video reception process, executes a first output process if a reception status of the background video data satisfies a predetermined condition, and executes a second output process if the reception status of the background video data does not satisfy the predetermined condition; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, The second output process causes the performance sound reproducing unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video reproducing unit to reproduce a video based on alternative video data stored in the storage unit. 、 The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video.

[0009] Furthermore, in the karaoke apparatus according to the present invention, The second output process causes the video playback unit to play back a video based on lyric data included in the music data stored in the storage unit, superimposed on a video based on alternative video data stored in the storage unit.

[0010] The karaoke device according to the present invention is also teeth , A karaoke device that reproduces karaoke background video by streaming, a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing music data including performance sound data and lyrics data of karaoke music pieces; A control unit, the control unit executes a video reception process for receiving background video data in a streaming manner, and in the video reception process, executes a first output process if a reception status of the background video data satisfies a predetermined condition, and executes a second output process if the reception status of the background video data does not satisfy the predetermined condition; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, The second output process causes the performance sound reproducing unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video reproducing unit to reproduce a still image based on background video data received by streaming. 、 The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video.

[0011] Furthermore, in the karaoke apparatus according to the present invention, The second output process causes the video playback unit to play back a video based on lyric data included in the music data stored in the storage unit, superimposed on a still image based on background video data received by streaming.

[0012] Furthermore, in the karaoke apparatus according to the present invention, In the video reception process, if a certain size of data can be received within a certain time period, the control unit determines that the reception status of the background video data satisfies a specified condition and executes the first output process, and if a certain size of data cannot be received within the certain time period, the control unit determines that the reception status of the background video data does not satisfy the specified condition and executes the second output process.

[0014] Furthermore, in the karaoke apparatus according to the present invention, The playlist includes a plurality of pieces of position information of the background video data, The video reception process receives background video data in a streaming manner based on a plurality of pieces of position information of the background video data included in a playlist.

[0015] Furthermore, in the karaoke apparatus according to the present invention, The position information of the background video data included in the playlist specifies a playback section, The first output process causes the video playback unit to play back a video based on a playback section defined in position information of background video data.

[0018] Furthermore, in the karaoke apparatus according to the present invention, The alternative video data is associated with the music data.

[0019] Furthermore, in the karaoke apparatus according to the present invention, The alternative video data is a video that notifies the user of an error that prevents video playback.

[0020] The karaoke reproducing method according to the present invention further comprises: A karaoke playback method for playing back karaoke background video in a streaming manner in an information processing device, comprising: The information processing device includes: a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing music data including performance sound data and lyric data of karaoke music pieces, and alternative image data; A video reception process is executed to receive background video data by a streaming method, and in the video reception process, if a reception status of the background video data satisfies a predetermined condition, a first output process is executed, and if a reception status of the background video data does not satisfy the predetermined condition, a second output process is executed; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, The second output process causes the performance sound reproducing unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video reproducing unit to reproduce a video based on alternative video data stored in the storage unit.、 The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video.

[0021] The karaoke program according to the present invention further comprises: A karaoke program for playing back a karaoke background video in a streaming manner in an information processing device, comprising: The information processing device includes: a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing music data including performance sound data and lyric data of karaoke music pieces, and alternative image data; A video reception process is executed to receive background video data by a streaming method, and in the video reception process, if a reception status of the background video data satisfies a predetermined condition, a first output process is executed, and if a reception status of the background video data does not satisfy the predetermined condition, a second output process is executed; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, The second output process causes the performance sound reproducing unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video reproducing unit to reproduce a video based on alternative video data stored in the storage unit. 、 The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video.

[0022] The karaoke reproducing method according to the present invention further comprises: A karaoke playback method for playing back karaoke background video in a streaming manner in an information processing device, comprising: The information processing device includes: a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; Music data including performance sound data and lyrics data for karaoke music of A storage unit for storing the A video reception process is executed to receive background video data by a streaming method, and in the video reception process, if a reception status of the background video data satisfies a predetermined condition, a first output process is executed, and if a reception status of the background video data does not satisfy the predetermined condition, a second output process is executed; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, The second output process causes the performance sound reproducing unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video reproducing unit to reproduce a still image based on background video data received by streaming. 、 The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video.

[0023] The karaoke program according to the present invention further comprises: A karaoke program for playing back a karaoke background video in a streaming manner in an information processing device, comprising: The information processing device includes: a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; Music data including performance sound data and lyrics data for karaoke music of A storage unit for storing the A video reception process is executed to receive background video data by a streaming method, and in the video reception process, if a reception status of the background video data satisfies a predetermined condition, a first output process is executed, and if a reception status of the background video data does not satisfy the predetermined condition, a second output process is executed; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, The second output process causes the performance sound reproducing unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video reproducing unit to reproduce a still image based on background video data received by streaming. 、 The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video. Effect of the Invention

[0024] According to the karaoke device of the present invention, when background video data is received by streaming, if the reception status of the background video data does not satisfy a predetermined condition, the video playback based on the background video data received by streaming is not performed, and the playback of the performance sound based on the performance sound data included in the music data continues. With this configuration, even if the reception status of the background video does not satisfy the predetermined condition, it is possible to sing well or continue singing. [Brief description of the drawings]

[0025] [Figure 1] FIG. 1 shows a configuration of a karaoke system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a flow diagram showing the overall control process of the present embodiment. [Diagram 3] 1 is a flow diagram showing a performance process according to an embodiment of the present invention; [Figure 4] Flow diagram showing the lyrics display process of the present embodiment. [Diagram 5] FIG. 1 is a flow diagram showing a video playback process according to an embodiment of the present invention; [Figure 6] FIG. 1 is a flow diagram showing a loop playback process according to an embodiment of the present invention; [Figure 7] 1 is a flow diagram showing a time-specified playback process according to an embodiment of the present invention; [Figure 8] FIG. 1 is a diagram showing an example of a playback list used in the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] 1 is a diagram showing the configuration of a karaoke system according to this embodiment. The karaoke system according to this embodiment includes a karaoke device 2 (sometimes called a commander) and a remote control device 1. The karaoke device 2 and the remote control device 1 are communicatively connected to each other so as to form a network using a LAN 100 and an access point 130.

[0027] The karaoke device 2 installed in a store such as a karaoke booth includes an audio control unit 25 as a performance sound reproducing unit for playing music. The karaoke device 2 also includes an operation unit 21 that receives various inputs from a user. The karaoke device 2 also includes an operation processing unit 22 that interprets the inputs from the operation unit 21 and transmits them to the CPU 30. The karaoke device 2 also includes a hard disk 32 as a storage unit for storing various information. The karaoke device 2 also includes a LAN communication unit 24a as a communication means for connecting to the LAN 100 and joining the network. The karaoke device 2 of this embodiment also includes a wireless LAN communication unit 24b, and instead of a wired network connection using the LAN communication unit 24a, it is also possible to perform a wireless network connection using the wireless LAN communication unit 24b.

[0028] The karaoke device 2 also includes a video playback unit that displays a lyric video and a background video on the monitor 41. This video playback unit includes a video formation unit 29 that plays video based on video data, a video RAM 28 that temporarily stores the video to be played, and a video control unit 31 that performs functions such as superimposing the lyric video on the played video and applying video effects. In this embodiment, the background video is a video, and the other videos are either video or still images.

[0029] Furthermore, in this karaoke device 2, various information can be displayed on the touch panel monitor 33 in addition to the externally connected monitor 41. The touch panel monitor 33 is configured by superimposing a display section 35 for displaying an image input from the image control section 31 and a touch panel 34 for outputting a touch input position to the operation processing section 22. This touch panel monitor 33 is disposed on the front of the housing of the karaoke device 2, and functions as an input section similar to the operation section 21 of the karaoke device 2 or the touch panel monitor 11 of the remote control device 1. By selecting a song on the touch panel monitor 33, the user can directly reserve a song on the karaoke device 2 and perform various operations on the karaoke device 2.

[0030] Furthermore, the karaoke device 2 is provided with a control section including a CPU 30 for controlling each component in an integrated manner, and a memory 27 for temporarily storing information required for executing various programs.

[0031] With this configuration, the karaoke device 2 executes various processes, but the main functions of the karaoke device 2 are capable of executing song reservation process, song playback process, etc. The song reservation process is a process for designating and reserving a song based on a user's specification, and is executed in cooperation with the remote control device 1. Reservation information formed by the song selection process of the remote control device 1 is transmitted to the karaoke device 2. The karaoke device 2 registers the received reservation information in a reservation table in the memory 27. The song playback process is a process for playing back a reserved song, and is a process in which a performance process, a lyric display process, and a video playback process are executed synchronously.

[0032] The performance process is a process for causing the audio control unit 25 to perform a performance based on performance sound data included in the music data. The music performed by the audio control unit 25 is output from the speaker 42 together with the singing voice input from the microphones 43a and 43b. The lyrics display process is a process for providing singing assistance by displaying a lyrics video based on the lyrics data included in the music data on the monitor 41. A background video display process may be executed to superimpose a background video on the lyrics video displayed in the lyrics display process.

[0033] Meanwhile, the remote control device 1 is capable of executing a song selection process in which it searches for songs based on instructions from the user and transmits reservation information for the song instructed to be played to the karaoke device 2. The remote control device 1 is also capable of receiving various information from the karaoke device 2 or a server device 5 connected to the Internet and executing various processes. In this embodiment, the remote control device 1 is provided with an operation unit 17 and a touch panel monitor 11 as a user interface for receiving various instructions from the user. The touch panel monitor 11 is configured with a display unit 11a and a touch panel 11b, and is capable of displaying various information on the display unit 11a and receiving touch input from the user.

[0034] Furthermore, the remote control device 1 is equipped with a memory 14 as a storage unit for storing databases required for music selection processing, various programs, and various information generated with program execution, and a remote control side control unit for controlling these components in an integrated manner. The remote control side control unit includes a CPU 15, an image control unit 13 that forms an image to be displayed on the touch panel monitor 11, a video RAM 12 that temporarily stores image data of the image to be displayed, and an operation processing unit 18 that interprets input from the touch panel monitor 11 or the operation unit 17 and transmits it to the CPU 15.

[0035] The remote control device 1 is connected to the network formed by the LAN 100 by being wirelessly connected to the access point 130 by the wireless LAN communication unit 16. Each remote control device 1 is pre-associated with a specific karaoke device 2. Various commands output from the remote control device 1 are received by the associated karaoke device 2.

[0036] With such a configuration of the remote control device 1, various inputs from the user can be received from the touch panel monitor 11 or the operation unit 17, and various information can be provided by displaying on the touch panel monitor 11, making it possible to perform various processes such as song selection processing which transmits reservation information to be output to the karaoke device 2.

[0037] Various processes executed in the karaoke device 2 will be described below. Fig. 2 is a flow chart showing the overall control process executed in the karaoke device 2. In the karaoke device 2, songs are reserved based on operations on an input unit such as the remote control device 1 or the touch panel monitor 33. When a song is reserved, reservation information including a song ID for identifying the song data and the user ID of the user who made the reservation is registered in a reservation table stored and managed in the memory 27 of the karaoke device 2.

[0038] In the overall control process, the reservation table is checked (S101), and if a song is not being played and the next song is registered in the reservation table (S102: Yes), song data is prepared (S103). The song data is prepared by referencing the song ID of the song to be played next that is registered in the reservation table, and reading the song data corresponding to the song ID into memory 27, etc.

[0039] In this embodiment, a playlist corresponding to the music is provided, and when music data is read, the playlist corresponding to the music data is also read (S104). The playlist is a list for streaming background video, and describes location information required for streaming playback, such as a uniform resource locator (URL). In this embodiment, two types of playlists are provided: a loop type shown in FIG. 8(A) and a time-specified type shown in FIG. 8(B).

[0040] The karaoke device 2 starts a performance process, a lyrics display process, and a video playback process based on the read music data and various data such as the playback list (S105).

[0041] 3 is a flow diagram showing the performance processing of this embodiment. The performance processing is processing for causing the audio control unit 25 to reproduce performance sound data included in the music data. When the performance processing is started in the overall control processing (S105), in the performance processing, a certain period of performance sound data is transmitted to the audio control unit 25 (S120) and the sound reproduction position is advanced (S121). Then, sound reproduction position data indicating the sound reproduction position is transmitted to the lyrics display processing and the video reproduction processing (S122). The performance sound data transmitted to the audio control unit 25 causes the performance sound of the music to be reproduced by the audio control unit 25 and output as sound from the speaker 42.

[0042] By repeatedly executing the processes of S120 to S122, the performance sound based on the performance sound data is reproduced. When the performance sound data reaches the end of the music piece (S123: Yes), the performance process is terminated by transmitting the end of the performance process to the overall control process and the video playback process (S124).

[0043] 4 is a flow diagram showing the lyrics display process of this embodiment. The lyrics display process is a process in which a lyrics video based on lyrics data included in music data is played back by the video playback unit. When the lyrics display process is started in the overall control process (S105), the lyrics display process graphically develops the lyrics data in the video RAM 28 (S140). In order to display lyrics in sync with the performance, the video formation unit 29 is used to display the graphically developed lyrics data on the monitor 41 (S142) based on the sound playback position data received from the performance process (S141: YES). Specifically, lyrics in sync with the performance are displayed by passing the lyrics data corresponding to the sound playback position data from the graphically developed lyrics data to the video formation unit 29.

[0044] The process of S141 to S143 is repeatedly executed to display the lyrics video based on the lyrics data. When the lyrics data reaches the end of the song (S143: Yes), the end of the lyrics display process is sent to the overall control process (S144), and the lyrics display process ends.

[0045] FIG. 5 is a flow diagram showing the video playback process of this embodiment. In the video playback process of this embodiment, a server device 5 connected to the Internet is accessed, and the background video is played back in streaming format. In the case of streaming, video playback may be interrupted or stopped depending on the line conditions. In such a case, the singer may be confused by the abnormality of the background video, and may find it difficult to sing well or to continue singing. In addition, depending on the karaoke system, the performance may also stop when the background video stops. Such a stop in performance is a fatal problem for the karaoke device 2, which is intended for the enjoyment of singing.

[0046] The video playback process of this embodiment takes into consideration playback of background video in such a streaming format, and enables the user to sing or continue singing satisfactorily even if the reception conditions for the background video data do not satisfy specified conditions due to deterioration of the line conditions, etc.

[0047] Fig. 8 is a diagram showing an example of a playlist used in this embodiment. As explained in the flow diagram of the overall control process in Fig. 2, in this embodiment, background video is played back using a playlist corresponding to music. There are two types of playlists, and a playlist corresponding to music is used.

[0048] FIG. 8(A) shows an example of a loop type playlist. In a loop type playlist, "loop type" is described in the playlist type. Also, three URLs (URL1 to URL3) are described as the video list to be used. Streaming playback is performed by accessing the described URLs in order. Note that when playback of the video described in URL3 ends, loop playback is performed by returning to the first URL1 and playing it again.

[0049] FIG. 8B shows an example of a time-specified playlist. In the time-specified playlist, "time-specified" is written in the playlist type. In the time-specified video list, a URL that specifies the audio playback position is written. In the example of FIG. 8B, multiple URLs (URL4-7) are specified, and at the beginning of each URL, times t1, t2, and t3 separated by commas (,) are specified (for example, in URL4, t1=0, t2=20, and t3=30). These times indicate the audio playback position and playback section, and indicate that when audio playback position t1 arrives counting from the start, the section from t2 to t3 of the video data indicated by the URL is to be played.

[0050] In the case of FIG. 8(B), from the start (0 seconds), the first described URL4 is played from 20 to 30 seconds (10 seconds), from 10 seconds, the second described URL5 is played from 10 to 25 seconds (15 seconds), and from 25 seconds, the third described URL6 is played from 70 to 75 seconds (5 seconds). Thereafter, the streaming playback is continued using the time-specified video list, so that the background video is played in synchronization with the performance. In this embodiment, the playback section (t2 to t3) of the video data played in the streaming method is specified in this way, so that the background video can be played in accordance with the atmosphere and progress of the music. It is also possible to flexibly create a variety of background videos for a large number of songs.

[0051] In addition, in the time-specified playlist, a still image list is specified. The still images used in this embodiment are stored in advance in the hard disk 32 of the karaoke device 2, and are displayed in place of the background image when the reception status of the streaming background image data does not satisfy a predetermined condition. In the still image list, file paths (Pic1 to 4) of the still images are described. At the beginning of each file path, times t4 and t5 separated by a comma (,) are specified (for example, in Pic1, t4=0, t5=10). This time indicates the sound playback position, and indicates that when the sound playback position t4 is reached counting from the start, the still image indicated by the file path is played for t5 seconds.

[0052] Now, the video playback process using such a playlist will be described with reference to Figs. 5 to 7. In Figs. 6 and 7, the alphabets A to C enclosed in circles indicate transitions to the same alphabets A to C. In the video playback process, the playlist read out corresponding to the music to be played is referenced to determine its type (S201). If the type of the playlist is the loop type (S201: loop type), the loop playback process (S210) shown in Fig. 6 is executed. On the other hand, if the type of the playlist is the time designation type (S201: time designation type), the time designation playback process (S210) shown in Fig. 7 is executed.

[0053] First, the loop playback process (S210) will be described. FIG. 6 is a flow diagram showing the loop playback process (S210). In the case of the loop type, the playback list in FIG. 8(A) is referenced, and URL1, URL2, and URL3 are accessed in that order to execute video playback by streaming. Therefore, the target of data to be acquired by streaming is the URL at the top of the video list (URL1), and the data acquisition position is set to the top of the video (S211). Then, by receiving sound playback position data from the performance process, next, reception of a certain size of data is started from the data acquisition position of the URL of the acquired data (S212).

[0054] If a certain amount of data is received within a certain time (S213: Yes), that is, if the reception status of the background video data satisfies a predetermined condition, the acquired data is decoded and video playback is performed (S219). If a performance end notification is not received from the performance process (S220: No) and the end of the video being played has not been reached (S221: No), the next position for the URL from which data is currently being acquired is set as the data acquisition position (S225), and a certain amount of data is received (S212), thereby continuing video playback by streaming for the same URL.

[0055] Also, if the end of the video being played is reached (S221: Yes), first it is determined whether the end of the video list (URL3 in the case of FIG. 8(A)) has been reached (S222). If the end of the video list has been reached (S222: Yes), the target of the acquired data is set to the first URL of the video list (URL1 in the case of FIG. 8(A)), the data acquisition position is set to the start of the video (S224), and video playback by streaming is started for the first URL in the video list. If the end of the video list has not been reached (S222: No), the target of the acquired data is set to the next URL in the video list, the data acquisition position is set to the start of the video (S223), and video playback by streaming is started for the next URL in the video list.

[0056] It should be noted that if a performance end notification is received from the performance processing during video playback (S220: Yes), the video playback is stopped (S226), and the end of the video playback processing is sent to the overall control processing (S227), thereby terminating the loop playback processing.

[0057] On the other hand, if the certain size of data cannot be received within the certain time (S213: No), that is, if the reception status of the background video data does not satisfy the predetermined condition, the video playback is stopped (S214) and a dedicated still image is displayed (S215). The dedicated still image is stored in advance in the hard disk 32 of the karaoke device 2, and is read by the CPU 30 and played by the video forming unit 29 to be displayed on the monitor 41. The dedicated still image may display an error message indicating that video playback is not possible due to an unstable communication situation.

[0058] After starting to display the dedicated still image, the loop playback process monitors the communication state. If no performance end notification is received from the performance process (S216: No) and the communication state does not improve (S217: No), the dedicated still image continues to be displayed. If the communication state improves during the communication state monitoring (S217: Yes), the dedicated still image is erased (S218) and playback of video using the streaming method is resumed. Note that if a performance end notification is received from the performance process while the dedicated still image is being displayed (S216: Yes), playback of the dedicated still image is stopped (S226), and an end of the video playback process is sent to the overall control process (S227), and the loop playback process is terminated.

[0059] Next, the time-specified playback process (S250) will be described. FIG. 7 is a flow diagram showing the time-specified playback process (S250). When the playback list is of the time-specified type, the time-specified URLs (URLs 4 to 7) in the playback list of FIG. 8(B) are referenced, and video playback is performed according to the sound playback position data. Therefore, video playback is performed in synchronization with the performance.

[0060] When sound playback position data is received from the performance process (S251: Yes), it is determined whether a video is being played (S252). If a video is being played (S252: Yes), a certain size of data is received from the next decoded position for the video of the URL currently being played (S254). On the other hand, if a video is not being played (S252: No), the playback target URL and its data acquisition position are calculated based on the sound playback position data received from the performance process and the time-specified video list in the playback list of Fig. 8 (B), and a certain size of data is received (S253).

[0061] If a certain size of data is received within a certain time (S255: Yes), that is, if the reception status of the background video data satisfies a predetermined condition, the acquired data is decoded and video playback is performed (S262). Note that in this embodiment, in consideration of the possibility that a deviation in the video playback position may occur when displaying a still image, etc., a video playback speed adjustment is performed (S263). For example, if the video playback position is behind the sound playback position data, the video playback speed is increased, and if the video playback position is ahead of the video sound playback position data, the video playback speed is decreased, thereby making it possible to reduce the deviation between the performance and the video playback.

[0062] During video playback, if a performance end notification is received from the performance processing (S264: Yes), the video playback is stopped (S268), and an end of the video playback processing is sent to the overall control processing (S269), and the time-specified playback processing is terminated.

[0063] During video playback, if no performance end notification is received from the performance process (S264: No), and the end of the designated section of the video being played is reached (S265: Yes), for example, in the time-specified video list of Fig. 8 (B), when the designated section of URL4 from 20 to 30 seconds is reached at 30 seconds, if the end of the time-specified video list has not been reached (S266: No), video playback is stopped (S267) and the process returns to the beginning of the time-specified playback process, and since the video is not being played (S252: No), the next URL in the time-specified video list is referenced and a certain size of data for the designated section is started to be received (S253). On the other hand, if the end of the designated section of the video being played has not been reached (S265: No), the process returns to the beginning of the time-specified playback process, and since the video is being played (S252: Yes), the process starts to receive a certain size of data from the next decoded position (S254).

[0064] During video playback, if a performance end notification is received from the performance processing (S264: Yes), or if the end of the time-specified video list is reached (S266: Yes), the video playback is stopped (S268), and an end of the video playback processing is sent to the overall control processing (S269), and the time-specified playback processing is terminated.

[0065] On the other hand, if the certain size of data cannot be received within a certain time (S255: No), that is, if the reception status of the background video data does not satisfy a predetermined condition, the video playback is stopped (S256), and a still image corresponding to the sound playback position data is specified and displayed from the still image list in the playback list (S257). As in the case of the loop playback process, the communication state is monitored during the playback of the still image. If the communication state is improved in the monitoring of the communication state (S260: Yes), the still image is erased (S261) and the process returns to the beginning of the time-specified playback process. If sound playback position data is received from the performance process during the period until the communication state is improved (S258: Yes), the still image list is referenced and the still image corresponding to the sound playback position data is displayed. Also, if a performance end notification is received from the performance process (S259: Yes), the playback of the still image is stopped (S268), and the end of the video playback process is transmitted to the overall control process (S269), and the time-specified playback process is ended.

[0066] In this way, in the time-specified playback process, if the reception status of the background video data does not satisfy a predetermined condition, still images are displayed based on the still image list in the playback list. Therefore, it is possible to display still images that correspond to the atmosphere of the music. In addition, while still images are being displayed, it is possible to change the still images based on the sound playback position data, and it is also possible to display still images that correspond to the playback timing of the music.

[0067] The video playback process of the karaoke device 2 according to this embodiment has been explained above. With the video playback process of this embodiment, even if the reception conditions of the background video data do not satisfy the predetermined conditions due to a deterioration in the line conditions or the like, it is possible to sing well or continue singing.

[0068] [First Modification] Next, various modified examples of this embodiment will be described. In the above-mentioned embodiment, still image playback is performed under the condition that a certain size of data cannot be received within a certain time. Such a condition can be implemented in various forms. For example, various forms can be implemented, such as monitoring the communication speed with the server device 5 and setting the condition that the communication speed falls below a threshold, or setting the condition that data reception is interrupted for a certain time (0 seconds or more).

[0069] [Second modified example] In the above-described embodiment, instead of playing back moving pictures by streaming, substitute video data such as still images (or dedicated still images) are played back. The substitute video data may be stored in a storage unit such as the hard disk 32 of the karaoke device 2, and may be not only still images but also moving pictures. The still images may be clipped still images of the background image that were displayed just before the playback of the moving picture of the background image was stopped.

[0070] [Third Modification] Various conditions can be adopted for determining whether the communication state has improved (S217, S260) in the above-described embodiment. For example, the communication speed with the server device 5 is monitored, and the condition is that the communication speed is equal to or higher than a certain level. Alternatively, the condition is that a ping response is received from the server device 5, or that the ping response is received within a predetermined time. Alternatively, various conditions can be adopted, such as sending and receiving data prepared in advance specifically for monitoring the communication state, and completing the sending and receiving normally.

[0071] [Fourth Modification] In the playlist in the above embodiment, a URL is used as location information required for streaming playback of the background video. The location information is not limited to a URL, and may be, for example, a URI (Uniform Resource Identifier) ​​or the like that indicates the location of the video data in the server device 5 on the Internet.

[0072] It should be noted that the present invention is not limited to the karaoke device 2. For example, the karaoke device 2, or a karaoke program that realizes the same functions as the karaoke device 2 by being executed on various information processing devices such as a smartphone, or a karaoke playback method also fall within the scope of the present invention. [Explanation of symbols]

[0073] 1: Remote control device 24b: Wireless LAN communication unit 2: Karaoke device 25: Sound control unit 5: Server equipment 27: Memory 11: Touch panel monitor 28: Video RAM 11a: Display unit 29: Image forming unit 11b: Touch panel 30: CPU 12: Video RAM 31: Video control section 13: Video control unit 32: Hard disk 14: Memory 33: Touch panel monitor 15: CPU 34: Touch panel 16:Wireless LAN communication section 35:Display section 17: Operation unit 41: Monitor 18: Operation processing unit 42: Speaker 21: Operation unit 43a, 43b: Microphone 22: Operation processing unit 130: Access point 24a:LAN communication department

Claims

1. A karaoke device that reproduces karaoke background video by streaming, a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing song data including performance sound data and lyric data of karaoke songs and alternative image data; A control unit, the control unit executes a video reception process for receiving background video data by a streaming method, and in the video reception process, executes a first output process when a reception status of the background video data satisfies a predetermined condition, and executes a second output process when the reception status of the background video data does not satisfy the predetermined condition; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, the second output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video replay unit to reproduce a video based on the alternative video data stored in the storage unit, The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video. Karaoke equipment.

2. The second output process causes the video playback unit to play back a video based on lyrics data included in the music data stored in the storage unit, superimposed on a video based on alternative video data stored in the storage unit.

2. The karaoke apparatus according to claim 1.

3. A karaoke device that reproduces karaoke background video by streaming, a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing music data including performance sound data and lyrics data of karaoke music pieces; A control unit, the control unit executes a video reception process for receiving background video data by a streaming method, and in the video reception process, executes a first output process when a reception status of the background video data satisfies a predetermined condition, and executes a second output process when the reception status of the background video data does not satisfy the predetermined condition; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, the second output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video replay unit to reproduce a still image based on background video data received by streaming; The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video. Karaoke equipment.

4. The second output process causes the video playback unit to play back a video based on lyric data included in the music data stored in the storage unit, superimposed on a still image based on background video data received by streaming.

4. The karaoke apparatus according to claim 3.

5. When the control unit is able to receive data of a certain size within a certain time in the video reception process, it determines that the reception status of the background video data satisfies a predetermined condition and executes the first output process, and when the control unit is unable to receive data of a certain size within the certain time, it determines that the reception status of the background video data does not satisfy the predetermined condition and executes the second output process.

4. The karaoke apparatus according to claim 1 or 3.

6. The playlist includes a plurality of pieces of position information of the background video data, The video reception process receives background video data in a streaming manner based on a plurality of pieces of position information of the background video data included in the playlist.

4. The karaoke apparatus according to claim 1 or 3.

7. The position information of the background video data included in the playlist specifies a playback section, The first output process causes the video playback unit to play back a video based on a playback section defined in position information of the background video data.

4. The karaoke apparatus according to claim 1 or 3.

8. The alternative video data is associated with the music data.

2. The karaoke apparatus according to claim 1.

9. The alternative video data is a video that notifies the user of an error that prevents video playback.

2. The karaoke apparatus according to claim 1.

10. A karaoke playback method for playing back karaoke background video in a streaming manner in an information processing device, comprising: The information processing device includes: a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing music data including performance sound data and lyric data of karaoke music pieces, and alternative image data; A video reception process is executed to receive background video data by a streaming method, and in the video reception process, if a reception status of the background video data satisfies a predetermined condition, a first output process is executed, and if a reception status of the background video data does not satisfy the predetermined condition, a second output process is executed; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, the second output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video replay unit to reproduce a video based on the alternative video data stored in the storage unit, The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video. How to play karaoke.

11. A karaoke program for playing back a karaoke background video in a streaming manner in an information processing device, comprising: The information processing device includes: a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing music data including performance sound data and lyric data of karaoke music pieces, and alternative image data; A video reception process is executed to receive background video data by a streaming method, and in the video reception process, if a reception status of the background video data satisfies a predetermined condition, a first output process is executed, and if a reception status of the background video data does not satisfy the predetermined condition, a second output process is executed; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, the second output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video replay unit to reproduce a video based on the alternative video data stored in the storage unit, The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video. Karaoke program.

12. A karaoke playback method for playing back karaoke background video in a streaming manner in an information processing device, comprising: The information processing device includes: a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing music data including performance sound data and lyrics data of karaoke music pieces; A video reception process is executed to receive background video data by a streaming method, and in the video reception process, if a reception status of the background video data satisfies a predetermined condition, a first output process is executed, and if a reception status of the background video data does not satisfy the predetermined condition, a second output process is executed; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, the second output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video replay unit to reproduce a still image based on background video data received by streaming; The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video. How to play karaoke.

13. A karaoke program for playing back a karaoke background video in a streaming manner in an information processing device, comprising: The information processing device includes: a performance sound reproducing unit that reproduces a performance sound; a video playback unit that plays back video; a storage unit for storing music data including performance sound data and lyrics data of karaoke music pieces; A video reception process is executed to receive background video data by a streaming method, and in the video reception process, if a reception status of the background video data satisfies a predetermined condition, a first output process is executed, and if a reception status of the background video data does not satisfy the predetermined condition, a second output process is executed; the first output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music data stored in the storage unit, and causes the video replay unit to superimpose a video based on lyric data included in the music data stored in the storage unit and a video based on background video data received by streaming, and reproduces the superimposed video, the second output process causes the performance sound replay unit to reproduce a performance sound based on performance sound data included in the music piece data stored in the storage unit, and causes the video replay unit to reproduce a still image based on background video data received by streaming; The music data is associated with a playlist of background video data received by streaming, The playlist includes location information of background video data received in a streaming manner, The video reception process receives background video data in a streaming manner based on position information of the background video data included in the playlist; The position information of the background video data included in the playlist specifies the playback timing of the background video relative to the performance, The first output process causes the video playback unit to play back the video based on a playback timing defined in position information of the background video data, and adjusts the playback speed of the video. Karaoke program.

Images