Karaoke device

Abstract

To provide a Karaoke device in which a background video having less sense of incongruity can be displayed.SOLUTION: A Karaoke device includes: a video storage unit that stores video identification information, a video keyword, video data, a reproduction speed, and video tempo information in association with each other; an extraction unit that extracts the video identification information and the video tempo information; a setting unit that sets a reproduction magnification for reproducing one video; a generation unit that generates a background video reproduction table; and a reproduction processing unit that refers to the background video reproduction table according to a Karaoke play of a musical piece, reads out the video data and the reproduction speed from the video storage unit in the numerical order of multiple videos, adjusts the reproduction speed with the set reproduction magnification, and reproduces the video based on the video data at the adjusted reproduction speed according to a reproduction start time of the video included in script data of the musical piece.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a karaoke device. [Background technology]

[0002] The karaoke machine can display a background image on the monitor in time with the karaoke performance. Here, the background image for the music may be a combination of multiple images.

[0003] For example, Patent Document 1 discloses a technology in which script information describing the storage locations of raw video data to be used in each of three performance sections consisting of an introduction, a middle section, and an end section is associated with each karaoke song, and a video playback means displays video played from the first, second, and third storage locations in each of the three performance sections according to the script information. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 11-052962 Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, some background images have a visually recognizable tempo, such as an image of an audience waving their hands at a constant tempo (such a tempo that can be visually recognized from a background image is sometimes referred to as "image tempo"). On the other hand, the tempo of a karaoke performance (hereinafter sometimes referred to as "performance tempo") varies from song to song. Therefore, when a background image is displayed on a monitor in time with a karaoke performance, if the performance tempo and the image tempo are different, the singer will feel uncomfortable when viewing the background image.

[0006] An object of the present invention is to provide a karaoke device that can display a background image that does not create a sense of incongruity. [Means for solving the problem]

[0007] The invention for achieving the above object includes a video storage unit that stores, in association with each other, video identification information for identifying a plurality of videos that constitute a background video to be displayed on a display means in sync with a karaoke performance, a video keyword that indicates the image of the video, video data for displaying the video corresponding to the video identification information, a playback speed for playing the video, and video tempo information that indicates the tempo value if the tempo can be recognized from the video and indicates a value of 0 if the tempo cannot be recognized from the video; an extraction unit that extracts, from the video storage unit, video identification information and video tempo information that are associated with a video keyword that matches a video keyword associated with a number of a video included in script data of a song to be karaoke performed; and, when the tempo value indicated by the extracted video tempo information is 0, a playback unit that extracts, from the video storage unit, video identification information and video tempo information that are associated with a video keyword that matches a video keyword associated with a number of a video included in script data of a song to be karaoke performed. a setting unit that sets a magnification to 1, and if the tempo value indicated by the extracted video tempo information is not 0, sets the value obtained by dividing the tempo value indicated by the performance tempo information of the song by the tempo value indicated by the video tempo information as the playback magnification when playing back the one video; a generation unit that generates a background video playback table by associating the extracted video identification information and the set playback magnification with the numerical order of multiple videos included in the script data of the song; and a playback processing unit that refers to the background video playback table in accordance with the karaoke performance of the song, reads out video data and playback speeds from the video storage unit in the numerical order of the multiple videos, adjusts the playback speed by the set playback magnification, and plays back videos based on the video data at the adjusted playback speed in accordance with the playback start time of the videos included in the script data of the song. Other features of the present invention will become apparent from the following description and drawings. [Effects of the Invention]

[0008] According to the present invention, a background image that does not create a sense of incongruity can be displayed. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram showing a karaoke device according to an embodiment; [Figure 2] 1 is a diagram showing a karaoke machine main body according to an embodiment; [Figure 3] FIG. 2 is a diagram showing script data according to the embodiment. [Figure 4] 10 is an example of information stored in a video storage unit according to the embodiment. [Figure 5] 4 is a flowchart showing the process of the karaoke device according to the embodiment. [Figure 6] 10 is an example of a background image playback table according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] <Embodiment> A karaoke device K according to an embodiment will be described with reference to FIGS.

[0011] ==Karaoke Equipment== The karaoke device K is a device for performing karaoke music and for singers to sing karaoke. As shown in Fig. 1, the karaoke device K includes a karaoke main unit 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

[0012] The karaoke machine main unit 10 performs various controls related to karaoke performance and singing, such as controlling the performance of the selected song, controlling the display of lyrics and background images, and processing audio signals input through the microphone 40. The speaker 20 is configured to emit sound based on the sound emission signal from the karaoke machine main unit 10. The display device 30 is configured to display videos and images on a screen based on the signal from the karaoke machine main unit 10. The display device 30 is an example of a "display means." The microphone 40 is configured to convert the singer's singing voice into an analog audio signal and input it to the karaoke machine main unit 10. The remote control device 50 is a device for performing various operations on the karaoke machine main unit 10.

[0013] 2, the karaoke machine 10 according to this embodiment includes a storage unit 10a, a communication unit 10b, an input unit 10c, a performance unit 10d, and a control unit 10e. Each component is connected to a bus B via an interface (not shown).

[0014] [Storage means] The storage means 10a is a large-capacity storage device that stores various types of data. The storage means 10a stores music data. The music data is assigned music identification information. The music identification information is information unique to each music piece, such as a music ID for identifying the music piece. The music data includes accompaniment data, reference data, script data, etc.

[0015] The accompaniment data is data that is the source of the karaoke performance sound. The accompaniment data includes performance tempo information that indicates the tempo of the karaoke performance (i.e., the performance tempo). A predetermined value (e.g., 100 BPM, 120 BPM) is set for the performance tempo for each song. The reference data is data used as a standard when scoring the singer's karaoke singing. The script data is data related to a background image to be displayed on the display device 30 or the like during the karaoke performance. In this embodiment, the background image is made up of multiple images.

[0016] Specifically, the script data includes video numbers, video playback start times, and video keywords. The video numbers indicate the order in which multiple videos are played. The video playback start times are the times at which video playback starts and are indicated by the elapsed time from the start of the karaoke performance. The video keywords are words that indicate the image of the video, such as "the sea" or "audience waving."

[0017] FIG. 3 is an example of script data for song X. The background video for song X consists of four videos. Each video is assigned a number from "1" to "4" according to the order in which it is played. Number "1" is associated with the playback start time "0 s" and the video keyword "ocean," number "2" is associated with the playback start time "120 s" and the video keyword "sand beach," number "3" is associated with the playback start time "180 s" and the video keyword "waving audience," and number "4" is associated with the playback start time "240 s" and the video keyword "sunset."

[0018] The storage means 10a also stores lyrics caption data for displaying lyrics corresponding to each piece of music on the display device 30 or the like, and song attribute information (information about the song such as the singer's name, lyricist / composer name, genre, etc.).

[0019] In this embodiment, a part of the storage area of the storage means 10a functions as a video storage section 11a.

[0020] (Video storage section) The video storage unit 11a stores video identification information, video keywords, video data, playback speed, and video tempo information in association with each other.

[0021] The video identification information is information for identifying multiple videos that make up the background video displayed on the display means in sync with the karaoke performance. The video identification information is information unique to each video, such as a video ID for identifying the video. As mentioned above, the video keyword is a word that indicates the image of the video. Note that the same video keyword may be set for different videos. The video data is data for displaying the video corresponding to the video identification information on the display means. The video data stores videos ranging in length from several tens of seconds to several minutes in a predetermined data format. The playback speed indicates the speed value when the video is played back. The playback speed is expressed, for example, as a frame rate (fps). The video tempo information is information indicating the tempo that can be visually recognized from the video (i.e., the video tempo). Specifically, if the tempo can be recognized from the video, the video tempo information indicates the value of the tempo. On the other hand, if the tempo cannot be recognized from the video, the video tempo information indicates a value of 0. The video tempo value can be expressed in BPM, similar to the performance tempo.

[0022] 4 shows an example of information stored in the video storage unit 11a. For example, video ID ***m1 is associated with a video keyword "ocean," video data m1, a playback speed of "30 fps," and video tempo information of "0 BPM." On the other hand, video ID ***m3 is associated with a video keyword "waving audience," video data m3, a playback speed of "30 fps," and video tempo information of "50 BPM."

[0023] The video keyword for video data m1 is "ocean." That is, video based on video data m1 is video that shows the ocean. Video that shows a sea-like scene is generally video with little movement. In other words, it is video from which the tempo cannot be visually recognized. On the other hand, the video keyword for video data m3 is "spectators waving." That is, video based on video data m3 is video that shows spectators waving. Such video is generally video with movement. In other words, it is video from which the tempo can be visually recognized.

[0024] The video storage unit 11a may be configured as multiple storage units, such as a first storage unit that stores video identification information, video keywords, and video tempo information in association with each other, and a second storage unit that stores video identification information, video data, and playback speed in association with each other.

[0025] [Communication means / input means] The communication means 10b provides an interface for communicating with the remote control device 50. The input means 10c is configured to allow the singer to input instructions. The input means 10c is a button or the like provided on the karaoke main unit 10. Alternatively, the remote control device 50 may function as the input means 10c.

[0026] [Means of performance] Based on the control of the control means 10e, the performance means 10d performs karaoke performance of music pieces and processes signals based on singing voices input through the microphone 40. The performance means 10d includes a sound source, a mixer, an amplifier, etc. (none of which are shown).

[0027] [Control means] The control means 10e performs various controls in the karaoke device K. The control means 10e includes a CPU and a memory (neither of which is shown). The CPU executes programs stored in the memory to realize various functions.

[0028] In this embodiment, the CPU executes a program stored in the memory, causing the control means 10e to function as an extraction unit 100, a setting unit 200, a generation unit 300, and a playback processing unit 400 (see FIG. 2).

[0029] (Extraction part) The extraction unit 100 extracts from the video storage unit 11a video identification information and video tempo information associated with a video keyword that matches a video keyword associated with the number of a video included in the script data of the song to be karaoke performed.

[0030] A singer who uses the karaoke device K to sing karaoke selects a song he or she wishes to sing by operating the remote control device 50. The remote control device 50 registers the song identification information of the selected song in a reservation queue.

[0031] The extraction unit 100 checks the script data included in the music data of the selected music piece and reads out video keywords in the order of video numbers. The extraction unit 100 refers to the video storage unit 11a and searches for video keywords that match the read video keywords. The extraction unit 100 extracts video IDs and video tempo information associated with the matching video keywords. The extraction unit 100 performs the same process for all numbers included in the script data. For example, if the video numbers included in the script data are "1" to "4," the extraction unit 100 extracts four video IDs and video tempo information. As mentioned above, the same video keyword may be set for different videos in the video storage unit 11a. In this case, the extraction unit 100 randomly selects one video keyword from multiple identical video keywords and extracts the video ID and video tempo information associated with the one video keyword.

[0032] (Settings section) If the tempo value indicated by the extracted video tempo information is 0, the setting unit 200 sets the playback magnification when playing back a video to 1, and if the tempo value indicated by the extracted video tempo information is not 0, the setting unit 200 sets the tempo value indicated by the performance tempo information of the music piece divided by the tempo value indicated by the video tempo information as the playback magnification when playing back a video.

[0033] When the extraction unit 100 extracts the video ID and video tempo information for one video number, the setting unit 200 checks the tempo value indicated by the extracted video tempo information. If the tempo value is 0, the setting unit 200 sets the playback magnification to 1 when playing back the video. If the tempo value is 0, the tempo cannot be recognized from the video, so the singer will not feel any discrepancy with the tempo of the music being played. Therefore, the singer will not feel uncomfortable when watching the video even if the playback speed is not changed.

[0034] On the other hand, if the tempo value is not 0, the setting unit 200 sets the tempo value indicated by the performance tempo information of the music piece divided by the tempo value indicated by the extracted video tempo information as the playback magnification. If the tempo value is not 0, the tempo can be recognized from the video, so the singer may feel a discrepancy with the performance tempo of the music piece. Therefore, if the playback speed is not changed, the singer may feel uncomfortable when watching the video. For example, suppose the tempo value indicated by the performance tempo information of the music piece is "100 BPM" and the tempo value indicated by the extracted video tempo information is "50 BPM." In this case, the setting unit 200 sets the playback magnification to "2" (= 100 BPM ÷ 50 BPM).

[0035] The setting unit 200 may perform the above process each time the extraction unit 100 extracts the video ID and video tempo information, or may perform the above process all at once after the extraction unit 100 extracts the video ID and video tempo information for all numbers included in the script data.

[0036] (Generation part) The generating unit 300 generates a background video playback table by associating the extracted video identification information and the set playback magnification with the numerical order of the multiple videos included in the script data of the music piece.

[0037] After the setting unit 200 sets the playback magnification for all video numbers included in the script data, the generation unit 300 generates a background video playback table in which video IDs and the set playback magnifications are associated in the order of video numbers. There is a one-to-one correspondence between the video numbers included in the script data and the video numbers included in the background video playback table.

[0038] (Playback processing unit) The playback processing unit 400 refers to the background video playback table in accordance with the karaoke performance of the song, reads out video data and playback speed from the video storage unit 11a in the order of the video numbers, adjusts the playback speed at a set playback magnification, and plays back the video based on the video data at the adjusted playback speed in accordance with the playback start time of the video included in the script data of the song.

[0039] The karaoke device K acquires accompaniment data for a song from the storage means 10a based on the song identification information registered in the reservation queue. The karaoke device K controls the performance means 10d to play the acquired accompaniment data and emit karaoke performance sounds from the speaker 20. The singer can sing karaoke using the microphone 40 in time with the karaoke performance sounds emitted from the speaker 20.

[0040] In synchronization with the karaoke performance of the song, the playback processing unit 400 refers to the background video playback table and obtains the video ID associated with the video number. The playback processing unit 400 reads out the video data and playback speed corresponding to the obtained video ID from the video storage unit 11a. The playback processing unit 400 refers to the background video playback table and obtains the playback magnification associated with the video ID. The playback processing unit 400 adjusts the read playback speed by the obtained playback magnification. The playback processing unit 400 also refers to the script data of the song and checks the playback start time associated with the video number. When the confirmed playback start time arrives, the playback processing unit 400 plays back the video based on the read video data at the adjusted playback speed. The played back video is displayed on the display device 30 of the karaoke device K. The playback processing unit 400 repeats the above process for all video numbers included in the background video playback table.

[0041] For example, if the playback magnification is "1", the video played back by the playback processing unit 400 is played back at the original playback speed (the playback speed stored in the video storage unit 11a). On the other hand, if the playback magnification is not "1", the video played back by the playback processing unit 400 is played back at a playback speed faster (or slower) than the original playback speed.

[0042] ==About the processing of Karaoke device K== Next, a specific example of the processing of the karaoke device K in this embodiment will be described with reference to Figures 5 and 6. Figure 5 is a flowchart showing the processing of the karaoke device K. Figure 6 is a diagram showing the background video playback table generated by the generation unit 300. In this example, the script data for song X is that shown in Figure 3. The video storage unit 11a stores the information shown in Figure 4. It is assumed that the performance tempo value indicated by the performance tempo information for song X is "60 BPM."

[0043] Singer S operates remote control device 50 to select song X that he or she wishes to sing as karaoke. Remote control device 50 registers the song ID of the selected song X in the reservation queue (reserving karaoke performance of song X; step 10).

[0044] The extraction unit 100 extracts from the video storage unit 11a a video ID and video tempo information associated with a video keyword that matches a video keyword associated with the number of a video included in the script data of the song X (extracting the video ID and video tempo information; step 11).

[0045] If the tempo value indicated by the video tempo information extracted in step 11 is 0, the setting unit 200 sets the playback magnification when playing back a video to 1, and if the tempo value indicated by the extracted video tempo information is not 0, the setting unit 200 sets the tempo value indicated by the performance tempo information of the music piece divided by the tempo value indicated by the video tempo information as the playback magnification when playing back a video (setting the video playback magnification; step 12).

[0046] The generation unit 300 generates a background video playback table by associating the extracted video IDs and the playback magnification set in step 13 in numerical order of the multiple videos included in the script data of song X (generating background video playback table; step 13).

[0047] The karaoke device K acquires accompaniment data for the song X from the storage means 10a based on the song ID registered in the reservation queue. The karaoke device K controls the performance means 10d to play the acquired accompaniment data and emit karaoke performance sounds from the speaker 20 (starting karaoke performance of the song X; step 14). The singer S sings karaoke using the microphone 40 in time with the karaoke performance sounds emitted from the speaker 20.

[0048] The playback processing unit 400 refers to the background video playback table generated in step 13 in accordance with the karaoke performance of the song X, reads out video data and playback speeds from the video storage unit 11a in the order of the video numbers, adjusts the playback speeds using the set playback magnification, and plays back the video based on the video data at the adjusted playback speed in accordance with the playback start time of the video included in the script data of the song X (playing back video at the adjusted playback speed; step 15). The played-back video is displayed on the display device 30 of the karaoke device K. The karaoke device K repeats the process of step 15 in accordance with the playback start time of each video until the karaoke performance ends (if Y in step 16).

[0049] Specifically, the extraction unit 100 checks the script data (see FIG. 3) included in the music data of the music piece X, and reads out the video keyword "ocean" associated with video number "1." The extraction unit 100 refers to the video storage unit 11a and searches for a video keyword that matches the read-out video keyword "ocean." The extraction unit 100 extracts the video ID ***m1 and video tempo information "0 BPM" that are associated with the matching video keyword "ocean." Next, the extraction unit 100 reads out the video keyword "sand beach" associated with video number "2." The extraction unit 100 refers to the video storage unit 11a and searches for a video keyword that matches the read-out video keyword "sand beach." The extraction unit 100 extracts the video ID ***m2 and video tempo information "0 BPM" that are associated with the matching video keyword "sand beach." Next, the extraction unit 100 reads out the video keyword "waving audience" associated with video number "3." The extraction unit 100 refers to the video storage unit 11a and searches for a video keyword that matches the read-out video keyword "audience waving." The extraction unit 100 extracts the video ID ***m3 and video tempo information "50 BPM" that are associated with the matching video keyword "audience waving." Finally, the extraction unit 100 reads out the video keyword "sunset" that is associated with video number "4." The extraction unit 100 refers to the video storage unit 11a and searches for a video keyword that matches the read-out video keyword "sunset." The extraction unit 100 extracts the video ID ***m4 and video tempo information "0 BPM" that are associated with the matching video keyword "sunset."

[0050] For video numbers "1," "2," and "4" with a tempo value of "0 BPM," the setting unit 200 sets the playback magnification to 1 when playing the videos corresponding to video ID ***m1, video ID ***m2, and video ID ***m4.

[0051] On the other hand, for video number "3" whose tempo value is "50 BPM", the setting unit 200 sets the playback multiplier to "1.2", which is the value obtained by dividing the performance tempo value "60 BPM" indicated by the performance tempo information of song X by the tempo value "50 BPM" indicated by the extracted video tempo information.

[0052] The generation unit 300 generates a background video playback table by associating the extracted video IDs and the set playback magnifications with the video numbers "1" to "4" included in the script data of song X, in that order. As shown in Fig. 6, in the background video playback table in this example, video number "1" is associated with video ID ***m1 and playback magnification "1", video number "2" is associated with video ID ***m2 and playback magnification "1", video number "3" is associated with video ID ***m3 and playback magnification "1.2", and video number "4" is associated with video ID ***m4 and playback magnification "1".

[0053] In synchronization with the karaoke performance of song X, the playback processing unit 400 refers to the background video playback table and acquires video ID ***m1 associated with video number "1." The playback processing unit 400 refers to the video storage unit 11a and reads out video data MD1 and a playback speed of "30 fps" corresponding to the acquired video ID ***m1. The playback processing unit 400 refers to the background video playback table and acquires the playback magnification "1" associated with video ID ***m1. The playback processing unit 400 multiplies the read playback speed "30 fps" by the acquired playback magnification "1" (in this case, the playback speed remains "30 fps"). The playback processing unit 400 refers to the script data of song X and confirms the playback start time "0 s" associated with video number "1." The playback processing unit 400 plays back video M1 based on the read video data MD1 at the adjusted playback speed "30 fps" in synchronization with the arrival of the confirmed playback start time (i.e., simultaneously with the start of the karaoke performance). The display device 30 of the karaoke device K displays the reproduced video M1.

[0054] Next, the playback processing unit 400 refers to the background video playback table and acquires the video ID ***m2 associated with video number "2." The playback processing unit 400 refers to the video storage unit 11a and reads out the video data MD2 and playback speed "30 fps" corresponding to the acquired video ID ***m2. The playback processing unit 400 refers to the background video playback table and acquires the playback magnification "1" associated with the video ID ***m2. The playback processing unit 400 multiplies the read playback speed "30 fps" by the acquired playback magnification "1" (in this case, the playback speed remains "30 fps"). The playback processing unit 400 refers to the script data of the song X and confirms the playback start time "120 s" associated with video number "2." The playback processing unit 400 plays back the video M2 based on the read video data MD2 at the adjusted playback speed "30 fps" when the confirmed playback start time arrives (i.e., when 120 s has elapsed since the start of the karaoke performance). The display device 30 of the karaoke device K displays the reproduced video M2.

[0055] Next, the playback processing unit 400 refers to the background video playback table and acquires the video ID ***m3 associated with video number "3." The playback processing unit 400 refers to the video storage unit 11a and reads out the video data MD3 and playback speed "30 fps" corresponding to the acquired video ID ***m3. The playback processing unit 400 refers to the background video playback table and acquires the playback magnification "1.2" associated with the video ID ***m3. The playback processing unit 400 multiplies the read playback speed "30 fps" by the acquired playback magnification "1.2" (in this case, the playback speed becomes "36 fps"). The playback processing unit 400 refers to the script data of the song X and confirms the playback start time "180 seconds" associated with video number "3." The playback processing unit 400 plays back the video M3 based on the read video data MD3 at the adjusted playback speed "36 fps" when the confirmed playback start time arrives (i.e., when 180 seconds have passed since the start of the karaoke performance). The display device 30 of the karaoke device K displays the reproduced video M3.

[0056] Finally, the playback processing unit 400 refers to the background video playback table and acquires the video ID ***m4 associated with video number "4." The playback processing unit 400 refers to the video storage unit 11a and reads out the video data MD4 and playback speed "30 fps" corresponding to the acquired video ID ***m4. The playback processing unit 400 refers to the background video playback table and acquires the playback magnification "1" associated with the video ID ***m4. The playback processing unit 400 multiplies the read playback speed "30 fps" by the acquired playback magnification "1" (in this case, the playback speed remains "30 fps"). The playback processing unit 400 refers to the script data of the song X and confirms the playback start time "240 seconds" associated with video number "4." The playback processing unit 400 plays back the video M4 based on the read video data MD4 at the adjusted playback speed "30 fps" when the confirmed playback start time arrives (i.e., when 240 seconds have passed since the start of the karaoke performance). The display device 30 of the karaoke device K displays the reproduced video M4.

[0057] As is clear from the above, the karaoke device K according to this embodiment comprises a video storage unit 11a that stores, in association with one another, video identification information for identifying a plurality of videos constituting a background video to be displayed on a display means in sync with a karaoke performance, a video keyword that indicates the image of the video, video data for displaying the video corresponding to the video identification information, a playback speed for playing the video, and video tempo information that indicates the value of the tempo if the tempo can be recognized from the video and indicates a value of 0 if the tempo cannot be recognized from the video; an extraction unit 100 that extracts, from the video storage unit 11a, video identification information and video tempo information that are associated with a video keyword that matches a video keyword associated with the number of a video included in script data of a song to be karaoke performed; and an extraction unit 100 that extracts, when the tempo value indicated by the extracted video tempo information is 0, and if the tempo value indicated by the extracted video tempo information is not 0, sets the playback magnification when playing back the video to a value obtained by dividing the tempo value indicated by the performance tempo information of the music by the tempo value indicated by the video tempo information; a generation unit 300 that generates a background video playback table by associating the extracted video identification information and the set playback magnification with the numerical order of the multiple videos included in the script data of the music; and a playback processing unit 400 that refers to the background video playback table in accordance with the karaoke performance of the music, reads out video data and playback speeds from the video storage unit 11a in the numerical order of the multiple videos, adjusts the playback speed by the set playback magnification, and plays back the video based on the video data at the adjusted playback speed in accordance with the playback start time of the video included in the script data of the music.

[0058] As described above, if the tempo value indicated by the video tempo information is not zero, the tempo can be recognized from the video, which may cause the singer to feel a discrepancy with the tempo of the music performance. Therefore, when the tempo value indicated by the extracted video tempo information is not zero, the karaoke device K according to this embodiment divides the tempo value indicated by the music performance tempo information by the tempo value indicated by the video tempo information, sets the result as the playback magnification when playing back a video, and adjusts the playback speed of the video by this playback magnification. In this case, the video played back by the playback processing unit 400 is played back at a playback speed faster (or slower) than the original playback speed. Playing back the video with the playback speed adjusted in this way can reduce the sense of discomfort felt by the singer due to the discrepancy between the music performance tempo and the video tempo. In other words, the karaoke device K according to this embodiment can display background video that does not feel strange.

[0059] <Modification> When the playback speed is adjusted by the process of the embodiment, the video may appear to be played back in fast forward (or slow motion), which may give the singer a visual sense of discomfort.

[0060] Therefore, if the tempo value indicated by the extracted video tempo information is not 0, and if the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the tempo value indicated by the video tempo information is equal to or greater than a first predetermined multiple, the setting unit 200 in this modified example can calculate a value obtained by multiplying the tempo value indicated by the video tempo information by the first predetermined multiple, and set the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the calculated value as the playback multiplier when playing back a single video.

[0061] Furthermore, if the tempo value indicated by the extracted video tempo information is not 0 and the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the tempo value indicated by the video tempo information is equal to or less than a second predetermined multiple, the setting unit 200 in this modified example can calculate a value obtained by multiplying the tempo value indicated by the video tempo information by the second predetermined multiple, and set the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the calculated value as the playback multiplier when playing back a single video.

[0062] The first predetermined multiple is an upper limit for playing back video that does not create a visually awkward feeling, and the second predetermined multiple is a lower limit for playing back video that does not create a visually awkward feeling. When the value obtained by dividing the tempo value indicated by the performance tempo information of the music by the tempo value indicated by the video tempo information is equal to or greater than the first predetermined multiple, the video will appear to the singer as if it were played back in fast forward. On the other hand, when the value obtained by dividing the tempo value indicated by the performance tempo information of the music by the tempo value indicated by the video tempo information is equal to or less than the second predetermined multiple, the video will appear to the singer as if it were played back in slow motion. Generally, doubling the playback speed of the original video tends to make it appear to be played back in fast forward, while reducing the playback speed of the original video by 0.5 tends to make it appear to be played back in slow motion. Therefore, it is preferable to set the first predetermined multiple to "2" and the second predetermined multiple to "0.5."

[0063] For example, suppose the first predetermined multiple is "2", the performance tempo value indicated by the performance tempo information of the music piece is 120 BPM, and the tempo value indicated by the extracted video tempo information is 40 BPM.

[0064] In this case, the setting unit 200 of the embodiment sets the value "3" obtained by dividing the tempo value "120 BPM" indicated by the performance tempo information of the music by the tempo value "40 BPM" indicated by the video tempo information as the playback multiplier when playing back one video.

[0065] On the other hand, the setting unit 200 according to this modification checks whether the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the tempo value indicated by the video tempo information is equal to or greater than the first predetermined multiple. Here, the value "3" obtained by dividing the tempo value "120 BPM" indicated by the performance tempo information of the music piece by the tempo value "40 BPM" indicated by the video tempo information is equal to or greater than the first predetermined multiple "2". In this case, the setting unit 200 obtains "80 BPM" by multiplying the tempo value "40 BPM" indicated by the video tempo information by the first predetermined multiple (i.e., double). The setting unit 200 sets "1.5", which is the value obtained by dividing the tempo value "120 BPM" indicated by the performance tempo information of the music piece by the obtained value "80 BPM", as the playback multiple when playing back one video.

[0066] The set playback magnification of "1.5" is lower than the playback magnification of "3" set by the processing of the setting unit 200 according to the embodiment. Therefore, the playback speed adjusted by the playback processing unit 400 is also slower in the case of this modification.

[0067] Also, for example, suppose the second predetermined multiple is "0.5", the performance tempo value indicated by the performance tempo information of the music piece is 40 BPM, and the tempo value indicated by the extracted video tempo information is 120 BPM.

[0068] In this case, the setting unit 200 of the embodiment sets the value "0.33" obtained by dividing the tempo value "40 BPM" indicated by the performance tempo information of the music by the tempo value "120 BPM" indicated by the video tempo information as the playback multiplier when playing back one video.

[0069] On the other hand, the setting unit 200 according to this modification checks whether the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the tempo value indicated by the video tempo information is equal to or less than the second predetermined multiple. Here, the value "0.33" obtained by dividing the tempo value "40 BPM" indicated by the performance tempo information of the music piece by the tempo value "120 BPM" indicated by the video tempo information is equal to or less than the first predetermined multiple "0.5". In this case, the setting unit 200 obtains "60 BPM" by multiplying the tempo value "120 BPM" indicated by the video tempo information by the second predetermined multiple (i.e., 0.5). The setting unit 200 sets "0.66", obtained by dividing the tempo value "40 BPM" indicated by the performance tempo information of the music piece by the obtained value "60 BPM", as the playback multiple when playing back one video.

[0070] The set playback magnification of "0.66" is higher than the playback magnification of "0.33" set by the processing of the setting unit 200 according to the embodiment. Therefore, the playback speed adjusted by the playback processing unit 400 is also faster in the case of this modification.

[0071] As is clear from the above, in the karaoke device K according to this modification, if the tempo value indicated by the extracted video tempo information is not zero and if the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the tempo value indicated by the video tempo information is equal to or greater than a first predetermined multiple, the setting unit 200 multiplies the tempo value indicated by the video tempo information by a first predetermined multiple and sets the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the first predetermined multiple as the playback magnification for playing back a single video. If the tempo value indicated by the extracted video tempo information is not zero and if the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the video tempo information is equal to or less than a second predetermined multiple, the setting unit 200 multiplies the tempo value indicated by the video tempo information by a second predetermined multiple and sets the value obtained by dividing the tempo value indicated by the performance tempo information of the music piece by the second predetermined multiple as the playback magnification for playing back a single video. This karaoke device K can prevent the playback speed from becoming too fast or too slow. This reduces the visual discomfort felt by the singer when viewing the displayed background video.

[0072] <Other> The program can also be supplied to a computer using a non-transitory computer-readable medium with an executable program stored thereon. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), CD-ROMs (Read Only Memory), etc.

[0073] The above-described embodiments are presented as examples and do not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The above-described embodiments and their modifications are included in the scope and spirit of the invention, as well as in the inventions described in the claims and their equivalents. [Explanation of symbols]

[0074] K Karaoke equipment 10 Karaoke machine 11a Video storage section 100 Extraction part 200 Settings 300 Generation part 400 Regeneration Processing Unit

Claims

1. a video storage unit that stores, in association with each other, video identification information for identifying a plurality of videos constituting a background video to be displayed on a display means in sync with a karaoke performance, a video keyword that indicates an image of the video, video data for displaying the video corresponding to the video identification information, a playback speed for playing the video, and video tempo information that indicates the value of the tempo if the tempo can be recognized from the video and indicates a value of 0 if the tempo cannot be recognized from the video; an extracting unit that extracts from the video storage unit video identification information and video tempo information associated with a video keyword that matches a video keyword associated with a number of a video included in script data of a song to be karaoke performed; a setting unit that sets a playback magnification ratio for playing back the one video to 1 when the tempo value indicated by the extracted video tempo information is 0, and sets a value obtained by dividing the tempo value indicated by performance tempo information of the music piece by the tempo value indicated by the video tempo information when the extracted tempo value indicated by the extracted video tempo information is not 0 as a playback magnification ratio for playing back the one video; a generation unit that generates a background video playback table by associating the extracted video identification information and a set playback magnification with the order of the numbers of the plurality of videos included in the script data of the music; a playback processing unit that refers to the background video playback table in accordance with the karaoke performance of the song, reads out video data and playback speeds from the video storage unit in numerical order of the plurality of videos, adjusts the playback speeds at a set playback magnification, and plays back videos based on the video data at the adjusted playback speed in accordance with the playback start times of the videos included in the script data of the song; A karaoke device having:

2. 2. The karaoke device according to claim 1, wherein, when the tempo value indicated by the extracted video tempo information is not 0 and when a value obtained by dividing the tempo value indicated by the performance tempo information of the song by the tempo value indicated by the video tempo information is equal to or greater than a first predetermined multiple, the setting unit calculates a value obtained by multiplying the tempo value indicated by the video tempo information by a first predetermined multiple and sets the value obtained by dividing the tempo value indicated by the performance tempo information of the song by the calculated value as a playback magnification for playing back the one video; and when the tempo value indicated by the extracted video tempo information is not 0 and when a value obtained by dividing the tempo value indicated by the performance tempo information of the song by the tempo value indicated by the video tempo information is equal to or less than a second predetermined multiple, the setting unit calculates a value obtained by multiplying the tempo value indicated by the video tempo information by a second predetermined multiple and sets the value obtained by dividing the tempo value indicated by the performance tempo information of the song by the calculated value as a playback magnification for playing back the one video.

Images