Karaoke equipment

Abstract

To provide a Karaoke device capable of increasing degrees of freedom of solo performance when a performer performs live performance of a musical instrument along with Karaoke performance sound.SOLUTION: A Karaoke device includes: a determination unit that determines a start and an end of a solo performance by a performer who performs live performance of a musical instrument along with Karaoke performance sound of a musical piece; and a performance control unit that, when the start of the solo performance is determined, suspends a Karaoke performance of the musical piece, and when the end of the solo performance is determined, resumes the Karaoke performance of the musical piece from a singing section following a singing section where the Karaoke performance was being performed immediately before the start of the solo performance.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a karaoke machine. [Background technology]

[0002] There are karaoke stores where musicians play live instruments in sync with the karaoke sounds produced by karaoke machines (see Non-Patent Document 1). Live performances create a sense of realism, like being at a live concert, which increases customer satisfaction. In addition, the musical instruments playing in sync with the karaoke sounds are more stable, making it easier for customers to sing. Furthermore, by using a karaoke machine, users can sing karaoke while viewing the lyrics on the screen.

[0003] Patent document 1 also discloses a karaoke device that can repeatedly play back an interlude when a guitar is played during the interlude of a karaoke song and the audience's level of excitement is determined to be equal to or greater than a predetermined value. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] BANDIES homepage, [searched March 19, 2022], Internet<URL:https: / / bandies-official.com / > [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-106061 Summary of the Invention [Problem to be solved by the invention]

[0006] In concerts and live performances by professional bands, the original solo performances are sometimes arranged, such as by changing the length of the solo performances in the interludes or by taking turns playing the solos of the instruments (so-called solo rotation). Therefore, even when live musical performances are performed along with the karaoke performance sounds, arranging the solo performances can liven up the karaoke singing experience.

[0007] On the other hand, when a live musical instrument is played along with karaoke performance sounds as in Non-Patent Document 1, it is difficult to arrange a solo performance because the length of the interlude is fixed for each song. Also, according to the technology in Patent Document 1, the karaoke performance sounds of the interlude are emitted while the interlude is repeated, making it difficult to arrange a live performance, such as inserting irregular breaks in the middle of a solo performance depending on the excitement of the audience.

[0008] An object of the present invention is to provide a karaoke apparatus that allows a performer to play a live musical instrument in time with the karaoke performance sound, thereby increasing the degree of freedom in solo performance. [Means for solving the problem]

[0009] One invention for achieving the above object is a karaoke device having a judgment unit that judges the start and end of a solo performance by a performer who plays a live instrument in time with the karaoke performance sound of a song, and a performance control unit that, when it judges that the solo performance has started, interrupts the karaoke performance of the song, and, when it judges that the solo performance has ended, resumes the karaoke performance of the song from the singing section next to the singing section in which the karaoke performance was being performed immediately before the solo performance started. Other features of the present invention will become apparent from the following description and drawings. [Effects of the Invention]

[0010] According to the present invention, when a performer plays a live musical instrument in time with the karaoke performance sound, the degree of freedom in solo performance can be increased. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram showing a karaoke device and musical instruments according to a first embodiment. [Figure 2] 1 is a diagram showing a karaoke device according to a first embodiment. [Figure 3] 1 is a diagram showing a karaoke main unit according to a first embodiment. FIG. [Figure 4] 4 is a flowchart showing the process of the karaoke device according to the first embodiment. [Figure 5] FIG. 10 is a diagram showing a karaoke main unit according to a second embodiment. [Figure 6] 10 is a flowchart showing the process of the karaoke device according to the second embodiment. [Figure 7] FIG. 10 is a diagram showing a karaoke main unit according to a third embodiment. [Figure 8] 10 is a flowchart showing the process of the karaoke apparatus according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] First Embodiment A karaoke device according to a first embodiment will be described with reference to FIGS.

[0013] ==Karaoke Equipment and Musical Instruments== A karaoke machine is a device that allows users to play karaoke songs selected by the user and sing karaoke. Karaoke machines are installed in karaoke stores where musical instruments are allowed to be played. In the example of FIG. 1, karaoke machine K is installed in karaoke store KS. Karaoke machine K is used by user U. User U is also on the stage.

[0014] The instruments include electric guitars, acoustic guitars, electric basses, synthesizers, drums, etc. Each instrument is used by a performer to play live along with the karaoke performance sound. A performer is someone who plays an instrument. FIG. 1 shows an example in which performer P1 plays instrument MI1 (guitar), performer P2 plays instrument MI2 (bass), and performer P3 plays instrument MI3 (drums) on stage. The sounds of the electric and electronic instruments are output from instrument speakers via an instrument amplifier (not shown).

[0015] Furthermore, a lighting device LE and a photographing device SE are installed in the karaoke store KS.

[0016] The lighting device LE is a device for illuminating the stage in accordance with the progress of the music. For example, when a user U sings karaoke along with the sounds of a karaoke performance, the lighting technician operates the lighting device LE to adjust the lighting so that the user U is lit. On the other hand, when a performer performs a solo performance, the lighting technician operates the lighting device LE to adjust the lighting so that spotlight is directed at the performer. A solo performance is a performance performed by a single performer or by only some of the performers in a live musical instrument performance by multiple performers.

[0017] The photographing device SE is a device, such as a camera, for photographing the stage where the performers are present and the inside of the karaoke store KS. The photographing device SE starts photographing based on an instruction from the karaoke device K and transmits the obtained video data to the karaoke device K.

[0018] ==Karaoke Equipment Details== As shown in FIG. 2, the karaoke device K includes a karaoke main unit 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

[0019] The karaoke machine main unit 10 performs various controls related to karaoke performance and singing, such as controlling the karaoke performance of the selected song, controlling the display of lyrics and background images, and processing audio signals input through the microphone 40. The speaker 20 is configured to emit sound based on signals from the karaoke machine main unit 10. The display device 30 is configured to display videos and images on a screen based on signals from the karaoke machine main unit 10. The microphone 40 is configured to convert the singing voice of the user into an analog audio signal and input it to the karaoke machine main unit 10. The remote control device 50 is a device for performing various operations on the karaoke machine main unit 10.

[0020] 3, the karaoke machine 10 according to this embodiment includes a storage unit 10a, a communication unit 10b, an input unit 10c, a performance unit 10d, and a control unit 10e. Each component is connected to a bus B via an interface (not shown).

[0021] [Storage means] The storage means 10a is a large-capacity storage device that stores various types of data. The storage means 10a stores song data. Song data is assigned song identification information. Song identification information is information unique to each song, such as a song ID for identifying the song. Song data includes karaoke performance data, reference data, section information, etc. Karaoke performance data is MIDI format data that is the source of karaoke performance sounds. Reference data is data that indicates the main melody of the song performed karaoke. Section information indicates a performance section. A performance section is a section in which karaoke performance is performed. A performance section includes a singing section and a non-singing section. A singing section is a section in which lyrics to be sung are set in a certain song (for example, the A-melody, B-melody, and chorus of the first verse). A non-singing section is a section in which lyrics to be sung are set in a certain song, such as an introduction, interlude, or postlude.

[0022] The storage means 20 also stores, for each song, background video data corresponding to the background video displayed during karaoke performance, lyric subtitle data for displaying the lyrics of the song, and song attribute information (song title, singer name, genre, etc.).

[0023] [Communication means / input means] The communication means 10b provides an interface for communicating with the outside. The input means 10c is configured to allow the user to input various instructions. The input means 10c is a button or the like provided on the karaoke main unit 10. Alternatively, the remote control device 50 may function as the input means 10c.

[0024] [Means of performance] Based on the control of the control means 10e, the performance means 10d performs karaoke performance of music pieces and processes signals based on singing voices input through the microphone 40. The performance means 10d includes a sound source, a mixer, an amplifier, etc. (none of which are shown).

[0025] [Control means] The control means 10e performs various controls in the karaoke device K. The control means 10e includes a CPU and a memory (neither of which is shown). The CPU executes programs stored in the memory to realize various functions.

[0026] In this embodiment, the CPU executes a program stored in the memory, and the control means 10e functions as a determination section 100 and a performance control section 200.

[0027] (Judgment Department) The determination unit 100 determines the start and end of a solo performance by a live musician playing an instrument in sync with the karaoke performance sound of a song.

[0028] The start and end of a solo performance can be determined by various methods. In this embodiment, the determination unit 100 determines the start and end of a solo performance by a performer based on video data obtained by filming the performer.

[0029] For example, a user of the karaoke device K operates the remote control device 50 to select a mode in which a musician plays a live musical instrument along with the karaoke performance sound (hereinafter referred to as "live performance mode"). The remote control device 50 transmits a signal to the karaoke device K indicating that the live performance mode has been selected.

[0030] When the karaoke device K receives a signal indicating that the live performance mode has been selected, the karaoke device K instructs the camera device SE (see FIG. 1) installed in the karaoke store KS to start filming the stage where the performers are. The camera device SE transmits the video data obtained by filming the stage to the karaoke device K. Note that the karaoke device K may also instruct the camera device SE to start filming the stage where the performers are at the timing when the karaoke performance of the song begins (i.e., the timing when the live performance begins).

[0031] The determination unit 100 analyzes the received video data using known image recognition technology, and acquires video data for each performer included in the video.

[0032] The determination unit 100 calculates the brightness value for each piece of video data of a performer using known techniques and determines whether it satisfies a predetermined condition, such as "1000 lux or more" or "more than 1500 lux."

[0033] As described above, when a performer is performing a solo, the lighting technician operates the lighting device LE to adjust the lighting so that the spotlight shines on the performer. In this case, the brightness value of the video data corresponding to the performer performing the solo performance will be high.

[0034] Therefore, when the determination unit 100 determines that the brightness value calculated for the video data corresponding to one performer satisfies a predetermined condition, it determines that a solo performance by that performer has started. Note that in this embodiment, an example will be described in which only one performer out of multiple performers performs a solo performance (see the modified example described below for an example in which each of multiple performers performs a solo performance).

[0035] Meanwhile, after determining that a solo performance by a performer has begun, the determination unit 100 monitors the luminance value of the video data corresponding to that performer. When the performer finishes his / her solo performance, the lighting technician operates the lighting device LE to adjust it so that the spotlight that had been illuminating that performer is removed. In this case, the luminance value of the video data corresponding to that performer is lower than the luminance value of the video data when the spotlight was illuminating that performer.

[0036] Therefore, when the determining unit 100 determines that the brightness value calculated for the video data corresponding to one performer does not satisfy the predetermined condition, it determines that the solo performance by the one performer has ended.

[0037] The method for determining the start and end of a solo performance from the video data is not limited to the above example. For example, the karaoke device K instructs the filming device SE to start filming the stage where the performers are and the user singing karaoke. The filming device SE then transmits the video data obtained by filming the stage and the user to the karaoke device K.

[0038] The determination unit 100 analyzes the received video data, calculates the distance between the seating area of ​​the karaoke store and each performer, and determines whether the distance satisfies a predetermined condition. The predetermined condition may be, for example, "within 3 meters" or "less than 2 meters."

[0039] When a performer performs a solo, he or she is likely to move from their usual position to the front of the stage and get closer to the audience. In this case, the distance between the performer and the audience is likely to become shorter.

[0040] Therefore, when the determining section 100 determines that the distance between the audience and the one performer satisfies a predetermined condition, it determines that a solo performance by the one performer has begun.

[0041] On the other hand, after determining that a solo performance by a performer has begun, the determination unit 100 monitors the distance between the performer and the audience. When the performer finishes his / her solo performance, he / she returns to his / her normal standing position. In this case, the distance between the performer and the audience indicates a value longer than the distance during the solo performance.

[0042] Therefore, when the determining unit 100 determines that the distance between one performer and the audience does not satisfy a predetermined condition, it determines that the solo performance by one performer has ended.

[0043] Alternatively, similar to the above example, the determination unit 100 analyzes the received video data using known image recognition technology and acquires video data for each performer included in the video.

[0044] The determination unit 100 extracts the performer's movements from each piece of video data of the performer using known technology and determines whether or not a predetermined condition for determining the start of a solo performance is met. The predetermined condition for determining the start of a solo performance is set in advance, for example, "raising the instrument high" or "(in the case of a drummer) making a counting motion with a stick."

[0045] When the determination unit 100 determines that the action extracted from the video data corresponding to one performer satisfies a predetermined condition for determining the start of a solo performance, it determines that a solo performance by one performer has started.

[0046] On the other hand, after determining that a solo performance by one performer has begun, the determination unit 100 monitors the movement of the performer. The determination unit 100 determines whether the movement of the performer satisfies a predetermined condition for determining the end of the solo performance. The predetermined condition for determining the end of the solo performance may be, for example, "raising a hand" or "bowing," which is set in advance.

[0047] When the determination unit 100 determines that the action extracted from the video data corresponding to one performer satisfies a predetermined condition for determining the end of the solo performance, it determines that the solo performance by one performer has ended.

[0048] (Performance control unit) The performance control unit 200 controls the karaoke performance in the karaoke device K.

[0049] For example, after selecting the live performance mode, the user operates the remote control device 50 to select a song to sing via the song selection screen. The remote control device 50 then transmits the song ID of the song selected by the user to the karaoke device K. The karaoke device K registers the received song ID in a reservation queue, thereby reserving the song for karaoke performance.

[0050] The performance control unit 200 acquires karaoke performance data of a song from the storage unit 10a based on the song ID registered in the reservation queue. The performance control unit 200 controls the performance unit 10d to play the acquired karaoke performance data and emit karaoke performance sounds from the speaker 20.

[0051] The performer plays a live musical instrument in sync with the karaoke performance sounds emitted from the speaker 20. The user can sing karaoke in sync with the karaoke performance sounds and the musical instrument performance sounds emitted from the speaker 20.

[0052] Here, the performance control unit 200 of this embodiment interrupts the karaoke performance of the song when it determines that a solo performance has started, and when it determines that the solo performance has ended, it resumes the karaoke performance of the song from the singing section following the singing section in which the karaoke performance was being performed immediately before the solo performance started.

[0053] For example, suppose a user is singing karaoke of a piece of music X, which is composed of singing sections and non-singing sections such as an introduction, an A-melody of the first verse, a B-melody of the first verse, a chorus of the first verse, an interlude, an A-melody of the second verse, a B-melody of the second verse, etc. Now, suppose the performer starts a solo performance in the interlude following the chorus of the first verse of music X. In this case, the determination unit 100 determines that a solo performance has started and notifies the performance control unit 200. In response to this notification, the performance control unit 200 interrupts the karaoke performance of the interlude of music X.

[0054] Meanwhile, suppose the performer has finished the solo performance. In this case, the determination unit 100 determines that the solo performance has ended and notifies the performance control unit 200. In response to the notification, the performance control unit 200 resumes the karaoke performance of the song X from the singing section following the chorus of the first verse (i.e., the verse of the second verse) where the karaoke performance was being performed immediately before the solo performance began.

[0055] When restarting the karaoke performance of a song, the performance control unit 200 may perform the karaoke performance of the introductory part of the song first, and then start the karaoke performance of the next singing section.

[0056] For example, in the above example, when restarting the karaoke performance of song X, the performance control unit 200 can first perform the karaoke performance of the introduction, and then restart the karaoke performance of the verse of the second verse.

[0057] Furthermore, when it is determined that a solo performance has started, the performance control unit 200 may fade out the karaoke performance sound of the song and then stop the karaoke performance. The fading out of the karaoke performance sound can be performed using known technology.

[0058] For example, as described above, if a solo performance is determined in the interlude following the first chorus of song X, the performance control unit 200 can fade out the karaoke performance sound of the interlude and then stop the karaoke performance.

[0059] In the above example, the solo performance is started in the interlude that is set in advance in the music piece X. However, the timing at which the solo performance starts is not limited to this.

[0060] For example, suppose there is a song Y that is composed of sung and non-sung sections such as an intro, the first verse's A-melody, the first verse's B-melody, the first verse's chorus, the second verse's A-melody, the second verse's B-melody, the second verse's chorus, an interlude, and the third verse's B-melody, etc.

[0061] Here, let's say that a performer starts a solo performance immediately after the end of the first chorus in time with the karaoke performance of song Y. In this case, the determination unit 100 determines that the performer has started a solo performance. The determination unit 100 notifies the performance control unit 200 of this fact. In response to the notification, the performance control unit 200 interrupts the karaoke performance of song Y. Thereafter, when the determination unit 100 determines that the solo performance has ended, the performance control unit 200 resumes the karaoke performance of song Y from the verse of the second verse, which is the singing section following the first chorus, where the karaoke performance was being performed immediately before the solo performance began.

[0062] ==About the operation of the karaoke device K== Next, a specific example of the operation of the karaoke device K in this embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of the operation of the karaoke device K. In this example, it is assumed that a user U uses the karaoke device K in a karaoke establishment KS (see Fig. 1). It is also assumed that performers P1 to P3 are on stage as live musical instrument performers (see Fig. 1). Furthermore, in this example, it is assumed that the user U sings a song X in karaoke in live performance mode. It is assumed that the song X is composed of singing sections and non-singing sections such as an introduction, an A-melody of the first verse, a B-melody of the first verse, a chorus of the first verse, an interlude, an A-melody of the second verse, a B-melody of the second verse, and so on.

[0063] The performance control unit 200 acquires karaoke performance data for song X from the storage means 10a based on the song ID of song X registered in the reservation queue. The performance control unit 200 controls the performance means 10d to play the acquired karaoke performance data and emit karaoke performance sounds from the speaker 20 (starting karaoke performance of the song; step 10). Performers P1 to P3 each perform live musical instruments in sync with the karaoke performance sounds emitted from the speaker 20. User U sings karaoke in sync with the karaoke performance sounds and instrumental performance sounds emitted from the speaker 20.

[0064] The determination unit 100 performs a process to determine whether the performer has started a solo performance. If it determines that a solo performance has started (Y in step 11), the determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 suspends the karaoke performance of the piece X (suspend karaoke performance; step 12). This allows the performer to freely perform the solo performance.

[0065] On the other hand, after determining that a solo performance by one performer has started, the determination unit 100 performs a process of determining whether the solo performance by that performer has ended. If the determination unit 100 determines that the solo performance has ended (Y in step 13), it notifies the performance control unit 200 of that fact. In response to the notification, the performance control unit 200 resumes the karaoke performance of song X from the singing section following the singing section in which the karaoke performance was performed immediately before the solo performance started (the karaoke performance of song X is resumed from the singing section following the singing section in which the karaoke performance was performed immediately before the solo performance started; step 14).

[0066] The karaoke device K repeats the processes from step 11 to step 14 until the karaoke performance of the piece of music X is completed (if Y in step 15).

[0067] Specifically, the determination unit 100 analyzes the video data received from the image capture device SE and acquires video data M1 to M3 for each of the performers P1 to P3 included in the video. Note that the karaoke device K does not need to determine which performer each piece of video data corresponds to.

[0068] The determination unit 100 calculates a brightness value for each of the video data M1 to M3 and determines whether it satisfies a predetermined condition. For example, if it is determined that the brightness value calculated for the video data M1 in the interlude of the musical piece X satisfies the predetermined condition, the determination unit 100 determines that a solo performance by the performer corresponding to the video data M1 has begun. The determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 suspends the karaoke performance of the interlude of the musical piece X. The performer corresponding to the video data M1 performs a solo performance freely. Furthermore, the performers corresponding to the video data M2 and M3 perform performances supporting the solo performance.

[0069] Meanwhile, after determining that the performer corresponding to the video data M1 has started a solo performance, the determination unit 100 monitors the brightness value of the video data M1. The determination unit 100 determines whether the brightness value of the video data M1 satisfies a predetermined condition. If the determination unit 100 determines that the brightness value calculated for the video data M1 does not satisfy the predetermined condition, the determination unit 100 determines that the solo performance by the performer corresponding to the video data M1 has ended. The determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 resumes the karaoke performance of the song X from the verse of the second verse, which is the singing section following the chorus of the first verse, where the karaoke performance was being performed immediately before the solo performance began.

[0070] As is clear from the above, the karaoke device K of this embodiment has a determination unit 100 that determines the start and end of a solo performance by a performer who plays a live instrument in time with the karaoke performance sound of a song, and a performance control unit 200 that, when it determines that a solo performance has started, interrupts the karaoke performance of the song, and when it determines that the solo performance has ended, resumes the karaoke performance of the song from the singing section next to the singing section in which the karaoke performance was being performed immediately before the solo performance started.

[0071] With this karaoke device K, when a performer starts a solo performance, the karaoke performance can be interrupted. The interruption of the karaoke performance does not result in the karaoke performance sound being emitted. Therefore, the performer can freely perform a solo performance in response to requests from the user and the audience, thereby livening up the karaoke singing atmosphere. Meanwhile, when a performer finishes a solo performance, the karaoke device K can resume the karaoke performance from the singing section following the singing section in which the karaoke performance was being performed immediately before the solo performance started. Therefore, the user can continue enjoying karaoke singing after the solo performance has ended. In other words, the karaoke device K of this embodiment allows a performer to have greater freedom in their solo performance when playing a live instrument along with the karaoke performance sound.

[0072] Furthermore, the determination unit 100 in the karaoke device K according to this embodiment can determine the start and end of a solo performance by a performer based on video data obtained by filming the performer. By using the video data, the start and end of a solo performance can be easily determined.

[0073] Furthermore, when resuming karaoke performance of a song, the performance control unit 200 of the karaoke device K according to this embodiment can perform karaoke performance of the introductory portion of the song and then perform karaoke performance of the next singing section. By performing karaoke performance of the introductory portion, which is a non-singing section, when resuming karaoke performance, the user can easily grasp the end of the solo performance. Therefore, karaoke singing can be resumed more smoothly than if karaoke performance of the singing section was started immediately after the solo performance ended.

[0074] Furthermore, when the performance control unit 200 of the karaoke device K according to this embodiment determines that a solo performance has begun, it can fade out the karaoke performance sound of the song and then pause the karaoke performance. Fading out the karaoke performance sound prevents the karaoke performance from being suddenly interrupted, allowing the performer to smoothly perform the solo performance or performances supporting the solo performance.

[0075] Second Embodiment A karaoke device according to a second embodiment will be described with reference to Figures 5 and 6. In this embodiment, an example will be described in which a karaoke performance is resumed while taking into consideration the tempo of the live performance during the period in which the karaoke performance was interrupted. Descriptions of the same components as those in the first embodiment will be omitted.

[0076] [Control means] In this embodiment, the CPU executes a program stored in the memory, causing the control means 10e to function as a determination section 100, a performance control section 200, a performance data acquisition section 300, and an extraction section 400 (see FIG. 5).

[0077] (Performance data acquisition section) The performance data acquisition unit 300 acquires performance data corresponding to a live performance by a performer.

[0078] The performance data can be acquired, for example, using a sound collection means (not shown) such as a microphone installed in the karaoke store.

[0079] In the live performance mode, the performer plays a live musical instrument. Here, when the determination unit 100 determines that a solo performance has begun, the performance data acquisition unit 300 instructs the sound collection means to collect the performance sounds of the live performance. The sound collection means begins collecting the performance sounds in response to the instruction. The sound collection means outputs data corresponding to the collected performance sounds to the performance data acquisition unit 300. The performance data acquisition unit 300 acquires the data corresponding to the performance sounds as performance data. On the other hand, when the determination unit 100 determines that the solo performance has ended, the performance data acquisition unit 300 instructs the sound collection means to stop collecting the performance sounds of the live performance. The sound collection means stops collecting the performance sounds in response to the instruction.

[0080] (Extraction part) After the solo performance by the performer begins, the extracting section 400 extracts tempo information based on the acquired performance data.

[0081] The tempo information indicates the tempo of a live performance, including a solo performance and performances by other instruments supporting the solo performance. The process of extracting tempo information from performance data can use known techniques. For example, the extraction unit 400 can process an audio signal containing the performance sounds of multiple instruments using a filter with predetermined frequency characteristics, identify beats based on peak values, and extract tempo information based on the identified beats.

[0082] The extracting unit 400 analyzes the performance data acquired by the performance data acquiring unit 300 after the performer starts a solo performance, and extracts tempo information. The extracting unit 400 outputs the extracted tempo information to the performance control unit 200.

[0083] The performance data acquisition unit 300 may start acquiring performance data from the moment the performer starts a live performance. In this case, the determination unit 100 determines the start of a solo performance and notifies the extraction unit 400. After receiving the notification, the extraction unit 400 analyzes the performance data acquired by the performance data acquisition unit 300 and extracts tempo information.

[0084] Furthermore, the tempo of the performance may change during the solo performance, so it is preferable that the extraction unit 400 extracts tempo information based on the performance data acquired immediately before the determination unit 100 determines that the solo performance has ended.

[0085] (Performance control unit) The performance control unit 200 according to this embodiment resumes the karaoke performance of the song based on the extracted tempo information.

[0086] For example, as described in the first embodiment, it is assumed that the determination unit 100 determines that the solo performance has ended and notifies the performance control unit 200. In response to the notification, the performance control unit 200 resumes the karaoke performance of the song X from the singing section following the chorus of the first verse (i.e., the verse of the second verse) where the karaoke performance was being performed immediately before the solo performance started.

[0087] At this time, the performance control unit 200 compares the tempo indicated by the extracted tempo information with the tempo set for the musical piece X in advance.

[0088] If the tempo indicated by the extracted tempo information differs from the tempo preset for the song X, the performance control unit 200 resumes the karaoke performance of the A-melody of the second verse at the tempo indicated by the extracted tempo information.

[0089] ==About the operation of the karaoke device K== Next, a specific example of the operation of the karaoke device K in this embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the operation of the karaoke device K. In this example, it is assumed that a user U uses the karaoke device K in a karaoke establishment KS (see Fig. 1). It is also assumed that performers P1 to P3 are on stage as live musical instrument performers (see Fig. 1). It is also assumed in this example that the user U sings a song X in karaoke in live performance mode. It is also assumed that the song X is composed of singing sections and non-singing sections such as an introduction, an A-melody of the first verse, a B-melody of the first verse, a chorus of the first verse, an interlude, an A-melody of the second verse, a B-melody of the second verse, and so on.

[0090] Steps 20 to 22 are the same as steps 10 to 12 in the first embodiment. After step 22, the performer is free to perform a solo performance.

[0091] The performance data acquisition unit 300 acquires performance data corresponding to a live performance by a performer (acquires performance data corresponding to a live performance; step 23).

[0092] The extraction unit 400 extracts tempo information based on the performance data corresponding to the live performance acquired in step 23 (extracting tempo information; step 24).

[0093] On the other hand, after determining that a solo performance by one performer has started, the determination unit 100 performs a process to determine the end of the solo performance by that performer. If the determination unit 100 determines that the solo performance has ended (Y in step 25), it notifies the performance control unit 200 of that fact. In response to the notification, the performance control unit 200 resumes the karaoke performance of song X from the singing section following the singing section in which the karaoke performance was performed immediately before the solo performance started, based on the tempo information extracted in step 24 (the karaoke performance of song X is resumed from the singing section following the singing section in which the karaoke performance was performed immediately before the solo performance started, based on the extracted tempo information; step 26).

[0094] The karaoke device K repeats the processes from step 21 to step 26 until the karaoke performance of the piece of music X is completed (if Y in step 27).

[0095] Specifically, the determination unit 100, like in the first embodiment, analyzes the video data received from the image capture device SE and acquires video data M1 to M3 for each of the performers P1 to P3 included in the video.

[0096] The determination unit 100 calculates a brightness value for each of the video data M1 to M3 and determines whether it satisfies a predetermined condition. For example, if it is determined that the brightness value calculated for the video data M1 in the interlude of the musical piece X satisfies the predetermined condition, the determination unit 100 determines that a solo performance by the performer corresponding to the video data M1 has begun. The determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 suspends the karaoke performance of the interlude of the musical piece X. The performer corresponding to the video data M1 performs a solo performance freely. Furthermore, the performers corresponding to the video data M2 and M3 perform performances supporting the solo performance.

[0097] Here, the performance data acquisition unit 300 acquires performance data corresponding to live performances by performers corresponding to the video data M1 to M3, and outputs the data to the extraction unit 400.

[0098] The extracting unit 400 extracts tempo information indicating the tempo Ts based on the acquired performance data corresponding to the live performance. The extracting unit 400 outputs the extracted tempo information to the performance control unit 200.

[0099] On the other hand, after determining that the performer corresponding to the video data M1 has started a solo performance, the determination unit 100 monitors the luminance value of the video data M1. The determination unit 100 determines whether the luminance value of the video data M1 satisfies a predetermined condition. If the determination unit 100 determines that the luminance value calculated for the video data M1 does not satisfy the predetermined condition, the determination unit 100 determines that the solo performance by the performer corresponding to the video data M1 has ended. The determination unit 100 notifies the performance control unit 200 of this fact.

[0100] The performance control unit 200 compares the tempo Ts indicated by the extracted tempo information with the tempo To that is preset for the musical piece X.

[0101] If the tempo values ​​are different, the performance control unit 200 resumes the karaoke performance of the song X at the tempo Ts from the verse of the second verse, which is the singing section following the chorus of the first verse, where the karaoke performance was being performed immediately before the solo performance started. Note that the performance control unit 200 may resume the karaoke performance at the tempo indicated by the extracted tempo information without comparing the tempo indicated by the tempo information with the tempo preset for the song X.

[0102] As is clear from the above, the karaoke device K according to this embodiment includes a performance data acquisition unit 300 that acquires performance data corresponding to a live performance by a performer, and an extraction unit 400 that extracts tempo information based on the acquired performance data after the performer starts a solo performance. The performance control unit 200 according to this embodiment resumes the karaoke performance of the song based on the extracted tempo information.

[0103] With this karaoke device K, if the tempo of a song changes during a solo performance, the tempo of the karaoke performance after the solo performance ends can be adjusted to match the tempo of the solo performance, allowing the user to continue enjoying karaoke singing in sync with the tempo of the solo performance.

[0104] <Third embodiment> A karaoke device according to a third embodiment will be described with reference to Figures 7 and 8. In this embodiment, an example will be described in which performance data of a musical instrument is used to determine the start and end of a solo performance. Descriptions of the same configuration as in the first embodiment will be omitted.

[0105] [Control means] In this embodiment, the CPU executes a program stored in the memory, causing the control means 10e to function as a determination section 100, a performance control section 200, and a performance data acquisition section 300 (see FIG. 7).

[0106] (Performance data acquisition section) The performance data acquisition unit 300 acquires performance data corresponding to a live performance by a performer.

[0107] In this embodiment, the performance data acquisition section 300 starts acquiring performance data from the moment a live performance of an instrument begins.

[0108] As in the second embodiment, performance data can be acquired using a sound collection means (not shown) such as a microphone installed in a karaoke venue. In live performance mode, a performer performs a live musical instrument performance. The performance data acquisition unit 300 instructs the sound collection means to collect the sound of the live performance. The sound collection means begins collecting the performance sound in response to the instruction. The sound collection means outputs data corresponding to the collected performance sound to the performance data acquisition unit 300. The performance data acquisition unit 300 acquires the data corresponding to the performance sound as performance data. On the other hand, when the live performance ends (i.e., when the karaoke performance ends), the performance data acquisition unit 300 instructs the sound collection means to stop collecting the sound of the live performance. The sound collection means stops collecting the performance sound in response to the instruction. Note that in this embodiment, performance data is acquired for each instrument. Here, if the instrument used in the live performance is an electric or electronic instrument, the performance data acquisition unit 300 can acquire performance data based on a performance signal input to an instrument amplifier.

[0109] (Judgment Department) The judgment unit 100 in this embodiment judges the start of a solo performance based on the acquired performance data and start judgment data previously set for each instrument, and judges the end of a solo performance based on the acquired performance data and end judgment data previously set for each instrument.

[0110] The start determination data is data for determining the start of a solo performance. Specifically, the start determination data is information indicating the pitch sequence and rhythm pattern when a solo performance starts. The end determination data is data for determining the end of a solo performance. Specifically, the end determination data is information indicating the pitch sequence and rhythm pattern when a solo performance ends. The start determination data and end determination data are set in advance for each instrument. The start determination data and end determination data are stored, for example, in the storage means 10a.

[0111] As described in the first embodiment, in the live performance mode, the performer plays a live musical instrument in time with the karaoke performance sounds emitted from the speaker 20. The user can sing karaoke in time with the karaoke performance sounds and the musical instrument performance sounds emitted from the speaker 20.

[0112] The performance data acquisition unit 300 starts acquiring performance data when a live performance of an instrument starts, and outputs the acquired performance data to the determination unit 100.

[0113] The determination unit 100 determines whether a solo performance has started based on the output performance data and the start determination data. For example, when the determination unit 100 detects a pitch sequence (phrase) indicated by the start determination data of any musical instrument from the output performance data, the determination unit 100 determines that a solo performance has started.

[0114] On the other hand, after determining the start of a solo performance, the determination unit 100 determines whether the solo performance has ended based on the output performance data and the end determination data. For example, the determination unit 100 determines that the solo performance has ended when a pitch sequence (phrase) indicated by the end determination data of the instrument corresponding to the start determination is detected from the output performance data from which it has been determined that a solo performance has started.

[0115] ==About the operation of the karaoke device K== Next, a specific example of the operation of the karaoke device K in this embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the operation of the karaoke device K. In this example, it is assumed that a user U uses the karaoke device K in a karaoke establishment KS (see Fig. 1). It is also assumed that performers P1 to P3 are on stage as live musical instrument performers (see Fig. 1). It is also assumed in this example that the user U sings a song X in karaoke in live performance mode. It is also assumed that the song X is composed of singing sections and non-singing sections such as an introduction, an A-melody of the first verse, a B-melody of the first verse, a chorus of the first verse, an interlude, an A-melody of the second verse, a B-melody of the second verse, and so on.

[0116] The performance control unit 200 acquires karaoke performance data for song X from the storage means 10a based on the song ID of song X registered in the reservation queue. The performance control unit 200 controls the performance means 10d to play the acquired karaoke performance data and emit karaoke performance sounds from the speaker 20 (starting karaoke performance of the song; step 30). Performers P1 to P3 each perform live musical instruments in sync with the karaoke performance sounds emitted from the speaker 20. User U sings karaoke in sync with the karaoke performance sounds and instrumental performance sounds emitted from the speaker 20.

[0117] The performance data acquisition unit 300 starts acquiring performance data when the live performance of the musical instrument begins (start acquiring performance data; step 31). The performance data acquisition unit 300 outputs the acquired performance data to the determination unit 100.

[0118] The determination unit 100 performs a process to determine whether the performer has started a solo performance based on the output performance data and start determination data. If the determination unit 100 determines that a solo performance has started (Y in step 32), it notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 suspends the karaoke performance of the piece X (suspend karaoke performance; step 33). This allows the performer to freely perform the solo performance.

[0119] On the other hand, after determining that the solo performance has started, the determination unit 100 performs a process of determining whether the performer's solo performance has ended based on the output performance data and end determination data. If the determination unit 100 determines that the solo performance has ended (Y in step 34), it notifies the performance control unit 200 of that fact. In response to the notification, the performance control unit 200 resumes the karaoke performance of song X from the singing section following the singing section in which the karaoke performance was performed immediately before the solo performance started (the karaoke performance of song X is resumed from the singing section following the singing section in which the karaoke performance was performed immediately before the solo performance started; step 35).

[0120] The karaoke device K repeats the processes from step 32 to step 35 until the karaoke performance of the piece of music X is completed (if Y in step 36).

[0121] Specifically, the determination unit 100 uses known phrase detection and pattern detection techniques to detect a pitch sequence (phrase) indicated by one of the start determination data for each instrument from the output performance data of a predetermined length. If the pitch sequence indicated by the start determination data for the guitar is detected from the output performance data of a predetermined length, the determination unit 100 determines that a guitar solo performance has started. The determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 pauses the karaoke performance of song X. The guitar player P1 then freely performs a solo performance. If it is not determined that a solo performance has started for the output performance data of a predetermined length, the determination unit 100 performs the same process on other performance data of a predetermined length output at the same timing. The determination unit 100 repeats this process by incrementing the start timing of the performance data of a predetermined length until it determines that a solo performance has started.

[0122] Meanwhile, after determining the start of a guitar solo performance, the determination unit 100 uses known phrase detection technology or pattern detection technology to detect the pitch sequence (phrase) indicated by the end determination data for the instrument corresponding to the start determination from the output performance data for which it has been determined that a solo performance has started. If the pitch sequence indicated by the guitar end determination data is detected from the performance data, the determination unit 100 determines that the guitar solo performance has ended. The determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 resumes the karaoke performance of song X from the verse of the second verse, which is the singing section following the chorus of the first verse, where the karaoke performance was being performed immediately before the solo performance began.

[0123] As is clear from the above, the karaoke device K according to this embodiment has a performance data acquisition unit 300 that acquires performance data corresponding to a live performance by a performer. The determination unit 100 according to this embodiment determines the start of a solo performance based on the acquired performance data and start determination data previously set for each instrument, and determines the end of a solo performance based on the acquired performance data and end determination data previously set for each instrument.

[0124] With this karaoke device K, it is possible to determine the start and end of a solo performance without using video data as in the first embodiment. Therefore, even in a karaoke store that does not have a video recording device, the degree of freedom of the solo performance can be increased when a performer plays a live instrument along with the karaoke performance sound.

[0125] It should be noted that when determining the start and end of a solo performance, the processes of the first and third embodiments may be combined.

[0126] For example, the determination section 100 may determine the start of a solo performance based on video data and the end of the solo performance based on performance data and end determination data. Conversely, the determination section 100 may determine the start of a solo performance based on performance data and start determination data and the end of the solo performance based on video data.

[0127] Alternatively, the determination unit 100 may make a determination based on both the video data and the performance data and the start determination data. For example, if the determination unit 100 determines that the luminance value calculated for the video data satisfies a predetermined condition and if a pitch sequence indicated by any of the start determination data is detected in the performance data, the determination unit 100 determines that a solo performance has started. Alternatively, the determination unit 100 may make a determination based on both the video data and the performance data and the end determination data. For example, if the determination unit 100 determines that the luminance value calculated for the video data does not satisfy a predetermined condition and if a pitch sequence indicated by the end determination data is detected in the performance data, the determination unit 100 determines that a solo performance has ended.

[0128] <Modification> When a live performance is performed by multiple performers, such as performers P1 to P3 shown in FIG. 1, each of the performers may also perform a solo performance.

[0129] In such a case, the determination section 100 may not determine the start of a solo performance by one performer while another performer is performing a solo performance.

[0130] As in the first embodiment, when the performance control unit 200 determines that a solo performance by a performer has ended, it resumes the karaoke performance of the song from the singing section following the singing section in which the karaoke performance was being performed immediately before the solo performance began. Furthermore, if the performance control unit 200 determines that a solo performance will begin again after the karaoke performance has resumed, it pauses the karaoke performance again. Here, in this modified example, if the time from the resumption of the karaoke performance to the start of the new solo performance is within a predetermined time, the performance control unit 200 resumes the karaoke performance of the song from the singing section following the singing section in which the karaoke performance was being performed immediately before the start of the solo performance by the first performer. The predetermined time is preset, for example, to 2000 msec.

[0131] For example, as described in the first embodiment, suppose that the performance control unit 200 resumes the karaoke performance of song X from the A-melody of the second verse, which is the singing section following the chorus of the first verse, where the karaoke performance was being performed immediately before the solo performance by the performer corresponding to video data M1 began.

[0132] The determination unit 100 continues to calculate the brightness value for each of the video data M1 to M3 and determines whether the brightness value satisfies the predetermined condition. For example, assume that 500 msec after the start of the karaoke performance of the A-melody of the second verse, the determination unit 100 determines that the brightness value calculated for the video data M2 satisfies the predetermined condition. In this case, the determination unit 100 determines that a solo performance by the performer corresponding to the video data M2 has begun. The determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 again pauses the karaoke performance of the song X.

[0133] Meanwhile, after determining that the performer corresponding to video data M2 has started a solo performance, the determination unit 100 monitors the luminance value of video data M2. The determination unit 100 determines whether the luminance value of video data M2 satisfies a predetermined condition. If the determination unit 100 determines that the luminance value calculated for video data M2 does not satisfy the predetermined condition, the determination unit 100 determines that the solo performance by the performer corresponding to video data M2 has ended. The determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 resumes the karaoke performance of song X from the verse of the second verse, which is the singing section following the chorus of the first verse, where the karaoke performance was being performed immediately before the solo performance by the performer corresponding to video data M1 started.

[0134] Such a karaoke device K allows multiple performers to smoothly take turns playing solos.

[0135] Alternatively, the determination unit 100 may determine the start of a solo performance by each performer individually. In this case, the performance control unit 200 will not resume the karaoke performance until all performers have finished their solo performances.

[0136] For example, as described in the first embodiment, suppose that the determination unit 100 determines that a solo performance by the performer corresponding to the video data M1 has begun during the interlude of the musical piece X. The determination unit 100 notifies the performance control unit 200 of this determination. In response to this notification, the performance control unit 200 suspends the karaoke performance of the musical piece X.

[0137] Similarly, the determination unit 100 analyzes the video data M2 and M3 to determine whether a solo performance by a performer has started. Here, it is assumed that the determination unit 100 determines that a solo performance by the performer corresponding to the video data M2 has started.

[0138] After determining that the performers corresponding to the video data M1 and M2 have started solo performances, the determination unit 100 monitors the luminance values ​​of the video data M1 and M2. The determination unit 100 determines whether the luminance values ​​of the video data M1 and M2 each satisfy a predetermined condition. If the determination unit 100 determines that neither the luminance value calculated for the video data M1 nor the luminance value calculated for the video data M2 satisfy the predetermined condition, the determination unit 100 determines that the solo performances of the performers corresponding to the video data M1 and M2 have ended. The determination unit 100 notifies the performance control unit 200 of this fact. In response to this notification, the performance control unit 200 resumes the karaoke performance of the song X from the verse of the second verse, which is the singing section following the chorus of the first verse, where the karaoke performance was being performed immediately before the solo performance began.

[0139] On the other hand, if it is determined that only one of the luminance values ​​obtained for the video data M1 and the luminance values ​​obtained for the video data M2 does not satisfy the predetermined condition, the determining section 100 does not determine that the solo performance has ended.

[0140] Such a karaoke device K allows players of different instruments to freely perform solo performances together (for example, a drummer may start a solo performance first and then join in with a bass player midway through).

[0141] <Other> The above-described embodiments are presented as examples and do not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The above-described embodiments and their modifications are included in the scope and spirit of the invention, as well as in the inventions described in the claims and their equivalents. [Explanation of symbols]

[0142] 100 Judgment section 200 Performance control unit 300 Performance data acquisition unit 400 Extraction part K Karaoke equipment

Claims

1. a determination unit that determines the start and end of a solo performance by a live performer of an instrument who is playing the music in sync with the karaoke performance sound of the song; a performance control unit that, when it is determined that a solo performance has started, suspends the karaoke performance of the song, and, when it is determined that the solo performance has ended, resumes the karaoke performance of the song from the singing section next to the singing section in which the karaoke performance was being performed immediately before the solo performance started; and The determination unit determines the start and end of a solo performance by a performer based on video data obtained by filming the performer.

2. 2. The karaoke apparatus according to claim 1, wherein the performance control unit, when restarting the karaoke performance of a song, performs a karaoke performance of an introductory portion of the song and then starts a karaoke performance of a next singing section.

3. 3. The karaoke apparatus according to claim 1, wherein the performance control unit, when determining that a solo performance has started, causes the karaoke performance sound of the song to fade out and then suspends the karaoke performance.

4. a performance data acquisition unit that acquires performance data corresponding to a live performance by the performer; an extracting unit that extracts tempo information based on the acquired performance data after the solo performance by the performer has started; and 4. The karaoke apparatus according to claim 1, wherein the performance control unit resumes the karaoke performance of the song based on the extracted tempo information.

5. a performance data acquisition unit that acquires performance data corresponding to a live performance by the performer; 5. The karaoke apparatus according to claim 1, wherein the determination unit determines the start of a solo performance based on the acquired performance data and start determination data previously set for each instrument, and determines the end of a solo performance based on the acquired performance data and end determination data previously set for each instrument.

Images