Karaoke device

The karaoke device identifies objects on content cards and detects user keywords to recommend associated videos, improving user engagement and content utilization through interactive content recommendation.

JP2024168813APending Publication Date: 2024-12-05DAIICHI KOSHO COMPANY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023085774
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-24
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing karaoke devices lack a mechanism to effectively recommend the use of installed content to users, especially when special cards featuring idols or characters are distributed.

Method used

A karaoke device equipped with a photographing means to identify objects on content cards, a sound collecting means to detect keywords, and a determination unit to recommend associated content videos based on user interaction.

Benefits of technology

Encourages users to utilize content by displaying recommended videos when specific keywords are detected, enhancing user engagement and content utilization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168813000001_ABST
    Figure 2024168813000001_ABST
Patent Text Reader

Abstract

To provide a Karaoke device that encourages use of an installed content by utilizing special cards distributed to users.SOLUTION: In a Karaoke device that recommends use of content to users by using multiple content cards that each show a different subject, and that is equipped with a Karaoke main unit, speakers, a display device, a microphone, and a remote control device, the Karaoke main unit 10 includes: an identification section that identifies a predetermined subject shown on the content card; a determination section that determines whether or not a sound collected by sound collection means corresponding to the shooting means contains the predetermined keyword corresponding to the identified object; and control means 10e that includes a display control section that displays the recommended video corresponding to the predetermined keyword on the display means at a timing when Karaoke performance is not being performed.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a karaoke machine. [Background technology]

[0002] In addition to the singing function, karaoke machines are equipped with various content such as a scoring function and a game function.

[0003] For example, there is a content that allows users to enjoy original videos of gravure idols as background videos for karaoke (see Non-Patent Document 1). In addition, for the purpose of strengthening sales promotion, cards with images of gravure idols appearing in the content may be distributed to users. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Grakara DX Daiichi Kosho Co., Ltd., [Retrieved May 20, 2023], Internet<URL:https: / / www.clubdam.com / movie / gurakaradx / > Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide a karaoke machine that utilizes a dedicated card distributed to a user and is capable of encouraging the use of the installed content. [Means for solving the problem]

[0006] One invention for achieving the above-mentioned object is a karaoke device that uses a plurality of content cards, each of which depicts a different object, to recommend content to a user, the karaoke device having an identification unit that identifies a specific object depicted on the content card from an image of the user captured by an imaging means, a determination unit that, when the specific object is identified, determines whether or not a specific keyword associated with the specific object is included in the sound collected by an audio collection means associated with the imaging means, and a display control unit that, when it is determined that the specific keyword is included, causes a display means to display a recommended image of the content associated with the specific keyword at a time when karaoke performance is not being performed. Other features of the present invention will become apparent from the following specification and drawings. Effect of the Invention

[0007] According to the present invention, it is possible to utilize a dedicated card distributed to a user and to recommend the use of the installed content. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a karaoke store according to an embodiment. [Diagram 2] 1 is a diagram showing a karaoke device according to an embodiment; [Diagram 3] FIG. 2 is a diagram showing a karaoke main unit according to the embodiment. [Figure 4] FIG. 4 is a diagram showing a table stored in a storage unit according to the embodiment. [Diagram 5] 4 is a flowchart showing a process of the karaoke device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] <Embodiment> A karaoke device according to an embodiment will be described with reference to FIGS. 1 to 5.

[0010] ==Karaoke store== A karaoke store is a place where customers can sing karaoke. Karaoke stores are equipped with karaoke machines.

[0011] A karaoke machine is a device for playing karaoke songs and for users to sing karaoke. The karaoke machine is equipped with various contents. The karaoke machine according to this embodiment uses multiple content cards and can recommend the use of the contents to the user.

[0012] The content cards are distributed to users who visit a karaoke store. The content cards are cards that show an image of an object that appears in the content. Each of the multiple content cards shows a different object. The object may be a real person such as a cast member or an idol, or may be an anime or game character.

[0013] In addition, each seat in the karaoke store is provided with an imaging means for imaging the user and a sound collecting means for collecting the sound uttered by the user. The imaging means and sound collecting means for each seat are associated in advance. The imaging means is preferably provided in a position where it is easy to image the user looking at the content card (for example, on the ceiling of the seat). In addition, the sound collecting means is preferably provided in a position where it is easy to collect the sound uttered by the user (for example, between the table and chair of the seat).

[0014] As shown in Fig. 1, a karaoke device K according to this embodiment is installed in a karaoke store S. The karaoke device K is loaded with content P. The content P is a content in which, when a song by a specific idol is selected and reserved, a dedicated background image corresponding to the specific idol is displayed as the background image during the karaoke performance of the song, instead of a normal background image (i.e., a background image previously associated with the song).

[0015] A user U is a person who uses a karaoke store S. On a table T in the seating area of ​​the user U, a number of content cards p1 to p4 distributed at the karaoke store S are placed. The content cards p1 to p4 show facial images of idols GA1 to GA4 who appear in the content P.

[0016] A camera C for photographing the user U and a microphone M for collecting sounds uttered by the user U are provided near the table T. The karaoke device K stores the camera C and the microphone M in association with each other. The camera C is an example of a photographing means, and the microphone M is an example of a sound collecting means. Note that while FIG. 1 shows one table T, karaoke establishments generally have multiple customer seats (i.e., multiple tables and cameras and microphones corresponding to each seat are provided).

[0017] ==Karaoke Equipment== As shown in FIG. 2, the karaoke device K includes a karaoke main unit 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

[0018] The karaoke main unit 10 performs various controls related to karaoke performance and singing, such as controlling the karaoke performance of songs, controlling the display of lyrics and background images, and processing audio signals input through the microphone 40. The speaker 20 is configured to emit sound based on a signal from the karaoke main unit 10. The display device 30 is configured to display videos and images on a screen based on a signal from the karaoke main unit 10. The microphone 40 is configured to convert the singing voice of the user singing karaoke into an analog audio signal and input it to the karaoke main unit 10. The remote control device 50 is a device for operating the karaoke main unit 10.

[0019] 3, the karaoke machine 10 according to this embodiment includes a storage means 10a, a communication means 10b, an input means 10c, a performance means 10d, and a control means 10e. Each of these components is connected to a bus B via an interface (not shown).

[0020] [Storage means] The storage means 10a is a large-capacity storage device that stores various data. The storage means 10a stores music data. The music data is provided with music identification information. The music identification information is information unique to each music piece, such as a music ID for identifying the music piece. The music data includes karaoke performance data, reference data, and the like.

[0021] In addition, the storage means 10a stores, for each song, background image data corresponding to the background image displayed during karaoke performance, lyric subtitle data for displaying the lyrics of the song, and attribute information of the song (song title, singer name, genre, performance time, etc.).

[0022] Here, the storage means 10a according to the present embodiment stores a content table. The content table is a table that the karaoke device refers to when recommending a certain content to a user. In the content table, identification information of the object, a predetermined keyword, an image for identifying the object, a dedicated background image, and a recommended image are associated with each object.

[0023] The identification information of the object is information unique to each object, such as an object ID for identifying the object. The predetermined keyword is a term set in advance, such as the name or nickname of the object, or a predetermined term (cute, beautiful, etc.). Only one predetermined keyword may be set, or multiple different keywords may be set. The image for identifying the object is an image unique to each object, such as a face image or a half-body image of the object. The dedicated background video is an image unique to each object, such as an image video of the object or a newly shot video in which the object appears. The recommended video is an image for recommending the use of the content, such as an introductory video of the content or a digest video of the object appearing in the content. The recommended video may include an introductory audio of the content. In addition, the data of the image for identifying the object, the dedicated background video, and the recommended video are stored in the storage means 10a.

[0024] FIG. 4 is a diagram showing a table corresponding to content P. In the table of FIG. 4, an idol ID, idol name, face image, dedicated background video, and recommended video are associated with each idol. The idol ID is an example of "target identification information", the idol name is an example of "predetermined keyword", and the face image is an example of "image for identifying a target". In this example, the same recommended video RV is associated with all idols. Note that different recommended videos may be associated with each idol.

[0025] [Communication means / input means] The communication means 10b provides an interface for communicating with the outside. The input means 10c is configured to allow employees of the karaoke store or users of the karaoke store S to input instructions. The input means 10c is a button or the like provided on the karaoke main unit 10. Alternatively, the remote control device 50 may function as the input means 10c.

[0026] [Means of performance] The performance means 10d, under the control of the control means 10e, performs karaoke performance of music pieces and processes signals based on singing voices input through the microphone 40. The performance means 10d includes a sound source, a mixer, an amplifier, etc. (none of which are shown).

[0027] [Control Means] The control means 10e performs various controls in the karaoke device K. The control means 10e includes a CPU and a memory (neither of which are shown in the figures). The CPU realizes various functions by executing programs stored in the memory.

[0028] In this embodiment, the CPU executes a program stored in the memory, whereby the control means 10e functions as a specification unit 100, a determination unit 200, and a display control unit 300 (see FIG. 3).

[0029] (Specific part) The identifying section 100 identifies a predetermined object appearing on the content card from an image of the user captured by the image capturing means.

[0030] The image capturing by the image capturing means is performed at a predetermined timing from when the user takes his / her seat until when he / she leaves. For example, the image capturing means may capture images continuously from when the user takes his / her seat until when he / she leaves. Alternatively, the image capturing means may capture images at regular intervals, such as every 30 seconds or every 5 minutes. The image capturing means transmits the captured image of the user to the karaoke device K.

[0031] The identification unit 100 analyzes the video of the user captured by the imaging means, and extracts an image of the target shown on the content card. A known method can be used for analyzing the video. The identification unit 100 compares the extracted image of the target with an image for identifying the target included in the content table, and identifies the matching target as the specified target. The identification unit 100 outputs identification information of the identified specified target to the determination unit 200.

[0032] In addition, if the result of analyzing the user's video shows that the content card is not included or the target in the video is not clear, the identifying unit 100 does not identify the target. Therefore, the karaoke device K does not perform the following process.

[0033] (Judgment Department) When a predetermined target is specified, the determination unit 200 determines whether or not a predetermined keyword associated with the predetermined target is included in the sound collected by the sound collection means associated with the imaging means.

[0034] The sound used for the judgment is collected at a predetermined time. The predetermined time is, for example, a certain time (for example, 10 seconds, 30 seconds) after the predetermined target is specified. Alternatively, the predetermined time may be the timing from when the predetermined target is specified to when the specified target is no longer included in the image captured by the image capture means.

[0035] When the identification unit 100 identifies a predetermined target, the determination unit 200 refers to a table stored in the storage means 10a and reads out a predetermined keyword associated with the identification information of the identified predetermined target. The determination unit 200 analyzes the sound collected by the sound collection means for a predetermined time and determines whether the read-out predetermined keyword is included. A publicly known method can be used for analyzing the sound. The determination of whether the predetermined keyword is included is made, for example, by converting the analyzed sound into text and checking whether all of the text corresponding to the predetermined keyword is included.

[0036] Furthermore, the determining unit 200 may determine that a predetermined keyword is included when the predetermined keyword is included a predetermined number of times or more.

[0037] The predetermined number of times is preset to a value of one. For example, the determination unit 200 analyzes the voice collected by the sound collection means, and checks whether the read-out predetermined keyword is included, and if so, how many times it is included. If the predetermined keyword is included the predetermined number of times or more, the determination unit 200 determines that the voice contains the predetermined keyword.

[0038] In addition, there are cases where a predetermined keyword is made up of a plurality of different keywords. In this case, the determination unit 200 can determine that the predetermined keyword is included when all of the keywords are included.

[0039] For example, assume that the predetermined keyword consists of three keywords. In this case, the determination unit 200 analyzes the voice collected by the sound collection means and checks whether the voice contains all three read keywords. If the voice contains all three keywords, the determination unit 200 determines that the voice contains the predetermined keyword.

[0040] (Display control unit) When it is determined that a predetermined keyword is included, the display control unit 300 causes the display means to display a recommended video of the content associated with the predetermined keyword at a time when karaoke is not being performed.

[0041] When the determining unit 200 determines that the predetermined keyword is included, the display control unit 300 refers to the table stored in the storage means 10a and reads out data of the recommended video associated with the predetermined keyword.

[0042] The display control unit 300 also checks whether karaoke is being performed on the karaoke device K. When karaoke is not being performed, the display control unit 300 plays the read data of the recommended video and displays the recommended video on the display screen of the display device 30. The display device 30 is an example of a "display means."

[0043] ==About the operation of the karaoke machine== Next, a specific example of the operation of the karaoke device K in this embodiment will be described with reference to Fig. 5. Fig. 5 is a flow chart showing the operation of the karaoke device K. In this example, the operation of the karaoke device K in the karaoke shop S shown in Fig. 1 will be described. It is also assumed that the karaoke device K stores the table shown in Fig. 4.

[0044] A user U visits a karaoke store S and arranges the distributed content cards p1 to p4 on a table T. When the user U takes his / her seat, a camera C starts photographing the user U. The karaoke device K receives the video captured by the camera C (receiving the video captured by the camera; step 10).

[0045] The identifying unit 100 identifies a predetermined object appearing on the content card from the video of the user U captured by the camera C (identifying a predetermined object appearing on the content card; step 11).

[0046] As a specific example, the identification unit 100 analyzes an image of the user U's hand in the video and checks whether a person's face is shown in the video. Here, it is assumed that the user U picks up a content card p1 and looks at it. It is also assumed that the face of idol GA1 is shown on the content card p1.

[0047] In this case, the identification unit 100 extracts the face image of the idol GA1 from the content card p1. The identification unit 100 compares the extracted face image of the idol GA1 with the face images of each idol included in the content table stored in the storage means 10a, and identifies the matching idol GA1 as a predetermined target. The identification unit 100 outputs the idol ID ***GA1 of the idol GA1 to the determination unit 200.

[0048] Next, when a predetermined target is identified in step 11, the microphone M starts collecting the voice uttered by the user U. The karaoke device K receives the voice collected by the microphone M (receiving voice collected by microphone; step 12).

[0049] The judgment unit 200 judges whether the voice collected by the microphone M associated with the camera C contains a predetermined keyword associated with the predetermined target (determines whether the voice contains the predetermined keyword; step 13).

[0050] If it is determined that a predetermined keyword is included (Y in step 14), the display control unit 300 causes the display device 30 to display a recommended video of the content associated with the predetermined keyword at a time when karaoke is not being performed (displaying the recommended video; step 15).

[0051] In the above example, when the determination unit 200 receives the input of the idol ID ***GA1 output from the identification unit 100, it reads out the keyword "GA1 (idol name)" associated with the idol ID ***GA1 from the table stored in the storage means 10a. The determination unit 200 analyzes the sound collected by the microphone M associated with the camera C, and determines whether the read-out keyword "GA1" is included.

[0052] Here, it is assumed that the user U, while looking at the content card p1 of the idol GA1, murmurs, "GA1 is great."

[0053] In this case, the microphone M collects the voice of the user U muttering "GA1-chan is great" and transmits it to the karaoke device K. The determination unit 200 analyzes the collected voice and determines whether the read keyword "GA1" is included. In this example, the keyword "GA1" is included in the voice. Therefore, the determination unit 200 outputs the determination result that the predetermined keyword is included to the display control unit 300. Note that if the predetermined keyword is not included, the karaoke device K does not carry out the subsequent processes.

[0054] When the display control unit 300 receives an input of a determination result that a predetermined keyword is included, it checks whether or not a karaoke performance is being performed at that time (specifically, the display control unit 300 checks whether or not the performance means 10d is operating). If a karaoke performance is not being performed, the display control unit 300 reads out the video data of the recommended video RV associated with the keyword "GA1" from the storage means 10a, and displays it on the display device 30. By displaying such a recommended video RV, it is possible to recommend the use of the content P to the user U.

[0055] As is clear from the above, the karaoke device K according to this embodiment is a device for recommending the use of content to a user by using a plurality of content cards each showing a different object. The karaoke device K has an identification unit 100 for identifying a predetermined object shown on the content card from an image of the user captured by a capture unit, a determination unit 200 for determining whether or not a predetermined keyword associated with the predetermined object is included in the sound collected by a sound collection unit associated with the capture unit when the predetermined object is identified, and a display control unit 300 for displaying a recommended image of the content associated with the predetermined keyword on a display unit when the karaoke performance is not being performed when the predetermined keyword is determined to be included.

[0056] With such a karaoke device K, it is possible to recommend the use of content to a user who is interested in an object shown on a content card based on the image of the user and the voice of the user. That is, with the karaoke device K according to this embodiment, it is possible to recommend the use of the content stored in the card by utilizing the dedicated card distributed to the user.

[0057] Furthermore, the determination unit 200 of the karaoke device K according to this embodiment can determine that the predetermined keyword is included when the predetermined keyword is included a predetermined number of times or more. Alternatively, in this embodiment, the predetermined keyword is composed of a plurality of different keywords, and the determination unit 200 can determine that the predetermined keyword is included when all the keywords are included. With such a karaoke device K, it is possible to more accurately determine whether the predetermined keyword is included in the voice uttered by the user (i.e., whether the user is interested in the object depicted on the content card).

[0058] <Modification> In the example embodiment, a user who wishes to use the recommended content must inform a karaoke store employee of his / her intention to use the content and have the content set up, or must set the content himself / herself when reserving a song, which is cumbersome.

[0059] Therefore, in this modified example, when a karaoke performance of a song is scheduled while a recommended video for a content is being displayed, the display control unit 300 can cause the display means to display a dedicated background video associated with a specified target as the background video during the karaoke performance.

[0060] For example, in the embodiment, assume that a user U, who is viewing a recommended video RV for content P, operates remote control device 50 while the recommended video RV is being displayed, and selects a song X that the user wishes to sing karaoke through a song selection screen. Remote control device 50 transmits the song ID of the song X selected by user U to karaoke device K. Karaoke device K registers the received song ID in a reservation queue, thereby reserving a karaoke performance of song X.

[0061] The karaoke device K acquires karaoke performance data of the song X from the storage means 10a based on the song ID registered in the reservation queue. The karaoke device K outputs the acquired karaoke performance data to the performance means 10d. The karaoke device K controls the performance means 10d to reproduce the karaoke performance data of the song X and emit karaoke performance sounds from the speaker 20.

[0062] At this time, the display control unit 300 reads out the video data of a dedicated background video corresponding to the idol ID ***GA1 from the storage means 10a, and displays the dedicated background video on the display device 30 using the read out video data instead of the background video data of the song X.

[0063] As is clear from the above, the display control unit 300 of the karaoke device K according to this modification can display a dedicated background image associated with a predetermined target on the display means as a background image during the karaoke performance when a karaoke performance of a song is reserved while a recommended video of the content is being displayed. With such a karaoke device K, the recommended content can be automatically performed according to the song selected by the user. Meanwhile, the user can enjoy the recommended content simply by reserving a song.

[0064] <Other> The above-mentioned embodiments are presented as examples and do not limit the scope of the invention. The above-mentioned configurations can be implemented in appropriate combinations, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. The above-mentioned embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and gist of the invention. [Explanation of symbols]

[0065] 100 Specific part 200 Judgment section 300 Display control unit K Karaoke equipment

Claims

1. A karaoke device for recommending content to a user by using a plurality of content cards each showing a different object, comprising: an identification unit that identifies a predetermined object appearing on the content card from an image of the user captured by the image capture means; a determination unit that, when the predetermined target is specified, determines whether or not a predetermined keyword associated with the predetermined target is included in a sound collected by a sound collection unit associated with the image capture unit; a display control unit that, when it is determined that the predetermined keyword is included, displays a recommended video of the content associated with the predetermined keyword on a display unit at a timing when karaoke performance is not being performed; A karaoke device having the following features:

2. 2. The karaoke apparatus according to claim 1, wherein the determining unit determines that the predetermined keyword is included when the predetermined keyword is included a predetermined number of times or more.

3. the predetermined keyword is composed of a plurality of different keywords, 2. The karaoke device according to claim 1, wherein the determining unit determines that the predetermined keyword is included when all keywords are included.

4. The karaoke device according to any one of claims 1 to 3, characterized in that, when a karaoke performance of a song is reserved while the recommended video of the content is being displayed, the display control unit causes the display means to display a dedicated background video associated with the specified target as a background video for the karaoke performance.