Karaoke device

Abstract

To provide a Karaoke device capable of enlivening an atmosphere of a karaoke singing place and preventing it from becoming dull.SOLUTION: A Karaoke device includes: a storage processing unit for storing a face image of a user in a first storage unit and a second storage unit within prescribed time from a use start of a Karaoke room; a determination unit for determining whether the face image of a prescribed person is stored in the first storage unit or the second storage unit when the face image of the prescribed person is included in a video photographed by an outdoor camera after prescribed time elapses; and a sound emission processing unit for allowing sound emission means to emit first effective sound when a signal indicating that a door is opened is received from a door open / close sensor and the face image of the prescribed person is determined to be not stored in the first storage unit and stored in the second storage unit and allowing the sound emission means to emit second effective sound when the face image of the prescribed person is determined to be not stored in either the first storage unit and the second storage unit.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a karaoke machine. [Background technology]

[0002] When multiple users sing karaoke together, the audience may join in or applaud during the singing to liven up the atmosphere. Karaoke machines also have a function to output sound effects that mimic interjections and applause.

[0003] For example, Patent Document 1 discloses a karaoke device with a sound effect generating function that can generate sound effects at predetermined positions of preset parts.

[0004] Furthermore, Non-Patent Document 1 discloses a karaoke device having a function of outputting sound effects simulating the singing voices of an audience singing together with the singer under the acoustics of a live concert hall, and sound effects simulating a response from the audience when a specific word is uttered during an introduction or interlude. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2000-330574 A [Non-patent literature]

[0006] [Non-Patent Document 1] Excite Mode Daiichi Kosho Co., Ltd., [Retrieved August 5, 2023], Internet<URL:https: / / www.clubdam.com / tips / 202304_1_excitelivehall.html> Summary of the Invention [Problem to be solved by the invention]

[0007] An artist may release a song that features or collaborates with another artist (hereafter referred to as a collaboration song). When an artist sings a collaboration song at a live concert, they will invite other artists to sing along as part of the concert's production, making the concert even more exciting. In particular, if another artist appears while an artist is singing a collaboration song, the concert becomes even more exciting. On the other hand, if an unintended incident occurs, such as an excited audience member breaking onto the stage, the concert will lose its excitement.

[0008] An object of the present invention is to provide a karaoke device capable of livening up the atmosphere of a karaoke singing venue and preventing the excitement from dying down. [Means for solving the problem]

[0009] One invention for achieving the above object is a karaoke device communicably connected to an opening / closing sensor attached to a door of a karaoke room and an outdoor camera installed outside the karaoke room and near the door, the karaoke device comprising a first storage unit for storing facial images of users staying in the karaoke room, a second storage unit for storing facial images of users who plan to use the karaoke room together with the users staying in the karaoke room, a storage processing unit for storing the facial images of users in the first storage unit and the second storage unit within a predetermined time from the start of use of the karaoke room, and a storage processing unit for storing the facial images of users in the first storage unit and the second storage unit when the facial image of a person in the image captured by the outdoor camera after the predetermined time has elapsed. a determination unit that determines whether a facial image of the certain person is stored in the first memory unit or the second memory unit when a signal indicating that the door has been opened is received from the opening / closing sensor and it is determined that the facial image of the certain person is not stored in the first memory unit and is stored in the second memory unit, and a sound emitting processing unit that causes a sound emitting means to emit a first sound effect when a signal indicating that the door has been opened is received from the opening / closing sensor and it is determined that the facial image of the certain person is not stored in the first memory unit and is stored in the second memory unit, and that causes the sound emitting means to emit a second sound effect different from the first sound effect when a signal indicating that the door has been opened is received from the opening / closing sensor and it is determined that the facial image of the certain person is not stored in either the first memory unit or the second memory unit. Other features of the present invention will become apparent from the following specification and drawings. Effect of the Invention

[0010] According to the present invention, it is possible to liven up the atmosphere of a karaoke singing venue and prevent the excitement from dying down. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing a karaoke room according to an embodiment. [Diagram 2] 1 is a diagram showing a karaoke device according to an embodiment; [Diagram 3] FIG. 2 is a diagram showing a karaoke main unit according to the embodiment. [Figure 4]4 is a flowchart showing a process of the karaoke device according to the embodiment. [Figure 5A] FIG. 4 is a diagram showing a display screen of the remote control device according to the embodiment. [Figure 5B] FIG. 4 is a diagram showing a display screen of the remote control device according to the embodiment. [Figure 6A] FIG. 1 is a diagram showing a karaoke room according to an embodiment. [Figure 6B] FIG. 1 is a diagram showing a karaoke room according to an embodiment. [Figure 7] FIG. 13 is a diagram showing a karaoke main unit according to a first modified example. [Figure 8] FIG. 13 is a diagram showing a karaoke room according to a first modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] <Embodiment> The karaoke device according to the embodiment will be described with reference to FIGS. 1 to 6B.

[0013] ==Karaoke Equipment== A karaoke machine is a device for playing karaoke songs and for allowing users to sing karaoke. Karaoke machines are installed in karaoke rooms in karaoke stores.

[0014] The karaoke room is provided with a door for entering and exiting. An opening / closing sensor is attached to the door to detect whether the door is open or closed. An indoor camera is installed inside the karaoke room to take pictures of the interior of the room. An outdoor camera is installed outside the karaoke room near the door to take pictures of the area around the door. The karaoke device is connected to the opening / closing sensor, the indoor camera, and the outdoor camera via wired or wireless communication. The karaoke device starts communication with the indoor camera, the opening / closing sensor, and the outdoor camera at a predetermined timing (for example, when the power is turned on). The indoor camera and the outdoor camera transmit images captured continuously or at regular intervals to the karaoke device. When the opening / closing sensor detects whether the door is open or closed, it transmits a signal to that effect to the karaoke device.

[0015] The karaoke machine is communicably connected to an external server device. The server device is a computer that manages and processes various types of information. The server device is communicably connected to the karaoke machine via a network such as a public telephone line network or the Internet.

[0016] The server device stores user information. The user information is related to a user who uses the karaoke device. Specifically, the user information includes user identification information, name, nickname, a facial image of the user, gender, date of birth, singing history, scoring history, related person information, etc. User identification information is information unique to each user, such as a user ID for identifying the user. Related person information is user identification information, name, nickname, etc. of other people, such as the user's family and friends. User information is input by the user, for example, via the karaoke device (specifically, a remote control device described later). The karaoke device transmits the input user information to the server device. The server device stores the received user information in a storage means.

[0017] As shown in Fig. 1, a karaoke device K according to this embodiment is installed in a karaoke room R. A user U1 is a person who uses the karaoke device K (that is, the karaoke room R).

[0018] An indoor camera C1 is installed in the karaoke room R. An opening / closing sensor S is also attached to the door D. Furthermore, an outdoor camera C2 is installed outside the karaoke room R near the door D. Note that a single karaoke room may have multiple cameras. Also, multiple opening / closing sensors may be installed. Furthermore, the karaoke device may have at least one of an indoor camera, an outdoor camera, and an opening / closing sensor.

[0019] The karaoke device K is communicably connected to a server device SV. The server device SV stores user information of a user U1.

[0020] As shown in FIG. 2, the karaoke device K includes a karaoke main unit 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

[0021] The karaoke main unit 10 performs various controls related to karaoke performance and singing, such as controlling the karaoke performance of songs, controlling the display of lyrics and background images, and processing audio signals input through the microphone 40. The speaker 20 is configured to emit sound based on a signal from the karaoke main unit 10. The display device 30 is configured to display videos and images on a screen based on a signal from the karaoke main unit 10. The microphone 40 is configured to convert the singing voice of the user singing karaoke into an analog audio signal and input it to the karaoke main unit 10. The remote control device 50 is a device for operating the karaoke main unit 10.

[0022] 3, the karaoke machine 10 according to this embodiment includes a storage means 10a, a communication means 10b, an input means 10c, a performance means 10d, and a control means 10e. Each of these components is connected to a bus B via an interface (not shown).

[0023] [Storage means] The storage means 10a is a large-capacity storage device that stores various data. The storage means 10a stores music data. The music data is provided with music identification information. The music identification information is information unique to each music piece, such as a music ID for identifying the music piece. The music data includes karaoke performance data, reference data, and the like.

[0024] In addition, the storage means 10a stores, for each song, background image data corresponding to the background image displayed during karaoke performance, lyric subtitle data for displaying the lyrics of the song, and attribute information of the song (song title, singer name, genre, performance time, etc.).

[0025] In this embodiment, a part of the storage area of ​​the storage means 10 a functions as a first storage section 100 and a second storage section 200 .

[0026] (First memory unit) The first storage unit 100 is for storing face images of users staying in the karaoke room. The face images of the users can be those included in the user information received from the server device. Alternatively, the face images of the users can be extracted from images captured by an in-room camera (details will be described later).

[0027] (Second memory unit) The second storage unit 200 is for storing face images of users who are staying in the karaoke room as well as users who are scheduled to use the karaoke room. The face images of the users may be those included in the user information received from the server device (described in detail later).

[0028] The first storage unit 100 and the second storage unit 200 store face images of users in a certain group from when the group starts using the karaoke room until the group finishes using the karaoke room. On the other hand, when the group finishes using the karaoke room, the karaoke device K erases the face images stored in the first storage unit 100 and the second storage unit 200.

[0029] [Communication means / input means] The communication means 10b provides an interface for communicating with the outside. The input means 10c is a component for allowing a user to input instructions. The input means 10c is a button or the like provided on the karaoke main unit 10. Alternatively, the remote control device 50 may function as the input means 10c.

[0030] [Means of performance] The performance means 10d, under the control of the control means 10e, performs karaoke performance of music pieces and processes signals based on singing voices input through the microphone 40. The performance means 10d includes a sound source, a mixer, an amplifier, etc. (none of which are shown).

[0031] [Control Means] The control means 10e performs various controls in the karaoke device K. The control means 10e includes a CPU and a memory (neither of which are shown in the figures). The CPU realizes various functions by executing programs stored in the memory.

[0032] In this embodiment, the CPU executes a program stored in the memory, whereby the control means 10e functions as a storage processing unit 300, a determination unit 400, and a sound emission processing unit 500 (see FIG. 3).

[0033] (Memory Processing Unit) The storage processing unit 300 stores the face image of the user in the first storage unit 100 or the second storage unit 200 within a predetermined time from the start of use of the karaoke room.

[0034] The start of use of the karaoke room can be determined by various methods. For example, the karaoke device K can determine that use of the karaoke room has started when the user performs a login operation via the remote control device 50 and logs into the karaoke device K.

[0035] A known method can be used to log in to the karaoke device K. For example, a user who wishes to log in operates the remote control device 50 to input his / her own user identification information and a preset password. The karaoke device K transmits a login request including the input user ID and password to the server device SV. The server device SV reads out user information corresponding to the user ID included in the received login request from the storage means and transmits it to the karaoke device K. The karaoke device K that made the login request completes the login to the karaoke device K by storing the received user information in the storage means 10a.

[0036] Alternatively, the karaoke device K analyzes the video captured by the indoor camera to check whether the video includes a user's video. If there is no user in the karaoke room, the video does not include a user's video. In this case, the karaoke device K determines that the karaoke room is not in use. On the other hand, if a user's video is included at a certain timing, the karaoke device K determines that the user has started using the karaoke room.

[0037] The predetermined time is set on the assumption that some users may arrive late among multiple users who use the karaoke room. The predetermined time is set in advance to a certain time, such as 3 minutes or 5 minutes.

[0038] After a predetermined time has elapsed, the karaoke device K can determine that the use of the karaoke room has ended if all users have performed a logout operation. A known method can be used to log out from the karaoke device K. For example, the user selects a logout icon displayed on the display screen of the remote control device 50. The karaoke device K completes the logout from the karaoke device K by deleting the user information received from the server device from the storage means 10a. Alternatively, the karaoke device K can check the video transmitted from the indoor camera, and determine that the use of the karaoke room has ended if no video of the user is included for a certain period of time (for example, 15 minutes or more).

[0039] Here, the facial images of the users can be stored by various methods. For example, the storage processing unit 300 can use a batch login process. For the batch login process, for example, the technology disclosed in Japanese Patent Application Laid-Open No. 2007-22620 can be used. By performing the batch login, the facial images of all users who will be using the karaoke room together, including other users who are already in the karaoke room and other users who will arrive late, can be easily stored.

[0040] Specifically, it is assumed that the karaoke device K that has made the login request has completed the login by storing the user information of a certain user received from the server device SV in the storage means 10a.

[0041] In this case (i.e., when a certain user has completed logging in), the certain user is already in the karaoke room. Therefore, the storage processing unit 300 reads out a face image from the user information of the certain user and stores it in the first storage unit 100.

[0042] Next, the storage processing unit 300 causes a certain user to select users who are targets of collective login, based on related person information included in the user information of the certain user.

[0043] For example, storage processing unit 300 refers to related person information included in the user information of a certain user, and displays the user IDs and names of other users on the display screen of remote control device 50 along with an icon of "already entered" or "scheduled to enter." A certain user selects, from among the other displayed users who will use the karaoke room together, as a target for collective login, and selects the icon of "already entered" or "scheduled to enter." For example, if there is another user who entered the room with a certain user, the certain user selects the icon of "already entered" for that other user. On the other hand, if there is another user who is late, the certain user selects the icon of "scheduled to enter" for that other user.

[0044] After that, one user operates the remote control device 50 to make a collective login request. When the collective login request is received, the karaoke device K transmits the collective login request including the user IDs of the other selected users to the server device SV. The server device SV reads out user information corresponding to the user IDs included in the received collective login request from the storage means and transmits it to the karaoke device K. The karaoke device K that made the collective login request stores the received user information in the storage means 10a, thereby completing the collective login to the karaoke device K.

[0045] When the login of the other user is completed, the user who selected the icon "Already in the karaoke room" is already in the karaoke room. Therefore, the storage processing unit 300 reads out a face image from the user information of the other user and stores it in the first storage unit 100.

[0046] On the other hand, the other users who have selected the “planned entry” icon have not yet entered the karaoke room. Therefore, the storage processing unit 300 reads out face images from the user information of the other users and stores them in the second storage unit 200.

[0047] In addition, if there are multiple users who have already entered the room within a specified period of time, one user may perform a collective login for all users who are scheduled to enter the room, and each user other than the one user may perform the login operation described above.

[0048] Alternatively, as a method of storing the user's face image, the storage processing unit 300 can use an image captured by an indoor camera.

[0049] For example, a user who wishes to log in operates remote control device 50 and inputs his / her own user ID and a preset password.

[0050] The karaoke device K transmits a login request including the input user ID and password to the server device SV. The server device SV reads out user information corresponding to the user ID included in the received login request from the storage means and transmits it to the karaoke device K. The karaoke device K that made the login request stores the received user information in the storage means 10a, thereby completing the login to the karaoke device K.

[0051] The memory processing unit 300 reads a facial image from the user information of a certain user and stores it in the first memory unit 100, and also refers to related person information included in the user information of the certain user received from the server device SV, and displays the user identification information and names of other users on the display screen of the remote control device 50.

[0052] The user selects from the displayed other users a user with whom he or she wishes to use the karaoke room.

[0053] After that, one user operates the remote control device 50 to make a collective login request. When the collective login request is received, the karaoke device K transmits the collective login request including the user IDs of the other selected users to the server device SV. The server device SV reads out user information corresponding to the user IDs included in the received collective login request from the storage means and transmits it to the karaoke device K. The karaoke device K that made the collective login request stores the received user information in the storage means 10a, thereby completing the collective login to the karaoke device K. At this time, the karaoke device K analyzes the video transmitted from the in-room camera and extracts facial images of the users included in the video.

[0054] When the login of the other user is completed, the storage processing unit 300 reads out the face image from the user information of the other user stored in the storage means 10a. The storage processing unit 300 compares the read out face image with the extracted face image, and stores the matching face image in the first storage unit 100, and stores the non-matching face image in the second storage unit 200. By using the video captured by the indoor camera in this way, a user does not need to select whether the other user has entered the room or not when logging in all the other users at once. Therefore, the face image can be stored easily.

[0055] (Judgment Department) When the image captured by the outdoor camera after a predetermined time has elapsed contains a facial image of a person, the determination unit 400 determines whether the facial image of the person is stored in the first memory unit 100 or the second memory unit 200.

[0056] After a predetermined time has elapsed, the determination unit 400 starts analyzing the video transmitted from the outdoor camera. If the video transmitted from the outdoor camera contains a video of a certain person, the determination unit 400 extracts a facial image of the certain person contained in the video transmitted from the outdoor camera. The determination unit 400 determines whether a facial image matching the extracted facial image of the certain person is stored in the first storage unit 100 or the second storage unit 200.

[0057] When it is determined that a face image matching the extracted face image of a certain person is not stored in the first storage unit 100 and is stored in the second storage unit 200, the determination unit 400 outputs the determination result to the sound emission processing unit 500. When it is determined that a face image matching the extracted face image of a certain person is not stored in either the first storage unit 100 or the second storage unit 200, the determination unit 400 outputs the determination result to the sound emission processing unit 500.

[0058] On the other hand, if it is determined that a face image matching the extracted face image of a certain person is stored in the first storage unit 100, the certain person corresponds to a user who has already used the karaoke room (i.e., a user who entered the karaoke room within the specified time). In this case, the determination unit 400 does not output the determination result to the sound emission processing unit 500. After the specified time has elapsed, the determination unit 400 analyzes the video transmitted from the outdoor camera and repeats the above process until the use of the karaoke room is completed.

[0059] (Sound emission processing unit) When the sound emission processing unit 500 receives a signal from the opening / closing sensor indicating that the door has been opened and it is determined that a facial image of a person is not stored in the first memory unit 100 but is stored in the second memory unit 200, it causes the sound emission means to emit a first sound effect, and when the sound emission processing unit 500 receives a signal from the opening / closing sensor indicating that the door has been opened and it is determined that a facial image of a person is not stored in either the first memory unit 100 or the second memory unit 200, it causes the sound emission means to emit a second sound effect different from the first sound effect.

[0060] The sound emission means is a speaker 20 provided in the karaoke device K or a dedicated speaker installed in the karaoke room. The first sound effect is a sound that welcomes the entry of a person, such as a sound that imitates applause or cheers by several people. The second sound effect is a sound different from the first sound effect. The second sound effect is a sound that does not welcome the entry of a person, such as a sound of booing. The sound data corresponding to the first sound effect and the second sound effect are stored in advance in the storage means 10a. Also, a plurality of pieces of sound data corresponding to the first sound effect and the second sound effect may be stored. In this case, the sound emission processing unit 500 can select one first sound effect and one second sound effect in a predetermined order or randomly.

[0061] When a signal indicating that the door has been opened is received from the opening / closing sensor, and the judgment unit 400 outputs a judgment result indicating that the sound is not stored in the first memory unit 100 but is stored in the second memory unit 200, the sound emission processing unit 500 reads out audio data corresponding to the first sound effect from the memory means 10a, and emits the first sound effect, for example, from the speaker 20.

[0062] On the other hand, when a signal indicating that the door has been opened is received from the opening / closing sensor, and the judgment unit 400 outputs a judgment result indicating that the signal is not stored in either the first memory unit 100 or the second memory unit 200, the sound emission processing unit 500 reads out audio data corresponding to the second sound effect from the memory means 10a, and emits the second sound effect, for example, from the speaker 20.

[0063] The sound emission processing unit 500 may emit the first sound effect or the second sound effect until a signal indicating that the door is closed is received from the opening / closing sensor, or may emit the first sound effect or the second sound effect for only a fixed period of time (e.g., 10 seconds).

[0064] In addition, when the first sound effect is emitted, the memory processing unit 300 can store a facial image of a person included in the video captured by the outdoor camera in the first memory unit 100 as a facial image of a user of the karaoke room.

[0065] ==About the operation of the karaoke machine== Next, a specific example of the operation of the karaoke device K in this embodiment will be described with reference to Fig. 4 to Fig. 6B. Fig. 4 is a flow chart showing the operation of the karaoke device K. Figs. 5A and 5B are display screens of the remote control device 50. Figs. 6A and 6B show an example of a karaoke room R.

[0066] When the user performs a login operation via the remote control device 50 and logs into the karaoke device K, the karaoke device K determines that use of the karaoke room R has begun (start of use of the karaoke room; step 10).

[0067] The storage processing unit 300 stores the user's facial image in the first storage unit 100 or the second storage unit 200 within a predetermined time from the start of use of the karaoke room R (stores the user's facial image in the first storage unit or the second storage unit; step 11).

[0068] After a predetermined time has elapsed (Y in step 12), the determination unit 400 starts analyzing the video transmitted from the outdoor camera C2. If the video captured by the outdoor camera C2 contains a facial image of a person, the determination unit 400 determines whether the facial image of the person is stored in the first storage unit 100 or the second storage unit 200 (determining whether the facial image of a person is stored in the first storage unit or the second storage unit; step 13).

[0069] If it is determined that a facial image of a certain person is not stored in the first memory unit 100 but is stored in the second memory unit 200, or if it is determined that a facial image of a certain person is not stored in either the first memory unit 100 or the second memory unit 200, the determination unit 400 outputs the determination result to the sound emission processing unit 500.

[0070] When a signal indicating that the door D has been opened is received from the opening / closing sensor S (Y in step 14), and a determination result is output that a facial image of a person is not stored in the first memory unit 100 but is stored in the second memory unit 200 (Y in step 15), the sound emission processing unit 500 causes the speaker 20 to emit a first sound effect (emit the first sound effect; step 16).

[0071] On the other hand, when a signal indicating that the door D has been opened is received from the opening / closing sensor S (Y in step 14), and a determination result is output that a face image of a certain person is not stored in either the first storage unit 100 or the second storage unit 200 (N in step 15 and Y in step 17), the sound emission processing unit 500 causes the speaker 20 to emit a second sound effect (emits the second sound effect; step 18). The karaoke device K repeats the processes from step 13 to step 18 until it is determined that the use of the karaoke room R has ended (Y in step 19). The processes in steps 15 and 17 may be performed in the reverse order or simultaneously.

[0072] Here, an example will be described in which user U1 and user U2 make an appointment to sing karaoke together, but user U2 arrives at karaoke room R late.

[0073] A user U1 who wishes to log in operates the remote control device 50 and inputs his / her own user ID and a preset password. The karaoke device K transmits a login request including the input user ID and password to the server device SV. The server device SV reads out user information corresponding to the user ID included in the received login request from the storage means and transmits it to the karaoke device K. The karaoke device K that made the login request stores the user information of the user U1 received from the server device SV in the storage means 10a, thereby completing the login to the karaoke device K. The karaoke device K determines that use of the karaoke room R has begun.

[0074] In this case, the user U1 is already in the karaoke room. Therefore, the storage processing unit 300 reads out a face image from the user information of the user U1 and stores it in the first storage unit 100.

[0075] In addition, the memory processing unit 300 refers to the related person information included in the user information of user U1, and displays the names of other users U2 to U4 on the display screen of the remote control device 50 along with icons indicating "already entered" or "scheduled to enter" (see FIG. 5A).

[0076] User U1 operates remote control device 50, checks the checkbox for user U2, who will be using the karaoke room with users U2 to U4 displayed on the display screen, and selects the ``Planned to enter'' icon (see Figure 5B), and then clicks the ``Execute login'' icon to request a collective login.

[0077] When the collective login request is received, the karaoke device K transmits the collective login request including the user ID of the selected user U2 to the server device SV. The server device SV reads out the user information corresponding to the user ID included in the received collective login request from the storage means and transmits it to the karaoke device K. The karaoke device K that made the collective login request stores the received user information of the user U2 in the storage means 10a, thereby completing the collective login to the karaoke device K.

[0078] When the login of the user U2 is completed, the user U2 has not yet entered the karaoke room. Therefore, the storage processing unit 300 reads out a face image from the user information of the user U2 and stores it in the second storage unit 200.

[0079] After a predetermined time has elapsed, the determination unit 400 starts analyzing the video transmitted from the outdoor camera C2. When the video captured by the outdoor camera C2 contains a facial image of a person, the determination unit 400 determines whether the facial image of the person is stored in the first storage unit 100 or the second storage unit 200.

[0080] For example, in Fig. 6A, a user U2 who arrives late at karaoke room R is standing in front of door D. Therefore, the image captured by camera C2 includes an image of user U2.

[0081] In this case, the judgment unit 400 extracts the facial image of user U2 contained in the video transmitted from the outdoor camera C2, and judges whether a facial image matching the facial image of user U2 is stored in the first memory unit 100 or the second memory unit 200.

[0082] In this example, a facial image of a user U1 is stored in the first storage unit 100. On the other hand, a facial image of a user U2 is stored in the second storage unit 200. Therefore, the determination unit 400 determines that a facial image matching the extracted facial image of the user U2 is not stored in the first storage unit 100 and is stored in the second storage unit 200. The determination unit 400 outputs the determination result to the sound emission processing unit 500.

[0083] After that, the user U2 opens the door D and enters the karaoke room R where the user U1 is staying. When the user U2 opens the door D, the opening / closing sensor S transmits a signal to the karaoke device K to that effect.

[0084] When the sound emission processing unit 500 receives a signal from the opening / closing sensor S indicating that the door D has been opened, and receives an input of a determination result that the facial image of the user U2 is not stored in the first memory unit 100 but is stored in the second memory unit 200, the sound emission processing unit 500 reads out audio data corresponding to the first sound effect from the memory means 10a, and emits the first sound effect (i.e., a sound welcoming the entry of the user U2) from the speaker 20.

[0085] When the first sound effect is emitted, the memory processing unit 300 stores the facial image of the user U2 included in the video captured by the outdoor camera C2 in the first memory unit 100 as the facial image of the user of the karaoke room R.

[0086] On the other hand, in Fig. 6B, user U5, who is using another karaoke room, mistakenly stands in front of door D of karaoke room R. Therefore, the image captured by camera C2 includes an image of user U5.

[0087] In this case, the judgment unit 400 extracts the facial image of user U5 contained in the video transmitted from the outdoor camera C2, and judges whether a facial image matching the facial image of user U5 is stored in the first memory unit 100 or the second memory unit 200.

[0088] In this example, a facial image of a user U1 is stored in the first storage unit 100. On the other hand, a facial image of a user U2 is stored in the second storage unit 200. Therefore, the determination unit 400 determines that a facial image matching the extracted facial image of user U5 is not stored in either the first storage unit 100 or the second storage unit 200. The determination unit 400 outputs the determination result to the sound emission processing unit 500.

[0089] After that, the user U5 opens the door D and enters the karaoke room R where the user U1 is staying. When the user U5 opens the door D, the opening / closing sensor S transmits a signal to the karaoke device K to that effect.

[0090] When the sound emission processing unit 500 receives a signal from the opening / closing sensor S indicating that the door D has been opened, and receives an input of a determination result that the face image of the user U5 is not stored in either the first storage unit 100 or the second storage unit 200, the sound emission processing unit 500 reads out audio data corresponding to the second sound effect from the storage means 10a, and emits the second sound effect (i.e., a sound that does not welcome the entry of the user U5) from the speaker 20. Upon hearing the second sound effect, the user U5 can immediately recognize that he or she has entered the wrong karaoke room.

[0091] As is clear from the above, the karaoke device K according to this embodiment is communicably connected to an opening / closing sensor S attached to the door D of the karaoke room R, and an outdoor camera C2 installed outside the karaoke room R near the door D. The karaoke device K includes a first storage unit 100 for storing face images of users staying in the karaoke room R, a second storage unit 200 for storing face images of users who plan to use the karaoke room R together with the users staying in the karaoke room R, a storage processing unit 300 for storing the face images of users in the first storage unit 100 or the second storage unit 200 within a predetermined time from the start of use of the karaoke room R, and a storage processing unit 300 for storing the face images of users in the first storage unit 100 or the second storage unit 200 when the face image of a certain person is included in the video captured by the outdoor camera C2 after the predetermined time has elapsed. and a sound emission processing unit 500 which, when a signal indicating that the door D has been opened is received from the opening / closing sensor S and it is determined that the face image of a certain person is not stored in the first storage unit 100 but is stored in the second storage unit 200, emits a first sound effect from the sound emitting means, and, when a signal indicating that the door D has been opened is received from the opening / closing sensor S and it is determined that the face image of a certain person is not stored in the first storage unit 100 or the second storage unit 200, emits a second sound effect different from the first sound effect from the sound emitting means.

[0092] According to such a karaoke device K, when some of the users who use the karaoke room enter the karaoke room late, a first sound effect that welcomes the entry of the user can be emitted. By emitting the first sound effect at such a timing, an effect similar to the reaction of the audience when other artists are invited to sing a collaboration song together as part of the performance of a live show can be obtained. Furthermore, according to such a karaoke device K, when a person who is not a user of a certain karaoke room enters the karaoke room, a second sound effect that does not welcome the entry of the user can be emitted. By emitting the second sound effect at such a timing, an effect similar to the reaction of the audience when an incident that is not part of the performance occurs at a live show can be obtained. That is, according to the karaoke device K of this embodiment, it is possible to liven up the atmosphere of the karaoke singing place and prevent the excitement from dropping.

[0093] Furthermore, when the first sound effect is emitted, the storage processing unit 300 according to this embodiment can store a facial image of a person included in the video captured by the outdoor camera C2 in the first storage unit 100 as a facial image of the user of the karaoke room R. With such a karaoke device K, it is possible to prevent the first sound effect from being emitted again, for example, when the user leaves the room to go to the restroom or the like and then returns.

[0094] <Variation 1> When using a karaoke room, a user may order food and drink. An employee of the karaoke store delivers the ordered food and drink to the karaoke room. Here, according to the embodiment example, the face image of the employee is not stored in either the first storage unit 100 or the second storage unit 200. Therefore, when the employee who delivers the food and drink enters the karaoke room, the second sound effect is emitted. In this modified example, an example will be described in which the second sound effect is not emitted when the employee enters the room.

[0095] In this modification, a part of the storage area of ​​the storage means 10a functions as a first storage section 100, a second storage section 200, and a third storage section 600 (see FIG. 7).

[0096] (Third memory unit) The third storage unit 600 is for storing face images of employees of the karaoke store in which the karaoke device is installed. Facial image data corresponding to the facial images of the employees is stored in advance in a store server (not shown) of the karaoke store together with their work schedules and the like. For example, when the karaoke store opens for business, the store server (not shown) transmits facial image data corresponding to the facial images of employees who are scheduled to work on that day to each karaoke device installed in the karaoke store. The storage processing unit 300 stores the facial images of the employees in the third storage unit 600 based on the received facial image data.

[0097] (Judgment Department) The determination unit 400 in this modified example determines whether a facial image of a person is stored in the third memory unit 600 when the image captured by the outdoor camera after a predetermined time has elapsed contains the facial image of the person.

[0098] After a predetermined time has elapsed, the determination unit 400 starts analyzing the video transmitted from the outdoor camera. If the video transmitted from the outdoor camera contains a video of a certain person, the determination unit 400 extracts a facial image of the certain person contained in the video transmitted from the outdoor camera. The determination unit 400 determines whether a facial image matching the extracted facial image of the certain person is stored in the first storage unit 100, the second storage unit 200, or the third storage unit 600.

[0099] When it is determined that a face image matching the extracted face image of a certain person is stored in the third storage unit 600, the determination unit 400 outputs the determination result to the sound emission processing unit 500. Note that, when a face image matching the extracted face image of a certain person is stored in the third storage unit 600, generally, a face image matching the extracted face image of a certain person is not stored in the first storage unit 100 and the second storage unit 200. Therefore, the determination unit 400 determines that the face image of a certain person is not stored in either the first storage unit 100 or the second storage unit 200. In other words, the determination unit 400 outputs the determination result that the face image of a certain person is not stored in either the first storage unit 100 or the second storage unit 200 and is stored in the third storage unit 600 to the sound emission processing unit 500.

[0100] On the other hand, if it is determined that a facial image matching the extracted facial image of a certain person is not stored in any of the first memory unit 100, the second memory unit 200, and the third memory unit 600, or if it is determined that the extracted facial image of a certain person is not stored in the first memory unit 100 or the third memory unit 600 and is stored in the second memory unit 200, the determination unit 400 outputs the determination result to the sound emission processing unit 500.

[0101] After the predetermined time has elapsed, the determination unit 400 analyzes the video image transmitted from the outdoor camera and repeats the above process until the use of the karaoke room is terminated.

[0102] (Sound emission processing unit) When the sound emission processing unit 500 of this modified example receives a signal from the opening / closing sensor indicating that the door has been opened, and determines that a facial image of a person is not stored in either the first memory unit 100 or the second memory unit 200, but is stored in the third memory unit 600, the sound emission processing unit 500 does not emit the second sound effect.

[0103] In this modified example, when a signal indicating that the door has been opened is received from the opening / closing sensor, and the judgment unit 400 outputs a judgment result that a facial image of a person is not stored in either the first memory unit 100 or the second memory unit 200, but is stored in the third memory unit 600, the sound emission processing unit 500 does not emit the second sound effect.

[0104] Here, an example will be described in which a karaoke store employee A delivers food and drink to users U1 and U2 who are using karaoke room R (see FIG. 8). In this example, the first storage unit 100 stores face images of users U1 and U2, the second storage unit 200 stores no face images, and the third storage unit 600 stores a face image of employee A. It is also assumed that a predetermined time has passed.

[0105] The determination unit 400 analyzes the video transmitted from the outdoor camera C2. When the video captured by the outdoor camera C2 contains a facial image of a person, the determination unit 400 determines whether the facial image of the person is stored in the first storage unit 100, the second storage unit 200, or the third storage unit 600. In the example of Fig. 8, employee A is standing in front of door D. Therefore, the video captured by the camera C2 contains an image of employee A.

[0106] In this case, the judgment unit 400 extracts the facial image of employee A contained in the video transmitted from the outdoor camera C2, and judges whether a facial image matching the facial image of employee A is stored in the first memory unit 100, the second memory unit 200 or the third memory unit 600.

[0107] In this example, only the facial images of users U1 and U2 are stored in the first storage unit 100, and no facial images are stored in the second storage unit 200. Therefore, the determination unit 400 determines that a facial image matching the extracted facial image of employee A is not stored in either the first storage unit 100 or the second storage unit 200. On the other hand, in this example, the facial image of employee A is stored in the third storage unit 600. Therefore, the determination unit 400 determines that a facial image matching the extracted facial image of employee A is stored in the third storage unit 600. The determination unit 400 outputs the determination result to the sound emission processing unit 500.

[0108] After that, employee A opens door D and enters karaoke room R where user U1 and user U2 are staying. When employee A opens door D, opening / closing sensor S transmits a signal to karaoke device K to that effect.

[0109] Here, the sound emission processing unit 500 receives an input of a determination result from the determination unit 400 that the face image of employee A is not stored in either the first storage unit 100 or the second storage unit 200, and that the face image of employee A is stored in the third storage unit 600. In this case, the sound emission processing unit 500 does not read out the voice data corresponding to the second sound effect from the storage means 10a. In other words, the sound emission processing unit 500 does not emit the second sound effect from the speaker 20.

[0110] When the sound emission processing unit 500 receives a signal indicating that the door has been opened from the opening / closing sensor and receives an input of a determination result that a face image matching the extracted face image of a certain person is not stored in any of the first storage unit 100, the second storage unit 200, and the third storage unit 600, the sound emission processing unit 500 reads out audio data corresponding to the second sound effect from the storage unit 10a and emits the second sound effect from the speaker 20. When the sound emission processing unit 500 receives a signal indicating that the door has been opened from the opening / closing sensor and receives an input of a determination result that a face image of a certain person that has been extracted is not stored in the first storage unit 100 or the third storage unit 600, and is stored in the second storage unit 200, the sound emission processing unit 500 reads out audio data corresponding to the first sound effect from the storage unit 10a and emits the first sound effect from the speaker 20.

[0111] As is clear from the above, the karaoke device K according to this modification has a third storage unit 600 for storing a face image of an employee of the karaoke store where the karaoke device K is installed. When a face image of a person is included in the video captured by the outdoor camera C2 after a predetermined time has elapsed, the determination unit 400 according to this modification determines whether the face image of the person is stored in the third storage unit 600. When the sound emission processing unit 500 according to this modification receives a signal from the opening / closing sensor S indicating that the door D has been opened, and determines that the face image of the person is not stored in either the first storage unit 100 or the second storage unit 200 and is stored in the third storage unit 600, the sound emission processing unit 500 does not emit the second sound effect. Such a karaoke device K can prevent the second sound effect (i.e., a sound that does not welcome the entry of an employee) from being emitted when an employee of the karaoke store enters the karaoke room.

[0112] <Variation 2> By changing the sound effects to be emitted depending on whether karaoke singing is being performed in the karaoke room, the karaoke singing atmosphere can be further enlivened. Whether karaoke singing is being performed in the karaoke room can be determined by whether karaoke equipment K is playing a karaoke song.

[0113] For example, when karaoke singing is being performed in a karaoke room when the first sound effect is to be emitted, the sound emission processing unit 500 in this modified example can emit the first sound effect at a volume louder than a preset volume.

[0114] Alternatively, when karaoke singing is being performed in the karaoke room when the sound emission processing unit 500 according to this modification is to emit a third sound effect different from the first sound effect and the second sound effect. The third sound effect is, for example, a sound that more welcomes the entry of a person into the room (a sound that indicates a more lively atmosphere than the first sound effect), such as a sound that simulates applause and cheers by many people. Sound data corresponding to the third sound effect is stored in advance in the storage means 10a. Also, a plurality of pieces of sound data corresponding to the third sound effect may be stored. In this case, the sound emission processing unit 500 can select one third sound effect in a predetermined order or randomly.

[0115] As is clear from the above, when karaoke singing is being performed in the karaoke room when the sound emission processing unit 500 according to this modification is to emit the first sound effect, the volume of the first sound effect can be made louder than a preset volume, or a third sound effect different from the first sound effect and the second sound effect can be emitted. According to such a karaoke device K, when a user enters the karaoke room late while karaoke singing is being performed in the karaoke room, the sound effect emitted can be made different from the normal sound effect. In the production of a live performance, when another artist appears while one artist is singing a collaboration song, the live performance becomes even more exciting. According to the karaoke device K according to this modification, the excitement of such a live performance can be reproduced. Therefore, the karaoke singing scene can be further excited.

[0116] <Other> Some examples of combinations of the disclosed technical features are set out below. (1) A karaoke device that is communicatively connected to an open / close sensor attached to a door of a karaoke room and an exterior camera installed outside the karaoke room and near the door, a first storage unit for storing face images of users staying in the karaoke room; a second storage unit for storing face images of users who are staying in the karaoke room and users who plan to use the karaoke room; a storage processing unit that stores a face image of the user in the first storage unit or the second storage unit within a predetermined time from the start of use of the karaoke room; a determination unit that, when a facial image of a certain person is included in the video captured by the outdoor camera after the predetermined time has elapsed, determines whether or not the facial image of the certain person is stored in the first storage unit or the second storage unit; a sound emission processing unit that, when a signal indicating that a door has been opened is received from the opening / closing sensor and it is determined that a facial image of the certain person is not stored in the first storage unit and is stored in the second storage unit, emits a first sound effect from a sound emission means, and, when a signal indicating that a door has been opened is received from the opening / closing sensor and it is determined that a facial image of the certain person is not stored in the first storage unit and is stored in the second storage unit, emits a second sound effect different from the first sound effect from the sound emission means. A karaoke device having the above configuration. (2) The karaoke device described in (1) is characterized in that, when the first sound effect is emitted, the memory processing unit stores a facial image of a person included in the image captured by the outdoor camera in the first memory unit as a facial image of a user of the karaoke room. (3) a third storage unit for storing a facial image of an employee of the karaoke store in which the karaoke device is installed; the determination unit, when a facial image of a certain person is included in the video captured by the outdoor camera after the predetermined time has elapsed, determines whether or not the facial image of the certain person is stored in the third storage unit; The karaoke device according to (1) or (2), characterized in that when the sound emission processing unit receives a signal from the opening / closing sensor indicating that the door has been opened, and when it is determined that the facial image of the certain person is not stored in either the first memory unit or the second memory unit, and is stored in the third memory unit, the sound emission processing unit does not emit the second sound effect. (4) The karaoke device according to any one of (1) to (3), wherein the sound emission processing unit, when emitting the first sound effect and karaoke singing is being performed in the karaoke room, emits the first sound effect at a volume louder than a preset volume, or emits a third sound effect different from the first sound effect and the second sound effect.

[0117] The above-mentioned embodiments are presented as examples and do not limit the scope of the invention. The above-mentioned configurations can be implemented in appropriate combinations, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. The above-mentioned embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and gist of the invention. [Explanation of symbols]

[0118] 100 First memory unit 200 Second memory unit 300 Memory Processing Unit 400 Judgment section 500 Sound emission processing section 600 Third Memory Unit C1 Indoor Camera C2 Outdoor Camera K Karaoke equipment S Open / Close Sensor SV server device

Claims

1. A karaoke device connected to an open / close sensor attached to a door of a karaoke room and an exterior camera installed outside the karaoke room and near the door so as to be able to communicate with each other, a first storage unit for storing face images of users staying in the karaoke room; a second storage unit for storing face images of users who are staying in the karaoke room and users who are scheduled to use the karaoke room; a storage processing unit for storing a face image of the user in the first storage unit or the second storage unit within a predetermined time from the start of use of the karaoke room; a determination unit that, when a facial image of a certain person is included in the video captured by the outdoor camera after the predetermined time has elapsed, determines whether or not the facial image of the certain person is stored in the first storage unit or the second storage unit; a sound emission processing unit that, when a signal indicating that a door has been opened is received from the opening / closing sensor and it is determined that a facial image of the certain person is not stored in the first storage unit and is stored in the second storage unit, emits a first sound effect from a sound emission means, and, when a signal indicating that a door has been opened is received from the opening / closing sensor and it is determined that a facial image of the certain person is not stored in the first storage unit and is stored in the second storage unit, emits a second sound effect different from the first sound effect from the sound emission means. A karaoke device having the above configuration.

2. 2. The karaoke device according to claim 1, wherein, when the first sound effect is emitted, the memory processing unit stores a facial image of a person included in the image captured by the outdoor camera in the first memory unit as a facial image of a user of the karaoke room.

3. a third storage unit for storing a face image of an employee of the karaoke store in which the karaoke device is installed; the determination unit, when a facial image of a certain person is included in the video captured by the outdoor camera after the predetermined time has elapsed, determines whether or not the facial image of the certain person is stored in the third storage unit; 2. The karaoke device according to claim 1, wherein the sound emission processing unit does not emit the second sound effect when it receives a signal from the opening / closing sensor indicating that the door has been opened and determines that the facial image of the certain person is not stored in either the first storage unit or the second storage unit and is stored in the third storage unit.

4. 4. The karaoke device according to claim 1, wherein, when karaoke singing is being performed in the karaoke room when the first sound effect is emitted, the sound emission processing unit emits the first sound effect at a volume greater than a preset volume, or emits a third sound effect different from the first sound effect and the second sound effect.

Images