Karaoke System

Abstract

To provide a Karaoke system which can easily resume operation when a user receives a remote controller by hand again.SOLUTION: A Karaoke system (1) includes: a remote controller (R) having an operation screen (29); and a Karaoke device (K) communicably connected to the remote controller. The remote controller includes: a detection part (22) for detecting a change of a user operating the remote controller on the basis of a face image of the user; a backup part (23) for backing up an operation history of the user before the change to the Karaoke device; a request part (24) for requesting the Karaoke device to transmit an operation history of the user after the change; and an update part (25) for updating the operation screen on the basis of an operation history received from the Karaoke device. The Karaoke device includes: a storage part (31) for storing backup of an operation history received from the remote controller; and a transmission part (32) for transmitting the operation history of the user after the change to the remote controller.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a karaoke system. [Background technology]

[0002] When multiple users use a karaoke machine at a karaoke booth, karaoke snack bar, or the like, a user may put down the remote control device they are operating at the request of another user or store staff. When this user picks up the remote control again, they have to operate it again from the beginning, which is troublesome. To address this issue, a technology has been proposed that allows multiple users to share a single remote control device by storing and retrieving the operation history associated with the user's identification information each time a different user picks up the remote control (see, for example, Patent Document 1).

[0003] In the karaoke system described in Patent Document 1, a fingerprint sensor is provided on the remote control device. A user registers their fingerprint with the karaoke service in advance, and when the fingerprint sensor reads the user's fingerprint, the user, whose fingerprint has been authenticated on the remote control device, can log in to the karaoke service. When a remote control device is passed from one user to another and the fingerprint of the other user is read by the fingerprint sensor, the user's current screen is temporarily saved in the memory of the remote control device, and when the fingerprint of that user is read again by the fingerprint sensor, the previous screen is read from the memory. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-294243 Summary of the Invention [Problem to be solved by the invention]

[0005] In the karaoke system described in Patent Document 1, there is no need to input identification information each time a remote control is received, but the operation of logging in to the karaoke service itself is troublesome. In particular, the overwhelming majority of night establishments such as karaoke snack bars do not require users to log in. Also, in some establishments, multiple remote controls may be connected to a karaoke device, and if a user lets go of the remote control they were operating and then operates another remote control, they must start over from the beginning.

[0006] SUMMARY OF THE INVENTION An object of the present invention is to provide a karaoke system that allows a user to easily resume operation when he or she picks up the remote control device again. [Means for solving the problem]

[0007] The main invention for achieving the above object is a karaoke system comprising a remote control device that accepts operations via an operation screen, and a karaoke device communicatively connected to the remote control device, wherein the remote control device has a detection unit that detects a change in the user operating the remote control device based on a facial image of the user captured by an imaging means, a backup unit that, when a change of user is detected, associates the operation history of the user before the change with the facial image data and backs it up to the karaoke device, a request unit that, when a change of user is detected, requests the karaoke device to send an operation history associated with the facial image data of the changed user, and an update unit that updates the operation screen of the remote control device based on the operation history received from the karaoke device in response to the request, and the karaoke device has a memory unit that stores the backup of the operation history and facial image data received from the remote control device, and a transmission unit that, in response to a request from the remote control device, reads out the operation history associated with the facial image data of the changed user and transmits it to the remote control device. [Effects of the Invention]

[0008] According to the present invention, when a user puts down the remote control device they were operating and another user picks up the remote control device, a change in user is detected based on the facial image captured by the imaging means, and the user's facial image data and operation history are backed up to the karaoke machine. Even if another user switches the operation screen of the remote control device, when the user picks up the remote control device again, the operation screen of the remote control device is updated based on the backed-up operation history, allowing operation to be resumed from the previous operation screen. In this way, multiple users can share the remote control device without having to perform a login operation. In particular, even when multiple remote control devices are connected to the karaoke machine, if a user puts down the remote control device they were operating and operates a different remote control device, the operation history is inherited between the remote control devices, allowing operation to be resumed from the previous operation screen. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a configuration diagram of a karaoke system according to a first embodiment. [Figure 2] 1 is a functional block diagram of a karaoke system according to a first embodiment. [Figure 3] 3 is an example showing a usage state of the remote control device of the first embodiment. [Figure 4] FIG. 3 is a flowchart showing an example of a processing operation of the karaoke system of the first embodiment. [Figure 5] FIG. 10 is a functional block diagram of a karaoke system according to a second embodiment. [Figure 6] FIG. 10 is a flowchart showing an example of a processing operation of the karaoke system according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] First Embodiment A karaoke system according to a first embodiment will be described with reference to Figures 1 and 2. Figure 1 is a configuration diagram of the karaoke system according to the first embodiment. Figure 2 is a functional block diagram of the karaoke system according to the first embodiment. For the sake of convenience, the functional block diagram of Figure 2 shows functional blocks for realizing specific processing, but it is assumed that the system also includes the components that a karaoke system normally includes.

[0011] As shown in Fig. 1, the karaoke system 1 is a system that allows a user to enjoy singing along with the performance of a song that the user has reserved, and includes a karaoke device K, a monitor 11, a speaker 12, a microphone 13, and a remote control device R. The monitor 11 displays lyrics and captions along with a background image in accordance with the karaoke performance based on a video signal and the like from the karaoke device K. The microphone 13 converts the user's singing voice into a singing voice signal and inputs it to the karaoke device K. The speaker 12 emits the user's singing voice along with the performance sound based on the performance sound signal from the karaoke device K and the singing voice signal from the microphone 13.

[0012] The remote control device R is provided with an operation screen 29 such as an operation panel. The operation screen 29 of the remote control device R displays various information such as search menus and search results, and accepts various operations such as reserving songs for the karaoke device K. The remote control device R and the karaoke device K are paired via short-range wireless communication, and various information is transmitted and received between the remote control device R and the karaoke device K. A song is searched for by the remote control device R, and the reservation operation is completed by touching a transfer button displayed on the operation screen 29, and the reserved song is notified from the remote control device R to the karaoke device K.

[0013] When the karaoke performance begins on the karaoke device K, lyrics captions and background images are displayed on the monitor 11 in sync with the karaoke performance. In the karaoke device K, the karaoke performance sound signal and the singing voice signal input from the microphone 13 are mixed by the mixer, and this mixed signal is amplified by the amplifier and output from the speaker 12. In this way, when the user sings along with the karaoke performance, the singing voice is output from the speaker 12 together with the performance sound. In addition, the karaoke device K scores the user's singing ability, and the score is displayed on the monitor 11.

[0014] 2, in the karaoke system 1, a remote control device R and a karaoke device K are connected to each other so that they can communicate with each other. In this karaoke system 1, even if a user puts down the remote control device R, the user's operation history is backed up in the karaoke device K so that the user can resume operation from the previous operation screen 29 when he or she picks up the remote control device R again. The remote control device R is provided with an imaging means 21, a detection unit 22, a backup unit 23, a request unit 24, an update unit 25, and an operation screen 29. Here, one remote control device R is shown, but multiple remote control devices R may be connected to the karaoke device K.

[0015] The imaging means 21 captures a facial image of a user operating the operation screen 29. The imaging means 21 is configured with a camera located near the operation screen 29 of the remote control device R, and the face of the user operating the remote control device R while looking at the operation screen 29 is captured within the field of view of the camera. The facial image of the user is captured by the imaging means 21, so that the user operating the remote control device R is automatically identified. Therefore, in the karaoke system 1 of this embodiment, there is no need for the user to log in to the karaoke system 1 in order to identify the user operating the remote control device R.

[0016] The detection unit 22 detects a change in the user operating the remote control device R based on the facial image of the user captured by the imaging means 21. For example, the detection unit 22 samples the facial image of the user captured by the imaging means 21 at a predetermined period to generate facial image data, and detects a change in the user by comparing the facial image data generated in the previous sampling with the facial image data generated in the current sampling. More specifically, the facial image input from the imaging means 21 is subjected to image processing such as a facial area extraction process for extracting a facial area from the facial image, and a feature amount extraction process for extracting feature amounts of the facial image from the facial area as facial image data.

[0017] The facial region extraction process employs known methods such as a method using edge detection of a facial image, a method using pixel values ​​(color values) of a facial image, a method using pattern matching, a method using a neural network, or a combination of these.The feature extraction process employs known methods such as SIFT (Scale-Invariant Feature Transform) and SURF (Speed-Up Robust Feature).As the feature of a facial image, points that indicate contour features of a facial image with large changes in shade, such as the inner corners and outer corners of the eyes, the wings of the nose, the corners of the mouth, and the tip of the chin, are extracted.

[0018] The feature amounts of the facial image extracted (generated) during the previous sampling are compared with the feature amounts of the facial image extracted (generated) during the current sampling. If the feature amounts of the facial images extracted during the previous and current samplings are equal to or greater than a predetermined similarity, a change in user is not detected. If the feature amounts of the facial images extracted during the previous and current samplings are lower than the predetermined similarity, a change in user is detected. When the detection unit 22 detects a change in user, the feature amounts of the facial image during the previous sampling are set as the facial image data before the change, and the feature amounts of the facial image during the current sampling are set as the facial image data after the change.

[0019] When a change of user is detected, the backup unit 23 associates the operation history of the user before the change with face image data (features) and backs them up to the karaoke device K. In this case, the operation history of the user before the change and the face image data are associated and transmitted from the remote control device R to the karaoke device K. In this way, the operation status is automatically backed up when the user lets go of the remote control device R. The operation history is a record of operations of the remote control device R by the user. The operation history is temporarily stored in the memory of the remote control device R, and is updated according to operations on the operation screen 29 of the remote control device R by the user.

[0020] When a change in user is detected, the request unit 24 requests the karaoke device K to transmit an operation history associated with the changed facial image data of the user. In this case, a request signal including the changed facial image data of the user is transmitted from the remote control device R to the karaoke device K. The update unit 25 updates the operation screen 29 of the remote control device R based on the operation history received from the karaoke device K in response to the request. In this case, the operation history included in the response signal received from the karaoke device K is extracted, and the operation screen 29 of the remote control device R is updated to reflect the operation history.

[0021] The karaoke device K is provided with a storage unit 31 and a transmission unit 32. The storage unit 31 stores the operation history and backup of facial image data received from the remote control device R. In response to a request from the remote control device R, the transmission unit 32 reads out the operation history associated with the changed facial image data of the user and transmits it to the remote control device R. In this case, backup data whose facial image data is similar to the request signal is identified, and the operation history of this backup data is read out. Then, a response signal including the operation history is transmitted from the karaoke device K to the remote control device R.

[0022] The karaoke device K may regard the facial image data transmitted in association with the operation history as "the facial image data of the user before the change," and may regard the facial image data transmitted without association with the operation history as "the facial image data of the user after the change." After the operation screen 29 of the remote control device R is updated based on the operation history from the karaoke device K, the operation of the user is reflected in the operation history of the remote control device R. Furthermore, every time the remote control device R backs up the facial image data and operation history to the karaoke device K, the facial image data and operation history stored in the storage unit 31 of the karaoke device K are overwritten.

[0023] The processing of each part of the karaoke system 1 may be realized by software using a processor, or may be realized by a logic circuit (hardware) formed in an integrated circuit or the like. When a processor is used, the processor reads and executes programs stored in memory to perform various processes. As the processor, for example, a CPU (Central Processing Unit) is used. Furthermore, the memory is configured by one or more storage media such as ROM (Read Only Memory) and RAM (Random Access Memory) depending on the application.

[0024] Next, a specific example of how the remote control device is used in a night store will be described. Fig. 3 shows an example of how the remote control device of the first embodiment is used. Note that in Fig. 3, the reference numerals in Fig. 2 will be used as appropriate. Here, the remote control device with device identification information ID***R1 will be referred to as remote control device R1, and the remote control device with device identification information ID***R2 will be referred to as remote control device R2.

[0025] Karaoke system 1 is installed in a night club such as a small karaoke bar with around 10 seats, and one staff member is in charge of serving customers and operating karaoke device K. Two remote control devices R1 and R2 are connected (paired) to karaoke device K, and each remote control device R1 and R2 is mainly used for searching for songs. While serving customers, the staff member is careful to ensure that the operation of remote control devices R1 and R2 and the karaoke singing are not biased towards any particular customer. Note that karaoke device K may be connected to one remote control device, or three or more remote control devices.

[0026] As shown in FIG. 3(A), at time T0, users U1 and U2 are seated at a counter in a store. At this time, user U1 is operating remote control device R1, and user U2 is operating remote control device R2. A facial image of user U1 is captured by imaging means 21 of remote control device R1, and a facial image is captured by imaging means 21 of remote control device R2. Facial image data (features) FD1 and FD2 of users U1 and U2 are generated in detection units 22 of remote control devices R1 and R2, respectively. In addition, operation histories OH1 and OH2 of users U1 and U2 are stored in memories of remote control devices R1 and R2, respectively.

[0027] As shown in Figure 3(B), at time T1, user U3 enters the store and sits at the counter. At this time, user U1 is operating remote control device R1, user U2 is operating remote control device R2, and user U3 is not holding either remote control device R1 or R2. Therefore, the imaging means 21 of remote control device R1 continues to capture a facial image of user U1, and the imaging means 21 of remote control device R2 continues to capture a facial image of user U2. In addition, the memories of remote control devices R1 and R2 store operation histories OH1 and OH2 of users U1 and U2, respectively.

[0028] 3(C), at time T2, user U1 is asked by a store staff member to hand over remote control device R1, which user U1 has been operating, to user U3. At this time, the imaging means 21 of remote control device R1 captures an image of user U3's face, and the detection unit 22 of remote control device R1 generates face image data FD3 of user U3. The detection unit 22 compares the face image data FD1 of user U1 at the previous sampling time with the face image data FD3 of user U3 at the current sampling time, and detects a change in the user of remote control device R1.

[0029] When the detection unit 22 of the remote control device R1 detects a change of user, the backup unit 23 of the remote control device R1 associates the facial image data FD1 and the operation history OH1 of the user U1 and transmits them to the karaoke device K. In the karaoke device K, the backup of the facial image data FD1 and the operation history OH1 received from the remote control device R1 is stored in the storage unit 31. In addition, the request unit 24 of the remote control device R1 transmits a request signal including the facial image data FD3 to the karaoke device K, requesting the karaoke device K to transmit the operation history of the user U3.

[0030] At time T2, the storage unit 31 of the karaoke device K does not store an operation history associated with the facial image data FD3. Therefore, the transmission unit 32 of the karaoke device K does not transmit a response signal corresponding to the request signal. Because the operation history is not transmitted from the karaoke device K to the remote control device R1, the update unit 25 of the remote control device R1 does not update the operation screen 29. Also, at time T2, the remote control device R2 is being operated by the user U2. The imaging means 21 of the remote control device R2 continues to capture the facial image of the user U2, and the detection unit 22 of the remote control device R2 does not detect a change in the user.

[0031] 3(D), at time T3, user U2 is asked by a store staff member to hand over remote control device R2, which user U2 has been operating, to user U1. At this time, the imaging means 21 of remote control device R2 captures an image of user U1's face, and the detection unit 22 of remote control device R2 generates face image data FD1 of user U1. The detection unit 22 compares the face image data FD2 of user U2 from the previous sampling with the face image data FD1 of user U1 from the current sampling, and detects a change in the user of remote control device R2.

[0032] When the detection unit 22 of the remote control device R2 detects a change of user, the backup unit 23 of the remote control device R2 associates the facial image data FD2 and the operation history OH2 of the user U2 and transmits them to the karaoke device K. The karaoke device K stores the facial image data FD2 and the operation history OH2 received from the remote control device R2 as backup data. In addition, the request unit 24 of the remote control device R2 transmits a request signal including the facial image data FD1 to the karaoke device K, requesting the karaoke device K to transmit the operation history OH1 of the user U1.

[0033] At time T3, the storage unit 31 of the karaoke device K stores the operation history OH1 associated with the facial image data FD1. Therefore, the transmission unit 32 of the karaoke device K transmits a response signal including the operation history OH1 to the remote control device R2 in response to the request signal from the remote control device R2. When the remote control device R2 receives the operation history OH1 from the karaoke device K, the update unit 25 of the remote control device R2 updates the operation screen 29 based on the operation history OH1. That is, the state of the operation screen 29 of the remote control device R2 at time T2, when the user U1 stopped operating the remote control device R1, is reproduced.

[0034] Also, at time T3, remote control device R1 is being operated by user U3. The imaging means 21 of remote control device R1 continues to capture an image of user U3's face, and the detection unit 22 of remote control device R1 does not detect a change in user. In this way, when the user operating remote control devices R1 and R2 changes, the user's operation history is backed up in karaoke device K. Thereafter, when the user picks up either remote control device R1 or R2, operation screen 29 is reproduced based on the backed-up operation history, and the user can resume operation from the previous operation screen 29.

[0035] The processing operation of the karaoke system of the first embodiment will be described with reference to Fig. 4. Fig. 4 is a flow diagram showing an example of the processing operation of the karaoke system of the first embodiment. Note that the symbols in Fig. 2 will be used as appropriate in the description. Also, the following flow diagram is merely an example and can be modified as appropriate.

[0036] 4, remote control device R is paired with karaoke device K (step S01), and imaging means 21 of remote control device R starts capturing a facial image of a user (step S02). Detection unit 22 periodically samples the facial image captured by imaging means 21, and performs various image processing on the sampled facial image to generate facial image data (feature amounts) (step S03). Detection unit 22 then compares the facial image data sampled last time with the facial image data sampled this time, and performs processing to detect a change in the user operating remote control device R (step S04).

[0037] When the detection unit 22 detects a change in the user operating the remote control device R (Yes in step S04), the backup unit 23 of the remote control device R transmits the facial image data and operation history of the user before the change to the karaoke device K (step S05). When the karaoke device K receives the facial image data and operation history of the user, the storage unit 31 associates the facial image data and operation history of the user and stores them (step S06). In this way, the operation history of the user who has let go of the remote control device R is backed up in the karaoke device K in association with the facial image data.

[0038] Furthermore, the request unit 24 of the remote control device R transmits a request signal including the changed facial image data of the user to the karaoke device K (step S07). When the karaoke device K receives the request signal, it searches whether an operation history associated with the facial image data of the request signal is stored (step S08). If an operation history associated with the facial image data of the request signal is stored (Yes in step S08), the transmitting unit 32 of the karaoke device K transmits a response signal including this operation history to the remote control device R (step S09).

[0039] When remote control device R receives the response signal, update unit 25 updates operation screen 29 of remote control device R based on the operation history of the response signal (step S10). In this way, if the user's operation history is backed up in karaoke device K, the previous operation screen 29 will be re-displayed when the user picks up remote control device R. If the pairing between remote control device R and karaoke device K is not released (No in steps S11 and S12), remote control device R returns to step S03 and performs the process, and karaoke device K returns to step S06 and performs the process.

[0040] As described above, according to the first embodiment, when a user puts down the remote control device R that he or she has been operating and another user picks up the remote control device R, a change in user is detected based on the facial image captured by the imaging means 21, and the user's facial image data and operation history are backed up in the karaoke device K. Even if another user switches the operation screen 29 of the remote control device R, when the user picks up the remote control device R again, the operation screen 29 of the remote control device R is updated based on the backed-up operation history, and operation can be resumed from the previous operation screen 29. In this way, the remote control device R can be shared among multiple users without a login operation. In particular, even when multiple remote control devices R are connected to the karaoke device K, even if a user puts down the remote control device R that he or she has been operating and operates another remote control device R, the operation history is inherited between the remote control devices R, and operation can be resumed from the previous operation screen 29.

[0041] In the first embodiment, the transmitting unit 32 of the karaoke device K is configured not to transmit the operation history if the operation history associated with the changed face image data of the user is not stored (backed up), but this is not limiting. The transmitting unit 32 of the karaoke device K may transmit the operation history corresponding to a predetermined screen to the remote control device R if the operation history associated with the changed face image data of the user is not stored.

[0042] Specifically, as shown in Fig. 3(C), remote control R1, which user U1 has been operating at time T2, is handed over to user U3. The request unit 24 of remote control R1 transmits a request signal including facial image data FD3 to karaoke device K, requesting karaoke device K to transmit the operation history of user U3. However, the storage unit 31 of karaoke device K does not store the operation history associated with the facial image data FD3. In this case, the transmission unit 32 of karaoke device K transmits a response signal including the operation history OH0 to remote control R1, in order to update the operation screen 29 of remote control R1 to a predetermined screen.

[0043] The operation history OH0 is an operation history for updating the operation screen 29 to a predetermined screen such as a "root screen after power-on" or a "menu screen," and is stored in the storage unit 31 without being associated with facial image data. When the remote control device R1 receives a response signal, the update unit 25 of the remote control device R1 displays a menu screen or the like on the operation screen 29 of the remote control device R1 based on the operation history OH0. Even if the operation history of the user U3 has not been backed up, the operation screen 29 of the remote control device R1 that the user U1 was operating is updated to the menu screen, allowing the user U3 to smoothly start operation from the menu screen.

[0044] Second Embodiment Next, a karaoke system according to a second embodiment will be described. FIG. 5 is a functional block diagram of the karaoke system according to the second embodiment. The karaoke system according to the second embodiment differs from the karaoke system according to the first embodiment in that it notifies the user of a long period of operation of the remote control device. Therefore, a description of the karaoke system according to the second embodiment that is similar to the karaoke system according to the first embodiment will be omitted. For ease of explanation, the same names as those in the first embodiment will be assigned the same reference numerals.

[0045] 5, in the karaoke system 1 of the second embodiment, a remote control device R and a karaoke device K are communicatively connected, similarly to the karaoke system 1 of the first embodiment. The remote control device R is provided with an imaging means 21, a detection unit 22, a backup unit 23, a request unit 24, an update unit 25, a notification unit 26, and an operation screen 29. When a change in user is detected, the notification unit 26 notifies the karaoke device K of the device identification information of the remote control device R. The notification of the device identification information not only notifies the karaoke device K of the change in user, but also identifies the remote control device R whose user has been changed.

[0046] The karaoke device K includes a storage unit 31, a transmission unit 32, a determination unit 33, and an informing unit 34. The determination unit 33 determines whether the elapsed time since the reception of the device identification information has exceeded a predetermined time. In this case, a timer (not shown) starts counting time upon reception of the device identification information, and determines whether the predetermined time (e.g., 10 minutes) has passed since the reception of the device identification information. If the elapsed time exceeds the predetermined time, the informing unit 34 notifies that the remote control device R corresponding to the device identification information has been operated for a long period of time. In this case, a message that the predetermined time has passed since the remote control device R was handed over to the current operator is displayed on the monitor 11 (see FIG. 1 ) or the like.

[0047] More specifically, at a certain time, user U4 is asked by a store staff member to hand over remote control device R1, which user U4 has been operating, to user U5. At this time, an image of user U5's face is captured by imaging means 21 of remote control device R1, and facial image data FD5 of user U5 is generated by detection unit 22 of remote control device R1. Detection unit 22 compares the facial image data FD4 of user U4 from the previous sampling with the facial image data FD5 of user U5 from the current sampling, and detects a change in the user of remote control device R1.

[0048] When the detection unit 22 of the remote control device R1 detects a change in user, the backup unit 23 of the remote control device R1 associates the facial image data FD4 and the operation history OH4 of the user U4 and transmits them to the karaoke device K. In the karaoke device K, the backup of the facial image data FD4 and the operation history OH4 received from the remote control device R1 is stored in the storage unit 31. In addition, the request unit 24 of the remote control device R1 transmits a request signal including the facial image data FD5 to the karaoke device K, requesting the karaoke device K to transmit the operation history OH5 of the user U5.

[0049] At this point, the operation history OH5 associated with the face image data FD5 is stored in the storage unit 31 of the karaoke device K. Therefore, the transmission unit 32 of the karaoke device K transmits a response signal including the operation history OH5 to the remote control device R1 in response to the request signal from the remote control device R1. When the remote control device R1 receives the operation history OH5 from the karaoke device K, the update unit 25 of the remote control device R1 updates the operation screen 29 based on the operation history OH5. In other words, the state at the time when the user U5 stopped operating the remote control device is reproduced on the operation screen 29 of the remote control device R1.

[0050] Furthermore, the notification unit 26 of the remote control R1 transmits the device identification information ID***R1 of the remote control R1 to the karaoke device K. In the karaoke device K, the reception of the device identification information ID***R1 triggers the start of timing by a timer, and the determination unit 33 determines whether a predetermined time has passed since the reception of the device identification information ID***R1. If the determination unit 33 determines that the predetermined time has passed, the notification unit 34 of the karaoke device K notifies the store staff or the like that the predetermined time has passed since the remote control R1 was handed over to the user U5, and prompts the user U5 to hand over the remote control R1 to another user.

[0051] The processing operation of the karaoke system of the second embodiment will be described with reference to Fig. 6. Fig. 6 is a flow diagram showing an example of the processing operation of the karaoke system of the second embodiment. Note that the symbols in Fig. 5 will be used as appropriate in the description. Also, the following flow diagram is merely an example and can be modified as appropriate.

[0052] 6, the processes from step S21 to step S30 in the second embodiment are the same as the processes from step S01 to step S10 in the first embodiment. When the operation screen 29 of the remote control device R is updated, the notification unit 26 of the remote control device R notifies the karaoke device K of the device identification information of the remote control device R (step S31). When the karaoke device K receives the device identification information, a timer starts counting the elapsed time from the time the device identification information was received (step S32). This counts the time since the remote control device R was handed over to the current user.

[0053] If the determination unit 33 of the karaoke device K determines that the elapsed time since the device identification information was received has exceeded the predetermined time (Yes in step S33), the notification unit 34 of the karaoke device K notifies the user that the remote control device R has been operated for a long period of time (step S34). This encourages users to hand over the remote control device R to each other. If the pairing between the remote control device R and the karaoke device K is not canceled (No in steps S35 and S36), the process returns to step S23 for the remote control device R, and the process returns to step S26 for the karaoke device K. Note that if the notification unit 34 issues a notification, or if new device identification information is received before it is determined that the elapsed time since the device identification information was received has exceeded the predetermined time, the timer is reset.

[0054] As described above, according to the second embodiment, when a user operates the remote control device R for a long period of time, this fact is notified, and the user can be prompted to hand over the remote control device R to another user.

[0055] In the first embodiment, the operation history of the user before the change is backed up, and then the transmission of the operation history of the user after the change is requested, but the order of these processes is not particularly limited. The operation history of the user before the change may be backed up after the transmission of the operation history of the user after the change is requested, or the backup of the operation history of the user before the change and the transmission of the operation history of the user after the change may be performed in parallel.

[0056] In the second embodiment, the operation history of the user before the change is backed up, a request is made to transmit the operation history of the user after the change, and then the device identification information of the remote control device is notified, but the order of these processes is not particularly limited. For example, after the device identification information of the remote control device is notified, the operation history of the user before the change may be backed up, and then the transmission of the operation history of the user after the change may be requested. Furthermore, the backup of the operation history of the user before the change, the transmission of the operation history of the user after the change, and the notification of the device identification information of the remote control device may be performed in parallel.

[0057] Furthermore, in the first and second embodiments, the feature amount of a face image is exemplified as face image data, but the face image data may be any data that can identify a face image.

[0058] In the above embodiment, a program may be installed in the karaoke system to add a backup function for the operation history of the remote control device. The program is stored in a storage medium. The storage medium is not particularly limited, and may be a non-transitory storage medium such as an optical disk, a magneto-optical disk, or a flash memory.

[0059] Although the present embodiment has been described, other embodiments may be obtained by combining the above-described embodiments and modifications in whole or in part.

[0060] Furthermore, the technology of the present invention is not limited to the above-described embodiments, and may be variously modified, substituted, or altered within the scope of the spirit of the technical idea. Furthermore, if the technical idea can be realized in a different way due to technological advances or other derived technologies, it may be implemented using that method. Therefore, the claims cover all embodiments that may fall within the scope of the technical idea. [Explanation of symbols]

[0061] 1: Karaoke system 21: Imaging means 22: Detection unit 23: Backup Department 24:Request part 25: Update section 26:Notification Department 31: Storage part 32: Transmitter 33: Judgment section 34: Information Department K: Karaoke equipment R: Remote control device

Claims

1. A karaoke system comprising: a remote control device that accepts operations via an operation screen; and a karaoke device that is communicably connected to the remote control device, The remote control device a detection unit that detects a change in the user operating the remote control device based on a face image of the user captured by an imaging means; a backup unit that, when a change of user is detected, associates the operation history and face image data of the user before the change with each other and backs them up to the karaoke device; a request unit that, when a change in user is detected, requests the karaoke device to transmit an operation history associated with face image data of the changed user; an update unit that updates the operation screen of the remote control device based on the operation history received from the karaoke device in response to a request, The karaoke device a storage unit that stores backups of operation history and face image data received from the remote control device; A karaoke system characterized by having a transmission unit that reads out the operation history associated with the changed user's facial image data in response to a request from the remote control device and transmits it to the remote control device.

2. The karaoke system of claim 1, characterized in that the transmitting unit transmits an operation history corresponding to a specified screen to the remote control device when an operation history corresponding to the changed user's facial image data is not stored.

3. The remote control device a notification unit that notifies the karaoke device of device identification information of the remote control device when a change in user is detected; The karaoke device a determination unit that determines whether or not a predetermined time has elapsed since the reception of the device identification information; 3. The karaoke system according to claim 1, further comprising an alarm unit that, when the elapsed time exceeds a predetermined time, notifies the user that the remote control device corresponding to the device identification information has been operated for a long period of time.

Images