KTV gesture recognition control system and control method

Abstract

Disclosed in the present invention is a KTV gesture recognition control system. The system comprises: a gesture recognition apparatus, which is used for monitoring a gesture action of a user and generating a corresponding control signal; and an on-demand playback apparatus, which performs a corresponding playback operation on the basis of the control signal of the gesture recognition apparatus, wherein the gesture recognition apparatus processes a collected gesture image to generate a control instruction representing a specific gesture intent; and the on-demand playback apparatus performs a playback operation on the basis of the specific gesture intent represented by the control instruction. Further disclosed in another aspect of the present invention is a KTV gesture recognition control method.

Description

KTV gesture recognition control system and control method TECHNICAL FIELD

[0001] The present application relates to the field of KTV wireless interaction technology, and particularly relates to a KTV gesture recognition control system and control method. BACKGROUND

[0002] With the development of music culture, karaoke has become one of the most popular modern entertainment ways in people's daily life, and the KTV bar, or bar, or catering bar, etc. in combination with the private space of the box can provide a place for singing entertainment and leisure socialization. People can usually invite friends to sing together in KTV, release stress and enjoy leisure time; at the same time, they can also have a party with friends, exchange and enhance friendship; for music lovers, it is also a place to show their singing talent.

[0003] When people are singing, they usually have some human-computer interaction needs from time to time, such as original singing, accompaniment, duet, pause, song switching, etc. The most frequently used control method is currently touch screen. In KTV rooms or bar compartments, almost all touch screens become the indispensable interaction way for people to order songs / sing, etc.

[0004] The earlier mouse and keyboard interaction method has long been out of sight because of too much trouble. Touch screen has become the most popular interactive operation and occupies an absolute position. They are commonly seen in song ordering screens or ordering machines, scene screens, and a few remote controllers, etc.

[0005] These physical contact interactions sometimes limit people who are enjoying leisure, and need to move their bodies to find the exact position of the keys. If it is not easy to operate at the moment, it will cause inner dissatisfaction, which produces emotional resistance for the demand of relaxing mood and freedom.

[0006] Therefore, it is urgent to provide a KTV gesture recognition control system and control method to overcome the above-mentioned defects. SUMMARY

[0007] The present application aims to provide a KTV gesture recognition control system and control method to overcome the above-mentioned defects in the prior art.

[0008] In order to achieve the above object, the application provides a KTV gesture recognition control system, comprising: a gesture recognition device, used for monitoring user gesture actions and generating corresponding control signals; a on-demand device, making corresponding playing operations based on the control signals of the gesture recognition device; wherein the gesture recognition device processes collected gesture images to generate control instructions representing a specific gesture intention; the on-demand device makes playing operations based on the specific gesture intention represented by the control instructions.

[0009] The gesture recognition device comprises: an image acquisition module, used for acquiring gesture images when a user makes gesture actions; an image processing module, performing hand detection processing on the images acquired by the image acquisition module, extracting images with hand regions, and performing gesture recognition processing on the extracted images with hand regions.

[0010] The gesture recognition device comprises: an image acquisition module, used for acquiring gesture images when a user makes gesture actions; an image processing module, performing hand detection processing on the images acquired by the image acquisition module, extracting images with hand regions, and performing gesture recognition processing on the extracted images with hand regions.

[0011] The image processing module detects hand shape information features from the images with hand regions and matches the hand shape information features with pre-defined hand models to detect information of the images containing the hand features.

[0012] The image processing module generates a gesture recognition index number based on the hand shape information features and matches the gesture recognition index number with the pre-defined hand models.

[0013] The control instructions have corresponding code values, and the code values are associated with and bound to the gesture recognition index numbers.

[0014] The specific gesture intention represents one of original / duet singing, duet singing, pause / playing, and song switching operations.

[0015] The KTV gesture recognition control system further comprises an indication device, used for prompting the current gesture recognition status of the user.

[0016] The indication device further comprises: a gesture recognition device carrying part, used for loading the gesture recognition device; an indication lamp, used for prompting the current gesture recognition status of the user; and an indication lamp carrying part, used for loading one or more indication lamps.

[0017] The indication lamp carrying part is a crown-shaped structure with multiple crown top prongs, and the indication lamps are respectively installed on the crown top prongs.

[0018] The indicator light is an LED light bead, and the indicator light is installed in parallel on the fork of the crown top part.

[0019] The gesture recognition device is installed on the tea table, and the gesture recognition device can monitor the user making a specific gesture in a monitoring area above the tea table and collect an image of the on-site gesture.

[0020] The gesture recognition device is installed inside the tea table, and the indication device is installed below the panel of the tea table, and the display state of the indication device can be observed through the panel.

[0021] When the gesture recognition device detects an image of a hand region, a first indication control instruction is sent to the indication device; after the indication device receives the first indication control instruction, a first state lighting operation is performed.

[0022] When the gesture recognition device performs gesture recognition processing on the image of the hand region and successfully recognizes hand shape information features, a second indication control instruction is output to the indication device; after the indication device receives the second indication control instruction, a second state lighting operation is performed.

[0023] When the gesture recognition device fails to successfully recognize the hand shape information features, a third indication control instruction is output to the indication device; after the indication device receives the third indication control instruction, a third state lighting operation is performed.

[0024] The application also provides a KTV gesture recognition control method, which comprises monitoring a user making a specific gesture and collecting an on-site gesture image, performing hand detection processing on the gesture image and extracting an image of a hand region, performing gesture recognition processing on the image of the hand region, and generating a control control instruction based on the gesture recognition processing result.

[0025] Beneficial effects: based on gesture recognition, air interaction is realized to complete frequent control encountered in KTV singing, so that users feel more free, more relaxed, more cool, and more perfectly integrated into the whole KTV leisure and entertainment, improve emotional value, and improve user experience. BRIEF DESCRIPTION OF DRAWINGS

[0026] Fig. 1 is a structural schematic view of a KTV gesture recognition control system according to the present application;

[0027] Fig. 2 is a schematic view of a control control instruction and a gesture action matching according to the present application;

[0028] Fig. 3 is a structural schematic view of a gesture recognition device according to the present application;

[0029] Fig. 4 is a structural schematic diagram of the indication device involved in the present application;

[0030] Figs. 5A-5B are structural schematic diagrams of a tea table equipped with the gesture recognition device involved in the present application;

[0031] Fig. 6 is a flow schematic diagram of the KTV gesture recognition control method involved in the present application;

[0032] Fig. 7 is a live schematic diagram of the KTV gesture recognition control system involved in the present application. DETAILED DESCRIPTION

[0033] The embodiments of the present application are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar notations represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the accompanying drawings are exemplary only, and are used to explain the present application, but cannot be interpreted as a limitation of the present application.

[0034] Those skilled in the art can understand that, unless specifically stated, the singular forms "a", "an" and "the" used herein also include the plural forms. It should be further understood that the use of the phrase "comprises" in the specification of the present application means that the stated features, integers, steps, operations, elements and / or components exist, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof. It should be understood that when we say an element is "connected" to another element, it can be directly connected to the other element, or there can be intermediate elements. In addition, "connected" used herein can include wireless connection. The phrase "and / or" used herein includes all or any single unit and all combinations of the associated listed items.

[0035] Those skilled in the art can understand that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as that generally understood by those skilled in the art to which the present application belongs. It should also be understood that terms such as those defined in a general dictionary should be understood to have meanings consistent with those in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless specifically defined as such.

[0036] Figure 1 is a schematic diagram of the structure of the KTV gesture recognition control system of the present embodiment. As shown in Figure 1, the KTV gesture control system comprises a gesture recognition device 100, a pointcast device 200 and an indication device 300. The gesture recognition device 100 is used to monitor the user's gesture actions and generate corresponding control signals. The pointcast device 200 (e.g. a video on demand device, VOD) is used to play audio and video files, such as music, songs and various audio and video files. The indication device 300 is used to prompt the user about the current gesture recognition status, which can be any one or combination of an on-off indicator light, an indicator signal light, an indicator light board, an indicator light box, an atmosphere light, a hurdle light, a projection light, a single color light, a multi-color light, a display screen, etc. During the user's singing in a KTV booth, when the user needs to perform original / duet singing, sing a song again, pause / play and / or change songs, the user makes corresponding gesture actions. The gesture recognition device 100 recognizes the user's gesture actions and generates corresponding control signals which are sent to the pointcast device 200. The pointcast device 200 receives the control signals representing the original / duet singing, singing a song again, pausing / play and / or changing songs and performs corresponding operations. The gesture recognition device 100 and the pointcast device 200 can be connected by wire or wirelessly, so that the control instruction signals of the gesture recognition device 100 are uploaded to the pointcast device 200. The gesture recognition device 100 and the indication device 300 can be connected by wire or wirelessly, so that the control operation of the indication device 300 is controlled.

[0037] In the above embodiment, preferably, the gesture recognition device 100 can perform image acquisition, calculation and processing based on computer vision to complete gesture recognition and output corresponding control instructions. The control instructions include but are not limited to one or a combination of control control instructions, indication control instructions and data packet instructions.

[0038] In the above embodiment, more preferably, the control control instructions are specific encoding signals for controlling the pointcast device, which are usually represented as a code value, each code value corresponding to a control, at least including four code values, i.e. corresponding to four controls: original / duet singing, singing a song again, pausing / play and changing songs (next song). The control control instructions are usually sent to the pointcast device 200 in the form of code values through a certain communication protocol or communication format. Before sending, the code values are associated and bound with the gesture index code based on gesture action recognition. After sending, the control control instructions are recognized by the pointcast device 200 to trigger the operation of the KTV pointcast system software. Each control of the control control instructions corresponds to only one gesture action, and the specific gesture action can be designed according to actual needs.

[0039] In the above embodiment, taking the serial communication protocol as an example, in combination with FIG. 2, the four commonly used gesture index codes correspond to four control code values, each gesture index code corresponds to one control code value, representing one gesture intention, such as extending the thumb for original / duet, extending the "V" shape gesture for duet, extending the palm gesture for pause / play, and extending the clenched fist gesture for song cutting. In the above embodiment, the gesture index code of extending the thumb, whose gesture intention is original / duet, corresponds to the control code value 0c, and the control control instruction is written as "[original / duet: 0c]". The brackets in the above control control instruction are a group of key-value pairs, the name before the colon and the code value after the colon. The control code value is usually a decimal conversion into hexadecimal, and then a certain communication format is adopted, such as the baud rate 4800, and the control instruction is "[baud rate: 4800]", in which 4800 is a decimal number, and the value is usually determined according to the internal parameters of the on-demand device 200; for example, the release interval 300, and the control instruction is "[release interval: 300]", in which 300 is a decimal number in milliseconds, and the value is usually determined according to the internal parameters of the on-demand device 200.

[0040] The indication control instruction is a switch signal for the indication device 300, which displays the gesture recognition status in real time. The indication control instruction can be a code value, a high-low level signal, or even a pulse modulation signal, which can be designed according to actual needs. If it appears in the form of a code value, it can be equivalent to the code value of the control control instruction. At this time, the control control instruction and the indication control instruction share the same code value. Therefore, the indication control instruction can be multiplexed with the control control instruction, or used separately.

[0041] The indication control instruction also includes a special control instruction, i.e. the display control of the gesture recognition function start state. When the user's hand appears in a certain monitoring area, a prompt signal is output to the indication device 300 to start lighting the identification, indicating that the gesture recognition process is within the normal detection range, so that the user can see and make gestures. The specific display effect can be designed according to actual needs.

[0042] The data packet instruction is a format for communication between the gesture recognition device 100 and the on-demand device 200 and / or the indication device 300, so as to realize data transmission and exchange. The communication between the gesture recognition device 100 and the on-demand device 200 and / or the indication device 300 is in the format of each data packet, which includes a frame header, data, a checksum, and a frame tail. At this time, the signal is no longer one-way, but two-way, that is, the data signal can go uplink or downlink, and after being accurately recognized, each realizes its own function.

[0043] The on-demand device 200 is commonly known as a karaoke machine, a karaoke machine, a karaoke machine, etc., including but not limited to commercial karaoke machines, home karaoke machines, car karaoke machines, online on-demand equipment, etc. The on-demand device 200 can also include a KTV ordering system control device or terminal without a song screen, a song table, a remote control, a mobile terminal, etc., without limitation. Preferably, the on-demand device 200 has a large-capacity built-in song library, adjusts the volume, and realizes the entertainment control host of singing while watching and listening by connecting a television, a projector, a power amplifier, and a sound. More preferably, the on-demand device 200 usually has several I / O interfaces, including but not limited to any combination of DC12V (DC 12V power input), VGA (video graphics array), HMDI (high-definition multimedia interface), USB (universal serial bus), Ethernet (Ethernet), WIFI, Bluetooth, star flash, 4G / 5G, central control, touch, serial port, optical fiber, video, sound left, sound right, recording, scoring, volume, etc.

[0044] The indication device 300 can display only one state or multiple states, including but not limited to an unlit (dark) state when not enabled, a dim state when not detected after being enabled, a high-light state when a hand is detected after being enabled, a high-light state after successful gesture recognition, a flashing state when gesture recognition fails, etc.

[0045] Fig. 3 is a structural schematic diagram of the gesture recognition device 100 of the embodiment. As shown in Fig. 3, the gesture recognition device 100 comprises an image acquisition module 101, an interface module 102, an image processing module 103, a power management module 104 and a storage module 105. The image acquisition module 101 is configured to acquire image videos of a user making a gesture action; the interface module 102 is configured to be communicatively connected with an external device; the image processing module 103 is configured to process the acquired image videos, generate and output corresponding control instructions; the power management module 104 is configured to provide power supply for the gesture recognition device 100; and the storage module 105 is configured to store gesture recognition related computer instructions. Preferably, the image processing module 103 is built-in with a gesture recognition program; and the power management module 104 provides input and output of power supply for the gesture recognition device 100, and monitors input voltage, output voltage, current, power and other parameters of the power supply in real time, so as to protect correct use of the power supply and not affect normal functions of the whole machine.

[0046] In the above embodiment, through mutual cooperation among the image acquisition module 101, the interface module 102, the image processing module 103, the power management module 104 and the storage module 105 of the gesture recognition device 100, the user can conveniently remotely control the on-demand device 200 by only making a gesture action, thereby overcoming inconvenience of physical contact type interaction.

[0047] Fig. 4 is a structural schematic diagram of the indication device 300 of the embodiment. As shown in Fig. 4, the indication device 300 comprises a gesture recognition device bearing part 310, an indication lamp bearing part 320 and an indication lamp 330. The gesture recognition device bearing part 310 is configured to load the gesture recognition device 100, and can also be used to display brand image; the indication lamp bearing part 320 is configured to load one or more indication lamps 330; and the indication lamp 330 is configured to prompt a user of a current gesture recognition status.

[0048] In the above embodiment, preferably, the indication lamp bearing part 320 has a plurality of bifurcated structures, and each bifurcation is provided with the indication lamp 330, including an indication lamp 330a, an indication lamp 330b, an indication lamp 330c and the like (see Fig. 4).

[0049] In the above embodiment, more preferably, the indicator light bearing component 320 adopts a crown structure, has multiple crown top prongs, and the indicator light 330 is installed on each crown top prong. The indicator light bearing component 320 adopting the crown structure not only enables the installation of the indicator light 330 on multiple crown top prongs, but also enables the indicator device 300 to exhibit a noble image and improve the user experience. Meanwhile, the installation of the indicator light 330 on each crown top prong not only enables the lighting and emission, but also enables the decoration of the crown, further exhibits the elegance of the indicator light bearing component 320 adopting the crown structure, and further improves the user experience.

[0050] In the above embodiment, preferably, the multiple indicator lights 330 (the indicator light 330a, the indicator light 330b, the indicator light 330c, etc.) are LED lamp beads, can be connected in parallel at the same time, and then connected to the general-purpose input and output pin (GPIO) of the gesture recognition device 100. When the gesture recognition device 100 outputs the gesture monitoring result, a high level is sent to the LED lamp bead 330, so that the LED lamp bead 330 can be powered on and lighted up, so that the user can see the display state of the LED lamp bead 330. The advantage of this setting is that if a certain lamp bead is damaged, the remaining lamp beads can still display normally, so that the indicator device 300 has a certain fault tolerance.

[0051] FIGS. 5A-5B are schematic diagrams of a tea table structure loaded with a gesture recognition device according to the present embodiment. As shown in FIGS. 5A-5B, a sofa 30 and a tea table 20 are arranged in a KTV box. The tea table 20 is close to the sofa 30, and a user sitting on the sofa 30 can reach the space above the tea table 20. The tea table 20 is installed with the gesture recognition device 100, which can monitor the user in the monitoring area (4a, 4b) above the tea table 20 to make a certain specific gesture and collect the image of the live gesture.

[0052] In the above embodiment, preferably, the gesture recognition device 100 is hidden in the tea table 20, and the indicator device 300 is installed below the panel 201 of the tea table 20, and the display state of the indicator light 330 of the indicator device 300 can be observed through the panel 201. More preferably, the gesture recognition device 100 is installed on the side of the tea table 20 close to the sofa 30.

[0053] In the above embodiment, the gesture recognition device 100 is installed on the tea table 20, so that the user sitting on the sofa can control the operation of the on-demand device 200 through gestures without getting up, further improving the user experience. In the above embodiment, the gesture recognition device 100 is installed on the tea table 20, so that the user sitting on the sofa can control the operation of the on-demand device 200 through gestures without getting up, further improving the user experience.

[0054] Fig. 6 is a flow chart of the KTV gesture recognition control method according to the present embodiment. As shown in Fig. 6, when the user 1 holds the microphone 2 and sings in front of the display screen 3, the user 1 makes a certain specific gesture 1b (such as a "V" shape gesture) (see Fig. 7). The image acquisition module 101 of the gesture recognition device 100 monitors the user 1 making the certain specific gesture 1b in the monitoring area (4a, 4b), acquires the image of the live gesture, and transmits the acquired image to the image processing module 103 (step S101). Preferably, the video image of the live gesture is acquired. The image processing module 103 of the gesture recognition device 100 performs hand detection processing on the acquired image (step S102), and determines whether a hand is detected (step S103). If the image processing module 103 does not detect a hand (step S103: No), the waiting continues. If the image processing module 103 detects a hand (step S103: Yes), the image of the hand region is extracted and retained, and a first indication control instruction is output to the indication device 300 (step S104), and then the gesture recognition processing continues (step S105).

[0055] In the above embodiment, preferably, after the video image of the live gesture is acquired, a video stream is formed over time, and the video image sequence is arranged in sequence. Then, the image is extracted from the video image sequence, the hand detection and segmentation are performed, it is detected whether the extracted image contains hand features, if not, the frame image is discarded, and the next frame image continues, if yes, the image region containing the specific position of the hand features is segmented. The segmented image region accounts for a smaller proportion of the whole image, i.e. the non-hand region image is much larger than the hand region image, which is not conducive to calculation. Therefore, the image with the hand region is segmented, and the image information with the hand region is retained, which can reduce the calculation amount.

[0056] In the above embodiment, preferably, in the hand detection processing, the detected hand shape information features are matched with the pre-defined hand model, so as to determine whether the hand features are contained, and thus the image information containing the hand features is detected. The hand shape information features have various geometric features, such as the contour features of the hand, the finger connection mode, the length / width / width ratio of the fingers and the palm, and the three-dimensional texture details. Once the information containing the hand features is detected, it is immediately determined that the current user is in the monitoring range suitable for making gesture actions, and thus an indication signal is generated, i.e. the first indication control instruction signal is output. The first indication control instruction signal can be any one or combination of code value, data packet, high / low level, pulse width modulation, etc.

[0057] The indication device 300 judges whether the first indication control command is received (step S201). If the indication device 300 does not receive the first indication control command (step S201: No), it continues to wait. If the indication device 300 receives the first indication control command (step S201: Yes), it performs the first state lighting operation (step S202) and waits to receive the second indication control command (step S203). After receiving the first indication control command, the indication device 300 performs the first state lighting operation by the indication light 330. The first state lighting operation can be one of low brightness, high brightness, monochromatic light, multi-color light, flashing, pulsation, gradual change, etc., which can be understood by the user as the current state being suitable for gesture operation.

[0058] In step S105, the image processing module 103 performs gesture recognition on the image with the hand region and judges whether the recognition is successful (step S106). If the image processing module 103 successfully recognizes the hand shape information feature (step S106: Yes), it outputs the second indication control command to the indication device 300 (step S108), and then generates the control command and sends it to the on-demand device 200 (step S109). The on-demand device 200 receives the control command and performs corresponding operation (step S110).

[0059] If the image processing module 103 fails to successfully recognize the hand shape information feature, i.e., the image processing module 103 fails to recognize the specific gesture 1b of the user 1 (step S106: No), it outputs the third indication control command to the indication device 300 (step S107).

[0060] In step S105, preferably, the image processing module 103 further processes the image with the hand region, extracts the hand gesture feature information from the image with the hand region, calculates the hand gesture feature and the hand gesture feature of the pre-established hand gesture model for matching, obtains the hand gesture probability value, normalizes the hand gesture probability value, generates a hand gesture recognition index number, and finally matches the hand gesture recognition index number with the pre-defined hand gesture library. The matching result is the hand gesture recognition success, the hand gesture recognition result is output, and the control command is generated.

[0061] In the above embodiment, preferably, the operation control instruction represents that the extended thumb means karaoke / singing along, the extended "V" shape gesture means duet, the extended five-fingered and closed palm gesture means pause / play, and the extended clenched fist gesture means one of the gesture intentions in song switching. After the on-demand device 200 receives the operation control instruction, it performs one of the operations of karaoke / singing along, duet, pause / play, and song switching based on the gesture intention represented by the operation control instruction.

[0062] In step S203, the indication device 300 determines whether the second indication control instruction is received. If the indication device 300 receives the second indication control instruction (step S201: YES), it performs a second state lighting operation (step S204). After the indication device 300 receives the second indication control instruction, it performs the second state lighting operation by the indication lamp 330. The second state lighting can be one of low brightness, high brightness, monochromatic light, multicolor light, flickering, pulsation, gradual change, etc., which is used to prompt the user to understand that the current gesture action has been successfully recognized after seeing it. The second state lighting is different from the first state lighting, for example, the first state lighting is low brightness, and the second state lighting is high brightness.

[0063] If the indication device 300 does not receive the second indication control instruction (step S203: NO), it determines whether the third indication control instruction is received (step S205). If the indication device 300 does not receive the third indication control instruction (step S205: NO), it returns to step 203 to continue waiting. If the indication device 300 receives the third indication control instruction (step S205: YES), it performs a third state lighting operation (step S206). After the indication device 300 receives the third indication control instruction, it performs the third state lighting operation by the indication lamp 330. The third state lighting can be one of low brightness, high brightness, monochromatic light, multicolor light, flickering, pulsation, gradual change, etc., which is used to prompt the user to understand that the current gesture action recognition fails after seeing it, so that the user can make a new gesture action in time. The third state lighting is different from the first state lighting and the second state lighting, for example, the first state lighting is low brightness, the second state lighting is high brightness, and the third state lighting is flickering.

[0064] In the above embodiment, preferably, when the gesture recognition device 100 monitors that the user 1 makes a certain specific gesture 1b in the monitoring area of the gesture recognition device 100, the gesture recognition device 100 starts the gesture recognition program. In this way, the gesture recognition program of the gesture recognition device 100 does not need to be in a running state all the time.

[0065] In the above embodiment, preferably, the indication device 300 can further have a function of adding a gesture pattern or a display image, and the display effect thereof is consistent with the gesture action made by the user, so that the user can conveniently confirm the gesture recognition result when / after making the gesture action.

[0066] The foregoing description of specific exemplary embodiments of the application is presented for the purpose of illustration and description. It is not intended to be a limitation on the application as it is apparent that many modifications and variations could be made to the present application by a person of ordinary skill in the art. The exemplary embodiments were chosen and described in order to best explain the principles of the application and its practical application, thereby enabling others skilled in the art to best utilize the application, various embodiments and various modifications as are suited to the particular use contemplated.

[0067] Those skilled in the art can understand that the steps, measures, schemes in various operations, methods, processes discussed in the present application can be alternated, changed, combined or deleted. Further, other steps, measures, schemes in various operations, methods, processes discussed in the present application can also be alternated, changed, rearranged, decomposed, combined or deleted. Further, the steps, measures, schemes in various operations, methods, processes in the prior art can also be alternated, changed, rearranged, decomposed, combined or deleted.

[0068] The above is only part of the embodiments of the present application, and it should be pointed out that, for those skilled in the art, without departing from the principles of the present application, a number of improvements and refinements can be made, and these improvements and refinements should be regarded as the protection scope of the present application

Claims

1. A KTV gesture recognition control system, comprising: a gesture recognition device for monitoring user gesture actions and generating corresponding control signals; a play-on-demand device for making corresponding play operations based on the control signals of the gesture recognition device; wherein the gesture recognition device processes collected gesture images to generate a control instruction representing a specific gesture intention; and the play-on-demand device makes play operations based on the specific gesture intention represented by the control instruction.

2. The KTV gesture recognition control system according to claim 1, characterized in that, The gesture recognition device comprises: an image collection module for collecting gesture images of user gesture actions; an image processing module for hand detection processing on images collected by the image collection module, extracting images with hand regions, and performing gesture recognition processing on the extracted images with hand regions. 3.The KTV gesture recognition control system of claim 2, wherein: the gesture images collected by the image collection module are video images; the image processing module extracts images from a sequence of the video images, and performs hand detection and segmentation to extract the images with hand regions. 4.The KTV gesture recognition control system of claim 3, wherein: the image processing module detects hand shape information features from the images with hand regions, and matches the hand shape information features with pre-defined hand models to detect information of the images containing the hand features.

5. The KTV gesture recognition control system according to claim 4, characterized in that: The image processing module generates a gesture recognition index number based on the hand shape information features, and matches the gesture recognition index number with the pre-defined hand models.

6. The KTV gesture recognition control system according to claim 5, characterized in that: The control instruction has a corresponding code value, which is associated and bound with the gesture recognition index number.

7. The KTV gesture recognition control system according to any one of claims 1-6, characterized in that: The specific gesture intention represents one of the following operations: original / duet singing, duet singing, pause / play, and song switching.

8. The KTV gesture recognition control system according to any one of claims 1-6, further comprising: An indication device for prompting the user of the current gesture recognition status.

9. The KTV gesture recognition control system according to claim 8, characterized in that, The indication device further comprises: a gesture recognition device carrying component for loading the gesture recognition device; an indication lamp for prompting the user of the current gesture recognition status; an indication lamp carrying component for loading one or more indication lamps. 10.The KTV gesture recognition control system of claim 9, wherein: the indication lamp carrying component is a crown-shaped structure with multiple crown top prongs, and the indication lamps are respectively installed on the crown top prongs.

11. The KTV gesture recognition control system according to claim 10, characterized in that: The indication lamps are LED lamp beads, and the indication lamps are respectively and parallelly installed on the crown top prongs.

12. The KTV gesture recognition control system according to claim 8, characterized in that: The gesture recognition device is installed on a coffee table, and the gesture recognition device can monitor the user making a specific gesture in a monitoring area above the coffee table, and collect images of the live gesture.

13. The KTV gesture recognition control system according to claim 12, characterized in that: The gesture recognition device is installed inside the coffee table, and the indication device is installed below a panel of the coffee table, and the display state of the indication device can be observed through the panel. 14.The KTV gesture recognition control system of claim 8, wherein: When the gesture recognition device detects the image with the hand region, a first indication control instruction is sent to the indication device; After the indication device receives the first indication control instruction, a first state lighting operation is performed.

15. The KTV gesture recognition control system of claim 8, wherein: When the gesture recognition device successfully recognizes the hand shape information feature from the image with the hand region, a second indication control instruction is output to the indication device; After the indication device receives the second indication control instruction, a second state lighting operation is performed.

16. The KTV gesture recognition control system of claim 8, wherein: When the gesture recognition device fails to successfully recognize the hand shape information feature, a third indication control instruction is output to the indication device; After the indication device receives the third indication control instruction, a third state lighting operation is performed.

17. A KTV gesture recognition control method, comprising: monitoring a user making a specific gesture and collecting a live gesture image; performing hand detection processing on the gesture image and extracting an image with a hand region; performing gesture recognition processing on the image with the hand region; generating a control control instruction based on the gesture recognition processing result.

18. The KTV gesture recognition control method of claim 17, wherein: the live gesture image is collected, hand detection processing is performed on the live gesture image to extract an image with a hand region, and gesture recognition processing is performed on the extracted image with the hand region.

19. The KTV gesture recognition control method of claim 17, wherein: the gesture image is a video image; an image is extracted from a sequence of the video image, and the hand detection processing is performed to extract the image with the hand region.

20. The KTV gesture recognition control method of claim 19, wherein: a hand shape information feature is detected from the image with the hand region, and the hand shape information feature is matched with a pre-defined hand model to detect information of the image containing the hand feature.

21. The KTV gesture recognition control method according to claim 20, characterized in that: a gesture recognition index number is generated based on the hand shape information feature, and the gesture recognition index number is matched with the pre-defined hand model.

22. The KTV gesture recognition control method according to claim 21, characterized in that: a code value of the control control instruction is associated with and bound to the gesture recognition index number.

23. The KTV gesture recognition control method of any one of claims 17-22, wherein: When the gesture recognition device detects the image with the hand region, a first indication control instruction is sent to the indication device; When the indication device receives the first indication control instruction, a first state lighting operation is performed.

24. The KTV gesture recognition control method of any one of claims 17-22, wherein: When the gesture recognition device successfully recognizes the hand shape information feature from the image with the hand region, a second indication control instruction is output to the indication device; The indication device receives the second indication control instruction and executes a second state lighting operation.

25. The KTV gesture recognition control method according to any one of claims 17-22, characterized in that: When the gesture recognition device fails to successfully recognize the hand shape information feature, a third indication control instruction is output to the indication device; The indication device receives the third indication control instruction and executes a third state lighting operation.

Images