Gesture recognition device and gesture recognition method based on crystal display piece

Abstract

The invention relates to a gesture recognition device and a gesture recognition method based on a crystal display piece, and relates to the technical field of gesture recognition devices. The display device comprises a display stand, a crystal display piece is arranged above the display stand, a through hole corresponding to the slot is formed in the display stand, a light guide rod is arranged in the through hole, one end of the light guide rod is located below the display stand, and the other end of the light guide rod penetrates through the through hole and is located in the crystal display piece; an LED light supplementing lamp assembly is arranged at the center of the light guide rod, and a light flow sensor is arranged at the end, away from the crystal display stand, of the light guide rod. The method has the effect of improving the accuracy of gesture recognition based on the crystal display piece.

Description

Technical Field

[0001] The present application relates to the technical field of gesture recognition devices, and in particular to a gesture recognition device and a gesture recognition method based on a crystal display. Background Art

[0002] As human-computer interaction technology develops rapidly, gesture recognition technology based on various sensors has been widely used, providing users with a more intuitive and convenient way of interaction. Especially in exhibitions, stores and other display occasions, crystal display pieces are widely used because of their beautiful appearance and easy to attract the audience's attention. The combination of gesture recognition technology and crystal display pieces can further enhance the interactivity and improve the user experience.

[0003] In order to realize gesture recognition, the commonly used technical means currently mainly include using sensors to capture changes in user gestures, and processing them through specific algorithms to finally realize gesture recognition. Specifically, common gesture recognition devices on the market mainly use technologies such as cameras or infrared sensors to capture gesture changes, and then realize gesture recognition through corresponding image processing and pattern recognition algorithms. In addition, there are some technical means combined with special display pieces to realize gesture recognition by capturing changes in light signals through optical sensors. These methods usually rely on complex imaging equipment and image processing technology, and to a certain extent, achieve a stable interactive experience.

[0004] However, the problem with the above existing gesture recognition technology is that the camera or infrared sensor is easily disturbed in a complex light environment, resulting in reduced recognition accuracy and difficulty in capturing the dynamic changes of gestures in a stable and real-time manner. In addition, existing optical sensors are generally not optimized specifically for crystal display pieces, resulting in low light collection efficiency in actual applications, which in turn affects the accuracy of gesture recognition. Summary of the invention

[0005] In order to improve the accuracy of gesture recognition based on a crystal display piece, the present application provides a gesture recognition device and a gesture recognition method based on a crystal display piece.

[0006] On the one hand, the present application provides a gesture recognition device based on a crystal display element, which adopts the following technical solution: A gesture recognition device based on a crystal display piece comprises a display stand, wherein a crystal display piece is arranged above the display stand, a through hole is arranged on the display stand corresponding to a slot, a light guide rod is arranged in the through hole, one end of the light guide rod is located below the display stand, and the other end of the light guide rod passes through the through hole and is located inside the crystal display piece; an LED fill light assembly is arranged at the center of the light guide rod, and an optical flow sensor is arranged at one end of the light guide rod away from the crystal display stand.

[0007] By adopting the above technical solution, during the gesture recognition process, the light emitted by the LED fill light assembly is irradiated onto the crystal display piece through the light guide rod. When the user's hand slides over the crystal display piece, the light signal emitted by the LED light assembly can be reflected by the hand and received by the optical flow sensor, and the gesture recognition is completed through the optical flow sensor.

[0008] Preferably, a slot is provided on a side of the crystal display piece close to the display stand, and an end of the light guide rod away from the optical flow sensor is plugged into and matched with the slot.

[0009] By adopting the above technical solution, the crystal display piece is brought close to the light guide rod and plugged in, so that the light emitted by the LED fill light assembly can be irradiated on the crystal display piece as much as possible through the light guide rod.

[0010] Preferably, the LED fill light assembly includes a mounting platform and a plurality of LED lamps, the mounting platform is mounted on the light guide rod, and the mounting platform has a plurality of mounting grooves along its circumference, the LED lamps are correspondingly mounted in the mounting grooves, and the heads of the LED lamps face the light guide rod.

[0011] By adopting the above technical solution, a mounting table is provided to provide a stable support and fixing platform for the LED lamp, ensuring that the LED lamp can be stably installed on the light guide rod and avoiding falling off or damage due to vibration or external force as much as possible.

[0012] Preferably, a light focusing groove is provided at one end of the mounting groove close to the light guide rod, the groove wall of the light focusing groove is inclined outward, and the LED lamp head is located in the light focusing groove.

[0013] By adopting the above technical solution, the focusing groove can ensure that the light emitted by the LED or the like can be concentrated on the light guide rod as much as possible, thereby further improving the utilization rate of the light.

[0014] Preferably, the axis of the light guide rod coincides with the axis of the crystal display element, and the sensing end of the optical flow sensor is located on the axis of the light guide rod.

[0015] By adopting the above technical solution, the light emitted by the LED fill light assembly can be more evenly projected onto the crystal display piece.

[0016] On the other hand, the present application provides a gesture recognition method based on a crystal display piece using the following technical solution: A gesture recognition method based on a crystal display piece, based on the above-mentioned gesture recognition device, includes an LED driving module, an RGB signal grayscale processing module, an optical flow signal processing module, a dynamic grayscale signal intersection module, an information processing module and an actuator; and also includes the following steps: Controlling the LED fill light assembly to emit light, the LED driving module outputs an RGB driving signal to the control end of the LED fill light assembly; Grayscale processing is performed on the light emitted by the LED fill light assembly. The LED driving module can also generate a corresponding LED fill light control instruction according to the RGB driving signal, and input the LED fill light control instruction to the RGB signal grayscale processing module. The RGB grayscale processing module generates corresponding RGB signal grayscale data according to the received LED fill light control instruction, and inputs the generated RGB signal grayscale data to the dynamic grayscale signal intersection module; When the user's hand slides over the crystal display piece, the light signal emitted by the LED light assembly can be reflected by the hand and received by the optical flow sensor, and the optical flow sensor outputs the optical flow signal to the optical flow signal processing module; Performing grayscale processing on the information received by the optical flow sensor, the optical flow signal grayscale processing module is used to receive the optical flow signal and generate optical flow signal grayscale data, and input the generated optical flow signal grayscale data into the dynamic grayscale signal intersection module; Recognize user gestures, the dynamic grayscale signal intersection module receives the RGB signal grayscale data and combines it with the optical flow signal grayscale data to generate synthetic dynamic grayscale data; the signal processing module is used to process the synthetic dynamic grayscale data to generate corresponding finger instructions and output them to the actuator.

[0017] By adopting the above technical solution, users do not need to wear any additional equipment or perform complicated settings. They can interact with the displayed content by simply making gestures above the crystal display piece, which improves user participation and experience and achieves accurate capture and rapid response to gestures.

[0018] Preferably, the synthesized dynamic grayscale data is equal to the optical flow signal grayscale data minus the RGB signal grayscale data.

[0019] By adopting the above technical solution, the RGB signal grayscale data may contain some static or slowly changing ambient light information. By subtracting this part of information, the interference of background light on gesture recognition can be reduced to a certain extent, and the accuracy of recognition can be improved.

[0020] Preferably, the LED driving module consists of a microprocessor and a driving circuit.

[0021] By adopting the above technical solution, the control of the LED light emitting lamp assembly is achieved.

[0022] Preferably, the LED driving signal can control the light quantity and light intensity of the LED fill light.

[0023] By adopting the above technical solution, the emission pipeline of the LED fill light assembly can be adjusted according to the surrounding ambient light and application scenarios.

[0024] In summary, the present application includes at least one of the following beneficial technical effects: 1. The stable coordination of the display stand and the crystal display piece and the precise installation of the light guide rod ensure the effective transmission and uniform distribution of light, thus improving the stability of gesture recognition; 2. The multi-LED lamp design and optimized focusing groove of the LED fill light assembly make the light more concentrated and uniform in intensity, significantly improving the accuracy of gesture recognition; 3. The optical flow sensor captures the dynamic changes of gestures in real time, and can produce optical flow signal grayscale data through the optical flow signal processing module. By subtracting the RGB grayscale signal grayscale data, it can effectively improve the real-time response capability and anti-interference performance of gesture recognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 It is a schematic diagram of the overall structure of Example 1 of the present application; Figure 2 is a schematic cross-sectional structure diagram of Example 1 of the present application; Figure 3 This is a principle block diagram of Example 2 of the present application; Figure 4 This is a method flow chart of Example 2 of the present application.

[0026] Figure numerals: 1. display stand; 2. crystal display piece; 21. slot; 3. light guide rod; 4. LED fill light assembly; 41. mounting stand; 411. mounting slot; 412. focusing slot; 42. LED lamp; 5. optical flow sensor. DETAILED DESCRIPTION

[0027] The following is combined with Figure 1-4 This application is described in further detail.

[0028] Embodiment 1: Embodiment 1 of the present application discloses a gesture recognition device and a gesture recognition method based on a crystal display piece.

[0029] Reference Figure 1 and Figure 2A gesture recognition device and a gesture recognition method based on a crystal display piece include a display stand 1, a crystal display piece 2 is arranged above the display stand 1, and a user's hand swings above the crystal display piece 2 to form a gesture. A slot 21 is arranged on the side of the crystal display piece 2 close to the display stand 1, and a through hole is arranged on the display stand 1 corresponding to the slot 21. A light guide rod 3 is arranged in the through hole, one end of the light guide rod 3 is located below the display stand 1, and the other end of the light guide rod 3 passes through the through hole and is connected to the crystal display piece 2. An LED fill light assembly 4 is also arranged at the center of the light guide rod 3, and an optical flow sensor 5 for receiving light is also arranged below the light guide rod 3 away from the display stand 1. The optical flow sensor 5 can capture the dynamic changes of gestures in real time by calculating the movement speed of pixels or feature points in the image, that is, the optical flow, so as to realize the recognition of gestures.

[0030] The display stand 1 is in the shape of a rectangular plate as a whole, and the crystal display piece 2 is in the shape of a cylinder as a whole, and the axis of the crystal display piece 2 is perpendicular to the length direction of the display stand 1, and the crystal display piece 2 can be used to collect light comprehensively. A cylindrical slot 21 is provided on the side of the crystal display piece 2 close to the display stand 1, and the light guide rod 3 is in the shape of a cylinder as a whole. The light guide rod 3 can be made of a transparent material such as transparent plastic or quartz material, and the axis of the light guide rod 3 coincides with the axis of the crystal display piece 2, and one end of the light guide rod 3 is plugged into the slot 21. The two ends of the light guide rod 3 are in the shape of arcs, that is, the two ends of the light guide rod 3 are in the shape of convex mirrors. The setting of the curvature of the convex mirrors at both ends of the light guide rod 3 is related to the shape and size of the crystal display piece, and it is necessary to ensure that the optical flow sensor 5 can capture the correct gesture motion optical flow information.

[0031] The LED fill light assembly 4 is located near the center of the light guide rod 3, and includes a mounting platform 41 and a plurality of LED lamps 42. The mounting platform 41 is in a circular shape as a whole, and the mounting platform 41 has a plurality of mounting grooves 411 for mounting the LED lamps 42 evenly arranged along its circumference. Preferably, a focusing groove 412 is provided at one end of the mounting groove 411 close to the light guide rod 3, and the head of the LED lamp 42 is located in the focusing groove 412, and the wiring terminal of the LED lamp 42 is located outside the mounting platform 41 for easy wiring. The groove wall of the focusing groove 412 is inclined outward, so that the light emitted by the LED lamp 42 can be irradiated on the light guide rod 3 as much as possible. In this embodiment, eight LED lamps 42 and mounting grooves 411 are provided, and the LED lamp 42 can adopt three-color (red, green, blue) LED lamp 42 beads, and the number of LED lamps 42 of each color can be adjusted as needed, and the luminous intensity of each LED lamp 42 can be adjusted as needed.

[0032] The implementation principle of the gesture recognition device based on the crystal display piece in the first embodiment of the present application is as follows: the structural stability and material selection of the display table 1 ensure the firmness and light transmittance of the entire device; the design of the slot 21 and the through hole ensures a stable matching relationship between the light guide rod 3 and the crystal display piece 2; the LED fill light assembly 4 uses a plurality of LED fill lights 42 evenly distributed along the circumference of the light guide rod 3 to ensure the uniform distribution and sufficient intensity of the light source; the optical flow sensor 5 uses a high-precision sensor, which can capture gesture changes in real time and improve recognition accuracy. These designs together ensure the overall stability of the device and the accuracy of gesture recognition.

[0033] Embodiment 2: Embodiment 2 of the present application discloses a gesture recognition method based on a crystal display piece.

[0034] refer to Figure 3 and Figure 4 A gesture recognition method based on a crystal display is based on the above-mentioned gesture recognition device, including an LED driving module, an RGB signal grayscale processing module, a dynamic grayscale signal intersection module, an optical flow signal processing module, a signal processing module and an actuator. The control output terminal of the LED driving module is connected to the control terminal of the LED fill light assembly, and the signal output terminal of the LED driving module is connected to the first signal output terminal of the dynamic grayscale signal intersection module through the RGB signal grayscale processing module. The signal output terminal of the optical flow sensor is connected to the second signal output terminal of the dynamic grayscale signal intersection module through the optical flow signal processing module, and the signal output terminal of the dynamic grayscale signal intersection module is transmitted to the actuator through the signal processing module.

[0035] The following steps are involved: S1: Control the LED fill light assembly to emit light. The control output end of the LED driver module is used to output an RGB drive signal to the control end of the LED fill light assembly. By controlling the RGB drive signal output by the LED module, the amount of light emitted and the intensity of light emitted by the LED fill light can be controlled. Specifically, the LED driver module is composed of a microprocessor and a drive circuit. The microprocessor can implement complex control logic, and the drive circuit is responsible for converting the control signal generated by the microprocessor into the drive current required by the LED fill light assembly. In addition, the LED driver module also includes a filter circuit, which can improve the stability of the LED fill light emission and improve the accuracy of subsequent gesture recognition.

[0036] Preferably, a light sensor is also provided on the display stand, and the output of the light sensor is connected to the LED driver module signal. The light sensor is used to detect the external light intensity. When the external light intensity is detected to be high, the LED driver module increases the luminous intensity of the LED fill light to reduce the influence of the external strong light on the detection; when the external light intensity is detected to be low, the LED driver module reduces the luminous intensity of the LED fill light, thereby achieving the effect of saving energy.

[0037] S2: Grayscale processing is performed on the light emitted by the LED fill light assembly. The LED driver module can also generate corresponding LED fill light control instructions according to the RGB drive signal, and input the LED fill light control instructions into the RGB signal grayscale processing module. The RGB grayscale processing module generates corresponding RGB signal grayscale data according to the received LED fill light control instructions, and inputs the generated RGB signal grayscale data into the dynamic grayscale signal intersection module. Specifically, this module can choose to use an ARM Cortex-A9 processor for signal processing. The processor first converts the RGB drive signal into grayscale data, calculates the average grayscale value of each pixel, and generates the grayscale distribution of each pixel, and finally generates the RGB signal grayscale data. By adjusting the luminous intensity and color of each LED fill light, different light environments can be provided for gesture recognition, reducing the impact of external light on recognition accuracy.

[0038] S3: When the user's hand slides over the crystal display piece, the light signal emitted by the LED light assembly can be reflected by the hand and received by the optical flow sensor. After receiving the light signal, the optical flow sensor can output the optical flow signal to the optical flow signal processing module at the subsequent stage.

[0039] S4: grayscale processing is performed on the information received by the optical flow sensor. After receiving the optical flow signal, the optical flow signal grayscale processing module processes it and generates the optical flow signal grayscale data, and inputs the generated optical flow signal grayscale data into the dynamic grayscale signal intersection module. Specifically, the optical flow signal processing module can be composed of a DSP chip and a peripheral circuit. The DSP chip has multi-core processing capabilities and high-speed floating-point computing capabilities. The peripheral circuit is responsible for signal input / output and power management.

[0040] Preferably, by setting human proximity sensors around the display stand, when the user detects that a human body is approaching, the information received by the optical flow sensor is gray-processed, so as to ensure to the greatest extent that only the user's gesture is recognized, and to eliminate the interference caused by other foreign objects passing over the display stand as much as possible. S5: Identify user gestures. The dynamic grayscale signal intersection module receives the RGB signal grayscale data and combines it with the optical flow signal grayscale data to generate synthetic dynamic grayscale data, wherein the synthetic dynamic grayscale data is equal to the optical flow signal grayscale data minus the RGB signal grayscale data. In this way, the gesture details can be retained while eliminating the interference of external light below, thereby improving the recognition accuracy.

[0041] Specifically, non-gesture signals (such as reflection signals from static objects such as desktops and backgrounds) can also be filtered. For example, by setting a specific grayscale threshold, light changes that are not related to gestures can be excluded, thereby further improving the accuracy of gesture recognition. In addition, fixed thresholds or adaptive threshold technologies can be used to distinguish gestures from non-gesture signals, ensuring that the system can still accurately identify subtle movements of the human hand even under interference from multiple light sources.

[0042] The synthesized dynamic grayscale data generated by the dynamic grayscale signal intersection module is input to the signal processing module, and the signal processing module is used to process the synthesized dynamic grayscale data to generate corresponding finger instructions and output them to the actuator.

[0043] S6: Execute action. The actuator can execute the corresponding action according to the received gesture command.

[0044] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.

Claims

1. A gesture recognition device based on a crystal display, characterized in that: The invention comprises a display stand (1), wherein a crystal display piece (2) is arranged above the display stand (1), a through hole is arranged on the display stand (1) corresponding to the slot (21), a light guide rod (3) is arranged in the through hole, one end of the light guide rod (3) is located below the display stand (1), and the other end of the light guide rod (3) passes through the through hole and is located inside the crystal display piece (2); an LED fill light assembly (4) is arranged at the center of the light guide rod (3), and an optical flow sensor (5) is arranged at the end of the light guide rod (3) away from the crystal display stand (1).

2. A gesture recognition device based on a crystal display according to claim 1, characterized in that: A slot (21) is provided on a side of the crystal display piece (2) close to the display stand (1), and an end of the light guide rod (3) away from the optical flow sensor (5) is plugged into and fitted with the slot (21).

3. The gesture recognition device based on a crystal display according to claim 1, characterized in that: The LED fill light assembly (4) comprises a mounting platform (41) and a plurality of LED lamps (42); the mounting platform (41) is mounted on the light guide rod (3), and the mounting platform (41) is provided with a plurality of mounting grooves (411) along its circumference; the LED lamps (42) are correspondingly mounted in the mounting grooves (411), and the heads of the LED lamps (42) face the light guide rod (3).

4. A gesture recognition device based on a crystal display according to claim 3, characterized in that: A light focusing groove (412) is provided at one end of the installation groove (411) close to the light guide rod (3); the groove wall of the light focusing groove (412) is inclined outwards, and the head of the LED lamp (42) is located in the light focusing groove (412).

5. The gesture recognition device based on a crystal display according to claim 1, characterized in that: The axis of the light guide rod (3) coincides with the axis of the crystal display piece (2), and the sensing end of the optical flow sensor (5) is located on the axis of the light guide rod (3).

6. A gesture recognition method based on a crystal display, based on the gesture recognition device according to any one of claims 1 to 5, characterized in that: It includes an LED driving module, an RGB signal grayscale processing module, an optical flow signal processing module, a dynamic grayscale signal intersection module, an information processing module and an actuator; and also includes the following steps: Controlling the LED fill light assembly to emit light, the LED driving module outputs an RGB driving signal to the control end of the LED fill light assembly; Grayscale processing is performed on the light emitted by the LED fill light assembly. The LED driving module can also generate a corresponding LED fill light control instruction according to the RGB driving signal, and input the LED fill light control instruction to the RGB signal grayscale processing module. The RGB grayscale processing module generates corresponding RGB signal grayscale data according to the received LED fill light control instruction, and inputs the generated RGB signal grayscale data to the dynamic grayscale signal intersection module; When the user's hand slides over the crystal display piece, the light signal emitted by the LED light assembly can be reflected by the hand and received by the optical flow sensor, and the optical flow sensor outputs the optical flow signal to the optical flow signal processing module; Performing grayscale processing on the information received by the optical flow sensor, the optical flow signal grayscale processing module is used to receive the optical flow signal and generate optical flow signal grayscale data, and input the generated optical flow signal grayscale data into the dynamic grayscale signal intersection module; Recognize user gestures, the dynamic grayscale signal intersection module receives the RGB signal grayscale data and combines it with the optical flow signal grayscale data to generate synthetic dynamic grayscale data; the signal processing module is used to process the synthetic dynamic grayscale data to generate corresponding finger instructions and output them to the actuator.

7. A method for hand gesture recognition based on a crystal display according to claim 6, characterized in that: The synthesized dynamic grayscale data is equal to the optical flow signal grayscale data minus the RGB signal grayscale data.

8. The method for hand gesture recognition based on a crystal display according to claim 6, characterized in that: The LED driving module is composed of a microprocessor and a driving circuit. A light sensor is also arranged on the display stand, and the output end of the light sensor is connected to the LED driving module signal.

9. The method for hand gesture recognition based on a crystal display according to claim 6, characterized in that: The LED driving signal can control the light quantity and light intensity of the LED fill light.

Images