Electronic device, operation gesture recognition method, and storage medium

Abstract

The present disclosure relates to an electronic device, an operation gesture recognition method and a storage medium. The electronic device comprises a first reflective optical module configured to emit a first emission light and receive a first reflection light returned based on the first emission light; and a processing module connected with the reflective optical module, configured to detect the first reflection light received within a preset time window; count a number of times that the first reflection light is detected to be received within the preset time window; and recognize an operation gesture according to the number of times that the first reflection light is detected to be received within the preset time window. Thus, the device for recognizing the operation gesture is low, the recognition algorithm is simple and feasible, the device is highly universal, and can be widely applied to various application scenarios.

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic devices, and in particular to an electronic device, an operation gesture recognition method, and a storage medium. Background Art

[0002] In related technologies, gesture recognition primarily relies on wearable devices specifically designed for gesture recognition, such as smart gloves, or uses touch technology to identify touch coordinates. Alternatively, gesture recognition is achieved through the use of computer vision devices combined with image processing and machine learning algorithms. This requires high hardware costs and developers to collect a large number of samples and incorporate complex gesture recognition algorithms. Consequently, existing gesture recognition methods face challenges such as high hardware costs and difficulty in implementation. Summary of the Invention

[0003] The present disclosure provides an electronic device, an operation gesture recognition method, and a storage medium. The technical solutions are as follows:

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0005] A first reflective optical module, configured to emit a first emitted light and receive a first reflected light returned based on the first emitted light;

[0006] A processing module is connected to the reflective optical module, and is used to detect the first reflected light received within a preset time window; count the number of times the first reflected light is detected and received within the preset time window; and recognize the operation gesture based on the number of times the first reflected light is detected and received within the preset time window.

[0007] Optionally, one of the preset time windows includes: a plurality of time intervals;

[0008] The processing module is further used for:

[0009] Counting the number of times the first reflected light is detected and received in different time intervals respectively, to obtain a number set consisting of the number of times the first reflected light is detected and received corresponding to each time interval;

[0010] The operation gesture is identified according to the number set.

[0011] Optionally, the duration interval includes: at least one detection cycle;

[0012] The processing module is further used for:

[0013] determining whether the first reflected light is detected and received in the current detection cycle;

[0014] If the current detection period does not detect the reception of the first reflected light, the end time of the current detection period is used as the end time of the time interval corresponding to the current detection period, and the end time of the current detection period is used as the start time of the adjacent time interval of the time interval corresponding to the current detection period.

[0015] Optionally, the processing module is further configured to:

[0016] Determine the number of detection cycles of the current detection cycle in the preset time window;

[0017] The number of detection cycles of the current detection cycle in the preset time window is used as the number of times the first reflected light is detected and received within the time interval corresponding to the current detection cycle.

[0018] Optionally, the device further includes:

[0019] The counting module is connected to the processing module and is configured to add one to the number of times the first reflected light is detected and received within a time interval corresponding to the current detection cycle if the first reflected light is detected and received in the current detection cycle.

[0020] Optionally, the processing module is further configured to:

[0021] Normalizing the frequency set to obtain a single eigenvalue;

[0022] The operation gesture corresponding to the feature value is determined according to the feature value.

[0023] Optionally, the device further includes:

[0024] a second reflective optical module connected to the processing module, configured to emit a second emitted light and receive a second reflected light returned based on the second emitted light;

[0025] The processing module is further configured to detect whether the second reflected light returned by the second emitted light is received; if it is detected that the second reflected light is received, the processing module controls the first reflective optical module to emit the first emitted light.

[0026] Optionally, the processing module is further configured to:

[0027] If it is detected that the second reflected light is not received, the electronic device is controlled to be turned off or enter a lock screen state.

[0028] According to a second aspect of an embodiment of the present disclosure, there is provided a method for identifying an operation gesture, which is applied to an electronic device. The method includes:

[0029] Utilizing a first reflective optical module in the electronic device to emit a first emitted light and receive a first reflected light returned based on the first emitted light;

[0030] detecting the first reflected light received within a preset time window;

[0031] Counting the number of times the first reflected light is detected and received within a preset time window;

[0032] The operation gesture is recognized according to the number of times the first reflected light is received detected in the preset time window.

[0033] Optionally, one of the preset time windows includes: a plurality of time intervals;

[0034] The counting of the number of times the first reflected light is detected and received within the preset time window includes:

[0035] Counting the number of times the first reflected light is detected and received in different time intervals respectively, to obtain a number set consisting of the number of times the first reflected light is detected and received corresponding to each time interval;

[0036] The operation gesture is identified according to the number set.

[0037] Optionally, the duration interval includes: at least one detection cycle;

[0038] The method further comprises:

[0039] determining whether the first reflected light is detected and received in the current detection cycle;

[0040] If the current detection period does not detect the reception of the first reflected light, the end time of the current period is used as the end time of the time interval corresponding to the current detection period, and the end time of the current period is used as the start time of the adjacent time interval of the time interval corresponding to the current detection period.

[0041] Optionally, counting the number of times the first reflected light is detected and received within a time interval corresponding to the current detection cycle includes:

[0042] Determine the number of detection cycles of the current detection cycle in the preset time window;

[0043] The number of detection cycles of the current detection cycle in the preset time window is used as the number of times the first reflected light is detected and received within the time interval corresponding to the current detection cycle.

[0044] Optionally, determining the number of detection cycles of the current detection cycle in the preset time window includes:

[0045] If the first reflected light is detected to be received in the current detection cycle, the number of times the first reflected light is detected to be received, which has been counted within the time interval corresponding to the current detection cycle, is increased by one.

[0046] Optionally, identifying the operation gesture according to the number set includes:

[0047] Normalizing the frequency set to obtain a single eigenvalue;

[0048] The operation gesture corresponding to the feature value is determined according to the feature value.

[0049] Optionally, the method further includes:

[0050] emitting a second emitted light and receiving a second reflected light based on the second emitted light by using a second reflective optical module of the electronic device;

[0051] detecting whether the second reflected light returned by the second emitted light is received;

[0052] If it is detected that the second emitted light is received, the first reflective optical module is controlled to emit the first emitted light.

[0053] Optionally, the method further includes:

[0054] If it is detected that the second reflected light is not received, the electronic device is controlled to be turned off or enter a lock screen state.

[0055] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, comprising:

[0056] processor;

[0057] a memory for storing processor-executable instructions;

[0058] Wherein, the processor is configured to: perform any of the above-mentioned operation gesture recognition methods when running executable instructions.

[0059] According to a fourth aspect of an embodiment of the present disclosure, a non-transitory computer-readable storage medium is provided, on which a computer program is stored, and the program is used by a processor to execute the steps of any of the above-mentioned operation gesture recognition methods.

[0060] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:

[0061] The present disclosure discloses an electronic device, comprising: a first reflective optical module for emitting a first emitted light and receiving a first reflected light returned based on the first emitted light; a processing module connected to the reflective optical module and configured to detect the first reflected light received within a preset time window; count the number of times the first reflected light is detected and received within the preset time window; and identify an operation gesture based on the number of times the first reflected light is detected and received within the preset time window. Thus, the present disclosure can identify an operation gesture by detecting the number of times the first reflective optical module emits and receives reflected light returned based on the emitted light. This means that the present disclosure only requires one reflective optical module capable of emitting light and receiving light reflected from the emitted light to achieve operation gesture recognition. Compared to related art methods that require dedicated wearable devices for operation gesture recognition, or computer vision devices such as cameras, combined with image processing and machine learning algorithms, the present disclosure only requires one reflective optical module for operation gesture recognition, and can identify different operation gestures by simply counting the number of times the first reflected light is detected and received. Therefore, the operation gesture recognition device is low-cost and the recognition algorithm is simple and feasible. And because it only involves a reflective optical module, it is simple to manufacture for the electronic device that serves as the identification device itself, and it is simple to modify the existing electronic device, making the electronic device highly versatile and applicable to various electronic devices. Therefore, the recognition of operation gestures using the electronic device of the above embodiment can adapt to more application scenarios, thereby increasing the application scope of the electronic device.

[0062] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0064] Figure 1 is a schematic diagram of an electronic device according to an exemplary embodiment;

[0065] Figure 2 is a schematic diagram showing a scenario of operation gesture recognition according to an exemplary embodiment;

[0066] Figure 3 is another schematic diagram of a scenario of operation gesture recognition according to an exemplary embodiment;

[0067] Figure 4 is another schematic diagram of an electronic device according to an exemplary embodiment;

[0068] Figure 5 is a schematic diagram of an electronic device according to an exemplary embodiment;

[0069] Figure 6 is a flowchart illustrating a method for identifying an operation gesture according to an exemplary embodiment;

[0070] Figure 7 is another flowchart of a method for identifying an operation gesture according to an exemplary embodiment;

[0071] Figure 8 is a block diagram of an operation gesture recognition device according to an exemplary embodiment;

[0072] Figure 9 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0073] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. In the following description, when referring to the drawings, like numbers in different figures represent like or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present invention, as detailed in the appended claims.

[0074] Figure 1 is a schematic diagram of an electronic device according to an exemplary embodiment. Figure 1 As shown, the electronic device 1 includes:

[0075] A first reflective optical module 11 is configured to emit a first emitted light and receive a first reflected light returned based on the first emitted light;

[0076] The processing module 12 is connected to the reflective optical module and is used to detect the first reflected light received within a preset time window; count the number of times the first reflected light is detected and received within the preset time window; and recognize the operation gesture based on the number of times the first reflected light is detected and received within the preset time window.

[0077] Here, the electronic device 1 can be a fixed terminal, such as a desktop computer, an all-in-one computer, or a smart TV; the electronic device 1 can also be a mobile terminal, such as a mobile phone, a tablet computer, or a laptop computer. The electronic device 1 can also be a terminal accessory, such as a mouse or a keyboard. In short, the electronic device can serve as an interface for human-computer interaction, and can be used to recognize operation gestures near the electronic device and control the electronic device itself or other electronic devices connected to the electronic device to perform the operation corresponding to the operation gesture.

[0078] Here, the first reflective optical module 11 may include: a reflective sensor.

[0079] Specifically, the first reflective optical module 11 may include an infrared reflective sensor.

[0080] It should be noted that the infrared reflection sensor uses the principle of infrared reflection to determine the presence of obstacles ahead based on the intensity of the reflection. The measurement accuracy is very high when the distance is moderate, and because it uses infrared rays, it has strong anti-interference ability, which can ensure the stability of operation gesture recognition.

[0081] Of course, in other embodiments, the first reflective optical module 11 may also use a sensor that emits other types of light, such as a laser.

[0082] It should be understood that after the first reflective optical module emits the first emitted light, if there is an obstacle in front of it, such as a finger blocking it, it will return the first reflected light; if there is no obstacle in front of it, such as no finger blocking it, it will not return the first reflected light.

[0083] Specifically, the first reflective optical module can be used to emit a first emitted light to an execution subject of the operation gesture and receive a first reflected light returned by the execution subject based on the first emitted light.

[0084] It can be understood that the first emission light emitted by the first reflective optical module is directed toward the subject that performs the operation gesture, so that the electronic device can accurately detect the operation gesture.

[0085] In actual applications, for different application scenarios, the location where the first reflective optical module is installed in the electronic device may also be different.

[0086] For example, in office meeting places, or training places, narrators are often required to stand in front of a computer to narrate media content. At this time, the first reflective optical module can be installed above the shell of the conference room computer or the classroom computer, so that the first emission light emitted by the first reflective optical module can be irradiated above the conference room computer or the classroom computer, so that the narrator can make operating gestures above the conference room computer or the classroom computer to control the computer.

[0087] For another example, in smart home environments, for example, in the scenario of controlling a room air conditioner, the first reflective optical module can be installed below the air conditioner casing, or on the side below, so that the first emitted light emitted by the first reflective optical module can illuminate the bottom or lower side of the air conditioner, so that the user can make operating gestures below or lower side of the air conditioner to control the air conditioner.

[0088] In summary, the installation position of the first reflective optical module can be determined based on the placement position of the electronic device and the direction of the execution entity to be detected. As long as the first emitted light of the first reflective optical module can illuminate the execution entity of the operation gesture, there is no limitation on the position of the first reflective optical module.

[0089] Here, the processing module 12 generally controls the overall operation of the electronic device 1, such as operations related to display, phone calls, data communications, camera operation, and recording. The processing module 12 may include one or more processors to execute instructions to complete the corresponding operations. Here, the processing module 12 detects the number of times the first reflected light is received within a preset time window, and can at least determine the number of times the front is blocked by the finger, thereby determining different gestures based on different times.

[0090] Here, the processing module 12 may be a central processing unit or a main control board, for example, an STC12C5A60S2 single chip microcomputer.

[0091] It can be understood that when the processing module 12 detects the state of the first reflective optical module, the first reflective optical module has only two states: high level and low level. The high level indicates that the first reflective optical module receives the first reflected light, while the low level indicates that the first reflective optical module does not receive the first reflected light.

[0092] See also Figure 2 ,like Figure 2As shown, the first reflective optical module 11 emits a first emitted light to the first execution subject 20 of the operation gesture. Due to an obstacle in front, for example, a finger is extended, it should be noted that the extended finger can completely cover the first emitted light emitted by the first reflective optical module. Therefore, if the first first reflected light 1102 based on the first first emitted light 1101 is detected within the preset time window, if the first execution subject maintains the operation gesture within the preset time window, that is, does not change the finger, or does not move in or out, then the first reflected light can be detected every time within the preset time window. If the execution subject changes the finger or moves in or out within the preset time window, there will be no obstacle in front, that is, no execution subject, resulting in the detection of no first reflected light in the gap between finger changes. Therefore, under the same preset time window, the number of times the first reflected light is detected will be less than the number of times the first reflected light is detected, that is, a finger maintains the corresponding operation gesture without changing. Therefore, different gestures can be distinguished by the different number of times the first reflected light is detected. Obviously, the number of times the finger covers the first emission light without moving is different from the number of times the finger moves relative to the first emission light.

[0093] Please refer to Figure 3 ,like Figure 3 As shown, the first reflective optical module 11 emits the first emission light to the second execution body 30 of the operation gesture. Since there are two fingers as the obstacle in front and there is a gap between the two fingers, it can be detected in one scan that the second first reflected light 1112 is returned based on the second first emission light 1111 within the preset time window, that is, the second first reflected light 1112 reflected at the index finger; in another scan, the third first emission light 1121 cannot be detected and the first reflected light cannot be returned, that is, the first reflected light returned by the third first emission light 1121 cannot be detected at the gap; and in another scan, the third first reflected light 1132 is detected based on the third first emission light 1131 within the preset time window, that is, the third first reflected light 1132 reflected by the middle finger. The reflected light can also be reflected at two more fingers. Therefore, the processing module can detect that the first reflected light is received more times than before. Figure 2 If a gesture completely covers the first emitted light and remains unchanged, the number of corresponding gestures is less.

[0094] Therefore, this embodiment uses the difference in the number of times the first reflected light is detected to distinguish different operation gestures, thereby providing a theoretical basis for using a reflective optical module to recognize operation gestures.

[0095] Here, the preset time window refers to the average duration of the operation gesture calculated by big data statistics.

[0096] In some embodiments, the preset time window can also be dynamically configured, for example, it can be dynamically configured according to the user type of the currently detected user. The user type may include: a type divided according to characteristics such as the user's age, occupation or gender. It is understandable that the time required for different types of users to perform the same operation gesture is also different. For example, for the elderly, since most elderly people react slowly, when it is detected that the current user is an elderly user type, the preset time window can be set to be greater than the preset time. Here, the preset time can be the average time required for the operation gesture calculated by big data, or it can be the average time required for the operation gesture among family members calculated. In this way, in this embodiment, the preset time window suitable for the user type can be dynamically configured according to the different user types currently in use, so that the operation gesture can be detected more accurately, reducing the misjudgment phenomenon caused by an extra gesture or a missing gesture within the preset time window.

[0097] In other embodiments, the preset time window can be set according to the usage habits of the user of the electronic device. It is understandable that different users may need different amounts of time to perform the same operation gesture. For example, if Zhang San's average speed of operating an electronic device is slower than Li Si's average speed of operating an electronic device, then the preset time window set for Zhang San's electronic device may be longer than the preset time window set for Li Si's electronic device. In this way, in this embodiment, since it can be configured more accurately according to the usage habits of the user of the electronic device, the operation gestures of the user of the electronic device can be detected more accurately, reducing the occurrence of misjudgment phenomena.

[0098] In the above embodiment, by introducing the detection of the second reflected light received by the first reflective optical module, the operation gesture is identified based on the number of times the first reflected light is detected within a preset time window, and the number of times the first reflected light is detected according to the preset time window. This eliminates the need to introduce complex analysis algorithms such as graphic imaging to detect the operation gesture, nor does it require the introduction of complex wearable devices or computer vision devices specifically for identifying operation gestures. This reduces the cost of the electronic device and makes the recognition algorithm simple and feasible. Furthermore, because only one reflective optical module is required, the electronic device itself, which serves as the recognition device, is simple to manufacture and can be easily modified for existing electronic devices, thereby increasing the versatility of the electronic device. Therefore, the electronic device can be applied to more application scenarios, such as smart TVs, air conditioners, etc., and can also be applied to scenarios such as office computers, thereby increasing the application range of the electronic device.

[0099] In some embodiments, when identifying an operation gesture based on the number of times the first reflected light is received within a preset time window, the number of times corresponds to the operation gesture. That is, different numbers of times correspond to different operation gestures.

[0100] In practical applications, please refer to Figure 2 and Figure 3 ,In fact, with the same number of times, the user can make two different ,operation gestures, e.g. Figure 2 In the example, the user slides the finger covering the first emitted light in and out twice, and the number of times the first reflected light is received is detected. Figure 3 In the gesture made by the user with two separated fingers, the number of times the first reflected light is detected can be the same. Based on the one-to-one correspondence between the number and the operation gesture, then Figure 2 In the gesture of sliding the finger that covers the first light twice, the gesture is the same as Figure 3 The gestures made by the user with two fingers separated can be regarded as the same operation gesture.

[0101] In the above embodiments, different times correspond to different operation gestures. However, in actual applications, a single number of times cannot well distinguish different gestures. In order to make gesture recognition more accurate, in other embodiments, a preset time window includes: multiple time intervals;

[0102] The processing module is further used for:

[0103] Counting the number of times the first reflected light is detected and received in different time intervals respectively, to obtain a number set consisting of the number of times the first reflected light is detected and received corresponding to each time interval;

[0104] The operation gesture is identified according to the number set.

[0105] Here, the preset time window may be divided into a plurality of time intervals, and within each time interval, a corresponding number of times of receiving the reflected light may be obtained to form a number set.

[0106] In some embodiments, the preset time window can be evenly divided into multiple time intervals, that is, the duration of each time zone is the same. Figure 2 and Figure 3 , assuming that the preset time window is divided into three time intervals evenly, Figure 2In the example, a gesture that completely covers the first emitted light is slid in and out twice. If the duration required for the slid in and out is less than the duration corresponding to the second duration interval, then the number of times the first reflected light can be detected within the second duration interval is less than the number of times corresponding to the first and third duration intervals. Let x represent the number of times corresponding to the first and third duration intervals, and y represent the number of times corresponding to the second duration interval. The resulting number set is (x, y, x). Figure 3 In the case where the two separated fingers remain motionless, the number of times detected in the three average time intervals can all be z times, so the number set obtained is (z, z, z). In this way, by dividing the preset time window into multiple time regions, the total number of times detected in the preset time window is divided into the number of times detected in different time intervals, which can better distinguish different operation gestures, thereby achieving the purpose of accurately identifying operation gestures. Furthermore, by dividing the preset time window into multiple time intervals, the number of times the first reflected light is received detected in multiple time intervals is obtained, and the number set obtained can enrich the operation gesture library.

[0107] Of course, if the preset time window is evenly divided into time intervals, if the division is not appropriate, it may happen that one operation gesture can correspond to multiple different sets of times. For example, as mentioned above, please refer to Figure 2 , Figure 2 When the middle finger slides twice in succession, the number of times y corresponding to the second duration area will get different values ​​due to the different durations of the duration area, resulting in the same operation gesture corresponding to multiple different number sets. Therefore, in order to more accurately obtain the correspondence between the number set and the operation gesture, in other embodiments, in order to dynamically divide the duration interval, the duration interval includes: at least one detection cycle;

[0108] The processing module is further used for:

[0109] determining whether the first reflected light is detected and received in the current detection cycle;

[0110] If the current detection period does not detect the reception of the first reflected light, the end time of the current detection period is used as the end time of the time interval corresponding to the current detection period, and the end time of the current detection period is used as the start time of the adjacent time interval of the time interval corresponding to the current detection period.

[0111] In this embodiment, by introducing a detection cycle, the end moment of the detection cycle corresponding to the failure to detect the reception of the first reflected light is used as the critical moment between two adjacent time intervals, thereby achieving dynamic division of the time intervals. Here, the detection cycle can be the period during which the first reflective optical module emits the first emitted light, and the detection cycle is synchronized with the period during which the first reflective optical module emits the first emitted light. Of course, the duration of the detection cycle can also be greater than the duration of the period of the first reflected light. By dynamically dividing the time intervals, the number of times the first reflected light is detected within the dynamic time interval is obtained. This dynamically divided time interval can accurately reflect the duration of time that the finger blocks the first emitted light, thereby reducing the situation where the same operation gesture can obtain multiple sets of times due to phenomena such as the absence of a finger or movement in and out of the time interval. Therefore, in this embodiment, by introducing a detection cycle and using the end moment of the detection cycle corresponding to the failure to detect the reception of the first reflected light as the critical point for dividing two adjacent time intervals, this method of dynamically dividing the time intervals can increase the accuracy of operation gesture recognition.

[0112] It should be noted that in the above embodiment, since the time point at which the first reflected light is not detected is used as the critical point between the duration interval and the duration interval, it can be understood that the length of each duration interval actually corresponds to the length of time that the finger remains on or covers the first reflected light. That is, the longer the finger remains on each time, the longer the corresponding duration interval is, and therefore the more corresponding detection cycles and the more corresponding times. Therefore, the number of detection cycles can be used to correspond to the number of times the first reflected light is received within the duration interval.

[0113] In some embodiments, in order to better record the number of times the first reflected light is received within the time interval, the processing module is further configured to:

[0114] Determine the number of detection cycles of the current detection cycle in the preset time window;

[0115] The number of detection cycles of the current detection cycle in the preset time window is used as the number of times the first reflected light is detected and received within the time interval corresponding to the current detection cycle.

[0116] For example, the detection cycle is 2ms, and the processing module obtains data every 2ms on whether the reflective optical module receives the first reflected light. If the first reflected light is received, the count is increased by one. If the first reflected light is not received, the count stops and the current count value is used as the number of times corresponding to the first time interval, that is, as the first value of the number set; continue to detect, if there is no first reflected light in the remaining preset time window, it can be considered as a finger swipe operation. If there is, continue to parse the subsequent data, if there is, continue to count until the next detection that no first reflected light is received, and use this value as the number of times corresponding to the second time interval, that is, as the second value of the number set, and so on. Therefore, please refer to Figure 2 , Figure 2 The number of times the middle finger slides once may be (x, 0), and the number of times the finger slides twice may be (x, 2*x).

[0117] In this way, in this embodiment, the number of times the first reflected light is received can be corresponded by determining the number of detection cycles, and the reflective optical module itself does not need to record the number of times the first reflected light is received, which means that the reflective optical module does not need a register, thereby further reducing hardware costs and reducing the system's processing of data in the register, thereby reducing system overhead.

[0118] In some other embodiments, the device further comprises:

[0119] The counting module is connected to the processing module and is used to add one to the number of times the first reflected light is detected and received within the time interval corresponding to the current detection cycle if the first reflected light is detected and received in the current detection cycle.

[0120] In this embodiment, by introducing a counting module, it is convenient to count and record the number of detection cycles within a preset time, which is simple and convenient.

[0121] Furthermore, in some other embodiments, the processing module is further configured to:

[0122] Normalizing the frequency set to obtain a single eigenvalue;

[0123] The operation gesture corresponding to the feature value is determined according to the feature value.

[0124] Here, normalizing the number set includes:

[0125] Perform dimensionality reduction processing on the degree set until the degree set is reduced to one dimension.

[0126] Specifically, performing dimensionality reduction processing on the degree set may include:

[0127] According to the mapping relationship between the number set and the single feature value, the feature value corresponding to the number set is determined.

[0128] Here, only the corresponding relationship between the single feature value and the operation gesture needs to be stored in the memory of the electronic device, and the corresponding relationship between the large number set and the operation gesture does not need to be stored, so in the embodiment, after detecting the operation gesture to obtain the number set, the number set is normalized to obtain the single feature value corresponding to the number set, and the corresponding operation gesture is found through the single feature value to recognize the operation gesture, so that the memory required by the operation gesture library of the electronic device can be reduced.

[0129] Please refer to Figure 4 As Figure 4 shown, in some other embodiments, the device further comprises:

[0130] The second reflective optical module 13 is connected with the processing module 12, and is used for emitting second emission light and receiving second reflection light returned based on the second emission light;

[0131] The processing module 12 is further used for detecting whether the second reflection light returned by the second reflection light is received; if it is detected that the second reflection light is received, the first reflective optical module 11 is controlled to emit the first emission light.

[0132] It can be understood that the second emission light emitted by the second reflective optical module 13 is towards the target object related to the execution subject of the operation finger. Here, the target object can be a person. In this way, by detecting whether the second reflection light returned by the second reflection light is received, it can be judged whether there is a person near the electronic device.

[0133] In actual application, for different application scenarios, the position of the second reflective optical module 13 installed on the electronic device is also different.

[0134] For example, for an office, the second reflective optical module 13 can be installed on the side of the computer shell, so that the second reflection light emitted by the second reflective optical module 13 can irradiate the front of the computer, so that it can be judged whether there is a person in front of the computer.

[0135] For example, for the scene of smart home, for example, in the control scene of the room air conditioner, the second reflective optical module 13 can be installed below the electronic device or the side below, so that the second emission light emitted by the second reflective optical module 13 can irradiate the position below or below the side of the air conditioner, so as to identify whether there is a person below or below the side of the air conditioner.

[0136] In this embodiment, by introducing a second reflective optical module to first detect the presence of a person, and only then enabling gesture recognition by the first reflective optical module when a person is present, this can reduce the false recognition rate of gestures and save energy for the electronic device. In fact, combined with the second reflective optical module's ability to detect the presence of a target object, the electronic device's location can be better determined, enabling even more accurate gesture recognition.

[0137] In some other embodiments, the processing module is further used to:

[0138] If it is detected that the second reflected light is not received, the electronic device is controlled to be turned off or enter a lock screen state.

[0139] Here, if the second reflected light is not received, it indicates that no one is present at the electronic device, or that the person has left. Therefore, this embodiment saves power for the electronic device by controlling the electronic device to shut down when the second reflected light is not received. For example, a smart TV or air conditioner that is currently turned on in a home environment can be turned off. Alternatively, when the second reflected light is not received, the electronic device can be controlled to enter a lock screen state to improve the confidentiality of the electronic device. For example, in an office environment, when a person leaves the computer, the computer can be automatically controlled to enter a lock screen state, thereby protecting the computer content from being viewed by others and improving privacy and confidentiality.

[0140] Furthermore, it should be added that the first reflective optical module and the processing module may be connected by a DuPont wire; and / or the second reflective optical module and the processing module may also be connected by a DuPont wire.

[0141] In addition, it should be added that the operation gesture can be used to control the electronic device to perform a corresponding operation, for example, to control the electronic device to turn on, or to control the electronic device to open or close a preset application.

[0142] Furthermore, the electronic device further includes a Bluetooth module for connecting to other electronic devices so as to control the other electronic devices to perform corresponding operations using the operation gestures.

[0143] Here, the Bluetooth module can be a Bluetooth transparent transmission module or a Bluetooth HID module. For example, a laptop can be connected via the Bluetooth HID module, thereby controlling the laptop to perform corresponding operations based on gestures. For another example, a desktop computer can be connected via the Bluetooth transparent transmission module, thereby controlling the desktop computer to perform corresponding operations based on gestures.

[0144] It should be supplemented that the electronic device may further include: a power supply module connected to the processing module, and configured to provide power to the electronic device.

[0145] The power supply module may further include: a boost module and a battery module; the boost module is used to increase the voltage provided by the battery module.

[0146] Furthermore, the present disclosure also provides a specific embodiment to further understand the terminal provided by the embodiment of the present disclosure.

[0147] This embodiment is applied in an office environment, such as controlling an office computer. The office computer can be a laptop or a desktop computer. Here, the electronic device can be an electronic device independent of the laptop, and the reflective optical module can be an infrared reflective sensor.

[0148] See also Figure 5 , Figure 5 is a schematic diagram of an electronic device according to an exemplary embodiment, such as Figure 5 As shown, the electronic device includes: a first infrared reflection type sensor and a second infrared reflection type sensor;

[0149] The first infrared reflection sensor and the second infrared reflection sensor are respectively connected to the STC125A60S2Z main control board.

[0150] Here, the lithium battery is equivalent to the battery module in the power supply module described in the above embodiment; the DCDC boost module here is equivalent to the boost module described in the above embodiment.

[0151] In addition, here, the Bluetooth module can be a Bluetooth HID module connected to a laptop computer and a Bluetooth transparent transmission module connected to a desktop computer, and the Bluetooth transparent transmission module is connected to the desktop computer via a UART to USB HID module. In addition, in this embodiment, the battery module can also be connected to a charging module for charging the battery module.

[0152] Specifically, a first infrared reflection sensor, placed above the office computer, detects specific gestures and sends corresponding control instructions to the laptop, enabling the office computer to perform the corresponding operation based on the gesture. A second infrared reflection sensor, placed on the front of the office computer, detects the presence of a person nearby. Only when a person is detected does the first infrared reflection sensor activate.

[0153] For example, if your laptop is not muted during a meeting or at a library, you can use a gesture, such as a single swipe, to mute or lower the volume on your laptop. This eliminates the need for the user to find a mute button or use keyboard or mouse movements to lower the volume. This allows users to easily lower the volume during a meeting without disturbing others.

[0154] For example, in some scenarios, unlocking an electronic device is more complicated and requires the user to enter a password, etc. Based on this, in this embodiment, by associating the operation gesture with the unlocking, the electronic device can be quickly unlocked based on the operation gesture, which brings convenience to the user and improves the user experience of the electronic device.

[0155] This embodiment discloses an electronic device capable of recognizing gestures used to control an office computer, allowing the computer to be controlled accordingly. The electronic device can also identify the presence of people near the computer, locking the screen when no one is around to protect privacy and enhance security. This electronic device utilizes only an infrared reflective sensor, resulting in low hardware cost and a simple algorithm for gesture recognition.

[0156] Figure 6 FIG. 1 is a flow chart of a method for identifying an operation gesture according to an exemplary embodiment. Figure 6 As shown, the method is applied to the electronic device described above, including:

[0157] Step 601: emitting a first emitted light and receiving a first reflected light based on the first emitted light by using a first reflective optical module in the electronic device;

[0158] Step 602: Detecting the first reflected light received within a preset time window;

[0159] Step 603: Counting the number of times the first reflected light is detected and received within a preset time window;

[0160] Step 604: Identify an operation gesture based on the number of times the first reflected light is received detected in the preset time window.

[0161] The embodiment of the present disclosure only requires a reflective optical module that can emit light and receive light reflected based on the emitted light to realize the recognition of operation gestures. Compared with the related art, which requires the use of dedicated wearable devices for operation gesture recognition, or the use of computer vision devices, such as cameras, combined with image processing and machine learning algorithms to perform operation gesture recognition, the recognition of operation gestures in the present application only requires a reflective optical module, and different operation gestures can be identified by simply counting the number of times the first reflected light is detected and received. Therefore, the equipment cost of operation gesture recognition is low, and the recognition algorithm is simple and feasible.

[0162] In an optional embodiment, one of the preset time windows includes: a plurality of time intervals;

[0163] The counting of the number of times the first reflected light is detected and received within the preset time window includes:

[0164] Counting the number of times the first reflected light is detected and received in different time intervals respectively, to obtain a number set consisting of the number of times the first reflected light is detected and received corresponding to each time interval;

[0165] The operation gesture is identified according to the number set.

[0166] In the embodiment of the present disclosure, by dividing the preset time window into multiple time intervals, the operation gestures can be expanded, and the recognition of the operation gestures can be made more accurate by counting the number of times.

[0167] In an optional embodiment, the duration interval includes: at least one detection cycle;

[0168] The method further comprises:

[0169] determining whether the first reflected light is detected and received in the current detection cycle;

[0170] If the current detection period does not detect the reception of the first reflected light, the end time of the current period is used as the end time of the time interval corresponding to the current detection period, and the end time of the current period is used as the start time of the adjacent time interval of the time interval corresponding to the current detection period.

[0171] In this embodiment, by introducing a detection cycle and taking the failure of detecting the reception of the first reflected light in the current detection cycle as a basis for division, the time intervals are dynamically divided, so that the recognition of the operation gesture is more accurate.

[0172] In an optional embodiment, counting the number of times the first reflected light is detected and received within a time interval corresponding to the current detection cycle includes:

[0173] Determine the number of detection cycles of the current detection cycle in the preset time window;

[0174] The number of detection cycles of the current detection cycle in the preset time window is used as the number of times the first reflected light is detected and received within the time interval corresponding to the current detection cycle.

[0175] In this embodiment, by counting the number of detection cycles as the number of times corresponding to the time interval, the number of times can be simplified and the processing efficiency can be improved.

[0176] In an optional embodiment, determining the number of detection cycles within the duration interval corresponding to the current detection cycle includes:

[0177] If the first reflected light is detected to be received in the current detection cycle, the number of times the first reflected light is detected to be received, which has been counted within the time interval corresponding to the current detection cycle, is increased by one.

[0178] In an optional embodiment, identifying the operation gesture according to the number set includes:

[0179] Normalizing the frequency set to obtain a single eigenvalue;

[0180] The operation gesture corresponding to the feature value is determined according to the feature value.

[0181] In an alternative embodiment, see Figure 7 ,like Figure 7 As shown, the method further includes:

[0182] Step 701: emitting a second emitted light and receiving a second reflected light based on the second emitted light by using a second reflective optical module of the electronic device;

[0183] Step 702: Detect whether the second reflected light returned by the second emitted light is received;

[0184] Step 703: If it is detected that the second emitted light is received, control the first reflective optical module to emit the first emitted light.

[0185] In this embodiment, by introducing a second reflective optical module to first detect the presence of a person, and only then enabling gesture recognition by the first reflective optical module when a person is present, this can reduce the false recognition rate of gestures and save energy for the electronic device. In fact, combined with the second reflective optical module's ability to detect the presence of a target object, the electronic device's location can be better determined, enabling even more accurate gesture recognition.

[0186] In an optional embodiment, the method further includes:

[0187] If it is detected that the second reflected light is not received, the electronic device is controlled to be turned off or enter a lock screen state.

[0188] In this embodiment, by introducing a second reflective optical module to first detect the presence of a person, and only then enabling gesture recognition by the first reflective optical module when a person is present, this can reduce the false recognition rate of gestures and save energy for the electronic device. In fact, combined with the second reflective optical module's ability to detect the presence of a target object, the electronic device's location can be better determined, enabling even more accurate gesture recognition.

[0189] The specific manner of the method in the above embodiment has been described in detail in the embodiment of the terminal, and will not be elaborated here.

[0190] Figure 8 FIG. 1 is a block diagram of an operation gesture recognition device according to an exemplary embodiment. Figure 8 , the device comprises:

[0191] The first transmitting module 81 is configured to transmit a first transmitted light and receive a first reflected light based on the first transmitted light by using a first reflective optical module in the electronic device;

[0192] A first detection module 82 is configured to detect the first reflected light received within a preset time window;

[0193] A statistics module 83 is configured to count the number of times the first reflected light is detected and received within a preset time window;

[0194] The recognition module 84 is configured to recognize an operation gesture according to the number of times the first reflected light is detected and received in the preset time window.

[0195] In an optional implementation, one of the preset time windows includes: a plurality of time intervals;

[0196] The statistical module 83 is further configured to: count the number of times the first reflected light is detected and received in different time intervals, respectively, to obtain a number set consisting of the number of times the first reflected light is detected and received corresponding to each time interval;

[0197] The recognition module 84 is further configured to: recognize the operation gesture according to the number set.

[0198] In an optional embodiment, the duration interval includes: at least one detection cycle;

[0199] The device further includes:

[0200] The determination module is configured to: determine whether the first reflected light is detected to be received in the current detection cycle; if the first reflected light is not detected to be received in the current detection cycle, then the end time of the current cycle is used as the end time of the time interval corresponding to the current detection cycle, and the end time of the current cycle is used as the start time of the adjacent time interval of the time interval corresponding to the current detection cycle.

[0201] In an optional embodiment, the statistics module 83 is specifically configured to:

[0202] Determine the number of detection cycles of the current detection cycle in the preset time window;

[0203] The number of detection cycles of the current detection cycle in the preset time window is used as the number of times the first reflected light is detected and received within the time interval corresponding to the current detection cycle.

[0204] In an optional embodiment, the statistics module 83 is further specifically configured to:

[0205] If the first reflected light is detected to be received in the current detection cycle, the number of times the first reflected light is detected to be received, which has been counted within the time interval corresponding to the current detection cycle, is increased by one.

[0206] In an optional embodiment, the identification module 84 is further configured to:

[0207] Normalizing the frequency set to obtain a single eigenvalue;

[0208] The operation gesture corresponding to the feature value is determined according to the feature value.

[0209] In an optional embodiment, the device further comprises:

[0210] A second transmitting module is configured to transmit a second transmitted light as a second reflective optical module of the electronic device and receive a second reflected light returned based on the second transmitted light;

[0211] a detection module, configured to detect whether the second reflected light returned by the second emitted light is received;

[0212] The control module is configured to control the first reflective optical module to emit the first emitted light if it is detected that the second emitted light is received.

[0213] In an optional embodiment, the control module is further configured to:

[0214] If it is detected that the second reflected light is not received, the electronic device is controlled to be turned off or enter a lock screen state.

[0215] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the electronic device and will not be elaborated on here.

[0216] Figure 9 1 is a block diagram of an electronic device 900 according to an exemplary embodiment. For example, the electronic device 900 may be a mobile phone, a computer, a digital broadcast electronic device, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0217] Reference Figure 9 , the electronic device 900 may include one or more of the following components: a processing component 902 , a storage component 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .

[0218] The processing component 902 generally controls the overall operation of the electronic device 900, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 902 may include one or more modules to facilitate interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.

[0219] The memory 904 is configured to store various types of data to support operations on the electronic device 900. Examples of such data include instructions for any application or method operating on the electronic device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0220] The power component 906 provides power to the various components of the electronic device 900. The power component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 900.

[0221] The multimedia component 908 includes a screen that provides an output interface between the electronic device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the electronic device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0222] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), and when the electronic device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 904 or transmitted via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.

[0223] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0224] The sensor assembly 914 includes one or more sensors for providing various aspects of status assessment for the electronic device 900. For example, the sensor assembly 914 can detect the open / closed state of the electronic device 900, the relative positioning of components, such as the display and keypad of the electronic device 900. The sensor assembly 914 can also detect changes in the position of the electronic device 900 or a component of the electronic device 900, the presence or absence of user contact with the electronic device 900, the orientation or acceleration / deceleration of the electronic device 900, and temperature changes of the electronic device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0225] The communication component 916 is configured to facilitate wired or wireless communication between the electronic device 900 and other devices. The electronic device 900 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0226] In an exemplary embodiment, the electronic device 900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described methods.

[0227] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions, and the instructions can be executed by the processor 920 of the electronic device 900 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0228] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute the display processing method described in the above embodiments.

[0229] Other embodiments of the present invention will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.

[0230] It should be understood that the present invention is not limited to the exact construction described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. An electronic device, characterized in that: include: A first reflective optical module, configured to emit a first emitted light and receive a first reflected light returned based on the first emitted light; a processing module connected to the reflective optical module, and configured to detect the first reflected light received within a preset time window; One of the preset time windows includes: a plurality of time intervals; the time interval includes: at least one detection cycle; The processing module is further used for: determining whether the first reflected light is detected and received in the current detection cycle; If the first reflected light is not detected in the current detection period, the end time of the current detection period is used as the end time of the duration interval corresponding to the current detection period, and the end time of the current detection period is used as the start time of the duration interval adjacent to the duration interval corresponding to the current detection period; Counting the number of times the first reflected light is detected and received in different time intervals respectively, to obtain a number set consisting of the number of times the first reflected light is detected and received corresponding to each time interval; An operation gesture is recognized according to a change in the number of times in the frequency concentration.

2. The device according to claim 1, characterized in that The processing module is further used for: Determine the number of detection cycles of the current detection cycle in the preset time window; The number of detection cycles of the current detection cycle in the preset time window is used as the number of times the first reflected light is detected and received within the time interval corresponding to the current detection cycle.

3. The device according to claim 2, characterized in that The device further comprises: The counting module is connected to the processing module and is configured to add one to the number of times the first reflected light is detected and received within a time interval corresponding to the current detection cycle if the first reflected light is detected and received in the current detection cycle.

4. The device according to claim 1, characterized in that The processing module is further used for: Normalizing the frequency set to obtain a single eigenvalue; The operation gesture corresponding to the feature value is determined according to the feature value.

5. The device according to claim 1, characterized in that The device further comprises: a second reflective optical module connected to the processing module, configured to emit a second emitted light and receive a second reflected light returned based on the second emitted light; The processing module is further configured to detect whether the second reflected light returned by the second emitted light is received; if it is detected that the second reflected light is received, the processing module controls the first reflective optical module to emit the first emitted light.

6. The device according to claim 5, characterized in that The processing module is further used for: If it is detected that the second reflected light is not received, the electronic device is controlled to be turned off or enter a lock screen state.

7. A method for identifying an operation gesture, characterized in that: Applied to electronic equipment, the method includes: Utilizing a first reflective optical module in the electronic device to emit a first emitted light and receive a first reflected light returned based on the first emitted light; detecting the first reflected light received within a preset time window; Counting the number of times the first reflected light is detected and received within a preset time window; recognizing an operation gesture according to the number of times the first reflected light is detected and received within the preset time window; Wherein, one of the preset time windows includes: a plurality of time intervals; the time interval includes: at least one detection cycle; determining whether the first reflected light is detected and received in the current detection cycle; If the first reflected light is not detected in the current detection period, the end time of the current detection period is used as the end time of the duration interval corresponding to the current detection period, and the end time of the current detection period is used as the start time of the duration interval adjacent to the duration interval corresponding to the current detection period; The counting of the number of times the first reflected light is detected and received within the preset time window includes: Counting the number of times the first reflected light is detected and received in different time intervals respectively, to obtain a number set consisting of the number of times the first reflected light is detected and received corresponding to each time interval; The detecting the number of times the first reflected light is received according to the preset time window and recognizing the operation gesture includes: The operation gesture is identified according to a change in the number of times in the frequency concentration.

8. The method according to claim 7, characterized in that Determining the number of detection cycles of the current detection cycle in the preset time window includes: If the first reflected light is detected to be received in the current detection cycle, the number of times the first reflected light is detected to be received, which has been counted within the time interval corresponding to the current detection cycle, is increased by one.

9. The method according to claim 7, characterized in that The identifying the operation gesture according to the number set includes: Normalizing the frequency set to obtain a single eigenvalue; The operation gesture corresponding to the feature value is determined according to the feature value.

10. The method according to claim 7, characterized in that: The method further comprises: emitting a second emitted light and receiving a second reflected light based on the second emitted light by using a second reflective optical module of the electronic device; detecting whether the second reflected light returned by the second emitted light is received; If it is detected that the second emitted light is received, the first reflective optical module is controlled to emit the first emitted light.

11. The method according to claim 10, characterized in that The method further comprises: If it is detected that the second reflected light is not received, the electronic device is controlled to be turned off or enter a lock screen state.

12. An electronic device, characterized in that: The electronic device comprises: processor; a memory for storing processor-executable instructions; The processor is configured to implement the operation gesture recognition method according to any one of claims 7 to 11 when running executable instructions.

13. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the steps of the operation gesture recognition method according to any one of claims 7 to 11.

Images