Interactive control system and method based on gesture

Abstract

The present invention relates to the field of interactive control technology, and in particular to a gesture-based interactive control system and method. It includes a gesture state preset module, an interactive state monitoring module, and a monitoring risk control module. The gesture action corresponding operation instruction is constructed through an angle space threshold to match the gesture action in the interactive area, so as to determine whether to grant the gesture action the authority to execute the operation instruction; at the same time, the gesture matching threshold is combined to determine whether to generate an initial risk instruction, so as to form a new gesture action based on the initial risk instruction to regulate the angle space threshold to construct a new gesture action, and based on the new gesture action and the gesture matching threshold, determine whether to generate a medium risk instruction, so as to reconstruct a new gesture action based on the medium risk instruction and indicate it to the user, eliminating the need for the user to remember the gesture action, and forming a safe and convenient interaction between the gesture action and the terminal device.

Description

Technical Field

[0001] The present invention relates to the field of interactive control technology, and in particular to a gesture-based interactive control system and method. Background Art

[0002] At present, a large number of terminal devices are equipped with gesture recognition interaction, so that by inputting preset gestures, the terminal device can output corresponding operation instructions according to the gestures, forming an intelligent interactive control between the gestures and the terminal device.

[0003] For example, the Chinese patent announcement is CN201810835941.5, which discloses a gesture interaction method and an interaction system, which relates to a field of gesture recognition technology, and solves the problem in the prior art that it is difficult to install a touch screen on some devices or it is difficult to operate various functions of the device according to user gestures. The key points of its technical solution are: the gesture interaction method includes the following steps: S1: collecting motion trajectory data of the gesture through a gesture acquisition device; S2: identifying the hand joint position information of the gesture according to the motion trajectory data; S3: triggering and identifying the corresponding trigger gesture according to the stay or movement of the hand joint position information within a preset time to realize interactive operation on the interactive interface, wherein the gesture is within the acquisition range of the gesture acquisition device. A gesture interaction method and an interaction system of the present invention can realize the control of the user interface of different terminal devices according to the user's gesture, which facilitates the user to control the user interface of the terminal device.

[0004] Although the above gesture interaction scheme can preset gestures to trigger interactive operations, when determining whether to grant the user the permission to interact with the terminal device through direct recognition of gestures, if there are some unauthorized users who collect and recognize gestures through the collection device in a frequent trial-and-error manner, there will be a great risk of triggering interactive operations in the interactive interface with different gestures, resulting in the security of the interaction between the user and the terminal device being affected;

[0005] Secondly, if multiple gestures are set for replacement, then after the set gesture replaces other gestures when the above-mentioned risk situation is triggered, the large number and complex gesture features will increase the difficulty for the authorized user to remember it. Therefore, it will affect the convenience of subsequent authorized users inputting gestures for interaction. In other words, it is currently impossible to provide a convenient interaction experience between users and terminal devices. Summary of the invention

[0006] In view of the above-mentioned shortcomings of the prior art, the present invention provides a gesture-based interactive control system and method, which can effectively solve the problem in the prior art that direct recognition and determination of gestures will affect the security and convenience of the interaction between the user and the terminal device.

[0007] To achieve the above objectives, the present invention is implemented through the following technical solutions:

[0008] The present invention provides a gesture-based interactive control system, which at least comprises:

[0009] The gesture state preset module is used to enable the user to preset gesture actions in the terminal device and output corresponding operation instructions with the preset gesture actions, wherein:

[0010] When presetting gesture actions, the angle space threshold F is reserved x Construct gesture actions;

[0011] And, the interaction state monitoring module, which is used to construct the gesture matching threshold F p and interactive area JA rea The judgment time J time , so that the interaction state monitoring module is based on the gesture matching threshold F p and interaction area JA rea The judgment time J time Matching the inputted gesture action in the database to determine whether the gesture action is authorized to execute the operation instruction;

[0012] Also includes:

[0013] The monitoring risk control module is used to monitor the input gesture action to perform matching and be within the gesture matching threshold F p When a gesture risk signal is generated and transmitted to the gesture state preset module, the gesture state preset module executes the following steps:

[0014] Get the angle space threshold F x And generate the initial risk instruction, through the initial risk instruction the angle space threshold F of the gesture action x Regulation forms a new angle space threshold F x And gestures, including:

[0015] After a new gesture is formed through the initial risk instruction, the interaction state monitoring module continues to monitor the interaction area JA rea The gestures entered in the system are collected and judged, including:

[0016] In the judgment time J time When the gesture matching threshold F is reached, a medium-risk instruction is generated, and a new gesture action is obtained through the medium-risk instruction. p It is determined whether to generate a matching threshold adjustment instruction, so as to limit the input gesture action through the matching threshold adjustment instruction.

[0017] Furthermore, the specific method of constructing the gesture action is:

[0018] Obtain finger features in the hand, including thumb, index finger, middle finger, little finger and ring finger;

[0019] The local joint structure D in each finger feature pmc Allow users to construct corresponding gestures, and when constructing gestures, limit the angle space threshold F between the finger features corresponding to the gestures x ,in:

[0020] Angle space threshold F x It refers to the reserved angle between two adjacent finger features, with the angle space threshold F x Allow the user to construct gestures corresponding to finger features, store the gestures in a database, and assign corresponding operation instructions to the gestures;

[0021] The local joint structure D pmc include:

[0022] The proximal interphalangeal joint, the distal interphalangeal joint and the metacarpophalangeal joint. Among the finger features, the thumb only has the metacarpophalangeal joint and the proximal interphalangeal joint.

[0023] Furthermore, the reserved angle space threshold F x The method to construct gesture actions is:

[0024] Determine the finger with the gesture action, determine the neighboring finger corresponding to the gesture action, and construct the angle space threshold F between the neighboring finger and the finger of the gesture action. x .

[0025] Furthermore, the method for determining whether to grant the gesture action the permission to execute the operation instruction is:

[0026] The interaction state monitoring module is based on the gesture matching threshold F p and interaction area JA rea The judgment time J time The input gesture action is matched in the database. If a corresponding gesture action is matched, the permission to execute the operation instruction corresponding to the gesture action is granted. Otherwise, it is not granted, and the step of collecting gesture action matching is repeated.

[0027] Furthermore, the initial risk instruction refers to the measurement of L by equal angles. jd Change the angle space threshold F of the gesture action x To form a new angle space threshold F x and gesture actions, where:

[0028] Equal angle measurement L jd Angle space threshold F xThe setting mode changes to increase or decrease the angle.

[0029] Furthermore, the angle space threshold F x According to the equal angle L jd The rule is changed so that when the gesture action input by the authorized user fails to cause the terminal device to output the corresponding operation instruction, the terminal device forms an indication of switching the gesture action.

[0030] Furthermore, the method of obtaining a new gesture action through a medium-risk instruction is:

[0031] Clarify the angle measurement L at the initial risk instruction stage jd Setting mode;

[0032] The medium risk instruction is measured at the medium angle of the initial risk instruction. jd The relative mode performs angle control, and the medium risk command is a medium angle amount L jd The change of angle is generated in real time, so that at each judgment time J time When the match is not successful, a medium-risk instruction is generated immediately and the equal angle quantity L is executed synchronously jd ,in:

[0033] Isometric dimension L for medium risk instructions jd The corresponding angle control is based on the equal angle quantity L in the initial risk instruction. jd The median angle is determined by

[0034] Furthermore, the generation method of the matching threshold adjustment instruction is:

[0035] When the interactive area JA rea When the gesture action input in the interactive state monitoring module is collected and no corresponding gesture action is matched, the interactive state monitoring module immediately generates a matching threshold adjustment instruction to adjust the gesture matching threshold F p , thus re-matching the gesture threshold F under the medium risk instruction p Collect matching gesture actions, including:

[0036] Matching threshold adjustment instruction refers to the medium risk instruction, based on the interactive area JA rea When the gesture action input in the interactive state monitoring module is collected and no corresponding gesture action is matched, the interactive state monitoring module obtains the number of matches this time, and generates a gesture matching threshold F according to the number of matches. p to regenerate the gesture matching threshold F p , among which:

[0037] When a match threshold adjustment instruction is generated and executed:

[0038] Get the gesture matching threshold F modified by the matching threshold adjustment instructionp , with the modified gesture matching threshold F p The number of times and the current risk instruction and the corresponding equal angle quantity L jd Perform superposition and combination to redefine the equal angle L of the medium risk instruction jd , thereby re-determining the gesture actions under the medium-risk instructions.

[0039] Furthermore, if the gesture action collected by the interaction status monitoring module is a historical gesture action of an operation instruction:

[0040] Determine the extended gesture matching threshold F based on the number of input history gesture actions p The number of times, and according to the switching rules of the initial risk command and the medium risk command and the gesture matching threshold F extended after the input of the historical gesture action p To predict new gestures corresponding to the operation instructions of historical gestures;

[0041] The historical gesture action refers to the gesture action when the terminal device switches the gesture action corresponding to the operation instruction without going through the initial risk instruction and the medium risk instruction.

[0042] An interactive control method is implemented according to the gesture-based interactive control system.

[0043] Compared with the known prior art, the technical solution provided by the present invention has the following beneficial effects:

[0044] Constructing gesture-action corresponding operation instructions through angle space thresholds to match gesture actions in the interactive area, thereby determining whether to grant the gesture action the authority to execute the operation instruction;

[0045] At the same time, the gesture matching threshold is combined to determine whether to generate an initial risk instruction, so as to construct a new gesture action based on the initial risk instruction by regulating the angle space threshold, and to determine whether to generate a medium risk instruction based on the new gesture action and the gesture matching threshold, so as to reconstruct a new gesture action based on the medium risk instruction and indicate it to the user, eliminating the need for the user to remember gesture actions and forming a safe and convenient interaction between gesture actions and terminal devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0047] Figure 1 It is the overall module block diagram of the present invention;

[0048] Figure 2 It is a schematic diagram of the method for constructing gesture actions of the present invention. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0050] The present invention will be further described below in conjunction with the embodiments.

[0051] Example 1 (see Figure 1 and Figure 2 ): A gesture-based interactive control system, comprising at least:

[0052] The gesture state preset module is used to enable the user to preset gesture actions in the terminal device and output the corresponding operation instructions with the preset gesture actions, wherein:

[0053] When the user performs a preset gesture action, the gesture state preset module limits the way the user sets the gesture action, specifically:

[0054] Get the finger features in the hand, including the thumb, index finger, middle finger, little finger and ring finger, and use the local joint structure D in each finger feature pmc Allow users to construct corresponding gestures, and when constructing gestures, limit the angle space threshold F between the finger features corresponding to the gestures x , in this scheme, the angle space threshold F x It means that an angle needs to be reserved between two adjacent finger features, and the angle space threshold F x Such as 10°, 20 degrees, etc., so that the user can construct the gesture action corresponding to the finger feature through the gesture state preset module, and store the preset gesture action in the database. Therefore, the user can assign the corresponding gesture action through the operation instruction in the terminal device, and the gesture action can output the corresponding operation instruction, forming an interactive control between the gesture action and the terminal device (such as a video terminal).

[0055] In the above, it should be noted that the local joint structure D pmcIncluding: proximal interphalangeal joints, distal interphalangeal joints and metacarpophalangeal joints. Among the finger features, except for the thumb, each finger feature has these three joint structures. The thumb only has metacarpophalangeal joints and proximal interphalangeal joints, but no distal interphalangeal joints.

[0056] Specifically, the angle space threshold F x Determine based on the finger features of the gesture action, specifically:

[0057] Determine the finger with the gesture action, determine the neighboring finger corresponding to the gesture action, and construct the angle space threshold F between the neighboring finger and the finger of the gesture action. x (When the finger of the gesture is the middle finger, the neighboring fingers are the index finger and the ring finger, that is, the angle space threshold F is between the index finger, the middle finger and the ring finger. x ;

[0058] When the finger of the gesture is the thumb, the neighboring finger is the index finger, that is, the angle space threshold F is between the thumb and the index finger. x ;

[0059] When the finger of the gesture is the little finger, the neighboring finger is the ring finger, that is, the angle space threshold F is between the ring finger and the little finger. x ), the other fingers of the hand are not affected by this.

[0060] Also includes:

[0061] The interactive status monitoring module is used to obtain the user's interactive area JA through the terminal device rea The gesture action inputted under (the collection area of ​​the gesture collection range of the terminal device) is matched with the gesture action corresponding to the operation instruction in the database to determine whether to grant the input gesture action the permission to execute the operation instruction, wherein:

[0062] In the process of matching the gesture action by the terminal device, if it is determined that the gesture action does not match the gesture action corresponding to any operation instruction in the database, a gesture matching threshold F is constructed. p , gesture matching threshold F p It means that the user can continue in the interactive area JA rea The maximum number of times that the gesture action is not matched with the gesture action of the operation instruction assigned in the database can be set to 3 times, 5 times, etc. without limitation, thereby enabling the interaction state monitoring module to detect the gesture action based on the gesture matching threshold F p Continue to match the gestures input by the user;

[0063] It should also be noted that, in the process of matching the gesture action input by the user in the interactive area of ​​the terminal device, in order to facilitate gesture interaction, the interactive area JA can be pre-set in the terminal device. rea The judgment time J for each gesture collection and matching time , the judgment time of the interaction area J time It can be preset to 5s, 6s, etc. This solution does not limit it. Therefore, when the interactive area JA rea Each time the input gesture action is collected and the time J is judged time When performing matching, the start time of the gesture action entered by the user is recorded, and when the judgment time JA is reached rea When the gesture action is matched with the corresponding gesture action in the database during the matching process, the terminal device outputs the operation instruction corresponding to the gesture action to execute the corresponding program, otherwise it will not be executed.

[0064] In the above, when judging the time J time When the matching is not successful, that is, the operation instruction is not executed, the terminal device is in the interactive area JA rea Determine whether the gesture continues to exist. If so, use the current time as the start time and combine it with the judgment time J time The gesture action is collected and matched again, that is, the terminal device repeats the above-mentioned steps of collecting and matching the gesture action and outputs the corresponding operation, which will not be described in detail here.

[0065] Furthermore, when the terminal device determines the input gesture action at the time J time After the matching is completed, if the input gesture action has not been matched to the corresponding gesture action in the database, and it is within the gesture matching threshold F p When a restricted input signal is generated, and the terminal device performs output display, thereby forming a safety warning. The restricted input signal refers to the user's interactive area JA of the terminal device at a specified time. rea The gesture action input below cannot be collected and matched. The specified time in this solution can be 1 hour, 2 hours, etc., and there is no specific limitation on this.

[0066] The monitoring risk control module is used to monitor the gesture action collected by the terminal device when the interactive state monitoring module detects that the gesture action of the user input is matched and is within the gesture matching threshold F. p When (it should be noted that when the gestures input by the user frequently fail to match, it can be reflected that the user has a great risk of being an unauthorized user of the terminal device), a gesture risk signal is generated and transmitted to the gesture state preset module. Therefore, in order to improve the output security of the operation command, the following steps are performed:

[0067] Get the angle space threshold F reserved between finger features x , generate the initial risk instruction, the initial risk instruction is to measure L by equal angles jd Change the angle space threshold F of the gesture action x To form a new angle space threshold F x And gesture action, thereby realizing the transformation of the overall gesture action in the finger feature. It should be noted that the equal angle quantity L in the initial risk instruction here jd Angle space threshold F x The change can be to increase or decrease the angle (the setting mode can be preset by the personnel, and there is no specific restriction). The specific increase or decrease angle can be preset to 5°, 10°, etc., and the decrease angle cannot exceed the angle space threshold F x , and the increased angle combined with the angle space threshold F x It cannot exceed 90°. The limit of the reduced or increased angle is used to ensure that the user can input gestures correctly. Therefore, the reduced or increased angle can be defined according to the actual condition of the user's hand to ensure that the user can input gestures correctly. Generally speaking, the increased angle is combined with the angle space threshold F x It cannot exceed 90°, so measure L by equal angles jd New gesture actions can be formed, and based on the new gesture actions, the security of the user's interaction with the terminal device through gesture actions can be improved, and the probability of unauthorized users connecting and interacting with the terminal device by frequently trial-and-error using gesture actions can be reduced.

[0068] It is worth noting that in this scheme, the initial risk instruction is based on the equal angle measurement L jd Generate a new angle space threshold F x , and here it is only the angle space threshold F x The changes performed are to the specific local joint structure D pmc The corresponding gesture action does not change, that is, the user only needs to use the previously preset gesture action combined with the current angle space threshold F x It is sufficient to input a new overall gesture action, which is easier for users to remember and avoids setting up more complex and cumbersome gesture actions in the database and switching them when encountering risks, which may affect the user's subsequent input of gesture actions and the convenient interaction between the terminal device.

[0069] According to the above, due to the angle space threshold F x According to the equal angle L jdTherefore, when the authorized user cannot make the terminal device output the corresponding operation instruction through the gesture action input, the terminal device forms an indication of the switching of the gesture action, so that the authorized user can infer that the gesture action corresponding to the previous operation instruction has changed, and then it is indicated that the user inputs the changed gesture action, thereby improving the convenience and security of the authorized user's interaction with the terminal device through gesture actions.

[0070] Furthermore, in the above-mentioned initial risk instruction, the angle space threshold F is generated. x After generating a new gesture action, the interaction state monitoring module continues to monitor the interaction area JA rea The gesture action input in the time is collected to judge the time J time Verify whether there is a matching gesture action, thereby determining whether to execute the operation instruction. It is worth noting that here, in order to further deepen the security of the interaction between the gesture action and the terminal device, the following steps are also performed:

[0071] Generate angle space threshold F through initial risk instruction x After changing the gesture action, the interaction status monitoring module continues to monitor the interaction area JA rea The gestures entered in the system are collected and judged, including:

[0072] In the judgment time J time When the match is not successful, a medium-risk instruction is generated immediately. The medium-risk instruction is to change the equal angle L jd The settings mode has new gesture actions, specifically:

[0073] At the initial risk instruction stage, the equal angle L jd The angle between the finger features is controlled in an increasing or decreasing manner. Therefore, the equal angle L of the initial risk instruction is pre-defined. jd When executing angle switching, it is in increasing or decreasing mode, that is, the medium risk instruction is the medium angle amount L of the initial risk instruction. jd The relative mode execution angle changes, such as the equal angle L in the initial risk instruction jd is increasing, then the equal angle quantity L in the medium risk instruction jd is decreasing, and for medium risk instructions, the medium angle L jd The change of angle is generated in real time, so that at each judgment time J time When the match is not successful, a medium-risk instruction is generated immediately and the equal angle quantity L is executed synchronously jd ;

[0074] It should be noted that in order to enhance the safety of the transformed gesture action, the equal angle L of the medium risk command jdThe angle to be increased or decreased is the same angle L in the initial risk instruction. jd The median value of the decreasing or increasing angle is determined. This method not only deepens the safety of gesture changes, but also facilitates users to adjust the median angle according to the initial risk instruction L jd It can be calculated by decreasing or increasing angles, which is more convenient.

[0075] In the above, the interaction status monitoring module continuously monitors the interaction area JA rea When collecting and judging the gesture action input in the system, the preset gesture matching threshold F is obtained synchronously. p , and according to the interaction area JA rea The result of the gesture action inputted in the judgment match determines whether to generate a matching threshold adjustment instruction, wherein:

[0076] When the interactive area JA rea When the gesture action input in the interactive state monitoring module is collected and no corresponding gesture action is matched, the interactive state monitoring module immediately generates a matching threshold adjustment instruction to adjust the gesture matching threshold F p , thus re-matching the gesture threshold F under the medium risk instruction p Collect matching gestures to reduce the risk of the matching process, including:

[0077] Matching threshold adjustment instruction means: Under medium risk instruction, according to the interactive area JA rea When the gesture action inputted in the interactive state monitoring module is collected and no corresponding gesture action is matched, the interactive state monitoring module obtains the number of matches this time (the number of matches of the input gesture action under the medium risk instruction), and generates a gesture matching threshold F according to the number of matches. p If the current gesture is the second time, the gesture matching threshold F p Reduced 2 times, that is, according to the gesture matching threshold F p The remaining number of times for the interactive area JA rea The gesture actions input in the system are collected and matched, so that when there are unmatched gesture actions under medium-risk instructions, which poses a greater risk, the risk probability can be reduced by reducing the number of input gesture actions.

[0078] It should also be noted that the gesture matching threshold F p The number of times corresponds to the degree (each time corresponds to each degree), so:

[0079] When the matching threshold adjustment instruction is generated and executed, the gesture matching threshold F modified by the matching threshold adjustment instruction is obtained. p , with the modified gesture matching threshold F p The number of times and the current risk instruction and the corresponding equal angle quantity L jdPerform superposition and combination to redefine the equal angle L of the medium risk instruction jd , thus, with the help of the determined gesture matching threshold F p Re-evaluate gesture actions under medium-risk instructions to improve the security of the interaction between gesture actions and terminal devices.

[0080] It is worth noting that since the gesture action changes according to the corresponding risk situation, in order to facilitate the authorized user to conveniently input the changed gesture action, the interaction status monitoring module needs to perform the following steps:

[0081] The interactive status monitoring module continuously collects and matches the gestures input by the user;

[0082] If the collected gesture action is a historical gesture action of the operation instruction, the historical gesture action refers to the gesture action initially corresponding to the operation instruction in the terminal device, but because in the subsequent process of collecting and matching the input gesture action, when the initial risk instruction and the medium risk instruction have been switched to a new gesture action, the gesture action is not granted the permission to interact with the terminal device, so that when the gesture actions input by the user are all historical gesture actions, the gesture matching threshold F is extended. p The gesture matching threshold F is extended according to the number of input history gesture actions. p The number of times (extending the gesture matching threshold F p For example, the number of times can be set as: the number of input historical gesture actions corresponds to the extended gesture matching threshold F p 2 times, the specific settings can also be defined in advance by authorized personnel, which is not limited here). When the gesture action input by the user is a historical gesture action that has not achieved interaction, it indicates that the user's gesture action has changed. Then the user is based on the switching rules of the initial risk command and the medium risk command, and the gesture matching threshold F extended after the historical gesture action is input. p To derive new gesture actions corresponding to operation instructions of historical gesture actions, so that authorized users can deduce the gesture actions for interacting with the terminal device according to actual conditions without having to remember multiple gesture actions, thereby realizing safe and convenient interaction between gesture actions and terminal devices.

[0083] Finally, the present invention also provides an interactive control method, which is implemented according to the gesture-based interactive control system.

[0084] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements will not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the embodiments of the present invention.

Claims

1. A gesture-based interactive control system, characterized in that: At least: The gesture state preset module is used to enable the user to preset gesture actions in the terminal device and output corresponding operation instructions with the preset gesture actions, wherein: When presetting gesture actions, the angle space threshold F is reserved x Construct gesture actions; And, the interaction state monitoring module, which is used to construct the gesture matching threshold F p and interactive area JA rea The judgment time J time , so that the interaction state monitoring module is based on the gesture matching threshold F p and interaction area JA rea The judgment time J time Matching the inputted gesture action in the database to determine whether the gesture action is authorized to execute the operation instruction; Also includes: The monitoring risk control module is used to monitor the input gesture action to perform matching and be within the gesture matching threshold F p When a gesture risk signal is generated and transmitted to the gesture state preset module, the gesture state preset module executes the following steps: Get the angle space threshold F x And generate the initial risk instruction, through the initial risk instruction the angle space threshold F of the gesture action x Regulation forms a new angle space threshold F x And gestures, including: After a new gesture is formed through the initial risk instruction, the interaction state monitoring module continues to monitor the interaction area JA rea The gestures entered in the system are collected and judged, including: In the judgment time J time When the gesture matching threshold F is reached, a medium-risk instruction is generated, and a new gesture action is obtained through the medium-risk instruction. p to determine whether to generate a matching threshold adjustment instruction, so as to limit the input gesture action through the matching threshold adjustment instruction; The initial risk instruction is to measure L by equal angles jd Change the angle space threshold F of the gesture action x To form a new angle space threshold F x and gesture actions, where: Equal angle measurement L jd Angle space threshold F x The change is to increase or decrease the setting mode of the angle; The method to obtain new gesture actions through medium-risk instructions is: Clarify the angle measurement L at the initial risk instruction stage jd Setting mode; The medium risk instruction is measured at the medium angle of the initial risk instruction. jd The relative mode performs angle control, and the medium risk command is a medium angle amount L jd The change of angle is generated in real time, so that at each judgment time J time When the match is not successful, a medium-risk instruction is generated immediately and the equal angle quantity L is executed synchronously jd ,in: Isometric dimension L for medium risk instructions jd The corresponding angle control is based on the equal angle quantity L in the initial risk instruction. jd The median angle is determined by 2. The gesture-based interactive control system according to claim 1, characterized in that: The specific method of constructing the gesture action is: Obtain finger features in the hand, including thumb, index finger, middle finger, little finger and ring finger; The local joint structure D in each finger feature pmc Allow users to construct corresponding gestures, and when constructing gestures, limit the angle space threshold F between the finger features corresponding to the gestures x ,in: Angle space threshold F x It refers to the reserved angle between two adjacent finger features, with the angle space threshold F x Allow the user to construct gestures corresponding to finger features, store the gestures in a database, and assign corresponding operation instructions to the gestures; The local joint structure D pmc include: The proximal interphalangeal joint, the distal interphalangeal joint and the metacarpophalangeal joint. Among the finger features, the thumb only has the metacarpophalangeal joint and the proximal interphalangeal joint.

3. The gesture-based interactive control system according to claim 1, characterized in that: The reserved angle space threshold F x The method to construct gesture actions is: Determine the finger with the gesture action, determine the neighboring finger corresponding to the gesture action, and construct the angle space threshold F between the neighboring finger and the finger of the gesture action. x .

4. The gesture-based interactive control system according to claim 1, characterized in that: The method for determining whether to grant the gesture action the permission to execute the operation instruction is: The interaction state monitoring module is based on the gesture matching threshold F p and interaction area JA rea The judgment time J time The input gesture action is matched in the database. If a corresponding gesture action is matched, the permission to execute the operation instruction corresponding to the gesture action is granted. Otherwise, it is not granted, and the step of collecting gesture action matching is repeated.

5. The gesture-based interactive control system according to claim 1, characterized in that: The angle space threshold F x According to the equal angle L jd The rule is changed so that when the gesture action input by the authorized user fails to cause the terminal device to output the corresponding operation instruction, the terminal device forms an indication of switching the gesture action.

6. The gesture-based interactive control system according to claim 1, characterized in that: The generation method of the matching threshold adjustment instruction is: When the interactive area JA rea When the gesture action input in the interactive state monitoring module is collected and no corresponding gesture action is matched, the interactive state monitoring module immediately generates a matching threshold adjustment instruction to adjust the gesture matching threshold F p , thus re-matching the gesture threshold F under the medium risk instruction p Collect matching gesture actions, including: Matching threshold adjustment instruction refers to the medium risk instruction, based on the interactive area JA rea When the gesture action input in the interactive state monitoring module is collected and no corresponding gesture action is matched, the interactive state monitoring module obtains the number of matches this time, and generates a gesture matching threshold F according to the number of matches. p to regenerate the gesture matching threshold F p , among which: When the match threshold adjustment instruction is generated and executed: Get the gesture matching threshold F modified by the matching threshold adjustment instruction p , with the modified gesture matching threshold F p The number of times and the current risk instruction and the corresponding equal angle quantity L jd Perform superposition and combination to redefine the equal angle L of the medium risk instruction jd , thereby re-determining the gesture actions under the medium-risk instructions.

7. The gesture-based interactive control system according to claim 6, characterized in that: If the gesture action collected by the interaction status monitoring module is a historical gesture action of an operation instruction: Determine the extended gesture matching threshold F based on the number of input history gesture actions p The number of times, and according to the switching rules of the initial risk command and the medium risk command and the gesture matching threshold F extended after the input of the historical gesture action p To predict new gestures corresponding to the operation instructions of historical gestures; The historical gesture action refers to the gesture action when the terminal device switches the gesture action corresponding to the operation instruction without going through the initial risk instruction and the medium risk instruction.

8. An interactive control method, characterized in that: The method is implemented according to the gesture-based interactive control system according to claim 1.

Images