Large screen gesture recognition interaction system adapted to databases
By introducing the recognition interaction management platform, key recognition construction unit and gesture recognition control unit into the database, the problems of key construction and data matching in large-screen gesture recognition are solved, the accuracy and security of gesture recognition are achieved, and the efficiency and security of data access are improved.
Patent Information
- Application Number
- CN202510947753.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-10
- Publication Date
- 2025-10-10
- Estimated Expiration
- 2045-07-10
AI Technical Summary
In the existing technology, when large-screen gestures are used to retrieve database data, the palm position cannot be identified as a key, key construction and data matching cannot be performed, and intervention cannot be made during the gesture recognition stage, resulting in gesture recognition errors and data leakage risks.
A large-screen gesture recognition interaction system adapted to the database is adopted, including an identification interaction management platform, a key identification construction unit, a data intelligent matching unit and a gesture recognition control unit. The key identification construction unit is used to identify user keys, the data intelligent matching unit is used to match data, and the gesture recognition control unit performs real-time intervention to ensure the accuracy and security of gesture recognition.
The accuracy and security of gesture recognition are improved, gesture recognition errors and data leakage are avoided, and the efficiency and security of data access are improved.
Smart Images

Figure CN120428870B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of large screen gesture recognition, and particularly to a large screen gesture recognition interaction system adapted to a database. BACKGROUND
[0002] Large screen gesture refers to an operation mode in which a human body hand action (such as sliding, clicking, zooming, waving, circling, etc.) is used to interact with a system on a large screen device (such as an LED spliced screen, a touch large screen, a projection curtain, etc.). It belongs to a kind of natural interaction technology, aiming to break free from the shackles of traditional keyboard and mouse, allowing users to complete instruction input through intuitive gestures, and improving the convenience and immersion of operation.
[0003] However, in the prior art, when large screen gestures are used for database data retrieval, the corresponding palm position cannot be recognized as a key recognition subject according to gesture recognition technology, the key cannot be constructed according to different data, and after the key is determined, the gesture and data cannot be matched, targeted operation cannot be performed, in addition, intervention cannot be performed during the gesture recognition stage, and the risk of accidental gestures cannot be overcome.
[0004] In view of the above technical defects, a solution is proposed. SUMMARY
[0005] The purpose of the present application is to solve the above-mentioned problems and propose a large screen gesture recognition interaction system adapted to a database.
[0006] The purpose of the present application can be achieved by the following technical solutions:
[0007] The large screen gesture recognition interaction system adapted to the database comprises a recognition interaction management platform, and the recognition interaction management platform is communicatively connected with a key recognition construction unit, a data intelligent matching unit and a gesture recognition control unit.
[0008] The key recognition construction unit constructs a key for a user with data access authority, and accurately recognizes gestures within the coverage range of the large screen during data retrieval.
[0009] After determining that the current authorized end key data matches the corresponding data retrieval, the data intelligent matching unit intelligently matches the retrieval data with the retrieval gesture.
[0010] After the recognition interaction management platform completes the permission recognition of the palm position and the retrieval recognition of the finger position, the gesture recognition control unit intervenes in the real-time gesture recognition.
[0011] As a preferred embodiment of the present application, the process of the key recognition construction unit is as follows:
[0012] Determine the data stored in the database and the corresponding user with access rights, and mark them as authorized terminals; determine the coverage range of the large screen, make the authorized terminal's hand within the large screen coverage range, and set the palm position within the authorized terminal's hand shape as the identification subject; collect data on the identification subject and set it as the authorized terminal key data of the current type of data, where the collected data is represented by the palm position of the authorized terminal corresponding to the palm print outline and palm print spacing;
[0013] After obtaining the authorization end key data, in the usage scenario, the database receives the data retrieval instruction, obtains the authorization end key data of the corresponding data according to the retrieved data, and at the same time, the large screen performs gesture recognition on the access end and collects the identification data of the real-time access end.
[0014] As a preferred embodiment of the present invention, after the access terminal completes the collection of identification data, the identification interaction management platform compares the identification data with the authorization terminal key data;
[0015] Perform handprint contour analysis on the identification data and authorization end key data, obtain the boundary of the palm position based on the contour of the palm position, set the same reference point, and when the reference point is used as the orientation center, identify and compare the handprint contours corresponding to the same position. If the overlapping area of the handprint contours is lower than the set area threshold, the current position is marked as a blurred position; if the overlapping area of the handprint contours is higher than the set area threshold, the current position is marked as a clear position.
[0016] As a preferred embodiment of the present invention, a position distribution map is obtained based on the distribution of fuzzy positions and clear positions after data comparison, and the position distribution map is analyzed:
[0017] If the fuzzy positions in the position distribution map are concentrated and single, and the clear positions are continuous and the number ratio exceeds the set ratio threshold, the handprint spacing of the clear positions will be identified. If the error in any handprint spacing identification is within the error range, the current access end will be determined as an authorized end, and the stored data corresponding to the current authorized end key data will be displayed on the large screen; if the fuzzy position distribution in the position distribution map exists or the number is not unique, and the clear positions are intermittent or the number ratio does not exceed the set ratio threshold, the current access end will be determined as a non-authorized end, and a deny access instruction will be sent to the large screen.
[0018] As a preferred embodiment of the present invention, the process of the data intelligent matching unit is as follows:
[0019] After determining the palm position of the authorized end, the finger position of the authorized end is obtained, and the gesture recognition origin is set based on the palm position as the center. Four recognition areas are constructed using the gesture recognition origin and horizontal, vertical and perpendicular cross auxiliary lines. Labels are set based on the access data type, and the data set in the labels corresponds to the four areas.
[0020] A data tag determination instruction is constructed according to the finger position, and the tag determination instruction is a position instruction and a trajectory instruction.
[0021] As a preferred embodiment of the present invention, when the tag determines that the instruction is a position instruction, any point of the finger position is selected as the instruction execution point based on the gesture recognition origin, and the number of finger position points selected is not unique; after the instruction execution point is determined, the instruction execution point and the corresponding recognition area are set to a point trigger relationship, and the instruction execution point and the point trigger relationship are only recorded by the authorized end; the point trigger relationship is expressed as the duration and frequency of the instruction execution point entering the recognition area;
[0022] When the tag determines that the instruction is a trajectory instruction, a line trigger relationship is set based on the instruction execution point and the corresponding recognition area. The line trigger relationship is represented by the linear trajectory completed by the instruction execution point within the set recognition area or between recognition areas, specifically a straight line trajectory, curved trajectory, or circular trajectory.
[0023] As a preferred embodiment of the present invention, after determining the gesture settings corresponding to various types of data stored in the database, use verification is performed; the gesture verification process of obtaining the real-time finger position is compared with the instruction execution point stored in the database and the corresponding trigger relationship;
[0024] Based on the gesture recognition origin, the orientation parameters of the real-time finger position and the instruction execution point corresponding to the finger position in the database are obtained; and it is determined whether the orientation of the finger position where the real-time instruction execution point is located is consistent with the instruction execution point orientation set by the finger position in the database. If they are consistent, it is set as a gesture recognition point; if not, it is set as a non-gesture recognition point.
[0025] As a preferred embodiment of the present invention, after obtaining the gesture recognition point, a real-time trigger execution period is set for the gesture recognition point, and the actions of the gesture recognition point are recorded during the execution period. Trigger relationship identification is performed based on the recorded actions. After the trigger relationship identification is executed, the corresponding storage data of the recognition area is displayed on the large screen and there is no deviation in the displayed data type, then the current gesture recognition logic is set to be satisfied; otherwise, the current gesture recognition is set to be unsatisfactory, and the instruction execution point is reset or the parameters set in the trigger relationship are reset; after the trigger relationship is not recognized and executed, there is no data operation on the current data retrieved by the large screen.
[0026] As a preferred embodiment of the present invention, the process of the gesture recognition control unit is as follows:
[0027] After the instruction execution point is determined, the point triggered by the corresponding finger position at the current time is recorded and marked as a synchronization point, and in the instruction execution point trigger relationship identification stage, the deviation time of the trigger relationship execution period corresponding to the real-time instruction execution point and the synchronization point is obtained, when the deviation time does not exceed the set deviation threshold, if the trigger relationship of the synchronization point and the instruction execution point is not identified at the same time, and the un-identified trigger relationship execution parameters are consistent, it is inferred that the current access terminal has an identification risk; if the trigger relationship of the synchronization point and the instruction execution point is identified at the same time, and the identified trigger relationship execution parameters are consistent, it is inferred that the current access terminal has an identification risk.
[0028] As a preferred embodiment of the present application, when there is an identification risk, the instruction execution point is re-identified, the corresponding trigger relationship is arbitrarily set, and the trigger relationship type is specified through a large screen, and the current execution gesture needs to be executed according to the specified type of trigger relationship, otherwise data retrieval cannot be performed;
[0029] When there is an identification risk, the data retrieval of the access terminal is set to only browse, and the execution of the subsequent trigger relationship is monitored, and when the execution parameters of the trigger relationship are consistent, the data access terminal is terminated, and the data that has been browsed is marked as leaked, and when the current data does not enter the adjacent update cycle, the data is updated in advance, and the data update cycle is reset.
[0030] Compared with the prior art, the present application has the following advantages:
[0031] 1、In the present application, the user with data access permission is identified and constructed by key, and the gesture in the large screen coverage range is accurately identified during data retrieval, which ensures the safety of data retrieval and improves the accuracy of gesture recognition according to the key setting of the user with permission, avoids the appearance of multiple gestures in the large screen coverage range, causes gesture recognition error or confusion, reduces the accuracy of gesture recognition interaction, and also reduces the data scheduling efficiency of the user with permission.
[0032] 2、In the present application, the retrieval gesture is intelligently matched to the retrieved data, the gesture corresponding to the corresponding retrieval operation of the retrieval operation is matched, so as to assist the authorized terminal in data access and retrieval in the large screen gesture interaction process, improve the efficiency of data access, and also perform retrieval data operation through gesture recognition, avoid repeated data loading in the database, reduce the timeliness of data access, and also alleviate the continuous occupation frequency of the data transmission channel in the database, directly promote the data scheduling transmission of the database.
[0033] 3、The present application, in the real-time gesture recognition stage, when there is a misoperation of the instruction execution point corresponding trigger relationship, interactive intervention is carried out to avoid the occurrence of accidental operation to cause the corresponding data to be called, causing data leakage, at the same time, the interactive intervention can reduce the risk of data leakage, and can improve the real-time gesture recognition efficiency, avoid the cumulative occurrence of multiple instructions in the recognition gesture, cause the call to be not timely, and affect the efficiency of data access call. BRIEF DESCRIPTION OF DRAWINGS
[0034] For the convenience of those skilled in the art, the present application will be further described below in conjunction with the drawings.
[0035] Figure 1 The principle block diagram of the system of the present application is shown in the figure.
[0036] Figure 2 The flow chart of the method of the present application is shown in the figure. DETAILED DESCRIPTION
[0037] In order to make the person skilled in the art better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.
[0038] In this paper, the phrase "embodiment" means that the specific features, structures or characteristics described in conjunction with the embodiment can be included in at least one embodiment of the present application. The phrase appears at various places in the specification does not necessarily refer to the same embodiment, nor is it independent or alternative to other embodiments. Those skilled in the art understand explicitly and implicitly that the embodiments described herein can be combined with other embodiments.
[0039] Please refer to Figure 1-Figure 2 As shown, the large-screen gesture recognition interactive system adapted to the database includes a recognition interaction management platform. It should be explained that the present application is adapted to the database. When data storage is performed in the database, each data in the database is called through large-screen gesture interaction when data calling is needed. The present application serves as the management center of the interactive system, and each part of the logic of the large-screen gesture interaction is constructed to ensure the feasibility of the gesture recognition interactive process.
[0040] Among them, the recognition interaction management platform is in communication connection with a key recognition construction unit, a data intelligent matching unit and a gesture recognition control unit.
[0041] The database is connected to the recognition and interaction management platform for two-way communication. When the storage data types of the database are diversified and continuously updated, the recognition and interaction management platform retrieves the data from the database and combines it with gestures.
[0042] The identification interaction management platform generates a key identification construction signal and sends it to the key identification construction unit;
[0043] The key identification and construction unit is used to identify and construct keys for users with data access rights, and accurately identify gestures within the coverage area of the large screen when retrieving data. This ensures the security of data retrieval and can also improve the accuracy of gesture recognition based on the key settings of authorized users, avoiding the recording of multiple gestures within the coverage area of the large screen, resulting in gesture recognition errors or confusion, reducing the accuracy of gesture recognition interaction, and reducing the data scheduling efficiency of authorized users;
[0044] Determine the data stored in the database and the corresponding user with access rights, and mark them as authorized terminals; determine the coverage range of the large screen, make the authorized terminal's hand within the large screen coverage range, and set the palm position within the authorized terminal's hand shape as the identification subject. It should be explained that the palm position of each authorized terminal cannot be moved at will, so the palm position is used as the key extraction position;
[0045] Collect data of the identification subject and set it as the authorization end key data of the current type of data, where the collected data is represented by the data such as the outline of the palm print corresponding to the palm position of the authorization end and the distance between the palm prints;
[0046] After obtaining the authorization end key data, in the usage scenario, the database receives the data retrieval instruction, obtains the authorization end key data of the corresponding data according to the retrieved data, and at the same time, the large screen performs gesture recognition on the access end, and collects the recognition data of the real-time access end; specifically, the recognition data includes the access end's handprint outline, handprint spacing and other data;
[0047] After the access end completes the collection of identification data, the identification interaction management platform compares the identification data with the authorization end key data;
[0048] Perform handprint contour analysis on the identification data and authorization end key data, obtain the boundary of the palm position based on the contour of the palm position, set the same reference point, and when the reference point is used as the orientation center, identify and compare the handprint contours corresponding to the same position. If the overlapping area of the handprint contours is lower than the set area threshold, the current position is marked as a blurred position; if the overlapping area of the handprint contours is higher than the set area threshold, the current position is marked as a clear position;
[0049] The position distribution map is obtained based on the distribution of fuzzy positions and clear positions after data comparison, and the position distribution map is analyzed:
[0050] If the fuzzy positions in the position distribution map are concentrated and single, and the clear positions are continuous and the number of them exceeds the set threshold, the handprint spacing of the clear positions will be identified. If the error of any handprint spacing is within the error range, the current access end will be determined as the authorized end, and the stored data corresponding to the current authorized end key data will be displayed on the large screen;
[0051] If there are fuzzy locations in the location distribution map or the number is not unique, and clear locations are intermittent or the number ratio does not exceed the set ratio threshold, the current access terminal is determined to be an unauthorized terminal and a denial of access instruction is sent to the large screen;
[0052] In the large-screen usage scenario, confirm that the current authorization end key data matches the corresponding data retrieved, then proceed to the next step;
[0053] The data intelligent matching unit is used to intelligently match the retrieval gestures for retrieval of data. By determining the retrieval operation corresponding to the retrieval operation, it matches the corresponding gesture to assist the authorized end in accessing and retrieving data during the large-screen gesture interaction process, thereby improving the efficiency of data access. It also performs targeted data retrieval operations through gesture recognition, avoiding repeated data loading in the database, reducing the timeliness of data access, and alleviating the continuous occupancy frequency of the data transmission channel in the database, directly promoting the data scheduling and transmission of the database;
[0054] After determining the palm position of the authorized end, the finger position of the authorized end is obtained, and the gesture recognition origin is set based on the palm position as the center. Four recognition areas are constructed with the gesture recognition origin and horizontal and vertical cross auxiliary lines. Tags are set according to the access data type, and the data of the set tags corresponds to the four areas. It should be explained that if the number of tags does not reach four, the number can be adjusted, such as setting three areas or two areas.
[0055] A data tag determination instruction is constructed according to the finger position, and the tag determination instruction is a position instruction and a trajectory instruction;
[0056] When the tag determines that the command is a position command, it selects any point of the finger position as the command execution point based on the gesture recognition origin, and the number of finger position points selected is not unique; after the command execution point is determined, the command execution point and the corresponding recognition area are set to a point trigger relationship, and the command execution point and the point trigger relationship are only recorded by the authorized end; the point trigger relationship is represented by the set parameters such as the duration and frequency of the command execution point entering the recognition area;
[0057] When the tag determination instruction is a trajectory instruction, a line triggering relationship is set between the instruction execution point and the corresponding recognition area, where the line triggering relationship represents a linear trajectory completed by the instruction execution point in the set recognition area or between the recognition areas, such as a straight line trajectory, a curve trajectory, or a circular trajectory, etc.
[0058] After determining the gesture settings of the data stored in the database for each type of data, the use is verified; and the position instruction and the trajectory instruction and the corresponding triggering relationship can be set synchronously, or the latter can be recognized synchronously;
[0059] The gesture verification process of the real-time finger position is obtained, and the instruction execution point and the corresponding triggering relationship stored in the database are compared;
[0060] According to the gesture recognition origin, the position parameters such as interval coordinate positions of the real-time finger position and the instruction execution point corresponding to the finger position in the database are obtained; and whether the position of the real-time instruction execution point in the finger position is consistent with the position of the instruction execution point set in the finger position in the database is determined, and if so, it is set as a gesture recognition point, and if not, it is set as a non-gesture recognition point; the judgment standard of consistency or not is the position interval and the position deviation of each contour of the finger position; it needs to be explained that after determining the non-gesture recognition point, the large screen does not make any recognition to the corresponding finger position; and the non-gesture recognition point makes the corresponding action of the triggering relationship of any data stored in the database, and the corresponding stored data is given a safety warning;
[0061] After obtaining the gesture recognition point, the real-time triggering execution period of the gesture recognition point is set, and the action of the gesture recognition point in the execution period is recorded, the triggering relationship is recognized according to the recorded action, and after the triggering relationship recognition is executed, the stored data corresponding to the recognition area is displayed on the large screen and the display data type is not deviated, then it is set that the current gesture recognition logic meets the requirements; otherwise, it is set that the current gesture recognition does not meet the requirements, and the instruction execution point is re-set or the parameters in the triggering relationship are re-set;
[0062] After the triggering relationship is not recognized and executed, the current data of the large screen is not operated;
[0063] After the recognition interaction management platform completes the permission recognition of the palm position and the call recognition of the finger position, the gesture recognition control unit intervenes in the real-time gesture recognition, when there is a misoperation of the instruction execution point corresponding to the triggering relationship in the real-time gesture recognition stage, the interactive intervention is carried out to avoid the occurrence of accidental operation to cause the call of the corresponding data and cause data leakage, at the same time, the interactive intervention can reduce the risk of data leakage, and can improve the efficiency of real-time gesture recognition, avoid the cumulative occurrence of multiple instructions in the recognized gesture, cause the call not in time, and affect the efficiency of data access call;
[0064] After determining the instruction execution point, record the point at which the trigger relationship is executed corresponding to the finger position at the current moment and mark it as the synchronization point. In the instruction execution point trigger relationship identification stage, obtain the deviation time between the real-time instruction execution point and the synchronization point corresponding to the trigger relationship execution period. When the deviation time does not exceed the set deviation threshold, if the trigger relationship of the synchronization point and the instruction execution point is not identified at the same time, and the execution parameters of the unidentified trigger relationship are consistent, it is inferred that there is an identification risk on the current access end, and the instruction execution point is re-identified. At the same time, the corresponding trigger relationship is arbitrarily set, and the trigger relationship type is specified through the large screen. The current execution gesture needs to be executed according to the specified type of trigger relationship. Otherwise, data cannot be retrieved.
[0065] If the trigger relationship of the synchronization point and the instruction execution point is identified at the same time, and the identified trigger relationship execution parameters are consistent, it is inferred that there is an identification risk in the current access terminal, and the data retrieval of the access terminal is set to only browse permissions, and the execution of subsequent trigger relationships is monitored. When the execution parameters of the trigger relationship continue to be consistent, the data access terminal is accessed, and the browsed data is calibrated for leakage. When the current data has not entered the adjacent update cycle, the data is updated in advance, and the data update cycle is reset;
[0066] When the execution process of the real-time trigger relationship between the synchronization point and the instruction execution point is in other situations, no intervention will be made.
[0067] When the present invention is in use, the key identification and construction unit performs key identification and construction for users with data access rights, and accurately identifies gestures within the coverage range of the large screen when retrieving data; after determining that the current authorization end key data is consistent with the corresponding data retrieval, the data intelligent matching unit performs intelligent matching of the retrieval gesture for the retrieved data; after the recognition and interaction management platform completes the authority recognition of the palm position and the retrieval recognition of the finger position, the gesture recognition control unit interactively intervenes in the real-time gesture recognition.
[0068] Thresholds, preset values, and preset ranges are set for comparative analysis of results to determine whether they are good or bad. The values are set based on a combination of large-scale model analysis of sample data and manual experience, and can also be adjusted appropriately based on seasonal or common-sense factors.
[0069] The settings of weight ratio coefficients, influencing factors, etc. are assigned specific values according to the influence of each parameter on the result, which ultimately reflects the impact on the result. They are also set and entered into storage through a combination of large-scale model analysis of sample data and manual experience. Appropriate adjustments can also be made based on seasonal or common-sense influencing conditions.
[0070] The preferred embodiments of the present invention disclosed above are intended only to help illustrate the present invention. These preferred embodiments do not exhaustively describe all details, nor do they limit the present invention to specific embodiments. Obviously, many modifications and variations are possible based on the contents of this specification. These embodiments are selected and described in detail in this specification to better explain the principles and practical applications of the present invention, thereby enabling those skilled in the art to better understand and utilize the present invention. The present invention is limited only by the claims and their full scope and equivalents.
Claims
1. A large-screen gesture recognition interaction system adapted to a database, characterized in that: It includes an identification and interaction management platform, which is communicatively connected to a key identification construction unit, a data intelligent matching unit, and a gesture recognition control unit; The key identification and construction unit performs key identification and construction for users with data access rights, and accurately recognizes gestures within the coverage area of the large screen when retrieving data; After determining that the current authorization terminal key data matches the corresponding data retrieved, the data intelligent matching unit performs intelligent matching of the retrieved data with the retrieved gesture; After the recognition and interaction management platform completes the palm position authorization recognition and finger position retrieval recognition, the gesture recognition control unit performs interactive intervention on the real-time gesture recognition; The process of key identification building block is as follows: Determine the data stored in the database and the corresponding user with access rights, and mark them as authorized terminals; determine the coverage range of the large screen, make the authorized terminal's hand within the large screen coverage range, and set the palm position within the authorized terminal's hand shape as the identification subject; collect data on the identification subject and set it as the authorized terminal key data of the current type of data, where the collected data is represented by the palm position of the authorized terminal corresponding to the palm print outline and palm print spacing; After obtaining the authorization end key data, in the usage scenario, the database receives the data retrieval instruction, obtains the authorization end key data of the corresponding data according to the retrieved data, and at the same time, the large screen performs gesture recognition on the access end and collects the identification data of the real-time access end; After the access end completes the collection of identification data, the identification interaction management platform compares the identification data with the authorization end key data; Perform handprint contour analysis on the identification data and authorization end key data, obtain the boundary of the palm position based on the contour of the palm position, set the same reference point, and when the reference point is used as the orientation center, identify and compare the handprint contours corresponding to the same position. If the overlapping area of the handprint contours is lower than the set area threshold, the current position is marked as a blurred position; if the overlapping area of the handprint contours is higher than the set area threshold, the current position is marked as a clear position; The position distribution map is obtained based on the distribution of fuzzy positions and clear positions after data comparison, and the position distribution map is analyzed: If the fuzzy positions in the position distribution map are concentrated and single, and the clear positions are continuous and the number of them exceeds the set threshold, the handprint spacing of the clear positions will be identified. If the error of any handprint spacing is within the error range, the current access end will be determined as the authorized end, and the stored data corresponding to the current authorized end key data will be displayed on the large screen; If there are fuzzy locations in the location distribution map or the number is not unique, and the clear locations are intermittent or the number ratio does not exceed the set ratio threshold, the current access end will be determined as an unauthorized end and a denial of access instruction will be sent to the large screen.
2. The large-screen gesture recognition and interaction system adapted to a database according to claim 1, characterized in that: The process of the data intelligent matching unit is as follows: After determining the palm position of the authorized end, the finger position of the authorized end is obtained, and the gesture recognition origin is set based on the palm position as the center. Four recognition areas are constructed using the gesture recognition origin and horizontal and vertical cross-auxiliary lines. Labels are set based on the access data type, and the data set in the labels corresponds to the four areas. A data tag determination instruction is constructed according to the finger position, and the tag determination instruction is a position instruction and a trajectory instruction.
3. The large-screen gesture recognition and interaction system adapted to a database according to claim 2, characterized in that: When the tag determines that the instruction is a position instruction, any point of the finger position is selected as the instruction execution point based on the gesture recognition origin, and the number of points selected for the finger position is not unique; After determining the instruction execution point, the instruction execution point and the corresponding identification area are set to establish a point trigger relationship, and the instruction execution point and the point trigger relationship are only recorded by the authorized end; The point trigger relationship is represented by the duration and frequency of the instruction execution point entering the recognition area; When the tag determines that the instruction is a trajectory instruction, a line trigger relationship is set based on the instruction execution point and the corresponding recognition area. The line trigger relationship is represented by the linear trajectory completed by the instruction execution point within the set recognition area or between recognition areas, specifically a straight line trajectory, curved trajectory, or circular trajectory.
4. The large-screen gesture recognition and interaction system adapted to a database according to claim 3, characterized in that: After determining the gesture settings corresponding to each type of data stored in the database, use verification is performed; the gesture verification process of obtaining the real-time finger position is compared with the instruction execution point stored in the database and the corresponding trigger relationship; Based on the gesture recognition origin, the orientation parameters of the real-time finger position and the instruction execution point corresponding to the finger position in the database are obtained; and it is determined whether the orientation of the finger position where the real-time instruction execution point is located is consistent with the instruction execution point orientation set by the finger position in the database. If they are consistent, it is set as a gesture recognition point; if not, it is set as a non-gesture recognition point.
5. The large-screen gesture recognition and interaction system adapted to a database according to claim 4, characterized in that: After obtaining the gesture recognition point, set the real-time trigger execution period for the gesture recognition point, and record the actions of the gesture recognition point during the execution period. Perform trigger relationship recognition based on the recorded actions. After the trigger relationship recognition is executed, if the corresponding storage data in the recognition area is displayed on the large screen and there is no deviation in the displayed data type, the current gesture recognition logic is set to be satisfied; otherwise, the current gesture recognition is set to be unsatisfactory, and the instruction execution point is reset or the parameters set in the trigger relationship are reset; after the trigger relationship is not recognized and executed, there is no data operation on the current data retrieved by the large screen.
6. The large-screen gesture recognition and interaction system adapted to a database according to claim 1, characterized in that: The process of the gesture recognition control unit is as follows: After determining the instruction execution point, record the point at which the trigger relationship is executed corresponding to the finger position at the current moment and mark it as the synchronization point. During the instruction execution point trigger relationship identification stage, obtain the deviation time between the real-time instruction execution point and the synchronization point corresponding to the trigger relationship execution period. When the deviation time does not exceed the set deviation threshold, if the trigger relationship of the synchronization point and the instruction execution point is not identified at the same time, and the execution parameters of the unidentified trigger relationship are consistent, it is inferred that there is an identification risk at the current access end; if the trigger relationship of the synchronization point and the instruction execution point is identified at the same time, and the identified trigger relationship execution parameters are consistent, it is inferred that there is an identification risk at the current access end.
7. The large-screen gesture recognition and interaction system adapted to a database according to claim 6, characterized in that: When there is an identification risk, the command execution point is re-identified, and the corresponding trigger relationship is arbitrarily set. The trigger relationship type is specified through the large screen, and the current execution gesture needs to be executed according to the specified type of trigger relationship. Otherwise, data cannot be retrieved; When there are hidden dangers to be identified, the data retrieval at the access end is set to browsing permissions only, and the execution of subsequent trigger relationships is monitored. When the execution parameters of the trigger relationship remain consistent, the data access terminal is accessed, and the browsed data is calibrated for leakage. When the current data has not entered the adjacent update cycle, the data is updated in advance and the data update cycle is reset.
Citation Information
Patent Citations
Security authentication method based on gesture recognition, terminal, server and system
CN104580143A