Large-screen gesture recognition interaction system adaptive to database

Abstract

The invention discloses a large-screen gesture recognition interaction system adaptive to a database, relates to the technical field of large-screen gesture recognition, solves the technical problem that in the prior art, gesture and data matching can be carried out after a key is determined, and targeted operation cannot be carried out, and particularly relates to a key recognition construction unit. Key identification construction is carried out on the user with the data access authority, and gestures in a large-screen coverage range are accurately identified during data calling; after determining that the secret key data of the current authorization end is matched with the corresponding data calling, a data intelligent matching unit performs calling gesture intelligent matching on the calling data; and after the recognition interaction management platform completes authority recognition of the palm position and calling recognition of the finger position, the gesture recognition control unit performs interaction intervention on real-time gesture recognition.

Description

Technical Field

[0001] The present invention relates to the technical field of large-screen gesture recognition, and in particular to a large-screen gesture recognition interaction system adapted to a database. Background Art

[0002] Large-screen gestures are a method of interacting with the system on large-screen devices (such as LED video walls, touchscreens, and projection screens) through hand movements (such as sliding, clicking, zooming, waving, and drawing circles). This is a form of natural interaction technology designed to break free from the constraints of traditional keyboards and mice, allowing users to input commands through intuitive gestures, improving operational convenience and immersion.

[0003] However, in the existing technology, when large-screen gestures are used to retrieve database data, it is impossible to use the corresponding palm position as the key identification subject based on gesture recognition technology, it is impossible to construct keys based on different data, and it is impossible to match gestures and data after determining the key, and it is impossible to perform targeted operations. In addition, it is impossible to intervene in the gesture recognition stage, and it is impossible to overcome the risks caused by occasional gestures.

[0004] In view of the above technical defects, a solution is now proposed. Summary of the Invention

[0005] The purpose of the present invention is to solve the above-mentioned problems and to propose a large-screen gesture recognition interaction system adapted to a database.

[0006] The purpose of the present invention can be achieved through the following technical solutions:

[0007] A large-screen gesture recognition interaction system adapted to a database includes a recognition interaction management platform, which is communicatively connected to a key recognition construction unit, a data intelligent matching unit, and a gesture recognition control unit;

[0008] The key identification and construction unit performs key identification and construction for users with data access rights, and accurately recognizes gestures within the coverage area of the large screen when retrieving data;

[0009] After determining that the current authorization terminal key data matches the corresponding data retrieved, the data intelligent matching unit performs intelligent matching of the retrieved data with the retrieved gesture;

[0010] After the recognition interaction management platform completes the permission recognition of the palm position and the call recognition of the finger position, the gesture recognition control unit interactively intervenes in the real-time gesture recognition.

[0011] As a preferred embodiment of the present invention, the process of the key identification construction unit is as follows:

[0012] Determine the data stored in the database and the corresponding user with access rights, and mark them as authorized terminals; determine the coverage range of the large screen, make the authorized terminal's hand within the large screen coverage range, and set the palm position within the authorized terminal's hand shape as the identification subject; collect data on the identification subject and set it as the authorized terminal key data of the current type of data, where the collected data is represented by the palm position of the authorized terminal corresponding to the palm print outline and palm print spacing;

[0013] After obtaining the authorization end key data, in the usage scenario, the database receives the data retrieval instruction, obtains the authorization end key data of the corresponding data according to the retrieved data, and at the same time, the large screen performs gesture recognition on the access end and collects the identification data of the real-time access end.

[0014] As a preferred embodiment of the present invention, after the access terminal completes the collection of identification data, the identification interaction management platform compares the identification data with the authorization terminal key data;

[0015] Perform handprint contour analysis on the identification data and authorization end key data, obtain the boundary of the palm position based on the contour of the palm position, set the same reference point, and when the reference point is used as the orientation center, identify and compare the handprint contours corresponding to the same position. If the overlapping area of the handprint contours is lower than the set area threshold, the current position is marked as a blurred position; if the overlapping area of the handprint contours is higher than the set area threshold, the current position is marked as a clear position.

[0016] As a preferred embodiment of the present invention, a position distribution map is obtained based on the distribution of fuzzy positions and clear positions after data comparison, and the position distribution map is analyzed:

[0017] If the fuzzy positions in the position distribution map are concentrated and single, and the clear positions are continuous and the number ratio exceeds the set ratio threshold, the handprint spacing of the clear positions will be identified. If the error in any handprint spacing identification is within the error range, the current access end will be determined as an authorized end, and the stored data corresponding to the current authorized end key data will be displayed on the large screen; if the fuzzy position distribution in the position distribution map exists or the number is not unique, and the clear positions are intermittent or the number ratio does not exceed the set ratio threshold, the current access end will be determined as a non-authorized end, and a deny access instruction will be sent to the large screen.

[0018] As a preferred embodiment of the present invention, the process of the data intelligent matching unit is as follows:

[0019] After determining the palm position of the authorized end, the finger position of the authorized end is obtained, and the gesture recognition origin is set based on the palm position as the center. Four recognition areas are constructed using the gesture recognition origin and horizontal and vertical cross-auxiliary lines. Labels are set based on the access data type, and the data set in the labels corresponds to the four areas.

[0020] A data tag determination instruction is constructed according to the finger position, and the tag determination instruction is a position instruction and a trajectory instruction.

[0021] As a preferred embodiment of the present invention, when the tag determines that the instruction is a position instruction, any point of the finger position is selected as the instruction execution point based on the gesture recognition origin, and the number of finger position points selected is not unique; after the instruction execution point is determined, the instruction execution point and the corresponding recognition area are set to a point trigger relationship, and the instruction execution point and the point trigger relationship are only recorded by the authorized end; the point trigger relationship is expressed as the duration and frequency of the instruction execution point entering the recognition area;

[0022] When the tag determines that the instruction is a trajectory instruction, a line trigger relationship is set based on the instruction execution point and the corresponding recognition area. The line trigger relationship is represented by the linear trajectory completed by the instruction execution point within the set recognition area or between recognition areas, specifically a straight line trajectory, curved trajectory, or circular trajectory.

[0023] As a preferred embodiment of the present invention, after determining the gesture settings corresponding to various types of data stored in the database, use verification is performed; the gesture verification process of obtaining the real-time finger position is compared with the instruction execution point stored in the database and the corresponding trigger relationship;

[0024] Based on the gesture recognition origin, the orientation parameters of the real-time finger position and the instruction execution point corresponding to the finger position in the database are obtained; and it is determined whether the orientation of the finger position where the real-time instruction execution point is located is consistent with the instruction execution point orientation set by the finger position in the database. If they are consistent, it is set as a gesture recognition point; if not, it is set as a non-gesture recognition point.

[0025] As a preferred embodiment of the present invention, after obtaining the gesture recognition point, a real-time trigger execution period is set for the gesture recognition point, and the actions of the gesture recognition point are recorded during the execution period. Trigger relationship identification is performed based on the recorded actions. After the trigger relationship identification is executed, the corresponding storage data of the recognition area is displayed on the large screen and there is no deviation in the displayed data type, then the current gesture recognition logic is set to be satisfied; otherwise, the current gesture recognition is set to be unsatisfactory, and the instruction execution point is reset or the parameters set in the trigger relationship are reset; after the trigger relationship is not recognized and executed, there is no data operation on the current data retrieved by the large screen.

[0026] As a preferred embodiment of the present invention, the process of the gesture recognition control unit is as follows:

[0027] After determining the instruction execution point, record the point at which the trigger relationship is executed corresponding to the finger position at the current moment and mark it as the synchronization point. During the instruction execution point trigger relationship identification stage, obtain the deviation time between the real-time instruction execution point and the synchronization point corresponding to the trigger relationship execution period. When the deviation time does not exceed the set deviation threshold, if the trigger relationship of the synchronization point and the instruction execution point is not identified at the same time, and the execution parameters of the unidentified trigger relationship are consistent, it is inferred that there is an identification risk at the current access end; if the trigger relationship of the synchronization point and the instruction execution point is identified at the same time, and the identified trigger relationship execution parameters are consistent, it is inferred that there is an identification risk at the current access end.

[0028] As a preferred embodiment of the present invention, when there is an identification risk, the instruction execution point is re-identified, and the corresponding trigger relationship is arbitrarily set. The trigger relationship type is specified through the large screen, and the current execution gesture needs to be executed according to the specified type of trigger relationship. Otherwise, data cannot be retrieved;

[0029] When there are hidden dangers to be identified, the data retrieval at the access end is set to browsing permissions only, and the execution of subsequent trigger relationships is monitored. When the execution parameters of the trigger relationship remain consistent, the data access terminal is accessed, and the browsed data is calibrated for leakage. When the current data has not entered the adjacent update cycle, the data is updated in advance and the data update cycle is reset.

[0030] Compared with the prior art, the present invention has the following beneficial effects:

[0031] 1. In the present invention, key identification is constructed for users with data access rights, and gestures within the coverage area of the large screen are accurately identified when data is retrieved. While ensuring the security of data retrieval, the accuracy of gesture recognition can be improved according to the key settings of the authorized user, avoiding the recording of multiple gestures within the coverage area of the large screen, resulting in gesture recognition errors or confusion, reducing the accuracy of gesture recognition interaction, and reducing the data scheduling efficiency of the authorized user.

[0032] 2. In the present invention, intelligent matching of retrieval gestures is performed on retrieved data. By determining the retrieval operation corresponding to the retrieved data, the gesture matching of the corresponding operation is performed, so that the authorized end can be assisted in data access and retrieval during the large-screen gesture interaction process, thereby improving the efficiency of data access. It also performs targeted data retrieval operations through gesture recognition, avoiding repeated data loading in the database, reducing the timeliness of data access, and alleviating the continuous occupancy frequency of the data transmission channel in the database, directly promoting the data scheduling and transmission of the database.

[0033] 3. In the present invention, when there is an erroneous operation in the trigger relationship corresponding to the instruction execution point during the real-time gesture recognition stage, interactive intervention is performed to avoid the occurrence of accidental operations that cause the retrieval of corresponding data and lead to data leakage. At the same time, interactive intervention can reduce the risk of data leakage and improve the efficiency of real-time gesture recognition, avoiding the accumulation of multiple instructions in the recognition gesture, resulting in untimely retrieval, which affects the efficiency of data access and retrieval. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] To facilitate understanding by those skilled in the art, the present invention is further described below with reference to the accompanying drawings.

[0035] Figure 1 It is a principle block diagram of the system of the present invention;

[0036] Figure 2 Flowchart of the method of the present invention. DETAILED DESCRIPTION

[0037] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0038] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute a separate or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0039] See also Figure 1-Figure 2 As shown, the large-screen gesture recognition interaction system adapted to the database includes a recognition interaction management platform. It should be explained that this application is adapted to the database. When the database stores data, the data in the database is retrieved through large-screen gesture interaction when data is needed; and this application, as the management center of the interactive system, constructs the logic of each part of the large-screen gesture interaction to ensure the feasibility of the gesture recognition interaction process;

[0040] Among them, the recognition interaction management platform is connected to the key recognition construction unit, the data intelligent matching unit and the gesture recognition control unit;

[0041] The database is connected to the recognition and interaction management platform for two-way communication. When the storage data types of the database are diversified and continuously updated, the recognition and interaction management platform retrieves the data from the database and combines it with gestures.

[0042] The identification interaction management platform generates a key identification construction signal and sends it to the key identification construction unit;

[0043] The key identification and construction unit is used to identify and construct keys for users with data access rights, and accurately identify gestures within the coverage area of the large screen when retrieving data. This ensures the security of data retrieval and can also improve the accuracy of gesture recognition based on the key settings of authorized users, avoiding the recording of multiple gestures within the coverage area of the large screen, resulting in gesture recognition errors or confusion, reducing the accuracy of gesture recognition interaction, and reducing the data scheduling efficiency of authorized users;

[0044] Determine the data stored in the database and the corresponding user with access rights, and mark them as authorized terminals; determine the coverage range of the large screen, make the authorized terminal's hand within the large screen coverage range, and set the palm position within the authorized terminal's hand shape as the identification subject. It should be explained that the palm position of each authorized terminal cannot be moved at will, so the palm position is used as the key extraction position;

[0045] Collect data of the identification subject and set it as the authorization end key data of the current type of data, where the collected data is represented by the data such as the outline of the palm print corresponding to the palm position of the authorization end and the distance between the palm prints;

[0046] After obtaining the authorization end key data, in the usage scenario, the database receives the data retrieval instruction, obtains the authorization end key data of the corresponding data according to the retrieved data, and at the same time, the large screen performs gesture recognition on the access end, and collects the recognition data of the real-time access end; specifically, the recognition data includes the access end's handprint outline, handprint spacing and other data;

[0047] After the access end completes the collection of identification data, the identification interaction management platform compares the identification data with the authorization end key data;

[0048] Perform handprint contour analysis on the identification data and authorization end key data, obtain the boundary of the palm position based on the contour of the palm position, set the same reference point, and when the reference point is used as the orientation center, identify and compare the handprint contours corresponding to the same position. If the overlapping area of the handprint contours is lower than the set area threshold, the current position is marked as a blurred position; if the overlapping area of the handprint contours is higher than the set area threshold, the current position is marked as a clear position;

[0049] The position distribution map is obtained based on the distribution of fuzzy positions and clear positions after data comparison, and the position distribution map is analyzed:

[0050] If the fuzzy positions in the position distribution map are concentrated and single, and the clear positions are continuous and the number of them exceeds the set threshold, the handprint spacing of the clear positions will be identified. If the error of any handprint spacing is within the error range, the current access end will be determined as the authorized end, and the stored data corresponding to the current authorized end key data will be displayed on the large screen;

[0051] If there are fuzzy locations in the location distribution map or the number is not unique, and clear locations are intermittent or the number ratio does not exceed the set ratio threshold, the current access terminal is determined to be an unauthorized terminal and a denial of access instruction is sent to the large screen;

[0052] In the large-screen usage scenario, confirm that the current authorization end key data matches the corresponding data retrieved, then proceed to the next step;

[0053] The data intelligent matching unit is used to intelligently match the retrieval gestures for retrieval of data. By determining the retrieval operation corresponding to the retrieval operation, it matches the corresponding gesture to assist the authorized end in accessing and retrieving data during the large-screen gesture interaction process, thereby improving the efficiency of data access. It also performs targeted data retrieval operations through gesture recognition, avoiding repeated data loading in the database, reducing the timeliness of data access, and alleviating the continuous occupancy frequency of the data transmission channel in the database, directly promoting the data scheduling and transmission of the database;

[0054] After determining the palm position of the authorized end, the finger position of the authorized end is obtained, and the gesture recognition origin is set based on the palm position as the center. Four recognition areas are constructed with the gesture recognition origin and horizontal and vertical cross auxiliary lines. Tags are set according to the access data type, and the data of the set tags corresponds to the four areas. It should be explained that if the number of tags does not reach four, the number can be adjusted, such as setting three areas or two areas.

[0055] A data tag determination instruction is constructed according to the finger position, and the tag determination instruction is a position instruction and a trajectory instruction;

[0056] When the tag determines that the command is a position command, it selects any point of the finger position as the command execution point based on the gesture recognition origin, and the number of finger position points selected is not unique; after the command execution point is determined, the command execution point and the corresponding recognition area are set to a point trigger relationship, and the command execution point and the point trigger relationship are only recorded by the authorized end; the point trigger relationship is represented by the set parameters such as the duration and frequency of the command execution point entering the recognition area;

[0057] When the tag determines that the instruction is a trajectory instruction, a line trigger relationship is set based on the instruction execution point and the corresponding recognition area. The line trigger relationship is represented by the linear trajectory completed by the instruction execution point within the set recognition area or between recognition areas, such as a straight line trajectory, a curved trajectory, or a circular trajectory.

[0058] After confirming the gesture settings corresponding to various types of data stored in the database, use verification is performed; and the position instructions and trajectory instructions as well as the corresponding trigger relationships can be set synchronously, and the latter can also be recognized synchronously or arbitrarily;

[0059] The gesture verification process obtains the real-time finger position and compares it with the instruction execution point and the corresponding trigger relationship stored in the database;

[0060] Based on the gesture recognition origin, the orientation parameters of the real-time finger position and the instruction execution point corresponding to the finger position in the database are obtained, such as the interval coordinate position; and it is determined whether the orientation of the finger position where the real-time instruction execution point is located is consistent with the orientation of the instruction execution point set for the finger position in the database. If they are consistent, it is set as a gesture recognition point, and if they are inconsistent, it is set as a non-gesture recognition point; the judgment criteria for consistency are the orientation interval and the orientation deviation of each contour of the finger position; it should be explained that after determining the non-gesture recognition point, if no action can be performed corresponding to the finger position, the large screen will not recognize it; and if the non-gesture recognition point makes an action corresponding to the trigger relationship of any data in the database, the corresponding stored data will be issued a safety warning;

[0061] After obtaining the gesture recognition point, set a real-time trigger execution period for the gesture recognition point, and record the actions of the gesture recognition point during the execution period. Perform trigger relationship recognition based on the recorded actions. After the trigger relationship recognition is executed, if the corresponding stored data of the recognition area is displayed on the large screen and there is no deviation in the displayed data type, then the current gesture recognition logic is determined to be satisfied; otherwise, the current gesture recognition is determined to be unsatisfactory, and the command execution point is reset or the parameters set in the trigger relationship are reset;

[0062] If the trigger relationship is not recognized and executed, there will be no data operation when retrieving data on the large screen;

[0063] After the recognition and interaction management platform completes the palm position authorization recognition and finger position retrieval recognition, the gesture recognition control unit interactively intervenes in the real-time gesture recognition. When there is an erroneous operation of the command execution point corresponding to the trigger relationship during the real-time gesture recognition stage, interactive intervention is performed to avoid occasional operations that cause the corresponding data to be retrieved, causing data leakage. At the same time, interactive intervention can reduce the risk of data leakage and improve the efficiency of real-time gesture recognition, avoiding the accumulation of multiple commands in the recognition gesture, resulting in untimely retrieval, which affects the efficiency of data access and retrieval;

[0064] After determining the instruction execution point, record the point at which the trigger relationship is executed corresponding to the finger position at the current moment and mark it as the synchronization point. In the instruction execution point trigger relationship identification stage, obtain the deviation time between the real-time instruction execution point and the synchronization point corresponding to the trigger relationship execution period. When the deviation time does not exceed the set deviation threshold, if the trigger relationship of the synchronization point and the instruction execution point is not identified at the same time, and the execution parameters of the unidentified trigger relationship are consistent, it is inferred that there is an identification risk on the current access end, and the instruction execution point is re-identified. At the same time, the corresponding trigger relationship is arbitrarily set, and the trigger relationship type is specified through the large screen. The current execution gesture needs to be executed according to the specified type of trigger relationship. Otherwise, data cannot be retrieved.

[0065] If the trigger relationship of the synchronization point and the instruction execution point is identified at the same time, and the identified trigger relationship execution parameters are consistent, it is inferred that there is an identification risk in the current access terminal, and the data retrieval of the access terminal is set to only browse permissions, and the execution of subsequent trigger relationships is monitored. When the execution parameters of the trigger relationship continue to be consistent, the data access terminal is accessed, and the browsed data is calibrated for leakage. When the current data has not entered the adjacent update cycle, the data is updated in advance, and the data update cycle is reset;

[0066] When the execution process of the real-time trigger relationship between the synchronization point and the instruction execution point is in other situations, no intervention will be made.

[0067] When the present invention is in use, the key identification and construction unit performs key identification and construction for users with data access rights, and accurately identifies gestures within the coverage range of the large screen when retrieving data; after determining that the current authorization end key data is consistent with the corresponding data retrieval, the data intelligent matching unit performs intelligent matching of the retrieval gesture for the retrieved data; after the recognition and interaction management platform completes the authority recognition of the palm position and the retrieval recognition of the finger position, the gesture recognition control unit interactively intervenes in the real-time gesture recognition.

[0068] Thresholds, preset values, and preset ranges are set for comparative analysis of results to determine whether they are good or bad. The values are set based on a combination of large-scale model analysis of sample data and manual experience, and can also be adjusted appropriately based on seasonal or common-sense factors.

[0069] The settings of weight ratio coefficients, influencing factors, etc. are assigned specific values according to the influence of each parameter on the result, which ultimately reflects the impact on the result. They are also set and entered into storage through a combination of large-scale model analysis of sample data and manual experience. Appropriate adjustments can also be made based on seasonal or common-sense influencing conditions.

[0070] The preferred embodiments of the present invention disclosed above are intended only to help illustrate the present invention. These preferred embodiments do not exhaustively describe all details, nor do they limit the present invention to specific embodiments. Obviously, many modifications and variations are possible based on the contents of this specification. These embodiments are selected and described in detail in this specification to better explain the principles and practical applications of the present invention, thereby enabling those skilled in the art to better understand and utilize the present invention. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. A large-screen gesture recognition interaction system adapted to a database, characterized in that: It includes an identification and interaction management platform, which is communicatively connected to a key identification construction unit, a data intelligent matching unit, and a gesture recognition control unit; The key identification and construction unit performs key identification and construction for users with data access rights, and accurately recognizes gestures within the coverage area of the large screen when retrieving data; After determining that the current authorization terminal key data matches the corresponding data retrieved, the data intelligent matching unit performs intelligent matching of the retrieved data with the retrieved gesture; After the recognition interaction management platform completes the permission recognition of the palm position and the call recognition of the finger position, the gesture recognition control unit interactively intervenes in the real-time gesture recognition.

2. The large-screen gesture recognition and interaction system adapted to a database according to claim 1, characterized in that: The process of key identification building block is as follows: Determine the data stored in the database and the corresponding user with access rights, and mark them as authorized terminals; determine the coverage range of the large screen, make the authorized terminal's hand within the large screen coverage range, and set the palm position within the authorized terminal's hand shape as the identification subject; collect data on the identification subject and set it as the authorized terminal key data of the current type of data, where the collected data is represented by the palm position of the authorized terminal corresponding to the palm print outline and palm print spacing; After obtaining the authorization end key data, in the usage scenario, the database receives the data retrieval instruction, obtains the authorization end key data of the corresponding data according to the retrieved data, and at the same time, the large screen performs gesture recognition on the access end and collects the identification data of the real-time access end.

3. The large-screen gesture recognition and interaction system adapted to a database according to claim 2, characterized in that: After the access end completes the collection of identification data, the identification interaction management platform compares the identification data with the authorization end key data; Perform handprint contour analysis on the identification data and authorization end key data, obtain the boundary of the palm position based on the contour of the palm position, set the same reference point, and when the reference point is used as the orientation center, identify and compare the handprint contours corresponding to the same position. If the overlapping area of the handprint contours is lower than the set area threshold, the current position is marked as a blurred position; if the overlapping area of the handprint contours is higher than the set area threshold, the current position is marked as a clear position.

4. The large-screen gesture recognition and interaction system adapted to a database according to claim 3, characterized in that: The position distribution map is obtained based on the distribution of fuzzy positions and clear positions after data comparison, and the position distribution map is analyzed: If the fuzzy positions in the position distribution map are concentrated and single, and the clear positions are continuous and the number of them exceeds the set threshold, the handprint spacing of the clear positions will be identified. If the error of any handprint spacing is within the error range, the current access end will be determined as the authorized end, and the stored data corresponding to the current authorized end key data will be displayed on the large screen; If there are fuzzy locations in the location distribution map or the number is not unique, and the clear locations are intermittent or the number ratio does not exceed the set ratio threshold, the current access end will be determined as an unauthorized end and a denial of access instruction will be sent to the large screen.

5. The large-screen gesture recognition and interaction system adapted to a database according to claim 1, characterized in that: The process of the data intelligent matching unit is as follows: After determining the palm position of the authorized end, the finger position of the authorized end is obtained, and the gesture recognition origin is set based on the palm position as the center. Four recognition areas are constructed using the gesture recognition origin and horizontal and vertical cross-auxiliary lines. Labels are set based on the access data type, and the data set in the labels corresponds to the four areas. A data tag determination instruction is constructed according to the finger position, and the tag determination instruction is a position instruction and a trajectory instruction.

6. The large-screen gesture recognition and interaction system adapted to a database according to claim 5, characterized in that: When the tag determines that the instruction is a position instruction, any point of the finger position is selected as the instruction execution point based on the gesture recognition origin, and the number of points selected for the finger position is not unique; After determining the instruction execution point, the instruction execution point and the corresponding identification area are set to establish a point trigger relationship, and the instruction execution point and the point trigger relationship are only recorded by the authorized end; The point trigger relationship is represented by the duration and frequency of the instruction execution point entering the recognition area; When the tag determines that the instruction is a trajectory instruction, a line trigger relationship is set based on the instruction execution point and the corresponding recognition area. The line trigger relationship is represented by the linear trajectory completed by the instruction execution point within the set recognition area or between recognition areas, specifically a straight line trajectory, curved trajectory, or circular trajectory.

7. The large-screen gesture recognition and interaction system adapted to a database according to claim 6, characterized in that: After determining the gesture settings corresponding to each type of data stored in the database, use verification is performed; the gesture verification process of obtaining the real-time finger position is compared with the instruction execution point stored in the database and the corresponding trigger relationship; Based on the gesture recognition origin, the orientation parameters of the real-time finger position and the instruction execution point corresponding to the finger position in the database are obtained; and it is determined whether the orientation of the finger position where the real-time instruction execution point is located is consistent with the instruction execution point orientation set by the finger position in the database. If they are consistent, it is set as a gesture recognition point; if not, it is set as a non-gesture recognition point.

8. The large-screen gesture recognition and interaction system adapted to a database according to claim 7, characterized in that: After obtaining the gesture recognition point, set the real-time trigger execution period for the gesture recognition point, and record the actions of the gesture recognition point during the execution period. Perform trigger relationship recognition based on the recorded actions. After the trigger relationship recognition is executed, if the corresponding storage data in the recognition area is displayed on the large screen and there is no deviation in the displayed data type, the current gesture recognition logic is set to be satisfied; otherwise, the current gesture recognition is set to be unsatisfactory, and the instruction execution point is reset or the parameters set in the trigger relationship are reset; after the trigger relationship is not recognized and executed, there is no data operation on the current data retrieved by the large screen.

9. The large-screen gesture recognition and interaction system adapted to a database according to claim 1, characterized in that: The process of the gesture recognition control unit is as follows: After determining the instruction execution point, record the point at which the trigger relationship is executed corresponding to the finger position at the current moment and mark it as the synchronization point. During the instruction execution point trigger relationship identification stage, obtain the deviation time between the real-time instruction execution point and the synchronization point corresponding to the trigger relationship execution period. When the deviation time does not exceed the set deviation threshold, if the trigger relationship of the synchronization point and the instruction execution point is not identified at the same time, and the execution parameters of the unidentified trigger relationship are consistent, it is inferred that there is an identification risk at the current access end; if the trigger relationship of the synchronization point and the instruction execution point is identified at the same time, and the identified trigger relationship execution parameters are consistent, it is inferred that there is an identification risk at the current access end.

10. The large-screen gesture recognition and interaction system adapted to a database according to claim 9, characterized in that: When there is an identification risk, the command execution point is re-identified, and the corresponding trigger relationship is arbitrarily set. The trigger relationship type is specified through the large screen, and the current execution gesture needs to be executed according to the specified type of trigger relationship. Otherwise, data cannot be retrieved; When there are hidden dangers to be identified, the data retrieval at the access end is set to browsing permissions only, and the execution of subsequent trigger relationships is monitored. When the execution parameters of the trigger relationship remain consistent, the data access terminal is accessed, and the browsed data is calibrated for leakage. When the current data has not entered the adjacent update cycle, the data is updated in advance and the data update cycle is reset.

Images