Mouse track identification method and device for credential terminal environment

Abstract

The invention relates to the technical field of computers, and provides a mouse track identification method and device for a credential terminal environment. The method comprises the following steps: setting a trigger key and a standard mouse track atlas, and configuring a trigger operation corresponding to the standard mouse track atlas; recording a mouse track in response to a trigger action instruction of the trigger key, and generating a mouse track diagram in response to an end action instruction of the trigger key; matching the generated mouse track diagram with a standard mouse track diagram set, and if a first threshold range is met, triggering a triggering operation corresponding to the matched standard track diagram; if the second threshold value range is met, triggering operations corresponding to the at least two matched standard track diagrams are provided for the user to select, the triggering operations are executed according to the selection result of the user, and if the third threshold value range is met, no triggering operation is carried out. The method is high in universality and practicability, is not limited to operation in a browser, can be used in any global program, is flexible to execute, and can be configured with various complex action combinations.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and device for identifying mouse trajectory in a trusted terminal environment. Background Art

[0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art.

[0003] The Chinese patent with publication number CN101408824A discloses a mouse gesture recognition method, which is based on mouse message events. The relevant messages include click, move and other events. If this method is used in a global environment, a large number of mouse messages and mouse message processing will occupy a large amount of computer CPU computing resources, causing computer delays. The most intuitive manifestation is freeze. When used in a specific program, it limits the general scope of the program and reduces convenience.

[0004] The Chinese patent with publication number CN109491578A discloses a user authentication method based on mouse gestures. The method constructs a user authentication method based on mouse gestures, and encodes the mouse gestures into a multi-digit password consisting of numbers 0 to 7 according to the direction. This algorithm will identify the direction of the gesture graphic and encode it into one of 8 directions, each direction is represented by a number; finally, the mouse gesture is converted into a multi-digit password consisting of numbers 0 to 7, and the password verification operation is performed. If the verification is successful, it is determined that the authentication is successful. In this technology, the movement direction of the mouse is encoded, and only specific directions of 8 angles are supported, and the recognition result is used for user authentication.

[0005] The Chinese patent with publication number CN106845439A discloses a method and device for identifying mouse gestures, including detecting the mouse gestures input by the user through mouse operation, obtaining the mouse gesture image to obtain the image to be identified; preprocessing the image to be identified to obtain the feature vector of the image to be identified; inputting the feature vector into the pre-trained BP neural network to obtain the identified characters, thereby, the advantages of the BP neural network such as distributed storage information, parallel processing information, self-organization, and self-learning information allow the mouse information input by the user to be processed in a timely manner, and a large amount of training also ensures the recognition accuracy. At the same time, it can also be applied to various types of applications, greatly improving the user experience. This technology requires preprocessing the image to be identified, and identifying and storing the feature vector. Although it improves the accuracy of mouse gesture recognition, it also reduces the efficiency of mouse gesture recognition and occupies a large amount of memory.

[0006] The Chinese patent with publication number CN106325702A discloses a method and device for mouse gesture recognition, including: receiving a mouse gesture trigger instruction, collecting the cursor position according to the movement trend of the cursor corresponding to the mouse within a movement cycle, obtaining at least one sampling point, and using the movement trend direction of a sampling point as the cursor's one-time movement direction; converting the movement direction into a corresponding identification code, and generating an identification sequence for all identification codes within the movement cycle; searching for operations corresponding to the identification sequence in the database, and executing the operations. This technology samples by point and generates identification codes. The gestures that can be recognized by this patent are relatively simple, and only support gesture combinations of horizontal and oblique lines; the order and shape of the gestures drawn by the user are relatively high, otherwise it is not easy to recognize, and the user's oblique gestures are prone to misrecognition, and the patent does not explain how to trigger recognition, so it is not very practical. Summary of the invention

[0007] In order to solve the technical problems existing in the above-mentioned background technology, the present invention provides a mouse trajectory recognition method and device for a trusted terminal environment. The present invention has strong versatility and practicality. It is not limited to running in a browser, but can be used in any global program. It can be flexibly executed and can be configured with various complex action combinations. It has a wide range of applications.

[0008] In order to achieve the above object, the present invention adopts the following technical solution:

[0009] The first aspect of the present invention provides a mouse trajectory recognition method in a trusted terminal environment.

[0010] A mouse trajectory recognition method in a trusted terminal environment, comprising:

[0011] Set the trigger key and standard mouse track atlas, and configure the trigger operation corresponding to the standard mouse track atlas;

[0012] In response to a trigger action instruction of a trigger key, a mouse trajectory is recorded, and in response to an end action instruction of the trigger key, a mouse trajectory graph is generated;

[0013] The generated mouse trajectory map is matched with the standard mouse trajectory map set. If the first threshold range is met, the trigger operation corresponding to the matched standard trajectory map is triggered; if the second threshold range is met, the trigger operations corresponding to at least two matched standard trajectory maps are provided for user selection, and the trigger operation is executed according to the user's selection result. If the third threshold range is met, no trigger operation is performed.

[0014] Furthermore, the setting of the trigger key includes: setting the right button or the middle button of the mouse as the trigger key.

[0015] Furthermore, the triggering operation includes: keyboard and mouse operation, clipboard operation, opening a file or program, maximizing, minimizing, and pinning a window, adjusting the volume, adjusting the display brightness, and browser search.

[0016] Furthermore, the method records the mouse trajectory in response to the trigger action instruction of the trigger key, and generates a mouse trajectory diagram in response to the end action instruction of the trigger key; the method includes: recording the initial coordinates of the mouse in response to the trigger action instruction of the trigger key, obtaining the mouse coordinates at each set time interval, calculating the distance between the current coordinates and the previous coordinates, if the distance is less than the set distance, discarding the current coordinates, otherwise storing them in an ordered data linked list, and generating a mouse trajectory diagram of the mouse coordinates and time in response to the end action instruction of the trigger key.

[0017] Furthermore, in the process of setting the trigger key, it also includes: setting a repeat trigger key, after the mouse track diagram is successfully recognized, responding to the repeat trigger key, executing the trigger operation multiple times.

[0018] Furthermore, when the image size of the currently selected object or the generated mouse trajectory map is smaller than the set size, the generated mouse trajectory map is not recognized; if the movement distance of the mouse collected three times before is smaller than the set pixel, the recognition is stopped.

[0019] Furthermore, when the image size of the currently selected object or the generated mouse trajectory graph is smaller than the set size, the generated mouse trajectory graph is not recognized.

[0020] The second aspect of the present invention provides a mouse trajectory recognition device for a trusted terminal environment.

[0021] A mouse track recognition device for a trusted terminal environment, comprising:

[0022] A setting module, which is configured to: set a trigger key and a standard mouse track atlas, and configure a trigger operation corresponding to the standard mouse track atlas;

[0023] A trajectory map generating module is configured to: record the mouse trajectory in response to a trigger action instruction of a trigger key, and generate a mouse trajectory map in response to an end action instruction of the trigger key;

[0024] A trigger judgment module is configured to: match the generated mouse trajectory map with the standard mouse trajectory map set; if the first threshold range is met, trigger the trigger operation corresponding to the matched standard trajectory map; if the second threshold range is met, provide the trigger operations corresponding to at least two matched standard trajectory maps for the user to select, and execute the trigger operation according to the user's selection result; if the third threshold range is met, no trigger operation is performed.

[0025] A third aspect of the present invention provides a computer-readable storage medium.

[0026] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the mouse trajectory recognition method in a trusted terminal environment as described in the first aspect above.

[0027] A fourth aspect of the present invention provides a computer device.

[0028] A computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the steps in the mouse trajectory recognition method in the trusted terminal environment as described in the first aspect above are implemented.

[0029] A fifth aspect of the present invention provides a computer program product or a computer program.

[0030] The present invention provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the steps in the mouse trajectory recognition method of the ICT terminal environment as described in the first aspect above.

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] The present invention is no longer based on mouse message events, thus avoiding real-time massive mouse message event processing, and utilizing mature image recognition algorithms to modularly implement mouse trajectory recognition. The later image recognition algorithms can be trained and upgraded separately, and the recognition efficiency can be improved through GPU calculations, thus reducing the occupancy of the central processing unit, thereby ensuring smooth operation and minimizing the impact on the computer.

[0033] The present invention does not require direction encoding, pre-calculation and pre-processing, and will not operate the canvas, create layered transparent windows, or draw mouse tracks. The present invention is based on the Xinchuang operating system and directly identifies the mouse tracks stored in the memory. It does not rely on any new external devices and does not require improving computer configuration. The implementation cost is low and the response speed is fast.

[0034] The present invention can call multiple configurable shortcut functions after the mouse trajectory graph is recognized, thereby improving the convenience of operation. It can run any program, operate the clipboard, read and write files, modify computer configuration, simulate keystrokes, simulate mouse operations, operate Excel, Word and almost all other computer operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0036] Figure 1 is a flow chart of mouse track configuration shown in the present invention;

[0037] Figure 2 It is a flow chart of mouse trajectory diagram recognition shown in the present invention;

[0038] Figure 3 It is a flow chart of the mouse trajectory recognition method in the trusted terminal environment shown in the present invention. DETAILED DESCRIPTION

[0039] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0040] It should be noted that the following detailed descriptions are all illustrative and intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs.

[0041] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit exemplary embodiments according to the present invention. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "comprising" and / or "including" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or combinations thereof.

[0042] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the methods and systems according to various embodiments of the present disclosure. It should be noted that each box in the flowchart or block diagram can represent a module, a program segment, or a part of a code, and the module, program segment, or a part of a code may include one or more executable instructions for implementing the logical functions specified in each embodiment. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, or they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the flowchart and / or block diagram, and the combination of boxes in the flowchart and / or block diagram can be implemented using a dedicated hardware-based system that performs a specified function or operation, or can be implemented using a combination of dedicated hardware and computer instructions.

[0043] Embodiment 1

[0044] like Figure 1 As shown, this embodiment provides a mouse trajectory recognition method for a trusted terminal environment. This embodiment uses the method applied to a server as an example. It can be understood that the method can also be applied to a terminal, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network servers, cloud communications, middleware services, domain name services, security services CDN, and big data and artificial intelligence platforms. The terminal can be a smart phone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, etc., but is not limited to this. The terminal and the server can be directly or indirectly connected via wired or wireless communication, which is not limited in this application. In this embodiment, the method includes the following steps:

[0045] Set the trigger key and standard mouse track atlas, and configure the trigger operation corresponding to the standard mouse track atlas;

[0046] In response to a trigger action instruction of a trigger key, a mouse trajectory is recorded, and in response to an end action instruction of the trigger key, a mouse trajectory graph is generated;

[0047] The generated mouse trajectory map is matched with the standard mouse trajectory map set. If the first threshold range is met, the trigger operation corresponding to the matched standard trajectory map is triggered; if the second threshold range is met, the trigger operations corresponding to at least two matched standard trajectory maps are provided for user selection, and the trigger operation is executed according to the user's selection result. If the third threshold range is met, no trigger operation is performed.

[0048] The present invention is started by a set mouse trigger key, such as the middle mouse button, right mouse button, side mouse button, etc. After pressing the trigger key, the mouse trajectory begins to be recorded immediately. After releasing it, the action to be performed can be performed according to the different movement trajectories. When the trigger key is not activated, the mouse trajectory will not be recorded and recognized, and the normal operation efficiency of the computer will not be affected. The desktop canvas will not be started, and it will not be determined whether the mouse trajectory recognition is in an activated state. The running speed is fast, it does not occupy too much system resources, and the user experience is good.

[0049] The core functions of the present invention are divided into two parts: mouse track configuration and mouse track map recognition.

[0050] In some embodiments, Figure 1 As shown, the process of mouse track configuration includes:

[0051] First, set the trigger button. You can choose the right button, middle button, X1 button, X2 button, etc. Press the trigger button to start recording the mouse trajectory. Release the trigger button to end the recording. Because the trigger key is a global trigger, the trigger key is generally not a common key. It is recommended to use the multi-function button on the side of the mouse.

[0052] Secondly, set the matching degree, which is related to trajectory recognition. The threshold range of matching degree is set to 80%-99 ％ , the higher the matching degree, the less likely it is to be triggered.

[0053] You can set a repeat trigger key again. After the mouse track is successfully recognized, press the repeat trigger key to perform the operation multiple times.

[0054] The present invention can be used in conjunction with a keyboard case through mouse gestures, such as the repeat trigger key mentioned above, and the combined use function is more powerful.

[0055] Again, regarding the mouse trajectory map setting, for the convenience of setting, the system presets the more commonly used mouse trajectory maps, such as C, S, N, P, V, etc., and you can also manually draw a personalized trajectory map, which is not limited to the present invention.

[0056] Finally, set the trigger action. The triggerable actions include keyboard and mouse operations, clipboard operations, opening files or programs, and other common functions, such as maximizing, minimizing, pinning, adjusting volume, adjusting display brightness, browser search, etc. The present invention is not limited here.

[0057] The present invention records the mouse position change trajectory into the memory through the background program, does not operate the canvas, create a layered transparent window, and draw the mouse trajectory, and can allocate more time and computing power to the background for identification, with faster response and more concise and efficient operation process. At the same time, the present invention is not only a control method suitable for browsers, but can be started in any program or window, with a wider range of applications and more convenient and practical.

[0058] In some embodiments, Figure 2 As shown in FIG. 1 , the process of mouse trajectory map recognition includes:

[0059] The first step is to press the trigger key according to the configured mouse trigger key to start recording the mouse trajectory. The mouse coordinates are obtained every 100 milliseconds (the acquisition interval can be adjusted if the computer configuration is low), and the distance between the current coordinate and the previous coordinate is calculated. If the distance is too short, it is discarded, otherwise it is stored in an ordered data linked list until the trigger key is released to end the acquisition. Using the coordinates in the data linked list as parameters, a Bezier curve or sampling curve graph of the coordinates and time is drawn as the mouse trajectory graph.

[0060] The present invention adopts a method of generating a Bezier curve or a sampling curve graph, which can make the generated trajectory graph smoother and facilitate later identification.

[0061] The second step is to send the trajectory map to the image recognition module, match the trajectory map with the system preset trajectory map, calculate the matching degree, and determine whether to trigger the action based on the matching degree setting and trigger setting.

[0062] In some embodiments, in order to avoid the problem of misoperation, the present invention also provides the following solutions:

[0063] The first is the application scenario, that is, the currently running program. You can set which programs are allowed to run, and only start them in the allowed scenarios, and under what circumstances they will not start, for example:

[0064] (1) Depending on whether there is a currently selected object, such as a document or folder, it will not be started;

[0065] (2) If the mouse movement distance collected in the first three times is less than 10 pixels, stop the recognition;

[0066] (3) The image size drawn according to the final mouse track, if the size is too small, such as less than 50 pixels in height, recognition is not started;

[0067] Since each person may have a certain difference in the trajectory of the same instruction when operating the mouse to draw the mouse trajectory, the present invention provides a characteristic fuzzy recognition, that is, when the second threshold range is set, the matching degree is less than 80%, and there are at least two system configuration trajectory diagrams with a matching degree exceeding 60%, an option can be provided for the user to select the instruction corresponding to the expected gesture. If it is less than 60%, that is, the third threshold range is met, no trigger operation is performed.

[0068] like Figure 3 As shown, the present invention can set the right mouse button and the middle button (note that the left mouse button cannot be set, because setting the left button will overlap with most system operations) by setting the mouse track action, and set the expected actions, such as opening software, simulating keystrokes, mouse clicks and other operations; monitor according to the set mouse action button, start monitoring the mouse track after the button is pressed, and draw according to the mouse track, and end the monitoring when the button is released. Identify the graphics drawn according to the mouse track, and if the expected mouse track action is matched, the corresponding operation is executed immediately. It integrates the mouse signal processing, advanced image recognition algorithm and dynamic response logic of the user interface in the Xinchuang operating system, aiming to improve the convenience of operation and system security, and realize the intelligent and rapid activation of preset functions by analyzing the user's mouse movement trajectory.

[0069] The present invention improves the convenience of system operation, and can conveniently and quickly perform some specific operations in any program. For example, when reading a document, if you encounter something you don't understand, you can open a browser and search for the selected text through a mouse track action. This series of operations can be triggered by a mouse track, making the computer more suitable for personal operating habits and improving work efficiency. The present invention does not adopt the existing mouse message analysis and processing method, which will greatly occupy system resources, affect the normal operation of the computer, and have a poor operating experience.

[0070] The present invention can continuously improve the deep learning trajectory matching algorithm. The matching calculation is completed on the server, which does not occupy the user's computer resources and is convenient for later improvement of the matching algorithm.

[0071] The present invention runs the computer program corresponding to the mouse trajectory recognition method of the above-mentioned trusted terminal environment on the i-mate client, and then the functions of the present invention can be obtained. The i-mate client is an office automation software that integrates multiple functions in an open manner, such as image recognition, AI writing, multi-platform integrated login, etc. Mouse trajectory recognition is one of the functions. Together with other functions of the software, it simplifies office operations and improves work efficiency by automatically executing in batches.

[0072] Embodiment 2

[0073] This embodiment provides a mouse trajectory recognition device for a trusted terminal environment.

[0074] A mouse track recognition device for a trusted terminal environment, comprising:

[0075] A setting module, which is configured to: set a trigger key and a standard mouse track atlas, and configure a trigger operation corresponding to the standard mouse track atlas;

[0076] A trajectory map generating module is configured to: record the mouse trajectory in response to a trigger action instruction of a trigger key, and generate a mouse trajectory map in response to an end action instruction of the trigger key;

[0077] A trigger judgment module is configured to: match the generated mouse trajectory map with the standard mouse trajectory map set; if the first threshold range is met, trigger the trigger operation corresponding to the matched standard trajectory map; if the second threshold range is met, provide the trigger operations corresponding to at least two matched standard trajectory maps for the user to select, and execute the trigger operation according to the user's selection result; if the third threshold range is met, no trigger operation is performed.

[0078] In some embodiments, setting the trigger key includes: setting the right button or the middle button of the mouse as the trigger key.

[0079] In some embodiments, the triggering operation includes: keyboard and mouse operation, clipboard operation, opening a file or program, maximizing, minimizing, pinning a window, adjusting the volume, adjusting the display brightness, and browser search.

[0080] In some embodiments, the trajectory map generation module is specifically configured to: respond to the trigger action instruction of the trigger key, record the initial coordinates of the mouse, obtain the mouse coordinates at each set time interval, calculate the distance between the current coordinates and the previous coordinates, if the distance is less than the set distance, discard the current coordinates, otherwise store them in an ordered data linked list, and respond to the end action instruction of the trigger key to generate a mouse trajectory map of the mouse coordinates and time.

[0081] In some embodiments, the setting module is further configured to: set a repeat trigger key, and after the mouse trajectory graph is successfully recognized, respond to the repeat trigger key to perform the trigger operation multiple times.

[0082] In some embodiments, when the image size of the currently selected object or the generated mouse trajectory map is smaller than the set size, the generated mouse trajectory map is not recognized; if the movement distance of the mouse collected three times before is smaller than the set pixel, the recognition is stopped.

[0083] Embodiment 3

[0084] This embodiment provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the mouse trajectory recognition method in the trusted terminal environment as described in the above-mentioned embodiment 1 are implemented.

[0085] Embodiment 4

[0086] This embodiment provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the steps in the mouse trajectory recognition method in the trusted terminal environment as described in the first embodiment above are implemented.

[0087] Embodiment 5

[0088] This embodiment provides a computer program product or a computer program, which includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the steps in the mouse trajectory recognition method of the credible terminal environment described in the first embodiment.

[0089] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of hardware embodiments, software embodiments, or embodiments combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.

[0090] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0091] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0092] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0093] A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0094] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A mouse trajectory recognition method in a trusted terminal environment, characterized in that: include: Set the trigger key and standard mouse track atlas, and configure the trigger operation corresponding to the standard mouse track atlas; In response to a trigger action instruction of a trigger key, a mouse trajectory is recorded, and in response to an end action instruction of the trigger key, a mouse trajectory graph is generated; The generated mouse trajectory map is matched with the standard mouse trajectory map set. If the first threshold range is met, the trigger operation corresponding to the matched standard trajectory map is triggered; if the second threshold range is met, the trigger operations corresponding to at least two matched standard trajectory maps are provided for user selection, and the trigger operation is executed according to the user's selection result. If the third threshold range is met, no trigger operation is performed.

2. According to the mouse trajectory recognition method of the credible terminal environment of claim 1, it is characterized in that: The trigger key setting includes: setting the right button or the middle button of the mouse as the trigger key.

3. According to the mouse trajectory recognition method of the credible terminal environment of claim 1, it is characterized in that: The triggering operation includes: keyboard and mouse operation, clipboard operation, opening a file or program, maximizing, minimizing, pinning a window, adjusting the volume, adjusting the display brightness, and browser search.

4. According to the mouse trajectory recognition method of the credible terminal environment of claim 1, it is characterized in that: The method records the mouse trajectory in response to the trigger action instruction of the trigger key, and generates a mouse trajectory diagram in response to the end action instruction of the trigger key; the method includes: recording the initial coordinates of the mouse in response to the trigger action instruction of the trigger key, obtaining the mouse coordinates at each set time interval, calculating the distance between the current coordinates and the previous coordinates, if the distance is less than the set distance, discarding the current coordinates, otherwise storing them in an ordered data linked list, and generating a mouse trajectory diagram of the mouse coordinates and time in response to the end action instruction of the trigger key.

5. According to the mouse trajectory recognition method of the credible terminal environment of claim 1, it is characterized in that: The process of setting the trigger key also includes: setting a repeat trigger key, and after the mouse track image is successfully recognized, responding to the repeat trigger key, executing the trigger operation multiple times.

6. The mouse trajectory recognition method in the credible terminal environment according to claim 1 is characterized in that: When there is currently a selected object or the image size of the generated mouse trajectory map is smaller than the set size, the generated mouse trajectory map will not be recognized; if the mouse movement distance collected three times before is less than the set pixel, the recognition will be stopped.

7. A mouse trajectory recognition device for a trusted terminal environment, characterized in that: include: A setting module, which is configured to: set a trigger key and a standard mouse track atlas, and configure a trigger operation corresponding to the standard mouse track atlas; A trajectory map generating module is configured to: record the mouse trajectory in response to a trigger action instruction of a trigger key, and generate a mouse trajectory map in response to an end action instruction of the trigger key; A trigger judgment module is configured to: match the generated mouse trajectory map with the standard mouse trajectory map set; if the first threshold range is met, trigger the trigger operation corresponding to the matched standard trajectory map; if the second threshold range is met, provide the trigger operations corresponding to at least two matched standard trajectory maps for the user to select, and execute the trigger operation according to the user's selection result; if the third threshold range is met, no trigger operation is performed.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, it implements the steps in the mouse trajectory recognition method of the trusted terminal environment as described in any one of claims 1-6.

9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, it implements the steps in the mouse trajectory recognition method of the trusted terminal environment as described in any one of claims 1-6.

10. A computer program product, characterized in that The computer program product includes a computer program, and when the computer program is executed by a processor, it implements the steps in the mouse trajectory recognition method of the trusted terminal environment as described in any one of claims 1-6.

Images