Gesture-based system control method, apparatus and device, and computer readable medium

Abstract

The invention relates to a system control method, device and equipment based on gestures and a computer readable medium. The method comprises the following steps: when a sliding gesture operation is monitored, obtaining a sliding track of a sliding gesture; gesture recognition is carried out on the sliding track so as to match a target gesture corresponding to the sliding gesture, and the target gesture is a trigger gesture set for a target system in advance; and under the condition that the current interface is not the interface of the target system, responding to a jump instruction triggered by the target gesture, and jumping to the target system. According to the method, different gestures are set for different systems, a user can draw a certain gesture on a display screen on any interface, the system carries out gesture recognition on the sliding track, then the system which the user wants to open is matched, and then the interface of the system can be immediately skipped to, so that the user operation is more convenient, the system response is more efficient, and the user experience is improved. The technical problem that system operation is tedious day by day is solved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a gesture-based system control method, device, equipment, and computer-readable medium. Background Art

[0002] As games develop and update, the number and types of game systems are also increasing, such as characters, backpacks, stores, tasks, leaderboards, chats, settings, etc. These systems provide players with rich functions and choices, increasing the fun and appeal of the game. However, the space on the game interface is limited and cannot accommodate all system icons. Therefore, some systems have to be hidden in menus or submenus, or represented by smaller icons. In this way, if players want to open a certain system, they need to perform multiple operations, such as clicking on the menu, sliding the screen, selecting a submenu, etc. These operations not only consume time and energy, but also affect the smoothness and aesthetics of the game.

[0003] There is currently no effective solution to the problem of increasingly complicated system operations. Summary of the invention

[0004] The present application provides a gesture-based system control method, device, equipment and computer-readable medium to solve the technical problem of increasingly complicated system operations.

[0005] According to one aspect of an embodiment of the present application, the present application provides a gesture-based system control method, including: when a sliding gesture operation is detected, obtaining a sliding trajectory of the sliding gesture; performing gesture recognition on the sliding trajectory to match a target gesture corresponding to the sliding gesture, wherein the target gesture is a trigger gesture pre-set for a target system; when the current interface is not the interface of the target system, responding to a jump instruction triggered by the target gesture to jump to the target system.

[0006] Optionally, performing gesture recognition on the sliding trajectory to match a target gesture corresponding to the sliding gesture includes: segmenting the sliding trajectory according to a preset segmentation length to obtain multiple sub-trajectories; extracting feature points of each sub-trajectory, and combining the feature points of all the sub-trajectories into a feature vector of the entire sliding trajectory according to the segmentation order of the sub-trajectories; calculating the similarity between the feature vector and preset vectors of multiple preset gestures; and determining the preset gesture corresponding to the preset vector having the largest value of the similarity with the feature vector as the target gesture matching the sliding gesture.

[0007] Optionally, the extracting of feature points of each section of the sub-trajectory and combining the feature points of all the sub-trajectories into a feature vector of the entire sliding trajectory in the order of segmentation of the sub-trajectories includes: identifying and extracting the starting point, inflection point and end point of each section of the sub-trajectory as the feature points; combining the feature points of each section of the sub-trajectory in the order from the starting point to the inflection point to the end point to obtain the sub-vectors of each sub-trajectory; and combining all the sub-vectors in the order of segmentation of the sub-trajectories to obtain the feature vector of the entire sliding trajectory.

[0008] Optionally, before obtaining the sliding trajectory of the sliding gesture, the method also includes judging that the received touch screen operation is the sliding gesture in the following manner: monitoring changes in touch points on the display screen; and judging that the touch screen operation is the sliding gesture when the changes in the touch points meet preset conditions.

[0009] Optionally, monitoring the changes of touch points on the display screen includes monitoring at least one of the contact position, contact time and contact speed of the touch points, and when the changes of the touch points meet a preset condition, judging that the touch screen operation is the sliding gesture includes at least one of the following: calculating the touch point movement distance according to the received contact positions of each touch point of the display screen, and determining that the touch screen operation is the sliding gesture when the touch point movement distance is greater than or equal to the minimum sliding distance; calculating the touch point movement time according to the received first contact time when the display screen is contacted and the second contact time when the contact ends, and determining that the touch screen operation is the sliding gesture when the touch point movement time is less than or equal to the maximum sliding time; determining that the touch screen operation is the sliding gesture when the contact speed is greater than or equal to the minimum sliding speed.

[0010] Optionally, the jump instruction triggered in response to the target gesture, jumping to the target system includes: obtaining the system icon of the target system and a preset animation associated with the target gesture; generating and displaying the preset animation at the end point of the sliding trajectory of the sliding gesture, and controlling the preset animation to move in the opposite direction of the sliding trajectory; popping up the system icon at the end point of the sliding trajectory of the sliding gesture, and controlling the system icon to move in the opposite direction of the sliding trajectory; when the preset animation and the system icon both reach the starting point of the sliding trajectory of the sliding gesture, opening and displaying the target system.

[0011] Optionally, before matching the target gesture corresponding to the sliding gesture, the method also includes setting a preset gesture in the following manner: according to a received preset gesture selected in a gesture list and a preset system selected in a system list, associating the preset gesture with the preset system to use the preset gesture as a trigger gesture for the preset system; or, according to a received custom gesture input in a gesture editor and the preset system selected in the system list, associating the custom gesture with the preset system to use the custom gesture as a trigger gesture for the preset system.

[0012] According to another aspect of an embodiment of the present application, the present application provides a gesture-based system control device, including: a trajectory acquisition module, used to acquire the sliding trajectory of the sliding gesture when a sliding gesture operation is detected; a gesture matching module, used to perform gesture recognition on the sliding trajectory to match a target gesture corresponding to the sliding gesture, wherein the target gesture is a trigger gesture pre-set for the target system; a jump module, used to respond to the jump instruction triggered by the target gesture and jump to the target system when the current interface is not the interface of the target system.

[0013] According to another aspect of an embodiment of the present application, the present application provides an electronic device, including a memory, a processor, a communication interface and a communication bus, wherein the memory stores a computer program that can be run on the processor, the memory and the processor communicate through the communication bus and the communication interface, and the steps of the above method are implemented when the processor executes the computer program.

[0014] According to another aspect of an embodiment of the present application, the present application also provides a computer-readable medium having a non-volatile program code executable by a processor, and the program code enables the processor to execute the above method.

[0015] The above technical solution provided by the embodiment of the present application has the following advantages compared with the related art:

[0016] The present application provides a gesture-based system control method, including: when a sliding gesture operation is detected, obtaining the sliding trajectory of the sliding gesture; performing gesture recognition on the sliding trajectory to match the target gesture corresponding to the sliding gesture, wherein the target gesture is a trigger gesture pre-set for the target system; when the current interface is not the interface of the target system, responding to the jump instruction triggered by the target gesture, jumping to the target system. The present application sets different gestures for different systems, so that the user can make a certain gesture on the display screen in any interface. The system can perform gesture recognition on the sliding trajectory and then match it to the system the user wants to open, and then jump to the interface of the system immediately. The user operation is more convenient, the system response is more efficient, and the technical problem of increasingly cumbersome system operation is solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0019] Figure 1 A schematic diagram of a hardware environment of an optional gesture-based system control method provided according to an embodiment of the present application;

[0020] Figure 2 A schematic flow chart of an optional gesture-based system control method provided according to an embodiment of the present application;

[0021] Figure 3 This is a schematic diagram of an optional gesture preset provided according to an embodiment of the present application;

[0022] Figure 4 A block diagram of an optional gesture-based system control device provided according to an embodiment of the present application;

[0023] Figure 5 A schematic diagram of an optional electronic device structure provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0025] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application and have no specific meaning. Therefore, "module" and "component" can be used interchangeably.

[0026] In order to solve the problem mentioned in the background technology, according to one aspect of the embodiments of the present application, an embodiment of a gesture-based system control method is provided.

[0027] Optionally, in the embodiment of the present application, the above-mentioned gesture-based system control method can be applied to Figure 1 In the hardware environment composed of the terminal 101 and the server 103 shown in FIG. Figure 1 As shown, the server 103 is connected to the terminal 101 via a network, and can be used to provide services (such as game services) for the terminal or a client installed on the terminal. A database 105 can be set on the server or independently of the server to provide data storage services for the server 103. The above-mentioned network includes but is not limited to: a wide area network, a metropolitan area network or a local area network, and the terminal 101 includes but is not limited to a PC, a mobile phone, a tablet computer, etc.

[0028] A gesture-based system control method in the embodiment of the present application can be executed by either the terminal 101 or the server 103, or can be executed by the server 103 and the terminal 101 together, such as Figure 2 As shown, the method may include the following steps:

[0029] Step S202, when a sliding gesture operation is detected, obtaining a sliding track of the sliding gesture;

[0030] Step S204, performing gesture recognition on the sliding trajectory to match a target gesture corresponding to the sliding gesture, wherein the target gesture is a trigger gesture pre-set for a target system;

[0031] Step S206, when the current interface is not the interface of the target system, respond to the jump instruction triggered by the target gesture and jump to the target system.

[0032] Through the above steps S202 to S206, the present application sets different gestures for different systems. The user can make certain gestures on the display screen in any interface. The system recognizes the gestures of the sliding trajectory and then matches the system the user wants to open. The user can immediately jump to the interface of the system. The user operation is more convenient and the system response is more efficient, which solves the technical problem of increasingly cumbersome system operation.

[0033] In step S202, when a sliding gesture operation is detected, the sliding track of the sliding gesture is obtained, wherein the present application determines whether the user operation is a sliding gesture based on monitoring touch events, that is, by monitoring the changes in the user's touch points on the touch screen to determine whether the user's touch point operation is a sliding gesture, and when it is determined that the user operation is a sliding gesture, the sliding track of the sliding gesture can be obtained based on the monitored touch events. This is explained below.

[0034] As an optional embodiment, before obtaining the sliding trajectory of the sliding gesture, the method also includes judging that the received touch screen operation is the sliding gesture in the following manner: monitoring the changes of the touch points on the display screen; and judging that the touch screen operation is the sliding gesture when the changes of the touch points meet preset conditions.

[0035] In the embodiment of the present application, the system monitors the touch event, that is, detects the change of the touch point on the display screen, and determines whether the user is performing a normal operation, such as tapping, long pressing, simple sliding, etc., or inputting a sliding gesture. A touch event refers to an event generated when a user performs a touch operation on a touch screen. On a mobile device or a touch screen, there are usually the following types of touch events: Press event (ACTION_DOWN): When the user touches the screen, a press event is triggered. The starting position can be recorded by obtaining information such as the coordinates of the touch point. Move event (ACTION_MOVE): When the user presses the finger and moves on the screen, a move event is triggered. The user's finger movement trajectory can be tracked by monitoring these events and obtaining the coordinate changes of the touch point. Lift event (ACTION_UP): When the user lifts his finger, a lift event is triggered. The trajectory recording can be ended or processed accordingly by monitoring this event. Cancel event (ACTION_CANCEL): In some cases, the touch event may be canceled, such as when an unexpected system event or other interference occurs during the touch process. This situation can be handled by monitoring the cancel event. By monitoring touch events, you can learn about changes in the touch points on the display screen, and then determine whether the user operation is a normal operation or a sliding gesture.

[0036] In the embodiment of the present application, by monitoring the touch event, the change of the touch point on the display screen that can be obtained includes but is not limited to the touch point position, touch time and touch speed of the touch point. Based on the above information, it is necessary to determine whether the user operation belongs to a normal operation or a sliding gesture, and whether the determination is accurate is related to the user experience. Therefore, the present application provides several recognition thresholds for sliding gestures, including a minimum sliding distance, a maximum sliding time and a minimum sliding speed. Based on this, when the change of the touch point meets the preset conditions, judging that the touch screen operation is the sliding gesture includes at least one of the following: calculating the touch point moving distance according to the received touch point positions of each touch point of the display screen, and determining that the touch screen operation is the sliding gesture when the touch point moving distance is greater than or equal to the minimum sliding distance; calculating the touch point moving time according to the received first contact time of the display screen being touched and the second contact time when the contact ends, and determining that the touch screen operation is the sliding gesture when the touch point moving time is less than or equal to the maximum sliding time; determining that the touch screen operation is the sliding gesture when the contact speed is greater than or equal to the minimum sliding speed.

[0037] In the first judgment method, the touch point positions of each touch point are multiple positions of the user during the period of touching the screen, not the starting position and the ending position. The sliding distance is calculated by connecting each touch point position in sequence starting from the first touch point position and then calculating the distance of each segment. Finally, the sum of the distances of each segment is the sliding distance of the user's sliding this time. The more divided touch point positions are, the more accurate the calculation of the sliding distance is.

[0038] In the second determination method, the touch point movement time is calculated as the time from when the user touches the screen to when the user leaves the screen.

[0039] In the third judgment method, the touch point speed needs to be determined based on the moving distance, moving time and moving direction of the touch point. The touch point speed is an instantaneous speed, that is, the instantaneous speed at a specific moment. Therefore, if you need to obtain continuous touch point speed, you can use a series of touch events to calculate the speed at each time point, and process and smooth it according to actual needs.

[0040] In the embodiment of the present application, the above-mentioned minimum sliding distance, maximum sliding time and minimum sliding speed can be set according to the actual situation or actual needs of the preset gesture.

[0041] In the embodiment of the present application, the above three methods can be used individually, in combination, or all together. Correspondingly, when all are used together, the accuracy of judging the sliding gesture reaches the highest.

[0042] When it is determined that the user operation belongs to a sliding gesture, the sliding trajectory of the sliding gesture can be obtained based on the monitored touch event. The process of obtaining the sliding trajectory of the sliding gesture is as follows: Listening for touch events: By registering a listener for touch events on the interface of the application, the user's finger touch action can be captured. Recording the starting position: When the user presses the finger, the coordinates at the time of pressing are recorded as the starting position. Listening for finger movement: After the user presses the finger, when the finger moves on the screen, continue to monitor and record the current position of the finger on the screen. Connecting trajectory points: According to the path of the finger movement, each trajectory point is connected to form a sliding trajectory. Processing the sliding trajectory: The sliding trajectory can be processed as needed, such as drawing it on the canvas, calculating the sliding distance or angle, etc. Ending sliding monitoring: When the finger is lifted, the sliding monitoring is ended and the trajectory recording stops. Through the above steps, the sliding trajectory of the sliding gesture can be obtained.

[0043] In step S204, gesture recognition is performed on the sliding trajectory to match the target gesture corresponding to the sliding gesture, wherein the present application establishes a gesture library in advance, and the gesture library stores the preset gestures that come with the system, and can also store the preset gestures that the user customizes himself. Each gesture stored in the gesture library has its own unique characteristics, which are expressed as feature vectors, which are obtained based on the recognition and combination of the feature points of each gesture. When the sliding trajectory is obtained, gesture recognition can be performed on the sliding trajectory. The purpose of gesture recognition is to extract the feature points of the sliding trajectory. The process of matching gestures is to combine the feature points of the sliding trajectory to obtain the feature vector of the sliding trajectory, and then compare the feature vector with the feature vectors of each preset gesture in the gesture library. The one with the highest similarity is the most matching target gesture. The following is an explanation of this process starting from the preset gestures.

[0044] As an optional embodiment, before matching the target gesture corresponding to the sliding gesture, the method also includes setting a preset gesture in the following manner: according to a received preset gesture selected in a gesture list and a preset system selected in a system list, the preset gesture is associated with the preset system to use the preset gesture as a trigger gesture for the preset system; or, according to a received custom gesture input in a gesture editor and the preset system selected in the system list, the custom gesture is associated with the preset system to use the custom gesture as a trigger gesture for the preset system.

[0045] In the present application embodiment, Figure 3As shown, in the "Quick Gesture Settings" column, multiple preset gestures that come with the system are displayed, and a drop-down selection box of the system list is displayed next to each preset gesture. The user can select a system in the drop-down selection box of the system list to associate with the current preset gesture. The drop-down selection box of the gesture list can also be placed in the position where the preset gestures are displayed in the "Quick Gesture Settings" column. Then the user can also select the desired preset gesture in the drop-down selection box of the gesture list, and then select a system in the drop-down selection box of the system list to associate with the current preset gesture. In the "Custom Gesture" column, multiple gesture editors are displayed. The user can set the gesture he wants in the gesture editor, and then associate it with the preset system, so that the custom gesture can be used as the trigger gesture of the preset system. The gesture can be a trajectory of any shape, such as a circle, triangle, number, letter, etc.

[0046] As an optional embodiment, the gesture recognition of the sliding trajectory to match the target gesture corresponding to the sliding gesture includes: dividing the sliding trajectory according to a preset segmentation length to obtain multiple sub-trajectories; extracting feature points of each sub-trajectory, and combining the feature points of all the sub-trajectories into a feature vector of the entire sliding trajectory according to the segmentation order of the sub-trajectories; calculating the similarity between the feature vector and preset vectors of multiple preset gestures; and determining the preset gesture corresponding to the preset vector having the largest value of the similarity with the feature vector as the target gesture matching the sliding gesture.

[0047] In order to improve the accuracy and efficiency of gesture recognition, this application adopts a gesture recognition algorithm based on feature points. The algorithm first divides the sliding trajectory into several segments and extracts the feature points of each segment. Then, the feature points are combined into a feature vector, and compared with the feature vectors of the preset gestures in the gesture library to calculate the similarity. Finally, according to the size of the similarity, the best matching gesture is selected as the recognition result. Among them, the trajectory segmentation stage can determine the segmentation points according to the nature and characteristics of the gesture, such as speed changes, acceleration changes or direction changes. The selection of feature points in the feature point extraction stage can be determined according to the shape and action of the gesture. The feature points may include the starting point, end point, inflection point, curvature extreme point, etc. In the feature vector generation stage, some feature descriptor methods can be used, such as encoding the coordinates and other attributes (such as speed, acceleration) of the feature points. The similarity calculation stage can use cosine similarity, Euclidean distance and other calculation methods.

[0048] As an optional embodiment, the above-mentioned extraction of feature points of each section of the sub-trajectory and combining the feature points of all the sub-trajectories into a feature vector of the entire sliding trajectory in the order of segmentation of the sub-trajectories includes: identifying and extracting the starting point, inflection point and end point of each section of the sub-trajectory as the feature points; combining the feature points of each section of the sub-trajectory in the order from the starting point to the inflection point to the end point to obtain the sub-vectors of each sub-trajectory; combining all the sub-vectors in the order of segmentation of the sub-trajectory to obtain the feature vector of the entire sliding trajectory.

[0049] In the embodiment of the present application, a feature vector of each sub-trajectory, that is, a sub-vector, may be generated first, and then all the sub-vectors may be combined according to the segmentation order of the sub-trajectory to obtain the feature vector of the entire sliding trajectory.

[0050] In step S206, when the current interface is not the interface of the target system, the jump to the target system is responded to the jump instruction triggered by the target gesture, wherein the jump to the target system in response to the jump instruction triggered by the target gesture includes: obtaining the system icon of the target system and the preset animation associated with the target gesture; generating and displaying the preset animation at the end point of the sliding trajectory of the sliding gesture, and controlling the preset animation to move in the opposite direction of the sliding trajectory; popping up the system icon at the end point of the sliding trajectory of the sliding gesture, and controlling the system icon to move in the opposite direction of the sliding trajectory; when the preset animation and the system icon both reach the starting point of the sliding trajectory of the sliding gesture, opening and displaying the target system.

[0051] In the embodiment of the present application, when the system interface jumps, the present application adopts an animation-based system summoning method. Specifically, this method generates an animation effect, such as flash, spark, smoke, etc., according to the trajectory and direction of the gesture. The animation effect starts from the end point of the gesture and moves in the opposite direction of the gesture until it reaches the starting point of the gesture. At the same time, a system icon pops up from the end point of the gesture and moves along the animation effect until it reaches the starting point of the gesture. When the animation effect and the system icon reach the starting point of the gesture, the corresponding system is opened and displayed on the interface.

[0052] In the embodiment of the present application, if the sliding track does not match any gesture (i.e., the similarity between the feature vector of the sliding track and the feature vector of each preset gesture is lower than the preset threshold), a brief feedback message is given, such as vibration, sound, prompt, etc. The feedback information indicates that the player's gesture is not recognized, prompting the user that the operation failed, and guiding the user to try again or modify the gesture.

[0053] In the embodiment of the present application, the gesture-based system control method can be applied to the game system, which can improve the convenience and efficiency of players opening various systems of the game, and enhance the game experience and user stickiness. Players can flexibly set custom gestures to meet the personalized needs of players. The gesture recognition method based on feature points can accurately recognize the user's ordinary touch screen operation and sliding gestures, and because the gesture summoning is fast, it can be used in any interface without affecting the game process and screen.

[0054] According to another aspect of the embodiment of the present application, Figure 4 As shown, a gesture-based system control device is provided, comprising:

[0055] The track acquisition module 401 is used to acquire the sliding track of the sliding gesture when a sliding gesture operation is detected;

[0056] A gesture matching module 403, configured to perform gesture recognition on the sliding track to match a target gesture corresponding to the sliding gesture, wherein the target gesture is a trigger gesture pre-set for a target system;

[0057] The jump module 405 is used to jump to the target system in response to the jump instruction triggered by the target gesture when the current interface is not the interface of the target system.

[0058] It should be noted that the trajectory acquisition module 401 in this embodiment can be used to execute step S202 in the embodiment of the present application, the gesture matching module 403 in this embodiment can be used to execute step S204 in the embodiment of the present application, and the jump module 405 in this embodiment can be used to execute step S206 in the embodiment of the present application.

[0059] It should be noted that the examples and application scenarios implemented by the above modules and corresponding steps are the same, but are not limited to the contents disclosed in the above embodiments. It should be noted that the above modules as part of the device can be run in Figure 1 In the hardware environment shown, it can be implemented by software or by hardware.

[0060] Optionally, the gesture matching module is specifically used to: divide the sliding trajectory according to preset segmentation lengths to obtain multiple sub-trajectories; extract feature points of each sub-trajectory, and combine the feature points of all the sub-trajectories into a feature vector of the entire sliding trajectory according to the segmentation order of the sub-trajectories; calculate the similarity between the feature vector and preset vectors of multiple preset gestures; and determine the preset gesture corresponding to the preset vector having the largest value of the similarity with the feature vector as the target gesture matching the sliding gesture.

[0061] Optionally, the gesture matching module is further used to: identify and extract the starting point, inflection point and end point of each segment of the sub-trajectory as the feature points; combine the feature points of each segment of the sub-trajectory in the order from the starting point to the inflection point to the end point to obtain the sub-vectors of each sub-trajectory; and combine all the sub-vectors in the order of segmentation of the sub-trajectory to obtain the feature vector of the entire sliding trajectory.

[0062] Optionally, the system control device further includes a gesture monitoring module, which is used to: monitor changes in touch points on the display screen; and determine that the touch screen operation is the sliding gesture when the changes in the touch points meet preset conditions.

[0063] Optionally, the gesture monitoring module is specifically used to monitor at least one of the contact position, contact time and contact speed of the touch point, and is also used to: calculate the touch point movement distance based on the received contact positions of each touch point on the display screen, and determine that the touch screen operation is the sliding gesture when the touch point movement distance is greater than or equal to the minimum sliding distance; calculate the touch point movement time based on the received first contact time when the display screen is contacted and the second contact time when the contact ends, and determine that the touch screen operation is the sliding gesture when the touch point movement time is less than or equal to the maximum sliding time; and determine that the touch screen operation is the sliding gesture when the contact speed is greater than or equal to the minimum sliding speed.

[0064] Optionally, the jump module is specifically used to: obtain the system icon of the target system and a preset animation associated with the target gesture; generate and display the preset animation at the end point of the sliding trajectory of the sliding gesture, and control the preset animation to move in the opposite direction of the sliding trajectory; pop up the system icon at the end point of the sliding trajectory of the sliding gesture, and control the system icon to move in the opposite direction of the sliding trajectory; when the preset animation and the system icon both reach the starting point of the sliding trajectory of the sliding gesture, open and display the target system.

[0065] Optionally, the system control device also includes a gesture preset module, which is used to: according to a received preset gesture selected in a gesture list and a preset system selected in a system list, associate the preset gesture with the preset system to use the preset gesture as a trigger gesture for the preset system; or, according to a received custom gesture input in a gesture editor and the preset system selected in the system list, associate the custom gesture with the preset system to use the custom gesture as a trigger gesture for the preset system.

[0066] According to another aspect of the embodiments of the present application, the present application provides an electronic device, such as Figure 5As shown, it includes a memory 501, a processor 503, a communication interface 505 and a communication bus 507. The memory 501 stores a computer program that can be run on the processor 503. The memory 501 and the processor 503 communicate through the communication interface 505 and the communication bus 507. When the processor 503 executes the computer program, the steps of the above method are implemented.

[0067] The memory and processor in the above electronic device communicate via a communication bus and a communication interface. The communication bus may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus may be divided into an address bus, a data bus, a control bus, etc.

[0068] The memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0069] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0070] According to another aspect of the embodiments of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the steps of any of the above embodiments.

[0071] Optionally, in an embodiment of the present application, the computer-readable medium is configured to store program codes for the processor to perform the following steps:

[0072] When a sliding gesture operation is detected, obtaining a sliding track of the sliding gesture;

[0073] Performing gesture recognition on the sliding trajectory to match a target gesture corresponding to the sliding gesture, wherein the target gesture is a trigger gesture pre-set for a target system;

[0074] When the current interface is not the interface of the target system, respond to the jump instruction triggered by the target gesture to jump to the target system.

[0075] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments, and this embodiment will not be described in detail here.

[0076] When the embodiments of the present application are specifically implemented, reference may be made to the above-mentioned embodiments, which have corresponding technical effects.

[0077] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application, or a combination thereof.

[0078] For software implementation, the technology described herein can be implemented by a unit that performs the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0079] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0080] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0081] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0082] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0083] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0084] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk or an optical disk. It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the term "include", "include" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements that are not explicitly listed, or also includes elements inherent to such a process, method, article or device. Without more constraints, an element defined by the phrase "comprising a..." does not exclude the existence of other identical elements in the process, method, article or apparatus comprising the element.

[0085] The above description is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest range consistent with the principles and novel features applied for herein.

Claims

1. A gesture-based system control method, characterized in that: include: When a sliding gesture operation is detected, obtaining a sliding track of the sliding gesture; Performing gesture recognition on the sliding trajectory to match a target gesture corresponding to the sliding gesture, wherein the target gesture is a trigger gesture pre-set for a target system; When the current interface is not the interface of the target system, respond to the jump instruction triggered by the target gesture to jump to the target system.

2. The method according to claim 1, characterized in that The performing gesture recognition on the sliding track to match a target gesture corresponding to the sliding gesture includes: The sliding track is divided according to a preset segmentation length to obtain a plurality of sub-tracks; Extracting feature points of each segment of the sub-trajectory, and combining the feature points of all the sub-trajectories into a feature vector of the entire sliding trajectory according to the segmentation order of the sub-trajectories; Calculating the similarity between the feature vector and preset vectors of a plurality of preset gestures; The preset gesture corresponding to the preset vector having the largest value of the similarity with the feature vector is determined as a target gesture matching the sliding gesture.

3. The method according to claim 2, characterized in that The step of extracting the feature points of each sub-trajectory and combining the feature points of all the sub-trajectories into a feature vector of the entire sliding trajectory according to the segmentation order of the sub-trajectories comprises: Identify and extract the starting point, turning point and end point of each sub-trajectory as the feature points; Combining the feature points of each sub-trajectory in the order from the starting point to the turning point to the end point to obtain a sub-vector of each sub-trajectory; All the sub-vectors are combined according to the segmentation order of the sub-trajectory to obtain the feature vector of the entire sliding trajectory.

4. The method according to claim 1, characterized in that: Before obtaining the sliding track of the sliding gesture, the method further includes determining that the received touch screen operation is the sliding gesture in the following manner: Monitor changes in touch points on the display screen; When the change of the touch point meets a preset condition, the touch screen operation is determined to be the sliding gesture.

5. The method according to claim 4, characterized in that The monitoring of changes in the touch point on the display screen includes monitoring at least one of a touch point position, a touch time, and a touch speed of the touch point, and when the change in the touch point satisfies a preset condition, determining that the touch screen operation is the sliding gesture includes at least one of the following: Calculating a moving distance of the touch point according to the received touch point positions of each touch point on the display screen, and determining that the touch screen operates the sliding gesture when the moving distance of the touch point is greater than or equal to the minimum sliding distance; Calculating the touch point moving time according to the received first contact time of the display screen being touched and the second contact time when the contact ends, and determining that the touch screen operation is the sliding gesture when the touch point moving time is less than or equal to the maximum sliding time; When the contact point speed is greater than or equal to the minimum sliding speed, the touch screen operation is determined to be the sliding gesture.

6. The method according to claim 1, characterized in that The jump instruction triggered in response to the target gesture, jumping to the target system includes: Acquire a system icon of the target system and a preset animation associated with the target gesture; Generate and display the preset animation at the end point of the sliding track of the sliding gesture, and control the preset animation to move in the opposite direction of the sliding track; Popping up the system icon at the end point of the sliding track of the sliding gesture, and controlling the system icon to move in the opposite direction of the sliding track; When both the preset animation and the system icon reach the starting point of the sliding track of the sliding gesture, the target system is opened and displayed.

7. The method according to any one of claims 1 to 6, characterized in that: Before matching the target gesture corresponding to the sliding gesture, the method further includes setting a preset gesture in the following manner: According to the received preset gesture selected in the gesture list and the preset system selected in the system list, associating the preset gesture with the preset system to use the preset gesture as a trigger gesture for the preset system; or, According to the received custom gesture input in the gesture editor and the preset system selected in the system list, the custom gesture is associated with the preset system to use the custom gesture as a trigger gesture for the preset system.

8. A gesture-based system control device, characterized in that: include: A track acquisition module, used for acquiring the sliding track of the sliding gesture when a sliding gesture operation is detected; A gesture matching module, used for performing gesture recognition on the sliding track to match a target gesture corresponding to the sliding gesture, wherein the target gesture is a trigger gesture pre-set for a target system; The jump module is used to jump to the target system in response to the jump instruction triggered by the target gesture when the current interface is not the interface of the target system.

9. An electronic device, comprising a memory, a processor, a communication interface and a communication bus, wherein the memory stores a computer program that can be run on the processor, and the memory and the processor communicate through the communication bus and the communication interface, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer readable medium having a non-volatile program code executable by a processor, characterized in that: The program code enables the processor to execute the method according to any one of claims 1 to 7.

Images