Gesture touch method, device, electronic device and storage medium

Abstract

The present disclosure proposes a gesture touch method, device, electronic device and storage medium, wherein the method includes: the terminal operating system monitors a first touch operation and a second touch operation, and when the touch area of ​​the first touch operation is greater than a threshold, according to the first touch operation and the second touch operation, a corresponding target instruction is determined from the system control instruction, and the target instruction is executed, thereby expanding more shortcut gestures without affecting the original touch function of the operating system, thereby improving the convenience of the touch operation.

Description

Technical Field

[0001] The present disclosure relates to the field of touch control technology, and in particular to a gesture touch control method, device, electronic device and storage medium. Background Art

[0002] At present, touch screens have become a standard feature of electronic products. On electronic products equipped with the Android system, quick gestures are a basic function of the Android system. As the functions in applications increase, quick gestures need to be continuously expanded, and at the same time, it is necessary to prevent the occurrence of false touches to improve the convenience of touch. Summary of the invention

[0003] The present disclosure aims to solve one of the technical problems in the related art at least to some extent.

[0004] To this end, the present disclosure proposes a gesture touch control method for expanding shortcut gestures while improving the flexibility of shortcut gestures.

[0005] The first aspect of the present disclosure provides a gesture touch method, which is executed by an operating system of a terminal and includes the following steps:

[0006] A first touch operation and a second touch operation are obtained by monitoring; wherein a touch area of ​​the first touch operation is greater than a threshold;

[0007] Determining a corresponding target instruction from system control instructions according to the first touch operation and the second touch operation;

[0008] Execute the target instruction.

[0009] A second embodiment of the present disclosure provides a gesture touch device, including:

[0010] A monitoring module, used for monitoring a first touch operation and a second touch operation; wherein a touch area of ​​the first touch operation is greater than a threshold;

[0011] A first determining module, configured to determine a corresponding target instruction from system control instructions according to the first touch operation and the second touch operation;

[0012] An execution module is used to execute the target instruction.

[0013] A third aspect of the present disclosure provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method described in the first aspect is implemented.

[0014] The fourth aspect of the present disclosure provides a non-temporary computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method described in the first aspect is implemented.

[0015] A fifth aspect of the present disclosure provides a computer program product. When a computer program in the computer program product is executed by a processor, the method described in the first aspect is implemented.

[0016] The technical solution provided by the embodiment of the present disclosure has the following beneficial effects:

[0017] The terminal's operating system monitors a first touch operation and a second touch operation, wherein a touch area of ​​the first touch operation is greater than a threshold value. According to the first touch operation and the second touch operation, a corresponding target instruction is determined from the system control instruction, and the target instruction is executed, thereby expanding more shortcut gestures without affecting the original touch function of the operating system, thereby improving the convenience of touch operations.

[0018] Additional aspects and advantages of the present disclosure will be given in part in the following description and in part will be obvious from the following description or learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above and / or additional aspects and advantages of the present disclosure will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0020] Figure 1 A schematic diagram of a flow chart of a gesture touch control method provided by an embodiment of the present disclosure;

[0021] Figure 2 A flowchart of another gesture touch control method provided by an embodiment of the present disclosure

[0022] Figure 3 A schematic diagram of a fitted target contour line according to an embodiment of the present disclosure;

[0023] Figure 4 A schematic diagram of a menu display provided in an embodiment of the present disclosure;

[0024] Figure 5 One of the schematic diagrams of object determination provided by the embodiment of the present disclosure;

[0025] Figure 6 A second schematic diagram of an object determination provided in an embodiment of the present disclosure;

[0026] Figure 7 A third schematic diagram of an object determination provided in an embodiment of the present disclosure;

[0027] Figure 8 A schematic diagram of the structure of a gesture touch control device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] Embodiments of the present disclosure are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.

[0029] The following describes the gesture touch method, device, electronic device and storage medium of the embodiments of the present disclosure with reference to the accompanying drawings.

[0030] In the related art, the gestures of multi-finger touch operation in the terminal have been distributed to various applications by the operating system, and the operating system itself can no longer process such gestures. For example, in the gallery application, the two-finger touch operation is used to zoom in or out the picture. At this time, when the user needs to use the multi-finger shortcut operation to adjust the screen brightness or volume, it cannot be realized, which reduces the convenience.

[0031] To this end, an embodiment of the present disclosure provides a gesture touch method, which monitors a first touch operation and a second touch operation, determines that the first touch operation is greater than a threshold, and determines a target instruction from a system control instruction based on a multi-finger touch operation corresponding to the first touch operation and the second touch operation, thereby expanding more shortcut gestures and improving the convenience of touch operations without affecting the original touch function of the operating system.

[0032] Figure 1 A flowchart of a gesture touch control method provided by an embodiment of the present disclosure is provided.

[0033] like Figure 1 As shown, the method comprises the following steps:

[0034] Step 101: monitor and obtain a first touch operation and a second touch operation.

[0035] The execution subject of the embodiment of the present disclosure is the operating system of the terminal. The terminal may be an electronic device equipped with a touch screen, such as a mobile phone, a tablet computer, a smart wearable device, etc., which are not listed one by one in this embodiment.

[0036] In one scenario of an embodiment of the present disclosure, when a user needs to perform a corresponding operation on a terminal, for example, in a gallery application, when a user needs to adjust the brightness, a first touch operation and a second touch operation will be performed, so that the operating system of the terminal can monitor the first touch operation and the second touch operation based on the electrical parameters of each pixel on the touch screen, such as voltage changes or capacitance changes. The first touch operation and the second touch operation may be monitored at the same time, or the first touch operation may be monitored first, and then the second touch operation may be monitored. The first touch operation and the second touch operation are two-finger touch operations, such as a two-finger touch operation of the thumb and index finger, or a two-finger touch operation of the index finger and middle finger, which are not limited in this embodiment. The first touch operation and the second touch operation may be the same or different. For example, the first touch operation is a pressing touch operation, and the second touch operation is a pressing touch operation; the first touch operation is a pressing touch operation, and the second touch operation is a sliding touch operation; the first touch operation is a pressing touch operation, and the second touch operation is a double-click touch operation; the first touch operation is a pressing touch operation, and the second touch operation is a pressing and circling touch operation. Other implementations of the first touch operation and the second touch operation are not listed one by one in this embodiment.

[0037] It should be noted that when the second touch operation is detected, the first touch operation is still in the touch state to implement the two-finger touch operation.

[0038] Step 102: Determine a corresponding target instruction from system control instructions according to the first touch operation and the second touch operation.

[0039] In this embodiment, when a first touch operation is detected, the touch area of ​​the first touch operation is identified. When the touch area of ​​the first touch operation is greater than a threshold, a corresponding target instruction is determined from the system control instruction based on the first touch operation and the detected second touch operation. For example, the first touch operation is a touch operation of finger pressing. When the area of ​​the finger pressing operation detected is greater than the threshold, for example, the thumb is used for pressing and the touch area is larger, it is identified as the touch area greater than the threshold. Then, based on the detected touch operation of the index finger sliding left and right and the touch operation of the thumb pressing, the corresponding target instruction is determined from the system instruction to be adjusting the brightness.

[0040] Step 103, execute the target instruction.

[0041] Then, according to the determined target instruction, the target instruction is executed to realize the corresponding operation.

[0042] In the disclosed embodiment, the operating system of the terminal will not send the events of the first touch operation and the second touch operation to the application program according to the first touch operation and the second touch operation detected, when the touch area of ​​the first touch operation is greater than the threshold value, so that the application program will not execute the instructions corresponding to the first touch operation and the second touch operation originally distributed to the application program by the system, but the operating system determines the target instructions corresponding to the first touch operation and the second touch operation from the system control instructions, thereby expanding more shortcut gestures and improving the convenience of touch operation without affecting the original touch function. For example, in a video application program, if the two-finger touch operation is pre-defined in the application program as adjusting the brightness, in the disclosed embodiment, the two-finger touch operation can be expanded to an instruction for fast forwarding or adjusting the volume by identifying the touch area of ​​the first touch operation in the two-finger touch operation, thereby improving the convenience of gesture touch operation.

[0043] In the gesture touch method of the disclosed embodiment, the terminal operating system monitors gesture touch operations to obtain a first touch operation and a second touch operation. When the touch area of ​​the first touch operation is greater than a threshold, the corresponding target instruction is determined from the system control instruction according to the first touch operation and the second touch operation, and the target instruction is executed, thereby expanding more shortcut gestures and improving the convenience of touch operations without affecting the original touch function of the operating system.

[0044] Based on the previous embodiment, this embodiment provides another gesture touch method. Figure 2 A flowchart of another gesture touch control method provided by an embodiment of the present disclosure.

[0045] like Figure 2 As shown, the method may include the following steps:

[0046] Step 201, monitoring gesture touch operations.

[0047] Step 202: when a first touch operation is detected, identifying a touch area of ​​the first touch operation.

[0048] In one implementation of the disclosed embodiment, a contour line is fitted to the touch area of ​​the first touch operation according to a set shape to obtain a target contour line. For example, the target contour line is obtained by fitting points on the contour line using the least square method. The touch area is determined according to the area within the target contour line. In the disclosed embodiment, the target contour line can present multiple groups of shapes. Due to the way the user's finger presses, the target contour line is usually circular or elliptical. The following describes the calculation of the area within the target contour line when the target contour line presents different shapes.

[0049] As an implementation method, the target contour is circular. According to the center point of the area enclosed by the target contour, the lengths of each axis passing through the center point are determined, the radius of the circular contour is determined by taking the average of the lengths of each axis, and the area within the circular target contour is determined based on the radius.

[0050] As another implementation method, the target contour is elliptical, and the lengths of the major axis and the minor axis passing through the center point are determined according to the center point of the area enclosed by the target contour, and the area within the target contour is determined according to the lengths of the major axis and the minor axis.

[0051] Figure 3 FIG. 1 is a schematic diagram of a fitted target contour line according to an embodiment of the present disclosure. Figure 3 As shown in the figure, M is the center point of the area surrounded by the target contour line, L is the major axis passing through the center point, and S is the minor axis passing through the center point. According to the area formula of the ellipse, determine

[0052] Step 203: If it is determined that the touch area of ​​the first touch operation is greater than a threshold, the gesture touch operation is continuously monitored to obtain a second touch operation.

[0053] In the disclosed embodiment, when the first touch operation is detected, the touch area of ​​the first touch operation is calculated by fitting to determine whether there is a large-area press event. That is, when the touch area of ​​the first touch operation is detected to be greater than the threshold, it is considered that there is a customized large-area touch event, and then the gesture touch operation is continuously monitored. For example, when the touch area of ​​the first touch operation is detected to be greater than the threshold, a set time is waited, such as several hundred milliseconds, and then the second touch operation is monitored to obtain the second touch operation, thereby avoiding the false triggering of the first touch operation and improving the accuracy of the monitoring of the first touch operation and the second touch operation. At the same time, the large-area press event of the first touch operation with a touch area greater than the threshold and the second touch operation will not be sent to the application hosted by the operating system for an indication message, so as to realize the customized convenient touch function.

[0054] For example, the first touch operation is a thumb press. Since the thumb presses a larger area, a threshold can be determined in advance based on the thumb press area. Thus, when the first touch operation is detected to have a touch area larger than the threshold, the thumb press is identified. When a thumb press over a larger area is detected, the second touch operation is monitored, such as left and right sliding, up and down sliding, double-clicking, and circle drawing, which are not listed one by one in this embodiment.

[0055] It should be noted that, when the touch area of ​​the first touch operation is detected to be greater than the threshold, the target instructions corresponding to the first touch operation and the second touch operation are determined from the system control instructions, rather than the instructions set by the operating system received in advance in the corresponding application, so that when a custom trigger event is detected, a custom convenient touch function can be realized. For example, in the gallery application, when the first touch operation and the second touch operation are detected, for example, a two-finger touch operation of thumb pressing and index finger sliding left and right, the determined instruction is to zoom in or out the picture, and in the embodiment of the present disclosure, when the area of ​​the touch operation of thumb pressing is detected to be greater than the threshold, according to the touch operation of index finger sliding left and right that is continuously monitored, the instruction corresponding to the two-finger touch operation is determined from the system control instruction to be to adjust the screen brightness. Therefore, the quick touch operation is expanded without affecting the control instructions of the original two-finger touch operation, thereby increasing convenience.

[0056] It should be understood that the target instruction corresponding to the two-finger touch operation can be flexibly set according to needs, and the embodiments of the present disclosure are not limited thereto.

[0057] In one implementation of this embodiment, in order to improve the user experience, when it is determined that the touch area of ​​the first touch operation is greater than a threshold, prompt information for prompting the execution of the second touch operation is displayed, for example, the screen is highlighted, or the periphery of the screen is lit up in a set color for a set time, or a pop-up window is popped up for prompting, which are not listed one by one in this embodiment, to prompt the user to execute the second touch operation, and continue to monitor the gesture touch operation to obtain the second touch operation, so as to better identify the user's true intention, thereby improving the reliability of touch operation recognition.

[0058] Step 204: If it is determined that the touch area is less than or equal to the threshold, an indication message is sent to an application hosted by the operating system.

[0059] In the embodiment of the present disclosure, when the touch area is less than or equal to the threshold, it is deemed that the customized large-area touch event is not detected. Therefore, when the touch area is less than or equal to the threshold, an indication message is sent to the application carried by the operating system, so that the corresponding application determines the first touch operation detected, or the first touch operation and the second touch operation detected, according to the indication message, and the corresponding instructions pre-assigned by the operating system. That is to say, when the touch area is less than or equal to the threshold, the corresponding touch gesture is processed by the application instead of the system, so that the control instructions corresponding to the original touch operation in the application are not affected.

[0060] Step 205 : determining a corresponding target instruction from the system control instructions according to the first touch operation and the second touch operation.

[0061] Table 1 lists the correspondence between the first touch operation, the second touch operation and the target instruction, where, for example, the first touch operation is a touch operation of the thumb, and the second touch operation is a touch operation of the index finger.

[0062] First touch operation Second touch operation Target Instructions Thumb press Slide your index finger left and right Adjust screen brightness Thumb press Slide your index finger up and down Adjust the volume Thumb press Double-click with index finger Screen capture Thumb press Index finger circle Capture the content at the specified location

[0063] Table 1 shows the correspondence between some two-finger touch operations and target instructions. The correspondence between other two-finger touch operations and target instructions is not listed one by one in this embodiment, nor does it constitute a limitation on this embodiment.

[0064] Furthermore, in actual applications, in order to increase the diversity of touch, for the first touch operation, in addition to identifying the operation area of ​​the first touch operation, at least one of the touch position and gesture direction of the first touch operation can also be identified to achieve more touch functions. For example, based on the first touch operation and the second touch operation, the target instruction for triggering menu display or the target instruction for object selection can also be determined.

[0065] Step 206, execute the target instruction.

[0066] In the disclosed embodiment, the corresponding target instruction is executed according to the determined target instruction.

[0067] In actual application scenarios, during the execution of the target instruction, one or more of the operation area, touch position and gesture direction of the first touch operation can also be identified to adjust the execution result of the target instruction and improve the execution effect. The target instruction can be used to trigger menu display or for object selection, which will be explained below using different embodiments.

[0068] In one implementation of the embodiment of the present disclosure, the target instruction is used to trigger menu display, and the menu is adjusted according to at least one of the touch position, touch area and gesture direction of the first touch operation, and the adjusted menu is displayed.

[0069] Figure 4 A schematic diagram of a menu display provided in an embodiment of the present disclosure, such as Figure 4 As shown, Figure 4 Two menu display modes, namely (a) and (b), are shown in the figure. Taking the menu display mode (b) as an example, the menu surrounds the finger in a ring-shaped manner, and the menu adjustment and display modes are explained in the touch process for different scenarios.

[0070] In the first scenario, the touch position of the first touch operation is monitored, and the position of the menu is adjusted according to the change of the touch position of the first touch operation, so that the relative position relationship between the menu and the finger performing the first touch operation remains unchanged, and the adjusted menu is displayed. For example, if the finger moves to the right, the menu also moves to the right, so as to keep the relative position relationship between the circular menu and the finger unchanged, and avoid blocking the menu due to the movement of the finger when the gesture changes.

[0071] In the second scenario, the touch area of ​​the first touch operation is monitored. When the touch area of ​​the first touch operation is greater than the threshold and the touch area changes, the size of the menu is adjusted according to the change in the touch area. For example, if the touch area increases, the size of the menu display increases, and if the touch area decreases, the size of the menu display decreases, so that the menu size adapts to the touch area. For example, if the pressing area is detected to increase, the size of the annular menu in (b) is also increased according to the set ratio to improve the display effect.

[0072] In the third scenario, the direction of the first touch operation is monitored, and when the direction of the gesture changes, the direction of the menu is adjusted accordingly, so that the relative position relationship between the menu and the finger performing the first touch operation does not change. For example, if the finger rotates clockwise, the annular menu in (b) also rotates clockwise to maintain the relative position relationship with the finger unchanged, avoiding the menu being blocked by the finger movement when the gesture changes.

[0073] In the fourth scenario, the menu can also be adjusted based on at least one of the touch position, touch area and gesture direction of the first touch operation, wherein the touch position, touch area and gesture direction can be regarded as changing factors of the first touch operation, that is, according to one or more changing factors of the first touch operation, the menu can be adjusted. When making specific adjustments, the menu adjustments in the above three scenarios can be performed simultaneously according to the changing factors of the touch operation to avoid menu obstruction and improve the display effect of the menu.

[0074] In a second implementation of the embodiment of the present disclosure, the determined target instruction is used for object selection. When selecting an object, different technical solutions are used for different scenarios for explanation below.

[0075] As an implementation method, the target position is determined according to the touch area and gesture direction of the first touch operation, and the object is selected according to the target position. For example, in the application scenario of the input method, in the related technology, the touch center point is detected, and then the point with the largest distance from the center point is determined, and then the gesture direction, such as the direction of the finger, is determined. According to the direction of the finger and the position of the largest point, the position of the user's touch is determined. This method is prone to misidentification. In the embodiment of the present disclosure, the target position corresponding to the user's touch area and gesture direction is determined by identifying the user's touch area and gesture direction, and the object is selected according to the target position, thereby improving the accuracy of object selection. For example, the user's finger presses on the letter L, that is, the touch area occupied by the letter L is large, and the letter L and the letter O are adjacent. If the object is determined according to the position of the edge point with the largest distance from the pressed center point and the gesture direction, the pressed object may be mistakenly identified as the letter O. In the embodiment of the present disclosure, the target position can be accurately determined according to the size of the touch area of ​​the first touch operation and the detected gesture direction. Based on the target position, the selected object can be accurately determined to be the letter L. Even if the point at the maximum distance from the touch center point falls on the letter O, we believe that the probability that the user wants to input the letter L is greater, thereby improving the accuracy of object selection in the touch scenario.

[0076] As another implementation manner, the target position is determined according to the touch position and gesture direction of the first touch operation, and the object is selected according to the target position.

[0077] In one scenario, for determining an object close to a touch position of a first touch operation, Figure 5 One of the schematic diagrams of object determination provided by the embodiment of the present disclosure, Figure 5 Figure (a) shows that in the related art, only the object with the shortest distance from the touch position of the first touch operation is selected each time, that is, Figure 5 The circle indicated by A in (a) corresponds to the object. In the embodiment of the present disclosure, the direction of the gesture is also taken into account, for example, the direction of the finger, the points in the opposite direction of the finger will be excluded, and the object with the shortest distance from the finger in the direction of the finger will be selected, that is, the selected Figure 5 In (b), the object indicated by B is selected instead of the object indicated by E which is closest. As an implementation method, a circle can be drawn according to the touch center position of the finger, and the weight values ​​in different directions can be set according to the set azimuth angle. Figure 5 Figure (c) in the middle shows the weight values ​​of targets at different azimuths reaching the touch position of the finger, among which, at an angle of 0 degrees, that is, the target angle direction in the same direction as the finger is pointing, has the smallest weight, and the weights at other angles increase. In the present disclosure, the target angle direction with the smallest weight and the object with the smallest distance from the touch position of the first touch operation is selected.

[0078] In another scenario, it is used to determine an object far away from the touch position of the first touch operation, that is, a long-distance selection target, such as Figure 6 As shown, the solid black dots in the right figure are selected targets, and the white dots are unselected targets. In a large-screen touch scene, for example, a large touch-screen device such as a tablet or a laptop computer can be based on the gesture direction of the first touch operation detected, wherein when the first touch operation is detected, the gesture direction, that is, the direction of the finger corresponding to the first touch operation is determined by continuously monitoring the direction of the change in the long axis of the target contour line of the first touch operation, and the first target pointed to by the finger, that is, the target with the smallest distance, is selected. Figure 6 The solid black dot in (a) is then moved back and forth without changing the direction of the finger to switch targets. For example, if the finger moves in the direction of the arrow, a target farther from the finger is selected, such as Figure 6 The solid black dot in (b) shows that when the user touches inward, the selected target can be grabbed. Figure 6 As shown in (c), the selected Figure 6 The solid black dot in (b), for example, can be used to grab a specific target in a game scene to improve the convenience of touch operation.

[0079] Step 207, when the first touch operation stops, stop executing the target instruction.

[0080] In the disclosed embodiment, when it is detected that the first touch operation stops, the execution of the target instruction stops.

[0081] In the gesture touch method of the disclosed embodiment, the operating system of the terminal monitors the gesture touch operation, and when the touch area of ​​the first touch operation is greater than the threshold, the second touch operation is continuously monitored, and the corresponding target instruction is determined from the system control instruction according to the first touch operation and the second touch operation, and the target instruction is executed, so that more shortcut gestures are expanded without affecting the original touch function of the operating system, and the convenience of the touch operation is improved. At the same time, one or more of the operation area, touch position and gesture direction of the first touch operation can also be identified to adjust the execution result of the target instruction and improve the execution effect.

[0082] Based on the above embodiment, this embodiment provides an implementation method, after monitoring the first touch operation and the second touch operation, it is determined that the touch area of ​​the first touch operation is greater than a threshold, and the position of the set part of the human body can be identified according to the first touch operation and the second touch operation. Figure 7As shown, the gesture direction of the first touch operation monitored and the gesture direction of the second touch operation are determined, and contour fitting is performed on the touch areas of the first touch operation and the second touch operation monitored to obtain a first target contour line of the touch area of ​​the first touch operation and a second target contour line of the touch area of ​​the second touch operation. According to the gesture directions of the first touch operation and the second touch operation, and the intersection between the extension line of the long axis of the first target contour line and the extension line of the long axis of the second target contour line, the orientation of the palm of the human body performing the touch operation and the orientation of the human body can be determined, as shown in Figure a, so as to facilitate the display and transformation of the interface.

[0083] As an implementation method, in a scenario, for example, in a game scenario, it is also possible to determine whether one user or multiple users performs the touch operation based on the gesture directions of the first touch operation and the second touch operation, and the intersection point between the extension line of the long axis of the first target contour line and the extension line of the long axis of the second target contour line, such as Figure 7 As shown in Figures ab, it is possible to identify whether there is one or more users currently participating in the game, so as to increase the fun of the game.

[0084] In order to implement the above embodiments, the present disclosure further provides a gesture touch device.

[0085] Figure 8 A schematic diagram of the structure of a gesture touch control device provided in an embodiment of the present disclosure.

[0086] like Figure 8 As shown, the device comprises:

[0087] The monitoring module 71 is used to monitor and obtain a first touch operation and a second touch operation, wherein a touch area of ​​the first touch operation is greater than a threshold.

[0088] The first determining module 72 is used to determine a corresponding target instruction from system control instructions according to the first touch operation and the second touch operation.

[0089] The execution module 73 is used to execute the target instruction.

[0090] Further, as an implementation method, the device further includes:

[0091] A sending module is used to send an indication message to an application carried by the operating system when the touch area is less than or equal to the threshold, wherein the indication message is used to instruct the application to execute application control instructions corresponding to the first touch operation and the second touch operation.

[0092] As an implementation mode, the monitoring module 71 is used to:

[0093] Monitoring gesture touch operations; when the first touch operation is monitored, identifying the touch area of ​​the first touch operation; and if it is determined that the touch area of ​​the first touch operation is greater than the threshold, continuing to monitor gesture touch operations to obtain the second touch operation.

[0094] As an implementation manner, when the second touch operation is in the touch state, the first touch operation is in the touch state.

[0095] As an implementation manner, the monitoring module 72 is used to perform contour fitting on the touch area of ​​the first touch operation according to a set shape to obtain a target contour; and determine the touch area according to the area within the target contour.

[0096] As an implementation method, the target contour line is elliptical; the device also includes:

[0097] The second determination module is used to determine the lengths of the major axis and the minor axis passing through the center point of the area surrounded by the target contour line according to the center point of the area surrounded by the target contour line; and determine the area within the target contour line according to the lengths of the major axis and the minor axis.

[0098] As an implementation manner, the monitoring module is further used to display prompt information, wherein the prompt information is used to prompt the execution of the second touch operation.

[0099] As an implementation method, the device further includes:

[0100] The stopping module is used to stop executing the target instruction when the first touch operation stops.

[0101] As an implementation method, the target instruction is used to trigger menu display; the execution module 73 is used to:

[0102] The menu is adjusted according to at least one of a touch position, a touch area, and a gesture direction of the first touch operation; and the adjusted menu is displayed.

[0103] As an implementation method, the target instruction is used for object selection, and the execution module 73 is used to:

[0104] A target position is determined according to the touch area and gesture direction of the first touch operation; and an object is selected according to the target position.

[0105] As an implementation method, the target instruction is used for object selection, and the execution module 73 is further used for:

[0106] A target position is determined according to the touch position and gesture direction of the first touch operation; and an object is selected according to the target position.

[0107] It should be noted that the above explanation of the method embodiment is also applicable to the device of this embodiment, and the principles are the same, which will not be repeated here.

[0108] In the gesture touch device of the disclosed embodiment, the terminal operating system monitors the first touch operation and the second touch operation. When the touch area of ​​the first touch operation is greater than a threshold, the corresponding target instruction is determined from the system control instruction according to the first touch operation and the second touch operation, and the target instruction is executed, thereby expanding more shortcut gestures and improving the convenience of touch operation without affecting the original touch function of the operating system.

[0109] In order to implement the above embodiments, the embodiments of the present disclosure propose an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the method described in the above method embodiments is implemented.

[0110] In order to implement the above embodiments, the embodiments of the present disclosure provide a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method described in the above method embodiments is implemented.

[0111] In order to implement the above embodiments, the embodiments of the present disclosure provide a computer program product. When a computer program in the computer program product is executed by a processor, the method described in the above method embodiments is implemented.

[0112] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0113] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0114] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present disclosure belong.

[0115] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0116] It should be understood that the various parts of the present disclosure can be implemented in hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0117] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0118] In addition, each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0119] The storage medium mentioned above may be a read-only memory, a disk or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present disclosure. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present disclosure.

Claims

1. A gesture touch method, characterized in that: The method is executed by the operating system of the terminal and includes the following steps: A first touch operation and a second touch operation are detected; identifying a touch area of ​​the first touch operation, and when the touch area of ​​the first touch operation is greater than a threshold, determining a corresponding target instruction from a system control instruction through the operating system according to the first touch operation and the second touch operation, wherein the events of the first touch operation and the second touch operation are not sent to an application through the operating system when the touch area is greater than the threshold, but are sent to the application through the operating system when the touch area is not greater than the threshold, and the target instruction determined by the operating system is different from the target instruction determined by the application; The target instruction is executed, and based on one or more of a touch area, a touch position, and a gesture direction of the first touch operation, an execution result of the target instruction is adjusted.

2. The gesture touch control method according to claim 1, characterized in that: The detecting of the first touch operation and the second touch operation includes: When the first touch operation is detected, identifying a touch area of ​​the first touch operation; If it is determined that the touch area of ​​the first touch operation is greater than the threshold, the gesture touch operation continues to be monitored to obtain the second touch operation.

3. The gesture touch control method according to claim 1, characterized in that: When the second touch control operation is in the touch control state, the first touch control operation is in the touch control state.

4. The gesture touch control method according to claim 2, characterized in that: The identifying the touch area of ​​the first touch operation includes: According to the set shape, contour fitting is performed on the touch area of ​​the first touch operation to obtain a target contour line; The touch area is determined according to the area within the target contour line.

5. The gesture touch control method according to claim 4, characterized in that: The target contour line is elliptical; the method further comprises: According to the center point of the area surrounded by the target contour line, determine the length of the major axis and the length of the minor axis passing through the center point; The area within the target contour is determined according to the length of the major axis and the length of the minor axis.

6. The gesture touch control method according to claim 2, characterized in that: After determining that the touch area of ​​the first touch operation is greater than the threshold, the method further includes: Display prompt information, wherein the prompt information is used to prompt the user to perform the second touch operation.

7. The gesture touch method according to any one of claims 1 to 5, characterized in that: The method further comprises: When the first touch operation stops, the target instruction is stopped.

8. The gesture touch control method according to any one of claims 1 to 5, characterized in that: The target instruction is used to trigger menu display; The executing the target instruction comprises: adjusting the menu according to at least one of a touch position, a touch area, and a gesture direction of the first touch operation; Display the adjusted menu.

9. The gesture touch method according to any one of claims 1 to 5, characterized in that: The target instruction is used for object selection; the executing the target instruction comprises: determining a target position according to a touch area and a gesture direction of the first touch operation; Object selection is performed according to the target position.

10. The gesture touch method according to any one of claims 1 to 5, characterized in that: The target instruction is used for object selection; the executing the target instruction comprises: Determining a target position according to a touch position and a gesture direction of the first touch operation; Object selection is performed according to the target position.

11. The gesture touch control method according to claim 1, characterized in that: The method further comprises: If it is determined that the touch area is less than or equal to the threshold, an indication message is sent to an application carried by the operating system, wherein the indication message is used to instruct the application to execute application control instructions corresponding to the first touch operation and the second touch operation.

12. A gesture touch device, characterized in that: include: A monitoring module, used for monitoring and obtaining a first touch operation and a second touch operation; a first determination module, configured to identify a touch area of ​​the first touch operation, and when the touch area of ​​the first touch operation is greater than a threshold, determine a corresponding target instruction from a system control instruction through an operating system according to the first touch operation and the second touch operation, wherein the events of the first touch operation and the second touch operation are not sent to an application through the operating system when the touch area is greater than the threshold, but are sent to the application through the operating system when the touch area is not greater than the threshold, and the target instruction determined by the operating system is different from the target instruction determined by the application; An execution module is used to execute the target instruction and adjust the execution result of the target instruction based on one or more of the touch area, touch position and gesture direction of the first touch operation.

13. The gesture touch device according to claim 12, characterized in that: The monitoring module is used for: When the first touch operation is detected, a touch area of ​​the first touch operation is identified; and when it is determined that the touch area of ​​the first touch operation is greater than the threshold, gesture touch operations are continuously monitored to obtain the second touch operation.

14. The gesture touch device according to claim 12, characterized in that: When the second touch control operation is in the touch control state, the first touch control operation is in the touch control state.

15. The gesture touch device according to claim 13, characterized in that: The monitoring module is used for: According to the set shape, contour fitting is performed on the touch area of ​​the first touch operation to obtain a target contour line; The touch area is determined according to the area within the target contour line.

16. The gesture touch device according to claim 14, characterized in that: The target contour is elliptical; the device further comprises: The second determination module is used to determine the lengths of the major axis and the minor axis passing through the center point of the area surrounded by the target contour line according to the center point of the area surrounded by the target contour line; and determine the area within the target contour line according to the lengths of the major axis and the minor axis.

17. The gesture touch device according to claim 13, characterized in that: The monitoring module is further used to display prompt information, wherein the prompt information is used to prompt the execution of the second touch operation.

18. The gesture touch device according to any one of claims 12 to 16, characterized in that: The device further comprises: The stopping module is used to stop executing the target instruction when the first touch operation stops.

19. The gesture touch device according to any one of claims 12 to 16, characterized in that: The target instruction is used to trigger menu display; the execution module is used to: adjusting the menu according to at least one of a touch position, a touch area, and a gesture direction of the first touch operation; Display the adjusted menu.

20. The gesture touch device according to any one of claims 12 to 16, characterized in that: The target instruction is used for object selection; the execution module is also used for: determining a target position according to a touch area and a gesture direction of the first touch operation; Object selection is performed according to the target position.

21. The gesture touch device according to any one of claims 12 to 16, characterized in that: The target instruction is used for object selection; the execution module is further used to: determine the target position according to the touch position and gesture direction of the first touch operation; Object selection is performed according to the target position.

22. The gesture touch device according to claim 12, characterized in that: The device further comprises: A sending module is used to send an indication message to an application carried by the operating system when the touch area is less than or equal to the threshold, wherein the indication message is used to instruct the application to execute application control instructions corresponding to the first touch operation and the second touch operation.

23. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method according to any one of claims 1 to 11 is implemented.

24. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 11 is implemented.

Images