Touch area classification method and device, electronic equipment and computer readable medium

Abstract

The invention discloses a touch area classification method and device, electronic equipment and a computer readable medium, and relates to the technical field of touch screens, the method comprises the following steps: under the condition that the electronic equipment displays a target application program through a touch screen, detecting a target touch operation of a user for a target interface of the target application program; acquiring gesture information corresponding to the target touch operation; and determining a touch type of a target operation area corresponding to the target touch operation based on the gesture information. Therefore, the touch type of the operation area corresponding to the gesture operation can be determined through the gesture information of the touch operation input by the user, that is, the area of the target interface can be classified through operation on the target interface, and the complexity of area classification operation can be reduced.

Description

Technical Field

[0001] The present application relates to the field of touch screen technology, and more specifically, to a touch area classification method, device, electronic device and computer-readable medium. Background Art

[0002] With the development of electronic technology, the functions of electronic devices are becoming more and more abundant. For example, electronic devices are equipped with touch screens. Users can control electronic devices by performing touch events on the touch screen, including press (down) events, lift (up) events, and slide (move) events.

[0003] At present, some applications can allow users to adjust the touch parameters of the touch screen when the application is running, so as to adjust the touch response in the interface of the application. However, the current adjustment method is global adjustment, that is, the touch parameters of the entire interface are adjusted together, which makes the adjustment method unreasonable. Summary of the invention

[0004] The present application proposes a touch area classification method, device, electronic device and computer-readable medium to improve the above-mentioned defects.

[0005] In a first aspect, the present application provides a touch area classification method applied to a touch screen of an electronic device, the method comprising: when the electronic device displays a target application through the touch screen, detecting a user's target touch operation on a target interface of the target application; obtaining gesture information corresponding to the target touch operation; and determining a touch type of a target operation area corresponding to the target touch operation based on the gesture information.

[0006] In a second aspect, the present application further provides a touch area classification device, which is applied to a touch screen of an electronic device, and the device includes: a detection unit, an acquisition unit, and a determination unit. The detection unit is used to detect a target touch operation of a user on a target interface of a target application when the electronic device displays a target application through the touch screen. The acquisition unit is used to acquire gesture information corresponding to the target touch operation. The determination unit is used to determine the touch type of the target operation area corresponding to the target touch operation based on the gesture information.

[0007] In a third aspect, the present application also provides an electronic device comprising: one or more processors; a memory; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the above method.

[0008] In a fourth aspect, the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the above method.

[0009] The touch area classification method, device, electronic device and computer-readable medium provided by the present application detect a user's target touch operation on a target interface of the target application when the electronic device displays the target application through the touch screen; obtain gesture information corresponding to the target touch operation; and determine the touch type of the target operation area corresponding to the target touch operation based on the gesture information. Therefore, the touch type of the operation area corresponding to the gesture operation can be determined by the gesture information of the touch operation input by the user, that is, the area of ​​the target interface can be classified by the operation on the target interface, which can reduce the complexity of the area classification operation.

[0010] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0012] Figure 1 A schematic diagram showing an operation area provided by an embodiment of the present application;

[0013] Figure 2 A method flow chart of a touch area classification method provided by an embodiment of the present application is shown;

[0014] Figure 3 A schematic diagram showing a touch operation on a target interface provided by an embodiment of the present application is shown;

[0015] Figure 4 Shown for Figure 3 A schematic diagram of gesture information of a touch operation;

[0016] Figure 5 A schematic diagram showing a touch operation on a target interface provided by another embodiment of the present application is shown;

[0017] Figure 6 Shown for Figure 5A schematic diagram of gesture information of a touch operation;

[0018] Figure 7 A schematic diagram showing a touch operation on a target interface provided by another embodiment of the present application is shown;

[0019] Figure 8 Shown for Figure 7 A schematic diagram of gesture information of a touch operation;

[0020] Fig. 9 A method flow chart of a touch area classification method provided by another embodiment of the present application is shown;

[0021] Fig.10 A flowchart of a method for determining a touch type by a timing feature vector provided in an embodiment of the present application is shown;

[0022] Fig.11 A module block diagram of a touch area classification device provided by an embodiment of the present application is shown;

[0023] Fig.12 A structural block diagram of an electronic device provided in an embodiment of the present application is shown;

[0024] Fig.13 A storage unit for storing or carrying a program code for implementing a method for setting a reporting rate according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0025] In order to make those skilled in the art better understand the present application scheme, the technical scheme in the present application embodiment will be clearly and completely described below in conjunction with the drawings in the present application embodiment. Obviously, the described embodiment is only a part of the present application embodiment, rather than all the embodiments. The components of the present application embodiment usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiment of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0026] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0027] With the development of electronic technology, electronic devices with touch screens (Touch panel, TP) such as mobile phones and tablet computers have become widely popular, and the development of touch technology has undergone great changes. Various touch scenarios such as games and various touch scenarios have made users more and more demanding on touch. In related technologies, the reporting speed is improved to meet the user's usage needs, but the reporting stability is poor, and the screen displayed to the user on the touch screen has a jitter problem.

[0028] The user controls the electronic device by executing touch events on the touch screen, including press (down) events, lift (up) events, and slide (move) events.

[0029] Usually, applications such as game applications need to set certain operation controls to implement corresponding functions. When users click on the touch screen, different controls will trigger different responses. For example, in a game scene, the game scene is usually divided into different areas. Users use different gestures in different areas, and these areas often correspond to different operation controls. Different areas have different requirements for the operation experience of the operation gestures themselves. For example, some areas focus on hand tracking, while some areas require smoothness, click delay, accuracy, etc.

[0030] For example, the interface of a game application may include a sliding hotspot, a click hotspot, a smooth hotspot, and a shaking hotspot, wherein the user's touch operation method for the sliding hotspot is a sliding operation, the user's touch operation method for the click hotspot is a click operation, the user's touch operation method for the smooth hotspot is a sliding operation, and the user's touch operation method for the shaking hotspot is a click or sliding operation. Among them, although the touch operation methods of the sliding hotspot and the smooth hotspot are the same, the response methods of the two are different.

[0031] For example, Figure 1As shown, taking a game application as an example, the game interface of the game application is the game scene interface of the game application, and the user can operate the game character 106 in the game scene interface. The operation area in the interface includes a sliding hot zone 101, a click hot zone 102, a click hot zone 103, a smooth hot zone 105 and a shaking hot zone 104. It can be seen that the sliding hot zone 101, the click hot zone 102 and the click hot zone 103 all correspond to buttons. The user can input a sliding operation on the direction button in the sliding hot zone 101 to control the game character 106 to move in the game scene. The user can trigger the game character to perform the operation corresponding to the button by clicking the buttons of the click hot zone 102 and the click hot zone 103, for example, releasing a skill. The user can control the content displayed in the game interface to change to the adjacent content of the current content by sliding the smooth hot zone 105. For example, by inputting a sliding operation toward the right in the smooth hot zone 105, the content displayed in the game interface is changed to the adjacent content on the left side of the current content, which is equivalent to displaying the content of the left field of view of the current field of view in the game interface. The jitter hot zone 104 displays the contents of the mini-map of the current game scene. The user can add and display marked content on the mini-map by clicking on the jitter hot zone 104, and can synchronize the added content to the mini-map of the game scene displayed by the terminal of the character associated with the game character 106 in the scene. In addition, the user can also input a sliding operation in the jitter hot zone 104 to control the application to perform an operation corresponding to the sliding operation, for example, changing the game field of view content of the game scene. Usually, the smooth hot zone 105 is the area in the game interface excluding the sliding hot zone 101, the click hot zone 102, the click hot zone 103 and the jitter hot zone 104. The smooth hot zone 105 displays the picture of the game scene. Relative to the controls in the game scene, the picture of the game scene can be understood as a background picture, wherein the controls refer to the aforementioned buttons and the display frame of the mini-map.

[0032] It can be seen that both the sliding hotspot 101 and the smooth hotspot 105 respond to the sliding operation input by the user, but the response methods of the two are different. The user's sliding operation on the sliding hotspot 101 usually acts on the buttons in the sliding hotspot 101, and the sliding operation in the sliding hotspot 101 keeps pressing continuously at the end position of the sliding track, that is, the user inputs the sliding operation and keeps pressing the touch screen at the stop sliding position, then the sliding direction of the sliding operation controls the moving direction of the game character 106 in the target interface, and the duration of keeping pressing is used to control the distance that the game character 106 moves in the moving direction. The user's sliding operation in the smooth hotspot 105 is used to determine the sliding direction, and the adjacent content of the current content of the game interface is loaded into the game interface based on the sliding direction. It is usually not necessary to keep pressing the operation at the end of the sliding. In addition, both the click hot zone 103 and the shake hot zone 104 respond to click operations. The difference between the two is that the user's click operation on the click hot zone 103 is usually a touch operation input on the button in the click type 103, while the user's click operation on the shake hot zone 104 is usually a touch operation input on the display content in the shake hot zone 104, wherein the display content may be auxiliary content corresponding to the game scene, for example, it may be the mini-map content of the game scene. When the user clicks on the mini-map content, indication information may be added to the mini-map content, and the indication information may be synchronized to other users in the game scene. Of course, the mini-map content may also be enlarged or reduced.

[0033] That is to say, the content in the operation area of ​​the click hot zone is usually a button, and the display content in the jitter hot zone 104 can be the auxiliary content corresponding to the main display content of the target interface, and changes with the change of the main display content, wherein the main display content can be the background display content of the target interface, and the controls corresponding to the aforementioned sliding hot zone, click hot zone, smooth hot zone and jitter hot zone are usually located on the background layer. The main display content is the core content displayed on the target interface. For example, the main display content is the game scene content, and the auxiliary content displayed by the jitter hot zone 104 can be a picture used to assist the main display content. For example, when the main display content is the game content, the auxiliary content is the small map content corresponding to the game scene content, and the small map content is used to assist in explaining the map corresponding to the main display content and the positions of each operation object of the main display content in the game map.

[0034] However, currently, the recognition of each operation area usually adopts the method of image detection and recognition, which usually has the following disadvantages:

[0035] (1) The processing time is relatively long. Currently, commonly used target detection algorithms such as the Yo Lo series can achieve a processing speed of dozens of frames on mobile phones. This processing speed is still insufficient for game scenes, and visual processing methods are limited by the image resolution of the processing frame. The higher the resolution, the slower the processing speed. In mobile game scenes, in order to ensure smoothness, a frame rate of 120 Hz or even higher is usually used. Visual methods are basically unable to achieve real-time frame-by-frame processing.

[0036] (2) Variability of game controls. Visual methods identify game controls to determine the operation area, but the controls in the game are sometimes not the actual touch area of ​​the user. For example, in the game interface, the steering wheel control, target detection can only identify the wheel itself, but the area for directional control is much larger than the steering wheel area itself. In addition, due to the characteristics of video frames that fade in and out, the controls appear transparent in the frame, which makes visual detection difficult.

[0037] Therefore, in order to overcome the above defects, an embodiment of the present application provides a touch area classification method, which does not determine the type of the operation area by image recognition, thereby avoiding the defects caused by the above image recognition method.

[0038] See also Figure 2 , which shows a touch area classification method provided in an embodiment of the present application, the method is applied to an electronic device with a touch screen, and the method includes: S201 to S203.

[0039] S201: When the electronic device displays a target application via the touch screen, a target touch operation of a user on a target interface of the target application is detected.

[0040] Displaying the target application through the touch screen of the electronic device means that the target application is installed in the electronic device, the target application runs in the foreground of the electronic device, and the interface of the target application is displayed on the touch screen of the electronic device. The interface of the target application displayed on the touch screen of the electronic device has a touch area, that is, the user can input a touch gesture through the touch screen when the target application is displayed on the touch screen, and the touch gesture triggers the target application to perform an operation corresponding to the touch gesture.

[0041] As an implementation mode, displaying the target application through the touch screen may mean that the target interface of the target application is displayed on the touch screen. Among them, the target interface may be an interface that has high requirements for touch operation among the multiple interfaces corresponding to the target application, and may be a pre-selected interface. For example, the interface of a specified type corresponding to the target application may be used as the target interface. The specified type may be a frequently operated type. The interface of the specified type may be pre-defined by the user or the developer of the target application, and is not limited here. Taking a game application as an example, the target interface may be a game scene interface of a game application. Since the user needs to operate the character in the game scene in the game scene interface, there are high requirements for touch operation. Therefore, the touch response for the game scene interface may be optimized. Of course, the target interface may also be other interfaces of the target application, which is not limited here.

[0042] In addition, the target application may be an application that matches an application in a pre-set whitelist, and the application in the whitelist may be user-defined or pre-defined by the developer of the electronic device, and after a user of the electronic device updates the whitelist, the server of the electronic device can synchronize the whitelist to other electronic devices. Usually, the application functions in the whitelist belong to applications that are frequently touched by users, which is not limited here. In an embodiment of the present application, the target application may be a game application.

[0043] As an implementation method, the implementation method of detecting the user's target touch operation on the target interface of the target application may be, after determining that the electronic device displays the target application through the touch screen, and when determining that the target interface of the target application is displayed on the touch screen, detecting the touch operation acting on the target interface, if the touch operation is detected, recording the touch operation as a target touch operation, and recording touch information corresponding to the target touch operation, the touch information may include multiple touch position information of the target touch operation and a timestamp corresponding to each touch position information, for example, multiple touch position information of the target touch operation and a timestamp corresponding to each touch position information may be sampled at a preset sampling frequency, so as to record the touch information of the target touch operation for subsequent operations.

[0044] S202: Acquire gesture information corresponding to the target touch operation.

[0045] As an implementation mode, the gesture information is used to characterize the gesture characteristics of the touch operation, and the gesture characteristics may include touch duration, trajectory, and direction change, etc. As mentioned above, after the electronic device detects the target touch operation, the touch information of the target touch operation is recorded, so that the touch duration and touch coordinates of the target touch operation can be obtained, so that the gesture information of the target touch operation can be analyzed based on the touch information.

[0046] S203: Determine a touch type of a target operation area corresponding to the target touch operation based on the gesture information.

[0047] The target operation area corresponding to the target touch operation is determined based on the touch area of ​​the target touch operation on the touch screen. Please refer to the subsequent embodiments for details.

[0048] As before Figure 1 As shown, since the target interface includes different operation controls, some controls need to be clicked, some controls need to be slid, and the sliding methods may also be different, for example, the sliding distance, direction, and trajectory may all be different, and the touch time length may also be different. Therefore, the control characteristics of the controls of different operation types on the target interface can be analyzed in advance, so as to summarize the control characteristics of the operation area corresponding to each control, and then obtain the touch characteristics of the operation area corresponding to each operation control. When the user operates each operation control of the target interface, the gesture information of the user's touch operation usually matches the operation control. For example, if the operation control is a click control, the gesture information of the user's touch operation for the operation control usually matches the gesture characteristics of the click operation. Therefore, the target interface can be analyzed in advance to obtain different operation characteristics of each type of control, and each operation characteristic can be used as the benchmark characteristic corresponding to the target interface, so as to determine the benchmark characteristic that matches the gesture information of the target touch operation, thereby determining the operation type of the operation area corresponding to the benchmark characteristic, and then obtaining the touch type of the target operation area corresponding to the target touch operation.

[0049] It should be noted that the aforementioned sliding hotspots, click hotspots, smooth hotspots and jitter hotspots can be determined according to the types of controls corresponding to each area, and the operation types recorded here refer to the touch operation types for the operation areas corresponding to each control, which emphasizes the touch characteristics of the touch gestures for the operation areas corresponding to each control. As an implementation method, the touch operation types corresponding to the operation areas corresponding to the aforementioned operation controls can be analyzed, for example, the touch operation types corresponding to the aforementioned sliding hotspots, click hotspots, smooth hotspots and jitter hotspots, so as to determine which touch operation types the target interface corresponds to.

[0050] In the embodiment of the present application, it is assumed that the touch operation type of the sliding hot zone corresponding to the direction button is a directional sliding operation, the touch operation type of the jitter hot zone corresponding to the small map control is at least one of a short sliding operation and a click operation, the touch type corresponding to the skill key includes a short sliding operation and a click operation, and the touch operation corresponding to the smooth area is a short sliding operation. Therefore, by analyzing the target interface and counting the user's operations on each area of ​​the target interface, it can be learned that the touch operation types corresponding to each operation area of ​​the target interface may include a click operation, a short sliding operation, and a directional sliding operation, and the operation characteristics of the user's operation of each touch type area can also be obtained.

[0051] like Figure 3 As shown, taking the target application as a game application as an example, the target interface is a game scene interface. Assuming that the user clicks a certain control, for example, the control is a skill key, the user clicks the skill key once to control the game character to release the skill corresponding to the skill key. Figure 1 It can be seen that Figure 3 The click action shown is in the Figure 1 Click hotspots in , see Figure 4 , combined with Figure 4 It can be seen that the gesture information of the touch operation when the user operates the click hot zone, that is, the coordinate change information, then the type of the operation area of ​​the operation control corresponding to the aforementioned click operation can be the click type. It can be seen that the operation characteristics of the click operation for the click hot zone, that is, the operation characteristics of the click type area, are that the pressing position is fixed, that is, the coordinates are relatively fixed, and the change range is very small, that is, multiple touch points are collected in one click operation, and the change range of the distance value between the touch coordinates of each touch point is small. In addition, another operation characteristic of the click operation is that the operation time is short. Usually, the operation time of a click operation (that is, the time period from the finger being pressed to being lifted) is tens of milliseconds, which is much shorter than the operation time of a sliding operation or a long press operation.

[0052] like Figure 5 As shown, taking the target application as a game application and the target interface as a game scene interface as an example, assuming that the user slides in the small map area to change the game field of view content of the game scene, the operation in the small map area is often to slide in a short distance in one direction to switch the field of view, for example, to view the content of a certain direction around the game character. Figure 6 It can be seen that the sliding operation in the small map area belongs to the sliding gesture, and the sliding track of the sliding gesture is usually approximately a line, and the sliding direction of the sliding track is usually relatively fixed. Figure 6The touch type of the operation area corresponding to the control of the sliding operation can be named as a short sliding type, that is, the touch type of the small map area, i.e., the jitter hot zone, can include a short sliding type. The operation characteristics of the short sliding type operation area are that the operation direction is strong and the sliding trajectory is usually close to a straight line, and the touch time is greater than the touch time of the click type. It should be noted that the touch type of the jitter hot zone can also include a click type, which can be specifically determined based on the type of the target. For example, the small map area of ​​the application of the first game type supports sliding operations and clicking operations, the small map area of ​​the application of the second game type does not support sliding operations but supports clicking operations, and the small map area of ​​the application of the third game type does not support clicking operations but supports sliding operations. No specific limitation is made here.

[0053] In addition, it should be noted that, in addition to Figure 5 In addition to the short-slide type of the touch type of the jitter hot zone corresponding to the listed maps, there are other areas that belong to the short-slide type, such as the smooth hot zone and the operation area corresponding to some skill buttons. It can be understood that the user can also switch the field of view by inputting a sliding gesture in the smooth hot zone, so the characteristic type of the sliding gesture in the smooth hot zone and the sliding gesture in the jitter hot zone of the small map also belongs to the short-slide type. Some skill keys need to slide to a certain direction to release the skill when clicked. For example, clicking a skill will display an avatar that can be the target of the skill release around the skill. The user presses the skill and slides to a certain avatar to complete the skill release of the character corresponding to the avatar. The operation of this skill also has the above-mentioned short-slide type operation characteristics. Therefore, the touch type of the operation area corresponding to this part of the skill buttons also belongs to the short-slide type.

[0054] It can be understood that the strong directionality of short swipe type operations means that the short swipe operation gesture is relatively fixed. For example, to release a skill key, the user generally needs to click the skill key first, then swipe a short distance in the target direction and raise the hand. For another example, the swipe operation for the small map is usually a left-right or forward-backward swipe operation.

[0055] like Figure 7 As shown, still taking the target application as a game application and the target interface as a game scene interface as an example, suppose that the user slides in the operation area corresponding to the direction key, that is, inputs a sliding gesture in the aforementioned sliding hot zone, thereby controlling the movement of the game character. Usually, when the user controls the movement of the game character, it will take a longer time (relative to the aforementioned short sliding type) to control the movement of the character. That is to say, the duration between the moment the sliding gesture is pressed and the moment the sliding gesture is lifted is longer than that of the short sliding type, and because the direction of the character's movement is usually not fixed, the sliding trajectory is also relatively messy and irregular. For example, as Figure 8As shown, the sliding direction of the sliding track of the sliding gesture for the operation area corresponding to the direction key is usually not fixed. Figure 8 The touch type of the operation area corresponding to the sliding gesture shown can be named as the directional sliding type, that is, the touch type of the operation area corresponding to the direction key (i.e., the sliding hot zone) is the directional sliding type, and the operation characteristics of the operation area of ​​the directional sliding type are usually long operation time, large action track, and no fixed direction. In other words, the touch time of the directional sliding type is usually greater than the touch time of the short sliding type, the sliding range of the sliding track of the directional sliding type is larger, and the sliding direction is not fixed.

[0056] Therefore, it can be seen from the above distance that the operation characteristics of the operation gestures for different touch types are different, and such operation characteristics often correspond to the operation areas of different controls, so the operation characteristics can reflect the characteristics of the touch operations for different controls. Based on the different operation characteristics exhibited by different touch types, the operation characteristics of the target touch operation can be determined through the gesture information of the target touch operation, and then the touch type matching the target touch operation can be determined, so that the touch type of the target operation area corresponding to the target touch operation can be determined.

[0057] In addition, since the optimization for a certain area is usually directly related to the touch type of the area, the above analysis of the operation characteristics of the operation gestures of each operation area in the target interface can determine what types of touch types the target interface includes, so that after detecting the touch operation acting on the target interface, the touch type of the area corresponding to the touch operation is determined based on the gesture information of the touch operation, and the optimization strategy can be determined based on the touch type, so that it is not necessary to determine the touch type of each operation area in the image after identifying the screenshot of the target interface, thereby reducing the complexity of the algorithm. Therefore, the touch type of the operation area corresponding to the gesture operation can be determined through the gesture information of the touch operation input by the user, that is, the area of ​​the target interface can be classified through the operation of the target interface, which can reduce the complexity of the area classification operation.

[0058] See also Fig. 9 , which shows a touch area classification method provided in an embodiment of the present application, the method is applied to an electronic device with a touch screen, and the method includes: S910 to S950.

[0059] S910: When the electronic device displays a target application through the touch screen, a target touch operation of a user on a target interface of the target application is detected.

[0060] S920: Acquire a touch duration corresponding to the target touch operation and a plurality of touch position information within the touch duration.

[0061] In an embodiment of the present application, the gesture information corresponding to the aforementioned target touch operation includes the touch duration and multiple touch position information within the touch duration. Among them, the touch duration can be the cumulative duration from the moment the user's finger is pressed on the target interface, and the cumulative duration ends when the finger is lifted from the target interface. Therefore, the touch duration can be the length of time from pressing to lifting, that is, recording the start time and the end time, and taking the time difference between the two as the touch duration. Therefore, in an embodiment of the present application, the implementation method for obtaining the gesture information corresponding to the target touch operation can be, when it is detected that the target touch operation ends, that is, when the finger corresponding to the finger ID of the target touch operation is lifted from the touch screen, the gesture information corresponding to the target touch operation is obtained, that is, the touch duration and the multiple touch position information within the touch duration are determined.

[0062] It should be noted that, after the target touch operation is detected, an identity is assigned to the target touch operation, and the gesture information of the target touch operation is stored corresponding to the identity of the target touch operation, and the identity of the target touch operation is the finger ID corresponding to the target touch operation, that is, the target finger ID. The touch screen usually uses multi-touch technology to realize the recognition and tracking of multiple fingers. When multiple fingers touch the touch screen at the same time, each finger will be assigned a unique finger ID so that the system can distinguish and track their positions. In most cases, the identification and tracking of finger IDs are completed by the operating system or device driver, and the application does not need to directly process the finger ID. Different operating systems may provide different finger ID recognition methods. For the Android system, the Android operating system usually detects and tracks finger touch events through the MotionEvent object. In each touch event, the getPointerId(int pointer Index) method can be used to obtain the unique ID of the finger. The parameter pointer Index of this method represents the index of the finger, 0 represents the first finger, 1 represents the second finger, and so on.

[0063] As an implementation method, the gesture information can be a timing feature vector, which includes multiple touch coordinates and the touch coordinates correspond to a time sequence number. The timing feature vector is obtained by sorting the multiple touch coordinates based on the time sequence number. In addition, the timing feature vector corresponds to the finger ID corresponding to the target touch operation, so that the gesture information corresponding to the finger ID can be obtained.

[0064] S930: Determine a touch position change range based on the touch position information within the touch duration.

[0065] As an implementation method, a method for determining the touch position change range may be to determine the starting position information and the end position information from multiple touch position information, wherein the starting position information may be the touch position information first collected during the duration of this touch, which corresponds to the first position point when the user presses the finger on the touch screen, and the end position information may be the last touch position information collected for the target touch operation, which corresponds to the last touch point collected before the user lifts his finger from the touch screen, and the Euclidean distance between the starting position information and the end position information is obtained, and the Euclidean distance is used as the touch position change range.

[0066] As another implementation manner, the touch position variation range may be determined by determining a coverage area of ​​a plurality of touch position information to determine the coverage range. For example, the plurality of touch position information corresponds to coordinate points of a screen coordinate system (XOY), wherein an X axis and a Y axis correspond to two adjacent sides of the touch screen. The maximum X coordinate value and the minimum X coordinate value, the maximum Y coordinate value and the minimum Y coordinate value in all the plurality of touch position information are counted, so that a first length in the X direction and a second length in the Y direction can be determined. Based on the first length and the second length, an area of ​​a rectangular region can be determined. The area of ​​the rectangular region is used as the touch position variation range.

[0067] S940: If the touch duration is less than or equal to the first time threshold and the touch position change range is less than the first range threshold, determine that the touch type of the target operation area corresponding to the target touch operation is a click type.

[0068] As mentioned above, the operating characteristics of the click operation, that is, the operating characteristics of the click type operation area, are that the pressing position is fixed and the operation time is short. Therefore, after obtaining the touch duration and touch position change range of the target touch operation, it is determined whether the touch duration belongs to the aforementioned short operation time characteristic, and whether the touch position change range belongs to the fixed pressing position characteristic.

[0069] Exemplarily, a first time threshold may be pre-set, and the first time threshold is used to characterize the duration length of a single click operation. For example, the duration of the click operation of the user's historical operation target interface may be pre-acquired, and the first time threshold may be obtained based on the duration statistics of the historical click operation. Of course, the first time threshold may also be an empirical value set based on experience. Therefore, if the touch duration is less than or equal to the first time threshold, it characterizes that the target touch operation satisfies the time characteristic of "short operation time" of the click operation. Similarly, the first range threshold may also be determined based on the historical touch position change range of the click operation of the user's historical operation target interface obtained in advance, or the first range threshold may be set based on experience. If the touch position change range is less than the first range threshold, it is determined that the target touch operation satisfies the position change characteristic of "fixed pressing position" of the click operation.

[0070] Therefore, when the touch duration is less than or equal to the first time threshold and the touch position change range is less than the first range threshold, it indicates that the target touch operation simultaneously satisfies the time characteristics and position change characteristics of the operation gesture (i.e., click operation) for the click type operation area. Therefore, it can be determined that the operation area corresponding to the user's target touch operation is the click type operation area, that is, the user is operating the click hot zone and other areas that need to trigger the corresponding function through a click operation, and then determine that the touch type of the target operation area corresponding to the target touch operation is the click type.

[0071] S950: If the touch duration is greater than the first time threshold and the touch position variation range is greater than the first range threshold, determine based on the target information that the touch type of the target operation area corresponding to the target touch operation is a preset sliding type.

[0072] It can be understood that, since the click type can be identified by the first time threshold and the first range threshold mentioned above, when the touch duration is greater than the first time threshold and the touch position variation range is greater than the first range threshold, it can be determined that the touch type of the target operation area does not belong to the click type. Therefore, when it is known that the area types corresponding to the target interface include click type, short slide type and directional slide type, it can be assumed that the short slide type and directional slide type are preset slide types. Therefore, if the touch duration is greater than the first time threshold and the touch position variation range is greater than the first range threshold, the touch type of the target operation area corresponding to the target touch operation is determined to be the preset slide type based on the target information, so that the click type can be distinguished from other types through the touch duration and the touch position variation range.

[0073] As mentioned above, the operating characteristics of the short sliding type operating area are that the operation direction is strong and the sliding trajectory is usually close to a straight line, and the operating characteristics of the directional sliding type operating area are usually long operation time, large action trajectory, and no fixed direction. That is to say, the touch time of the directional sliding type is usually greater than the touch time of the short sliding type, the sliding range of the sliding trajectory of the directional sliding type is larger, and the sliding direction is not fixed.

[0074] Therefore, it can be seen that there are differences in the touch duration, sliding distance, touch position variation range and sliding direction of the short sliding type and the directional sliding type. Therefore, the short sliding type and the directional sliding type can be identified and distinguished through these four dimensions, namely, touch duration, sliding distance, touch position variation range and sliding direction. Therefore, the target information includes at least one of the touch duration and the sliding information, wherein the sliding information is determined based on the touch position information, and includes at least one of the sliding direction, sliding trajectory and touch position variation range. In other words, the four dimensions can be used alone to determine whether the touch type of the target operation area corresponding to the target touch operation is a short sliding type or a directional sliding type, or at least two of them can be combined to determine whether the touch type of the target operation area is a short sliding type or a directional sliding type.

[0075] It should be noted that the preset sliding type includes a first sliding type and a second sliding type. For example, the first sliding type is the short sliding type, and the second sliding type is the directional sliding type. However, it should be understood that the embodiments of the present application are not limited to the short sliding type and the directional sliding type. As long as the two different sliding types can be distinguished by the aforementioned target information, for example, assuming that the duration of the two sliding types is the same, but the sliding trajectories are different, then one of the sliding types may not be a short sliding type, but may be named otherwise.

[0076] The following will explain implementation methods of determining the first sliding type or the second sliding type one by one.

[0077] In the first way, it is assumed that there is a large difference between the touch durations of the first sliding type and the second sliding type, for example, the touch duration of the directional sliding type is greater than the touch duration of the short sliding type. Then, the target information includes the touch duration, and the implementation method of determining the touch type of the target operation area corresponding to the target touch operation as the preset sliding type based on the target information is: if the touch duration is greater than the first time threshold and less than the second time threshold, the touch type of the target operation area corresponding to the target touch operation is determined to be the first sliding type; if the touch duration is greater than or equal to the second time threshold, the touch type of the target operation area corresponding to the target touch operation is determined to be the second sliding type. Among them, the determination method of the first time threshold can refer to the above description, and the second time threshold can be determined based on the touch duration of the user's operation gesture on the operation area of ​​the first sliding type. For example, the second time threshold can be the maximum touch duration of the user's operation gesture on the operation area of ​​the first sliding type. Therefore, the first sliding type and the second sliding type can be distinguished by the second time threshold.

[0078] In the second mode, assuming that there is a large difference in at least one of the sliding direction, sliding trajectory and touch position change range between the first sliding type and the second sliding type, that is, in addition to the touch duration, other information related to the change of touch coordinates can also be used to determine the first sliding type and the second sliding type, then at least one of the sliding direction, sliding trajectory and touch position change range is named sliding information, and the implementation method of determining the touch type of the target operation area corresponding to the target touch operation as the preset sliding type based on the target information can be that if the sliding information satisfies the first preset sliding condition, the touch type of the target operation area corresponding to the target touch operation is determined to be the first sliding type; if the sliding information satisfies the second preset sliding condition, the touch type of the target operation area corresponding to the target touch operation is determined to be the first sliding type. Among them, the setting of the first preset sliding condition and the second preset sliding condition can be determined based on the actual operation characteristics of the first sliding type and the second sliding type. For example, in the case of different implementations of the sliding information, the setting methods of the first preset sliding condition and the second preset sliding condition are also different. Therefore, based on different implementations of the sliding information, the second method for determining whether the sliding information satisfies the first preset sliding condition or the second preset sliding condition is different. Specifically, it can be divided into method 2.1, method 2.2, method 2.3 and method 2.4.

[0079] Exemplarily, in the method 2.1, the sliding information includes a sliding direction, and the method of determining whether the sliding information satisfies the first preset sliding condition or the second preset sliding condition is that if the sliding direction is single, the sliding information is determined to satisfy the first preset sliding condition; if the sliding direction is variable, the sliding information is determined to satisfy the second preset sliding condition. The sliding direction can be determined by curve fitting of multiple touch position information within the touch duration. Assuming that the first sliding type is a short sliding type and the second sliding type is a directional sliding type, as mentioned above, the sliding direction of the short sliding type is often relatively single, while the sliding direction of the directional sliding type is often relatively complex, so the two can be distinguished by the sliding direction.

[0080] Exemplarily, in the 2.2 mode, the sliding information includes a sliding trajectory, and the mode of determining whether the sliding information satisfies the first preset sliding condition or the second preset sliding condition is that if the sliding trajectory matches the first trajectory, the sliding information is determined to satisfy the first preset sliding condition; if the sliding trajectory matches the second trajectory, the sliding information is determined to satisfy the second preset sliding condition. The sliding trajectory can also be determined by fitting a plurality of touch position information within the touch duration. Assuming that the first sliding type is a short sliding type and the second sliding type is a directional sliding type, as mentioned above, there is a large difference between the sliding trajectory of the short sliding type and the sliding trajectory of the directional sliding type. For example, the sliding trajectory of the short sliding type is often a straight line, while the sliding trajectory of the directional sliding type is often a messy line segment. Therefore, the sliding trajectory corresponding to the first sliding type can be pre-counted as the first trajectory. For example, the sliding trajectory of the sliding gesture of the user in the operation area belonging to the first sliding type in the historical operation data within the preset time period is counted, and the plurality of sliding trajectories are counted to obtain N trajectories that appear frequently as the first trajectory. Similarly, the second trajectory can also be counted in this way.

[0081] Exemplarily, in the method 2.3, the sliding information includes a touch position variation range, and the method for determining whether the sliding information satisfies the first preset sliding condition or the second preset sliding condition is that if the touch position variation range is greater than the first range threshold and less than the second range threshold, then the sliding information is determined to satisfy the first preset sliding condition; if the touch position variation range is greater than the second range threshold, then the sliding information is determined to satisfy the second preset sliding condition. Assuming that the first sliding type is a short sliding type and the second sliding type is a directional sliding type, as mentioned above, there is a large difference between the touch position variation range of the short sliding type and the touch position variation range of the directional sliding type. It can be seen that the touch position variation range of the directional sliding type is greater than the touch position variation range of the short sliding type.

[0082] It should be noted that since the sliding direction of the directional sliding type is not fixed, it is possible that the Euclidean distance between the starting point position information and the end point position information of the short sliding type and the directional sliding type is not much different. Therefore, in order to more easily distinguish the two, the method of determining the touch position change range can be based on the aforementioned coverage area of ​​multiple touch position information, that is, it is determined by the area of ​​the rectangular area.

[0083] Exemplarily, the method 2.4 is at least two of the methods 2.1, 2.2, and 2.3. For example, the method 2.4 is the methods 2.1 and 2.2. Then, the method for determining whether the sliding information satisfies the first preset sliding condition or the second preset sliding condition is that if the sliding direction is single and if the sliding track matches the first track, then the sliding information is determined to satisfy the first preset sliding condition; if the sliding direction is variable and the sliding track matches the second track, then the sliding information is determined to satisfy the second preset sliding condition. Other combinations can refer to the combination of the methods 2.1 and 2.2, which will not be described in detail here.

[0084] The third method is a combination of the first method and the second method mentioned above, that is, the target information includes the touch duration and the sliding information, the preset sliding type includes a first sliding type and a second sliding type, and the implementation method of determining the touch type of the target operation area corresponding to the target touch operation as the preset sliding type based on the target information is as follows: if the touch duration is greater than the first time threshold and less than the second time threshold, and the sliding information satisfies the first preset sliding condition, then the touch type of the target operation area corresponding to the target touch operation is determined to be the first sliding type; if the touch duration is greater than or equal to the second time threshold, and the sliding information satisfies the second preset sliding condition, then the touch type of the target operation area corresponding to the target touch operation is determined to be the first sliding type.

[0085] It should be noted that, in the method of determining the touch type of the target operation area corresponding to the target touch operation, the target operation area corresponding to the target touch operation can be the area determined by the starting touch point of the target touch operation, or it can be the area range determined by the ending touch point, or it can be the area determined based on all touch points. Exemplarily, after the touch type is determined based on the gesture information of the target touch operation, the target operation area corresponding to the target touch operation is determined, and then the aforementioned determined touch type is set for the target operation area. Among them, the target operation area corresponding to the target touch operation can be determined based on the touch area of ​​the target touch operation on the touch screen.

[0086] As an implementation method, if the touch duration is less than or equal to a first time threshold and the touch position change range is less than a first range threshold, the area corresponding to the initial touch position of the target touch operation is used as the target operation area corresponding to the target touch operation, and then the touch type of the target operation area is set to a click type.

[0087] It can be understood that, when the touch duration is less than or equal to the first time threshold and the touch position change range is less than the first range threshold, it can be determined that the area operated by the target touch operation belongs to the click type. Considering that when the user inputs a click operation, the click position is usually fixed, so any touch position information collected within the touch duration of the target touch operation can be used as a reference point, and the target operation area is determined based on the reference point, wherein the area within the preset range of the reference point is used as the target operation area, for example, a circular area with the reference point as the center and a specified number of pixels as the radius. In the embodiment of the present application, the reference point can be the starting touch point of the target touch operation.

[0088] As another implementation, if the touch duration is greater than a first time threshold and the touch position change range is greater than a first range threshold, the areas corresponding to each touch position information of the target touch operation are integrated to obtain a target operation area corresponding to the target touch operation; based on the target information, the touch type of the target operation area corresponding to the target touch operation is determined to be a preset sliding type.

[0089] It can be understood that, when the touch duration is greater than the first time threshold and the touch position change range is greater than the first range threshold, it can be determined that the area operated by the target touch operation belongs to the sliding type. The sliding type may be the first sliding type or the second sliding type, but belongs to the general category of the preset sliding type. For the sliding type, all touch areas of the target touch operation within the touch duration can be integrated to obtain a new area as the target operation area.

[0090] In addition, as mentioned above, the gesture information may be a time series feature vector, that is, the gesture information is a time series feature vector, and the time series feature vector includes a plurality of touch position information corresponding to the target touch operation.

[0091] Exemplarily, the touch position information refers to the touch coordinates, and the feature information of each frame is extracted, including but not limited to information such as finger ID, touch coordinates, game frame settings, etc., so as to construct a time series feature vector. It is understandable that when a touch operation is performed on the screen, the system will continuously collect and update the information of the touch point at a certain frequency. These continuous sampling data form a frame of the touch signal (Frame), also known as a frame of a touch event. The frame of the touch signal represents the state and properties of the touch point within a continuous frame. Each touch frame usually contains the following information: a frame timestamp, which records the time point when the frame data is collected; the number of touch points, which records the number of touch points in the current frame, that is, the number of fingers touching the screen at the same time. In an embodiment of the present application, the target touch operation corresponds to a touch operation of a finger ID. Among them, the game frame setting can be to extract relevant setting information of the current game frame, such as game scene, game state, game character, game interface layout, etc. The above feature information is combined into a time series signal feature. It can be considered to use a time window or a fixed time interval to divide the feature sequence. For example, a feature is extracted every 100 milliseconds. As for the finger ID and touch coordinates, they can be regarded as part of the feature sequence and arranged in time order to obtain a time series feature vector.

[0092] As an implementation method, the implementation method of determining the touch type of the target operation area corresponding to the target touch operation based on the gesture information may be inputting the time series feature vector into a pre-trained classification model, and determining the touch type of the target operation area corresponding to the target touch operation through the classification model.

[0093] For example, Fig.10 As shown, taking the target application as an example, when the game is started, the game type is determined, where the game start may refer to the target interface of the game application being displayed on the touch screen. As mentioned above, since the area types of the operating areas contained in the target interfaces of different types of applications may be different, the recognition logic of the area types of different interfaces may also be different. Due to the difference in games, the data used in the model training phase are different, resulting in differences in the algorithm models trained. Therefore, it is necessary to determine the game type first, and then determine the algorithm model corresponding to the game type.

[0094] During the running of the game, it is continuously detected whether the user has a touch pressing operation, that is, whether there is a touch operation acting on the target interface. If so, the user's touch information is obtained, and then the timing signal feature is constructed in the above manner, that is, the timing feature vector, and input into the LSTM algorithm module (that is, the pre-trained classification model mentioned above). The LSTM algorithm module is pre-trained and based on the recognition logic of the different operation types mentioned above, it can determine the touch type of the operation area corresponding to the touch operation based on the timing feature vector.

[0095] like Fig.10 As shown, after determining that the finger of the target touch operation is lifted, the touch type of the operation area corresponding to the target touch operation is output. At the same time, the area information of the gesture, that is, the area position information of the target operation area, can also be determined in combination with the gesture trajectory.

[0096] It should be noted that the time series signal composed of the feature information collected in each frame is directly input into the LSTM algorithm module. The LSTM algorithm has long-term memory capability, that is, by introducing a gating mechanism, it can effectively capture and store long-term dependencies. By using forget gates, input gates, and output gates, information can be selectively forgotten, added, or output, so that relevant historical information can be better retained and utilized when processing sequence data. Therefore, even the time series feature vector of the current frame processed this time may refer to the historical time series feature vector.

[0097] In addition, for electronic devices such as mobile phones, the user's touch information is a very important personal resource. Combined with other information of the electronic device and the user's personal data, it can be used to improve the user's experience and enrich the user's personal portrait. For example, the embodiment of the present application provides the extraction of game area information through touch information. In addition, in the game scene, by comparing the touch trajectory with the game master, suggestions for improving the user's game can be given. In the game scene, by analyzing the user's touch trajectory, the user's optimal touch parameters are adaptively given. When users browse e-commerce products, some prefer product evaluation, and some prefer exquisite product displays. According to the user's preferences or browsing areas, the user's touch experience is identified or optimized.

[0098] Therefore, the embodiment of the present application can determine the touch type of the operation area corresponding to the touch operation by analyzing the gesture information of the current touch operation based on the operation characteristics of the touch operation of each touch type. Compared with the solution of determining the touch type of the operation area by analyzing the image of the target interface, its calculation is simple, can adapt to high frame rates such as game scenes, and can be applied to the user self-adjustment mode of the game control area, etc., and is not affected by the transparent control of the game frame screen. In addition, the use of the LSTM algorithm is not affected by the phenomenon of long timing signals caused by the user pressing for too long, and can be processed frame by frame.

[0099] See also Fig.11 , which shows a structural block diagram of a touch area classification device 1100 provided in an embodiment of the present application. The device may include: a detection unit 1101, an acquisition unit 1102 and a determination unit 1103.

[0100] The detection unit 1101 is configured to detect a target touch operation of a user on a target interface of a target application when the electronic device displays the target application via the touch screen.

[0101] The acquisition unit 1102 is used to acquire gesture information corresponding to the target touch operation.

[0102] The determining unit 1103 is configured to determine a touch type of a target operation area corresponding to the target touch operation based on the gesture information.

[0103] Furthermore, the gesture information includes touch duration and multiple touch position information within the touch duration, and the determination unit 1103 is also used to determine the touch position change range based on the touch position information within the touch duration; if the touch duration is less than or equal to the first time threshold and the touch position change range is less than the first range threshold, then the touch type of the target operation area corresponding to the target touch operation is determined to be a click type.

[0104] Furthermore, the determination unit 1103 is also used to use the area corresponding to the initial touch position of the target touch operation as the target operation area corresponding to the target touch operation if the touch duration is less than or equal to the first time threshold and the touch position change range is less than the first range threshold; and set the touch type of the target operation area to a click type.

[0105] Furthermore, the gesture information includes a touch duration and multiple touch position information within the touch duration, and the determination unit 1103 is also used to determine the touch position change range based on the touch position information within the touch duration; if the touch duration is greater than a first time threshold and the touch position change range is greater than a first range threshold, the touch type of the target operation area corresponding to the target touch operation is determined to be a preset sliding type based on the target information, wherein the target information includes at least one of the touch duration and the sliding information, wherein the sliding information is determined based on the touch position information, and includes at least one of a sliding direction, a sliding trajectory and a touch position change range.

[0106] Furthermore, the target information includes touch duration, the preset sliding type includes a first sliding type and a second sliding type, and the determination unit 1103 is also used to determine that the touch type of the target operation area corresponding to the target touch operation is the first sliding type if the touch duration is greater than the first time threshold and less than the second time threshold; if the touch duration is greater than or equal to the second time threshold, determine that the touch type of the target operation area corresponding to the target touch operation is the second sliding type.

[0107] Further, the target information includes sliding information, and the preset sliding type includes a first sliding type and a second sliding type. The determination unit 1103 is also used to determine that the touch type of the target operation area corresponding to the target touch operation is the first sliding type if the sliding information satisfies the first preset sliding condition; if the sliding information satisfies the second preset sliding condition, determine that the touch type of the target operation area corresponding to the target touch operation is the first sliding type.

[0108] Furthermore, the target information includes the touch duration and the sliding information, the preset sliding type includes a first sliding type and a second sliding type, and the determination unit 1103 is also used to determine that the touch type of the target operation area corresponding to the target touch operation is the first sliding type if the touch duration is greater than the first time threshold and less than the second time threshold, and the sliding information satisfies the first preset sliding condition; if the touch duration is greater than or equal to the second time threshold, and the sliding information satisfies the second preset sliding condition, then determine that the touch type of the target operation area corresponding to the target touch operation is the first sliding type.

[0109] Furthermore, the sliding information includes a sliding direction, and the determination unit 1103 is further configured to determine that the sliding information satisfies a first preset sliding condition if the sliding direction is single, and to determine that the sliding information satisfies a second preset sliding condition if the sliding directions are variable.

[0110] Further, the sliding information includes a sliding trajectory, and the determining unit 1103 is further configured to determine that the sliding information satisfies a first preset sliding condition if the sliding trajectory matches a first trajectory; and determine that the sliding information satisfies a second preset sliding condition if the sliding trajectory matches a second trajectory.

[0111] Furthermore, the sliding information includes a touch position change range, and the determination unit 1103 is also used to determine that the sliding information satisfies a first preset sliding condition if the touch position change range is greater than a first range threshold and less than a second range threshold; if the touch position change range is greater than the second range threshold, then determine that the sliding information satisfies a second preset sliding condition.

[0112] Furthermore, the determination unit 1103 is also used to integrate the areas corresponding to each touch position information of the target touch operation to obtain the target operation area corresponding to the target touch operation if the touch duration is greater than a first time threshold and the touch position change range is greater than a first range threshold; and determine based on the target information that the touch type of the target operation area corresponding to the target touch operation is a preset sliding type.

[0113] Furthermore, the gesture information is a timing feature vector, which includes multiple touch position information corresponding to the target touch operation. The determination unit 1103 is also used to input the timing feature vector into a pre-trained classification model; and determine the touch type of the target operation area corresponding to the target touch operation through the classification model.

[0114] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0115] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0116] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0117] Please refer to Fig.12 , which shows a structural block diagram of an electronic device provided in an embodiment of the present application. The electronic device 100 may be an electronic device capable of running applications, such as a smart phone, a tablet computer, an e-book, etc. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

[0118] The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor 110 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0119] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0120] Please refer to Fig.13 , which shows a structural block diagram of a computer-readable medium provided in an embodiment of the present application. The computer-readable medium 1300 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0121] The computer readable medium 1300 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable medium 1300 includes a non-transitory computer-readable storage medium. The computer readable medium 1300 has storage space for program code 1310 that executes any method step in the above method. These program codes can be read from or written to one or more computer program products. The program code 1310 can be compressed, for example, in an appropriate form.

[0122] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A touch area classification method, characterized in that: A touch screen applied to an electronic device, the method comprising: When the electronic device displays a target application through the touch screen, detecting a target touch operation of a user on a target interface of the target application; Acquire gesture information corresponding to the target touch operation; A touch type of a target operation area corresponding to the target touch operation is determined based on the gesture information.

2. The method according to claim 1, characterized in that: The gesture information includes a touch duration and a plurality of touch position information within the touch duration, and determining the touch type of the target operation area corresponding to the target touch operation based on the gesture information includes: Determine a touch position change range based on touch position information within a touch duration; If the touch duration is less than or equal to the first time threshold and the touch position variation range is less than the first range threshold, it is determined that the touch type of the target operation area corresponding to the target touch operation is a click type.

3. The method according to claim 2, characterized in that If the touch duration is less than or equal to the first time threshold and the touch position change range is less than the first range threshold, determining that the touch type of the target operation area corresponding to the target touch operation is a click type includes: If the touch duration is less than or equal to the first time threshold and the touch position variation range is less than the first range threshold, taking the area corresponding to the initial touch position of the target touch operation as the target operation area corresponding to the target touch operation; The touch type of the target operation area is set to a click type.

4. The method according to claim 1, characterized in that The gesture information includes a touch duration and a plurality of touch position information within the touch duration, and determining the touch type of the target operation area corresponding to the target touch operation based on the gesture information includes: Determine a touch position change range based on touch position information within a touch duration; If the touch duration is greater than a first time threshold and the touch position change range is greater than a first range threshold, the touch type of the target operation area corresponding to the target touch operation is determined to be a preset sliding type based on target information, wherein the target information includes at least one of the touch duration and sliding information, wherein the sliding information is determined based on the touch position information, and includes at least one of a sliding direction, a sliding trajectory and a touch position change range.

5. The method according to claim 4, characterized in that The target information includes a touch duration, the preset sliding type includes a first sliding type and a second sliding type, and determining, based on the target information, that the touch type of the target operation area corresponding to the target touch operation is the preset sliding type, includes: If the touch duration is greater than the first time threshold and less than the second time threshold, determining that the touch type of the target operation area corresponding to the target touch operation is the first sliding type; If the touch duration is greater than or equal to a second time threshold, it is determined that the touch type of the target operation area corresponding to the target touch operation is a second sliding type.

6. The method according to claim 4, characterized in that The target information includes sliding information, the preset sliding type includes a first sliding type and a second sliding type, and determining, based on the target information, that the touch type of the target operation area corresponding to the target touch operation is the preset sliding type, includes: If the sliding information satisfies a first preset sliding condition, determining that the touch type of the target operation area corresponding to the target touch operation is a first sliding type; If the sliding information satisfies the second preset sliding condition, it is determined that the touch type of the target operation area corresponding to the target touch operation is the first sliding type.

7. The method according to claim 4, characterized in that The target information includes the touch duration and the sliding information, the preset sliding type includes a first sliding type and a second sliding type, and determining the touch type of the target operation area corresponding to the target touch operation as the preset sliding type based on the target information includes: If the touch duration is greater than the first time threshold and less than the second time threshold, and the sliding information satisfies the first preset sliding condition, determining that the touch type of the target operation area corresponding to the target touch operation is the first sliding type; If the touch duration is greater than or equal to a second time threshold, and the sliding information satisfies a second preset sliding condition, it is determined that the touch type of the target operation area corresponding to the target touch operation is a first sliding type.

8. The method according to claim 6 or 7, characterized in that: The sliding information includes a sliding direction, and the method further includes: If the sliding direction is single, determining that the sliding information satisfies a first preset sliding condition; If the sliding direction is changeable, it is determined that the sliding information satisfies a second preset sliding condition.

9. The method according to claim 6 or 7, characterized in that: The sliding information includes a sliding track, and the method further includes: If the sliding track matches the first track, determining that the sliding information satisfies a first preset sliding condition; If the sliding track matches the second track, it is determined that the sliding information satisfies a second preset sliding condition.

10. The method according to claim 6 or 7, characterized in that: The sliding information includes a touch position variation range, and the method further includes: If the touch position change range is greater than the first range threshold and less than the second range threshold, it is determined that the sliding information meets the first preset sliding condition; If the touch position change range is greater than a second range threshold, it is determined that the sliding information meets a second preset sliding condition.

11. The method according to claim 4, characterized in that If the touch duration is greater than a first time threshold and the touch position variation range is greater than a first range threshold, determining based on the target information that the touch type of the target operation area corresponding to the target touch operation is a preset sliding type, including: If the touch duration is greater than a first time threshold and the touch position variation range is greater than a first range threshold, integrating regions corresponding to each touch position information of the target touch operation to obtain a target operation region corresponding to the target touch operation; The touch type of the target operation area corresponding to the target touch operation is determined to be a preset sliding type based on the target information.

12. The method according to claim 1, characterized in that The gesture information is a time series feature vector, the time series feature vector includes a plurality of touch position information corresponding to the target touch operation, and the determining the touch type of the target operation area corresponding to the target touch operation based on the gesture information includes: Inputting the time series feature vector into a pre-trained classification model; The touch type of the target operation area corresponding to the target touch operation is determined by the classification model.

13. A touch area classification device, characterized in that: A touch screen applied to an electronic device, the device comprising: A detection unit, configured to detect a target touch operation of a user on a target interface of a target application when the electronic device displays the target application through the touch screen; An acquisition unit, used to acquire gesture information corresponding to the target touch operation; A determination unit is used to determine a touch type of a target operation area corresponding to the target touch operation based on the gesture information.

14. An electronic device, characterized in that: include: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the method according to any one of claims 1-12.

15. A computer readable medium, characterized in that The computer-readable medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the method according to any one of claims 1 to 12.

Images