Touch control method, device, electronic device and storage medium

By generating a touch image and using image feature information to correct the touch area and adjusting the virtual keyboard display method, the problem of frequent misoperation in electronic devices is solved, and operation accuracy and convenience are improved.

CN114968060BActive Publication Date: 2024-11-08BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210471420.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-28
Publication Date
2024-11-08
Estimated Expiration
2042-04-28

AI Technical Summary

Technical Problem

In the interactive operation of existing electronic devices on touch screens, as the functions increase, the possibility of misoperation increases, resulting in a decrease in operation accuracy.

Method used

By generating a touch image, using image feature information to correct the touch area and adjust the display content of the touch screen, determine the user's finger target area, and adjust the display method of the virtual keyboard to improve operation accuracy.

Benefits of technology

It effectively reduces mist touch control operations, improves the accuracy and operation convenience of user input, and is suitable for various electronic devices such as mobile phones and tablets.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114968060B_ABST
    Figure CN114968060B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a touch method, device, electronic device and storage medium, and to the field of interactive technology. A user performs a touch operation based on a touch screen, and in response to the touch operation, a touch image showing a touch area is generated, and then the touch area is corrected according to image feature information of the touch image, thereby improving the accuracy of the operation, and / or adjusting the display mode of the display content of the touch screen, which is convenient for the user to input and also improves the accuracy of the operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of interactive technology, and in particular to a touch control method, device, electronic device and storage medium. Background Art

[0002] Most of the current electronic devices interact through the user's touching the touch screen. With the development of technology, the touch feedback accuracy of the touch screen is getting higher and higher. With the increase in the functions of electronic devices, the number of interactive controls applied on the same touch screen is also increasing. When users use electronic devices, the possibility of users' misoperation of the touch screen increases. Therefore, how to improve the accuracy of touch operation has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a touch method, device, electronic device and storage medium, aiming to solve the above technical problems.

[0004] According to a first aspect of an embodiment of the present disclosure, a touch method is provided, comprising: generating a touch image in response to a user's touch operation on a touch screen, the touch image including an image of a touch area on the touch screen; and correcting the touch area and / or adjusting the display mode of the display content of the touch screen according to image feature information of the touch image.

[0005] Optionally, the correcting the touch area according to image feature information of the touch image includes: determining a target area touched by the user's finger from the touch area according to the image feature information; and correcting the touch area to the target area.

[0006] Optionally, determining the target area touched by the user's finger from the touch area based on the image feature information includes: when the touch area includes two separate touch areas, determining the target area touched by the user's finger based on shape feature information of the image of each of the touch areas; or, when the touch area is a connected area, determining a touch gesture for generating the touch area based on the image feature information, determining a holding direction based on the touch gesture, and segmenting the touch area according to a preset ratio, and obtaining the segmented area on the side opposite to the holding direction as the target area.

[0007] Optionally, generating a touch image in response to a user's touch operation on the touch screen includes: responding to the user's touch operation on a virtual keyboard on the touch screen; adjusting the display mode of the display content of the touch screen according to image feature information of the touch image includes: adjusting the display mode of the virtual keyboard on the touch screen according to image feature information of the touch image.

[0008] Optionally, adjusting the display mode of the virtual keyboard on the touch screen according to image feature information of the touch image includes: determining a touch gesture that generates the touch area according to the image feature information; and if the touch gesture is characterized by a single-hand touch, adjusting the display mode of the virtual keyboard on the touch screen.

[0009] Optionally, adjusting the display mode of the virtual keyboard on the touch screen includes: reducing the size of the virtual keyboard; and displaying the reduced virtual keyboard at a display position determined on the touch screen according to the touch gesture.

[0010] Optionally, the virtual keyboard includes multiple controls, and adjusting the display mode of the virtual keyboard on the touch screen includes: determining a first category of controls, a second category of controls, and a third category of controls from the multiple controls on the virtual keyboard according to the touch gesture, wherein the first category of controls are controls in the hand-holding direction on the touch screen, and the second category of controls are controls on the side of the touch screen opposite to the hand-holding direction; while the size of the virtual keyboard remains unchanged, controlling the size of the first category of controls to be reduced, the size of the second category of controls to be enlarged, and the size of the third category of controls to remain unchanged.

[0011] Optionally, the virtual keyboard includes multiple controls, and adjusting the display mode of the virtual keyboard on the touch screen includes: determining a target control from the multiple controls on the virtual keyboard; deleting controls except the target control from the multiple controls, and retaining the target control as a new virtual keyboard; and enlarging the target control on the new virtual keyboard while keeping the size of the virtual keyboard unchanged.

[0012] Optionally, before correcting the touch area and / or adjusting the display mode of the display content of the touch screen according to the image feature information of the touch image, the method further includes: extracting the image feature information of the touch image.

[0013] Optionally, extracting the image feature information of the touch image includes: segmenting the touch image to obtain an edge image; extracting features of the edge image to obtain the first feature information; extracting features of the touch image to obtain the second feature information; and splicing the first feature information and the second feature information to obtain the image feature information.

[0014] Optionally, extracting image feature information of the touch image includes: generating multiple anchor frames in the touch image; and performing feature extraction on each of the multiple anchor frames on the touch image to obtain image feature information of the multiple anchor frames.

[0015] Optionally, determining the touch gesture for generating the touch area according to the image feature information includes: recognizing the image feature information of the multiple anchor frames through a first fully connected layer to obtain the position information of each anchor frame in the multiple anchor frames; recognizing the image feature information of the multiple anchor frames through a second fully connected layer to obtain the touch gesture of each anchor frame in the multiple anchor frames; and processing the position information of each anchor frame in the multiple anchor frames and the touch gesture of each anchor frame in the multiple anchor frames according to a classifier to obtain the touch gesture for generating the touch area.

[0016] According to a second aspect of an embodiment of the present disclosure, a touch device is provided, comprising: a touch module, for generating a touch image in response to a user's touch operation on a touch screen, wherein the touch image includes an image of a touch area on the touch screen; and an adjustment module, for correcting the touch area and / or adjusting the display mode of the display content of the touch screen according to image feature information of the touch image.

[0017] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, comprising: a memory on which a computer program is stored; and a processor, configured to execute the computer program in the memory to implement the steps of the above method.

[0018] According to a fourth aspect of an embodiment of the present disclosure, there is provided a non-temporary computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the above method are implemented.

[0019] The touch method, device, electronic device and storage medium provided by the present disclosure enable a user to perform a touch operation based on a touch screen, and in response to the touch operation, a touch image displaying a touch area is generated, and then the touch area is corrected based on image feature information of the touch image, thereby improving the accuracy of the operation, and / or adjusting the display mode of the display content of the touch screen, thereby facilitating user input and improving the accuracy of the operation.

[0020] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0022] Figure 1 It is a touch image;

[0023] Figure 2 is a flow chart of a touch control method according to an exemplary embodiment;

[0024] Figure 3 is a flow chart of a touch control method according to another exemplary embodiment;

[0025] Figure 4 is a flow chart of a touch control method according to another exemplary embodiment;

[0026] Figure 5 Shown is a schematic diagram of a touch screen;

[0027] Figure 6 is based on Figure 4 A flowchart of step S320 of a touch control method shown in the embodiment;

[0028] Figure 7 is based on Figure 6 A flowchart of step S322 of a touch control method shown in the embodiment;

[0029] Figure 8 Shown is a schematic diagram of the touch screen after adjustment;

[0030] Fig. 9 is based on Figure 6 A flowchart of step S322 of a touch control method shown in the embodiment;

[0031] Fig.10 Shown is a schematic diagram of the touch screen after adjustment;

[0032] Fig.11 is based on Figure 6 A flowchart of step S322 of a touch control method shown in the embodiment;

[0033] Fig.12 Shown is a schematic diagram of the touch screen after adjustment;

[0034] Fig.13 is a flow chart of a touch control method according to another exemplary embodiment;

[0035] Fig.14 is based on Fig.13 A flowchart of step S420 of a touch control method shown in the embodiment;

[0036] Fig.15 is based on Fig.13 A flowchart of step S420 of a touch control method shown in the embodiment;

[0037] Fig.16 is based on Fig.13 A flowchart of step S430 of a touch control method shown in the embodiment;

[0038] Fig.17 is a block diagram of a touch control device according to an exemplary embodiment;

[0039] Fig.18 The invention is a block diagram of an electronic device for a touch control method according to an exemplary embodiment. DETAILED DESCRIPTION

[0040] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0041] It should be noted that all actions of acquiring signals, information or data in this application are carried out in compliance with the relevant data protection laws and policies of the country where they are located, and with the authorization given by the owner of the corresponding device.

[0042] Most of the current electronic devices interact with each other by touching the touch screen. With the development of technology, the touch feedback accuracy of the touch screen is getting higher and higher. With the increase of the functions of the electronic devices, the number of interactive controls applied on the same touch screen is also increasing. When the user uses the electronic device, the possibility of the user's misoperation of the touch screen increases. For example, when the user operates the electronic device with one hand, due to the large size of the touch screen or the small hand of the user, when the user operates the touch screen with the right hand, it is difficult for the right hand fingers to touch the controls on the left side of the screen, but the right hand's base and other positions are easy to touch the controls on the right side of the screen by mistake. Figure 1 As shown, in the obtained touch image, the touch area is annotated using an anchor frame to obtain touch area 1 and touch area 2. According to the shapes of touch area 1 and touch area 2, it can be inferred that the user is holding the electronic device, and touch area 1 is caused by finger touch, and touch area 2 is caused by thumb touch. Therefore, how to improve the accuracy of touch operation has become a technical problem that needs to be solved urgently.

[0043] In view of the above technical problems, the inventor has discovered and proposed a touch control method after long-term research. The execution subject of the method can be an electronic device, wherein the electronic device can be a mobile phone, a tablet computer, a smart wearable device, a learning machine, etc. The electronic device includes a touch screen, wherein the touch screen can be a full screen or a non-full screen, please refer to Figure 2 The touch control method may specifically include the following steps:

[0044] Step S110 : generating a touch image in response to a touch operation of a user on the touch screen, wherein the touch image includes an image of a touch area on the touch screen.

[0045] At least one control is displayed on the touch screen of the electronic device, and the user realizes human-computer interaction by touching the control. When using the electronic device, the user performs touch operations on the control on the touch screen of the electronic device, wherein the touch operations may include clicking, sliding, dragging, long pressing, etc., and the electronic device generates a touch image in response to the touch operation. The touch image displays the touch area generated when the user touches the touch screen.

[0046] In one embodiment, a user performs a touch operation on the touch screen of an electronic device, and the touch operation changes the voltage on the touch screen of the electronic device. The position where the voltage changes is the position where the user touches the touch screen, thereby generating a touch image showing a touch area. Among them, for determining the touch position according to the voltage, as a method, the touch screen is a capacitive screen. When the user touches the capacitive screen with a finger, a capacitor is formed between the finger and the screen. The capacitor acts as a conductor, and the finger absorbs a current from the touch position through the capacitor, thereby changing the voltage at the touch position, and obtaining a voltage change value diff according to the voltage before and after the voltage change. After filtering the voltage change value diff through the filter inside the electronic device, the processed voltage change value is obtained. The capacitive screen is divided into m*n (taking 16*40 as an example) areas. When the processed voltage change value on a certain area is greater than 300, it is determined that the user's touch operation successfully touches the area, and the area is the touch position. It can be understood that the touch image reflects the voltage distribution diagram of the display screen at the moment when the user inputs the touch operation.

[0047] Step S120: Correct the touch area and / or adjust the display mode of the display content of the touch screen according to the image feature information of the touch image.

[0048] The touch image is subjected to feature extraction according to a feature extraction algorithm, a feature extraction network or a feature extraction model to obtain image feature information of the touch image, wherein the image feature information may be a point, edge or object of a specific structure in the touch image, etc. Then, processing is performed according to the extracted image feature information.

[0049] In one embodiment, the touch area is corrected according to the image feature information. Optionally, due to the high precision of the touch screen, the user can achieve touch control by just slightly touching the touch screen, or there are a large number of controls on the touch screen, and the user can easily touch the control by mistake, or the user's hand is small, and the base of the hand, the palm, etc. can easily touch the screen and cause a false touch. Therefore, when the user uses the electronic device, the touch area generated may include the false touch area generated by the above false touch and the input area generated by the user's finger input. However, the above false touch is not what the user expects. Therefore, it is necessary to correct the touch area, clear the false touch area generated by the false touch, do not execute the functions related to the touch operation of the controls in the false touch area, and retain the input area, respond to the touch operation of the controls in the input area, enter the corresponding page or execute the corresponding function.

[0050] In another embodiment, the display content of the touch screen is adjusted according to the image feature information of the touch image to facilitate viewing or operation by the user.

[0051] In another embodiment, the display content of the touch screen is adjusted according to the image feature information of the touch image to facilitate user input and improve the accuracy of input. The user can perform input operations based on the adjusted display content, and the electronic device captures new touch operations again, responds to the touch operations, and generates a new touch image, wherein the new touch image includes a new touch area generated by the new touch operation. The electronic device corrects the new touch area through the new touch image to reduce false touches and further improve the accuracy of input.

[0052] In the touch method provided in this embodiment, the user performs a touch operation based on the touch screen, and the electronic device generates a touch image showing the touch area in response to the touch operation, and then corrects the touch area based on the image feature information of the touch image, thereby improving the accuracy of the operation, and / or adjusts the display mode of the display content of the touch screen to facilitate user input and improve the accuracy of the operation.

[0053] Optionally, when it is inferred from the touch image that there is an erroneous touch area in the touch area, the touch area needs to be calibrated so that the electronic device can perform the corresponding function according to the user's expectation (or intention). Figure 3 The touch control method may specifically include the following steps:

[0054] Step S210: In response to a touch operation performed by a user on the touch screen, a touch image is generated, where the touch image includes an image of a touch area on the touch screen.

[0055] In this embodiment, the specific description of step S210 may refer to step S110 in the above embodiment, which will not be repeated here.

[0056] Step S220: Determine a target area touched by the user's finger from the touch area according to the image feature information.

[0057] Using an image recognition algorithm, based on the touch area represented by the image feature information, the area touched by the user's finger is determined from the touch area as the target area, and the area touched by non-finger parts (such as the base of the thumb, palm, etc.) is determined as the false touch area.

[0058] Optionally, when the touch image is identified as including two touch areas according to the image recognition algorithm, in the case where the touch area includes two separate touch areas, the target area touched by the user's finger is determined according to the shape feature information of the image of each of the touch areas, and the user's touch operation on the target area is responded to, and the other touch area of ​​the two touch areas is a false touch area. Figure 1 As shown, the touch area 1 and the touch area 2 are separated, that is, the two touch areas are not connected. According to the shapes of the touch areas, the touch area 1 is judged as the target area, and the touch area 2 is the mis-touch area.

[0059] Optionally, in the case where the touch area is a connected area, for example, the user's fingers, palm and base of the thumb may simultaneously touch the connected area generated by the touch screen, and the touch gesture that generates the touch area is determined according to the image feature information. As a method, a fully connected layer or a pre-trained classifier is used to identify the image feature information to obtain a probability vector, wherein the probability vector represents the probability values ​​corresponding to the situations of using the left hand, the right hand, both hands, and no hand, etc., and the touch gesture is obtained through the probability vector. For example, the touch gesture is inferred according to the probability value with the largest probability value in the probability vector and greater than a preset value, such as inferring that the touch gesture is used. The user's touch gesture is with the right hand; then, the holding direction is determined according to the touch gesture, for example, the holding direction is the direction of the user's right hand, and the touch area is divided according to a preset ratio, and the area on the side opposite to the holding direction is obtained as the target area, and the area on the side of the holding direction is the erroneous operation area caused by the palm, the base of the thumb, etc. For example, the preset ratio is to start from the holding direction, move to the side opposite to the holding direction to the position of 1 / 4 of the touch image for segmentation, obtain the target area on the side of the holding direction that occupies 3 / 4 of the touch area, and obtain the erroneous touch area on the side opposite to the holding direction that occupies 1 / 4 of the touch area.

[0060] Step S230: calibrate the touch area to the target area.

[0061] The target area obtained is the area touched by the finger. It can be understood that the target area is the area that the user expects to touch, and the mis-touch area is the area touched due to the user's misoperation. If the two areas exist at the same time, the electronic device may execute the function corresponding to the control in the mis-touch area, resulting in the actual operation performed by the electronic device not being what the user expects. Therefore, in order to avoid the touch operation on the mis-touch area affecting the normal interaction between the user and the electronic device, the touch area is corrected to the target area. It can be understood that the mis-touch area is deleted from the touch area and the target area is retained, and the function corresponding to the control in the target area is executed to ensure normal interaction between the user and the electronic device.

[0062] It should be noted that when it is determined based on image feature information that only an erroneous touch area exists in the touch image, it means that the touch operation that generates the erroneous touch area is not what the user expects. Therefore, it can be considered that there is no target area in the touch area, and the electronic device does not execute the function corresponding to the control in the erroneous touch area.

[0063] In the touch method provided in this embodiment, the user performs a touch operation based on the touch screen, and in response to the touch operation, a touch image displaying the touch area is generated, and then based on the image feature information of the touch image, the target area touched by the user's finger is determined from the touch area, and the touch area is corrected to the target area, so that the electronic device can execute the corresponding function according to the touch of the target area, thereby improving the accuracy of the operation.

[0064] Optionally, the content displayed on the touch screen is a virtual keyboard, and the user performs input operations through the virtual keyboard. Figure 4 The touch control method may specifically include the following steps:

[0065] Step S310: generating the touch image in response to the user's touch operation on the virtual keyboard on the touch screen.

[0066] When the user needs to input text, numbers, symbols, emoticons, etc., Figure 5 As shown, a virtual keyboard A may be displayed on the touch screen, and the user implements input by performing touch operations on the virtual keyboard A, and a touch image is generated based on the touch operations.

[0067] Step S320: adjusting the display mode of the virtual keyboard on the touch screen according to the image feature information of the touch image.

[0068] Feature extraction is performed on the touch image according to a feature extraction algorithm, a feature extraction network or a feature extraction model to obtain image feature information of the touch image, and based on the image feature information of the touch image, the display content of the touch screen is adjusted to facilitate the user to operate the virtual keyboard.

[0069] In one embodiment, see Figure 6 , step S320 includes the following sub-steps:

[0070] Sub-step S321: determining a touch gesture that generates the touch area according to the image feature information.

[0071] Use a fully connected layer or a pre-trained classifier to identify image feature information and obtain a probability vector, wherein the probability vector represents the probability values ​​corresponding to the use of the left hand, right hand, both hands, no hands, etc., and the touch gesture is obtained through the probability vector. For example, the touch gesture is inferred based on the probability value with the largest probability value in the probability vector and greater than a preset value, such as inferring that the user's touch gesture is with the right hand.

[0072] If the touch gesture is characterized by no hand, it means that the user's hands are not touching the touch screen, and the touch screen may be accidentally touched by the elbow or other parts. Therefore, the input is ignored. It is understandable that the electronic device considers that the touch has failed, that is, it considers that the touch control in the touch area has failed due to the accidental touch operation.

[0073] If the touch gesture is represented by both hands, it means that the user is operating the electronic device with both hands. Therefore, there may be no difficult-to-touch area on the touch screen, and the electronic device maintains the current display mode of the virtual keyboard on the touch screen, that is, the display mode of the virtual keyboard is not adjusted.

[0074] Sub-step S322: If the touch gesture is characterized by single-hand touch, adjust the display mode of the virtual keyboard on the touch screen.

[0075] If the touch gesture is characterized by one-hand touch, that is, the touch gesture is characterized by left-hand touch or right-hand touch, the user holds the electronic device with one hand and touches the electronic device with the hand holding the electronic device. Due to the large size of the touch screen or the small hand of the user, the position on the touch screen opposite to the holding side is difficult to touch. In order to solve this problem, the display mode of the virtual keyboard on the touch screen is adjusted so that the adjusted virtual keyboard is convenient for the user to input with one hand.

[0076] As a way, see Figure 7 , sub-step S322 includes the following sub-steps:

[0077] Sub-step S322-1: reducing the size of the virtual keyboard.

[0078] The size of the virtual keyboard is reduced, and the display area occupied by the reduced virtual keyboard is smaller than the display area occupied by the virtual keyboard before the reduction.

[0079] Optionally, the reduced size is preset, and the virtual keyboard can be reduced according to the preset size.

[0080] Optionally, the size of the user's hand (which can be understood as the size of the hand) reflected by the image feature information on the touch image can be used to determine the compression size according to the size of the hand, and the size of the virtual keyboard can be reduced according to the compression size. The size of the hand is inversely correlated with the compression size. For example, if the user's size is smaller than the preset size, the virtual keyboard is reduced according to the first compression size; if the user's size is larger than the preset size, the virtual keyboard is reduced according to the second compression size, wherein the first compression size is larger than the second compression size. It can be understood that the smaller the user's hand, the smaller the virtual keyboard after reduction; the larger the user's hand, the larger the virtual keyboard after reduction.

[0081] Sub-step S322-2: displaying the reduced virtual keyboard at the display position determined on the touch screen according to the touch gesture.

[0082] The display position determined from the touch screen according to the touch gesture is located on the hand-held side of the display screen. For example, the touch gesture represents the user's right hand touch, such as Figure 8 As shown, the reduced virtual keyboard A' occupies a smaller display area than the virtual keyboard A before reduction, and on the touch screen, the reduced virtual keyboard A' is displayed close to the right hand side, so that the user can touch all controls on the virtual keyboard A' with one hand of the right hand.

[0083] It should be noted that the display of the reduced virtual keyboard is not limited to Figure 8 As shown, when the touch gesture represents a touch by the user's left hand, the reduced virtual keyboard can be displayed on the left hand side of the touch screen.

[0084] As another example, the virtual keyboard includes multiple controls. Fig. 9 , sub-step S322 includes the following sub-steps:

[0085] Sub-step S322-3, according to the touch gesture, determine the first category of controls, the second category of controls and the third category of controls from the multiple controls on the virtual keyboard, wherein the first category of controls are controls in the hand-holding direction on the touch screen, and the second category of controls are controls on the side of the touch screen opposite to the hand-holding direction.

[0086] Compared to the distance from the edge of the screen on the hand-held side of the touch screen, the first type of controls are closest to the edge of the screen, the third type of controls are the second closest, and the second type of controls are the farthest. The first and third types of controls are easy for users to touch with one hand, while the second type of controls are difficult for users to touch with one hand.

[0087] Sub-step S322-4: When the size of the virtual keyboard remains unchanged, the size of the first-category controls is reduced, the size of the second-category controls is enlarged, and the size of the third-category controls remains unchanged.

[0088] When the size of the virtual keyboard remains unchanged, the electronic device controls the size of the first type of controls closest to the edge of the screen to be reduced, so that the first type of controls make room for the second type of controls, and controls the size of the second type of controls to be enlarged, so that the enlarged second type of controls are closer to the handheld side, and the user can touch the enlarged second type of controls when operating with one hand. Fig.10 As shown, the size of the virtual keyboard A' after the size adjustment is the same as the size of the virtual keyboard A before the adjustment.

[0089] As another example, the virtual keyboard includes multiple controls. Fig.11 , sub-step S322 includes the following sub-steps:

[0090] Sub-step S322-5: determining a target control from multiple controls on the virtual keyboard.

[0091] The target control is the control that the user needs to touch. When the electronic device detects a single-handed operation, it determines the target control from multiple controls on the virtual keyboard. Optionally, the target control can be selected from multiple controls on the virtual keyboard according to user settings or default settings.

[0092] Sub-step S322-6: Delete the controls except the target control from the multiple controls, and keep the target control as a new virtual keyboard.

[0093] Among the multiple controls, other controls except the target control may not be touched by the user, for example, other controls may be numeric keys on a virtual keyboard when the user is typing. Other controls are deleted, and only the target control is retained on the virtual keyboard. It can be understood that the virtual keyboard only includes the target control.

[0094] Sub-step S322-7: Enlarging the target control on the new virtual keyboard while keeping the size of the virtual keyboard unchanged.

[0095] While the size of the virtual keyboard remains unchanged, the target controls are enlarged as a whole so that each target control occupies a larger area and the user can touch each control even when operating with one hand. Fig.12 As shown, the size of the virtual keyboard A' after the size adjustment is the same as the size of the virtual keyboard A before the adjustment.

[0096] In the touch method provided in this embodiment, the user performs a touch operation based on the touch screen, and in response to the touch operation, a touch image displaying the touch area is generated, and then the display mode of the virtual keyboard is adjusted according to the image feature information of the touch image, so that the controls that are difficult for the user to touch are easy to touch after adjustment, thereby improving the accuracy of operating the virtual keyboard.

[0097] Optionally, see Fig.13 The touch control method may specifically include the following steps:

[0098] Step S410: In response to a touch operation performed by a user on the touch screen, a touch image is generated, where the touch image includes an image of a touch area on the touch screen.

[0099] In this embodiment, the specific description of step S410 may refer to step S110 in the above embodiment, which will not be repeated here.

[0100] Step S420: extracting image feature information of the touch image.

[0101] Feature extraction is performed on the touch image according to a feature extraction algorithm, a feature extraction network (such as resent, resnext, mobilenet, shufflenet) or a feature extraction model to obtain image feature information of the touch image.

[0102] In some embodiments, taking the feature extraction network as mobilenet as an example, the touch image is processed in sequence through a convolution layer (cove) and an average pooling layer (avg pool) to extract x image feature information. For example, taking a (16*40*1) touch image as an example, the (16*40*1) touch image is input into a convolution layer, and the width and height of the touch image are reduced by the convolution layer, and the dimension is increased to obtain image data, for example, (2*5*x) image data can be obtained, where x can be 1000; the obtained image data is processed using an average pooling layer, and the mean of the image data is calculated, for example, the mean of (2*5*x) is calculated to obtain feature information of (1*1*x), which can be understood as splitting a touch image into x feature information, that is, using x feature information to represent a touch image. It should be noted that the image features can be extracted in the manner of this embodiment for both full-screen and non-full-screen touch screens.

[0103] In other embodiments, for a full-screen touch screen, when a user holds the electronic device, the edge of the full-screen of the electronic device will capture touch operations, and different holding postures will produce different touch images on the curved edge of the full-screen. Fig.14 , step S420 may include the following sub-steps:

[0104] Sub-step S421: segment the touch image to obtain an edge image.

[0105] The touch image is divided into an edge image and an internal image. The edge image is the image of the touch screen border. It can be understood that the edge image is obtained by hollowing out the inside of the touch image, and the hollowed-out part is the internal image. For example, for a (16*40) touch image, firstly, 4 x1 strips are divided along the edge of the touch image. Optionally, x1 can be 4, and the four strips are spliced ​​to obtain an edge image of (16+40)*2*x1, which contains the data of the edge of the touch screen. After the (16*40) touch image is divided into an edge image of (112*4), the remaining image is the internal image.

[0106] Sub-step S422: extracting features of the edge image to obtain first feature information.

[0107] Taking the feature extraction network as mobilenet as an example, the edge image is processed through the convolution layer and the average pooling layer in sequence to extract x1 edge feature information. For example, taking the edge image of (112*4*1) as an example, the edge image of (112*4*1) is input into the convolution layer, and the width and height of the touch image are reduced and the dimension is increased through the convolution layer to obtain image data, for example, image data of (28*1*x1) can be obtained, where x1 can be 1000; the obtained image data is processed using the average pooling layer, and the mean of the image data is calculated, for example, the mean of (28*1*x1) is calculated to obtain the first feature information of (1*1*x1), which can be understood as splitting an edge image into x1 feature information.

[0108] Sub-step S423: extracting features of the touch image to obtain second feature information.

[0109] Similarly, in this embodiment, taking the feature extraction network as mobilenet as an example, the touch image is processed by the convolution layer and the average pooling layer in sequence to extract x2 image feature information. For example, taking a (16*40*1) touch image as an example, the (16*40*1) touch image is input into the convolution layer, and the width and height of the touch image are reduced by the convolution layer, and the dimension is increased to obtain image data, for example, (2*5*x2) image data can be obtained, where x2 can be 1000; the obtained image data is processed using the average pooling layer, and the mean of the image data is calculated, for example, the mean of (2*5*x2) is calculated to obtain the second feature information of (1*1*x2), which can be understood as splitting a touch image into x2 feature information.

[0110] Sub-step S424: concatenate the first feature information and the second feature information to obtain the image feature information.

[0111] The first feature information (1*1*x1) and the second feature information (1*1*x2) are concatenated to obtain the concatenated image feature information (1*1*(x1+x2)).

[0112] The first feature information and the second feature information are spliced ​​to obtain image feature information. The edge image can reflect the touch gesture. Based on the second feature information of the entire touch image and in coordination with the first feature information of the edge image, the image feature information obtained can more accurately reflect the user's touch gesture.

[0113] In some embodiments, see Fig.15 , step S420 may include the following sub-steps:

[0114] Sub-step S425: generating a plurality of anchor frames in the touch image.

[0115] A plurality of anchor frames are generated in the touch image, and at least one target exists in each anchor frame.

[0116] Sub-step S426: extracting features from each anchor frame in the multiple anchor frames on the touch image to obtain image feature information of the multiple anchor frames.

[0117] Among them, the method of performing feature extraction on each anchor frame is similar to the above-mentioned embodiment. In the above-mentioned embodiment, feature extraction is performed on the entire touch image. In the present embodiment, feature extraction is performed on the image in the anchor frame. Feature extraction is required for each anchor frame on the touch image to obtain image feature information of each anchor frame of multiple anchor frames.

[0118] Step S430: Correct the touch area and / or adjust the display mode of the display content of the touch screen according to the image feature information of the touch image.

[0119] In some implementations, a touch gesture that generates the touch area is determined based on the image feature information; if the touch gesture is characterized by a single-hand touch, the display mode of the virtual keyboard on the touch screen is adjusted.

[0120] Among them, see Fig.16 , through two fully connected layers, one of which is used to obtain position information and the other is used to obtain touch gestures, determining the touch gesture that generates the touch area according to the image feature information includes the following sub-steps:

[0121] Sub-step S431: identifying the image feature information of the multiple anchor frames through the first fully connected layer to obtain the position information of each anchor frame in the multiple anchor frames.

[0122] Among them, the position information can be represented by the coordinates of the center of the anchor box and the height and width of the anchor box.

[0123] For example, a coordinate system is established based on the surface where the touch screen is located, and the coordinates of each anchor frame in the coordinate system can be (x, y), and the height w and width h of the anchor frame are determined.

[0124] Sub-step S432: recognizing the image feature information of the multiple anchor frames through the second fully connected layer to obtain the touch gesture of each anchor frame in the multiple anchor frames.

[0125] Among them, the second fully connected layer recognizes the image feature information of multiple anchor frames, outputs the probability vector corresponding to each anchor frame, and represents the touch gesture of each anchor frame through the probability vector.

[0126] Sub-step S433: Processing the position information of each anchor frame in the multiple anchor frames and the touch gesture of each anchor frame in the multiple anchor frames according to the classifier to obtain the touch gesture that generates the touch area.

[0127] The processing results of the first fully connected layer and the second fully connected layer are classified by a classifier, and the final touch gesture is inferred according to the prediction results of multiple anchor frames.

[0128] In other real-time methods, the image feature information is processed through a fully connected layer or a pre-trained classifier to obtain a probability vector to determine the touch gesture that generates the touch area.

[0129] In other embodiments, the electronic device is equipped with a specific absorption rate sensor (SAR sensor), which can be used to directly determine the pressing area and thus the touch gesture. For example, when the value collected by the sensor in a certain area on the touch screen is greater than a preset value, the area is determined to be a touch area, and the preset value can be 300.

[0130] In a scenario where a user types on a virtual keyboard on a touch screen of an electronic device with one hand, for example, an instant messaging software is installed on the electronic device, the user logs in to a user account on the instant messaging software, communicates with accounts that are associated with each other (which can be understood as friend relationships), the user holds the electronic device with one hand (for example, the left hand or the right hand), and performs touch operations on the electronic device with one hand, and the electronic device generates a touch image in response to the user's touch operation on the touch screen, wherein the touch image includes an image of a touch area generated on the touch screen by the touch operation. Since the user operates the electronic device with one hand, it is difficult for the user to touch the controls on the display screen on the side of the touch screen opposite to the one-hand side, therefore, it is necessary to adjust the display mode of the virtual keyboard, display the adjusted virtual keyboard on the touch screen, and the user can touch all controls on the adjusted virtual keyboard with one hand, thereby improving the accuracy of the input data detected. When the user types on the adjusted virtual keyboard, if the user's base of the hand or other parts of the palm accidentally touches the touch screen, there will be an erroneous touch area in the regenerated touch image. Since the erroneous touch area is not what the user expected, the electronic device does not perform the corresponding function of the erroneous touch area for the user's touch operation on the erroneous touch area, thereby further improving the accuracy of the detected input data.

[0131] To implement the above-mentioned touch control method, this embodiment provides a touch control device. Fig.17 is a block diagram of a touch control device according to an exemplary embodiment. Fig.17 The touch control device 100 includes a touch control module 110 and an adjustment module 120 .

[0132] A touch module 110, for generating a touch image in response to a user's touch operation on the touch screen, wherein the touch image includes an image of a touch area on the touch screen;

[0133] The adjustment module 120 is used to calibrate the touch area and / or adjust the display mode of the display content of the touch screen according to the image feature information of the touch image.

[0134] Optionally, the adjustment module 120 includes: a target area determination module and a first adjustment module.

[0135] A target area determination module, used to determine a target area touched by the user's finger from the touch area according to the image feature information;

[0136] The first adjustment module is used to correct the touch area to the target area.

[0137] Optionally, the target area determination module includes: a first target determination module and a second target determination module.

[0138] A first target determination module, configured to determine a target area touched by the user's finger according to shape feature information of an image of each of the touch areas when the touch area includes two separate touch areas;

[0139] The second target determination module is used to determine the touch gesture that generates the touch area according to the image feature information when the touch area is a connected area, determine the holding direction according to the touch gesture, and divide the touch area according to a preset ratio to obtain the divided area on the side opposite to the holding direction as the target area.

[0140] Optionally, the touch module 110 includes: a touch image generation module.

[0141] The touch image generation module is used to generate the touch image in response to the user's touch operation on the virtual keyboard on the touch screen.

[0142] The adjustment module 120 includes: a second adjustment module.

[0143] The second adjustment module is used to adjust the display mode of the virtual keyboard on the touch screen according to the image feature information of the touch image.

[0144] Optionally, the second adjustment module includes: a determination module and a display mode adjustment module.

[0145] A determination module, configured to determine a touch gesture that generates the touch area according to the image feature information;

[0146] The display mode adjustment module is used to adjust the display mode of the virtual keyboard on the touch screen if the touch gesture is characterized by single-hand touch.

[0147] Optionally, the display mode adjustment module includes: a size reduction module and a first size adjustment module.

[0148] A size reduction module, used to reduce the size of the virtual keyboard;

[0149] The first size adjustment module is used to display the reduced virtual keyboard at a display position determined on the touch screen according to the touch gesture.

[0150] Optionally, the virtual keyboard includes a plurality of controls, and the second adjustment module includes: a control type determination module and a second size adjustment module.

[0151] a control type determination module, configured to determine, from the plurality of controls on the virtual keyboard according to the touch gesture, a first type of control, a second type of control, and a third type of control, wherein the first type of control is a control in a hand-holding direction on the touch screen, and the second type of control is a control on a side of the touch screen opposite to the hand-holding direction;

[0152] The second size adjustment module is used to control the size of the first category of controls to be reduced, the size of the second category of controls to be enlarged, and the size of the third category of controls to remain unchanged, while the size of the virtual keyboard remains unchanged.

[0153] Optionally, the virtual keyboard includes a plurality of controls, and the display mode adjustment module includes: a target control determination module, a deletion module and a third size adjustment module.

[0154] A target control determining module, used to determine a target control from a plurality of controls on the virtual keyboard;

[0155] A deleting module, used for deleting controls except a target control from the multiple controls, and retaining the target control as a new virtual keyboard;

[0156] The third size adjustment module is used to enlarge the target control on the new virtual keyboard without changing the size of the virtual keyboard.

[0157] Optionally, the touch control device 100 further includes: a feature extraction module.

[0158] The feature extraction module is used to extract image feature information of the touch image.

[0159] Optionally, the feature extraction module includes: a segmentation module, a first feature information extraction module, a second feature information extraction module and a splicing module.

[0160] A segmentation module, used for segmenting the touch image to obtain an edge image;

[0161] A first feature information extraction module, used to extract the features of the edge image to obtain first feature information;

[0162] A second feature information extraction module, used to extract the features of the touch image to obtain second feature information;

[0163] A splicing module is used to splice the first feature information and the second feature information to obtain the image feature information.

[0164] Optionally, the feature extraction module includes: a generation module and an anchor frame feature extraction module.

[0165] A generating module, configured to generate a plurality of anchor frames in the touch image;

[0166] The anchor frame feature extraction module is used to extract features from each anchor frame in the multiple anchor frames on the touch image to obtain image feature information of the multiple anchor frames.

[0167] Optionally, the determination module includes: a first identification module, a second identification module and a processing module.

[0168] A first recognition module is used to recognize the image feature information of the multiple anchor frames through a first fully connected layer to obtain the position information of each anchor frame in the multiple anchor frames;

[0169] A second recognition module is used to recognize the image feature information of the multiple anchor frames through a second fully connected layer to obtain a touch gesture of each anchor frame in the multiple anchor frames;

[0170] The processing module is used to process the position information of each anchor frame in the multiple anchor frames and the touch gesture of each anchor frame in the multiple anchor frames according to the classifier to obtain the touch gesture that generates the touch area.

[0171] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0172] The present disclosure also provides a computer-readable storage medium on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the touch control method provided by the present disclosure are implemented.

[0173] Fig.18 8 is a block diagram of an electronic device for a touch control method according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0174] Reference Fig.18 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0175] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0176] The memory 804 is configured to store various types of data to support operations on the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0177] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0178] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0179] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0180] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0181] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the electronic device 800, the relative positioning of the components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0182] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0183] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0184] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by a processor 820 of an electronic device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0185] In addition to being an independent electronic device, the above-mentioned device can also be a part of an independent electronic device. For example, in one embodiment, the device can be an integrated circuit (IC) or a chip, wherein the integrated circuit can be an IC or a collection of multiple ICs; the chip can include but is not limited to the following types: GPU (Graphics Processing Unit), CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), SOC (System on Chip, SoC), etc. The above-mentioned integrated circuit or chip can be used to execute executable instructions (or codes) to implement the above-mentioned touch method. The executable instructions can be stored in the integrated circuit or chip, or can be obtained from other devices or equipment, for example, the integrated circuit or chip includes a processor, a memory, and an interface for communicating with other devices. The executable instruction may be stored in the processor, and when the executable instruction is executed by the processor, the above-mentioned touch method is implemented; alternatively, the integrated circuit or chip may receive the executable instruction through the interface and transmit it to the processor for execution, so as to implement the above-mentioned touch method.

[0186] In another exemplary embodiment, a computer program product is further provided. The computer program product includes a computer program that can be executed by a programmable device. The computer program has a code portion for executing the above touch control method when executed by the programmable device.

[0187] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. This application is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0188] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A touch control method, characterized in that: include: In response to a touch operation of a user on the touch screen, generating a touch image, wherein the touch image includes an image of a touch area on the touch screen; Correcting the touch area and / or adjusting the display mode of the display content of the touch screen according to the image feature information of the touch image; The correcting the touch area according to the image feature information of the touch image includes: Determining a target area touched by the user's finger from the touch area according to the image feature information; Correcting the touch area to the target area; The determining, from the touch area, a target area touched by the user's finger according to the image feature information includes: In the case that the touch area is a connected area, the touch gesture that generates the touch area is determined according to the image feature information, the holding direction is determined according to the touch gesture, and the touch area is segmented according to a preset ratio, and the segmented area on the side opposite to the holding direction is obtained as the target area.

2. The method according to claim 1, characterized in that The determining, from the touch area, a target area touched by the user's finger according to the image feature information includes: In the case that the touch area includes two separate touch areas, the target area touched by the finger of the user is determined according to shape feature information of the image of each touch area.

3. The method according to claim 1, characterized in that: The step of generating a touch image in response to a touch operation performed by a user on the touch screen includes: generating the touch image in response to a user's touch operation on the virtual keyboard on the touch screen; The adjusting the display mode of the display content of the touch screen according to the image feature information of the touch image includes: The display mode of the virtual keyboard on the touch screen is adjusted according to the image feature information of the touch image.

4. The method according to claim 3, characterized in that The adjusting the display mode of the virtual keyboard of the touch screen according to the image feature information of the touch image includes: Determining a touch gesture that generates the touch area according to the image feature information; If the touch gesture is characterized by a single-hand touch, the display mode of the virtual keyboard on the touch screen is adjusted.

5. The method according to claim 4, characterized in that The adjusting the display mode of the virtual keyboard of the touch screen includes: Reducing the size of the virtual keyboard; The reduced virtual keyboard is displayed at a display position determined on the touch screen according to the touch gesture.

6. The method according to claim 4, characterized in that The virtual keyboard includes a plurality of controls, and the adjusting the display mode of the virtual keyboard on the touch screen includes: Determine, according to the touch gesture, a first category of controls, a second category of controls, and a third category of controls from the multiple controls on the virtual keyboard, wherein the first category of controls are controls on the hand-holding direction of the touch screen, and the second category of controls are controls on a side of the touch screen opposite to the hand-holding direction; When the size of the virtual keyboard remains unchanged, the size of the first-category controls is controlled to be reduced, the size of the second-category controls is controlled to be enlarged, and the size of the third-category controls remains unchanged.

7. The method according to claim 4, characterized in that The virtual keyboard includes a plurality of controls, and the adjusting the display mode of the virtual keyboard on the touch screen includes: Determine a target control from a plurality of controls on the virtual keyboard; Deleting controls except a target control from the multiple controls, and retaining the target control as a new virtual keyboard; Under the condition that the size of the virtual keyboard remains unchanged, the target control on the new virtual keyboard is enlarged.

8. The method according to claim 2 or 4, characterized in that: Before correcting the touch area and / or adjusting the display mode of the display content of the touch screen according to the image feature information of the touch image, the method further includes: Image feature information of the touch image is extracted.

9. The method according to claim 8, characterized in that The extracting the image feature information of the touch image includes: Segmenting the touch image to obtain an edge image; Extracting features of the edge image to obtain first feature information; Extracting features of the touch image to obtain second feature information; The first feature information and the second feature information are concatenated to obtain the image feature information.

10. The method according to claim 8, characterized in that The extracting the image feature information of the touch image includes: generating a plurality of anchor frames in the touch image; Feature extraction is performed on each anchor frame of the multiple anchor frames on the touch image to obtain image feature information of the multiple anchor frames.

11. The method according to claim 10, characterized in that The step of determining the touch gesture that generates the touch area according to the image feature information includes: Recognize the image feature information of the multiple anchor frames through the first fully connected layer to obtain the position information of each anchor frame in the multiple anchor frames; Recognizing the image feature information of the multiple anchor frames through a second fully connected layer to obtain a touch gesture of each anchor frame in the multiple anchor frames; The position information of each anchor frame in the multiple anchor frames and the touch gesture of each anchor frame in the multiple anchor frames are processed according to the classifier to obtain the touch gesture generating the touch area.

12. A touch device, characterized in that: include: A touch module, configured to generate a touch image in response to a user's touch operation on the touch screen, wherein the touch image includes an image of a touch area on the touch screen; An adjustment module, used for correcting the touch area and / or adjusting the display mode of the display content of the touch screen according to the image feature information of the touch image; The adjustment module includes a target area determination module and a first adjustment module; A target area determination module, used to determine a target area touched by the user's finger from the touch area according to the image feature information; A first adjustment module, used for correcting the touch area to the target area; The target area determination module includes a second target determination module; The second target determination module is used to determine the touch gesture that generates the touch area according to the image feature information when the touch area is a connected area, determine the holding direction according to the touch gesture, and divide the touch area according to a preset ratio to obtain the divided area on the side opposite to the holding direction as the target area.

13. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor, configured to execute the computer program in the memory to implement the steps of the method according to any one of claims 1 to 11.

14. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method described in any one of claims 1 to 11 are implemented.