Touch operation processing method and device, electronic equipment and readable storage medium

By combining image data and touch data to determine user actions, the problem of detection error in the anti-mistouch function of foldable screen devices has been solved, improving the device's response accuracy and user experience.

CN115469795BActive Publication Date: 2026-02-27VIVO MOBILE COMM CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202211288865.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-20
Publication Date
2026-02-27
Estimated Expiration
2042-10-20

AI Technical Summary

Technical Problem

Existing foldable screen phones and other electronic devices have errors in the detection process for the anti-accidental touch function, which causes the screen to become unresponsive when the user is using it normally.

Method used

By acquiring image data from electronic devices and touch data from touch chips, it determines whether the user is using the device normally, and only resumes response to touch operations when facial information is detected, the device is held, and the touch operation is the target operation.

Benefits of technology

This reduces the likelihood of devices failing to respond to user touches due to errors, thus improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115469795B_ABST
    Figure CN115469795B_ABST
Patent Text Reader

Abstract

The application discloses a touch operation processing method and device, electronic equipment and a readable storage medium, and belongs to the technical field of communication. The method comprises the following steps: acquiring a response state of an electronic equipment; acquiring image data and first touch data of a touch chip of the electronic equipment in the case that the response state is an inhibition state; determining the state of the electronic equipment according to the first touch data, and acquiring a touch operation through a touch driver; wherein the touch driver determines the touch operation according to the first touch data; and in the case that the image data comprises face information, the state of the electronic equipment is in a holding state, and the touch operation is a target touch operation, the response to the target touch operation is restored.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of communication, and particularly relates to a touch operation processing method and device, electronic equipment and a readable storage medium. BACKGROUND

[0002] With the continuous development of communication product technology, users hope that electronic equipment has a smaller size, and at the same time has a larger display screen and operation area. As a branch of flexible screens, folding screens can meet the needs of users.

[0003] At present, most folding screen mobile phones and other electronic equipment have a function of preventing mis-touch during the folding process of the equipment. The electronic equipment detects acceleration by using an inertial sensor to identify the folding or unfolding process, and when it is detected that the electronic equipment is in the folding or unfolding process, the anti-mis-touch function is started to inhibit user operation.

[0004] The inventor found in the research process that the above detection process often has a large error, and the anti-mis-touch function can only be stopped after the user's fingers are completely removed, which affects the user experience. SUMMARY

[0005] The purpose of the embodiments of the present application is to provide a touch operation processing method and device, electronic equipment and a readable storage medium, which can solve the problem that the detection process of the anti-mis-touch function of folding screen mobile phones and other electronic equipment has errors, resulting in the screen being unable to respond when the user normally uses it.

[0006] In a first aspect, the embodiments of the present application provide a touch operation processing method, which comprises:

[0007] obtaining a response state of an electronic equipment;

[0008] in a case where the response state is an inhibition state, obtaining image data and first touch data of a touch chip of the electronic equipment, wherein the inhibition state indicates that the response to a touch operation is stopped;

[0009] determining a state of the electronic equipment according to the first touch data, and obtaining a touch operation by a touch driver, wherein the touch driver determines the touch operation according to the first touch data;

[0010] in a case where the image data includes face information, the state of the electronic equipment is in a holding state, and the touch operation is a target touch operation, resuming the response to the target touch operation.

[0011] In a second aspect, the embodiments of the present application provide a touch operation processing device, which comprises:

[0012] a first obtaining module configured to obtain a response state of an electronic equipment;

[0013] The second obtaining module is configured to, in the case that the response state is a suppression state, obtain image data and first touch data of a touch chip of the electronic device; the suppression state indicates that the response to the touch operation is stopped;

[0014] The determining module is configured to determine the state of the electronic device according to the first touch data, and obtain the touch operation through a touch driver; wherein the touch driver determines the touch operation according to the first touch data.

[0015] The resuming module is configured to, in the case that the image data includes face information, the state of the electronic device is in a holding state, and the touch operation is a target touch operation, resume the response to the target touch operation.

[0016] In a third aspect, an electronic device is provided, which includes a processor and a memory. The memory stores programs or instructions that can be run on the processor. When the programs or instructions are executed by the processor, the steps of the method according to the first aspect are implemented.

[0017] In a fourth aspect, a readable storage medium is provided. The readable storage medium stores programs or instructions. When the programs or instructions are executed by a processor, the steps of the method according to the first aspect are implemented.

[0018] In the embodiments of the present application, the response state of the electronic device can be obtained. In the case that the response state is a suppression state, image data and first touch data of a touch chip of the electronic device are obtained; the suppression state indicates that the response to the touch operation is stopped. The state of the electronic device is determined according to the first touch data, and the touch operation is obtained through a touch driver; wherein the touch driver determines the touch operation according to the first touch data. In the case that the image data includes face information, the state of the electronic device is in a holding state, and the touch operation is a target touch operation, the response to the target touch operation is resumed. The above-mentioned solution can determine whether the user is normally using the electronic device by judging whether the image data includes a face, whether the electronic device is in a holding state, and whether the touch function operation is a target touch function operation. In the case that the image data includes face information, the state of the electronic device is in a holding state, and the touch operation is a target touch operation, it is indicated that the user is normally using the electronic device. The response to the touch operation of the user is performed, which can compensate for the error in the detection process of the anti-mis-touch function of the electronic device such as a folding screen mobile phone to a certain extent, reduce the possibility that the device does not respond to the user's touch due to the error, and improve the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0019] Figure 1is a step flow chart of a touch operation processing method provided by an embodiment of the present application;

[0020] Figure 2 is a flow diagram of an electronic device in a holding state provided by an embodiment of the present application;

[0021] Figure 3 is a step flow chart of a touch operation processing method provided by an embodiment of the present application;

[0022] Figure 4 is a diagram of an electronic device in a holding state provided by an embodiment of the present application;

[0023] Figure 5 is a diagram of touch data provided by an embodiment of the present application;

[0024] Figure 6 is a diagram of touch data of a back area provided by an embodiment of the present application;

[0025] Figure 7 is a diagram of a row holding differential value of touch data of a back area provided by an embodiment of the present application;

[0026] Figure 8 is a diagram of a column holding differential value of touch data of a back area provided by an embodiment of the present application;

[0027] Figure 9 is a block diagram of a touch operation processing apparatus provided by an embodiment of the present application;

[0028] Figure 10 is an electronic device provided by an embodiment of the present application;

[0029] Figure 11 is a hardware structure diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0030] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0031] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally a class and do not limit the number of objects, for example, the first object can be one or at least two. In addition, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / ", generally indicates that the objects before and after are in a "or" relationship.

[0032] The touch operation processing method provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings, specific embodiments and application scenarios.

[0033] Referring to Figure 1 , Figure 1 A step flowchart of a touch operation processing method provided by an embodiment of the present application is shown, which specifically includes the following steps:

[0034] Step 101, obtaining the response state of the electronic device.

[0035] In the embodiments of the present application, the electronic device can have a folding screen, which can be a folding screen composed of multiple screens, or a folding screen composed of a flexible screen. The electronic device can change the screen size by folding, such as: changing the screen size. The folding process of the folding screen includes a folding process and an unfolding process. The folding process refers to the process of folding multiple screens together to reduce the screen size of the electronic device. The unfolding process refers to the process of unfolding multiple screens, which can be to display a large screen composed of multiple screens.

[0036] The electronic device includes a touch chip. For a capacitive type electronic device, the screen includes multiple touch nodes. The touch nodes receive input signals such as pressing and touching, and output corresponding first touch data to the touch chip. The touch chip can process the obtained first touch data uploaded to the touch driver to obtain the position of the user pressing or touching the screen, and drive the electronic device to respond to the user operation.

[0037] The response state of the electronic device includes a normal state and a suppression state, the normal state indicating a normal response to a touch operation, and the suppression state indicating a stop of the response to the touch operation. In order to perform the anti-mistouch processing for the folding process of the folding screen, the electronic device enters the suppression state in the folding process. Specifically, when the folding screen is in the folding process, parameters such as acceleration and angular velocity of the electronic device change. Therefore, the electronic device can detect the parameters such as the acceleration and the angular velocity of the electronic device through an inertial sensor such as an accelerometer or a gyroscope, and when the parameters such as the acceleration and the angular velocity change, the electronic device can determine that the electronic device is in the suppression state.

[0038] In the embodiments of the present application, for the electronic device with the non-folding screen, if the above-mentioned suppression state exists, the embodiments of the present application can also perform the processes of steps 101-104. When the electronic device is in the suppression state but is normally used by the user, such as a click or swipe operation of the user when the electronic device is in the suppression state, the response to the click or swipe is restored.

[0039] Figure 2 A flowchart of the electronic device in the suppression state provided by the embodiments of the present application is shown in FIG. 1. As shown in FIG. 1, a touch IC (integrated circuit), that is, a touch chip, sends the received first touch data to a touch driver. The touch driver identifies a touch operation and a coordinate corresponding to the touch operation according to the first touch data. When the electronic device is in the suppression state, a frame suppression program will prevent the touch driver from sending the touch coordinates obtained according to the first touch data to various APPs (application), resulting in that the various APPs cannot receive valid touch data and cannot respond to the touch operation of the user. Figure 2

[0040] In the case of not being in the suppression state, the touch IC reports the data to the touch driver, and then the touch driver determines the touch operation and the coordinate, and provides the determined touch operation to the APP corresponding to the coordinate, and the APP responds to the touch operation.

[0041] In the embodiments of the present application, the electronic device can be a mobile terminal such as a mobile phone or a tablet computer, and the embodiments of the present application are not limited thereto. The electronic device has the folding screen as described above.

[0042] In step 102, when the response state is the suppression state, image data and first touch data of a touch chip of the electronic device are obtained, and the suppression state indicates a stop of the response to a touch operation.

[0043] ​In the embodiments of the present application, in order to determine the state of the electronic device and perform subsequent operations, image data captured by the electronic device and touch data received by the screen need to be acquired first. The first touch data is touch data received by the screen of the electronic device. The electronic device has a photographing function, and in actual applications, the photographing can be performed by the front camera of the electronic device to acquire a captured image, i.e., the image data. The electronic device can perform face recognition based on the image data obtained by photographing. For example, the electronic device can keep the camera to detect intermittently when the electronic device is in the suppression state, and the front camera of the electronic device can capture an image once per 1-2 seconds. The specific interval time is not limited in the embodiments of the present application.

[0044] For the electronic device of the capacitive type, the screen contains touch nodes, and the change of the capacitance value of the touch nodes reflects the operation of the screen by the outside world. When a conductive substance contacts or approaches the screen, the touch data of the touch nodes of the screen changes. In the embodiments of the present application, the touch data can be the capacitance value of the touch nodes of the touch screen. Specifically, the electronic device can update the touch data at a frequency of 120 Hz. Of course, the electronic device can also update the touch data at other frequencies, and the embodiments of the present application are not limited thereto.

[0045] As Figure 2 The touch screen refreshes the touch data at the above frequency, and the touch chip can also obtain the corresponding first touch data. The first touch data can include the coordinate positions of the touch nodes and the capacitance values of the touch nodes.

[0046] In addition, in order to accurately determine whether the user normally uses the electronic device, the image data can also be acquired. In actual applications, the image data of the front camera can be acquired, because when the user normally clicks and slides the touch screen, the face is facing the screen.

[0047] Step 103, determining the state of the electronic device according to the first touch data, and acquiring a touch operation through a touch driver, wherein the touch driver determines the touch operation according to the first touch data.

[0048] In actual situations, other conductive materials such as clothes and other factors can affect the touch data of the electronic device, so before responding to the touch operation, it should be determined whether the state of the electronic device corresponding to the touch data received by the electronic device is the holding state in the normal operation scenario. Only when the electronic device is in the holding state and the touch operation is the target touch operation such as clicking and sliding operation, the step of responding to the touch operation needs to be continued, so as to avoid meaningless operation occupying resources. Therefore, in the embodiments of the present application, first, it can be determined whether the state of the electronic device is in the holding state according to the first touch data, and the touch operation is obtained according to the processing result of the touch driving, and it is judged whether the touch operation is the target touch operation, so as to cooperate with the judgment of whether the user is normally using the electronic device.

[0049] Among them, the target touch operation is at least one of the clicking operation and the sliding operation.

[0050] Step 104, in the case that the image data includes face information, the state of the electronic device is in the holding state, and the touch operation is the target touch operation, the response to the target touch operation is restored.

[0051] When the user uses the electronic device, the screen of the electronic device is faced. If the image data does not include face information, it means that the user does not use the electronic device. If the image data includes face information, it means that the user may be using the electronic device. At the same time, if the electronic device is in the holding state and the touch operation is the target touch operation, the user is very likely to use the electronic device. At this time, the electronic device is in the suppression state, and there is a possibility that the user's normal operation is suppressed, which may cause the problem of no response to the user's operation. At this time, the suppression state needs to be exited, that is, the touch operation corresponding to the touch data is responded.

[0052] Therefore, when the image data includes face image, the electronic device is in the holding state, and the touch operation is the target touch operation, it means that the user is normally using the electronic device, and the response to the target touch operation needs to be restored. When any one of the three conditions that the image data does not include face image, the electronic device is not in the holding state, and the touch operation is not the target touch operation exists, it means that the user does not want to normally use the electronic device, which means that the simulation logic of the simulation state can be normally executed.

[0053] In the embodiment of the present application, the response state of the electronic device can be acquired; then in the case that the response state is a suppression state, image data is acquired and touch data of the touch chip is acquired; the suppression state indicates that the touch operation corresponding to the touch data is prohibited from being responded; according to the image data and the touch data, an operation scene corresponding to the touch data received by the electronic device is determined; in the case that the operation scene is a normal operation scene, the touch operation corresponding to the touch data is responded based on the touch data. Through the above scheme, the error in the detection process of the anti-mis-touch function of the electronic device such as a folding screen mobile phone can be compensated to a certain extent, the possibility of the device not responding to the user touch caused by the error is reduced, and the user experience is improved.

[0054] With reference to Figure 3 , Figure 3 A step flowchart of a touch operation processing method provided by an embodiment of the present application is shown, which specifically includes the following steps:

[0055] Step 201, acquiring a response state of an electronic device.

[0056] This step is similar to step 101 and will not be described in detail here.

[0057] Optionally, the step 201 of acquiring the response state of the electronic device includes:

[0058] Sub-step 2011, acquiring a suppression state enabling parameter;

[0059] Sub-step 2012, in the case that the suppression state enabling parameter indicates that the suppression state is enabled, determining that the electronic device is in the suppression state;

[0060] Sub-step 2013, in the case that the suppression state enabling parameter indicates that the suppression state is not enabled, determining that the electronic device is not in the suppression state.

[0061] In the embodiment of the present application, for the suppression state, a suppression state enabling parameter for the suppression state can be set in the operating system, which can indicate that the suppression state is enabled or indicate that the suppression state is not enabled. For example, a special global tag tag, when the global tag tag = 1, it indicates that the suppression state is enabled, and when the global tag tag = 0, it indicates that the suppression state is not enabled, which is not limited by the embodiment of the present application.

[0062] Optionally, the electronic device is a foldable electronic device, and before the step 201 of acquiring the suppression state enabling parameter, the method further includes:

[0063] Obtaining folding process data of the foldable electronic device; in a case where the folding process data indicates that the foldable electronic device is unfolded within a second preset time duration after being folded, proceeding to step 201.

[0064] In the embodiments of the present application, the process of steps 201-206 of the present application can be used for a particular folding case. For example, the electronic device is folded and then unfolded. At this time, the electronic device should be in the non-suppressed state, but this case will cause the electronic device to be in the suppressed state for a period of time, and after a period of time after unfolding, the suppressed state will be released. In this period of time, the normal operation of the user will be suppressed, and for this case, step 201 can be entered.

[0065] Step 202, in a case where the response state is a suppressed state, obtaining image data and first touch data of a touch chip of the electronic device; the suppressed state indicates that the touch operation is stopped.

[0066] This step is similar to step 102 and will not be described in detail here.

[0067] Step 203, determining the state of the electronic device according to second touch data, the second touch data being touch data corresponding to the back area of the electronic device in the first touch data.

[0068] In the embodiments of the present application, the state of the electronic device includes a holding state, with reference to Figure 4 , Figure 4 A schematic diagram of an electronic device in a holding state provided by an embodiment of the present application is shown, as shown in Figure 4 In a case where the user uses the electronic device, the electronic device is in a holding state, the user folds or unfolds the folding screen, the face is facing the screen, and the finger pressing position on the back of the electronic device will not change much. Therefore, when the electronic device is in a holding state, the finger pressing position on the back will not change much, and the touch data of the back area of the electronic device will not change much. By detecting whether the touch data of the back area of the electronic device changes much within a period of time, whether the finger on the back area changes position much can be detected. The touch data of the back area of the electronic device does not change much, which indicates that the electronic device is in a holding state.

[0069] With reference to Figure 5 , Figure 5 A schematic diagram of original touch data provided by an embodiment of the present application is shown, as shown in Figure 5As shown, the original touch data contains multiple channels, each channel contains multiple nodes, and each node contains a capacitance value, i.e., the original touch data. The touch data contains the capacitance value of the folding screen touch node. The adjacent channel can be a horizontally adjacent channel or a vertically adjacent channel, and the difference value reflects the capacitance difference of the adjacent channel, which can be an absolute value. The same frame original difference value of the adjacent channel can be the sum of the difference values of the original touch data of the two adjacent channels in the original touch data. It should be noted that for a non-folding screen, if the back area is not a screen, the corresponding touch data can be touch data obtained by other sensors, such as an additional pressure sensor, etc. The embodiments of the present application do not limit this.

[0070] In step 204, the operation type and touch coordinates of the touch operation are determined according to the first touch data.

[0071] In the embodiments of the present application, the operation type of the touch operation can include clicking, sliding, or long pressing, etc. When the operation type of the touch operation is clicking or sliding, it can be determined that the operation scenario is a normal operation scenario, and the user normally uses the electronic device, and then the subsequent steps are continued.

[0072] The first touch data includes coordinate data, touch time, etc. In actual application, it can include multiple frames of first touch data. Taking the first coordinate data and the second coordinate data included in two frames of first touch data as an example, the first coordinate data and the second coordinate data can be two times of coordinate data obtained continuously in a short period of time. The first coordinate data can be the data of the touch coordinates acquired for the first time in a time interval, including the horizontal coordinate, the vertical coordinate, the touch time, etc. of the touch coordinates; the second coordinate data can be the data of the touch coordinates acquired for the second time in a time interval, including the horizontal coordinate, the vertical coordinate, the touch time, etc. of the second touch coordinates.

[0073] According to the first touch data, the touch operation can be determined. For example, based on the touch data, the first coordinate data and the second coordinate data can be acquired first; according to the first coordinate data and the second coordinate data, the horizontal coordinate difference value, the vertical coordinate difference value, and the interval time are obtained; then in the case that the absolute value of the horizontal coordinate difference value is greater than a first preset length or the absolute value of the vertical coordinate difference value is greater than a first preset length, it can be determined that the operation is sliding; in the case that the absolute value of the horizontal coordinate difference value is less than a second preset length, the absolute value of the vertical coordinate difference value is less than the second preset length, and the interval time between the first touch and the second touch is less than a first preset time, it can be determined that the operation is clicking.

[0074] The first preset length, the second preset length, and the interval time can be modified according to the type of the electronic device, the habit of the user, and the specific situation, and the embodiments of the present application do not make specific limitations.

[0075] Of course, the type of the touch operation can also be determined according to more frames of the first touch data, and the embodiments of the present application do not limit this.

[0076] In step 205, in a case where the touch operation is of a target operation type and the touch coordinates are not located in a display region of an application icon, it is determined that the touch operation is a target touch operation.

[0077] In the embodiments of the present application, the target operation type can be sliding and clicking. In a case where the touch coordinates are located in the application icon region, the electronic device directly responds to the touch operation corresponding to the touch data, resulting in that the app is responded, which causes confusion to the user's operation, and therefore, when the touch coordinates are located in the application icon region, the touch data corresponding to the touch operation is not responded. The touch operation is of the target operation type, and the touch coordinates are not located in the display region of the application icon, which indicates that the user is normally using the electronic device, and the subsequent operation of resuming the response is continued.

[0078] In a case where any one of the touch operation is not of the target operation type and the touch coordinates are located in the display region of the application icon, it is determined that the touch operation is not a target touch operation.

[0079] It should be noted that, after a preset time interval, for example, 2s, the same touch operation is again recognized at the same coordinates, which indicates that the user needs to touch the application icon at the position, and therefore, the operation can be recognized as a target touch operation, and the response to the target touch operation is resumed in a case where subsequent other conditions are met, so that the corresponding position of the app is responded.

[0080] In step 206, in a case where the image data includes face information, the state of the electronic device is a holding state, and the touch operation is a target touch operation, the response to the target touch operation is resumed.

[0081] In the embodiments of the present application, the face information can be a front portrait or eyes, and when the image data contains the front portrait or eyes, it indicates that the user can be viewing or using the electronic device. The image data contains the face information of the user, and according to the touch data, it is determined that the touch position on the back of the electronic device does not change greatly, and the screen receives the target touch operation, so it can be determined that the user is using the electronic device, and the suppression state of the electronic device can be ended, and the response of the electronic device to the target touch operation corresponding to the first touch data is resumed.

[0082] Optionally, the sub-step 203 includes:

[0083] In sub-step 2031, a consistency value of the multiple frames of the second touch data is obtained according to the multiple frames of the second touch data within a preset time length.

[0084] Sub-step 2032: If the consistency value of multiple frames of the second touch data meets the first preset condition, determine that the state of the electronic device is a holding state.

[0085] In this embodiment of the application, the first preset condition is that the consistency value is less than a threshold preset according to the specific circumstances such as the type of electronic device and user habits. The larger the consistency value, the greater the change in the pressing position of the finger. Therefore, when the consistency value is greater than or equal to the preset threshold, it means that the pressing position of the finger has changed significantly and the electronic device is not in a holding state; when the consistency value is less than the preset threshold, it means that the pressing position of the finger has changed slightly and the electronic device is in a holding state.

[0086] Sub-step 2031 includes:

[0087] Step A111: For each frame of the second touch data, subtract the second touch data of the adjacent channels to obtain the difference value of the adjacent channels.

[0088] Subtracting the touch data between adjacent rows of the touch data in the back area and taking the absolute value yields the row grip difference value of the touch data; subtracting the touch data between adjacent columns of the touch data in the back area and taking the absolute value yields the column grip difference value of the touch data. In this embodiment, the row grip difference value and column grip difference value reflect the degree of change in the touch data, and therefore, absolute values ​​can be taken.

[0089] Reference Figure 6 , Figure 6 This illustration shows a schematic diagram of touch data in the back area provided in an embodiment of this application. Figure 7 This illustration shows a schematic diagram of the row gripping difference value of touch data in the back area provided in an embodiment of this application; Figure 8 This illustration shows a schematic diagram of column grip difference values ​​for touch data in the back area provided in an embodiment of this application.

[0090] for example Figure 7 In China, with Figure 6 The values ​​are for calculation reference; the value of each row is the absolute value of the current row's value minus the value of the next row. Figure 7 The first row and first column of the result is 0 (863-863), the first row and first column of the result is 1 (the absolute value of -1) (863-864), the first row and first column of the result is 3 (the absolute value of -3) (864-867), the first row and first column of the result is 3 (867-870), the first row and first column of the result is 2 (870-872), and so on.

[0091] for example Figure 7 In China, withFigure 6 The values ​​are for calculation reference; the value in each column is the absolute value of the current row's value minus the value in the next column. Figure 7 The first row and first column of the result is 2 (863-861), the first row and second column is 2 (861-859), the first row and third column is 3 (859-856), the first row and fourth column is 4 (856-852), and so on.

[0092] Step A112: Determine the consistency value of multiple frames of the second touch data based on the difference value of each frame of the second touch data.

[0093] For example, the consistency value can be obtained by adding the column grip difference values ​​and the row grip difference values ​​of all the touch data. Another example is that for each frame of touch data, the consistency value can be obtained by... Figure 7 The row differences are summed row by row. Figure 8 The column differences are accumulated column by column. For multi-frame data, the row and column differences between consecutive frames are subtracted to obtain the row error and column error. The absolute values ​​of these errors are then summed to obtain the total error between the two frames. A consistency value is calculated based on this total error, for example, by averaging the total errors across all frames. This method allows for a more convenient determination of the consistency value.

[0094] In summary, in this embodiment, the response state of the electronic device can be obtained; then, when the response state is in a suppressed state, image data and touch data from the touch chip are obtained; the suppressed state indicates that the touch operation corresponding to the touch data is prohibited from being responded to; based on the image data and the touch data, the operation scenario corresponding to the touch data received by the electronic device is determined; when the operation scenario is a normal operation scenario, the touch operation corresponding to the touch data is responded to based on the touch data. Through the above solution, errors in the detection process of the anti-mistouch function of electronic devices such as foldable screen phones can be compensated to a certain extent, reducing the possibility of the device not responding to user touches due to such errors, and improving the user experience.

[0095] The touch operation processing method provided in this application embodiment can be executed by a touch operation processing device. (Refer to...) Figure 9 , Figure 9 This is a block diagram of a touch operation processing device provided in an embodiment of this application, such as... Figure 9 As shown, the touch operation processing device includes:

[0096] The first acquisition module 301 is used to acquire the response status of the electronic device;

[0097] The second acquisition module 302 is configured to acquire image data and first touch data of a touch chip of the electronic device when the response state is a suppression state, and the suppression state indicates that the touch operation is stopped from being responded to.

[0098] The determination module 303 is configured to determine a state of the electronic device according to the first touch data, and acquire a touch operation through a touch driver, wherein the touch driver determines the touch operation according to the first touch data.

[0099] The recovery module 304 is configured to recover the response to the target touch operation when the image data includes face information, the state of the electronic device is in a holding state, and the touch operation is a target touch operation.

[0100] Optionally, the determination module 303 includes:

[0101] The back data determination sub-module is configured to determine the state of the electronic device according to second touch data, and the second touch data is touch data corresponding to a back area of the electronic device in the first touch data.

[0102] Optionally, the back data determination sub-module includes:

[0103] The first determination sub-module is configured to acquire a consistency value of a plurality of frames of the second touch data according to the plurality of frames of the second touch data within a preset time length.

[0104] The second determination sub-module is configured to determine that the foldable screen is in the holding state when the consistency value of the plurality of frames of the second touch data meets a first preset condition.

[0105] The first determination sub-module includes:

[0106] The third determination sub-module is configured to subtract second touch data of adjacent channels for each frame of the second touch data to obtain a difference value of the adjacent channels.

[0107] The fourth determination sub-module is configured to determine the consistency value of each frame of the second touch data according to the difference value of each frame of the second touch data.

[0108] Optionally, the determination module includes:

[0109] The fifth determination sub-module is configured to acquire an operation type and a touch coordinate of the touch operation.

[0110] The sixth determination sub-module is configured to determine that the touch operation is a target touch operation when the touch operation is a target operation type and the touch coordinate is not located in a display area of an application icon.

[0111] To sum up, the touch operation processing apparatus provided by the embodiment of the present application comprises a first acquisition module configured to acquire a response state of an electronic device; a second acquisition module configured to acquire image data and first touch data of a touch chip of the electronic device in the case that the response state is a suppression state; the suppression state indicates that the touch operation is stopped from being responded; a determination module configured to determine a state of the electronic device according to the first touch data, and acquire a touch operation through a touch driver; wherein the touch driver determines the touch operation according to the first touch data; and a recovery module configured to recover the response to a target touch operation in the case that the image data comprises face information, the state of the electronic device is in a holding state, and the touch operation is the target touch operation. The apparatus can compensate for the error in the detection process of the anti-mis-touch function of the folding screen mobile phone and other electronic devices to a certain extent, reduce the possibility that the device does not respond to the user's touch due to the error, and improve the user experience.

[0112] The touch operation processing apparatus in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than the terminal. For example, the electronic device can be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The electronic device can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiment of the present application is not limited in this regard.

[0113] The touch operation processing apparatus in the embodiment of the present application can be an apparatus with an operating system. The operating system can be an Android operating system, an ios operating system, or other possible operating systems. The embodiment of the present application is not limited in this regard.

[0114] The message sending apparatus provided by the embodiment of the present application can implement the method embodiment Figures 1 to 9 The method embodiment implements various processes, which will not be repeated here to avoid repetition.

[0115] Optionally, as shown in Figure 10 The electronic device M00 provided by the embodiment of the present application includes a processor M01 and a memory M02, and the memory M02 stores programs or instructions that can run on the processor M01. When the programs or instructions are executed by the processor M01, the steps of the above-mentioned screen color temperature adjustment method embodiments are implemented, and the same technical effects are achieved. To avoid repetition, details are not described here.

[0116] It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

[0117] Figure 11 The hardware structure of the electronic device in the embodiment of the present application is shown in the figure.

[0118] The electronic device 1000 includes, but is not limited to, a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010, etc.

[0119] Those skilled in the art can understand that the electronic device 1000 can also include a power supply (such as a battery) for powering each component. The power supply can be logically connected to the processor 1010 through a power management system, so as to realize the functions of managing charging, discharging, and power consumption management through the power management system. Figure 11 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device can include more or fewer components than the figure, or combine certain components, or different component arrangements, which are not described here.

[0120] The processor 1010 is configured to obtain a response state of the electronic device; in a case where the response state is a suppression state, obtain image data and first touch data of a touch chip of the electronic device; the suppression state indicates that the response to a touch operation is stopped; determine a state of the electronic device according to the first touch data, and obtain the touch operation through a touch driver; the touch driver determines the touch operation according to the first touch data; in a case where the image data includes face information, the state of the electronic device is a holding state, and the touch operation is a target touch operation, resume the response to the target touch operation.

[0121] In the embodiment of the present application, the response state of the electronic device can be acquired; in the case that the response state is a suppression state, the image data and the first touch data of the touch chip of the electronic device are acquired; the suppression state indicates that the response to the touch operation is stopped; the state of the electronic device is determined according to the first touch data, and the touch operation is acquired through a touch driver; wherein the touch driver determines the touch operation according to the first touch data; in the case that the image data includes face information, the state of the electronic device is in a holding state, and the touch operation is a target touch operation, the response to the target touch operation is restored. Through the above scheme, the error in the detection process of the anti-mis-touch function of the electronic device such as a folding screen mobile phone can be compensated to a certain extent, the possibility of the device not responding to the user's touch due to the error is reduced, and the user experience is improved.

[0122] It should be understood that in the embodiments of the present application, the input unit 1004 can include a graphics processor (GPU) 1041 and a microphone 1042. The graphics processor 1041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1006 can include a display panel 10061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes at least one of a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 can include two parts of a touch detection device and a touch controller. The other input devices 10072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), a trackball, a mouse, an operation lever, and the like, which will not be described here.

[0123] The memory 1009 can be used to store software programs and various data. The memory 1009 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), and the like. In addition, the memory 1009 can include a volatile memory or a non-volatile memory, or the memory 1009 can include both volatile and non-volatile memories. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synch link DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 1009 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.

[0124] The processor 1010 can include one or at least two processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 1010.

[0125] The embodiments of the present application also provide a readable storage medium, the readable storage medium stores programs or instructions, the programs or instructions are executed by a processor to realize each process of the above-mentioned touch operation processing method embodiments, and the same technical effects can be achieved. To avoid repetition, details are not described here.

[0126] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0127] It should be noted that, in this document, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element preceded by "comprises... a" does not, without more constraints, foreclose the existence of additional identical elements in the process, method, article, or apparatus that includes the element. In addition, it should be noted that the scope of the methods and apparatus of the present embodiments are not limited by the order of the steps or the order of the functions performed in the steps, and can include performing the functions in different orders, or substantially simultaneously, or in reverse order, such as described, for example, the described methods can be performed in an order different from that described, and various steps can be added, omitted, or combined, in addition, features described with reference to certain examples can be combined in other examples.

[0128] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment method can be realized by means of software and the necessary general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a plurality of instructions for making a terminal (which can be a mobile phone, computer, server, or network equipment, etc.) execute the method described in each embodiment of the present application.

[0129] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above specific embodiments, the above specific embodiments are only illustrative, not restrictive, and those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the protection scope of the claims.

Claims

1. A touch operation processing method, characterized in that, Acquire the response status of an electronic device; wherein the electronic device is a foldable electronic device; When the response state is in the suppressed state, image data captured by the electronic device and first touch data from the touch chip of the electronic device are acquired, wherein the electronic device enters the suppressed state when it is determined that the electronic device is in a bending process; the suppressed state indicates that the response to touch operation is stopped; The state of the electronic device is determined based on the first touch data, and a touch operation is obtained through a touch driver, wherein the touch driver determines the touch operation based on the first touch data; If the image data includes facial information, the electronic device is in a holding state, and the touch operation is a target touch operation, then the response to the target touch operation is restored.

2. The method according to claim 1, characterized in that, Determining the state of the electronic device based on the first touch data includes: The state of the electronic device is determined based on the second touch data, which is the touch data in the first touch data that corresponds to the back area of ​​the electronic device.

3. The method according to claim 2, characterized in that, Determining the state of the electronic device based on the second touch data includes: Based on multiple frames of the second touch data within a preset time period, obtain the consistency value of the multiple frames of the second touch data; If the consistency value of multiple frames of the second touch data meets the first preset condition, the state of the electronic device is determined to be a holding state; The step of obtaining the consistency value of multiple frames of the second touch data based on multiple frames of the second touch data within a preset time period includes: For each frame of the second touch data, the second touch data of adjacent channels are subtracted to obtain the difference value of adjacent channels; Based on the difference value of the second touch data in each frame, a consistency value of the second touch data in multiple frames is determined.

4. The method according to claim 1, characterized in that, The process of obtaining touch operations through touch driving includes: Obtain the operation type and touch coordinates of the touch operation; If the touch operation is a target operation type and the touch coordinates are not located in the display area of ​​the application icon, then the touch operation is determined to be a target touch operation.

5. A touch operation processing device, characterized in that, The device includes: The first acquisition module is used to acquire the response status of the electronic device; wherein the electronic device is a foldable electronic device; The second acquisition module is used to acquire image data captured by the electronic device and first touch data of the touch chip of the electronic device when the response state is in the suppression state, wherein the electronic device enters the suppression state when it is determined that the electronic device is in a bending process; the suppression state indicates that the response to touch operation is stopped; A determining module is used to determine the state of the electronic device based on the first touch data, and to obtain touch operations through a touch driver, wherein the touch driver determines the touch operations based on the first touch data; The recovery module is used to recover the response to the target touch operation when the image data includes facial information, the electronic device is in a holding state, and the touch operation is a target touch operation.

6. The apparatus according to claim 5, characterized in that, The determining module includes: The determining module is specifically used to determine the state of the electronic device based on the second touch data, wherein the second touch data is the touch data in the first touch data that corresponds to the back area of ​​the electronic device.

7. The apparatus according to claim 6, characterized in that, The determining module includes: The first determining submodule is used to obtain the consistency value of multiple frames of the second touch data based on multiple frames of the second touch data within a preset time period; The second determining submodule is used to determine the state of the electronic device as a holding state when the consistency value of multiple frames of the second touch data meets the first preset condition; The first determining submodule includes: The third determining submodule is used to subtract the second touch data of adjacent channels for each frame of the second touch data to obtain the difference value of adjacent channels; The fourth determining submodule is used to determine the consistency value of multiple frames of the second touch data based on the difference value of each frame of the second touch data.

8. The apparatus according to claim 5, characterized in that, The determining module includes: The fifth determining submodule is used to obtain the operation type and touch coordinates of the touch operation; The sixth determining submodule is used to determine that the touch operation is a target touch operation when the touch operation is a target operation type and the touch coordinates are not located in the display area of ​​the application icon.

9. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing programs or instructions that can run on the processor, the programs or instructions being executed by the processor to implement the method of any one of claims 1 to 4.

10. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the method of any one of claims 1 to 4.

Citation Information

Patent Citations

  • Electronic equipment and method and device for controlling screen of electronic equipment

    CN104281377A

  • Terminal screen-off control device and method

    CN106775067A

  • Terminal control method and device, terminal and readable storage medium

    CN108228257A