Control method for touch operation recognition, electronic device and readable storage medium

Abstract

The present application discloses a control method, an electronic device and a readable storage medium for touch operation recognition, and belongs to the field of terminal technology. The method includes: receiving a touch operation on an electronic device when a knuckle function is turned on, and the knuckle function is a function that can be implemented by the electronic device in response to a knuckle touch operation; when the touch operation is a single-point touch operation and the interface acted on belongs to a specified interface, if the number of touches of the single-point touch operation detected continuously is greater than or equal to a first preset value, the knuckle recognition algorithm model is not called, and the knuckle recognition algorithm model is used to identify whether the touch operation is a knuckle touch operation, and the first preset value is an integer greater than 2. The present application will not call the knuckle recognition algorithm model when the touch operation meets certain conditions, thereby reducing the steps of identifying the touch operation, reducing the power consumption of the electronic device, and ensuring the operational stability of the electronic device.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a control method for touch operation recognition, an electronic device, and a readable storage medium. Background Art

[0002] With the development of terminal technology, the functions of electronic devices such as mobile phones and tablets are becoming more and more diversified. For example, users can tap electronic devices with their knuckles. The operation of tapping electronic devices with their knuckles is a touch operation, which can usually be called a knuckle touch operation. The electronic device can take screenshots, record screens, or annotate the displayed screen in response to the knuckle touch operation.

[0003] Currently, when an electronic device receives a touch operation, it can determine whether the touch operation is a knuckle touch operation through a knuckle recognition algorithm model, and when it is identified that the touch operation is a knuckle touch operation, it can take screenshots, record the screen, or annotate the screen displayed by the electronic device.

[0004] However, identifying whether a touch operation is a knuckle touch operation by using a knuckle recognition algorithm model is likely to increase the power consumption of the electronic device, which is not conducive to the operational stability of the electronic device. Summary of the invention

[0005] The present application provides a control method for touch operation recognition, an electronic device and a readable storage medium, which can be used to reduce the steps of identifying touch operations. The technical solution is as follows:

[0006] In a first aspect, a control method for touch operation recognition is provided, which is applied to an electronic device, and the method includes:

[0007] When the knuckle function is turned on, a touch operation on the electronic device is received, and the knuckle function is a function that can be implemented by the electronic device in response to the knuckle touch operation; when the touch operation is a single-point touch operation and the interface acted on belongs to a designated interface, if the number of touches of the single-point touch operation detected continuously is greater than or equal to a first preset value, the knuckle recognition algorithm model is not called; wherein the knuckle recognition algorithm model is used to identify whether the touch operation is a knuckle touch operation, and the first preset value is an integer greater than 2.

[0008] In this way, when a touch operation is received, the knuckle recognition algorithm model will not be called immediately. Instead, a series of conditional judgments will be performed on the touch operation. When the touch operation meets certain conditions, the electronic device can prohibit calling the knuckle recognition algorithm model, that is, the knuckle recognition algorithm model will not be called continuously, thereby reducing the steps of identifying touch operations, reducing the power consumption of electronic devices, and ensuring the operating stability of electronic devices.

[0009] It should be noted that the designated interface includes operation objects that require multiple single-point touch operations to complete corresponding task items.

[0010] Exemplarily, the designated interface may be an interface including a virtual keyboard, and the designated interface may be a piano game interface, a jumping game interface, etc. When the designated interface is an interface including a virtual keyboard, the corresponding task item refers to inputting text through the virtual keyboard; when the designated interface is a piano game interface, the corresponding task item may be completing music performance through the virtual piano keys in the piano game interface, etc.; when the designated interface is a jumping game interface, the corresponding task item may be reaching the destination through continuous jumping.

[0011] As an example of the present application, when the knuckle function is turned on, after receiving a touch operation on the electronic device, if the touch operation is not a single-point touch operation, the knuckle recognition algorithm model may not be called.

[0012] In this way, the power consumption caused by the electronic device running the finger joint recognition algorithm model is reduced, and the stability of the operation of the electronic device is improved.

[0013] As an example of the present application, when the knuckle function is turned on, after receiving a touch operation on an electronic device, if the interface acted upon by the touch operation is a privacy interface, the knuckle recognition algorithm model is not called, and the privacy interface is an interface that includes user privacy information.

[0014] In this way, when the interface acted on by the touch operation is a privacy interface, since the electronic device will not call the knuckle recognition algorithm model, the electronic device cannot recognize the knuckle touch operation, thereby avoiding screenshot and recording operations on the privacy interface and ensuring the security of the user's privacy information.

[0015] As an example of the present application, when the touch operation is a single-point touch operation and the interface acted on belongs to a designated interface, if the number of touches of the single-point touch operation counted is greater than or equal to a second preset value and less than a first preset value, then the touch time interval between the last two single-point touch operations counted is determined, and the second preset value is an integer less than the first preset value and greater than or equal to 2; when the touch time interval is greater than the first duration threshold, start timing; during the timing process, if a single-point touch operation is detected again within the preset duration, continue to count the number of touches of the single-point touch operation; when the number of touches of the single-point touch operation counted is greater than or equal to the first preset value, the knuckle recognition algorithm model is not called.

[0016] In this way, when the counted number of touches is greater than or equal to the second preset value and less than the first preset value, it is determined whether a single-point touch operation is detected again within the preset time length, thereby avoiding misjudgment of the user's frequent single-point touch operations and improving the accuracy of counting the number of touches of single-point touch operations.

[0017] As an example of the present application, after starting timing when the touch time interval is greater than a first duration threshold, when the timing duration reaches a preset duration and no single-point touch operation is detected again, the knuckle recognition algorithm model is called.

[0018] In this way, by determining the relationship between the touch time interval and the first duration threshold, misjudgment of the user's frequent single-point touch operations is avoided, and the accuracy of counting the number of touches of the single-point touch operations is improved.

[0019] As an example of the present application, when the touch operation is a single-point touch operation and the indicated interface belongs to a designated interface, if the number of touches of the single-point touch operation detected continuously is greater than or equal to a first preset value, the finger joint recognition algorithm model is not called. After that, when the time for not calling the finger joint recognition algorithm model reaches a second time threshold, if the single-point touch operation continues to be detected, and the number of touches of the single-point touch operation detected continuously within a third time threshold is less than or equal to the second preset value, the finger joint recognition algorithm model is called, and the second preset value is an integer less than the first preset value and greater than or equal to 2; or, after ending the response to the touch operation, if the single-point touch operation continues to be detected, and the number of touches of the single-point touch operation detected continuously within the third time threshold is less than or equal to the second preset value, the finger joint recognition algorithm model is called.

[0020] In this way, although the calling of the knuckle recognition algorithm model is prohibited this time, when the touch operation meets certain conditions in the future, the electronic device can call the knuckle recognition algorithm model in time, thereby ensuring the normal use of the knuckle function.

[0021] As an example of the present application, before receiving a touch operation on an electronic device, when the knuckle function is turned on and a startup operation on a game application is received, if there is no corresponding application assistant for the game application and the type of the game application is a preset type, the knuckle function can be turned off.

[0022] As an example of the present application, before receiving a touch operation on an electronic device, when the knuckle function is turned on and a startup operation on a game application is received, if there is no corresponding application assistant for the game application and the application identifier of the game application is in a preset whitelist, the knuckle function can be turned off; when the game application is running in the foreground, when a touch operation is received, the knuckle recognition algorithm model is not called.

[0023] In this way, when the knuckle function is turned off and the game application is running in the foreground, the electronic device will not call the knuckle recognition algorithm model, thereby reducing the power consumption of the electronic device and ensuring the running stability of the game application.

[0024] As an example, when the knuckle function is turned off, if the application interface of the game application is exited, the electronic device can turn the knuckle function back on.

[0025] As an example of the present application, when a game application is running in the foreground, after receiving a touch operation, the knuckle recognition algorithm model is not called, and a first setting operation can also be received; in response to the first setting operation, the knuckle function is turned on.

[0026] In this way, by manually turning on the knuckle function by the user, not only the interactivity with the user is improved, but also the flexibility of using the knuckle function is improved.

[0027] As an example of the present application, when the knuckle function is turned on, after receiving a touch operation on the electronic device, the area of ​​the display screen where the touch operation acts can also be determined; when the touch operation acts on a target area of ​​the display screen, the number of touch points corresponding to the touch operation is determined, and the target area is the area in the electronic device that can recognize knuckle touch operations; when the number of touch points is a first value, it is determined that the touch operation is a single-point touch operation.

[0028] In this way, since a target area is set for the display screen, no matter which interface is displayed on the display screen, the electronic device can determine whether to continue subsequent operations based on the target area, further reducing the scenarios in which the knuckle recognition algorithm model is called.

[0029] In a second aspect, an electronic device is provided, wherein the structure of the electronic device includes a processor and a memory, wherein the memory is used to store a program that supports the electronic device to execute the control method for touch operation recognition provided in the first aspect, and to store data involved in the control method for touch operation recognition described in the first aspect. The processor is configured to execute the program stored in the memory. The electronic device may also include a communication bus, which is used to establish a connection between the processor and the memory.

[0030] In a third aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer executes the control method for touch operation recognition described in the first aspect.

[0031] In a fourth aspect, a computer program product including instructions is provided, which, when executed on a computer, enables the computer to execute the control method for touch operation recognition described in the first aspect.

[0032] The technical effects obtained by the above-mentioned second aspect, third aspect and fourth aspect are similar to the technical effects obtained by the corresponding technical means in the above-mentioned first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a schematic diagram of an application scenario provided by an embodiment of the present application;

[0034] Figure 2 is a schematic diagram of another application scenario provided by an embodiment of the present application;

[0035] Figure 3 is a schematic diagram of another application scenario provided by an embodiment of the present application;

[0036] Figure 4 is a schematic diagram of another application scenario provided by an embodiment of the present application;

[0037] Figure 5 is a schematic diagram of another application scenario provided by an embodiment of the present application;

[0038] Figure 6 is a schematic diagram of another application scenario provided by an embodiment of the present application;

[0039] Figure 7 is a block diagram of a software system of an electronic device provided in an embodiment of the present application;

[0040] Figure 8 is an interactive schematic diagram of a touch operation recognition method provided in an embodiment of the present application;

[0041] Fig. 9 is a flow chart of another touch operation recognition method provided in an embodiment of the present application;

[0042] Fig.10 is a flow chart of another touch operation recognition method provided in an embodiment of the present application;

[0043] Fig.11 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0045] It should be understood that the "multiple" mentioned in this application refers to two or more. In the description of this application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate the clear description of the technical solution of this application, the words "first" and "second" are used to distinguish between the same items or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not limit them to be different.

[0046] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0047] In some scenarios, electronic devices such as mobile phones and tablet computers have a knuckle function. When the knuckle function is turned on, users can use knuckle touch operations to trigger mobile phones, tablet computers and other electronic devices to take screenshots, record screens, and annotate the displayed interface. The screenshot operation includes full screenshot operations, partial screenshot operations, and scrolling screenshot operations. For example, see Figure 1 In Figure (a), when the mobile phone is playing a video, if the user needs to take a screenshot or record the current playing screen, the user can tap the display screen with the knuckles; in response to the tapping operation on the display screen, the mobile phone calls the knuckle recognition algorithm model to identify whether the tapping operation is a knuckle touch operation, and if it is identified that the tapping operation is a knuckle touch operation, refer to Figure 1 In (b), the mobile phone takes a screenshot of the currently displayed playback screen.

[0048] However, since the knuckle function is turned on, no matter what kind of touch operation the user performs on the electronic device, the electronic device needs to call the knuckle recognition algorithm model to identify whether the touch operation is a knuckle touch operation. For example, when the user uses the fingertips to click, long press, slide, or other touch operations on the display screen, the electronic device will still call the knuckle recognition algorithm model, resulting in the knuckle recognition algorithm model being constantly called and the touch operation recognition method being redundant, thereby increasing the power consumption of the electronic device and affecting the operating stability of the electronic device.

[0049] In order to reduce the power consumption of electronic devices and improve the operational stability of electronic devices, an embodiment of the present application provides a control method for touch operation recognition, in which, when the electronic device receives a touch operation, if the touch operation is a single-point touch operation and the interface on which the touch operation acts is a designated interface, then if the number of touches of the single-point touch operation detected continuously is greater than or equal to a first preset value, the finger joint recognition algorithm model will not be called. Because in the embodiment of the present application, the finger joint recognition algorithm model will not be called when the touch operation meets certain conditions, that is, the finger joint recognition algorithm model will not be called continuously, thereby reducing the steps of identifying the touch operation, reducing the power consumption of the electronic device, and ensuring the operational stability of the electronic device.

[0050] To facilitate understanding, the following uses a mobile phone as an example to introduce application scenarios involved in the embodiments of the present application.

[0051] Please refer to Figure 2 , Figure 2 is a schematic diagram of an application scenario according to an exemplary embodiment. In an application scenario, when a user needs to search for information or publish information, the mobile phone can display the following information: Figure 2 The search interface shown in the figure has a virtual keyboard S1, and the user can click the keys in the virtual keyboard S1 to enter text in the input field S2 of the search interface. When the user taps the virtual keyboard S1, the mobile phone recognizes that the tapping operation is a single-point touch operation, and recognizes that the search interface includes the virtual keyboard S1. Since the user taps the virtual keyboard S1 frequently, the mobile phone will not call the knuckle recognition algorithm model when the number of single-point touch operations detected by the mobile phone is greater than 5 times. That is, the mobile phone will not identify whether the touch operation is a knuckle touch operation through the knuckle recognition algorithm model.

[0052] In another application scenario, when a user uses a payment application to make a payment, the mobile phone may display the following information: Figure 3In the payment interface shown in Figure (a), the payment code is displayed in the payment interface, and the payment code is the user's private information. When the mobile phone detects that the displayed interface contains private information, it will not call the knuckle recognition algorithm model. In this way, when the user performs a knuckle touch operation on the payment interface, the mobile phone may not respond to the knuckle touch operation. In other words, when the user performs a knuckle touch operation on the payment interface, the mobile phone will not take a screenshot of the payment interface.

[0053] As an example, in order to inform the user why the mobile phone cannot respond to the knuckle touch operation, the mobile phone can display the following information in the payment interface without calling the knuckle recognition algorithm model: Figure 3 The first prompt information shown in Figure (b) may display "To avoid payment code leakage, this interface does not support screenshot and screen recording operations."

[0054] In another application scenario, when a user uses a game application, if the game application has a corresponding game assistant (also called an application assistant, which is a built-in application or a small program), when the game application is started, the mobile phone can automatically turn off the knuckle function through the game assistant. And when the knuckle function is turned off, see Figure 4 As shown in Figure (a) in the figure, the mobile phone can display a second prompt message in the application interface of the game application, such as displaying "The knuckle function is closed" to prompt the user that the knuckle function cannot be used when using the game application.

[0055] In some embodiments, when a user is using a game application, if the game application does not have a corresponding game assistant, then when the game application is started, the mobile phone can automatically turn off the knuckle function and display a second prompt message if the game type corresponding to the game application is a specified type such as piano, jumping (running), etc.

[0056] In some embodiments, when a user is using a game application, if the user wishes to enable the knuckle function, the user may pull down the navigation bar (eg, Figure 4 In response to the user pulling down the navigation bar, the mobile phone displays the following Figure 4 In the navigation interface shown in Figure (b), the user can continue to click the "Shield Knuckles" option S3 in the navigation bar; see Figure 4In Figure (c), in response to a click operation on the "shield knuckles" option S3, the mobile phone turns on the knuckles function when the knuckles function is turned off, and the color of the "shield knuckles" option S3 changes. In the embodiment of the present application, the "shield knuckles" option S3 is represented by a black and white color change to indicate different states of the "shield knuckles" option S3.

[0057] In another application scenario, when a user is using a game application, he or she can enable the knuckle function not only in the above manner, but also in other manners. Figure 5 In Figure (a), when the mobile phone displays the application interface of the game application in the foreground, the user can swipe upward from the bottom of the application interface of the game application. In response to the swiping upward, the mobile phone exits the game application to the background and displays the following Figure 5 The mobile phone desktop shown in Figure (b).

[0058] As an example, after the game application exits the background, the phone can turn on the knuckle function and Figure 5 The third prompt information shown in Figure (b) in the figure may display "knuckle function is turned on" to prompt the user to continue to use the knuckle function. If the game application is returned to the foreground, that is, the mobile phone responds to the user's swiping up from the bottom of the desktop, the following may be displayed: Figure 5 In the background management interface shown in FIG. (c) of FIG. 1 , the user can click on the background interface of the game application displayed in the background management interface. In response to the click operation on the background interface of the game application, the mobile phone can display the following Figure 5 The application interface of the game application is shown in Figure (d), and the second prompt information can be displayed again in the application interface, that is, "the knuckle function is turned off".

[0059] It should also be noted that the mobile phone can not only enable the knuckle function when the game application enters the background, but also enable the knuckle function when the game application is completely exited.

[0060] In another application scenario, when a user is using a mobile phone, if he needs to take a screenshot of any displayed interface, such as taking a screenshot of an input interface currently displayed on the mobile phone, the user can tap the display screen with his knuckles. In response to the operation of tapping the display screen with his knuckles, the mobile phone can determine whether the operation is in the form of Figure 6If it is determined that the operation of the knuckle tapping the display screen is outside the target area S4, the knuckle recognition algorithm model is prohibited from being called, that is, the mobile phone responds to the operation of the knuckle display screen and does not perform a screenshot operation. In order to prompt the user why the screenshot operation cannot be performed, the mobile phone can display the following Figure 6 The fourth prompt message shown in Figure (b) may display "Please perform operations at other locations on the screen."

[0061] As an example, the target area S4 can be a rectangle, a square, a circle or an ellipse, etc. The embodiment of the present application is described by taking the target area S4 as a rectangle as an example, which does not constitute a limitation on the embodiment of the present application. The lines of the target area S4 in the accompanying drawings are for illustrating the position of the display area. In actual applications, the lines of the target area S4 are not visible.

[0062] As an example, when the target area S4 is a rectangle, the distance between each area edge of the target area S4 and the corresponding display screen frame is between 8mm (millimeter) and 9mm. That is, the distance between the upper edge of the target area S4 and the upper frame of the display screen is between 8mm (millimeter) and 9mm, the distance between the lower edge of the target area S4 and the lower frame of the display screen is between 8mm (millimeter) and 9mm, the distance between the left edge of the target area S4 and the left frame of the display screen is between 8mm (millimeter) and 9mm, and the distance between the right edge of the target area S4 and the right frame of the display screen is between 8mm (millimeter) and 9mm.

[0063] It should be noted that, in the embodiments of the present application, only the above Figure 2-Figure 6 The application scenario shown is used as an example for illustration and does not constitute a limitation on the embodiments of the present application.

[0064] Next, the software system of the electronic device 100 will be described.

[0065] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software system of the electronic device 100.

[0066] Figure 7 1 is a block diagram of a software system of an electronic device 100 provided in an embodiment of the present application. Figure 7 The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into multiple layers, from top to bottom, namely, the application layer, the application framework layer, the native layer, and the kernel layer.

[0067] The application layer can include a series of application packages.

[0068] As an example, Figure 7 As shown, the application layer may also include a finger joint function module and a scene recognition module.

[0069] As an example, the knuckle function module can perform a screenshot operation, a screen recording operation or a global annotation operation on the interface affected when receiving an operation instruction corresponding to the knuckle touch operation. The scene recognition module can identify the interface affected by the touch operation.

[0070] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 7 As shown, the application framework layer may include a first power management module (Power Manager) and a screenshot management module (HnSmartShot.apk).

[0071] As an example, the first power management module can send a prohibition call message to the local layer when the display screen enters the off-screen state, and the prohibition call message is used to indicate that the call of the finger joint recognition algorithm model is prohibited; when the display screen enters the bright-screen state from the off-screen state, the first power management module can send a release prohibition message to the local layer, and the release prohibition message is used to indicate that the call of the finger joint recognition algorithm model is released. The screenshot management module can send a corresponding operation instruction to the finger joint function module when receiving a response message sent by the local layer, and the response message is a message indicating a response to the finger joint touch operation.

[0072] The local layer may include a touch input processing module (Input Framework), a touch management module (libfingersense_wrapper.so) and a touch algorithm library (hwlibfingersence.so). The touch algorithm library includes various algorithms for identifying touch operations, such as a finger joint recognition algorithm model.

[0073] As an example, the touch input processing module can determine whether the touch operation is a single-point touch operation when detecting a touch operation, and send an identification message to the scene recognition module to instruct the scene recognition module to identify the interface on which the touch operation acts; when the touch input processing module determines that the touch operation is a single-point touch operation and the interface identified by the scene recognition module is a designated interface, if the number of consecutive single-point touch operations counted is greater than or equal to a certain threshold, a prohibition call message is sent to the touch algorithm library to prohibit the call of the finger joint recognition algorithm model in the touch algorithm library. The designated interface includes operation objects that require multiple single-point touch operations to complete the corresponding task items.

[0074] As an example, when the touch input processing module allows the call of the finger joint recognition algorithm model, the touch algorithm library can read and write the touch data in the kernel layer, and the touch data includes acceleration (ACC) data and touch (TP) data. The touch algorithm library can calculate the coverage area and tapping force of the touch operation in real time according to the touch data, so as to identify whether the touch operation is a finger joint touch operation through the finger joint recognition algorithm model. In the case of identifying that the touch operation is a finger joint touch operation, the touch algorithm library can send a recognition success mark to the touch management module, such as the recognition success mark is flag=1 / 3, and the recognition success mark is used to indicate that the finger joint touch operation is successfully recognized. When the touch management module receives the recognition success mark, it can obtain the touch track of the finger joint touch operation, and send the touch track and the recognition success mark to the touch input processing module. When the touch input processing module receives the touch track and the recognition success mark, it sends a corresponding response message to the screenshot management module according to the touch track of the finger joint touch operation.

[0075] As an example, the local layer may further include a second power management module, which is used to send a prohibition call instruction to the touch algorithm library when receiving a prohibition call message sent by the first power management module, so as to instruct the touch algorithm library to prohibit calling the finger joint recognition algorithm model. The second power management module is also used to send a release prohibition instruction to the touch algorithm library when receiving a release prohibition message sent by the first power management module, so as to instruct the touch algorithm library to release the prohibition call of the finger joint recognition algorithm model.

[0076] The kernel layer is the layer between hardware and software. The kernel layer contains multiple drivers, such as touch sensor driver, acceleration sensor driver, etc.

[0077] As an example, the touch sensor driver may obtain TP diff data detected by the touch sensor in the hardware layer, and the acceleration sensor driver may receive ACC data detected by the acceleration sensor reported by the sensor management component (Sensor Hub) in the hardware layer.

[0078] The following is an example of the workflow of the software and hardware of the electronic device 100 in conjunction with a typing scenario.

[0079] When the touch sensor 180K and the acceleration sensor detect a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into raw input events (including touch coordinates, timestamp of the touch operation, and other information). The raw input events are stored in the kernel layer. The application framework layer can obtain the raw input events from the kernel layer and identify the controls corresponding to the raw input events. If the touch operation is not a single-point touch operation, the application framework layer will not call the knuckle recognition algorithm model.

[0080] Based on the execution subject provided by the above embodiment, the control method of touch operation recognition provided by the embodiment of the present application is introduced below. Figure 8 , Figure 8 The present invention is a flow chart of a control method for touch operation recognition according to an exemplary embodiment. As an example but not a limitation, the method is applied to an electronic device and is described by taking the above module interaction as an example. The method may include some or all of the following contents:

[0081] Step 801: When receiving TP data and ACC data, the driving module determines touch information according to the TP data and stores the touch information.

[0082] It should be noted that the driving module includes a sensor driver and a touch sensor driver.

[0083] Since users may touch the display screen of the electronic device when using the electronic device, in this case, the acceleration sensor in the electronic device can detect ACC data, and the touch sensor can detect TP data. Figure 7 As shown, when the acceleration sensor detects ACC data, the ACC data can be sent to the acceleration sensor driver through the sensor management component. When the touch sensor detects TP data, the TP data can be sent to the touch sensor driver.

[0084] As an example, the ACC data may be a 128-bit one-dimensional array, and the TP data may be TPdiff data of a 7*7 matrix value. When the display screen of the electronic device is a capacitive display screen, the TP data may be the capacitance of the touch operation position. When the display screen of the electronic device is a resistive display screen, the TP data may be the resistance of the touch operation position.

[0085] In some embodiments, when the driver module receives the TP data, it can determine the current change according to the TP data, and then determine the touch coordinate information according to the current change. In addition, the driver module can determine the time when the TP data is received as the timestamp information of the touch operation. Of course, the driver module can also determine the touch information in other ways, and the embodiments of the present application do not specifically limit this.

[0086] It should be noted that the touch information may include one or more of touch coordinate information of the touch operation, timestamp information of the touch operation, and the number of touch points.

[0087] As an example, the driving module may store the determined touch information and the corresponding ACC data in correspondence.

[0088] Step 802: When a touch operation is detected, the touch input processing module reads touch information from the driving module.

[0089] Generally, the reading of input events requires the cooperation of multiple modules, and touch operations belong to input events. Therefore, the detection of touch operations requires the cooperation of multiple modules.

[0090] It should be noted that the multiple modules may include a system service module (SystemServer), a first input management service module (InputManagerService), a second input management module (com_android_server_input_Input_ManagerService), a native input management module (NativeInputManager), an input management module (InputManager), an input reading module (InputReader), an input thread module (InputThread) and an event management center (EventHub). Among them, the event management center is a module of the kernel layer, and the first input management service module, the second input management module, the native input management module, the input management module, the input reading module and the input thread module are all submodules in the touch input processing module.

[0091] As an example, under the cooperation of multiple modules, the input thread module can cyclically read input events from the event management center. When the input thread module reads the input event, that is, when a touch operation is detected, the touch input processing module can obtain touch information from the driving module.

[0092] It should be noted that, when the user performs a touch operation on the display screen, the driving module can store the touch information corresponding to the touch operation, and therefore, the touch input processing module can obtain the latest stored touch information from the driving module.

[0093] Step 803: The touch input processing module determines whether the touch operation is a single-point touch operation according to the touch information.

[0094] As can be seen from the above, the touch information may include one or more of touch coordinate information, touch timestamp information, and touch point quantity of the touch operation. Depending on the touch information, the touch input processing module determines whether the touch operation is a single-point touch operation in different ways.

[0095] In one possible manner, when the touch information includes the number of touch points, if the number of touch points is a first value, the touch input processing module can determine that the number of touch points indicates that the touch operation is a single-point touch operation; if the number of touch points is not the first value, the touch input processing module determines that the number of touch points indicates that the touch operation is not a single-point touch operation, that is, determines that the touch operation is a multi-point touch operation.

[0096] As an example, the parameter indicating the number of touch points can be represented by "pointer", and the touch input processing module can read the value of "pointer" and, when "pointer 0" is read, determine that the number of touch points indicates that the touch operation is a single-point touch operation.

[0097] It should be noted that the first value can be pre-set according to requirements, for example, the first value can be 0 or 1.

[0098] In another possible manner, the touch information does not include the number of touch points and includes touch coordinate information and timestamp information of the touch operation. The touch coordinate information includes the touch coordinates of the starting action position of the touch operation and the touch coordinates of the ending action position, and the timestamp information of the touch operation includes the time point of the starting action and the time point of the ending action of the touch operation. In this way, the touch input processing module may include the following steps after determining whether the touch operation is a single-point touch operation according to the touch information: determining the moving distance of the touch operation according to the touch coordinates of the starting action position and the touch coordinates of the ending action position of the touch operation; determining the touch action duration of the touch operation according to the time point of the starting action and the time point of the ending action of the touch operation; and determining that the number of touch points indicates that the touch operation is a single-point touch operation when the moving distance is less than or equal to the second value and the touch action duration is less than or equal to the third value.

[0099] As an example, the touch input processing module can determine the moving distance of the touch operation according to the touch coordinates of the starting position and the touch coordinates of the ending position of the touch operation by using the following first formula, and determine the touch duration of the touch operation according to the starting time point and the ending time point of the touch operation by using the following second formula.

[0100] First formula:

[0101] Second formula: (2)

[0102] It should be noted that, in the above first formula (1), is the moving distance of the touch operation, is the horizontal coordinate of the end action position, is the vertical coordinate of the end action position, is the horizontal coordinate of the starting action position, and is the vertical coordinate of the starting action position; in the above second formula (2), is the touch action duration, is the time point of the start action, and is the time point of the end action.

[0103] It should also be noted that the second value and the third value can be pre-set according to requirements. For example, the second value can be 0 or 1, and the third value can be 200 milliseconds or 250 milliseconds.

[0104] As an example, when the moving distance is greater than the second value and / or the touch action duration is greater than the third value, the touch input processing module can determine that the number of touch points indicates that the touch operation is not a single-point touch operation.

[0105] As an example, when the moving distance is greater than the second value and less than or equal to the fourth value, and the touch action duration is greater than the third value, the touch input processing module may determine that the touch operation is a short-distance sliding operation. When the moving distance is greater than the fourth value, and the touch action duration is greater than the third value, the touch input processing module may determine that the touch operation is a long-distance sliding operation. When the moving distance is less than or equal to the second value, and the touch action duration is greater than the third value, the touch input processing module may determine that the touch operation is a long press operation.

[0106] Step 804: When the touch input processing module determines that the touch operation is a single-point touch operation, the touch input processing module sends a scene recognition message to the scene recognition module.

[0107] Since the touch operation is a single-point touch operation, the single-point touch operation may also be an operation that the user must perform in some scenarios. For example, when the user is typing on a virtual keyboard, or when the user is required to continuously click on the interface in the game interface, etc., although these situations can detect that the touch operation is a single-point touch operation, in this case, it is not necessary to identify whether the touch operation is a knuckle touch operation. In this way, when the touch input processing module determines that the touch operation is a single-point touch operation, it is also necessary to determine the scenario in which the user performs the single-point touch operation, that is, to determine the interface on which the touch operation acts. Therefore, the touch input processing module can send a scene recognition message to the scene recognition module to obtain the application interface used for the single-point touch operation through the scene recognition module.

[0108] In some embodiments, when the touch input processing module determines that the touch operation is not a single-point touch operation, that is, when the touch operation is a multi-point touch operation, it can send a prohibition call message to the touch algorithm library. When the touch algorithm library receives the prohibition call message, other programs or modules will not call the finger joint recognition algorithm model.

[0109] It should be noted that the knuckle recognition algorithm model is used to identify whether the touch operation is a knuckle touch operation.

[0110] As an example, when the touch algorithm library receives a call prohibition message, it can prohibit the call of the finger joint recognition algorithm model, for example, the finger joint recognition algorithm model can be shielded. After the touch algorithm library shields the finger joint recognition algorithm model, other modules can no longer call the finger joint recognition algorithm model. The shielding of the finger joint recognition algorithm model can be achieved by adding a prohibition access mark to the finger joint recognition algorithm model, modifying the function name, etc., and the embodiments of the present application do not impose specific restrictions on this.

[0111] Exemplarily, the touch algorithm library can implement prohibition and unbanning of the finger joint recognition algorithm model through the PWM function. The code segment for prohibition and unbanning of the finger joint recognition algorithm model can be as follows, and the code segment is only an example and does not limit the embodiments of the present application.

[0112] Void nativeSetFingerSense(jboolean enable){

[0113] (gFingerSenseHandle = NULL) {

[0114] ALOGE("libfingersense_wrapper not found");

[0115] Return;

[0116] (enableFingerSense=NULL||disableFingerSense=NULL){

[0117] ALOGE("fingersense method not found");

[0118] Return;

[0119] Step 805: The scene recognition module recognizes the interface on which the touch operation acts, and sends the interface recognition result to the touch input processing module.

[0120] Step 806: The touch input processing module receives the interface recognition result sent by the scene recognition module.

[0121] Step 807: When the interface recognition result indicates that the interface acted upon by the touch operation is a designated interface, the touch input processing module counts the number of touches of the single-point touch operation detected continuously.

[0122] It should be noted that the designated interface includes operation objects that require multiple single-point touch operations to complete the corresponding task items. For example, the designated interface may be an interface displaying a virtual keyboard, or a game interface that requires multiple clicks on game operation controls. Figure 2 The application scenario shown.

[0123] Since the interface affected by the touch operation is a designated interface, it means that the current scenario may be that the user needs to frequently perform single-point touch operations, and not a scenario for knuckle touch operations. Therefore, in order to accurately identify touch operations, the touch input processing module can count the number of single-point touch operations detected continuously.

[0124] In some embodiments, when the user continuously performs touch operations, the TP sensor can continuously detect TP data, and the ACC sensor can continuously detect ACC data, so that each time the user performs a touch operation, the driving module can repeat the operation of step 801, the touch processing module can repeat the operation of steps 802-804, and the scene recognition module can repeat the operation of step 805, and each time it is determined that the current interface recognition result has not changed, the touch input processing module can repeat the operation of step 807. That is, when the user continuously performs a single-point touch operation in a specified interface, the touch input processing module can count the number of touches of the continuously detected single-point touch operations.

[0125] Step 808: When the counted number of touch operations is greater than or equal to the second preset value and less than the first preset value, the touch input processing module may determine the touch time interval between the last two single-point touch operations counted.

[0126] Since the touch input processing module will count the number of touches each time a single-point touch operation is detected, when the user performs touch operations multiple times (usually greater than or equal to 2 times), there must be a situation where the number of touches is greater than or equal to the second preset value and less than the first preset value. When the number of touches is greater than or equal to the second preset value and less than the first preset value, the touch input processing module can determine whether it is a scenario where the user frequently clicks on the display screen by the time interval between consecutive single-point touch operations, that is, the touch input processing module can determine the touch time interval between the last two single-point touch operations counted. The first preset value is an integer greater than 2, and the second preset value is an integer greater than or equal to 2 and less than the first preset value.

[0127] Since the touch information includes the timestamp information of the touch operation, the touch input processing module can determine the touch time interval between the last two single-point touch operations counted according to the timestamp information respectively corresponding to the last two single-point touch operations counted.

[0128] It should be noted that the first preset value and the second preset value can be pre-set according to needs. For example, the first preset value can be 4 times, 5 times or 6 times, and the second preset value can be 2 times or 3 times.

[0129] In some embodiments, when the number of touches counted is less than the second preset value, and the number of touches counted has not been greater than or equal to the second preset value within the third time threshold, the touch input processing module can send an operation identification message to the touch algorithm library. The operation identification message is used to indicate whether the finger joint recognition algorithm model in the touch algorithm library identifies the touch operation as a finger joint touch operation, that is, the touch input processing module can call the finger joint recognition algorithm model.

[0130] It should be noted that the third duration threshold can be set according to demand, for example, the third duration threshold can be 2 seconds or 3 seconds.

[0131] Step 809: When the touch time interval is greater than the first time threshold, the touch input processing module starts timing.

[0132] When the touch time interval is greater than the first duration threshold, the user may be performing a knuckle touch operation, or the user may be performing frequent single-point touch operations at a slow speed. Therefore, in order to avoid misjudgment, the touch input processing module may also start timing when the touch time interval is greater than the first duration threshold.

[0133] It should be noted that the touch input processing module can perform timing by a timer, and of course can also perform timing by other methods, and the embodiment of the present application does not impose specific limitations on this.

[0134] In some embodiments, when the touch time interval is less than or equal to the first time threshold, it indicates that the user is most likely frequently performing single-point touch operations rather than knuckle touch operations, and therefore, the touch input processing module may continue to count the number of touches of the single-point touch operations. That is, the touch input processing module may return to the operation of step 807.

[0135] It should be noted that the first duration threshold can be set according to demand, for example, the first duration threshold can be 500 milliseconds or 1 second.

[0136] Step 810: within the preset time duration, if the touch input processing module detects a single-point touch operation again, the process returns to the operation of step 807.

[0137] Since the touch input processing module detects the single-point touch operation again within the preset timing time, it means that the user is most likely clicking the display screen frequently. Therefore, the touch input processing module can continue to count the number of touches of the single-point touch operation.

[0138] It should be noted that the preset time length can be set in advance according to needs, for example, the preset time length can be 1 second or 2 seconds.

[0139] In some embodiments, when the timing duration reaches a preset duration and the single-point touch operation cannot be detected again, the touch input processing module can send an operation identification message to the touch algorithm library.

[0140] Step 811: when the number of touch operations of the single-point touch is greater than or equal to a first preset value, the touch input processing module sends a prohibition call message to the touch algorithm library.

[0141] When the number of touches is greater than or equal to the first preset value, it indicates that the user is frequently performing single-point touch operations and does not need to use the knuckle function. Therefore, the touch input processing module may send a prohibition call message to the touch algorithm library.

[0142] Step 812: When receiving the prohibition call message, the touch algorithm library prohibits other programs or modules from calling the finger joint recognition algorithm model.

[0143] It should be noted that the operation of the touch algorithm library prohibiting other programs or modules from calling the finger joint recognition algorithm model can refer to the operation of the touch algorithm library prohibiting other programs or modules from calling the finger joint recognition algorithm model recorded in the above step 804, and the embodiment of the present application will not elaborate on this one by one.

[0144] Step 813: When the touch operation response ends, the touch input processing module sends a release message to the touch algorithm library.

[0145] In some embodiments, when the touch processing module sends a prohibition call message to the touch algorithm library, the touch processing module can also send an execution message to the module that responds to the touch operation through the input event distribution module (InputDispatcher). That is, the operations of steps 803-813 above can be performed before the touch processing module sends the execution message to the module that responds to the touch operation.

[0146] It should be noted that the operations of the above steps 803 to 813 can all be completed by the input listening module (InputListener) in the touch processing module.

[0147] In some embodiments, the touch input processing module can not only send a release message to the touch algorithm library when the touch operation response ends, but also send a release message to the touch algorithm library when the time after sending the prohibit call message reaches a second time threshold.

[0148] Step 814: upon receiving the release message, the touch algorithm library releases the prohibition on calling the knuckle recognition algorithm model.

[0149] As an example, the operation of the touch algorithm library to lift the prohibition on calling the knuckle recognition algorithm model corresponds to the operation of prohibiting the calling of the knuckle recognition algorithm model, such as the operation of prohibiting the calling of the knuckle recognition algorithm model is: adding a prohibit access flag to the knuckle recognition algorithm model. Then the operation of lifting the prohibition on calling the knuckle recognition algorithm model may include: deleting the prohibit access flag added to the knuckle recognition algorithm model; or, changing the prohibit access flag corresponding to the knuckle recognition algorithm model to an allowed access flag. The operation of prohibiting the calling of the knuckle recognition algorithm model is: changing the function name of the knuckle recognition algorithm model. Then the operation of lifting the prohibition on calling the knuckle recognition algorithm model may include: restoring the function name of the knuckle recognition algorithm model, etc.

[0150] In an embodiment of the present application, when the electronic device receives a touch operation, it will not immediately call the finger joint recognition algorithm model, and when the touch operation meets certain conditions, it will prohibit calling the finger joint recognition algorithm model, that is, the finger joint recognition algorithm model will not be called continuously, thereby reducing the steps of identifying touch operations, reducing the power consumption of the electronic device, and ensuring the operating stability of the electronic device.

[0151] The above embodiment takes the interaction of multiple modules included in the electronic device as an example to explain the control method for touch operation recognition provided by the embodiment of the present application. Next, the electronic device is used as the execution subject to continue the description. Please refer to Fig. 9 , the method may include some or all of the following:

[0152] Step 901: Check whether the finger joint function is turned on. If so, execute the operation of the following step 902. If not, end, that is, do not perform subsequent steps.

[0153] Since the electronic device does not use the knuckle recognition algorithm model when the knuckle function is not turned on, the electronic device needs to detect whether the knuckle function is turned on, and if the knuckle function is not turned on, no further steps are performed, and if a touch operation is detected, the electronic device responds to the touch operation.

[0154] It should be noted that the user can choose whether to enable the knuckle function. Of course, in some embodiments, when the electronic device enters the screen-on state, the knuckle function is enabled by default.

[0155] Step 902: When a touch operation is received, determine whether the touch operation is performed within the target area of ​​the display screen. If yes, perform the operation of the following step 903; if no, perform the operation of the following step 913.

[0156] It should be noted that the target area is an area on the display screen that can recognize the finger joint touch operation. Figure 6 The target area is shown.

[0157] When using an electronic device, the user will perform touch operations on the display screen. The touch operations may be performed at locations near the border of the display screen. The touch operations performed at these locations are usually page turning operations, return operations, etc., and are very likely to be finger joint touch operations. In this way, in order to reduce the process of electronic devices recognizing touch operations, a target area can be set in the electronic device. When the area where the touch operation is performed is not the target area of ​​the display screen, calling the finger joint recognition algorithm model can be prohibited. When the touch operation is performed in the target area of ​​the display screen, continue to perform the following step 903.

[0158] It should be noted that when the electronic device receives a touch operation, it can determine the touch coordinate information of the touch operation, and when the touch coordinate information is located in the target area, it is determined that the touch operation is performed in the target area of ​​the display screen. When the touch coordinate information is not located in the target area, it is determined that the area where the touch operation is performed is not the target area of ​​the display screen.

[0159] In addition, the operation of the electronic device to determine the touch coordinate information of the touch operation may refer to the operations of the above-mentioned steps 801 and 802.

[0160] Step 903: Determine the number of touch points corresponding to the touch operation.

[0161] It should be noted that the operation of the electronic device determining the number of touch points corresponding to the touch operation can refer to the operation of step 803 above, and this embodiment of the present application will not be described in detail.

[0162] Step 904: Determine whether the touch operation is a single-point touch operation according to the number of touch points. If yes, perform the operation of the following step 905; if no, perform the operation of the following step 913.

[0163] Since the knuckle touch operation is usually a single-point touch operation, the electronic device can determine whether the touch operation is a single-point touch operation according to the number of touch points. If the touch operation is not a single-point touch operation, it means that the touch operation is not a knuckle touch operation. In this case, the electronic device can perform the following step 913, that is, prohibiting the calling of the knuckle recognition algorithm model.

[0164] It should be noted that the operation of step 904 may also refer to the operation of step 803 described above.

[0165] Step 905: Determine whether the interface used for the touch operation is a designated interface. If yes, execute the operation of the following step 906; if no, execute the operation of the following step 912.

[0166] Since some interfaces include tasks that require the user to click the interface multiple times to complete, when the touch operation is a single-point touch operation, the electronic device can continue to identify the interface affected by the touch operation to determine whether the interface is a designated interface.

[0167] It should be noted that the operation of step 905 may refer to the operations of steps 804 to 806 described above.

[0168] When the interface is not a designated interface, the touch operation may be a knuckle touch operation. Therefore, the electronic device may call a knuckle recognition algorithm model to identify whether the touch operation is a knuckle touch operation.

[0169] Step 906: Count the number of touches of the single-point touch operation detected continuously.

[0170] When the interface is a designated interface, the user may click on the designated interface multiple times to complete the task. For example, if the user needs to input text on the input interface, the user will click on the virtual keyboard multiple times. However, the knuckle function may also be used, that is, the user may also perform knuckle touch operations in the designated interface. Therefore, in order to further determine whether to call the knuckle recognition algorithm model, the electronic device can count the number of touches that continuously detect single-point touch operations.

[0171] As an example, each time the electronic device detects a single-point touch operation, it counts the number of touches of the single-point touch operation. That is, if M represents the number of touches of the single-point touch operation, each time the number of single-point touches is detected, M=M+1.

[0172] It should be noted that the operation of step 906 may refer to the operation of step 807 described above.

[0173] Step 907: Determine whether the counted number of touch operations of the single-point touch operation is greater than or equal to a first preset value, if so, execute the operation of the following step 913, if not, execute the operation of the following step 908.

[0174] When implementing the knuckle function, the number of times a user can tap the display screen with a knuckle is limited. For example, a screenshot operation usually requires a user to tap the display screen with a knuckle twice, and a screen recording operation usually requires a user to tap the display screen with a knuckle three times, etc. Therefore, a first preset value can be set to determine whether the knuckle recognition algorithm model needs to be called.

[0175] As an example, the electronic device may perform the operation of step 907 when the number of touch operations counted for the single-point touch operation is greater than or equal to a second preset value.

[0176] It should be noted that the operation of step 907 may refer to the operation of step 808 described above.

[0177] Step 908: Determine the touch time interval between the last two single-point touch operations counted.

[0178] When the number of single-point touch operations is greater than or equal to the second preset number and less than the first preset value, the judgment can continue to be performed based on the touch time interval.

[0179] It should be noted that the operation of step 908 may refer to the operation of step 808 described above.

[0180] Step 909: Determine whether the touch time interval is greater than the first time threshold, if so, execute the operation of the following step 910, if not, execute the operation of step 906.

[0181] When the touch time interval is less than or equal to the first time threshold, it indicates that the user is performing a quick click operation on the interface. Therefore, the electronic device may continue to count the number of touches of the single-point touch operation that is continuously detected.

[0182] Step 910: Start timing.

[0183] It should be noted that the operations of step 909 and step 910 may refer to the operation of the above-mentioned step 809.

[0184] In some embodiments, the electronic device may start timing through a timer, or may start timing through other methods, and the embodiments of the present application do not impose specific limitations on this.

[0185] Step 911: Determine whether a single-point touch operation is detected within the specified time duration. If so, execute the operation of step 906; if not, execute the operation of step 912.

[0186] When the timer reaches the specified time and no single-point touch operation is detected within the specified time, it means that the current user's touch operation is not a frequent click operation, and the touch operation may be a knuckle touch operation. Therefore, the electronic device can identify whether the touch operation is a knuckle touch operation through a knuckle recognition algorithm model. That is, when no single-point touch operation is detected within the specified time, the following step 912 is performed.

[0187] If the single-point touch operation is detected within the specified time period, it means that the current user is frequently performing click operations, and the electronic device can continue to count the number of touches of the single-point touch operations detected continuously, that is, return to the operation of the above step 906.

[0188] Step 912: calling the knuckle recognition algorithm model to identify whether the touch operation is a knuckle touch operation.

[0189] Step 913: prohibiting calling the knuckle recognition algorithm model to identify whether the touch operation is a knuckle touch operation.

[0190] It should be noted that the operation of prohibiting the electronic device from calling the finger joint recognition algorithm model can refer to the operation of prohibiting the touch input processing module from calling the finger joint recognition algorithm model in the above step 804, and the embodiment of the present application will not elaborate on this one by one.

[0191] In some embodiments, in order to facilitate viewing of system operation status, the control status of the electronic device over the finger joint recognition algorithm model during the execution of various services can be recorded in a key diary.

[0192] In an embodiment of the present application, when the electronic device receives a touch operation, it does not immediately call the finger joint recognition algorithm model, but instead performs a series of conditional judgments on the touch operation. When the touch operation meets certain conditions, the electronic device may prohibit calling the finger joint recognition algorithm model, that is, the finger joint recognition algorithm model will not be called continuously, thereby reducing the steps of identifying touch operations, reducing the power consumption of the electronic device, and ensuring the operating stability of the electronic device.

[0193] The above description is based on the example of identifying the interface affected by the touch operation when the touch operation is a single-point touch operation. However, the present embodiment of the application does not specifically limit the order of determining whether the touch operation is a single-point touch operation and identifying the interface affected by the touch operation. Fig.10 , Fig.10 is a schematic flow chart of a control method for touch operation recognition according to an exemplary embodiment, and Fig.10 The order of determining whether the touch operation is a single-point touch operation and identifying the interface on which the touch operation acts is not limited. As an example but not a limitation, the method is described by taking application to an electronic device as an example, and the method may include some or all of the following contents:

[0194] Step 1001: When the knuckle function is turned on, receiving a touch operation on the electronic device.

[0195] It should be noted that the knuckle function is a function that can be achieved by the electronic device in response to the knuckle touch operation.

[0196] Exemplarily, the knuckle function may include screenshot operation, screen recording operation and global annotation operation on the interface acted upon by the knuckle touch operation, and the knuckle function implemented may be different depending on the trajectory and / or number of touches of the knuckle touch operation.

[0197] In some embodiments, a target area may also be set in the electronic device. Therefore, when the finger joint function is turned on, if the electronic device receives a touch operation, the electronic device can determine the area of ​​the display screen where the touch operation acts. When the touch operation acts on the target area of ​​the display screen, the number of touch points corresponding to the touch operation can be determined. When the number of touch points is a first value, the touch operation is determined to be a single-point touch operation; when the number of touch points is not the first value, the touch operation is determined not to be a single-point touch operation, such as determining that the touch operation is a multi-point touch operation.

[0198] In one possible case, when the touch operation does not act on the target area of ​​the display screen, the knuckle recognition algorithm model is not called.

[0199] It is worth noting that since a target area is set for the display screen, no matter which interface is displayed on the display screen, the electronic device can determine whether to continue subsequent operations based on the target area, further reducing the scenarios for calling the knuckle recognition algorithm model.

[0200] It should be noted that when the electronic device is in the screen-off state, the electronic device will turn off the knuckle function. When the display screen of the electronic device changes from the screen-off state to the screen-on state, the electronic device will turn on the knuckle function. Therefore, when the electronic device is in the screen-on state, the knuckle function is usually on.

[0201] In another possible case, when the finger joint function is turned on, if the electronic device receives a touch operation, the electronic device can determine the number of touch points corresponding to the touch operation; if the number of touch points indicates that the touch operation is a single-point touch operation, the interface on which the touch operation acts is identified. This process can refer to the operations after 903-905 of the above steps, and the present embodiment of the application will not be repeated one by one.

[0202] In another possible situation, when the knuckle function is turned on, if the electronic device receives a touch operation on the target area, it identifies the interface affected by the touch operation, and if the interface affected by the touch operation is a designated interface, determines the number of touch points corresponding to the touch operation.

[0203] It should be noted that the designated interface includes operation objects that require multiple single-point touch operations to complete the corresponding task items. Exemplarily, the designated interface may be an interface including a virtual keyboard, and the designated interface may be a piano game interface, a jumping game interface, etc. In the case where the designated interface is an interface including a virtual keyboard, the corresponding task item refers to inputting text through the virtual keyboard; in the case where the designated interface is a piano game interface, the corresponding task item may be completing the performance of a piece of music through the virtual keys in the piano game interface; in the case where the designated interface is a jumping game interface, the corresponding task item may be reaching the destination through continuous jumping.

[0204] In another possible case, when the knuckle function is turned on, if the electronic device receives a touch operation on the target area of ​​the display screen, the electronic device can simultaneously determine the number of touch points corresponding to the touch operation and identify the interface on which the touch operation acts.

[0205] As an example, when the number of touch points indicates that the touch operation is not a single-point touch operation, in other words, when the touch operation is not a single-point touch operation, the electronic device will not call the knuckle recognition algorithm model, that is, the electronic device will not identify whether the touch operation is a knuckle touch operation through the knuckle recognition algorithm model.

[0206] Since knuckle touch operations are usually single-point touch operations, when the touch point quantity index shows that the touch operation is not a single-point touch operation, it means that the touch operation is most likely not a knuckle touch operation, and there is no need to use a knuckle recognition algorithm model to identify whether the touch operation is a knuckle touch operation. Therefore, the electronic device may not call the knuckle recognition algorithm model.

[0207] It should be noted that the operation of the electronic device not calling the finger joint recognition algorithm model can refer to the operation of the touch input processing module prohibiting the calling of the finger joint recognition algorithm model in the above step 805, and the embodiment of the present application will not elaborate on this one by one.

[0208] It is worth noting that when the touch operation is not a single-point touch operation, by prohibiting the calling of the knuckle recognition algorithm model, the power consumption caused by the running of the knuckle recognition algorithm model of the electronic device is reduced, and the stability of the operation of the electronic device is improved.

[0209] As an example, when the interface acted on by the touch operation is a private interface, the knuckle recognition algorithm model is not called. The private interface is an interface including user privacy information. Figure 3 The application scenario shown.

[0210] Since the privacy interface includes user privacy information, such as user ID number, home address, payment code (or payment QR code), etc., and when the privacy interface is a video conference interface, the video conference may be some technical discussion meetings that need to be kept confidential, which also belong to the user's privacy information. Since such privacy information is usually not allowed to be leaked, and screenshots and screen recordings of privacy interfaces are usually not allowed, therefore, when the interface affected by the touch operation is a privacy interface, the electronic device will not call the knuckle recognition algorithm model.

[0211] In some embodiments, the electronic device can detect whether the interface acted upon by the touch operation contains a privacy layer, and if it contains a privacy layer, the interface can be determined to be a privacy interface. Alternatively, the electronic device can identify the content displayed on the interface acted upon by the touch operation, and if it is identified that there is preset privacy information in the interface acted upon by the touch operation, the interface acted upon by the touch operation is determined to be a privacy interface, and the preset privacy information includes at least one of an ID number, a phone number, a payment code, etc.

[0212] It is worth noting that when the interface acted upon by the touch operation is a privacy interface, since the electronic device will not call the knuckle recognition algorithm model, the electronic device cannot recognize the knuckle touch operation, thereby avoiding screenshot and screen recording operations on the privacy interface, and ensuring the security of the user's privacy information.

[0213] In some embodiments, the electronic device may detect whether the interface acted upon by the touch operation is a privacy interface when receiving a touch operation, or may detect the current interface before receiving the touch operation. That is, after displaying an interface, the electronic device may detect the interface, and if the interface is a privacy interface, the interface may be recorded as a privacy interface. If a touch operation is received in the interface, the electronic device may not call the finger joint recognition algorithm model. The embodiments of the present application do not impose specific restrictions on this.

[0214] In some embodiments, when the knuckle function is turned on, in response to a startup operation of a game application, if the game application has a built-in application assistant, the electronic device can directly turn off the knuckle function through the application assistant; if the game application does not have a built-in application assistant, the electronic device can determine the type of the game application; if the game application type is a preset type, the electronic device can turn off the knuckle function. Alternatively, when the knuckle function is turned on and the electronic device receives a startup operation for the game application, if the game application does not have a corresponding application assistant and the application identifier of the game application is in a preset whitelist, the electronic device can turn off the knuckle function.

[0215] In addition, when the knuckle function is turned off, if the electronic device receives a touch operation while the game application is running in the foreground, the electronic device will not call the knuckle recognition algorithm model; when the application interface of the game application is exited, the electronic device can turn on the knuckle function again. Figure 5 The application scenario shown.

[0216] Since the user may trigger the game application when the knuckle function is turned on, and the user will frequently operate in the interface of the electronic device during the process of using the game application, if the knuckle function is turned on, the electronic device is likely to frequently call the knuckle recognition algorithm model, resulting in increased power consumption of the electronic device, which is not conducive to the operation stability of the electronic device, and then affects the stability of the game application. Therefore, when the electronic device receives the startup operation of the game application, for the game application with an application assistant, the electronic device can turn off the knuckle function through the application assistant; for the game application without an application assistant, when the type of the game application is a preset type, or when the application identifier of the game application is in the preset whitelist, the electronic device can also turn off the knuckle function. When the knuckle function is turned off, the electronic device will not call the knuckle recognition algorithm model, that is, when the game application is running in the foreground, the electronic device cannot take screenshots and record the application interface of the game application.

[0217] It should be noted that the preset types may include jumping types, piano types, etc., which require the user to continuously click on the interface to play the game during the running of the game application. The preset whitelist may be preset during the development of the electronic device, or may be actively set by the user during the use of the electronic device, or it can be said that the preset whitelist is preset during the development of the electronic device, and the preset whitelist allows the user to edit it during use, for example, allowing the user to add an application identifier to the preset whitelist, delete an application identifier, etc.

[0218] It should also be noted that the electronic device can choose whether to turn off the knuckle function according to the above method, based on whether the game application has an application assistant and the type of the game application. Of course, in another possible implementation, for any game application, regardless of whether the game application has an application assistant, the electronic device can also directly turn off the knuckle function, which is not specifically limited in the embodiments of the present application.

[0219] As an example, exiting the application interface of the game application may mean running the game application in the background, or completely exiting the game application.

[0220] It is worth noting that when the knuckle function is turned off and the game application is running in the foreground, the electronic device will not call the knuckle recognition algorithm model, thereby reducing the power consumption of the electronic device and ensuring the running stability of the game application.

[0221] In some embodiments, since the electronic device is running a game application in the foreground and the electronic device does not call the finger joint recognition algorithm model, the user may need to take a screenshot or record the screen of the application interface of the game application, such as taking a screenshot of the game result. In this case, the electronic device can receive a first setting operation; in response to the first setting operation, the finger joint function is enabled. Exemplarily, this scenario can refer to the above Figure 4 The scene shown, of course, Figure 4 The scenarios shown are merely examples and do not constitute a limitation on the embodiments of the present application.

[0222] Since the user can operate the interface of the electronic device through the knuckles when the knuckle function is turned on, the electronic device can execute the operation of step 1001, and when it is necessary to call the knuckle recognition algorithm model, call the knuckle recognition algorithm model to identify whether the touch operation is a knuckle touch operation.

[0223] It is worth noting that by manually turning on the knuckle function by the user, not only the interactivity with the user is improved, but also the flexibility of using the knuckle function is improved.

[0224] Step 1002: When the touch operation is a single-point touch operation and the interface affected is a designated interface, if the number of consecutively detected single-point touch operations is greater than or equal to a first preset value, the knuckle recognition algorithm model is not called.

[0225] In some embodiments, when the touch operation is a single-point touch operation and the interface acted on belongs to a designated interface, if the number of touches of the single-point touch operation counted is greater than or equal to a second preset value and less than a first preset value, the touch time interval between the last two single-point touch operations counted is determined, and the second preset value is an integer less than the first preset value and greater than or equal to 2; timing is started when the touch time interval is greater than the first duration threshold; during the timing process, if the single-point touch operation is detected again within the preset duration, the number of touches of the single-point touch operation continues to be counted; when the number of touches of the single-point touch operation counted is greater than or equal to the first preset value, the knuckle recognition algorithm model is not called.

[0226] Since the touch operation is a single-point touch operation and the interface on which it is applied belongs to the specified interface, it means that the user may have clicked on the interface multiple times, and the operation of the user clicking on the interface multiple times may be a finger joint touch operation, or it may be to complete the task items in the specified interface. Therefore, in order to further confirm whether to call the finger joint recognition algorithm model, the electronic device can count the number of touches of the single-point touch operation detected continuously, and when the number of touches of the single-point touch operation detected continuously is greater than or equal to the second preset value and less than the first preset value, it does not necessarily indicate which type of touch operation the user is. In this case, the electronic device can start timing. If the single-point touch operation is detected again within the preset duration of the timing, then the user is likely to have completed the task items corresponding to multiple single-point touch operations on the specified interface. Therefore, the electronic device can continue to count the number of touches of the single-point touch operation. When the number of touches of the single-point touch operation is greater than or equal to the first preset value, it means that the user is completing the task items of frequent single-point touch operations on the specified interface. Therefore, the electronic device does not need to identify the finger joint touch operation, and the electronic device may not call the finger joint recognition algorithm model.

[0227] It is worth noting that when the counted number of touches is greater than or equal to the second preset value and less than the first preset value, it is determined whether a single-point touch operation is detected again within the preset time length, thereby avoiding misjudgment of the user's frequent single-point touch operations and improving the accuracy of counting the number of touches of single-point touch operations.

[0228] In some embodiments, when the timing duration reaches a preset duration and no single-point touch operation is detected again, the knuckle recognition algorithm model is called.

[0229] Since when the timing duration reaches the preset duration and no single-point touch operation is detected again, it is very likely that the user needs to use the knuckle function. Therefore, the electronic device can call the knuckle recognition algorithm model to identify whether the touch operation is a knuckle touch operation.

[0230] In some embodiments, when the duration during which the electronic device does not call the finger joint recognition algorithm model reaches a second duration threshold, the prohibition on calling the finger joint recognition algorithm model is lifted; or, after the response to the touch operation ends, the prohibition on calling the finger joint recognition algorithm model is lifted.

[0231] It should be noted that the second duration threshold can be pre-set according to demand, for example, the second duration threshold can be 10 seconds or 5 seconds.

[0232] It is worth noting that by promptly lifting the prohibition on calling the knuckle recognition algorithm model, the situation in which the knuckle touch operation cannot be recognized when the knuckle function is needed in the future is avoided, thereby ensuring the normal use of the knuckle function.

[0233] In some embodiments, when the duration for which the electronic device does not call the finger joint recognition algorithm model reaches the second duration threshold, or after the electronic device ends its response to the touch operation, the user may perform a touch operation on the display screen again. In one possible case, the electronic device detects that the touch operation is a single-point touch operation again, and the number of touches of the single-point touch operation detected again within the third duration threshold is less than or equal to the second preset value, then the electronic device can call the finger joint recognition algorithm model. In another possible case, the electronic device detects that the touch operation is a single-point touch operation again, and when the number of touches of the single-point touch operation is greater than or equal to the second preset value and less than the first preset value, if the touch time interval between the last two single-point touch operations counted by the electronic device is greater than the first duration threshold, then timing can be performed again; after starting timing, when the timing duration reaches the preset duration and the single-point touch operation is not detected again, the electronic device can call the finger joint recognition algorithm model.

[0234] In an embodiment of the present application, when the electronic device receives a touch operation, it does not immediately call the finger joint recognition algorithm model, but instead performs a series of conditional judgments on the touch operation. When the touch operation meets certain conditions, the electronic device may prohibit calling the finger joint recognition algorithm model, that is, the finger joint recognition algorithm model will not be called continuously, thereby reducing the steps of identifying touch operations, reducing the power consumption of the electronic device, and ensuring the operating stability of the electronic device.

[0235] Next, the electronic device involved in the embodiment of the present application is described.

[0236] As an example, the method can be applied to an electronic device with a knuckle function, that is, the method can be applied to an electronic device that can perform a screenshot operation, a screen recording operation, and / or a global annotation operation on the interface of the electronic device in response to a knuckle touch operation. As an example and not a limitation, the electronic device can be, but is not limited to, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, a vehicle-mounted device, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a mobile phone, a smart watch, etc., and the embodiments of the present application are not limited to this.

[0237] Fig.11is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.11 The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0238] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0239] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0240] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0241] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0242] In some embodiments, the processor 110 may include one or more interfaces, such as an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0243] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0244] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is an integer greater than 1.

[0245] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created by the electronic device 100 during use (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0246] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than a pressure threshold acts on a short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the pressure threshold acts on a short message application icon, an instruction to create a new short message is executed.

[0247] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. The acceleration sensor 180E can also be used to identify the posture of the electronic device 100, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc.

[0248] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor 180K can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0249] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (such as: coaxial cable, optical fiber, data subscriber line (Digital Subscriber Line, DSL)) or wireless (such as: infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access, or a data storage device such as a server or data center that includes one or more available media integrations. The available medium may be a magnetic medium (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a digital versatile disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD)).

[0250] The above are optional embodiments provided for the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the technical scope disclosed in the present application shall be included in the protection scope of the present application.

Claims

1. A control method for touch operation recognition, characterized in that: Applied in an electronic device, the method comprises: When the knuckle function is turned on, receiving a touch operation on the electronic device, the knuckle function being a function that can be implemented by the electronic device in response to the knuckle touch operation; In the case where the touch operation is a single-point touch operation and the interface acted on is a designated interface, if the number of touches of the single-point touch operation detected continuously is greater than or equal to a first preset value, the knuckle recognition algorithm model is not called; In the case where the duration without calling the knuckle recognition algorithm model reaches the second duration threshold, if the single-point touch operation continues to be detected, and the number of touches of the single-point touch operation continuously detected within the third duration threshold is less than or equal to the second preset value, then the knuckle recognition algorithm model is called, and the second preset value is an integer less than the first preset value and greater than or equal to 2; or, after ending the response to the touch operation, if the single-point touch operation continues to be detected, and the number of touches of the single-point touch operation continuously detected within the third duration threshold is less than or equal to the second preset value, then the knuckle recognition algorithm model is called; Among them, the knuckle recognition algorithm model is used to identify whether the touch operation is a knuckle touch operation, and the first preset value is an integer greater than 2.

2. The method according to claim 1, characterized in that In the case where the knuckle function is turned on, after receiving a touch operation on the electronic device, the method further includes: When the touch operation is not the single-point touch operation, the knuckle recognition algorithm model is not called.

3. The method according to claim 1, characterized in that In the case where the knuckle function is turned on, after receiving a touch operation on the electronic device, the method further includes: In the case where the interface acted upon by the touch operation is a privacy interface, the knuckle recognition algorithm model is not called, and the privacy interface is an interface including user privacy information.

4. The method according to any one of claims 1 to 3, characterized in that In the case where the touch operation is a single-point touch operation and the interface acted on is a designated interface, if the number of touches of the single-point touch operation detected continuously is greater than or equal to a first preset value, then the knuckle recognition algorithm model is not called, including: In the case where the touch operation is the single-point touch operation and the interface acted on belongs to the designated interface, if the number of touches of the single-point touch operation counted is greater than or equal to a second preset value and less than the first preset value, then determining the touch time interval between the last two single-point touch operations counted, where the second preset value is an integer less than the first preset value and greater than or equal to 2; Start timing when the touch time interval is greater than a first time threshold; During the timing process, if the single-point touch operation is detected again within the preset time length, the number of touches of the single-point touch operation continues to be counted; When the number of touches of the single-point touch operation is counted to be greater than or equal to the first preset value, the knuckle recognition algorithm model is not called.

5. The method according to claim 4, characterized in that After starting timing when the touch time interval is greater than the first duration threshold, the method further includes: When the timing duration reaches the preset duration and the single-point touch operation is not detected again, the knuckle recognition algorithm model is called.

6. The method according to any one of claims 1 to 5, characterized in that When the knuckle function is turned on, before receiving a touch operation on the electronic device, the method further includes: When the knuckle function is turned on and a start-up operation for a game application is received, if the game application does not have a corresponding application assistant and the type of the game application is a preset type, the knuckle function is turned off; or, when the knuckle function is turned on and a start-up operation for the game application is received, if the game application does not have a corresponding application assistant and the application identifier of the game application is in a preset whitelist, the knuckle function is turned off; When the game application is in the foreground and the touch operation is received, the knuckle recognition algorithm model is not called; When exiting the application interface of the game application, the knuckle function is reopened.

7. The method according to claim 6, characterized in that In the process in which the game application is running in the foreground, when the touch operation is received, after not calling the knuckle recognition algorithm model, the method further includes: receiving a first setting operation; In response to the first setting operation, the knuckle function is turned on.

8. The method according to claim 1, wherein after receiving a touch operation on the electronic device when the knuckle function is turned on, the method further comprises: Determining the area of ​​the display screen where the touch operation is applied; In the case where the touch operation acts on a target area of ​​the display screen, determining the number of touch points corresponding to the touch operation, the target area being an area of ​​the electronic device that can recognize the knuckle touch operation; When the number of touch points is a first value, it is determined that the touch operation is the single-point touch operation.

9. An electronic device, characterized in that: The structure of the electronic device includes a processor and a memory; The memory is used to store a program that supports the electronic device to execute the method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 8.

Images