Fingerprint gesture processing method and electronic equipment
By detecting and processing the conditions and device status of the first touch operation, and identifying and handling accidental touches, the problem of fingerprint recognition devices being prone to accidental touches is solved, thus improving the user interaction experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HUAWEI DEVICE CO LTD
- Filing Date
- 2024-11-18
- Publication Date
- 2026-05-19
AI Technical Summary
In existing technologies, fingerprint recognition devices are prone to accidental touches, leading to a decline in the user interaction experience.
By detecting whether the first touch operation meets a series of conditions and the electronic device status, mis-touches are identified and processed, including determining whether the touch image is a fingerprint image, the touch area area, the swipe distance and duration, etc., and using artificial intelligence algorithms and binarization algorithms to filter out noise signals and determine the fingerprint gesture.
This effectively reduces the probability of accidental touches on the fingerprint recognition device and improves the user experience when interacting with electronic devices using fingerprint recognition.
Smart Images

Figure CN122067280A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic technology, and in particular to a fingerprint gesture processing method and electronic device. Background Technology
[0002] With the development of technology, electronic devices are becoming increasingly larger, and the ways users interact with them are no longer limited to interacting through buttons or touchscreens. They can also interact with electronic devices through fingerprint recognition devices.
[0003] Fingerprint recognition devices are often placed in locations easily touched by users, increasing the probability of accidental activation. Reducing this probability and improving the user experience when interacting with electronic devices via fingerprint recognition has become a pressing issue. Summary of the Invention
[0004] To reduce the probability of accidental touches on the fingerprint recognition device, this application proposes the following technical solution.
[0005] The first aspect of this application provides a fingerprint gesture processing method, the method comprising: an electronic device detecting a first touch operation; the electronic device processing the first touch operation based on whether the first touch operation satisfies a first condition and / or the state of the electronic device. In this manner, the electronic device can recognize and process more accidental touches on the fingerprint device in various scenarios, improving the probability of accidental touch prevention and effectively enhancing the user experience when interacting with the electronic device using a fingerprint device.
[0006] In some possible implementations, the first condition includes at least one of the following: the touch image of the first touch operation is a fingerprint image; the area of the touch region of the touch image of the first touch operation is greater than or equal to a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold; the touch image of the first touch operation includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration; the touch image of the first touch operation is a continuous fingerprint image and its duration is greater than a third preset duration; the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold; the touch image of the first touch operation is a continuous fingerprint image.
[0007] In some possible implementations, the electronic device identifies the touch image as a fingerprint image based on a fingerprint recognition algorithm. The fingerprint recognition algorithm can be an artificial intelligence (AI) algorithm.
[0008] In some possible implementations, the touch image is first identified as a fingerprint image using a fingerprint recognition algorithm. If the touch image is a fingerprint image, the electronic device identifies the fingerprint gesture corresponding to the first touch operation based on the fingerprint image; if the touch image is not a fingerprint image, the first touch operation is determined to be a mis-touch. This reduces the computational load on the electronic device, helps improve the execution efficiency of the anti-mis-touch method, increases the feedback speed, and thus enhances the user experience.
[0009] In some possible implementations, the electronic device determines that the first touch operation is a erroneous operation if it detects that the pressing area of the first touch operation is less than a first threshold. If the touch area is too small, the probability of the first touch operation being a erroneous touch is high. Determining touches with smaller pressing areas as erroneous touches in the above manner can reduce the probability of erroneous touches.
[0010] In some possible implementations, when the touch image is a fingerprint image, the touch area is the fingerprint area, and the electronic device can detect whether the first touch operation is a erroneous operation based on the fingerprint area. Ignoring non-touch areas and judging solely based on the information provided by the touch area can improve the efficiency of accidental touch detection. On the other hand, it can also reduce the interference of noise signals and improve the accuracy of detection.
[0011] In some possible implementations, the electronic device obtains the touch area from the touch image using a segmentation algorithm.
[0012] In some possible implementations, the area of the touch region can be calculated by accumulating the pixels in the touch region.
[0013] In some possible implementations, the electronic device determines the fingerprint gesture corresponding to the first touch operation based on the sliding distance of the first touch operation on the fingerprint recognition device.
[0014] In some possible implementations, before determining the movement of the first touch operation on the fingerprint device based on the touch image, the touch image can be processed using a binarization algorithm; the movement of the first touch operation on the fingerprint device can then be determined based on the processed touch image. Processing the touch image using a binarization algorithm can filter out noise signals, making the touch image clearer and facilitating faster and more accurate acquisition of the movement of the first touch operation on the fingerprint device.
[0015] In some possible implementations, processing the first touch operation based on whether the first touch operation satisfies a first condition includes: determining that the fingerprint gesture of the first touch operation is a two-touch fingerprint gesture when the touch image of the first touch operation is a fingerprint image, the area of the touch region of the touch image of the first touch operation is greater than or equal to a first threshold, the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold, and the touch image of the first touch operation includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration.
[0016] In some possible implementations, processing the first touch operation based on whether the first touch operation satisfies a first condition includes: determining that the fingerprint gesture of the first touch operation is a long press fingerprint gesture when the touch image of the first touch operation is a fingerprint image, the area of the touch region of the touch image of the first touch operation is greater than or equal to a first threshold, the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold, and the touch image of the first touch operation is a continuous fingerprint image with a duration greater than a third preset duration.
[0017] In some possible implementations, processing the first touch operation based on whether the first touch operation satisfies a first condition includes: determining that the fingerprint gesture of the first touch operation is a swipe fingerprint gesture when the touch image of the first touch operation is a fingerprint image, the area of the touch region of the touch image of the first touch operation is greater than or equal to a first threshold, the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold, and the touch image of the first touch operation is a continuous fingerprint image.
[0018] In some possible implementations, processing the first touch operation based on whether the first touch operation satisfies the first condition and / or the state of the electronic device includes: if the first touch operation satisfies the first condition, determining the fingerprint gesture corresponding to the first touch operation; if the electronic device is in a preset state, determining that the first touch operation is a misoperation.
[0019] In some possible implementations, the preset state includes at least one of the following: a first state, a second state, or a third state.
[0020] In some possible implementations, the method further includes: the electronic device detecting a second touch operation by the user on the touchscreen and entering a first state. The second touch operation typically occurs when the touchscreen is on. The user interacts with the electronic device based on the image displayed on the touchscreen through the second touch operation. During interaction via the touchscreen, the first touch operation on the fingerprint device has a high probability of being a false touch. The electronic device entering a touch state and not responding to any touch gestures can improve the success rate of preventing false touches.
[0021] In some possible implementations, the method further includes: when the electronic device detects that a button on the electronic device has been pressed, the electronic device enters a second state.
[0022] In some possible implementations, the method further includes: the electronic device entering a third state when it detects that the user is not looking at the display screen. When operating an electronic device with one hand, the user usually needs to interact through the display screen. If the user is not looking at the display screen, the probability of the first touch operation being a mis-touch is relatively high. The above method can reduce the probability of mis-touch.
[0023] In some possible implementations, the method further includes: after determining that the first touch operation is a erroneous operation, the electronic device does not respond to the first touch operation, or intercepts the response to the first touch operation.
[0024] In some possible implementations, the electronic device processes the touch operation based on the fingerprint gesture and / or the state of the electronic device, including: if the first touch operation is not a misoperation, the electronic device responds to the first touch operation.
[0025] A second aspect of this application provides a fingerprint gesture processing method, the method comprising: an electronic device detecting a first touch operation; the electronic device determining, based on a second condition, that the first touch operation is a misoperation.
[0026] In some possible implementations, the touch image of the first touch operation is not a fingerprint image; the area of the touch region of the touch image of the first touch operation is less than or equal to a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold; the touch image of the first touch operation does not satisfy the following: the touch image includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration; the touch image of the first touch operation does not satisfy the following: the touch image of the first touch operation is a continuous fingerprint image and the duration is greater than a third preset duration; the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold; the touch image of the first touch operation does not satisfy the following: the touch image is a continuous fingerprint image; the electronic device is in a preset state.
[0027] In some possible implementations, the preset state includes at least one of the following: a first state, a second state, or a third state, wherein the first state is the state entered when the electronic device detects a second touch operation of the user on the touchscreen; the second state is the state entered when the electronic device detects that a button of the electronic device is pressed; and the third state is the state entered when the electronic device detects that the user is not looking at the display screen of the electronic device.
[0028] A third aspect of this application provides an electronic device, comprising: one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories being used to store computer program code, the computer program code including computer instructions, which, when the one or more processors execute the computer instructions, cause the electronic device to perform a fingerprint gesture processing method in any possible implementation of any of the above aspects.
[0029] A fourth aspect of this application provides a computer storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the fingerprint gesture processing method in any possible implementation of any of the above aspects.
[0030] The fifth aspect of this application provides a computer program product that, when run on a computer, causes the electronic device to perform the fingerprint gesture processing method in any possible implementation of any of the above aspects.
[0031] This application processes a user's first touch operation based on whether the first touch operation meets a first condition and / or the state of the electronic device. In this manner, the electronic device can recognize and handle more accidental touches to the fingerprint recognition device in various scenarios, reducing the probability of accidental touches and effectively improving the user experience when interacting with the electronic device using the fingerprint recognition device.
[0032] Other features, aspects, and advantages of this application will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description
[0033] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0034] Figure 1 This is a schematic diagram of the structure of an electronic device 100 according to an embodiment of this application;
[0035] Figure 2 This is a software structure block diagram of the electronic device 100 according to an embodiment of this application;
[0036] Figure 3 This is a schematic diagram of a fingerprint recognition device according to an embodiment of this application;
[0037] Figures 4A-4B This is a schematic diagram of a handheld posture and touch image according to an embodiment of this application;
[0038] Figures 5A-5B This is a schematic diagram of a handheld posture and touch image according to another embodiment of this application;
[0039] Figure 6 This application provides fingerprint gesture processing methods in some embodiments;
[0040] Figure 7 This application provides a method for processing electronic devices based on fingerprint gestures and the current state of the electronic device, which is provided in some embodiments.
[0041] Figure 8 This application provides some embodiments of an electronic device for recognizing fingerprint gestures and processing methods based on fingerprint gestures and the current state. Detailed Implementation
[0042] Various exemplary embodiments of this application will now be described in detail with reference to the accompanying drawings. The descriptions of the exemplary embodiments are merely illustrative and are in no way intended to limit the scope of this application or its application or use. This application may be implemented in many different forms and is not limited to the embodiments described herein. These embodiments are provided to make the application thorough and complete, and to fully express the scope of the application to those skilled in the art. It should be noted that, unless otherwise specifically stated, the relative arrangement of components and steps, the composition of materials, numerical expressions, and values set forth in these embodiments should be interpreted as merely exemplary and not as limiting.
[0043] The terms "first," "second," and similar words used in this application do not indicate any order, quantity, or importance, but are merely used to distinguish different parts. Words such as "including" or "contains" mean that the element preceding the word encompasses the element listed after it, and do not exclude the possibility of encompassing other elements as well. Terms such as "above" and "below" are used only to indicate relative positional relationships; when the absolute position of the described object changes, this relative positional relationship may also change accordingly.
[0044] In this application, "at least one" and "one or more" can be considered to have the same meaning.
[0045] In this application, when a specific component is described as being located between a first component and a second component, an intermediary component may or may not be present between the specific component and the first or second component. When a specific component is described as connecting to other components, the specific component may be directly connected to the other components without an intermediary component, or it may not be directly connected to the other components but may have an intermediary component.
[0046] All terms used in this application (including technical or scientific terms) have the same meaning as understood by one of ordinary skill in the art to which this application pertains, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art, and not as having an idealized or highly formalized meaning, unless expressly defined herein.
[0047] This application provides a fingerprint gesture processing method that can be applied to electronic devices. The following will first combine... Figure 1 This application describes an electronic device.
[0048] Figure 1 This is a schematic diagram of the structure of an electronic device 100 according to an embodiment of this application.
[0049] The fingerprint gesture processing method provided in this application embodiment can be applied to, for example, Figure 1 The electronic device 100.
[0050] In some embodiments, such as Figure 1 As shown, electronic device 100 may include at least one of the following: mobile phone, foldable electronic device, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, super mobile personal computer, netbook, cellular phone, PDA, AR device, VR device, artificial intelligence device, wearable device, in-vehicle device, smart home device, and smart city device. This application embodiment does not impose any special limitations on the type of electronic device 100.
[0051] Electronic device 100 may include a processor 110, a memory 120, a power supply 130, a communication module 140, an audio module 150, a sensor module 160, buttons 170, a camera module 180, a display screen 190, and an input / output module 111, etc. The sensor module 160 may include a pressure sensor 160A, a proximity sensor 160B, a fingerprint sensor 160C, a touch sensor 160D, an ambient light sensor 160E, a bone conduction sensor 160F, etc.
[0052] The structures illustrated in the embodiments of this application do not constitute a limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0053] Processor 110 may include one or more processing units, such as application processors, modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0054] The processor 110 can generate operation control signals based on the instruction opcode and timing signals to control the instruction fetching and execution.
[0055] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 101 may be a cache memory. This memory can store instructions or data that have been used or are frequently used by the processor 110.
[0056] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include integrated circuit I2C interfaces, I2S interfaces, PCM interfaces, UART interfaces, MIPI interfaces, GPIO interfaces, SIM interfaces, and / or USB interfaces, etc. The processor 110 can connect to modules such as sensor module 160, audio module 150, communication module 140, display screen 190, or camera module 180 through at least one of these interfaces.
[0057] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0058] Power supply 130 is used to supply power to processor 110, memory 120, display screen 190, camera module 180, etc.
[0059] Electronic device 100 can achieve wired or wireless communication functions through communication module 140. For example, communication module 140 can provide a wireless communication solution including at least one of 2G, 3G, 4G, 5G, or 6G applied to electronic device 100. Communication module 140 can also provide modules such as wireless LAN module, Bluetooth module, BLE module, ultra-wideband (UWB) module, global navigation satellite system (GNSS) module, FM module, near field communication (NFC) module, or infrared module applied to electronic device 100.
[0060] Electronic device 100 can implement display functions through a GPU, display screen 190, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 190 and the application processor. The GPU is used to perform mathematical and geometric calculations and graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0061] Display screen 190 is used to display images, videos, etc. In some embodiments, electronic device 100 may include one or more display screens 190. Display screen 190 may be at least one of LCD, OLED, AMOLED, FLED, Miniled, MicroLED, Micro-OLED, quantum dot light-emitting diode (QLED) displays, etc.
[0062] Electronic device 100 can realize camera function through camera module 180, ISP, video codec, GPU, display screen 190, application processor AP, neural network processor NPU, etc.
[0063] The camera module 180 can be used to acquire color image data and depth data of the subject. The image ISP can be used to process the color image data acquired by the camera module 180. For example, when taking a picture, the shutter is opened, light passes through the lens to the camera's photosensitive element, the light signal is converted into an electrical signal, and the photosensitive element transmits this electrical signal to the ISP for processing, converting it into a visible image. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set within the camera module 180.
[0064] In some embodiments, the camera module 180 may consist of a color camera module and a 3D sensing module.
[0065] In some embodiments, the photosensitive element of the camera in a color camera module may include a CCD or a CMOS phototransistor. The photosensitive element converts light signals into electrical signals, which are then transmitted to the ISP for conversion into digital image signals. The ISP outputs the digital image signals to the DSP for processing.
[0066] In some embodiments, the 3D sensing module may be a structured light 3D sensing module. The structured light 3D sensing module may include an infrared emitter, an infrared camera module, etc. The structured light 3D sensing module first emits a light spot of a specific pattern onto the object being photographed, then receives the encoded pattern of the light spot on the object's surface, and compares it with the original projected light spot to determine the object's three-dimensional coordinates. These three-dimensional coordinates may include the distance between the electronic device 100 and the object being photographed. The 3D sensing module can obtain the distance (i.e., depth) between itself and the object being photographed by measuring the infrared reflection time, thus obtaining a 3D depth map.
[0067] Structured light 3D sensing modules can also be applied to fields such as facial recognition, motion-sensing game consoles, and industrial machine vision inspection. 3D sensing modules can also be applied to game consoles, AR, and VR.
[0068] In other embodiments, the camera module 180 may also consist of two or more cameras. These two or more cameras may include a color camera, which can be used to acquire color image data of the object being photographed. These two or more cameras may employ stereoscopic vision technology to acquire depth data of the object being photographed.
[0069] In some embodiments, the electronic device 100 may include one or more camera modules 180. The electronic device 100 may include a front-facing camera module and a rear-facing camera module. The front-facing camera module can be used to acquire color image data and depth data of the photographer, while the rear-facing camera module can be used to acquire color image data and depth data of the subject (such as a person, landscape, etc.) in front of the photographer.
[0070] In some embodiments, the electronic device 100 can identify whether the image captured by the front-facing camera module includes a user's facial image, and further determine whether the user is looking at the display screen of the electronic device 100 based on the captured image.
[0071] In some embodiments, the CPU, GPU, or NPU in the processor 110 can process the color image data and depth data acquired by the camera module 180. In some embodiments, the NPU can identify the color image data acquired by the camera module 180 using neural network algorithms based on skeletal point recognition technology, such as convolutional neural network algorithms (CNN), to determine the skeletal points of the person being photographed. The CPU or GPU can also be used to run neural network algorithms to determine the skeletal points of the person being photographed based on the color image data. In some embodiments, the CPU, GPU, or NPU can also be used to confirm the body shape of the person being photographed (such as body proportions, the degree of fatness or thinness of body parts between skeletal points) based on the depth data acquired by the camera module 180 (which may be a 3D sensing module) and the identified skeletal points, and can further determine the beautification parameters for the person being photographed, and finally process the captured image of the person being photographed based on the body beautification parameters so that the body shape of the person being photographed in the captured image is beautified.
[0072] The memory 120 can be used to store computer executable program code, including instructions. The memory 120 may include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.). Furthermore, the memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional methods or data processing of the electronic device 100 by running instructions stored in the memory 120 and / or instructions stored in memory disposed in the processor.
[0073] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170 and application processor.
[0074] Pressure sensor 160A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 160A may be disposed on display screen 190; in other embodiments, pressure sensor 160A may be detachably disposed outside display screen 1290. Pressure sensor 160A can be of many types, such as resistive pressure sensor, inductive pressure sensor, capacitive pressure sensor, etc. Capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 160A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 190, electronic device 100 detects the intensity of the touch operation based on pressure sensor 160A. Electronic device 100 may also calculate the touch position based on the detection signal from pressure sensor 160A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities may correspond to different operation commands. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to the SMS application icon, a command to view SMS messages is executed. When a touch operation with a strength greater than or equal to the first pressure threshold is applied to the SMS application icon, the instruction to create a new SMS message is executed.
[0075] The proximity sensor 160B may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When the intensity of the detected reflected light is greater than a threshold, it can be determined that an object is approaching the electronic device 100. When the intensity of the detected reflected light is less than the threshold, the electronic device 100 can determine that no object is approaching the electronic device 100. The electronic device 100 may use the proximity sensor 160B to detect when a user holds the electronic device 100 close to their ear for a phone call, so as to automatically turn off the screen to save power. The proximity sensor 160B can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.
[0076] The fingerprint sensor 160C is used to collect fingerprints, and the collected fingerprint image includes fingerprint feature information. For example, the fingerprint image includes ridges (lines with a certain width and direction in the fingerprint image) and valleys (the recessed parts between the lines) on the fingerprint surface. Fingerprint images from different fingers of different users are different. The fingerprint image is used to achieve fingerprint recognition, fingerprint gesture recognition, etc. In some implementations of this application, the fingerprint image is a multi-grayscale image where the ridges are black and the valleys are white, which can be processed by the fingerprint recognition algorithm of the electronic device. The electronic device 100 can utilize the characteristics of the collected fingerprint to achieve fingerprint unlocking, accessing application locks, fingerprint photography, fingerprint answering of calls, etc. The electronic device 100 can have a fingerprint recognition function, which can identify whether the collected image is a fingerprint image and can also identify the user's identity based on the fingerprint image. The electronic device 100 can also have a fingerprint gesture recognition function. The fingerprint sensor 160C can be located on the back of the electronic device 100, such as below the rear camera or in the lower middle part of the electronic device. The fingerprint sensor 160C can also be located on the front of the electronic device 100, such as below the display screen 190. The fingerprint sensor 160C can also be disposed on the side of the electronic device 100. For example, the fingerprint sensor 160C can be disposed in the display screen 190, integrated with the display screen 190 to realize the fingerprint recognition function of the mobile phone 100. In this case, the fingerprint sensor 160C is configured as part of the display screen 190, or it can be disposed in the display screen 190 in other ways. The fingerprint sensor 160C in the embodiments of this application can employ any type of sensing technology, including but not limited to optical, capacitive, piezoelectric, or ultrasonic sensing technologies.
[0077] The fingerprint sensor 160C can be an optical sensor. Optical sensors utilize the principles of light refraction and reflection to detect the refracted and reflected light rays from an object touching the fingerprint recognition device. The angles and brightness of light refracted and reflected on the uneven surface of the object vary. The optical sensor projects the received light rays onto its image acquisition device through an optical structure, forming a touch image. The electronic device then uses this touch image for fingerprint recognition, detecting whether the touch image is a fingerprint image. The fingerprint image is a touch image that includes the fingerprint itself.
[0078] The fingerprint sensor 160C may also include a capacitive sensor. A capacitive sensor detects changes in capacitance between the surface of an object touching the fingerprint recognition device and the sensor electrodes. When the object touches the surface of the capacitive sensor, the sensor detects the electrical signal generated by the capacitance change. Based on the electric field distribution of the electrical signal, it converts the signal into a digital signal, thus forming a touch image.
[0079] The fingerprint sensor 160C may also include an ultrasonic sensor that detects ultrasonic pulses reflected and scattered by an object touching the fingerprint recognition device, thereby determining the distance difference between the unevenness of the object's surface based on the difference in the ultrasonic pulse signals, and forming a touch image based on the distance difference.
[0080] The fingerprint sensor 160C can also use sensors based on other principles to acquire touch images, and this application does not impose any restrictions on this.
[0081] Touch sensor 160D, also known as a "touch device," can be disposed on display screen 190. The touch sensor 160D and display screen 190 together form a touchscreen, also known as a "touch panel." Touch sensor 160D detects touch operations applied to or near it, generating a touch (TP) signal. Touch sensor 160D can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 190. In other embodiments, touch sensor 160D may also be disposed on the surface of electronic device 100, in a different location than display screen 190.
[0082] Button 170 may include a power button, volume buttons, etc. Button 170 may be a mechanical button or a touch button. Electronic device 100 can receive button input and generate button signals related to user settings and function control of electronic device 100. Fingerprint sensor 160C may be disposed on button 170, and the fingerprint sensor 160C and button 170 together form a button with fingerprint acquisition function. Fingerprint sensor 160C detects touch operation on button 170 and acquires the fingerprint of the finger touching button 170.
[0083] The electronic device 100 provided in this application embodiment can run an operating system (OS). This operating system can be various operating systems currently used in the industry, such as an operating system based on OpenHarmony, such as HarmonyOS; or other operating systems such as Android. TM An operating system can refer to the iOS mobile operating system; it can also refer to various open-source operating systems or their derivatives, such as Linux OS and other embedded operating systems; or it can refer to future new operating systems, such as AI operating systems based on artificial intelligence. An operating system is a set of interconnected system software programs that manage and control the operation of electronic devices, utilize and run hardware and software resources, and provide public services to organize user interactions. In electronic devices, the operating system occupies a pivotal position, connecting to the physical hardware layer below and providing a runtime environment for application software above.
[0084] An operating system typically includes a kernel layer, a middleware layer, and an application layer. The application layer includes applications, which can include system applications and third-party applications. The middleware layer is a suite of software, or frameworks, that provides various services to application developers, such as databases, multimedia, and graphics, or capabilities like distributed scheduling and system expansion. For example, the middleware layer can also be broadly divided into a framework layer and / or a system service layer. The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The system service layer includes the system's core capabilities, providing services to applications through the framework layer. The kernel layer is the layer between hardware and software. The kernel layer can include hardware drivers and the operating system kernel. In addition to providing hardware drivers, the kernel layer also supports functions such as memory management and system process management.
[0085] The electronic devices we use in our daily lives come in various types and forms, and the application scenarios of electronic device 100 are also very wide. Therefore, based on the different forms and functions of electronic devices 100, different application scenarios, and different user needs, the operating systems used in electronic devices 100 may also be different. These operating systems have commonalities as well as their own characteristics, and different operating systems affect user experience, application ecosystem, and system performance. The basic functions implemented by the electronic device 100 provided in this application can be implemented through a general-purpose operating system or through a dedicated operating system. To more clearly illustrate the implementation of the embodiments of this application under a specific operating system, the following shows an operating system architecture. Those skilled in the art can deduce the implementation of the embodiments of this application under other specific operating systems, such as HarmonyOS or Android. TM Implementation under the operating system.
[0086] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered architecture operating system as an example to exemplify the software structure of electronic device 100.
[0087] Figure 2 This is a software structure block diagram of the electronic device 100 according to an embodiment of this application.
[0088] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the operating system includes an application layer.
[0089] The application layer can include a series of application packages.
[0090] like Figure 2As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
[0091] With the development of technology, electronic devices are becoming increasingly larger. Considering the inconvenience of operating electronic devices with one hand, some electronic devices use fingerprint recognition devices to collect fingerprint signals, identify the corresponding fingerprint gestures, and control the electronic devices based on the fingerprint gestures.
[0092] Fingerprint gestures are a gesture control method based on fingerprint recognition technology. Users control electronic devices by performing different operations on the fingerprint recognition device. These fingerprint gestures can include, for example, swiping, single-click / single-touch, double-touch / double-touch, and long-press. Fingerprint gestures can be used for common operations such as unlocking phones, opening applications, taking photos, adjusting volume, bringing up or hiding specific menus, and switching pages. Controlling electronic devices with fingerprint gestures simplifies operation steps, improves control efficiency, facilitates one-handed operation of electronic devices, and enhances the user experience.
[0093] To facilitate user interaction with electronic devices via fingerprint gestures, fingerprint recognition devices are often placed in locations that are easily accessible to users. For example, to facilitate one-handed operation, fingerprint recognition devices are placed on the side of electronic devices, which further increases the probability of accidental touches on the fingerprint recognition device.
[0094] In existing technologies, in screen-off scenarios, proximity light devices, such as proximity light sensors 160B, are used to determine whether an object is approaching the electronic device 100, thereby detecting whether the user is blocking the screen. If the screen is blocked, for example, when the user holds the electronic device 100 close to their ear to make a call, the electronic device 100 is controlled to enter an anti-mistouch mode, which disables the fingerprint recognition device, thereby reducing the probability of the user accidentally touching the fingerprint recognition device when they lift the electronic device 100 to make or receive a call.
[0095] However, besides the scenarios mentioned above, there are other scenarios that may lead to accidental touches, and the above methods cannot effectively prevent accidental touches.
[0096] This application provides a fingerprint gesture processing method applied to an electronic device, the electronic device including a fingerprint recognition device. In some embodiments, the electronic device may be as follows: Figure 1 The electronic device 100 shown may include a fingerprint sensor 160C as its fingerprint recognition device.
[0097] Combination Figure 1 This application describes a fingerprint gesture processing method according to an embodiment of the present application.
[0098] In some embodiments of this application, the fingerprint recognition device of the electronic device detects a user's first touch operation on the fingerprint recognition device, and processes the first touch operation based on whether the first touch operation meets a first condition and / or the state of the electronic device. By determining whether the user's touch operation is a mis-touch through the fingerprint gesture and the current state of the electronic device, it is possible to accurately identify user operations and mis-touches. The electronic device can identify and process mis-touches to the fingerprint recognition device in more scenarios, reducing the probability of the fingerprint recognition device being mis-touched and effectively improving the user experience when interacting with the electronic device using the fingerprint recognition device.
[0099] In some embodiments of this application, the electronic device determines the fingerprint gesture corresponding to the first touch operation based on the touch image of the first touch operation.
[0100] In some embodiments of this application, when the fingerprint recognition device detects a touch signal from a first touch operation, it begins to acquire a touch image. When the acquisition duration reaches a preset duration, the acquisition of the touch image stops.
[0101] In some embodiments of this application, the touch image may include a time sequence image.
[0102] In some embodiments of this application, the fingerprint recognition device continuously acquires multiple frames of time-series images at a preset sampling frequency.
[0103] In some embodiments of this application, the fingerprint recognition device may also be disposed under the display screen of the electronic device, on the back of the electronic device, or on the side of the electronic device. The placement of the fingerprint recognition device does not affect the effect of preventing accidental touches.
[0104] Figure 3 This is a schematic diagram of the setting position of a fingerprint recognition device according to an embodiment of this application.
[0105] In some embodiments of this application, such as Figure 3 As shown, the fingerprint recognition device 301 is located on the side of the electronic device 100. For example, in order to facilitate one-handed operation by touching the fingerprint recognition device 301 with the thumb when holding the electronic device 100 with the right hand, the fingerprint recognition device 301 is located on the right side of the electronic device 100.
[0106] In some embodiments of this application, for example, the first condition may include at least one of the following: the touch image of the first touch operation is a fingerprint image; the area of the touch region of the touch image of the first touch operation is greater than a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold; the touch image of the first touch operation includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration; the touch image of the first touch operation is a continuous fingerprint image and the duration is greater than a third preset duration; the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to the second threshold; the touch image of the first touch operation is a continuous fingerprint image.
[0107] In some embodiments of this application, the electronic device can determine that the fingerprint gesture of the first touch operation is a two-touch fingerprint gesture based on a first condition. For example, the first condition includes: the touch image of the first touch operation is a fingerprint image; the area of the touch region of the touch image of the first touch operation is greater than a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold; and the touch image of the first touch operation includes a first fingerprint image and a second fingerprint image, separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, while the duration of the signal-free image is less than a second preset duration. When the first touch operation satisfies the above first condition, the electronic device determines that the fingerprint gesture of the first touch operation is a two-touch fingerprint gesture. The signal-free image is an image collected by the fingerprint recognition device according to the sampling frequency when the user's finger or other object does not touch the fingerprint recognition device. In some embodiments of this application, the signal-free image can be a blank image. During processing, the order in which the electronic device executes the determination of whether the first touch operation satisfies the first condition can be arbitrarily adjusted, or executed simultaneously. This application does not impose any limitations.
[0108] In some embodiments of this application, the electronic device can determine that the fingerprint gesture of the first touch operation is a long press fingerprint gesture based on a first condition. For example, the first condition includes: the touch image of the first touch operation is a fingerprint image; the area of the touch region of the touch image of the first touch operation is greater than a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold; and the touch image of the first touch operation is a continuous fingerprint image with a duration greater than a third preset duration. When the first touch operation satisfies the above first condition, the electronic device determines that the fingerprint gesture of the first touch operation is a long press fingerprint gesture. A continuous fingerprint image indicates that the user's finger has not left the surface of the fingerprint recognition device during the first touch operation, and the sliding distance of the first touch operation being less than the second threshold indicates that the user's finger has slid a short distance or not slid at all on the fingerprint recognition device; therefore, the gesture of the first touch operation can be determined to be a long press gesture. The electronic device can respond to the first touch operation based on the determined long press fingerprint gesture.
[0109] In some embodiments of this application, the electronic device can determine that the fingerprint gesture of the first touch operation is a swipe fingerprint gesture based on a first condition. For example, the first condition includes: the touch image of the first touch operation is a fingerprint image; the area of the touch region of the touch image of the first touch operation is greater than a first threshold; the swiping distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold; and the touch image of the first touch operation is a continuous fingerprint image. When the first touch operation satisfies the above first condition, the electronic device determines that the fingerprint gesture of the first touch operation is a swipe fingerprint gesture. If the user's finger does not leave the surface of the fingerprint recognition device during the first touch operation and the swiping distance is relatively long, then the gesture of the first touch operation can be determined to be a swipe fingerprint gesture. The electronic device can respond to the first touch operation based on the determined swipe fingerprint gesture.
[0110] In some embodiments of this application, the electronic device can further determine whether the swipe fingerprint gesture is an upward swipe, downward swipe, leftward swipe, or rightward swipe gesture based on the swiping direction of the first touch operation. For example, the first conditions include: the touch image of the first touch operation acquired by the fingerprint recognition device is a fingerprint image; the pressing area of the first touch operation is greater than or equal to a first threshold; the swiping distance of the first touch operation is greater than or equal to a second threshold; the touch image of the first touch operation is a continuous fingerprint image; and the swiping direction of the first touch operation on the fingerprint recognition device is an upward swipe. If the first touch operation satisfies the above first conditions, the electronic device determines that the fingerprint gesture corresponding to the first touch operation is an upward swipe fingerprint gesture. The electronic device can respond to the first touch operation based on the determined upward swipe fingerprint gesture.
[0111] In some embodiments, the electronic device sets one or more preset fingerprint gestures and a corresponding processing method for each preset fingerprint gesture. When the electronic device determines that the fingerprint gesture corresponding to the first touch operation is a preset fingerprint gesture, the electronic device can process the first touch operation using the processing method corresponding to that preset fingerprint gesture. For example, if the electronic device sets preset fingerprint gesture 1 to a two-touch fingerprint gesture, the electronic device displays interface 1 when it determines that the gesture of the first touch operation is a two-touch fingerprint gesture. If the electronic device sets preset fingerprint gesture 2 to a swipe fingerprint gesture, the electronic device displays interface 2 when it determines that the gesture of the first touch operation is a swipe fingerprint gesture.
[0112] In some embodiments of this application, if the first touch operation does not meet the first condition, it can be determined that the first touch operation is a mis-touch operation.
[0113] Figures 4A-4B This illustration shows a handheld posture and touch image diagram according to an embodiment of this application. (Combined with...) Figures 4A-4B This application provides an example of determining a fingerprint gesture according to an embodiment.
[0114] In some embodiments of this application, the first condition includes that the touch image of the first touch operation is a fingerprint image. The electronic device 100 determines that the user's first touch operation is a erroneous operation or accidental touch based on the fact that the touch image of the first touch operation is not a fingerprint image. By using the above conditions, accidental touches caused by non-finger touches can be easily, quickly, and accurately screened, thereby improving the recognition efficiency of preventing accidental touches and the accuracy of fingerprint gesture recognition.
[0115] In some embodiments of this application, if the electronic device determines that the touch image is not a fingerprint image based on the collected touch image, the electronic device will not respond to the erroneous operation, or the electronic device will block the response to the erroneous operation.
[0116] In some embodiments of this application, a fingerprint recognition algorithm can be used to identify whether a touch image is a fingerprint image. The fingerprint recognition algorithm can be an AI algorithm, such as a machine learning algorithm, a deep learning algorithm, or a neural network algorithm.
[0117] For example, Figure 4A The image shows touch images captured by the fingerprint recognition device 301 in two different scenarios. Figure 4A As shown, when the normally operated handheld electronic device 100 is operated via the fingerprint recognition device 301, the fingerprint recognition device 301 acquires a touch image. Since the finger is positioned on the fingerprint recognition device, the fingerprint recognition device can acquire a fingerprint image. The acquired touch image 402 can be identified as a fingerprint image by the fingerprint recognition algorithm. When the user accidentally touches the electronic device 100, the finger is not on the fingerprint recognition device. For example, as... Figure 4BAs shown, when the right hand touches the fingerprint recognition device 301 at the web of the thumb in a gripping posture, the touch image 403 collected by the fingerprint recognition device 301 is not a fingerprint image.
[0118] In some embodiments, the electronic device can input all the touch images collected by the fingerprint recognition device into the fingerprint recognition algorithm, or it can select a portion of the touch images from multiple touch images collected by the fingerprint recognition device into the fingerprint recognition algorithm. For example, the first touch image can be selected. The above methods can improve the efficiency of fingerprint recognition, reduce the amount of computation, alleviate the computational pressure on the electronic device, and help improve the processing speed.
[0119] One or more touch images can be selected according to preset rules for input into the fingerprint recognition algorithm, or one or more touch images can be selected randomly. For example, a portion of touch images can be extracted from multiple touch images at fixed time intervals for input into the fingerprint recognition algorithm. Another example is that one or more frames from the middle of multiple touch images can be selected in chronological order for input into the fingerprint recognition algorithm. Based on the pattern of finger touch movements, the contact area between the fingertip and the fingerprint recognition device is larger during the middle of the touch movement, making it easier to provide more fingerprint-related information to the fingerprint recognition algorithm. Selecting a portion of the middle sub-image for input into the fingerprint recognition algorithm helps improve the accuracy of recognition.
[0120] In some embodiments of this application, the first condition includes that the touch area of the touch image of the first touch operation is greater than a first threshold. The electronic device can determine whether the first touch operation is a erroneous operation or a mis-touch based on the fact that the touch area of the touch image of the user's first touch operation is less than the first threshold.
[0121] In some embodiments of this application, the electronic device can obtain the touch area of the touch image based on the touch image of the first touch operation. The touch area is the area where the object touching the fingerprint recognition device contacts the surface of the fingerprint recognition device; the touch area can also be referred to as the pressing area, contact area, etc. The area of the touch area is the pressing area of the first touch operation. When the pressing area is too small, the probability of the first touch operation being a false touch is relatively high. By using the above conditions, some false operations can be quickly screened out, improving the effect of preventing false touches.
[0122] In some embodiments of this application, the touch image may include a fingerprint image, and the touch area is the fingerprint area.
[0123] In some embodiments of this application, Figure 5A and Figure 5BThe images of touch captured by the fingerprint recognition device 301 in two different scenarios are shown. Touch image 404 is captured when the user holds the electronic device in the posture shown on the left. Touch image 405 is captured when the user holds the electronic device in the posture shown on the right. Because the sides of the electronic device 100 are relatively narrow, the size of the sensing area of the fingerprint recognition device 301 is limited. When the user touches the fingerprint recognition device 301 normally with their finger, the touch area 4041 occupies a larger area. However, when the user accidentally touches the fingerprint recognition device 301 with only their fingertip, such as when picking up the electronic device 100, the touch area 4051 is smaller, and the probability of a false touch is higher. When detecting false touches by the fingerprint recognition device, identifying the first touch operation with the smaller touch area as a false touch can reduce the probability of a false touch being responded to, improve the anti-false touch effect, and thus enhance the accuracy of the detection.
[0124] In some embodiments of this application, the first threshold can be determined based on the ratio of the total area of the touch image to the area of the touch region. For example, if the ratio of the pressing area of the touch region to the total area of the touch image is less than a third threshold, the first touch operation is determined to be a mis-touch or erroneous operation.
[0125] In some embodiments of this application, a third threshold can be set based on the area of the sensing area of the fingerprint recognition device and the surface area of the fingertip area. For example, the third threshold can be 40%.
[0126] In some implementations of this application, the touch region can be obtained from the touch image using a segmentation algorithm. The segmentation algorithm can identify touch and non-touch regions in the touch image. The segmentation algorithm can be implemented based on thresholding, edge-based, region-based, graph theory-based, energy functional theory-based, or other types of segmentation principles; this application does not impose any restrictions on this.
[0127] In some implementations of this application, the pressing area can be calculated by accumulating the pixels in the touch area. The pressing area can also be obtained using other known calculation methods, and this application does not impose any restrictions on this.
[0128] In some embodiments of this application, the first condition includes a sliding distance of the first touch operation on the fingerprint recognition device being less than a second threshold. The electronic device can determine that the first touch operation is a erroneous operation based on whether the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to the second threshold.
[0129] If an electronic device has only one preset gesture set, and that preset gesture is a two-touch gesture, if the user's first touch operation has a sliding distance on the fingerprint recognition device that is greater than or equal to a second threshold, the first touch operation can be identified as a misoperation.
[0130] In the case of two-touch gestures and long-press gestures on electronic devices, if the sliding distance of the user's first touch operation on the fingerprint recognition device is greater than or equal to the second threshold, the first touch operation can be determined as a misoperation.
[0131] In some embodiments of this application, the first condition includes a sliding distance of the first touch operation on the fingerprint recognition device that is greater than or equal to a second threshold. The electronic device can determine that the first touch operation is a erroneous operation based on the sliding distance of the first touch operation on the fingerprint recognition device being less than the second threshold.
[0132] If an electronic device has only one preset gesture set, and that preset gesture is a swipe gesture, if the user's first touch operation involves a swipe distance on the fingerprint recognition device that is less than a second threshold, the first touch operation can be identified as a misoperation.
[0133] In some embodiments of this application, the sliding distance of the first touch operation on the fingerprint recognition device can be determined based on the touch image of the first touch operation. For example, if the fingerprint recognition device acquires a time-series image and detects that the sliding distance of the first touch operation is greater than a second threshold based on the time-series image, it can be determined that the gesture of the first touch operation is not a two-touch gesture.
[0134] In some embodiments of this application, the second threshold may be equal to the length of the long side of the sensing area of the fingerprint recognition device.
[0135] Taking a fingerprint recognition device located on the side of an electronic device as an example, such as Figure 3 As shown, due to the limited thickness of the electronic device 100, the length of the identification device 301 perpendicular to the thickness direction of the electronic device (lateral direction) is small, resulting in insufficient sliding space, while the length in the longitudinal direction is larger, providing sufficient sliding space. The second threshold can be set to be equal to the longitudinal length of the sensing area.
[0136] In other embodiments, the second threshold may be equal to the side length of the fingerprint recognition device in the direction of movement of the first touch operation.
[0137] Sufficient sliding space is reserved in both the horizontal and vertical directions of the fingerprint recognition device. The preset distance can be set to be related to the movement direction of the first touch operation. When the first touch operation moves horizontally on the fingerprint recognition device, the preset distance is equal to the horizontal length of the sensing area of the fingerprint recognition device. When the first touch operation moves vertically on the fingerprint recognition device, the preset distance is equal to the vertical length of the sensing area.
[0138] In some embodiments of this application, the electronic device can obtain the sliding distance of the first touch operation on the fingerprint recognition device through a pixel-based image matching method.
[0139] The electronic device acquires multiple frames of time-series images of the first touch operation. Following the chronological order, it identifies identical pixels in adjacent time-series images using a pixel-based image matching method. Based on the movement trajectories of multiple identical pixels across the multiple time-series images, the movement trajectory of the first touch operation within the sensing area of the fingerprint recognition device can be determined. The sliding distance of the first touch operation is then determined based on its movement trajectory within the sensing area of the fingerprint recognition device. In some embodiments of this application, the sliding direction can also be determined based on the movement trajectory.
[0140] In some embodiments of this application, before determining the sliding distance of the first touch operation on the fingerprint recognition device based on the touch image, the touch image can be processed using a binarization algorithm; the displacement of the first touch operation on the fingerprint recognition device can then be determined based on the processed touch image. Processing the touch image using a binarization algorithm can filter out noise signals, making the touch image clearer and helping to obtain the movement trajectory of the first touch operation on the fingerprint recognition device more quickly and accurately.
[0141] In some embodiments of this application, the touch image includes a fingerprint image. Determining the sliding distance of the first touch operation on the fingerprint recognition device based on the touch image includes determining the sliding distance of the first touch operation on the fingerprint recognition device based on the fingerprint region of the fingerprint image. The fingerprint region retains a significant amount of information about the user's fingerprint and can be referred to as the effective region. The region outside the fingerprint region can be referred to as the untouched region or invalid region. The untouched region cannot provide information about the user's fingerprint and may introduce noise signals unrelated to the user's fingerprint. When determining the sliding distance of the first touch operation on the fingerprint recognition device, ignoring the untouched region and judging solely based on the information provided by the fingerprint region can improve the efficiency of accidental touch detection. On the other hand, it can also reduce the interference of noise signals and improve the detection accuracy.
[0142] Figure 6 This application illustrates a fingerprint gesture processing method according to an embodiment of the present application.
[0143] In some embodiments of this application, the electronic device may be configured as follows: Figure 6 The steps shown determine that the fingerprint gesture corresponding to the first touch operation is a two-touch fingerprint gesture.
[0144] The electronic device acquires the touch image of the first touch operation, as shown in step S601. The electronic device can first determine whether the touch image is a fingerprint image, as shown in step S602. If the touch image is a fingerprint image, step S603 is executed to determine whether the pressing area of the first touch operation is greater than or equal to a first threshold. If the pressing area of the first touch operation is greater than or equal to the first threshold, step S604 is executed to determine whether the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold. If the sliding distance of the first touch operation on the fingerprint recognition device is less than the second threshold, step S605 is executed to determine whether the first touch operation meets the following conditions: the touch image includes a first fingerprint image and a second fingerprint image, and the first fingerprint image and the second fingerprint image are separated by a signal-free image. If the conditions are met, the fingerprint gesture corresponding to the first touch operation is determined to be a two-touch fingerprint gesture, as shown in step S606. If the touch image is not a fingerprint image, the area of the touch region is less than the proportion of the total area of the touch image to a preset value, the sliding distance is not less than the first threshold, or the first touch operation does not meet the following conditions: the touch image includes a first fingerprint image and a second fingerprint image, and the first fingerprint image and the second fingerprint image are separated by a signal-free image, the electronic device determines that the first touch operation is a misoperation, as shown in step S607.
[0145] It should be understood that Figure 6 This document merely exemplifies one step in determining that the fingerprint gesture corresponding to the first touch operation is a two-touch fingerprint gesture. The order in which steps S601, S602, S603, and S604, which determine the various conditions, are executed, does not affect the effect of preventing accidental touches. These steps can be executed sequentially or in parallel, and this application does not impose any limitations on this. In some embodiments of this application, such as... Figure 6 Steps S602 and S603 shown can be selectively executed. In some embodiments of this application, the duration of the first fingerprint image, the second fingerprint image, and the image without a signal source can also be limited in step S604. If the time condition is not met, the electronic device determines that the gesture corresponding to the first touch operation is not a two-touch gesture or that the first touch operation is a misoperation.
[0146] In some embodiments of this application, the electronic device can also process the first touch operation based on its current state. The current state of the electronic device can include a preset state and a non-preset state. For example, if the electronic device detects a user's first touch operation, and the electronic device is currently in a preset state, and the electronic device determines that the first touch operation is a mistake, the electronic device may not respond to the first touch operation or may block the response to the first touch operation. If the electronic device is currently in a non-preset state, that is, not in a preset state, the electronic device can respond to the first touch operation.
[0147] In some embodiments of this application, the preset state of the electronic device may include at least one of, for example, a first state, a second state, and a third state.
[0148] In some embodiments of this application, the electronic device can further process the first touch operation based on whether the first touch operation meets a first condition and the current state of the electronic device. The electronic device detects a user's first touch operation by touching the fingerprint recognition device, acquires the user's fingerprint image, determines whether the user's first touch operation meets a first condition based on the fingerprint image, and if the first condition is met, the electronic device determines the user's fingerprint gesture and processes the first touch operation based on the fingerprint gesture and the current state of the electronic device.
[0149] In some embodiments of this application, the current state of the electronic device may include a preset state and a non-preset state.
[0150] In some embodiments of this application, the electronic device is currently in a preset state. The electronic device can determine that the first touch operation is a erroneous operation and may choose not to respond to the first touch operation or block the response to the first touch operation. If the electronic device is currently in a non-preset state, that is, not in a preset state, the electronic device can respond to the fingerprint gesture corresponding to the first touch operation.
[0151] For example, when the current state of the electronic device is a preset state, the electronic device processes the first touch operation based on the fingerprint gesture and the current state of the electronic device, including the electronic device not responding to the fingerprint gesture. When the current state of the electronic device is not a preset state, the electronic device processes the first touch operation based on the fingerprint gesture and the current state of the electronic device, including the electronic device responding to the fingerprint gesture and processing it. The preset state indicates that the electronic device suppresses the user's touch operation on the fingerprint recognition device. The non-preset state indicates that the electronic device processes the user's touch operation on the fingerprint recognition device.
[0152] In some embodiments of this application, the electronic device processes the first touch operation based on whether the first touch operation meets the first condition and / or the state of the electronic device, including: when the first touch operation meets the first condition, the electronic device determines the fingerprint gesture corresponding to the first touch operation; when it is determined that the electronic device is in a preset state, it determines that the first touch operation is a misoperation.
[0153] In some embodiments of this application, the electronic device is in a preset state. If it is determined that the first touch operation is a misoperation, the electronic device may not respond to the first touch operation or may block the response to the first touch operation.
[0154] In some embodiments of this application, the electronic device is in a non-preset state, that is, the electronic device is not in a preset state, and the electronic device can respond to the first touch operation according to the fingerprint gesture corresponding to the first touch operation.
[0155] In some embodiments of this application, when the current state of the electronic device is a preset state, the electronic device may collect a fingerprint image without based on the detected first touch operation of the fingerprint recognition device when it detects the user's first touch operation on the fingerprint recognition device. When the current state of the electronic device is not a preset state, the electronic device detects the user's first touch operation on the fingerprint recognition device through the fingerprint recognition device, collects the user's fingerprint image in response to the detected first touch operation, determines the fingerprint gesture based on the collected fingerprint image, and processes the first touch operation based on the fingerprint gesture and the current state of the electronic device.
[0156] In some embodiments of this application, the preset state of the electronic device may include at least one of a first state, a second state, and a third state.
[0157] In some embodiments of this application, the electronic device can enter a first state upon detecting a second touch operation on the touchscreen. While in the first state, the electronic device determines the fingerprint gesture corresponding to the first touch operation, and may also determine that the first touch operation was a mis-touch due to being in the first state.
[0158] When a second touch operation is detected on the touchscreen, the electronic device enters a first state. In this first state, any first touch operation on the fingerprint recognition device is considered a malfunction. For distinction, in this application, a user's touch operation on the fingerprint recognition device can be referred to as a first touch operation, and a user's touch operation on the touchscreen of the electronic device can be referred to as a second touch operation. The first state can be triggered by a user's touch on the touchscreen; therefore, the first state can also be called a touch suppression state.
[0159] The second touch operation can be any touch operation on the touchscreen, such as a user's click, swipe, long press, or double touch on the touchscreen. As long as the touchscreen generates a TP signal, it is considered a second touch operation.
[0160] For example, when a second touch operation is detected on the touchscreen while it is on, the electronic device enters the first state. The second touch operation typically occurs when the touchscreen is on, and the user interacts with the electronic device based on the image displayed on the touchscreen. During this interaction, the first touch operation on the fingerprint recognition device is likely to be a false touch. By entering the touch control state and not responding to any fingerprint touch gestures, the success rate of preventing false touches can be improved.
[0161] In some embodiments, while the electronic device is in a first state, the fingerprint recognition device may also stop acquiring touch images. When the first state ends, the fingerprint recognition device resumes acquiring touch images.
[0162] In some embodiments of this application, the electronic device can enter a second state when it detects that a button has been pressed. While in the second state, even if the electronic device identifies the fingerprint gesture corresponding to the first touch operation, it will determine that the first touch operation was a erroneous operation.
[0163] When a button is detected as being pressed, the electronic device enters a second state. In this second state, any initial touch operation on the fingerprint recognition device is considered a false touch. This second state, also known as the button suppression state, is triggered by a button being pressed. When a button on an electronic device is pressed, it indicates that the user is controlling the device via the button, increasing the probability of a false touch on the fingerprint recognition device. The above method effectively reduces the probability of false touches on the fingerprint recognition device when a button is pressed.
[0164] In some embodiments of this application, the button may be a power button, a volume button, or one of other buttons with specific functions.
[0165] In some embodiments of this application, the electronic device can enter a third state when it detects that the user is not looking at the display screen. In the third state, even if the electronic device identifies the fingerprint gesture corresponding to the first touch operation, it will determine that the first touch operation is a erroneous operation and therefore will not respond to it. The purpose of the fingerprint recognition device is to allow for one-handed operation of the electronic device. During operation, the user usually needs to check the display screen to see if the operation is successful. If the user is not looking at the display screen, the probability of the first touch operation being a erroneous touch is relatively high. The above method can reduce the probability of erroneous touches.
[0166] In some embodiments of this application, the electronic device can detect whether a user is commenting on the display screen via a camera. The camera can be, for example, Figure 1 One or more cameras in the camera module 180 shown, the display screen can be as follows Figure 1 The display screen shown is 190°. The camera can be a front-facing camera. The electronic device can detect the user's eyes based on the user's facial image, and then detect whether the user is in an open-eye state, and if so, the direction of the user's gaze, and thus determine whether the user is looking at the display screen. The third state can be caused by the user not looking at the display screen; the third state can also be called the gaze inhibition state.
[0167] Figure 7 This application illustrates a method for processing electronic devices based on fingerprint gestures and the current state of the electronic device, according to some embodiments of this application.
[0168] like Figure 7As shown, the electronic device detects a first touch operation, as in step S701. The electronic device determines the fingerprint gesture corresponding to the first touch operation, as in step S702. It then determines whether the electronic device is in a preset state, as in step S703. If the electronic device is in a preset state, step S705 is executed, and the electronic device either does not respond to the first touch operation or intercepts the response to the first touch operation; if the electronic device is not in a preset state, step S704 is executed, and the electronic device responds to the first touch operation. The determination of the fingerprint gesture corresponding to the first touch operation by the electronic device can be found in other embodiments of this application, and will not be elaborated upon here.
[0169] In some embodiments of this application, the preset state includes at least one of a first state, a second state, or a third state.
[0170] In some embodiments of this application, when it is determined that the electronic device is in any one of the preset states of the first state, the second state, or the third state, the electronic device does not respond to the first touch operation and may not need to detect whether the electronic device is in other states.
[0171] In some embodiments of this application, the electronic device can selectively respond to only the first touch operation corresponding to a portion of fingerprint gestures, without affecting other fingerprint gestures, depending on the specific scenario. In this manner, the electronic device can more flexibly and specifically prevent accidental touches.
[0172] For example, electronic devices are set with multiple fingerprint gestures, including fingerprint gesture 1, fingerprint gesture 2 and fingerprint gesture 3.
[0173] In some embodiments of this application, when the electronic device detects that the user is not looking at the display screen, it enters a third state; in the third state, if the electronic device determines that the fingerprint gesture corresponding to the first touch operation is fingerprint gesture 1, the electronic device determines that the first touch operation is a mis-touch, and the electronic device does not respond to the first touch operation or intercepts the response to the first touch operation; if the electronic device determines that the user's first touch operation is fingerprint gesture 2 or fingerprint gesture 3, the electronic device responds to the first touch operation.
[0174] In some embodiments of this application, when an electronic device enters a first state or a second state, it may respond to only some fingerprint gestures while blocking other fingerprint gestures.
[0175] The current state of an electronic device can include being in a preset state or a non-preset state. If the electronic device is in a preset state, it may be in at least one of the following states: touch suppression state, button suppression state, and gaze suppression state. When the electronic device detects a user's first touch operation on the fingerprint recognition device, it will not acquire a fingerprint image based on the detected first touch operation or will not respond to the first touch operation.
[0176] When an electronic device is in a preset state, it may be controlled by other devices, such as a touchscreen or buttons. Alternatively, the user may not be looking at the electronic device. In such cases, the probability of the user's first touch operation on the fingerprint recognition device is a mis-touch. By determining the current state of the electronic device, mis-operations in the above scenarios can be avoided, thus improving the effectiveness of preventing mis-touches.
[0177] In some embodiments of this application, the electronic device further includes a touchscreen, for example, the touchscreen may be as follows: Figure 1 The touch sensor 160D and the display screen 190 shown constitute a touch screen. The electronic device detects a first touch operation on the fingerprint recognition device when the touch screen is on. In the on-screen state, the user may interact with the electronic device 1 through touch operations on the fingerprint recognition device. Any embodiment of this application can be applied to scenarios where the touch screen is on.
[0178] Figure 8 This application illustrates an electronic device for recognizing fingerprint gestures and a processing method based on fingerprint gestures and the current state, according to some embodiments of this application.
[0179] like Figure 8As shown, the electronic device acquires the touch image of the first touch operation, as shown in step S801. The electronic device can first determine whether the touch image is a fingerprint image, as shown in step S802. If the touch image is a fingerprint image, step S803 is executed to determine whether the ratio of the area of the touch region in the touch image to the total area of the touch image is greater than or equal to a preset value. If the ratio of the area of the touch region to the total area of the touch image is greater than or equal to the preset value, step S804 is executed to detect whether the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold. If the sliding distance is less than the second threshold, step S805 is executed to determine whether the first touch operation meets the following conditions: the touch image includes a first fingerprint image and a second fingerprint image, and the first fingerprint image and the second fingerprint image are separated by a signal-free image. If this condition is met, the fingerprint gesture corresponding to the first touch operation is determined to be a two-touch fingerprint gesture, as shown in step S806. If the electronic device determines that the fingerprint gesture corresponding to the first touch operation is a two-touch fingerprint gesture, step S807 is executed to determine whether the electronic device is in a preset state. If the electronic device is not in a preset state, the electronic device responds to the first touch operation, as shown in step S808. If the touch image is not a fingerprint image, the area of the touch region is less than a preset value relative to the total area of the touch image, the sliding distance is not less than a second threshold, the first touch operation does not conform to the following conditions: the touch image includes a first fingerprint image and a second fingerprint image, and the first fingerprint image and the second fingerprint image are separated by a no-signal-source image, or the electronic device is in a preset state, the electronic device determines that the first touch operation is a misoperation, as shown in step S809. In some embodiments of this application, the preset state includes at least one of a first state, a second state, and a third state.
[0180] Figure 8 This is merely an example illustrating an electronic device that recognizes fingerprint gestures and a processing method based on the fingerprint gesture and the current state. Figure 8 In this process, steps S801 to S806 are the process of determining the fingerprint gesture for the first touch operation. Steps S806 to S809 are the process of processing the first touch operation based on the fingerprint gesture and the current state. Steps S801 to S806 are related to... Figure 6 Steps S601 to S606 are the same. The order in which S801, S802, S803, and S804 are executed does not affect the effect of preventing accidental touches. Each step can be executed serially or in parallel, and this application does not impose any restrictions on this. Steps S802 and S803 can be executed selectively.
[0181] This application also provides a solution for handling accidental touches in electronic devices. The electronic device detects a first touch operation and determines, based on a second condition, that the first touch operation is an accidental touch.
[0182] In some embodiments of this application, the second condition may include at least one of the following: the touch image of the first touch operation is not a fingerprint image; the area of the touch region of the touch image of the first touch operation is less than a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold; the touch image of the first touch operation does not satisfy: the touch image includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration; the touch image of the first touch operation does not satisfy: the touch image of the first touch operation is a continuous fingerprint image and the duration is greater than a third preset duration; the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold; the touch image of the first touch operation does not satisfy: the touch image is a continuous fingerprint image; the electronic device is in a preset state.
[0183] In some embodiments of this application, the preset state includes at least one of the following: a first state, a second state, or a third state. The first state is the state entered when the electronic device detects a second touch operation by the user on the touchscreen. The second state is the state entered when the electronic device detects a button on the electronic device being pressed. The third state is the state entered when the electronic device detects that the user is not looking at the display screen of the electronic device.
[0184] In some embodiments of this application, the electronic device is configured with a dual-touch fingerprint gesture as a preset fingerprint gesture. The second condition may include at least one of the following: the touch image of the first touch operation is not a fingerprint image; the area of the touch region of the touch image of the first touch operation is less than a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold; the touch image of the first touch operation does not satisfy the following conditions: the touch image includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, the duration of the signal-free image is less than a second preset duration, and the electronic device is in a preset state.
[0185] In other words, if the electronic device determines that any one of the above conditions is met, it can determine that the first touch operation is a mistake.
[0186] Similar to the above embodiments, the electronic device is configured with a two-touch fingerprint gesture as a preset fingerprint gesture. The second condition may include at least one of the following: the touch image of the first touch operation is not a fingerprint image; the area of the touch region of the touch image of the first touch operation is less than a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold; the touch image of the first touch operation does not satisfy: the touch image of the first touch operation is a continuous fingerprint image and the duration is greater than a third preset duration; or the electronic device is in a preset state. If the electronic device determines that any one of the above conditions is currently met, it can determine that the first touch operation is a misoperation.
[0187] In some embodiments of this application, the electronic device is configured with multiple preset fingerprint gestures, such as a two-touch fingerprint gesture, a long-press fingerprint gesture, and a swipe fingerprint gesture. The second condition may include at least one of the following: the touch image of the first touch operation is not a fingerprint image; the area of the touch region of the touch image of the first touch operation is less than a first threshold; or the electronic device is in a preset state.
[0188] In some embodiments of this application, the second condition may further include: the touch image of the first touch operation does not satisfy any of the following conditions: the touch image includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, the duration of the signal-free image is less than a second preset duration, the touch image of the first touch operation is a continuous fingerprint image and the duration is greater than a third preset duration, and the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold, and the touch image is a continuous fingerprint image.
[0189] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).
[0190] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0191] In summary, the above description is merely an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made according to the disclosure of the present invention should be included within the scope of protection of the present invention.
Claims
1. An electronic device, characterized in that, include: A fingerprint recognition device, one or more processors, and one or more memories; the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, the computer program code including computer instructions, which, when the one or more processors execute the computer instructions, cause the electronic device to detect a first touch operation; The first touch operation is processed based on whether the first touch operation satisfies the first condition and / or the state of the electronic device.
2. The electronic device according to claim 1, characterized in that, The first condition includes at least one of the following: The touch image of the first touch operation is a fingerprint image; The area of the touch region of the touch image of the first touch operation is greater than or equal to a first threshold. The sliding distance of the first touch operation on the fingerprint recognition device is less than the second threshold. The touch image of the first touch operation includes a first fingerprint image and a second fingerprint image. The first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration. The touch image of the first touch operation is a continuous fingerprint image and the duration is longer than a third preset duration; The sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to the second threshold; the touch image of the first touch operation is a continuous fingerprint image.
3. The electronic device according to claim 2, characterized in that, The step of processing the first touch operation based on whether the first touch operation meets the first condition includes: determining that the fingerprint gesture of the first touch operation is a two-touch fingerprint gesture when the touch image of the first touch operation is a fingerprint image, the area of the touch region of the touch image of the first touch operation is greater than or equal to a first threshold, the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold, the touch image of the first touch operation includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration.
4. The electronic device according to claim 2, characterized in that, The step of processing the first touch operation based on whether the first touch operation satisfies the first condition includes: If the touch image of the first touch operation is a fingerprint image, the area of the touch region of the touch image of the first touch operation is greater than or equal to a first threshold, the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold, and the touch image of the first touch operation is a continuous fingerprint image with a duration greater than a third preset duration, then the fingerprint gesture of the first touch operation is determined to be a long press fingerprint gesture.
5. The electronic device according to claim 2, characterized in that, The step of processing the first touch operation based on whether the first touch operation satisfies the first condition includes: If the touch image of the first touch operation is a fingerprint image, the area of the touch region of the touch image of the first touch operation is greater than or equal to a first threshold, the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold, and the touch image of the first touch operation is a continuous fingerprint image, then the fingerprint gesture of the first touch operation is determined to be a sliding fingerprint gesture.
6. The electronic device according to claim 1, characterized in that, The step of processing the first touch operation based on whether the first touch operation satisfies the first condition includes: If the first touch operation does not meet the first condition, the first touch operation is determined to be a misoperation.
7. The electronic device according to any one of claims 1-5, characterized in that, The step of processing the first touch operation based on whether the first touch operation satisfies the first condition and / or the state of the electronic device includes: If the first touch operation satisfies the first condition, the fingerprint gesture corresponding to the first touch operation is determined. When the electronic device is determined to be in a preset state, the first touch operation is determined to be a misoperation.
8. The electronic device according to claim 7, characterized in that, The preset state includes at least one of the following: a first state, a second state, or a third state.
9. The electronic device according to claim 8, characterized in that, When the one or more processors execute the computer instructions, causing the electronic device to detect a second touch operation by the user on the touchscreen, the electronic device enters the first state.
10. The electronic device according to claim 8, characterized in that, When one or more processors execute the computer instructions, causing the electronic device to detect that a key on the electronic device has been pressed, the electronic device enters the second state.
11. The electronic device according to claim 8, characterized in that, When the one or more processors execute the computer instructions, causing the electronic device to detect that the user is not looking at the display screen of the electronic device, the electronic device enters the third state.
12. The electronic device according to any one of claims 6-11, characterized in that, When the one or more processors execute the computer instructions, the electronic device causes the electronic device to either not respond to the first touch operation based on the assumption that the first touch operation is a mistake, or to intercept the response to the first touch operation.
13. An electronic device, characterized in that, include: A fingerprint recognition device, one or more processors, and one or more memories; the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, the computer program code including computer instructions, which, when the one or more processors execute the computer instructions, cause the electronic device to detect a first touch operation; Based on the second condition, it is determined that the first touch operation was a mistake.
14. The electronic device according to claim 13, characterized in that, The second condition includes at least one of the following: The touch image of the first touch operation is not a fingerprint image; The area of the touch region in the touch image of the first touch operation is less than a first threshold. The sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to the second threshold. The touch image of the first touch operation does not meet the following requirements: the touch image includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration. The touch image of the first touch operation does not meet the following requirements: the touch image of the first touch operation is a continuous fingerprint image and the duration is longer than the third preset duration; The sliding distance of the first touch operation on the fingerprint recognition device is less than the second threshold. The touch image of the first touch operation does not satisfy the condition that the touch image is a continuous fingerprint image; The electronic device is in a preset state.
15. The electronic device according to claim 14, characterized in that, The preset state includes at least one of the following: a first state, a second state, or a third state; The first state is the state entered when the electronic device detects a second touch operation by the user on the touchscreen; the second state is the state entered when the electronic device detects that a button on the electronic device has been pressed; and the third state is the state entered when the electronic device detects that the user is not looking at the display screen of the electronic device.
16. The electronic device according to claim 13, characterized in that, When the one or more processors execute the computer instructions, the electronic device is made not to respond to the first touch operation, or the response to the first touch operation is blocked.
17. A method for processing fingerprint gestures, characterized in that, The method includes: The electronic device detected the first touch operation; The electronic device processes the first touch operation based on whether the first touch operation meets the first condition and / or the state of the electronic device.
18. The method according to claim 17, characterized in that, The first condition includes at least one of the following: The touch image of the first touch operation is a fingerprint image; The area of the touch region in the touch image of the first touch operation is greater than a first threshold. The sliding distance of the first touch operation on the fingerprint recognition device is less than the second threshold. The touch image of the first touch operation includes a first fingerprint image and a second fingerprint image. The first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration. The touch image of the first touch operation is a continuous fingerprint image and the duration is longer than a third preset duration; The sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to the second threshold; the touch image of the first touch operation is a continuous fingerprint image.
19. The method according to claim 18, characterized in that, The electronic device processes the first touch operation based on whether the first touch operation satisfies a first condition, including: The electronic device determines that the fingerprint gesture of the first touch operation is a two-touch fingerprint gesture when: the touch image of the first touch operation is a fingerprint image; the area of the touch region of the touch image of the first touch operation is greater than a first threshold; the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold; the touch image of the first touch operation includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration.
20. The method according to claim 18, characterized in that, The electronic device processes the first touch operation based on whether the first touch operation satisfies a first condition, including: The electronic device determines that the fingerprint gesture of the first touch operation is a long press fingerprint gesture when the touch image of the first touch operation is a fingerprint image, the area of the touch area of the touch image of the first touch operation is greater than a first threshold, the sliding distance of the first touch operation on the fingerprint recognition device is less than a second threshold, and the touch image of the first touch operation is a continuous fingerprint image with a duration greater than a third preset duration.
21. The method according to claim 18, characterized in that, The electronic device processes the first touch operation based on whether the first touch operation satisfies a first condition, including: The electronic device determines that the fingerprint gesture of the first touch operation is a swipe fingerprint gesture when the touch image of the first touch operation is a fingerprint image, the area of the touch region of the touch image of the first touch operation is greater than a first threshold, the sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to a second threshold, and the touch image of the first touch operation is a continuous fingerprint image.
22. The method according to claim 17, characterized in that, The electronic device processes the first touch operation based on whether the first touch operation satisfies a first condition, including: If the first touch operation does not meet the first condition, the electronic device determines that the first touch operation is a misoperation.
23. The method according to any one of claims 17-22, characterized in that, The electronic device's processing of the first touch operation based on whether the first touch operation satisfies a first condition and / or the state of the electronic device includes: If the first touch operation satisfies the first condition, the electronic device determines the fingerprint gesture corresponding to the first touch operation. When the electronic device is determined to be in a preset state, the electronic device determines that the first touch operation is a mistake.
24. The method according to claim 23, characterized in that, The preset state includes at least one of the following: a first state, a second state, or a third state.
25. The method according to claim 24, characterized in that, The method further includes: The electronic device detects a second touch operation by the user on the touchscreen and enters the first state.
26. The method according to claim 24, characterized in that, The method further includes: When the electronic device detects that a button on the electronic device has been pressed, the electronic device enters the second state.
27. The method according to claim 24, characterized in that, The method further includes: The electronic device enters the third state when it detects that the user is not looking at the display screen of the electronic device.
28. The method according to any one of claims 22-27, characterized in that, The method further includes: The electronic device either does not respond to the first touch operation or blocks the response to the first touch operation after determining that the first touch operation is a mistake.
29. A method for processing fingerprint gestures, characterized in that, The method includes: The electronic device detected the first touch operation; The electronic device determines that the first touch operation is a mistake based on a second condition.
30. The method according to claim 29, characterized in that, The second condition includes at least one of the following: The touch image of the first touch operation is not a fingerprint image; The area of the touch region of the touch image of the first touch operation is less than or equal to a first threshold. The sliding distance of the first touch operation on the fingerprint recognition device is less than the second threshold. The touch image of the first touch operation does not meet the following requirements: the touch image includes a first fingerprint image and a second fingerprint image, the first fingerprint image and the second fingerprint image are separated by a signal-free image, and the duration of the first fingerprint image and the second fingerprint image is less than a first preset duration, and the duration of the signal-free image is less than a second preset duration. The touch image of the first touch operation does not meet the following requirements: the touch image of the first touch operation is a continuous fingerprint image and the duration is longer than the third preset duration; The sliding distance of the first touch operation on the fingerprint recognition device is greater than or equal to the second threshold. The touch image of the first touch operation does not satisfy the condition that the touch image is a continuous fingerprint image; The electronic device is in a preset state.
31. The method according to claim 30, characterized in that, The preset state includes at least one of the following: a first state, a second state, or a third state; The first state is the state that the electronic device enters when it detects a second touch operation by the user on the touchscreen. The second state is the state that the electronic device enters when it detects that a button on the electronic device has been pressed; The third state is the state that the electronic device enters when it detects that the user is not looking at the display screen of the electronic device.
32. A computer storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 17-28 or 29-31.
33. A computer program product containing instructions, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 17-28 or 29-31.