Fingerprint acquisition control method and device and electronic equipment
By introducing a hardware connection between the touch screen sensor and the fingerprint sensor in the electronic device, the fingerprint image acquisition is controlled by voltage status, which solves the problem of fingerprint image abnormality caused by the user's fingers being quickly lifted, and improves the fingerprint recognition rate.
Patent Information
- Application Number
- CN202411705464.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-26
- Publication Date
- 2025-03-14
AI Technical Summary
In the prior art, if the fingerprint sensor is raised immediately after the user's finger touches, it still collects fingerprint images in response to the touch signal, resulting in abnormal images collected and reducing the fingerprint recognition rate.
By introducing a signal line between the touch screen sensor and the fingerprint sensor, hardware connection is realized. The processor sets the voltage state of the signal line according to the touch coordinates. The fingerprint sensor decides whether to collect fingerprint images by reading the voltage state.
Through direct hardware connection and voltage status control, it is possible to quickly and accurately determine whether the user's finger is touching the acquisition area of the fingerprint sensor, avoiding fingerprint image abnormalities caused by rapid lifting and improving fingerprint recognition rate.
Smart Images

Figure CN119625797A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to a fingerprint collection control method, device and electronic equipment. Background Art
[0002] With the continuous development of Internet technology and the upgrade of device hardware configuration, the functions of electronic devices are becoming more and more abundant. For example, they can realize functions such as making calls, taking pictures, storing files, instant messaging, and online payment. Electronic devices store various types of user privacy information, which makes the security of electronic devices particularly important. At present, in order to improve the security of electronic devices, fingerprint sensors are installed in electronic devices. Since fingerprints are the lines formed by the uneven surface of the skin on the finger, and the fingerprint features are unique and stable, fingerprint sensors can be used to identify the user's identity to ensure the security of the device.
[0003] For full-screen electronic devices, the fingerprint sensor in the electronic device is an under-screen fingerprint sensor, which needs to cooperate with the touch screen sensor to realize fingerprint collection. In the related art, if the touch screen sensor detects that the user's finger touches the screen, it will obtain the touch coordinates of the user's finger on the screen and pass the touch coordinates to the driver layer program on the processor. The driver layer program determines whether the user's finger touches the fingerprint collection area of the fingerprint sensor based on the touch coordinates. If the user's finger touches the fingerprint collection area of the fingerprint sensor, it will generate a touch signal and pass the touch signal to the hardware abstraction layer (HAL layer) program on the processor. The touch signal is passed to the fingerprint sensor via the HAL layer program. The fingerprint sensor receives the touch signal and performs fingerprint image collection.
[0004] However, in the case where the user's finger touches the fingerprint collection area of the fingerprint sensor and then immediately lifts it up, at the moment the user's finger touches the fingerprint collection area of the fingerprint sensor, the touch screen sensor will obtain the touch coordinates of the user's finger. Since it takes a certain amount of time for the touch screen sensor to obtain the touch coordinates of the user's finger, for the driver layer program to send a touch signal based on the touch coordinates, and then for the touch signal to be transmitted to the fingerprint sensor via the HAL layer program, and the user's finger is quickly lifted up from the fingerprint collection area of the fingerprint sensor, when the fingerprint sensor receives the touch signal, the user's finger has actually been lifted up from the fingerprint collection area of the fingerprint sensor, but the fingerprint sensor does not know that the user's finger has been lifted up, and still responds to the touch signal to collect the fingerprint image. At this time, the collected fingerprint image is not the fingerprint image of the user's finger, and the image is abnormal, resulting in a decrease in the fingerprint recognition rate. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide a fingerprint collection control method, device and electronic device, which can solve the problem of decreased fingerprint recognition rate caused by abnormal fingerprint images collected by fingerprint sensors in related technologies.
[0006] In a first aspect, an embodiment of the present application provides a fingerprint collection control method, which is applied to an electronic device, wherein the electronic device includes a processor, a screen, a touch screen sensor, and a fingerprint sensor, wherein a pin of the touch screen sensor is connected to a pin of the fingerprint sensor via a signal line, and the method includes:
[0007] The touch screen sensor, when detecting that a touch object touches the screen, acquires touch coordinates of the touch object on the screen and sends the touch coordinates to the processor;
[0008] The processor, upon receiving the touch coordinates, determines whether the touch object touches a fingerprint collection area of the fingerprint sensor according to the touch coordinates, and if so, sets the voltage state of the signal line to a first level and sends a touch signal to the fingerprint sensor;
[0009] The processor, when the touch object does not touch the screen or the fingerprint collection area of the fingerprint sensor, sets the voltage state of the signal line to a second level, wherein the first level is different from the second level;
[0010] When receiving the touch signal, the fingerprint sensor reads the voltage state of the signal line, and if the voltage state of the signal line is the first level, performs fingerprint image acquisition on the touch object; if the voltage state of the signal line is the second level, stops fingerprint image acquisition.
[0011] In a second aspect, an embodiment of the present application provides a fingerprint collection control device, which is applied to an electronic device, wherein the electronic device includes a processor, a screen, a touch screen sensor, and a fingerprint sensor, wherein a pin of the touch screen sensor is connected to a pin of the fingerprint sensor via a signal line, and the device includes:
[0012] A first processing module, configured to obtain, through the touch screen sensor, touch coordinates of the touch object on the screen when the touch object touches the screen, and send the touch coordinates to the processor;
[0013] A second processing module, configured to determine, by the processor, whether the touch object touches the fingerprint collection area of the fingerprint sensor according to the touch coordinates when the touch coordinates are received, and if so, set the voltage state of the signal line to a first level and send a touch signal to the fingerprint sensor;
[0014] The second processing module is further configured to set the voltage state of the signal line to a second level through the processor when the touch object does not touch the screen or the fingerprint collection area of the fingerprint sensor, wherein the first level is different from the second level;
[0015] The third processing module is used to read the voltage state of the signal line when the fingerprint sensor receives the touch signal, and if the voltage state of the signal line is the first level, perform fingerprint image acquisition on the touch object; if the voltage state of the signal line is the second level, stop fingerprint image acquisition.
[0016] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the fingerprint collection control method described in the first aspect are implemented.
[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the fingerprint collection control method as described in the first aspect are implemented.
[0018] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the steps of the fingerprint collection control method as described in the first aspect.
[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the fingerprint collection control method as described in the first aspect.
[0020] In an embodiment of the present application, when a touch screen sensor of an electronic device detects that a touch object touches the screen, it obtains the touch coordinates of the touch object on the screen and sends the touch coordinates to a processor; wherein a pin of the touch screen sensor is connected to a pin of a fingerprint sensor via a signal line; when the processor receives the touch coordinates, it determines whether the touch object touches a fingerprint collection area of the fingerprint sensor according to the touch coordinates, and if so, sets the voltage state of the signal line to a first level and sends a touch signal to the fingerprint sensor; when the touch object does not touch the screen or the fingerprint collection area of the fingerprint sensor, the processor sets the voltage state of the signal line to a second level, wherein the first level is different from the second level; when the fingerprint sensor receives the touch signal, it reads the voltage state of the signal line, and if the voltage state of the signal line is the first level, performs fingerprint image collection on the touch object; if the voltage state of the signal line is the second level, stops fingerprint image collection.
[0021] It can be seen that in the embodiment of the present application, a physical signal line can be added on the basis of the original hardware structure of the electronic device, and the touch screen sensor and the fingerprint sensor in the electronic device can be connected in hardware through the physical signal line. Since the touch screen sensor and the fingerprint sensor are directly connected through a physical link, and the data volume of the level signal is very small, the speed of transmitting the level signal on the physical link is very fast, which is much faster than the transmission speed of the touch signal on the software link. When the fingerprint sensor receives the touch signal transmitted by the HAL layer program, it can further determine whether the touch object is actually touching the fingerprint sensor by reading the level signal transmitted by the physical link. If the level signal transmitted through the physical link determines that the touch object touches the fingerprint collection area of the fingerprint sensor, it means that the touch object did not lift up immediately after touching the fingerprint collection area of the fingerprint sensor. At this time, the fingerprint image of the touch object is collected; if the level signal transmitted through the physical link determines that the touch object does not touch the fingerprint collection area of the fingerprint sensor, it means that the touch object lifted up immediately after touching the fingerprint collection area of the fingerprint sensor. At this time, the fingerprint image of the touch object is not collected. For the situation where the user's finger is lifted up immediately after touching the fingerprint collection area of the fingerprint sensor, it can avoid abnormalities in the collected fingerprint image and improve the fingerprint recognition rate. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 It is an example diagram of a fingerprint collection control method provided by the related art;
[0023] Figure 2 is a flow chart of a fingerprint collection control method provided by an embodiment of the present application;
[0024] Figure 3is an example diagram of the fingerprint collection control method provided in an embodiment of the present application;
[0025] Figure 4 It is a structural block diagram of a fingerprint collection control device provided in an embodiment of the present application;
[0026] Figure 5 is a structural schematic diagram of an electronic device provided in an embodiment of the present application;
[0027] Figure 6 It is a schematic diagram of the hardware structure of an electronic device implementing various embodiments of the present application. DETAILED DESCRIPTION
[0028] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0029] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0030] First, some concepts and application scenarios involved in the embodiments of this application are introduced.
[0031] 1. Concept
[0032] A touch screen sensor can be defined as a switch activated by touch. It is a device that can sense touch input and convert it into electrical signals, thereby realizing the function of human-computer interaction. Touch screen sensors are classified according to the type of touch, mainly including capacitive touch switches, resistive touch switches, and piezoelectric touch switches. These sensors are widely used in various electronic devices, such as smartphones, tablets, personal computers, etc., providing intuitive and convenient operation methods, greatly improving the user experience.
[0033] A touch object refers to an object that touches the screen. In practical applications, the touch object includes but is not limited to: a user's finger, a touch input device such as a stylus, etc. For ease of understanding, the following description will mainly use fingers as an example.
[0034] Fingerprint sensor, also known as fingerprint sensor, is a sensing device and a key component for realizing automatic fingerprint collection. At present, fingerprint sensors are used more and more widely in electronic devices and can be used in scenarios such as device unlocking and payment. Currently, fingerprint sensors in mainstream electronic devices are divided into three categories: the first category is capacitive fingerprint sensors, which are generally packaged together with the power button and are external; the second category is optical fingerprint sensors, which are generally installed on the lower surface of the screen; the third category is ultrasonic fingerprint sensors, which are generally installed on the lower surface of the screen; the second and third categories mentioned above can generally be referred to as under-screen fingerprint solutions. The embodiments of the present application are applied to the under-screen fingerprint solutions of the second and third categories mentioned above.
[0035] Signal line refers to an electronic circuit or circuit used to transmit signals. It transmits specially processed high and low level signals and plays a very important role in electronic equipment or systems. Signal lines can carry various types of signals, such as audio signals, video signals, digital signals, analog signals, etc. Different types of signals need to be transmitted using different signal lines. The main function of the signal line is to transmit signals. Using high-quality signal lines can effectively reduce signal distortion and noise interference, and improve the accuracy and stability of sound quality, picture quality and data transmission.
[0036] Level is a parameter used to describe the relative size of voltage, current or electric power. In electronics, level usually refers to the voltage level, that is, the voltage value at a certain point in the circuit.
[0037] High level refers to a high voltage relative to a low level, which is a term used in electrical engineering. In logic level, it is the minimum input high level allowed to ensure that the input of the logic gate is at a high level. When the input level is higher than the input high voltage (Vih), the input level is considered to be a high level.
[0038] Low level refers to the low voltage relative to the high level, which is a term used in electrical engineering. In the logic level, it is the maximum input low level allowed when the input of the logic gate is at a low level. When the input level is lower than the input low voltage (Vil), the input level is considered to be a low level. In digital logic circuits, low level represents 0 and high level represents 1. Generally speaking, the low level is 0 to 0.25V and the high level is 3.5 to 5V.
[0039] The fingerprint image to be identified refers to the image obtained by the fingerprint sensor collecting the fingerprint image of the touch object.
[0040] The reference fingerprint image refers to the average data collected by the fingerprint sensor when there is no touch object in the fingerprint collection area of the fingerprint sensor. The reference fingerprint image is a physical reference surface data and is an indispensable reference data in the fingerprint recognition process.
[0041] Fingerprint recognition is to classify and compare the fingerprints of the identified object to make a judgment.
[0042] Trusted Execution Environment (TEE) is an environment that can be executed independently from the Android operating system (Android OS). The software operates based on this environment.
[0043] Normal mode (Rich Execution Environment, REE) is the environment of the Android OS system, which sends commands to TEE through REE to perform corresponding operations.
[0044] A trusted application (TA) is an application in a TEE environment. Each TA is independent and cannot access the security resources of another TA. For example, in a fingerprint payment project, the fingerprint application and the payment application will each have their own TA.
[0045] Client Application (CA) is an application in the REE environment, mainly used to communicate with TA. Different TAs will have different corresponding CA programs.
[0046] The hardware layer refers to the specific physical sensor layer, such as fingerprint sensors, touch screen sensors, etc.
[0047] The driver layer refers to the layer where software programs used to directly operate hardware devices are located. It runs in the kernel space and is the Linux kernel layer. For example, the software programs on the touch screen driver layer can read the signals of the touch screen sensor, and the software programs on the fingerprint driver layer can read the signals of the fingerprint sensor.
[0048] The hardware abstraction layer (HAL layer) refers to the interface layer between the operating system kernel and the hardware circuit. It runs in the user space and aims to abstract the hardware, hide the hardware interface details of a specific platform, and provide a virtual hardware platform for the operating system, making it hardware-independent and portable on multiple platforms. For example, the fingerprint HAL layer can communicate with the fingerprint driver on the one hand and with the fingerprint TA on the other.
[0049] The driver layer and the HAL layer are both layers where the software programs running on the processor of the electronic device in the under-screen fingerprint solution are located. The two layers are independent of each other, but can communicate with each other. For example, the overall Android framework, from top to bottom, the mainstream standard framework is: the top layer is the APP layer, running various APPs; the next layer is the Framework layer, connecting to the APP layer upward and the HAL layer downward; the next layer is the HAL layer, connecting to the Framework layer upward and the driver layer downward; the bottom layer is the driver layer, connecting to the HAL layer upward and the actual hardware downward.
[0050] General-purpose input / output (GPIO) pins have functions similar to P0-P3 of 8051. The pins can be used freely by the user through program control. The pins can be used as general-purpose input (GPI) or general-purpose output (GPO) or general-purpose input and output according to practical considerations.
[0051] 2. Application Scenarios
[0052] In order to improve the security of the device, fingerprint communication on electronic devices needs to be carried out in the TEE security environment. Unlike the working environment of other devices, its software implementation will be more complicated.
[0053] At present, for the under-screen fingerprint solution in the TEE environment, the fingerprint collection control process in related technologies is as follows: Figure 1 As shown, there is no direct hardware connection between the touch screen sensor and the fingerprint sensor at the hardware layer. The information transmission between the touch screen sensor and the fingerprint sensor can only be achieved through the software link between the driver layer and the HAL layer running on the processor.
[0054] For ease of understanding, taking the touch object as the user's finger as an example, first, the touch screen sensor will detect in real time whether the user's finger touches the screen. In step 101, if the touch screen sensor detects that the user's finger touches the screen, the touch coordinates are sent to be passed to the touch screen driver. In step 102, the touch screen driver receives the touch coordinates. If it is determined that the finger touches the fingerprint collection area of the fingerprint sensor according to the touch coordinates, an INT1 signal is sent. At this time, the INT1 signal is used to indicate that the user's finger touches the fingerprint collection area of the fingerprint sensor. In step 103, the touch screen driver notifies the fingerprint driver of the INT1 signal. In step 104, the fingerprint driver notifies the fingerprint HAL layer program of the INT1 signal. In step 105, the fingerprint HAL layer program notifies the fingerprint TA of the INT1 signal. In step 106, the fingerprint TA receives the INT1 signal, controls the fingerprint sensor to collect the fingerprint image of the user's finger, and identifies the collected fingerprint image. Among them, the above-mentioned touch screen driver and fingerprint driver are both software programs of the driver layer, the above-mentioned fingerprint HAL layer program and fingerprint TA are both software programs of the HAL layer, and the above-mentioned software programs of the driver layer and the software programs of the HAL layer both run on the processor.
[0055] For the convenience of subsequent description, the touch screen driver is referred to as touch screen software, and the fingerprint driver, fingerprint HAL layer program and fingerprint TA are collectively referred to as fingerprint software.
[0056] Although the relevant technology can realize the collection of user fingerprint images to a certain extent, there are also some problems: Problem one, there is a certain delay in the transmission of touch screen signals. For example, the user's finger is lifted up immediately after touching the screen. At this time, the fingerprint software is still processing the user's touch information, but in fact the user has already raised his hand, so the fingerprint processing result may be abnormal.
[0057] Problem 2: The touchscreen signal sometimes needs to be reset. For example, when the screen is off, the user's finger touches the fingerprint collection area, and then the device is unlocked successfully to enter the desktop system. The touchscreen signal may need to be reset to better handle subsequent touch needs. This is an operation required by the touchscreen chip. If the user's finger is still pressed on the fingerprint collection area at this time, the touchscreen software will still report an error message that the user's finger has left to the fingerprint software. If the fingerprint software processes this information, it will mistakenly believe that the user's finger has left, and the fingerprint data processing result may also be abnormal.
[0058] For ease of understanding, the causes of the above two problems are explained in detail based on the current communication method between the touch screen sensor and the fingerprint sensor, as well as the coupling information between the touch screen sensor and the fingerprint sensor:
[0059] 1) Communication method
[0060] There are many communication methods in the related technology. For example, using the Linux kernel underlying notifier mechanism, the kernel defines four types of notification chains. The code of the touch screen driver and the fingerprint driver can use a simple Blocking notifier. The specific execution operations are: for the C language code of the touch screen driver, initialize a blocking_notifier; for the C language code of the fingerprint driver, register the callback function to the blocking_notifier; when the user's finger touches the screen, the touch screen driver will call the registered callback function; due to the call in the previous step, the C code of the fingerprint driver will be called, so that the fingerprint driver receives the information passed by the touch screen driver.
[0061] It is understandable that the touch screen sensor itself needs electricity to work. Only with electricity can it detect the touch information of the user's finger on the screen. When the touch information is detected, the touch information is transmitted using the above-mentioned Linux kernel bottom notifier mechanism. This is a pure software solution. Since the software solution is executed by the processor, and the processor is powered, it is possible even if the touch screen sensor and the fingerprint sensor have no power at this time. In other words, this is a software solution created by the bottom kernel code. In addition, using the Linux kernel bottom notifier mechanism, any two kernel business modules can interact at the bottom of the Linux kernel.
[0062] 2) Coupling information between touch screen sensor and fingerprint sensor
[0063] The information provided by the touch screen sensor to the fingerprint sensor mainly includes two categories: one is the information of the touch object touching the screen (referred to as touch information), and the other is the information of the touch object being lifted from the screen (referred to as lift information).
[0064] 3) Causes of the problem
[0065] 3.1 When the touch screen sensor sends touch information, taking the touch object as the user's finger as an example, the fingerprint collection control process is:
[0066] The fingerprint software switches to the finger pressing process, and the fingerprint sensor starts to collect the fingerprint image to be identified. For the collected fingerprint image to be identified, the fingerprint software will consider it as a finger pressing.
[0067] Since the above software switching process and finger data collection both take time, usually tens of milliseconds, within these tens of milliseconds, if the user raises his hand, the fingerprint software will not know, because it has entered the TEE system. As long as it has not left the TEE system, the information of the user raising his hand cannot be known by the fingerprint software. Therefore, the fingerprint sensor will continue to collect images, collect images that are considered to be pressed by fingers, and then send them to the fingerprint algorithm for identification. If a film is used on the screen or there are fingerprint residues or dirt on the screen, the fingerprint sensor will collect these dirty images. Dirty images exist in all images, which may cause fingerprint recognition failure and may also cause fingerprint misrecognition. After fingerprint misrecognition, because there is still a fingerprint deep learning mechanism, it will lead to a series of problems such as a decrease in fingerprint recognition rate. This is also the first problem mentioned above.
[0068] 3.2 When the touch screen sensor sends a lift message, taking the user's finger as an example, the fingerprint collection control process is:
[0069] The fingerprint software switches to the finger lift process, and the fingerprint sensor starts to collect the baseline fingerprint image. The fingerprint software will consider the currently collected baseline fingerprint image, that is, the image without the finger on the fingerprint collection area, as the base data. The accuracy of the base data will directly affect the recognition rate of the fingerprint algorithm, so the base data is very critical.
[0070] After the screen turns from off to on, the touch screen driver will force the touch screen sensor to reset. The so-called reset means to power on and off the touch screen sensor again and re-establish the touch screen baseline data. At this time, no matter what object, including human hands, is pressed on the screen, even if a capacitance value is generated, the touch screen software will force the current capacitance value data to be updated as the baseline data, and send a hand-raising information to the fingerprint sensor. When the fingerprint software receives the hand-raising information, it will execute the above hand-raising process. If the user does not raise his hand at this time, the fingerprint sensor will still collect the base data with the fingerprint path information of the hand pressing on the screen. The base data is obviously wrong and will cause the fingerprint recognition rate to drop. This is also the second problem mentioned above.
[0071] It can be seen that in the related art, the fingerprint sensor can only rely on software signals sent by the touch screen software and fingerprint software running on the processor to obtain information such as whether the touch object touches the screen or is lifted from the screen. The software signal cannot represent the actual touch and lift conditions of the touch object. For example, the user's finger may be touching the fingerprint collection area, but the touch screen software sends lift information. Relying on pure software may cause some errors.
[0072] In order to solve the above technical problems, the embodiments of the present application provide a fingerprint collection control method, device and electronic device.
[0073] Different from the software-only interaction in the related art, in the embodiment of the present application, a software solution based on hardware connection is proposed. Specifically, a physical electrical signal connection is established between the touch screen sensor and the fingerprint sensor, that is, the fingerprint sensor and the touch screen sensor are directly connected in hardware through a signal line, and the touch information and lift information of the touch screen sensor can be transmitted via the signal line, so that both the touch information and the lift information will be directly reflected in the physical electrical signal. The fingerprint sensor can directly obtain the most realistic touch information and lift information, so that the fingerprint image to be identified and the reference fingerprint image finally collected by the fingerprint sensor are normal, thereby improving the fingerprint recognition rate.
[0074] The fingerprint collection control method provided in the embodiment of the present application is described in detail below with reference to the accompanying drawings.
[0075] It should be noted that the fingerprint collection control method provided in the embodiment of the present application can be applied to electronic devices. In practical applications, the electronic devices may include: smart phones, tablet computers and other terminals, which are not limited in the embodiment of the present application.
[0076] Figure 2 is a flow chart of a fingerprint collection control method provided by an embodiment of the present application, which is applied to an electronic device, the electronic device includes a processor, a screen, a touch screen sensor and a fingerprint sensor, and the pins of the touch screen sensor are connected to the pins of the fingerprint sensor through a signal line, such as Figure 2 As shown, the method may include the following steps: step 201, step 202, step 203 and step 204;
[0077] In step 201, when the touch screen sensor detects that a touch object touches the screen, it obtains the touch coordinates of the touch object on the screen and sends the touch coordinates to the processor.
[0078] In the embodiment of the present application, a signal line can be used to connect the GPIO pin of the touch screen sensor with the GPIO pin of the fingerprint sensor to achieve a direct connection between the touch screen sensor and the touch screen sensor in hardware.
[0079] In the embodiment of the present application, the touch coordinates are used to indicate the touch position of the touch object on the screen.
[0080] In the embodiment of the present application, since the touch screen driver of the touch screen sensor, the fingerprint driver of the fingerprint sensor, the fingerprint HAL program and the fingerprint TA are all running on the processor, in order to determine whether the touch position of the touch object on the screen is located in the fingerprint collection area of the fingerprint sensor, the touch screen sensor will send the touch coordinates of the touch object on the screen to the processor, and the processor will determine whether the touch object touches the fingerprint collection area of the fingerprint sensor based on the touch coordinates.
[0081] In the embodiment of the present application, the touch object refers to an object touching the screen. In practical applications, the touch object includes but is not limited to: a user's finger, a touch input device such as a stylus, etc.
[0082] In step 202, upon receiving the touch coordinates, the processor determines whether the touch object touches the fingerprint collection area of the fingerprint sensor according to the touch coordinates. If so, the voltage state of the signal line is set to the first level, and a touch signal is sent to the fingerprint sensor.
[0083] In the embodiment of the present application, since the coordinate position information of the fingerprint collection area of the fingerprint sensor on the screen is known, the processor can determine whether the touch object touches the fingerprint collection area of the fingerprint sensor by judging whether the touch coordinates are within the coordinate range of the fingerprint collection area. If the touch coordinates are within the coordinate range of the fingerprint collection area, it is determined that the touch object touches the fingerprint collection area of the fingerprint sensor; if the touch coordinates are outside the coordinate range of the fingerprint collection area, it is determined that the touch object does not touch the fingerprint collection area of the fingerprint sensor.
[0084] In the embodiment of the present application, on the one hand, considering that the touch signal needs to go through the following process from generation to transmission to the fingerprint sensor: the touch screen sensor obtains the touch coordinates of the touch object and transmits the touch coordinates to the driver layer program, the driver layer program sends a touch signal according to the touch coordinates, and the touch signal is transmitted to the fingerprint sensor via the HAL layer program, and this process is executed on the software link (driver layer program, HAL layer program, etc.), which takes a certain amount of time, that is, "there is a certain delay in the transmission of the touch signal", so the touch signal cannot truly represent the current touch and lift status of the touch object. If it only relies on the touch signal, the fingerprint sensor will collect the fingerprint. The fingerprint image may be abnormal; on the other hand, considering that the touch screen sensor and the fingerprint sensor are directly connected through a signal line, and the amount of data of the level signal transmitted on the signal line is small, the signal line transmits the level signal very quickly and almost does not require any time, that is, "there is no delay in the transmission of the level signal". Therefore, in order to facilitate the fingerprint sensor to read the voltage state of the signal line to obtain the actual touch and lift of the screen by the touch object, the processor sets the voltage state of the signal line to the first level when it determines that the touch object touches the fingerprint collection area of the fingerprint sensor, and indicates that the touch object touches the fingerprint collection area of the fingerprint sensor through the first level.
[0085] In the embodiment of the present application, considering the general design rules in the industry, the first level is a high level.
[0086] In the embodiment of the present application, when the processor determines that the touch object touches the fingerprint collection area of the fingerprint sensor, it sends a touch signal to the fingerprint sensor to notify the fingerprint sensor to collect the fingerprint image of the touch object; wherein, the touch signal in the embodiment of the present application is the same as the INT1 signal in the related technology.
[0087] In step 203, the processor sets the voltage state of the signal line to a second level when the touch object does not touch the screen or the fingerprint collection area of the fingerprint sensor.
[0088] In the embodiment of the present application, the first level is different from the second level. Considering the general design rules in the industry, when the first level is a high level, the second level is a low level.
[0089] In the embodiment of the present application, on the one hand, it is considered that the touch signal needs to go through the following process from generation to transmission to the fingerprint sensor: the touch screen sensor obtains the touch coordinates of the touch object and transmits the touch coordinates to the driver layer program, the driver layer program sends a touch signal according to the touch coordinates, and the touch signal is transmitted to the fingerprint sensor via the HAL layer program. This process is executed on the software link (driver layer program, HAL layer program, etc.), which takes a certain amount of time, that is, "there is a certain delay in the transmission of the touch signal". Therefore, the touch signal cannot truly represent the current touch and lift status of the touch object. If it only relies on the touch signal, the fingerprint image collected by the fingerprint sensor may be abnormal. On the other hand, considering that the touch screen sensor and the fingerprint sensor are directly connected through a signal line and the amount of data of the level signal transmitted on the signal line is small, the signal line transmits the level signal very quickly and almost does not require any time, that is, "there is no delay in the transmission of the level signal". Therefore, in order to facilitate the fingerprint sensor to distinguish the actual touch and lift of the screen by the touch object by reading the voltage state of the signal line, the processor sets the voltage state of the signal line to the second level when it determines that the touch object has not touched the screen or the fingerprint collection area of the fingerprint sensor, and indicates through the second level that the touch object has not touched the screen or the fingerprint collection area of the fingerprint sensor.
[0090] In step 204, when the fingerprint sensor receives the touch signal, it reads the voltage state of the signal line. If the voltage state of the signal line is at the first level, the fingerprint image of the touch object is collected; if the voltage state of the signal line is at the second level, the fingerprint image collection is stopped.
[0091] In the embodiment of the present application, when a touch signal is received, if the voltage state of the signal line read by the fingerprint sensor is the first level, it represents that this is a valid signal of touching the fingerprint collection area, indicating that the touch object is indeed touching the fingerprint collection area of the fingerprint sensor, and the fingerprint image of the touch object is collected at this time.
[0092] It is understandable that when the touch object is the user's finger, the fingerprint image to be identified is obtained by collecting the fingerprint image of the touch object, and the fingerprint image to be identified contains the fingerprint information of the finger, and the fingerprint image to be identified is considered to be a valid image. When the touch object is an object other than the user's finger, the fingerprint image to be identified is obtained by collecting the fingerprint image of the touch object, and the fingerprint image to be identified does not contain the fingerprint information, and the fingerprint image to be identified is considered to be an invalid image.
[0093] In the embodiment of the present application, when a touch signal is received, if the voltage state of the signal line read by the fingerprint sensor is the second level, it means that when the fingerprint software processes the touch information, the touch object has been lifted from the fingerprint collection area of the fingerprint sensor, and the fingerprint image is not collected for the touch object at this time.
[0094] In some embodiments, when the fingerprint sensor receives a touch signal, if the voltage state of the signal line is at the second level, a prompt message is output through the screen, wherein the prompt message is used to prompt that the touch input of the touch object is too fast.
[0095] In an embodiment of the present application, when the fingerprint sensor receives a touch signal, if the voltage state of the signal line is at the second level, it means that the touch object is lifted immediately after touching the fingerprint collection area of the fingerprint sensor. At this time, in order to improve the fingerprint recognition rate, the touch object is prompted to increase the contact time with the fingerprint collection area of the fingerprint sensor so that the fingerprint sensor can collect the real fingerprint image of the touch object.
[0096] In the embodiment of the present application, the form of the prompt information includes but is not limited to: a prompt message displayed on the screen, an output prompt voice, an output prompt vibration, etc.
[0097] For example, when the touch object is the user's finger, the user lifts the finger immediately after touching the screen. At this time, the fingerprint software is still processing the touch information of the user's finger, but in fact the user has lifted his hand, so the fingerprint processing result may be abnormal. At this time, the user is prompted that the fingerprint input is too fast, so that after the user sees the prompt information, he can fully contact the finger with the screen, so that the fingerprint sensor can collect the correct user fingerprint image, thereby improving the fingerprint recognition rate.
[0098] In some embodiments, considering the working principle of the TEE environment: once the program enters the TEE system, as long as it has not exited the TEE system, the information that the touch object has been lifted cannot be known by the software, so the fingerprint sensor will continue to collect images, collect images that are considered to be pressed by the touch object, and then send them to the fingerprint algorithm for recognition. Figure 1 After step 204 in the illustrated embodiment, the following steps may also be included: step 205, step 206 and step 207;
[0099] In step 205, when the fingerprint sensor collects the fingerprint image of the touch object, each time the fingerprint image is collected, the fingerprint sensor sends a collected fingerprint image to be identified of the touch object to the processor.
[0100] In the embodiment of the present application, when the fingerprint sensor collects the fingerprint image of the touch object, it indicates that the TEE environment has been entered. After entering the TEE environment, the fingerprint sensor sends the collected fingerprint image of the touch object to be identified to the processor each time it collects the fingerprint image.
[0101] In step 206, upon receiving the fingerprint image to be identified, the processor performs fingerprint identification on the fingerprint image to be identified. If the identification fails, a fingerprint identification failure signal is sent to the fingerprint sensor. If the identification succeeds, a fingerprint identification success signal is sent to the fingerprint sensor.
[0102] In the embodiment of the present application, the processor can compare the fingerprint image to be identified with the fingerprint base images in the fingerprint base library, and calculate the similarity between the fingerprint image to be identified and each fingerprint base image according to the fingerprint algorithm.
[0103] In the embodiment of the present application, if the calculated similarities are all lower than the first threshold, for example 80%, it means that there is no fingerprint base image in the fingerprint base database that matches the fingerprint image to be identified, that is, the identification fails. At this time, a fingerprint identification failure signal is sent to the fingerprint sensor to notify the fingerprint sensor of the identification failure through the fingerprint identification failure signal.
[0104] In the embodiment of the present application, if at least one of the calculated similarities is higher than the first threshold, for example, 80%, it means that there is a fingerprint base image in the fingerprint base database that matches the fingerprint image to be identified, that is, the identification is successful. At this time, a fingerprint identification success signal is sent to the fingerprint sensor to notify the fingerprint sensor of the successful identification through the fingerprint identification success signal.
[0105] In step 207, when the fingerprint sensor receives a fingerprint recognition failure signal, if the number of times the fingerprint image is collected for the touch object is less than the number threshold, the voltage state of the signal line is read, and if the voltage state of the signal line is a first level, the fingerprint image is collected for the touch object; if the voltage state of the signal line is a second level, the fingerprint image collection is stopped; when the fingerprint recognition failure signal is received, if the number of times the fingerprint image is collected for the touch object is the number threshold, the fingerprint image collection is stopped; when the fingerprint recognition success signal is received, the fingerprint image collection is stopped.
[0106] In the embodiment of the present application, considering power consumption and user experience, in the TEE environment, the fingerprint sensor cannot collect fingerprint images indefinitely, and the processor usually sets the number of recognition failures, that is, the number threshold, recorded as N. If the fingerprint sensor continuously collects N fingerprint images to be recognized, and all of them fail to be recognized by the recognition algorithm in the processor, then exit the TEE environment. For example, N = 3, if the fingerprint sensor continuously collects 3 fingerprint images to be recognized, and all of them fail to be recognized by the recognition algorithm in the processor, then exit the TEE environment.
[0107] In the embodiment of the present application, if the fingerprint sensor receives a fingerprint recognition failure signal and the number of times the fingerprint image of the touch object is collected is less than the number threshold, it means that the fingerprint image of the touch object needs to continue to be collected. In order to determine whether the touch object is actually pressed on the fingerprint collection area of the fingerprint sensor, the voltage state of the signal line will be read again. If the voltage state of the signal line is the first level, it represents that this is a valid touch signal in the fingerprint collection area, indicating that the touch object is indeed pressed on the fingerprint collection area of the fingerprint sensor. At this time, the fingerprint image of the touch object is collected again, and the collected fingerprint image to be identified is sent to the processor for identification.
[0108] In the embodiment of the present application, if the fingerprint sensor receives a fingerprint recognition failure signal and the number of times the fingerprint image of the touch object is collected is less than the number threshold, it means that the fingerprint image of the touch object needs to continue to be collected. In order to determine whether the touch object is actually pressed on the fingerprint collection area of the fingerprint sensor, the voltage state of the signal line will be read again. If the voltage state of the signal line is the second level, it means that when the fingerprint software processes the touch information, the touch object has been lifted from the fingerprint collection area of the fingerprint sensor. At this time, the fingerprint image of the touch object is no longer collected.
[0109] In the embodiment of the present application, if the fingerprint sensor receives a fingerprint recognition failure signal and the number of times the fingerprint image is collected for the touch object is the number threshold, it means that the upper limit of the number of times the fingerprint sensor collects images has been reached, and the fingerprint image of the touch object will no longer be collected at this time.
[0110] In the embodiment of the present application, if the fingerprint sensor receives a fingerprint recognition success signal, it means that the touch object has been successfully authenticated this time, and the fingerprint image of the touch object is no longer collected at this time.
[0111] It can be seen that in the embodiment of the present application, in the TEE environment, the fingerprint sensor can accurately determine whether the touch object is actually touching the fingerprint collection area through the voltage state of the signal line, and then decide whether to perform the fingerprint collection operation on the touch object, so that the fingerprint sensor can collect the correct fingerprint image of the touch object, thereby improving the fingerprint recognition rate.
[0112] For ease of understanding, take the touch object as the user's finger as an example. Figure 3 The example diagram shown illustrates the fingerprint collection control process provided in the embodiment of the present application.
[0113] like Figure 3 As shown, there is a direct hardware connection between the touch screen sensor and the fingerprint sensor at the hardware layer. The information transmission between the touch screen sensor and the fingerprint sensor can be achieved through the software link between the driver layer and the HAL layer running on the processor, and can also be achieved through the signal line between the touch screen sensor and the fingerprint sensor.
[0114] First, the touch screen sensor detects in real time whether the user's finger touches the screen. In step 301, if the touch screen sensor detects that the user's finger touches the screen, the touch coordinates are sent to the touch screen driver. In step 302, the touch screen driver receives the touch coordinates. If it is determined that the finger touches the fingerprint collection area of the fingerprint sensor according to the touch coordinates, the INT2 signal is pulled high and the INT1 signal is sent. At this time, the INT1 signal and the INT2 signal are both used to indicate that the user's finger touches the fingerprint area of the fingerprint sensor. In step 303, the touch screen driver notifies the fingerprint driver of the INT1 signal. In step 304, the fingerprint driver notifies the fingerprint HAL layer program of the INT1 signal. In step 305, the fingerprint HAL layer program notifies the fingerprint TA of the INT1 signal. In step 306, the fingerprint TA receives the INT1 signal and determines whether the INT2 signal is a high level. If so, the fingerprint sensor is controlled to collect the user's fingerprint image and identify the collected user's fingerprint image; otherwise, the fingerprint image collection is stopped. Among them, the above-mentioned touch screen driver and fingerprint driver are both software programs of the driver layer, the above-mentioned fingerprint HAL layer program and fingerprint TA are both software programs of the HAL layer, and the above-mentioned software programs of the driver layer and the software programs of the HAL layer both run on the processor.
[0115] Related technologies Figure 1 Compared with the fingerprint collection control process shown in the figure, in the embodiment of the present application, when the fingerprint software is processing the touch information of the user's finger, it will detect the voltage state of the INT2 signal of the signal line at this time. Since the INT2 signal is directly operated by the touch screen sensor, it is an electrical signal at the physical level and can be considered to have no delay. The fingerprint software will read the INT2 signal, specifically: if the INT2 signal is at a high level, it means that the user's finger is indeed pressed on the fingerprint collection area, and the user's fingerprint image is collected at this time; if the INT2 signal is at a low level, it means that the user's finger has been lifted up when the fingerprint software processes the touch information, and it cannot be sent to the algorithm for matching, because it is no longer the user's finger fingerprint image, and the user's fingerprint image is not collected at this time.
[0116] It can be seen from the above embodiments that in this embodiment, when the touch screen sensor of the electronic device detects that the touch object touches the screen, it obtains the touch coordinates of the touch object on the screen and sends the touch coordinates to the processor; wherein the pins of the touch screen sensor are connected to the pins of the fingerprint sensor through a signal line; when the processor receives the touch coordinates, it determines whether the touch object touches the fingerprint collection area of the fingerprint sensor according to the touch coordinates, and if so, sets the voltage state of the signal line to the first level and sends a touch signal to the fingerprint sensor; when the touch object does not touch the screen or does not touch the fingerprint collection area of the fingerprint sensor, the processor sets the voltage state of the signal line to the second level, wherein the first level is different from the second level; when the fingerprint sensor receives the touch signal, it reads the voltage state of the signal line, and if the voltage state of the signal line is the first level, the fingerprint image of the touch object is collected; if the voltage state of the signal line is the second level, the fingerprint image collection is stopped.
[0117] It can be seen that in the embodiment of the present application, a physical signal line can be added on the basis of the original hardware structure of the electronic device, and the touch screen sensor and the fingerprint sensor in the electronic device can be connected in hardware through the physical signal line. Since the touch screen sensor and the fingerprint sensor are directly connected through a physical link and the data volume of the level signal is very small, the speed of transmitting the level signal on the physical link is very fast, which is far higher than the transmission speed of the touch signal on the software link. When the fingerprint sensor receives the touch signal transmitted by the HAL layer program, it can determine whether the touch object is actually touching the fingerprint collection area of the fingerprint sensor by reading the level signal transmitted by the physical link. If the level signal transmitted through the physical link determines that the touch object touches the fingerprint collection area of the fingerprint sensor, it means that the touch object did not lift up immediately after touching the fingerprint collection area of the fingerprint sensor, and the fingerprint image of the touch object is collected at this time; if the level signal transmitted through the physical link determines that the touch object does not touch the fingerprint collection area of the fingerprint sensor, it means that the touch object lifted up immediately after touching the fingerprint collection area of the fingerprint sensor, and the fingerprint image of the touch object is not collected at this time. For the situation where the user's finger is lifted up immediately after touching the fingerprint collection area of the fingerprint sensor, it can avoid abnormalities in the collected fingerprint image and improve the fingerprint recognition rate.
[0118] In another embodiment provided in the present application, the fingerprint collection control method provided is: Figure 1 Based on the embodiment shown, the following steps may also be included: step 210 and step 211;
[0119] In step 210, when the touch screen sensor detects that the reset condition of the touch screen sensor is met, the touch screen sensor sends a lift signal to the fingerprint sensor through the processor.
[0120] In the embodiment of the present application, the reset operation of the touch screen sensor refers to the process of restoring the touch screen sensor to its initial state. The condition for triggering the reset operation performed by the touch screen sensor is called the reset condition of the touch screen sensor.
[0121] In the embodiment of the present application, it is considered that the touch screen signal sometimes needs to be reset. For example, when the screen is off, the user's finger touches the fingerprint collection area. If the device is successfully unlocked and enters the desktop system, the touch screen signal may need to be reset to better handle subsequent touch requirements. This is an operation required by the touch screen sensor. Although the user's finger is still touching the fingerprint collection area of the fingerprint sensor at this time, the touch screen sensor will still report an error message that the user's finger has left to the fingerprint software. If the fingerprint software processes this information, it will mistakenly believe that the user's finger has left the fingerprint collection area of the fingerprint sensor. At this time, the base data is collected, resulting in abnormal base data, which in turn affects the unlocking success rate of the fingerprint.
[0122] In step 211, when the fingerprint sensor receives the lift-up signal, it reads the voltage state of the signal line. If the voltage state of the signal line is at the first level, the reference fingerprint image is not collected; if the voltage state of the signal line is at the second level, the reference fingerprint image is collected.
[0123] In the embodiment of the present application, the fingerprint software will detect the voltage state of the signal line when processing the lift signal. Since the voltage state of the signal line is directly operated by the touch screen sensor, it is an electrical signal at the physical level and can be considered to have no delay. If the voltage state of the signal line is high, it means that the touch object is pressed on the fingerprint collection area, and the reference fingerprint image is not collected at this time. If the voltage state of the signal line is low, it means that the touch object has been actually lifted, and the reference fingerprint image is collected at this time.
[0124] It can be seen that in the embodiment of the present application, a physical signal line can be added on the basis of the original hardware structure of the electronic device, and the touch screen sensor and the fingerprint sensor in the electronic device can be connected in hardware through the physical signal line. Since the touch screen sensor and the fingerprint sensor are directly connected through a physical link, and the data volume of the level signal is very small, the speed of transmitting the level signal on the physical link is very fast, which is much faster than the transmission speed of the lift signal on the software link. When the fingerprint sensor receives the lift signal transmitted by the HAL layer program, it can determine whether the touch object is really lifted from the fingerprint collection area of the fingerprint sensor by reading the level signal transmitted by the physical link. If the level signal transmitted by the physical link determines that the touch object is lifted from the fingerprint collection area of the fingerprint sensor, the baseline fingerprint image is collected; if the level signal transmitted by the physical link determines that the touch object is not lifted from the fingerprint collection area of the fingerprint sensor, it means that the touch object is still touching the fingerprint collection area of the fingerprint sensor. At this time, the baseline fingerprint image is not collected, thereby avoiding abnormalities in the collected baseline fingerprint image.
[0125] The fingerprint collection control method provided in the embodiment of the present application can be executed by a fingerprint collection control device. In the embodiment of the present application, the fingerprint collection control device executing the fingerprint collection control method is taken as an example to illustrate the fingerprint collection control device provided in the embodiment of the present application.
[0126] Figure 4 is a structural block diagram of a fingerprint collection control device provided in an embodiment of the present application, which is applied to an electronic device, wherein the electronic device includes a processor, a screen, a touch screen sensor and a fingerprint sensor, and the pins of the touch screen sensor are connected to the pins of the fingerprint sensor through a signal line, such as Figure 4 As shown, the fingerprint collection control device 400 may include: a first processing module 401, a second processing module 402 and a third processing module 403;
[0127] The first processing module 401 is configured to obtain the touch coordinates of the touch object on the screen when the touch screen sensor detects that the touch object touches the screen, and send the touch coordinates to the processor;
[0128] The second processing module 402 is configured to determine, by the processor, whether the touch object touches the fingerprint collection area of the fingerprint sensor according to the touch coordinates when the touch coordinates are received, and if so, set the voltage state of the signal line to the first level and send a touch signal to the fingerprint sensor;
[0129] The second processing module 402 is further configured to set the voltage state of the signal line to a second level through the processor when the touch object does not touch the screen or the fingerprint collection area of the fingerprint sensor, wherein the first level is different from the second level;
[0130] The third processing module 403 is used to read the voltage state of the signal line through the fingerprint sensor when receiving the touch signal. If the voltage state of the signal line is the first level, fingerprint image acquisition is performed on the touch object; if the voltage state of the signal line is the second level, fingerprint image acquisition is stopped.
[0131] It can be seen from the above embodiments that in this embodiment, when the touch screen sensor of the electronic device detects that the touch object touches the screen, it obtains the touch coordinates of the touch object on the screen and sends the touch coordinates to the processor; wherein the pins of the touch screen sensor are connected to the pins of the fingerprint sensor through a signal line; when the processor receives the touch coordinates, it determines whether the touch object touches the fingerprint collection area of the fingerprint sensor according to the touch coordinates, and if so, sets the voltage state of the signal line to the first level and sends a touch signal to the fingerprint sensor; when the touch object does not touch the screen or does not touch the fingerprint collection area of the fingerprint sensor, the processor sets the voltage state of the signal line to the second level, wherein the first level is different from the second level; when the fingerprint sensor receives the touch signal, it reads the voltage state of the signal line, and if the voltage state of the signal line is the first level, the fingerprint image of the touch object is collected; if the voltage state of the signal line is the second level, the fingerprint image collection is stopped.
[0132] It can be seen that in the embodiment of the present application, a physical signal line can be added on the basis of the original hardware structure of the electronic device, and the touch screen sensor and the fingerprint sensor in the electronic device can be connected in hardware through the physical signal line. Since the touch screen sensor and the fingerprint sensor are directly connected through a physical link and the data volume of the level signal is very small, the speed of transmitting the level signal on the physical link is very fast, which is far higher than the transmission speed of the touch signal on the software link. When the fingerprint sensor receives the touch signal transmitted by the HAL layer program, it can determine whether the touch object is actually touching the fingerprint collection area of the fingerprint sensor by reading the level signal transmitted by the physical link. If the level signal transmitted through the physical link determines that the touch object touches the fingerprint collection area of the fingerprint sensor, it means that the touch object did not lift up immediately after touching the fingerprint collection area of the fingerprint sensor, and the fingerprint image of the touch object is collected at this time; if the level signal transmitted through the physical link determines that the touch object does not touch the fingerprint collection area of the fingerprint sensor, it means that the touch object lifted up immediately after touching the fingerprint collection area of the fingerprint sensor, and the fingerprint image of the touch object is not collected at this time. For the situation where the user's finger is lifted up immediately after touching the fingerprint collection area of the fingerprint sensor, it can avoid abnormalities in the collected fingerprint image and improve the fingerprint recognition rate.
[0133] Optionally, as an embodiment, the first processing module 401 is further configured to send a lift signal to the fingerprint sensor through the processor when the touch screen sensor detects that a reset condition of the touch screen sensor is met;
[0134] The third processing module 403 is also used to read the voltage state of the signal line through the fingerprint sensor when receiving the lift-up signal. If the voltage state of the signal line is the first level, the baseline fingerprint image is not collected; if the level state of the signal line is the second level, the baseline fingerprint image is collected.
[0135] Optionally, as an embodiment, the third processing module 403 is further configured to send a fingerprint image to be identified of the touch object collected once to the processor each time the fingerprint image is collected for the touch object through the fingerprint sensor;
[0136] The second processing module 402 is further configured to perform fingerprint recognition on the fingerprint image to be recognized through the processor when the fingerprint image to be recognized is received, and if the recognition fails, send a fingerprint recognition failure signal to the fingerprint sensor; if the recognition succeeds, send a fingerprint recognition success signal to the fingerprint sensor;
[0137] The third processing module 403 is further configured to, when the fingerprint sensor receives the fingerprint recognition failure signal, if the number of times the fingerprint image is collected for the touch object is less than a number threshold, read the voltage state of the signal line; if the voltage state of the signal line is the first level, collect the fingerprint image of the touch object; if the voltage state of the signal line is the second level, stop collecting the fingerprint image; when the fingerprint recognition failure signal is received, if the number of times the fingerprint image is collected for the touch object is the number threshold, stop collecting the fingerprint image; when the fingerprint recognition success signal is received, stop collecting the fingerprint image.
[0138] Optionally, as an embodiment, the third processing module 403 is also used to output a prompt message through the screen when the fingerprint sensor receives the touch signal and the voltage state of the signal line is the second level, wherein the prompt message is used to prompt that the touch input of the touch object is too fast.
[0139] Optionally, as an embodiment, the first level is a high level, and the second level is a low level.
[0140] The fingerprint acquisition control device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (Augmented Reality, AR) / virtual reality (Virtual Reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (Ultra-Mobile Personal Computer, UMPC), a netbook or a personal digital assistant (Personal Digital Assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (Personal Computer, PC), a television (Television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0141] The fingerprint collection control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0142] The fingerprint collection control device provided in the embodiment of the present application can achieve Figure 2 or Figure 3 To avoid repetition, the various processes implemented in the illustrated method embodiment will not be described again here.
[0143] Alternatively, if Figure 5 As shown, the embodiment of the present application also provides an electronic device 500, including a processor 501 and a memory 502, and the memory 502 stores a program or instruction that can be executed on the processor 501. When the program or instruction is executed by the processor 501, the various steps of the above-mentioned fingerprint collection control method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0144] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0145] Figure 6 It is a schematic diagram of the hardware structure of an electronic device implementing various embodiments of the present application.
[0146] The electronic device 600 includes but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a fingerprint sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, and a processor 610.
[0147] Those skilled in the art will appreciate that the electronic device 600 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 610 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0148] The user input unit 607 is used to obtain the touch coordinates of the touch object on the screen when detecting that the touch object touches the screen, and send the touch coordinates to the processor 610;
[0149] The processor 610 is configured to determine whether the touch object touches the fingerprint collection area of the fingerprint sensor 605 according to the touch coordinates when the touch coordinates are received, and if so, set the voltage state of the signal line to the first level and send a touch signal to the fingerprint sensor 605;
[0150] The processor 610 is further configured to set the voltage state of the signal line to a second level when the touch object does not touch the screen or the fingerprint collection area of the fingerprint sensor 605, wherein the first level is different from the second level;
[0151] The fingerprint sensor 605 is used to read the voltage state of the signal line when receiving a touch signal. If the voltage state of the signal line is at a first level, the fingerprint image of the touch object is collected; if the voltage state of the signal line is at a second level, the fingerprint image collection is stopped.
[0152] It can be seen that in the embodiment of the present application, a physical signal line can be added on the basis of the original hardware structure of the electronic device, and the touch screen sensor and the fingerprint sensor in the electronic device can be connected in hardware through the physical signal line. Since the touch screen sensor and the fingerprint sensor are directly connected through a physical link and the data volume of the level signal is very small, the speed of transmitting the level signal on the physical link is very fast, which is far higher than the transmission speed of the touch signal on the software link. When the fingerprint sensor receives the touch signal transmitted by the HAL layer program, it can determine whether the touch object is actually touching the fingerprint collection area of the fingerprint sensor by reading the level signal transmitted by the physical link. If the level signal transmitted through the physical link determines that the touch object touches the fingerprint collection area of the fingerprint sensor, it means that the touch object did not lift up immediately after touching the fingerprint collection area of the fingerprint sensor, and the fingerprint image of the touch object is collected at this time; if the level signal transmitted through the physical link determines that the touch object does not touch the fingerprint collection area of the fingerprint sensor, it means that the touch object lifted up immediately after touching the fingerprint collection area of the fingerprint sensor, and the fingerprint image of the touch object is not collected at this time. For the situation where the user's finger is lifted up immediately after touching the fingerprint collection area of the fingerprint sensor, it can avoid abnormalities in the collected fingerprint image and improve the fingerprint recognition rate.
[0153] Optionally, as an embodiment, the user input unit 607 is further configured to send a lift signal to the fingerprint sensor 605 through the processor 610 when it is detected that the reset condition of the fingerprint sensor 605 is met;
[0154] The fingerprint sensor 605 is also used to read the voltage state of the signal line when receiving the lift signal. If the voltage state of the signal line is at the first level, the reference fingerprint image is not collected; if the voltage state of the signal line is at the second level, the reference fingerprint image is collected.
[0155] Optionally, as an embodiment, the fingerprint sensor 605 is further configured to send a fingerprint image to be identified of the touch object collected to the processor 610 each time the fingerprint image is collected for the touch object;
[0156] The processor 610 is further configured to perform fingerprint recognition on the fingerprint image to be recognized when the fingerprint image to be recognized is received, and if the recognition fails, send a fingerprint recognition failure signal to the fingerprint sensor; if the recognition succeeds, send a fingerprint recognition success signal to the fingerprint sensor;
[0157] The fingerprint sensor 605 is further used for, when receiving the fingerprint recognition failure signal, if the number of times the fingerprint image is collected for the touch object is less than the number threshold, reading the voltage state of the signal line, if the voltage state of the signal line is the first level, collecting the fingerprint image of the touch object, if the voltage state of the signal line is the second level, stopping the fingerprint image collection; when receiving the fingerprint recognition failure signal, if the number of times the fingerprint image is collected for the touch object is the number threshold, stopping the fingerprint image collection; when receiving the fingerprint recognition success signal, stopping the fingerprint image collection.
[0158] Optionally, as an embodiment, the fingerprint sensor 605 is also used to output a prompt message through the screen when the voltage state of the signal line is the second level upon receiving the touch signal, wherein the prompt message is used to prompt that the touch input of the touch object is too fast.
[0159] Optionally, as an embodiment, the first level is a high level and the second level is a low level.
[0160] It should be understood that in the embodiment of the present application, the input unit 604 may include a graphics processor (GPU) 6041 and a microphone 6042, and the graphics processor 6041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The fingerprint sensor 605 is used to collect fingerprint images. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 607 includes a touch panel 6071 and at least one of other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include two parts: a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0161] The memory 609 can be used to store software programs and various data. The memory 609 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 609 may include a volatile memory or a non-volatile memory, or the memory 609 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 609 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0162] The processor 610 may include one or more processing units; optionally, the processor 610 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 610.
[0163] The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned fingerprint collection control method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0164] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0165] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned fingerprint collection control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0166] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0167] The embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the fingerprint collection control method embodiment described above, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0168] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0169] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0170] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. A fingerprint collection control method, characterized in that: Applied to an electronic device, the electronic device includes a processor, a screen, a touch screen sensor and a fingerprint sensor, the pins of the touch screen sensor are connected with the pins of the fingerprint sensor via a signal line, and the method includes: The touch screen sensor, when detecting that a touch object touches the screen, acquires touch coordinates of the touch object on the screen and sends the touch coordinates to the processor; The processor, upon receiving the touch coordinates, determines whether the touch object touches a fingerprint collection area of the fingerprint sensor according to the touch coordinates, and if so, sets the voltage state of the signal line to a first level and sends a touch signal to the fingerprint sensor; The processor, when the touch object does not touch the screen or the fingerprint collection area of the fingerprint sensor, sets the voltage state of the signal line to a second level, wherein the first level is different from the second level; When receiving the touch signal, the fingerprint sensor reads the voltage state of the signal line, and if the voltage state of the signal line is the first level, performs fingerprint image acquisition on the touch object; if the voltage state of the signal line is the second level, stops fingerprint image acquisition.
2. The method according to claim 1, characterized in that The method further comprises: The touch screen sensor sends a lift signal to the fingerprint sensor through the processor when detecting that a reset condition of the touch screen sensor is met; When receiving the lift-up signal, the fingerprint sensor reads the voltage state of the signal line. If the voltage state of the signal line is the first level, the reference fingerprint image is not collected; if the voltage state of the signal line is the second level, the reference fingerprint image is collected.
3. The method according to claim 1, characterized in that The method further comprises: The fingerprint sensor, when collecting a fingerprint image of the touch object, sends a collected fingerprint image of the touch object to be identified to the processor each time the fingerprint image is collected; The processor, upon receiving the fingerprint image to be identified, performs fingerprint identification on the fingerprint image to be identified, and if the identification fails, sends a fingerprint identification failure signal to the fingerprint sensor, and if the identification succeeds, sends a fingerprint identification success signal to the fingerprint sensor; The fingerprint sensor, when receiving the fingerprint recognition failure signal, reads the voltage state of the signal line if the number of times the fingerprint image is collected for the touch object is less than the number threshold, and collects the fingerprint image for the touch object if the voltage state of the signal line is the first level, and stops collecting the fingerprint image if the voltage state of the signal line is the second level; The fingerprint sensor, when receiving the fingerprint recognition failure signal, stops collecting fingerprint images if the number of times of collecting fingerprint images of the touch object reaches a number threshold; The fingerprint sensor stops collecting fingerprint images when receiving the fingerprint recognition success signal.
4. The method according to claim 1, characterized in that: The method further comprises: The fingerprint sensor, when receiving the touch signal, outputs prompt information through the screen if the voltage state of the signal line is the second level, wherein the prompt information is used to prompt that the touch input of the touch object is too fast.
5. The method according to any one of claims 1 to 4, characterized in that: The first level is a high level, and the second level is a low level.
6. A fingerprint collection control device, characterized in that: Applied to an electronic device, the electronic device includes a processor, a screen, a touch screen sensor and a fingerprint sensor, the pins of the touch screen sensor are connected with the pins of the fingerprint sensor via a signal line, and the device includes: A first processing module, configured to obtain, through the touch screen sensor, touch coordinates of the touch object on the screen when the touch object touches the screen, and send the touch coordinates to the processor; A second processing module, configured to determine, by the processor, whether the touch object touches the fingerprint collection area of the fingerprint sensor according to the touch coordinates when the touch coordinates are received, and if so, set the voltage state of the signal line to a first level and send a touch signal to the fingerprint sensor; The second processing module is further configured to set the voltage state of the signal line to a second level through the processor when the touch object does not touch the screen or the fingerprint collection area of the fingerprint sensor, wherein the first level is different from the second level; The third processing module is used to read the voltage state of the signal line when the fingerprint sensor receives the touch signal, and if the voltage state of the signal line is the first level, perform fingerprint image acquisition on the touch object; if the voltage state of the signal line is the second level, stop fingerprint image acquisition.
7. The device according to claim 6, characterized in that The first processing module is further configured to send a lift signal to the fingerprint sensor through the processor when the touch screen sensor detects that a reset condition of the touch screen sensor is met; The third processing module is further configured to read the voltage state of the signal line through the fingerprint sensor when receiving the lift-up signal, and if the voltage state of the signal line is the first level, not collect the reference fingerprint image; If the level state of the signal line is the second level, a reference fingerprint image is collected.
8. The device according to claim 6, characterized in that The third processing module is further configured to send a fingerprint image to be identified of the touch object collected by the fingerprint sensor to the processor each time the fingerprint image is collected; The second processing module is further configured to perform fingerprint recognition on the fingerprint image to be recognized through the processor when the fingerprint image to be recognized is received, and if the recognition fails, send a fingerprint recognition failure signal to the fingerprint sensor; if the recognition succeeds, send a fingerprint recognition success signal to the fingerprint sensor; The third processing module is further configured to, when the fingerprint sensor receives the fingerprint recognition failure signal, if the number of times the fingerprint image is collected for the touch object is less than a number threshold, read the voltage state of the signal line; if the voltage state of the signal line is the first level, collect the fingerprint image of the touch object; if the voltage state of the signal line is the second level, stop collecting the fingerprint image; when the fingerprint recognition failure signal is received, if the number of times the fingerprint image is collected for the touch object is the number threshold, stop collecting the fingerprint image; when the fingerprint recognition success signal is received, stop collecting the fingerprint image.
9. The device according to claim 6, characterized in that The third processing module is further configured to output a prompt message through the screen when the fingerprint sensor receives the touch signal and the voltage state of the signal line is the second level, wherein the prompt message is configured to prompt that the touch input of the touch object is too fast.
10. The device according to any one of claims 6 to 9, characterized in that: The first level is a high level, and the second level is a low level.
11. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the fingerprint collection control method according to any one of claims 1 to 5 are implemented.