A method and system for confirming identity
By combining fingerprint and infrared information identification, the problem of the inability to distinguish between living and non-living bodies in the prior art is solved, and the safety of identity confirmation is improved, ensuring the safety of vehicle and driving safety.
Patent Information
- Application Number
- CN201911330006.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-12-20
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2039-12-20
AI Technical Summary
Existing biometric identity confirmation equipment cannot effectively distinguish between living and inactive, and has safety risks and is difficult to apply to equipment with high safety requirements such as vehicle verification.
Combined with fingerprint information identification and infrared information identification, comprehensive judgment is made through fingerprint information identification results and infrared information identification results to determine whether the user is alive and improve the security of identity confirmation.
Effectively prevent illegal personnel from stealing biometric information, improve the safety of vehicles, and ensure that only living users can confirm their identity, reducing the risks of theft and driving safety.
Smart Images

Figure CN113011233B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of security, and in particular to an identity confirmation method and system. Background Art
[0002] With the continuous development of the Internet and communication technology, biometric information (such as fingerprints and faces) has been widely used in user identity authentication. The current identity confirmation equipment only confirms the identity of the user based on biometric information, but cannot determine whether the carrier carrying the biometric information is alive. Illegal personnel can steal the user's biometric information (for example, make a fake finger, fingerprint film or fingerprint cover) for identity confirmation, which poses certain security risks. For this reason, biometric information is difficult to apply to equipment with higher security requirements, such as vehicle verification. Therefore, the present application provides a method and system for identity confirmation that can be used on vehicles with higher security. Summary of the invention
[0003] One embodiment of the present invention provides an identity confirmation method. The identity confirmation method includes: obtaining fingerprint information of a user under test; determining a fingerprint information recognition result based on the fingerprint information; obtaining infrared information of the user under test; determining an infrared information recognition result based on the infrared information; and determining a detection result of the user under test based on the fingerprint information recognition result and the infrared information recognition result.
[0004] One of the embodiments of the present invention provides an identity confirmation system. The identity confirmation system includes a first recognition unit, the first recognition unit is used to obtain fingerprint information of a user under test, and determine a fingerprint information recognition result based on the fingerprint information; a second recognition unit, the second recognition unit is used to obtain infrared information of the user under test, and determine an infrared information recognition result based on the infrared information; and a determination unit, the determination unit is used to determine a detection result of the user under test based on the fingerprint information recognition result and the infrared information recognition result.
[0005] One of the embodiments of the present invention provides an automobile, including an identity confirmation device, wherein the identity confirmation device includes at least one processor and at least one storage device, wherein the storage device is used to store instructions, and when the at least one processor executes the instructions, the identity confirmation device executes an identity confirmation method, and the identity confirmation device is installed on at least one of the following automobile mechanisms: an automobile door, an automobile door handle, an automobile engine switch, or an automobile steering wheel. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] The present application will be further described in the form of exemplary embodiments, which will be described in detail by way of the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:
[0007] Figure 1 is a schematic diagram of an application scenario of an identity confirmation system according to some embodiments of the present application;
[0008] Figure 2 is a schematic diagram of exemplary hardware and / or software of an identity confirmation device according to some embodiments of the present application;
[0009] Figure 3 is an exemplary flow chart of an identity confirmation method according to some embodiments of the present application;
[0010] Figure 4 is an exemplary flow chart of living body recognition according to some embodiments of the present application;
[0011] Figure 5A is a cross-sectional view of an identity confirmation device according to some embodiments of the present application;
[0012] Figure 5B is a top view of an identity confirmation device according to some embodiments of the present application;
[0013] Figure 6 This is an application scenario diagram of applying an identity confirmation device to a car door according to some embodiments of the present application;
[0014] Figure 7 is an application scenario diagram of applying the identity confirmation device to the start button and steering wheel of a car according to some embodiments of the present application; and
[0015] Figure 8 It is a graph of received signals of a human finger and a simulated finger according to some embodiments of the present application. DETAILED DESCRIPTION
[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of the present application. For those of ordinary skill in the art, the present application can also be applied to other similar scenarios based on these drawings without creative work. It should be understood that these exemplary embodiments are provided only to enable technicians in the relevant fields to better understand and implement the present invention, and are not intended to limit the scope of the present invention in any way. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.
[0017] It should be understood that the "system", "device", "unit", "module" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.
[0018] As shown in this application and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprises" and "includes" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.
[0019] Although the present application makes various references to certain modules or units in the system according to the embodiments of the present application, any number of different modules or units can be used and run on the client and / or server. The modules are illustrative only, and different aspects of the system and method can use different modules.
[0020] Flowcharts are used in the present application to illustrate the operations performed by the system according to the embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed accurately in order. On the contrary, the various steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.
[0021] One of the embodiments of the present application relates to an identity confirmation method and system. The identity confirmation system can be applied to vehicles, such as cars, bicycles, battery cars, motorcycles, cruise ships, buses, trains, light rails, and trams. For example, it can be installed on the handlebars (or door locks) of cars, the engine switches (or start buttons) of cars, and the steering wheels of cars. The present application takes cars as an example, but it should be understood that the present application can also be applied to other types of vehicles, which are not limited here. On the one hand, the identity confirmation system can retrieve the fingerprint information of the user being tested in a pre-stored user fingerprint information library to determine the identity of the user being tested. On the other hand, the identity confirmation system can determine whether the user being tested is alive based on the infrared light intensity of the infrared light received by the photoelectric receiver. When the system is applied to the door lock or the vehicle start button, it can prevent illegal personnel from stealing the user's fingerprint and making a fingerprint film or fingerprint sticker, opening the door, starting the car and stealing the car, thereby improving the safety of the vehicle. When the system is applied to the steering wheel of a car, when the user holds the steering wheel, the system can detect the user's vital signs (blood oxygen, heart rate, etc.) to prevent sudden death and other heart diseases from occurring during driving, which may cause serious consequences. When the system is set on the steering wheel of a car, if the user is driving the vehicle and it is found that the user has a heart disease such as sudden death based on the detected vital signs (blood oxygen, heart rate, etc.), a voice reminder and / or telephone alarm can be issued, and the vehicle can be safely parked or continue to drive to the destination or hospital in combination with automatic driving technology. In addition, when the system is set on the steering wheel of a car, the system can also detect whether the user's hands are off the steering wheel to monitor whether the user's driving behavior is safe. By applying this system in the automotive field, the safety of car driving is improved.
[0022] Figure 11 is a schematic diagram of an application scenario of an identity confirmation system according to some embodiments of the present application. The identity confirmation system 100 may include a server 110, a network 120, an identity confirmation device 130, and a user terminal 140. The identity confirmation system 100 may obtain the user's identity confirmation information (such as fingerprint information, infrared recognition information, etc.) and complete the confirmation of the user's identity based on the user's identity confirmation information. After confirming the user's identity, corresponding operations may be performed based on the user's identity. For example, the identity confirmation system 100 may be applied to a car door (such as a car door lock, a car handle, etc.). Based on the user's identity confirmation information, it may be determined whether the user is allowed to open the car door. Further, if it is determined that the user is allowed to open the car door, the identity confirmation system 100 may control the car door to be unlocked. In some embodiments, after the car door lock is unlocked, the user may open the car door by himself. In some other embodiments, after the car door lock is unlocked, the identity confirmation system 100 may control the car door to open automatically. For another example, the identity confirmation system 100 may be applied to a car engine switch (or a start button). Based on the user's identity confirmation information, it may be determined whether the user's identity confirmation information exists in a database corresponding to the car. Based on a photoelectric receiver (such as Figure 5AOr the infrared light intensity of the infrared light received by the photoelectric receiver 520 in 5B) determines whether the user being tested is alive. Further, if the user's identity confirmation information exists in the database corresponding to the car and the user being tested is alive, the identity confirmation system 100 can start the car. In some embodiments, when performing liveness detection, it can also be determined whether the user's vital signs meet the driving needs, for example, whether there is a serious heart disease, whether there is a sudden acceleration or deceleration of the heartbeat (for example, there is the possibility of drunk driving or drug driving), whether there is a low blood oxygen concentration (such as fatigue driving), etc. Only when the user's vital signs meet the driving needs can the engine be started, avoiding the user from starting the car when the physical condition is poor, further ensuring the safety of driving. For another example, the identity confirmation system 100 can be applied to the steering wheel of a car. According to the infrared light intensity of the infrared light received by the photoelectric receiver, the user's vital signs (blood oxygen, heart rate, etc.) can be calculated to prevent sudden death and other heart diseases from occurring during driving and causing serious consequences. If, while the user is driving the vehicle, it can be determined based on the detected vital signs of the user (blood oxygen, heart rate, etc.) that the user has suffered from a heart disease such as sudden death, an alarm can be issued, and the vehicle can be safely parked or continued to drive to the destination or hospital in combination with autonomous driving technology. While the user is driving the vehicle, the intensity of the infrared light received by the photoelectric receiver can also be used to detect whether the user's fingers are off the steering wheel to monitor whether the user's driving behavior is safe. For another example, the identity confirmation system 100 can be applied to various types of transportation equipment (e.g., cars, bicycles, battery cars, motorcycles, cruise ships, buses, trains, light rail, trams, etc.). Based on the user's identity confirmation information, it can be determined whether the user is the owner or current lessee of the transportation equipment, and then determine whether to unlock the transportation equipment and / or start the transportation equipment. The characteristics of living and non-living objects and methods for distinguishing them can be found in Figure 8 and its description. The method of obtaining the user's vital signs information from the infrared light intensity curve can also be found in Figure 8 It should be noted that the identity confirmation system 100 can also be applied to other devices, scenarios and applications that require identity confirmation, without limitation, and any device, scenario and / or application that can use the identity confirmation method included in this application is within the scope of protection of this application.
[0023] In some embodiments, the server 110 can be used to process information and / or data related to determining the identity of the user. For example, the server 110 can process the identity confirmation information of the user in the identity confirmation device 130, and complete the confirmation of the user's identity based on the identity confirmation information. In some embodiments, the identity confirmation information may include fingerprint recognition information and infrared recognition information. For another example, the server 110 can compare and match the user identity confirmation information obtained from the identity confirmation device 130 with the pre-stored user identity confirmation information to confirm the identity of the user. For another example, the server 110 can generate an instruction to control the identity confirmation device 130 based on the confirmation result of the user's identity. The server 110 can be an independent server or a server group. The server group can be centralized or distributed (e.g., the server 110 can be a distributed system).
[0024] In some embodiments, the server 110 may be regional or remote. For example, the server 110 may access information and / or data stored in the identity confirmation device 130 and the user terminal 140 through the network 120. In some embodiments, the server 110 may be directly connected to the identity confirmation device 130 and the user terminal 140 to access the information and / or data stored therein. For example, the server 110 may be located in the identity confirmation device 130 or directly connected to the identity confirmation device 130. In some embodiments, the server 110 may be executed on a cloud platform. For example, the cloud platform may include one or any combination of a private cloud, a public cloud, a hybrid cloud, a community cloud, a decentralized cloud, an internal cloud, etc.
[0025] In some embodiments, the server 110 may include a processing device. The processing device may process data and / or information related to identity confirmation to perform one or more functions described in the present application. For example, the processing device may receive an identity confirmation request signal sent by the identity confirmation device 130 or the user terminal 140, and send a control instruction to the identity confirmation device 130. For another example, the processing device may obtain the identity confirmation information collected by the identity confirmation device 130, and send the confirmation result of the user identity to the user terminal 140. In some embodiments, the processing device may include one or more sub-processing devices (e.g., a single-core processing device or a multi-core multi-core processing device). As an example only, the processing device may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction processor (ASIP), a graphics processing unit (GPU), a physical processing unit (PPU), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic circuit (PLD), a controller, a microcontroller unit, a reduced instruction set computer (RISC), a microprocessor, etc., or any combination thereof.
[0026] The network 120 can facilitate the exchange of data and / or information in the identity confirmation system 100. In some embodiments, one or more components in the identity confirmation system 100 (e.g., the server 110, the identity confirmation device 130, the user terminal 140) can send data and / or information to other components in the identity confirmation system 100 through the network 120. For example, the identity confirmation information collected by the identity confirmation device 130 can be transmitted to the server 110 through the network 120. For another example, the confirmation result of the user identity in the server 110 can be transmitted to the user terminal 140 through the network 120. In some embodiments, the network 120 can be any type of wired or wireless network. For example, the network 120 can include a cable network, a wired network, a fiber optic network, a telecommunications network, an intranet, an internet network, a local area network (LAN), a wide area network (WAN), a wireless area network (WLAN), a metropolitan area network (MAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, a near field communication (NFC) network, etc. or any combination thereof. In some embodiments, the network 120 can include one or more network entry and exit points. For example, the network 120 may include wired or wireless network access points, such as base stations and / or Internet exchange points 120-1, 120-2, ..., through which one or more components of the identity confirmation system 100 may connect to the network 120 to exchange data and / or information.
[0027] The identity confirmation device 130 can obtain the identity confirmation information of the user and confirm the identity of the user according to the identity confirmation information. After confirming the identity of the user, corresponding operations can be performed according to the identity of the user. In some embodiments, the identity confirmation device 130 can obtain the vital signs information (blood oxygen, heart rate, etc.) of the measured user according to the infrared light intensity of the infrared light received by the photoelectric receiver, and determine whether the measured user is alive. In some embodiments, the identity confirmation device 130 can retrieve the fingerprint information of the measured user in the pre-stored user fingerprint information library to determine the identity of the measured user. In some embodiments, the identity confirmation device 130 can be applied to a car 130-1, a motorcycle 130-2, and a bicycle 130-3. For example, when the identity confirmation device 130 is set on the door of the car 130-1, the identity confirmation device 130 can determine whether the user is allowed to open the car door according to the user's identity confirmation information and the user's live information. When the user's identity confirmation information passes through the identity confirmation device 130 and the identity confirmation device 130 detects that the user is alive, the door lock on the car 130-1 is unlocked, and the user is allowed to open the door. In some embodiments, by category, the door lock may include a push-button door lock, a dial door lock, an electronic key door lock, a touch door lock, a password identification door lock, a remote control door lock, a card identification door lock (such as a magnetic card, an IC card), a biometric door lock (such as a fingerprint, a finger vein, a palm print, a face, a voice, an iris, a retina), etc., or any combination thereof. For another example, when the identity confirmation device 130 is set at the start switch (such as a start button) of the car 130-1, the identity confirmation device 130 can determine whether to allow the user to turn on the start switch of the car 130-1 based on the user's identity confirmation information and the information on whether the user is alive. Only when the user's identity confirmation information and the user's live body information are both passed through the identity confirmation device 130, the user can start the engine when pressing the start switch. For another example, when the identity confirmation device 130 is set on the steering wheel of the car 130-1, if the user is driving the vehicle, according to the detected vital signs of the user (blood oxygen, heart rate, etc.), it is found that the user has a heart disease such as sudden death, an alarm can be issued, and the vehicle can be safely parked or continued to drive to the destination or hospital in combination with the automatic driving technology. For another example, when the identity confirmation device 130 is applied to a motorcycle 130-2 or a bicycle 130-3, the motorcycle 130-2 or the bicycle 130-3 can be a private transportation device or a shared transportation device (such as a shared bicycle). According to the user's identity confirmation information, it can be determined whether the user is the owner or current renter of the transportation device, and then determine whether to open the lock and / or start the transportation device. When the identity confirmation device 130 on the motorcycle 130-2 or the bicycle 130-3 successfully confirms the user's identity confirmation information, the motorcycle 130-2 or the bicycle 130-3 can be unlocked or started.
[0028] Figure 2 Schematic diagram of exemplary hardware and / or software of an identity confirmation device according to some embodiments of the present application. Figure 2 As shown, the identity confirmation device 130 may include a first recognition unit 210 (also referred to as an identity recognition unit) and a second recognition unit 220 (also referred to as a living body recognition unit).
[0029] The first identification unit 210 can be used to obtain the user's identity information and can determine the identity result based on the identity information. The identity information may include one or more of fingerprints, palm prints, finger veins, sounds, irises or faces. The following description takes fingerprints as an example, but the identity information should not be limited to fingerprint information. The first identification unit 210 may include a first information acquisition subunit 211 and a first information processing subunit 212. The first information acquisition subunit 211 can be used to obtain the user's fingerprint information. In some embodiments, the first information acquisition subunit 211 may include a fingerprint collector, etc. In some embodiments, the identity confirmation device 130 for a car may include multiple first identification units 210.
[0030] The first information processing subunit 212 may be used to determine a fingerprint recognition result based on the fingerprint information. In some embodiments, determining the fingerprint information recognition result may include retrieving the fingerprint information from a pre-stored fingerprint information set, and determining the fingerprint information recognition result based on the retrieval result. When the fingerprint information is retrieved or matched from the pre-stored fingerprint information set, the fingerprint information recognition result is passed (i.e., the user identity recognition is passed).
[0031] The second recognition unit 220 can be used to obtain the user's live body recognition information and determine the live body recognition result according to the live body recognition information. In some embodiments, the live body recognition information may include the user's infrared information, blood oxygen information (which can also be obtained through infrared information), heart rate information, finger vein information, facial information, etc., or any combination thereof. The following description takes infrared information as an example, but it should not be limited to infrared information only. The infrared information is information obtained by a group of infrared light emitting elements and photoelectric receivers through reflection of the user's living tissue. Specifically, the infrared light emitting element can emit infrared light, which can be reflected by the user's living tissue (such as a finger), and the reflected infrared light can be received by the photoelectric receiver. The received infrared signal can be converted into an electrical signal and used to determine whether the user is alive. Infrared information can refer to the received infrared signal (or the converted electrical signal). The second recognition unit 220 may include a second information acquisition subunit 221 and a second information processing subunit 222. The second information acquisition subunit 221 can be used to obtain the user's infrared information. The second information processing subunit 222 can determine the infrared information recognition result according to the infrared information. The second information acquisition subunit 221 may include an infrared light emitting element and a photoelectric receiver.
[0032] In some embodiments, the identity confirmation device 130 may further include a wake-up unit 230. The wake-up unit 230 may be used to wake up the elements (e.g., the first identification unit 210, the second identification unit 220) in the identity confirmation system 100 or the identity confirmation device 130 from sleep or standby mode. In some embodiments, the wake-up mode of the wake-up unit 230 may include contact wake-up and non-contact wake-up. Contact wake-up may include mechanical switch wake-up (e.g., key switch wake-up, spring-type pressure switch wake-up), touch wake-up (e.g., pressure sensor wake-up, capacitive sensor wake-up). Non-touch wake-up may include sound wake-up (e.g., sound sensor), infrared proximity wake-up (e.g., infrared proximity sensor, infrared proximity switch), etc., or any combination thereof. As an example only, the wake-up unit 230 may be a key switch, the mechanical position or stroke of which changes under the action of external pressure, and the control circuit of the identity confirmation system 100 or the identity confirmation device 130 is connected, thereby achieving the purpose of wake-up or activation. For another example, the wake-up unit 230 may be a pressure sensor, which may sense a pressure signal, convert the pressure signal into an electrical signal, and then transmit it to the vehicle controller. When the electrical signal is greater than a certain threshold, the automobile controller can control the first identification unit 210 and / or the second identification unit 220 to enter a working state. For another example, the wake-up unit 230 can be a capacitive sensor, and the capacitance of the capacitive sensor will change under the action of the measured user (for example, touch, press, slide). The wake-up unit 230 can convert the signal of the change in capacitance into an electrical signal and transmit it to the automobile controller. When the electrical signal is greater than a certain threshold, the automobile controller can control the first identification unit 210 and / or the second identification unit 220 to enter a working state.
[0033] In some embodiments, the identity confirmation device 130 may further include a determination unit 240. The determination unit may determine the detection result of the user based on the fingerprint identification information recognition result and the infrared information recognition result.
[0034] It should be noted that the above description of the identity recognition device 130 is only for convenience of description, and one or more embodiments of this specification cannot be limited to the scope of the embodiments. It can be understood that for those skilled in the art, after understanding the principle of the identity recognition device 130, it is possible to arbitrarily combine the various units without deviating from this principle, or omit one or more of the units. In some embodiments, the wake-up unit 230 can be omitted. For example, the first recognition unit 210 and the second recognition unit 220 can be in a working state all the time without the need for the wake-up unit 230 to wake up. In some embodiments, the wake-up unit 230 can be merged with the first recognition unit 210 or the second recognition unit 220. For example, the wake-up unit 230 is merged with the first recognition unit 210, and the wake-up unit 230 activates the first recognition unit 210 after obtaining the wake-up signal. For another example, the wake-up unit 230 is merged with the second recognition unit 220, and the wake-up unit 230 activates the second recognition unit 220 after obtaining the wake-up signal. For another example, the above modules can share a storage module, and each module can also have its own storage module. Such variations are within the protection scope of one or more embodiments of this specification.
[0035] Figure 3 is an exemplary flow chart of an identity recognition method according to some embodiments of the present application. In some embodiments, Figure 3 The process 300 of the identity recognition method shown in FIG. 1 may be performed by the identity confirmation device 130. In some embodiments, the identity confirmation device 130 may be disposed on a vehicle. Figure 3 As shown, the process 300 of the identity recognition method may include:
[0036] In step 310, a wake-up signal from the user being measured is received. This step 310 can be performed by the wake-up unit 230. The wake-up unit 230 can wake up the elements in the identity confirmation system 200 (for example, the first recognition unit 210, the second recognition unit 220) from the sleep or standby mode. In some embodiments, the wake-up mode of the wake-up unit 230 may include contact wake-up and non-contact wake-up. Contact wake-up may include mechanical switch wake-up (for example, key switch wake-up, spring pressure switch wake-up), touch wake-up (for example, pressure sensor wake-up, capacitive sensor wake-up). Non-touch wake-up may include sound wake-up, infrared proximity wake-up, etc., or any combination thereof. In the embodiments of this specification, the wake-up signal can be used to wake up the first recognition unit 210 or / and the second recognition unit 220. For example, when the user being measured acts (for example, touches, presses, slides) on the area corresponding to the capacitive sensor, the capacitance change value of the capacitive sensor can be used as a wake-up signal. For another example, when the wake-up unit 230 is a pressure sensor, when the user being measured presses the area corresponding to the pressure sensor, the pressure signal of the pressure sensor can be used as a wake-up signal. For another example, when the wake-up unit 230 is a sound sensor, when an external sound acts on the sound sensor (such as a microphone), a capacitance change signal of the sound sensor can be used as a wake-up signal. For another example, when the wake-up unit 230 is a speech recognition system, a pre-set sound sentence can be used as a wake-up signal.
[0037] Step 320 , obtaining fingerprint information of the user being tested. Step 320 may be performed by the first information obtaining subunit 211 .
[0038] Fingerprint identification information can be information used to reflect the user's identity (also referred to as identity identification information). In some embodiments, the fingerprint information in step 320 can also be replaced by other identity identification information, such as one or more of palm prints, finger veins, voice, iris or face.
[0039] In step 330, a fingerprint information recognition result is determined based on the fingerprint information. This step 230 may be performed by the first information processing subunit 312. In some embodiments, the fingerprint information recognition result may include that the user fingerprint information recognition is passed (i.e., the identity recognition is passed) or the user fingerprint information recognition is not passed (i.e., the identity recognition is not passed).
[0040] In some embodiments, determining the fingerprint information recognition result may include retrieving the fingerprint recognition information in a pre-stored fingerprint recognition information set, and determining the fingerprint information recognition result based on the retrieval result. When the fingerprint recognition information is retrieved or matched in the pre-stored fingerprint recognition information set, the fingerprint information recognition result is that the user identity recognition is passed. For example, the fingerprint information of the tested user acquired by the first information acquisition subunit 211 is retrieved and matched with the fingerprint information in the pre-stored fingerprint recognition information set. If the corresponding fingerprint information is matched in the pre-stored fingerprint recognition information set, the user fingerprint information recognition is passed. When the fingerprint recognition information is not retrieved or matched in the pre-stored fingerprint recognition information set, the fingerprint information recognition result is that the user fingerprint information recognition is not passed. The fingerprint recognition information acquired by the first information acquisition subunit 211 can be transmitted to the first information processing subunit 212 through the network 120, and the pre-stored fingerprint recognition information set can be located in the hard disk or memory of the first information processing subunit 212.
[0041] In step 340, infrared information of the user under test is obtained. This step 340 may be performed by the second information acquisition subunit 221. In some embodiments, the infrared information in step 340 may also be replaced by other living body recognition information, such as one or more of blood oxygen, heart rate, finger vein or facial information.
[0042] In step 350, the infrared information recognition result is determined according to the infrared information. This step 350 may be performed by the second information processing subunit 222. The infrared information acquired by the second information acquisition subunit 221 may be transmitted to the second information processing subunit 222 via the network 120.
[0043] In some embodiments, the infrared information recognition result may include infrared information recognition passing (i.e., user liveness recognition passing) or infrared information recognition failing (i.e., user liveness recognition failing). In some embodiments, determining the infrared information recognition result based on the infrared information may include: comparing the infrared information (also referred to as liveness recognition information) with liveness detection conditions, and determining the infrared information recognition result based on the comparison result. For a specific method of comparing infrared information with liveness detection conditions, see Figure 4 Step 430 and its description in .
[0044] In step 360 , based on the fingerprint information recognition result and the infrared information recognition result, the detection result of the user is determined. This step 360 may be performed by the determination unit 240 .
[0045] In some embodiments, based on the fingerprint information recognition result and the infrared information recognition result, determining the user's test result may include the following situations: (1) When the fingerprint information recognition result is that the user identity recognition is passed and the infrared information recognition result is that the user live recognition is passed, the user's test result is determined to be passed. (2) When the fingerprint information recognition result is that the user identity recognition is not passed and the infrared information recognition result is that the user live recognition is not passed, the test result of the tested user is determined to be not passed. (3) When the fingerprint information recognition result is that the user identity recognition is passed and the infrared information recognition result is that the user live recognition is not passed, the test result of the tested user is determined to be not passed. (4) Or when the fingerprint information recognition result is that the user identity recognition is not passed and the infrared information recognition result is that the user live recognition is passed, the test result of the tested user is determined to be not passed. In some embodiments, in the second, third, and fourth situations, although the test results are all not passed, the subsequent operations may be different.
[0046] Alternatively, when there are multiple identity recognition information, identity recognition passing may mean that the number of identity recognition information passed by the subject to be tested is greater than a certain threshold. Similarly, when there are multiple liveness recognition information, liveness recognition passing may mean that the number of liveness recognition information passed by the subject to be tested is greater than a certain threshold.
[0047] Figure 4 is an exemplary flow chart of liveness recognition according to some embodiments of the present application. Process 400 is a modified embodiment after 320 and 340 in process 300 are implemented in sequence. Among them, 410 to 430 are specific embodiments of 340 and 350 in process 300. After 440 is executed, 320 and 330 can be continued. Figure 4 As shown, process 400 may include:
[0048] In step 410, infrared light is emitted to the user under test. The infrared light may be emitted by a light emitting element. Preferably, the wavelength of the infrared light may be 830nm to 950nm. More preferably, the wavelength of the infrared light may be 850nm or 940nm.
[0049] In some embodiments, the light-emitting element may also be a light-emitting diode of other wavelengths to emit other invisible light with a wavelength less than 380nm or greater than 760nm (for example, ultraviolet light, far infrared light) or visible light with a wavelength between 380 and 780nm (for example, red light, orange light, yellow light, green light, cyan light, blue light, purple light, white light, etc.) to the user being tested.
[0050] In step 420, infrared light reflected by the detected user is received. The infrared light can be received by a photoelectric receiver.
[0051] It should be noted that the photoelectric receiver can convert the received optical signal into an electrical signal, and the electrical signal will change with the change of the intensity of the optical signal. It should be noted that when infrared light is irradiated on the human finger, the blood oxygen in the finger will absorb part of the infrared light, and the blood oxygen concentration in the finger tissue will change regularly. The regular change of blood oxygen concentration will directly lead to the regular change of the amount of infrared light absorbed by blood oxygen. If the user being measured is a non-living body, the infrared light will not be absorbed by the non-living body or the amount of infrared light absorption is constant, or the amount of infrared light absorption changes irregularly. Therefore, the curve formed by the infrared light intensity of the infrared light reflected by the non-living body is a constant straight line or an irregular curve, while the infrared light intensity of the infrared light reflected by the living body is a regular curve. The detection time period can be set according to the specific situation and is not limited here. More specifically, different objects will cause different signal attenuation due to different reflectivity of the material. For example, the reflectivity of the material of the lower-end fingerprint film / fingerprint cover may be very different from the reflectivity of human tissue. This leads to a great difference in the intensity of the infrared light after they are reflected. By comparing the intensity (average value) of the reflected infrared light with a preset threshold, it is possible to distinguish whether the object to be tested is human tissue. For another example, the reflectivity of the material of a higher-end fingerprint film / fingerprint cover may be similar to that of human tissue. However, the blood oxygen concentration of a living body will change periodically due to the heart and pulse. Due to the absorption of infrared light by blood oxygen in human tissue and the diffuse reflection characteristics of infrared light itself, the absorption of infrared light by blood oxygen will also change with the change of blood oxygen concentration, resulting in periodic fluctuations in the intensity of the reflected infrared light. This fluctuation is not even available in higher-end fingerprint films / fingerprint covers whose materials are similar to human tissue. By comparing the fluctuation value (difference between the maximum and minimum values) or the maximum slope of the reflected infrared light with a preset threshold, it is possible to distinguish whether the object to be tested is a living body. In addition, the periodic fluctuation of blood oxygen concentration can also reflect the changes in the human heart rate. By analyzing the reflected infrared light, vital signs such as the human heart rate can be obtained.
[0052] In step 430, it can be determined whether the infrared light intensity (ie, infrared information) of the infrared light reflected by the detected user meets a preset living body detection condition.
[0053] In some embodiments, determining whether the infrared light intensity of the infrared light reflected by the measured user meets the preset living body detection condition may include determining whether the infrared light intensity of the infrared light reflected by the measured user is within a preset intensity interval. For example, the preset intensity interval has an upper limit value and a lower limit value. If the infrared light intensity of the infrared light reflected by the measured user is greater than or equal to the lower limit value and less than or equal to the lower limit value, the measured user is determined to be a living body. If the infrared light intensity of the infrared light reflected by the measured user is less than the lower limit value or greater than the upper limit value, the measured user is a non-living body. In some embodiments, the infrared light intensity of the infrared light reflected by the measured user may include an average value, a maximum value, or a minimum value of the infrared light intensity, or any combination thereof. Further, one or more of the average value and the maximum value of the infrared light intensity of the infrared light reflected by the measured user may be compared with a preset intensity interval. In some embodiments, the difference between the maximum value and the minimum value of the infrared light intensity of the infrared light emitted by the measured user may be compared with a preset intensity interval. If the difference between the maximum and minimum values of the infrared light intensity of the infrared light emitted by the user under test is within the preset intensity range, the user under test is alive. If the difference between the maximum and minimum values of the infrared light intensity of the infrared light emitted by the user under test is less than the preset intensity range, the user under test may be non-live. Specifically, if the difference between the maximum and minimum values of the infrared light intensity of the infrared light emitted by the user under test is greater than the preset intensity range, the user under test may be non-live or the user under test may not perform a standard operation during liveness detection.
[0054] In some embodiments, whether the infrared light intensity of the infrared light reflected by the detected user meets the preset living body detection condition may also include whether the curve of the infrared light intensity of the infrared light reflected by the detected user changing with time during the detection time period conforms to the preset curve. More specifically, conforming to the preset curve may mean that the change trend of the curve of the infrared light intensity of the reflected infrared light changing with time conforms to the change trend of the preset curve.
[0055] In some embodiments, it is possible to determine whether a curve of the infrared light intensity of the infrared light reflected by the measured user changing over time conforms to a pre-set curve by comparing whether the similarity of the curves conforms to a similarity threshold. In some embodiments, if the similarity between the curve of the infrared light intensity of the infrared light reflected by the measured user changing over time and the pre-set curve is greater than or equal to the similarity threshold, the measured user is a living body. If the similarity between the curve of the infrared light intensity of the infrared light reflected by the measured user changing over time and the pre-set curve is less than the similarity threshold, the measured user is a non-living body. For example, just as an exemplary illustration, the similarity threshold is 80%, if the similarity between the above two curves is greater than or equal to 80%, the measured user is a living body. If the similarity between the above two curves is less than 80%, the measured user is a non-living body.
[0056] In some embodiments, the curve similarity can be compared through a trained machine learning model. In some embodiments, the algorithm for comparing the curve similarity of the machine learning model may include a similarity algorithm based on Euclidean distance, a similarity algorithm based on Manhattan distance, a similarity algorithm based on Chebyshev distance, a similarity algorithm based on Minkowski distance, a similarity algorithm based on standardized Euclidean distance, a similarity algorithm based on Mahalanobis distance, a similarity algorithm based on angle cosine, a similarity algorithm based on Pearson correlation coefficient, a similarity algorithm based on DTW distance, a similarity algorithm based on KL divergence, etc., or any combination thereof. In some embodiments, a historical curve of the infrared light intensity of at least one measured user reflecting infrared light changing over time can be selected as a training sample to train the machine learning model for comparing the similarity of the curves.
[0057] In some embodiments, the identity of the user being tested can also be determined by comparing the curve of the infrared light intensity of the infrared light reflected by the user being tested during the detection period with the pre-set curve. For example, the user can store the reflected infrared light intensity curve corresponding to the user identity in the identity confirmation system 200 in advance. After the identity confirmation system 200 obtains the curve of the infrared light intensity of the infrared light reflected by the user being tested with the time, it can be searched and matched with the pre-set curve to determine the identity of the user being tested. For example, in a short period of time (several hours, several days), two different living bodies may have their own fixed but different blood oxygen content, which causes their infrared light intensity curves to be fixed but different from each other. Therefore, by searching and matching the infrared light intensity curve with the pre-set curve, identity recognition can be performed at the same time as living body recognition. In some embodiments, when it is determined that a certain user being tested is identified as a living body and passes identity recognition, his electrical signal curve can be stored in his corresponding identity. Within a certain period of time, if the same electrical signal curve is detected, the user being tested can be directly judged as the corresponding stored identity based on the stored electrical signal curve without identity recognition.
[0058] In some embodiments, by comparing the curve of the infrared light intensity of the infrared light reflected by the user during the detection time period changing with time with a pre-set curve, it is determined whether the user has a heart disease (such as high heart rate, low heart rate, arrhythmia, cardiac arrest).
[0059] If the infrared light intensity of the infrared light reflected by the detected user meets the preset liveness detection condition, step 440 is executed: the detected object is detected as a live body; otherwise, the detected user is determined to be a non-live body, and step 450 is executed: fingerprint recognition is not performed. In some embodiments, step 320 may be further executed after step 440.
[0060] It should be noted that the detection of whether the user being tested is alive can be achieved by using one of the above-mentioned liveness detection conditions of infrared light intensity or the curve of the infrared light intensity changing with time in the detection time period. However, it is also possible to simultaneously meet several liveness detection conditions of infrared light intensity and the curve of the infrared light intensity changing with time in the detection time period to determine whether the user being tested is alive. In some embodiments, the second recognition unit 220 can also perform liveness detection on the user being tested based on information such as the user's heart rate, finger veins, face, iris, etc.
[0061] In some embodiments, by analyzing the curve of the infrared light intensity of the infrared light reflected by the measured user during the driving period changing with time or comparing it with a pre-set curve, it is also possible to determine whether the user has a sudden heart disease (such as high heart rate, low heart rate, arrhythmia, cardiac arrest, etc.).
[0062] It should be noted that the above description of process 400 is only for example and explanation, and does not limit the scope of application of this specification. For those skilled in the art, various modifications and changes can be made to process 400 under the guidance of this specification. However, these modifications and changes are still within the scope of this specification. For example, in some embodiments, infrared light is replaced with visible light (such as white light, green light, blue light, etc.). For another example, in some embodiments, the living body detection condition (pre-set infrared intensity range or infrared curve) is replaced with information related to heart rate, face, finger vein, iris, etc.
[0063] Figure 5A It is a cross-sectional view of an identity confirmation device according to some embodiments of the present application. Figure 5B is a top view of an identity confirmation device according to some embodiments of the present application. Figure 5A and Figure 5B As shown, the identity confirmation device 500 may include an optical lens 510 (also referred to as a light-transmitting plate), a photoelectric receiver 520, a chip (not shown in the figure), a fingerprint scanner 540 and an infrared light emitting element 550. The fingerprint scanner 540 and the infrared light emitting element 550 are Figure 2 The infrared light emitting element 550 and the photoelectric receiver 520 correspond to the first information acquisition subunit 211 in Figure 2 The chip corresponds to the second information acquisition subunit 221 in Figure 2 The first information processing sub-unit 212 and the second information processing sub-unit 222 correspond to each other.
[0064] The fingerprint scanner 540 can be used to scan the fingerprint image of the user being tested. The fingerprint image is an image obtained by using an image acquisition device to collect the uneven lines on the front skin of the finger end. The lines of each fingerprint image are regularly arranged to form different lines, as well as detailed features such as the starting point, end point, junction point and bifurcation point of the lines. The fingerprint scanner 540 can be the first information acquisition subunit 211 in the first recognition unit 210.
[0065] The infrared light emitting element 550 can emit infrared light of a certain wavelength. The photoelectric receiver 520 can be used to receive the infrared light emitted by the measured user, and convert the infrared light intensity of the infrared light reflected by the measured user into an electrical signal. In this embodiment, an infrared light emitting diode is preferred, but it is not limited to an infrared light emitting diode. In some embodiments, the infrared light emitting element 550 can also be a light emitting element of other colors, for example, a red light emitting element, a blue light emitting element, a white light emitting element, etc. Accordingly, the infrared light emitting element 550 is adapted to the photoelectric receiver 520.
[0066] It should be noted that the infrared light emitting element 550 and the photoelectric receiver 520 are not limited to Figure 5A and Figure 5B The group shown in the figure may also be multiple groups (for example, two groups, three groups, four groups, etc.). In some embodiments, multiple groups of infrared light emitting elements 550 and photoelectric receivers 520 may respectively emit and receive infrared light of different wavelengths. The emission and reception processes of multiple groups of infrared light emitting elements 550 and photoelectric receivers 520 may be simultaneous or sequential. The infrared light emitting elements 550 and photoelectric receivers 520 are included in the second information acquisition subunit 221.
[0067] In some embodiments, the infrared light emitting element 550 and the photoelectric receiver 520 may be arranged opposite to each other. For example, the infrared light emitting element 550 may be located on one side of the fingerprint scanner 540, and the photoelectric receiver 520 may be located on the other side of the fingerprint scanner 540. In some embodiments, the infrared light emitting element 550 and the photoelectric receiver 520 may also be located at two corners on the diagonal line of the fingerprint scanner 540, respectively.
[0068] In some embodiments, the upper surface of the infrared light emitting element 550 and the upper surface of the photoelectric receiver 520 are not higher than the upper surface of the fingerprint scanner 540. It should be noted that the infrared light emitting element 550 is a device that can emit infrared light. In the embodiments provided in this specification, the infrared light emitting element 550 is used to emit infrared light to the user to be tested, and the photoelectric receiver 520 receives the infrared light reflected by the user to be tested. The photoelectric receiver 520 converts the received infrared light into an electrical signal, and the chip realizes the liveness detection function by determining the strength and change amount of the electrical signal. If the infrared light directly irradiates the photoelectric receiver 520, the intensity of the infrared light reflected from the user to be tested will be several orders of magnitude smaller than the intensity of the infrared light directly irradiated to the photoelectric receiver 520 and will be covered. At this time, the liveness recognition of the user to be tested will be very inaccurate. Therefore, the infrared light emitted by the infrared light emitting element 550 cannot directly irradiate the photoelectric receiver 520 (it needs to be irradiated to the object to be tested through the optical lens 510, and then reflected from the object to be tested through the optical lens 510 and irradiated to the photoelectric receiver 520).
[0069] like Figure 5A As shown, the optical lens 510 can be set above the fingerprint scanner 540, the infrared light emitting element 550 and the photoelectric receiver 520. The infrared light emitted by the infrared light emitting element 550 is irradiated to the user under test through the optical lens 510, the photoelectric receiver 520 receives the infrared light reflected by the user under test, and the fingerprint scanner 540 scans the fingerprint image of the user under test placed on the optical lens 510.
[0070] The optical lens 510 can isolate the components inside the identity confirmation device 500 from the outside world to prevent external foreign objects from entering the identity confirmation device 500. The optical lens 510 can also allow the infrared light of the infrared light emitting element 550 to pass through, and can allow the infrared light to irradiate the measured user placed on its surface. The optical lens 510 can also allow the infrared light reflected by the measured user to pass through and be received by the photoelectric receiver 520. In some embodiments, the optical lens 510 can also filter out some specific wavelengths of light, or have a large attenuation for specific wavelengths of light. In some embodiments, the light transmittance (also known as transmittance, total light transmittance) of the optical lens 510 needs to be at least 45%. The light transmittance can refer to the percentage of the luminous flux passing through the optical lens and its incident luminous flux. In some embodiments, the material of the optical lens 510 can include glass, organic glass (PMMA), polyvinyl chloride, polycarbonate (PC), polystyrene (PS) or ABS plastic, etc. The optical lens 510 is compatible with the light emitting element. For example, when the light emitting element is an infrared light emitting element 550, the optical lens 510 used can be penetrated by infrared light. For another example, when the light emitting element is a white light emitting element, the optical lens 510 used can be penetrated by white light.
[0071] Taking the infrared light emitting element 550 in this embodiment as an example, the infrared light emitted by the infrared light emitting element 550 can be irradiated to the user under test through the optical lens 510. Due to the diffuse reflection characteristics of light, the user under test will reflect the infrared light, and the reflected infrared light will be received by the photoelectric receiver 520. The photoelectric receiver 520 will convert the received infrared light into an electrical signal, and the electrical signal will change with the intensity of the infrared light.
[0072] The chip may include a processor. The chip is connected to the photoelectric receiver 520, the infrared light emitting element 550, and the fingerprint scanner 540. In some embodiments, the chip may determine the liveness recognition result of the user under test based on the infrared light received by the photoelectric receiver 520. In some embodiments, the chip may also retrieve the fingerprint image of the user under test from a pre-recorded fingerprint image set to determine the fingerprint recognition result.
[0073] It should be noted that, since the blood oxygen in the finger tissue absorbs infrared light, and when infrared light irradiates the finger tissue, the blood oxygen concentration in the finger tissue will change, and the absorption of infrared light by blood oxygen will also change with the change of blood oxygen concentration, the photoelectric receiver 520 will convert the infrared light into an electrical signal, and transmit the electrical signal to the chip for analysis. The chip determines whether the user being tested is alive based on whether the intensity of the electrical signal changes. For the specific details of determining the liveness recognition result and fingerprint recognition result of the user being tested, please refer to the description elsewhere in this application, which will not be repeated here.
[0074] In some embodiments, one or more user fingerprint images may be pre-entered and stored in a storage device or database to obtain a fingerprint image set. During use, the acquired fingerprint image of the user being tested is matched and identified with the fingerprint images in the fingerprint image set. If the fingerprint image of the user being tested has the same fingerprint features as a fingerprint image in the fingerprint image set, it indicates that the fingerprint match is successful, and the fingerprint identification is determined to be successful. If the fingerprint image of the user being tested does not match the fingerprint features of the fingerprint images in the fingerprint image set, it indicates that the fingerprint match is unsuccessful, and the fingerprint identification is determined to be unsuccessful.
[0075] In some embodiments, only when the user under test is alive, will fingerprint recognition be performed on the user under test and a fingerprint recognition result be obtained. When the user under test is not alive, fingerprint recognition is not performed. In some embodiments, only when the fingerprint recognition of the user under test passes, liveness recognition is performed on the user under test. When the fingerprint recognition of the user under test fails, liveness recognition is not performed. Alternatively, liveness recognition and fingerprint recognition (or other identity recognition) can be performed simultaneously, and a detection result is determined based on the results of liveness recognition and fingerprint recognition.
[0076] In some embodiments, the identity confirmation device 500 may further include a support plate 530. The support plate 530 is disposed below the fingerprint scanner 540, in contact with the fingerprint scanner 540, the infrared light emitting element 550, and the photoelectric receiver 520, and is used to support the fingerprint scanner 540, the infrared light emitting element 550, and the photoelectric receiver 520. In some embodiments, the support plate 530 may be a printed circuit board, a flexible circuit board, etc., but is not limited thereto.
[0077] Based on the above-mentioned identity confirmation device 500, the implementation principle thereof is described below by way of example:
[0078] When a human finger contacts the optical lens 510, the awakening device (such as the awakening unit 230) can awaken the infrared light emitting element 550. The infrared light emitting element 550 emits infrared light, which passes through the optical lens 510 and irradiates the finger. The finger reflects the infrared light and passes through the optical lens 510 to be received by the photoelectric receiver 520. The photoelectric receiver 520 converts the received infrared light into an electrical signal and transmits it to the chip for processing. If the user being tested is a living finger, when the infrared light normally irradiates the finger tissue, the blood oxygen concentration in the finger tissue will change, and the absorption of infrared light by blood oxygen will also change with the change of blood oxygen concentration. At this time, the infrared light intensity received by the photoelectric receiver 520 changes periodically. The photoelectric receiver 520 converts the changing infrared light intensity into a changing electrical signal. The chip determines that the user being tested is a living person at this time through the changing electrical signal. If the user under test is a non-living body, when the infrared light is irradiated to the user under test, the user under test will reflect the infrared light. Since the user under test is a non-living body, there will be no change in blood oxygen concentration and no change in infrared intensity. Therefore, the infrared light intensity received by the photoelectric receiver 520 is constant, and the electrical signal converted by the photoelectric receiver 520 from the constant infrared light is also constant. The chip can determine that the user under test is a non-living body through the constant electrical signal. When the user under test is detected to be a living body, the fingerprint image scanned during the live fingerprint detection is subjected to fingerprint recognition (which is a type of identity recognition). The fingerprint recognition is to retrieve the fingerprint image of the user under test from a pre-recorded fingerprint image set. When a fingerprint image with the same fingerprint feature as the fingerprint image of the user under test is retrieved, it is determined that the fingerprint recognition is passed. If a fingerprint image with the same fingerprint feature as the fingerprint image of the user under test is not retrieved from the fingerprint image set, it is determined that the fingerprint recognition is not passed. The identity confirmation device 500 provided in this embodiment can determine the liveness recognition result by performing liveness recognition on the user under test, and then recognize the fingerprint of the user under test to determine the fingerprint recognition result. The use of double verification can improve the security of the fingerprint lock using fingerprint recognition technology, so that the device can be used in vehicles and other equipment that require higher security.
[0079] In order to more accurately obtain the infrared light intensity of the infrared light reflected by the measured user, the light emitting element and the photoelectric receiver can be separated so that the light emitted by the light emitting element does not directly irradiate the photoelectric receiver. In some embodiments, a shading element can be provided between the light emitting element and the photoelectric receiver. The shading element can be made of an opaque material.
[0080] Figure 6 is a schematic diagram of an application scenario of applying an identity confirmation device to a car door according to some embodiments of the present application. Figure 6 As shown, the identity confirmation device 130 can be set on the door of the car 610 (such as a door lock, door handle, etc.). The identity confirmation device 130 may include a fingerprint recognition module and a liveness detection module. The fingerprint recognition module can be used to confirm whether the user's fingerprint matches the fingerprint information in the pre-stored fingerprint library. The liveness detection module can determine whether the user under test is alive according to the infrared light intensity of the infrared light received by the photoelectric receiver. In some embodiments, the identity confirmation device 130 can be used to control whether the car door lock is unlocked according to the user's identity confirmation information. In some embodiments, after the car door lock is unlocked, the user can open the car door by himself. In some other embodiments, after the car door lock is unlocked, the identity confirmation device 130 can control the car door to open automatically. The identity confirmation information may include fingerprint matching information and whether the current user is alive. Specifically, when the identity confirmation device 130 confirms that the current user's fingerprint matches the fingerprint information in the pre-stored fingerprint library and the liveness detection module detects that the current user is alive, the car door lock is controlled to unlock, and the user is allowed to open the car door or the car door is controlled to open automatically. If only one of the conditions of the current user's fingerprint matching the fingerprint information in the pre-stored fingerprint library and the current user being alive is met or both are not met, the car door lock will not be controlled to be unlocked or the car door lock will be controlled to be further locked, and the user is prohibited from opening the door. The identity confirmation device 130 can prevent illegal persons from stealing the user's fingerprint and making a fingerprint film or fingerprint sticker, opening the door, and stealing the car, thereby improving the security of the door lock. In some embodiments, the identity confirmation device 130 can be set at any position on the car door. Specifically, the identity confirmation device 130 can be set on the car door handle, near the car door handle, etc.
[0081] Figure 7 Schematic diagram of an application scenario in which an identity confirmation device is applied to a car start button according to some embodiments of the present application. Figure 7As shown, the identity confirmation device 130 can be set on the car start button 720. The identity confirmation device 130 may include a fingerprint recognition module and a liveness detection module. The fingerprint recognition module can be used to confirm whether the user's fingerprint matches the fingerprint information in the pre-stored fingerprint library. The liveness detection module can determine whether the user under test is alive according to the infrared light intensity of the infrared light received by the photoelectric receiver. In some embodiments, the identity confirmation device 130 can be used to control whether the car start button starts the engine according to the user's identity confirmation information. The identity confirmation information may include fingerprint matching information and whether the current user is alive. Specifically, when the fingerprint recognition module confirms that the current user's fingerprint matches the fingerprint information in the pre-stored fingerprint library and the liveness detection module detects that the current user is alive, the car start button is controlled to start the engine. If only one of the conditions that the current user's fingerprint matches the fingerprint information in the pre-stored fingerprint library and the current user is alive is met or not met, the engine is controlled not to start. The identity confirmation system is set on the car start button. Only when the fingerprint matches and is alive, the car start button can start the engine. This can prevent illegal persons from stealing the user's fingerprint and making a fingerprint film or fingerprint sticker, starting the engine, and stealing the car, thereby improving the anti-theft safety factor of the car. In some embodiments, when performing liveness detection, it is also possible to determine whether the user's vital signs meet the driving needs, for example, whether there is a serious heart disease, whether there is a sudden acceleration of the heartbeat (for example, there is the possibility of drunk driving or drug driving), whether there is a low blood oxygen concentration (such as fatigue driving), etc. The engine can only be started when the user's vital signs meet the driving needs, avoiding the user from starting the car when the physical condition is poor, further ensuring driving safety.
[0082] In some embodiments, Figure 7As shown, the identity confirmation device 130 can be set on the steering wheel 710 of the car. In some embodiments, the identity confirmation device 130 installed on the steering wheel 710 of the car can only include a liveness detection module. In some other embodiments, the identity confirmation device 130 installed on the steering wheel 710 of the car can include a liveness detection module and an identity recognition module at the same time. The liveness detection module can determine whether the user has a sudden heart disease (such as high heart rate, low heart rate, arrhythmia, cardiac arrest) by analyzing the curve of the infrared light intensity of the infrared light reflected by the user in a certain period of time and comparing it with a preset curve. In some embodiments, when the user holds the steering wheel with at least one hand, the identity confirmation device 130 can detect the curve of the infrared light intensity of the infrared light reflected by the user in the driving time period and the time change, so as to obtain the vital signs of the user (blood oxygen, heart rate, etc.). When the vital signs of the user are abnormal, the user and other passengers can be informed by voice, an emergency call can be made to a preset number or hospital, and the vehicle can be safely parked or driven to the destination or hospital in combination with automatic driving technology. The present invention can prevent serious consequences such as sudden death from heart diseases during driving. In some embodiments, the method of informing the user can be voice broadcast, flashing lights, text prompts or video prompts. In some embodiments, the liveness detection module can determine whether the user's at least one hand has left the steering wheel based on the infrared light intensity of the infrared light received by the photoelectric receiver to monitor whether the user's driving behavior is safe. For example, if the identity confirmation device 130 confirms that the user's at least one hand has left the steering wheel, it is confirmed that the user's driving behavior is dangerous; if the identity confirmation device 130 confirms that the user's two hands have not left the steering wheel, it is confirmed that the user's driving behavior is safe. The identity confirmation device 130 can inform the user or passenger of the user's driving situation in a similar manner. The method of obtaining the user's vital signs information from the infrared light intensity curve can be found in Figure 8 and its description.
[0083] Figure 8 It is a graph of received signal curves of human fingers and imitation fingers shown in some embodiments of the present application. Curve 801 in the figure is a curve showing the change of the intensity of infrared light (here taking the current value of the corresponding electrical signal converted by the infrared receiving device according to the intensity of infrared light as an example) received by the infrared receiving device (such as the second recognition unit 220, the photoelectric receiver) over time when a non-living imitation finger (for example, a whole imitation finger, a fingerprint film attached to a human finger, a fingerprint cover, etc.) is placed in the detection area (such as the finger and palm placement area). Curve 802 in the figure is a curve showing the change of the intensity of infrared light received by the infrared receiving device over time when a living human finger is placed in the detection area described in the present application. The working principle of the infrared receiving device in the embodiments of the present application can be found in the description elsewhere in the present application.
[0084] like Figure 8 As shown, curves 801 and 802 are both 0 at the beginning, when the non-living imitation finger and the living human finger have not been placed. During the finger placement process, curves 801 and 802 both experience a certain change in the strength of the electrical signal. After a period of time, such as after t0, the curve 801 corresponding to the non-living imitation finger presents a flat straight line, indicating that the strength of the electrical signal received by the second recognition unit 220 remains unchanged, and its value is I1. In contrast, after a period of time, the curve 801 corresponding to the living human finger is a curve with periodic fluctuations, and its average value is I2, the fluctuation value is ΔI, and the fluctuation period is T. The reason why curves 801 and 802 have a difference in average values is that the imitation finger and the human finger have different reflectivities for infrared rays, which leads to different reflected light intensities. The reason why curve 802 fluctuates while curve 801 does not fluctuate is that there are no blood vessels in the imitation finger (even if a fingerprint film or fingerprint cover is used, the blood vessels will be blocked), while curve 802 has blood vessels. The blood vessels will bring about changes in blood oxygen in each cardiac cycle due to the beating of the heart. The changes in blood oxygen will cause periodic fluctuations in reflectivity, which will in turn cause different reflected light intensities. The following will specifically describe how to determine whether the user being tested is a non-living imitation finger or a living human finger based on the characteristics of curves 801 and 802. The following electrical signals refer to electrical signals after the finger is completely placed (i.e., after t0).
[0085] In some embodiments, the liveness detection threshold may include a liveness detection strength threshold. By comparing the electrical signal strength received by the second recognition unit 220 with the liveness detection strength threshold, it can be determined whether the user being tested is live or non-live. In some embodiments, the average value of the electrical signal strength received by the second recognition unit 220 can be compared with the liveness detection strength threshold I3 (here the absolute value is compared). When the average value of the electrical signal strength is greater than the liveness detection strength threshold I3, the user being tested can be judged to be live. For example, the average value I2 corresponding to the curve 802 is greater than I3, so it can be judged to be a live body. On the contrary, the average value I1 corresponding to the curve 801 is less than I3, so it can be judged to be a non-live. Preferably, I3 can be set according to the average value of the electrical signal strength of common imitation fingers and the average value of the electrical signal strength of common human fingers (for example, between them), as long as I3 can distinguish live from non-live. In some embodiments, the maximum value, minimum value, or difference ΔI between the maximum value and the minimum value of the electrical signal strength received by the second recognition unit 220 can also be compared with the liveness detection strength threshold. Specifically, when the difference ΔI between the maximum and minimum values of the electrical signal strength is greater than the liveness detection strength threshold, the user being measured can be judged to be live; when the difference ΔI between the maximum and minimum values of the electrical signal strength is less than the liveness detection strength threshold, the user being measured can be judged to be non-live.
[0086] In some embodiments, the liveness detection threshold may include a liveness detection slope threshold. By comparing the slope value of the electrical signal received by the second identification unit 220 with the liveness detection slope threshold, it can be determined whether the user being tested is live or non-live. Specifically, the slope value of the electrical signal may be G=dI / dt. In some embodiments, the maximum slope value of the electrical signal received by the second identification unit 220 may be compared with the liveness detection slope threshold. When the maximum slope value of the electrical signal is greater than the liveness detection slope threshold, the user being tested may be determined to be live. When the maximum slope value of the electrical signal is less than the liveness detection slope threshold, the user being tested may be determined to be non-live. In some embodiments, the minimum slope value of the electrical signal received by the second identification unit 220 may be compared with the liveness detection slope threshold. When the minimum slope value of the electrical signal is less than the liveness detection slope threshold, the user being tested may be determined to be live. When the minimum slope value of the electrical signal is greater than the liveness detection slope threshold, the user being tested may be determined to be non-live. Through the above comparison, the recognition result of whether the user being tested is alive or not can be obtained.
[0087] In some embodiments, the heart rate of the user being measured can also be detected based on the electrical signal curve graph received by the second recognition unit 220. Figure 8 It can be seen that after stabilization, the electrical signal curve 802 corresponding to the living body is a curve that changes periodically. The period T of the electrical signal curve 802 can be obtained from the electrical signal curve diagram (only the time span of one cycle can be measured, or the time span of multiple cycles can be measured and averaged), and the heart rate of the subject to be measured can be calculated based on T. Specifically, if the cardiac cycle is T (seconds), the heart rate per minute can be calculated as 60 / T. By detecting the heart rate of the user being measured, the vital signs of the user being measured can be detected. For example, it can be applied to the heart rate detection of the driver in the car driving, and the driver can be warned of sudden heart disease during driving. For another example, it can also be applied to the heart rate detection of users in security equipment (such as car door locks) to achieve the purpose of identity authentication and safety and health detection at the same time. More content about heart rate detection can be found elsewhere in this application and will not be repeated here.
[0088] The beneficial effects that may be brought about by the embodiments of the present application include but are not limited to: (1) The present application requires the user to pass both fingerprint recognition and liveness detection before opening the car door or starting the engine, which effectively improves the safety of the car. (2) The present application also detects in real time whether the user has sudden heart disease and whether there is any dangerous driving behavior, further ensuring driving safety. It should be noted that different embodiments may produce different beneficial effects. In different embodiments, the beneficial effects that may be produced may be any one or a combination of the above, or any other possible beneficial effects.
[0089] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of the present application. Although not explicitly stated herein, those skilled in the art may make various modifications, improvements and amendments to the present application. Such modifications, improvements and amendments are suggested in the present application, so such modifications, improvements and amendments still belong to the spirit and scope of the exemplary embodiments of the present application.
[0090] At the same time, the present application uses specific words to describe the embodiments of the present application. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of the present application. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, some features, structures or characteristics in one or more embodiments of the present application can be appropriately combined.
[0091] In addition, it will be appreciated by those skilled in the art that various aspects of the present application may be illustrated and described by a number of patentable categories or situations, including any new and useful process, machine, product or combination of substances, or any new and useful improvements thereto. Accordingly, various aspects of the present application may be performed entirely by hardware, entirely by software (including firmware, resident software, microcode, etc.), or by a combination of hardware and software. The above hardware or software may all be referred to as "data blocks", "modules", "engines", "units", "components" or "systems". In addition, various aspects of the present application may be represented as a computer product located in one or more computer-readable media, which includes computer-readable program code.
[0092] A computer storage medium may include a propagated data signal containing computer program code, for example, in baseband or as part of a carrier wave. The propagated signal may be in a variety of forms, including electromagnetic, optical, etc., or a suitable combination. A computer storage medium may be any computer-readable medium other than a computer-readable storage medium, which can be connected to an instruction execution system, device or apparatus to communicate, propagate or transmit the program for use. The program code on the computer storage medium may be transmitted via any suitable medium, including radio, cable, fiber optic cable, RF, or similar media, or any combination of the above media.
[0093] The computer program coding required for the operation of each part of the application can be written in any one or more programming languages, including object-oriented programming languages such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python, etc., conventional procedural programming languages such as C language, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, Ruby and Groovy, or other programming languages, etc. The program coding can be run completely on the user's computer, or run on the user's computer as an independent software package, or run partly on the user's computer and partly on the remote computer, or run completely on the remote computer or server. In the latter case, the remote computer can be connected to the user's computer through any network form, such as a local area network (LAN) or a wide area network (WAN), or connected to an external computer (e.g., via the Internet), or in a cloud computing environment, or used as a service such as software as a service (SaaS).
[0094] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this application, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this application. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this application. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.
[0095] Similarly, it should be noted that in order to simplify the description of the disclosure of this application and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this application, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the object of this application are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.
[0096] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of the present application are approximate values, in specific embodiments, the setting of such numerical values is as accurate as possible within the feasible range.
[0097] Each patent, patent application, patent application disclosure, and other materials, such as articles, books, instructions, publications, documents, etc., cited in this application are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the content of this application, documents that limit the broadest scope of the claims of this application (currently or later attached to this application) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the attached materials of this application are inconsistent or conflicting with the content described in this application, the descriptions, definitions, and / or use of terms in this application shall prevail.
[0098] Finally, it should be understood that the embodiments described in this application are only used to illustrate the principles of the embodiments of the present application. Other variations may also fall within the scope of the present application. Therefore, as an example and not a limitation, the alternative configurations of the embodiments of the present application may be considered to be consistent with the teachings of the present application. Accordingly, the embodiments of the present application are not limited to the embodiments explicitly introduced and described in the present application.
Claims
1. An identity confirmation method, characterized in that: The method comprises: Obtain the fingerprint information of the user being tested; Determine a fingerprint information recognition result according to the fingerprint information; Acquiring infrared information of the measured user; An infrared information recognition result is determined according to the infrared information, wherein the infrared information includes blood oxygen information of the measured user, and the infrared information recognition result includes a curve of the change of the infrared light intensity of the infrared light reflected by the measured user over time during the detection time period, including: By using a trained machine learning model, a curve of the infrared light intensity of the infrared light reflected by the measured user changing over time is compared with a preset curve; or By comparing whether the curve similarity meets the similarity threshold, determining whether the curve of the infrared light intensity of the infrared light reflected by the measured user changing with time meets the preset curve; and Based on the fingerprint information recognition result and the infrared information recognition result, a detection result of the detected user is determined, including: In response to the detection result of the tested user being passed, storing a curve showing changes in the infrared light intensity of the infrared light reflected by the measured user over time; and In response to detecting the same change curve within a certain period of time, the identity of the detected user is directly determined according to the change curve.
2. The method according to claim 1, characterized in that The determining the detection result of the detected user based on the fingerprint information recognition result and the infrared information recognition result comprises: When the fingerprint information recognition result is that the fingerprint recognition of the tested user has passed and the infrared information recognition result is that the liveness recognition of the tested user has passed, it is determined that the detection result of the tested user has passed; otherwise, Determine that the test result of the tested user is failed.
3. The method according to claim 1, characterized in that The step of determining the infrared information recognition result according to the infrared information further comprises: Comparing the infrared information with a living body detection threshold; and The infrared information recognition result is determined according to the comparison result.
4. The method according to claim 3, characterized in that The liveness detection threshold includes a liveness detection intensity threshold; and comparing the infrared information with the liveness detection threshold includes: Comparing the average value of the infrared information with the living body detection intensity threshold; or The maximum value, the minimum value, or the difference between the maximum value and the minimum value of the infrared information is compared with the living body detection intensity threshold.
5. The method according to claim 3, characterized in that: The liveness detection threshold includes a liveness detection slope threshold; and comparing the infrared information with the liveness detection threshold includes: The maximum slope value or the minimum slope value of the infrared information is compared with the living body detection slope threshold.
6. The method according to claim 1, characterized in that Determining the fingerprint information recognition result according to the fingerprint information includes: Retrieving the fingerprint information from a pre-stored fingerprint information set to obtain a retrieval result; The fingerprint information recognition result is determined according to the search result.
7. An identity confirmation device, characterized in that: The device comprises: A first identification unit, the first identification unit is used to obtain fingerprint information of a tested user and determine a fingerprint information identification result according to the fingerprint information; The second identification unit is used to obtain infrared information of the measured user, and determine an infrared information identification result according to the infrared information, wherein the infrared information includes blood oxygen information of the measured user, and the infrared information identification result includes a curve of the infrared light intensity of the infrared light reflected by the measured user changing with time during the detection time period, including: By using a trained machine learning model, a curve of the infrared light intensity of the infrared light reflected by the measured user changing over time is compared with a preset curve; or By comparing whether the curve similarity meets the similarity threshold, determining whether the curve of the infrared light intensity of the infrared light reflected by the measured user changing with time meets the preset curve; and A determination unit, the determination unit is used to determine the detection result of the detected user based on the fingerprint information recognition result and the infrared information recognition result, including: In response to the detection result of the tested user being passed, storing a curve showing changes in the infrared light intensity of the infrared light reflected by the measured user over time; and In response to detecting the same change curve within a certain period of time, the identity of the detected user is directly determined according to the change curve.
8. A car, characterized in that: The invention comprises an identity confirmation device, wherein the identity confirmation device comprises at least one processor and at least one storage device, wherein the storage device is used to store instructions, and when the at least one processor executes the instructions, the identity confirmation method according to any one of claims 1 to 6 is implemented, and the identity confirmation device is installed on at least one of the following automobile mechanisms: an automobile door, an automobile door handle, an automobile engine switch or an automobile steering wheel.
