Emergency or stealth responses triggered by fingerprint sensor

Abstract

A method may include: receiving fingerprint sensor data from a fingerprint sensor system; detecting the presence of a finger on an outer surface of the device in the fingerprint sensor system area based on the fingerprint sensor data; determining a finger force or finger pressure on the outer surface of the device based on the fingerprint sensor data; and determining a time threshold value based on the fingerprint sensor data. The time threshold value determination may include determining whether the duration for which the finger force exceeds a threshold finger force or the finger pressure exceeds a threshold finger pressure is greater than or equal to a threshold time duration. The method may include determining, at least in part, whether to activate one or more emergency response functions of the device based on the time threshold value determination.

Description

Technical Field

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. patent application No. 17 / 448,195, filed on September 20, 2021, entitled “EMERGENCY OR STEALTH RESPONSES TRIGGERED BY FINGERPRINT SENSOR,” which is incorporated herein by reference and for all purposes.

[0003] The present disclosure generally relates to fingerprint sensors and methods for using such systems. Prior Art

[0004] Fingerprint sensors, including but not limited to ultrasonic fingerprint sensors, have been incorporated into devices such as smartphones, ATMs, and automobiles to authenticate user identities. Although some existing devices with fingerprint sensors may provide satisfactory performance, improved devices and methods for operating such devices are needed. Summary of the Invention

[0005] The systems, methods, and apparatus of the present disclosure each have several innovative aspects, no single one of which is solely responsible for the desirable attributes disclosed herein.

[0006] Some innovative aspects of the subject matter described in this disclosure can be implemented in a method. The method may include controlling a device including a fingerprint sensor system. The method may include receiving, by a control system, fingerprint sensor data from the fingerprint sensor system. The method may include detecting, by the control system and based on the fingerprint sensor data, the presence of a finger on an external surface of the device in an area of ​​the fingerprint sensor system. The method may include determining, by the control system and based on the fingerprint sensor data, a finger force or finger pressure on the external surface of the device. The method may include performing, by the control system and based on the fingerprint sensor data, a time threshold determination. In some examples, the time threshold determination may include determining whether a length of time during which the finger force exceeds a threshold finger force or during which the finger pressure exceeds a threshold finger pressure is greater than or equal to a threshold time length. The method may include determining, by the control system and based at least in part on the time threshold determination, whether to enable one or more emergency response functions of the device.

[0007] In some instances, the one or more emergency response functions may include one or more of the following: initiating a phone call to an emergency response phone number, initiating a phone call to a designated emergency communication recipient, or initiating a text message to a designated emergency communication recipient. In some examples, the one or more emergency response functions may include one or more of the following: initiating an audio recording session, initiating a video recording session, capturing one or more photos, or causing one or more financial institution accounts to be locked.

[0008] According to some examples, the method may include determining, by the control system and based on the fingerprint sensor data, a heart rate. Some such examples may include determining, by the control system, whether the heart rate equals or exceeds a threshold heart rate.

[0009] In some instances, where the control system determines that the heart rate does not equal or exceed a threshold heart rate, the method may include controlling the device, by the control system, to provide a prompt indicating that if a first specified user action is taken, at least one of the one or more emergency response functions will be enabled. In some examples, providing the prompt may include presenting a graphical user interface (GUI) on a display device of the device. In some instances, the first specified user action may be or may include an additional instance of finger force or additional instance of finger pressure to be applied in an area of ​​the fingerprint sensor system.

[0010] According to some examples, where the control system determines that the heart rate is equal to or exceeds a threshold heart rate, the method may include estimating, by the control system and based on the fingerprint sensor data, an anxiety level. In some examples, estimating the anxiety level may include detecting the presence or absence of finger sweating.

[0011] In some examples, where the control system detects the presence of finger sweating, the method may include enabling, by the control system, one or more emergency response functions. According to some such examples, the method may include determining user location data before enabling the one or more emergency response functions, and providing the user location data with at least one emergency response communication.

[0012] According to some examples, where the control system does not detect the presence of finger sweat, the method may include controlling the device, by the control system, to provide a prompt indicating that at least one of the one or more emergency response functions will be enabled if a second specified user action is taken. In some examples, the second specified user action may be or include an additional instance of finger force or additional instance of finger pressure to be applied in the fingerprint sensor system area.

[0013] According to some examples, the method may include determining, by the control system, whether the finger is the finger most commonly used in the authentication process. In some examples, the method may include performing, by the control system, an authentication process that may be based at least in part on fingerprint sensor data. In some embodiments, receiving fingerprint sensor data may include receiving ultrasonic fingerprint sensor data.

[0014] In some examples, the method may include determining, by the control system, whether the finger has been selected for triggering one or more emergency response functions. In some such examples, determining whether to enable the one or more emergency response functions may be based at least in part on whether the finger has been selected for triggering the one or more emergency response functions.

[0015] According to some examples, the method may include a pattern determination process in which the control system determines whether a complete pattern has been entered via the fingerprint sensor system. In some such examples, determining whether to enable one or more emergency response functions may be based at least in part on the pattern determination process. In some instances, the complete pattern may include or include multiple instances of finger force or finger pressure applied in an area of ​​the fingerprint sensor system.

[0016] In some examples, where the control system determines that a complete pattern has not been received via the fingerprint sensor system, the method may include controlling the device, by the control system, to provide a prompt indicating that if a specified user action is taken, at least one of the one or more emergency response functions will be enabled. In some such examples, providing the prompt may include presenting a GUI on a display device of the device. In some examples, the specified user action may be or may include additional instances of finger force or additional instances of finger pressure to be applied in the area of ​​the fingerprint sensor system.

[0017] Some or all of the operations, functions, and / or methods described herein may be performed by one or more devices according to instructions (e.g., software) stored on one or more non-transitory media. Such non-transitory media may include memory devices such as those described herein, including but not limited to random access memory (RAM) devices, read-only memory (ROM) devices, and the like. Therefore, some innovative aspects of the subject matter described in this disclosure may be implemented in one or more non-transitory media having software stored thereon.

[0018] For example, the software may include instructions for controlling one or more devices to perform a method. According to some examples, the method may include receiving, by a control system, fingerprint sensor data from a fingerprint sensor system. In some examples, the method may include detecting, by the control system and based on the fingerprint sensor data, the presence of a finger on an external surface of the device in the area of ​​the fingerprint sensor system. In some examples, the method may include determining, by the control system and based on the fingerprint sensor data, the finger force or pressure of the finger on the external surface of the device. In some examples, the method may include determining, by the control system and based on the fingerprint sensor data, a heart rate. In some examples, the method may include determining, by the control system and based at least in part on the heart rate and the finger force or pressure, whether to enable one or more emergency response functions of the device.

[0019] In some examples, the one or more emergency response functions may include one or more of: initiating a telephone call to an emergency response telephone number, initiating a telephone call to a designated emergency communication recipient, initiating a text message to a designated emergency communication recipient, initiating an audio recording session, initiating a video recording session, taking one or more photos, or causing one or more financial institution accounts to be locked.

[0020] In some examples, the method may include determining, by the control system, whether the heart rate equals or exceeds a threshold heart rate. In some examples, where the control system determines that the heart rate does not equal or exceed the threshold heart rate, the method may include controlling, by the control system, the device to provide a prompt indicating that at least one of the one or more emergency response functions will be enabled if a first specified user action is taken. In some examples, providing the prompt may include presenting a GUI on a display device of the device. According to some examples, the first specified user action may be or may include an additional instance of finger force or additional instance of finger pressure to be applied in the fingerprint sensor system area.

[0021] Some innovative aspects of the subject matter described in this disclosure may be embodied in a device. The device may include a fingerprint sensor system and a control system configured to communicate with the fingerprint sensor system. In some examples, at least a portion of the control system may be coupled to the fingerprint sensor. In some embodiments, a mobile device may be or may include the device. For example, the mobile device may include a device as disclosed herein.

[0022] The control system may include one or more general-purpose single-chip or multi-chip processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic elements, discrete gate or transistor logic, discrete hardware components, or combinations thereof. According to some examples, the control system may be configured to receive fingerprint sensor data from a fingerprint sensor system. In some examples, the control system may be configured to detect the presence of a finger on an external surface of the device in the area of ​​the fingerprint sensor system based on the fingerprint sensor data. In some examples, the control system may be configured to determine the finger force or finger pressure of the finger on the external surface of the device based on the fingerprint sensor data. In some examples, the control system may be configured to perform a time threshold determination, comprising determining whether a length of time during which the finger force exceeds a threshold finger force or during which the finger pressure exceeds a threshold finger pressure is greater than or equal to a threshold time length. In some examples, the control system may be configured to determine whether to enable one or more emergency response functions of the device based at least in part on the time threshold determination.

[0023] In some examples, the control system can be configured to perform a pattern determination process that determines whether a complete pattern has been entered via the fingerprint sensor system. According to some such examples, the complete pattern can be or can include multiple instances of finger force applied in the fingerprint sensor system area and / or multiple additional instances of finger pressure. In some examples, determining whether to enable one or more emergency response functions can be based at least in part on the pattern determination process. Simple diagram description

[0024] The following drawings and description set forth details of one or more embodiments of the subject matter described in this specification. Additional features, aspects, and advantages will become apparent from the description, drawings, and claims. Note that the relative dimensions of the following figures may not be drawn to scale. Similar reference numerals and symbols in different figures indicate similar elements.

[0025] FIG. 1A is a block diagram illustrating example components of an apparatus according to some disclosed embodiments.

[0026] FIG. 1B is a block diagram illustrating example components of the apparatus of FIG. 1A , according to some disclosed embodiments.

[0027] FIG. 2 illustrates a cross-section of a device according to some disclosed embodiments.

[0028] FIG3 is a flowchart providing example blocks of some methods disclosed herein.

[0029] FIG4 is a flowchart providing example blocks of some methods disclosed herein.

[0030] 5 , 6 , and 7 illustrate examples of visual cues that may be displayed in the context of the method of FIG. 4 , in some implementations.

[0031] 8 , 9 , and 10 illustrate examples of GUIs that may be presented according to some implementations.

[0032] FIG. 11 is a flowchart providing example blocks of some methods disclosed herein.

[0033] FIG. 12 is a flow chart providing example blocks of some methods disclosed herein.

[0034] FIG. 13 is a flow chart providing example blocks of some of the methods disclosed herein.

[0035] 14A , 14B, 14C, and 14D illustrate examples of graphical user interfaces (GUIs) that may be presented during implementation of method 300 according to some example approaches.

[0036] FIG. 15 is a flow chart providing example blocks for some additional methods disclosed herein.

[0037] 16A , 16B, and 16C illustrate examples of GUIs that might be presented during the pressure calibration phase of the user registration process.

[0038] 17A , 17B, 17C, and 17D illustrate examples of GUIs that might be presented during the fingerprint capture phase of the user registration process.

[0039] FIG. 17E is a flowchart providing example blocks of some alternative methods disclosed herein.

[0040] 18A , 18B, and 18C illustrate examples of graphs indicating changes in a fingerprint image according to changes in applied finger pressure.

[0041] FIG. 19 is a graph illustrating changes in received signal strength according to changes in force applied by a finger on an ultrasonic sensor, according to some examples.

[0042] FIG. 20 shows an example of a fingerprint image obtained from a dry finger by an ultrasonic fingerprint sensor.

[0043] FIG21 shows an example of a fingerprint image and corresponding force.

[0044] 22A illustrates an example implementation of measuring heart rate and respiration rate using an ultrasonic fingerprint sensor according to some aspects of the present disclosure.

[0045] 22B is a graph of reflected acoustic energy versus frequency according to one example.

[0046] FIG. 22C illustrates details of some blocks of FIG. 22A according to some aspects of the present disclosure.

[0047] FIG. 23 illustrates details of block 2206 of FIG. 22A according to some aspects of the present disclosure.

[0048] FIG. 24 illustrates details of block 2310 of FIG. 23 according to some aspects of the present disclosure.

[0049] FIG. 25 illustrates details of block 2320 of FIG. 23 according to some aspects of the present disclosure.

[0050] FIG. 26 illustrates details of block 2330 of FIG. 23 according to some aspects of the present disclosure.

[0051] FIG. 27 representatively illustrates aspects of a 4×4 pixel array of sensor pixels for an ultrasonic fingerprint sensor.

[0052] 28A and 28B illustrate example arrangements of ultrasonic transmitters and receivers in an ultrasonic fingerprint sensor, although other arrangements are possible.

[0053] FIG28C shows an exploded view of an example of an ultrasonic fingerprint sensor. Implementation Method

[0054] The following description is directed to certain embodiments used to describe the innovative aspects of the present disclosure. However, one of ordinary skill in the art will readily recognize that the teachings herein may be applied in a variety of different ways. The described implementations may be implemented in any device, apparatus, or system that includes a biometric system as disclosed herein. In addition, it is contemplated that the described implementations may be included in or associated with various electronic devices, such as, but not limited to: mobile phones, multimedia Internet mobile phones, mobile television receivers, wireless devices, smart phones, smart cards, wearable devices such as bracelets, armbands, wristbands, rings, headwear, badges, etc., Bluetooth® devices, personal digital assistants (PDAs), wireless email receivers, handheld or portable computers, laptops, notebooks, smartbooks, tablet computers, printers, copiers, scanners, fax machines, global positioning systems (GPS), and the like.

[0014] Examples of the present invention include electronic devices such as GPS (Global Positioning System) receivers / navigators, cameras, digital media players (such as MP3 players), video cameras, game consoles, wrist watches, clocks, calculators, television monitors, flat panel displays, electronic reading devices (e.g., e-readers), mobile health devices, computer monitors, automotive displays (including odometer and speedometer displays, etc.), cockpit controls and / or displays, camera view displays (such as the display of a rearview camera in a vehicle), electronic photographs, electronic billboards or signs, projectors, architectural structures, microwave ovens, refrigerators, stereo systems, cassette recorders or players, DVD players, CD players, VCRs, radios, portable memory chips, washers, dryers, washer / dryers, automatic teller machines (ATMs), parking meters, packaging (such as in electromechanical systems (EMS) applications including microelectromechanical systems (MEMS) applications as well as non-EMS applications), artistic structures (such as the display of images on jewelry or clothing), and various EMS devices. The teachings herein may also be used in applications such as, but not limited to, electronic switching devices, radio frequency filters, sensors, accelerometers, gyroscopes, motion sensing devices, magnetometers, inertial elements for consumer electronics, components for consumer electronics, automotive doors, steering wheels, or other automotive components, variable capacitors, liquid crystal devices, electrophoretic display devices, drive schemes, manufacturing processes, and electronic test equipment. Therefore, the teachings herein are not intended to be limited to the embodiments depicted in the drawings alone, but rather have broad applicability, as will be apparent to those skilled in the art.

[0055] In emergency situations, time is of the essence. Therefore, it's desirable to have quick and effective methods for summoning help or taking other actions in an emergency. These actions may be referred to herein as "emergency response functions." In some instances, including but not limited to situations where a person and / or their property is threatened by one or more other persons, it may be desirable to summon help or take other actions without the other persons being aware that such a response is occurring. Such actions may be referred to herein as "stealth actions," "stealth events," and the like. While stealth actions may not always correspond to situations involving risk of harm to people or property, as used herein, stealth actions are considered a subset of possible emergency response functions.

[0056] In some embodiments, a device may include a fingerprint sensor system (which in some instances may be an ultrasonic fingerprint sensor system) and a control system. According to some examples, the control system may be configured to determine whether a finger is on an external surface of the device within the fingerprint sensor system area. In some examples, upon determining that a finger is on an external surface of the device within the fingerprint sensor system area, the control system may be configured to determine (e.g., based on fingerprint sensor data corresponding to the finger) the finger force or finger pressure applied to the external surface. In some examples, the control system may be configured to perform a time threshold determination based on the fingerprint sensor data. The time threshold determination may include determining whether a length of time during which the finger force exceeds a threshold force or during which the finger pressure exceeds a threshold pressure is greater than or equal to a threshold time length. According to some examples, the control system may be configured to determine whether to enable one or more emergency response features of the device based, at least in part, on the time threshold determination. Some embodiments may include other methods of detecting an emergency, such as determining a heart rate (e.g., based on fingerprint sensor data) and determining whether the heart rate equals or exceeds a threshold heart rate. In some examples, the emergency response function(s) may include initiating a phone call to an emergency response phone number and / or initiating a text message or phone call to a designated emergency communication recipient. For example, the emergency response phone number may be a publicly available emergency response phone number (such as 911 in the United States). In some examples, the designated emergency communication recipient may be a spouse, parent, caregiver, etc. In some instances, the one or more emergency response functions may include initiating an audio recording session, initiating a video recording session, capturing one or more photos, and / or causing one or more financial institution accounts to be locked.

[0057] Certain embodiments of the subject matter described in this disclosure can be implemented to achieve one or more of the following potential advantages. In some embodiments, a user can quickly trigger one or more emergency response functions through a discreet action in a manner that is not easily detected by one or more nearby persons. According to some such embodiments, a user can trigger one or more emergency response functions via a mobile device (such as a cellular phone) that includes a fingerprint sensor system. Because such mobile devices are widely deployed, a person can have an enhanced level of personal security based on embodiments of the present disclosure.

[0058] While force and pressure are different because pressure is force per unit area, the terms "force" and "pressure" are sometimes used interchangeably. According to some disclosed examples, a normal range of force or pressure applied by a user to an area of ​​a fingerprint sensor can be determined during the enrollment process. In some such examples, prompts regarding the current finger force or pressure can be part of the user enrollment process, for example, during a force or pressure calibration phase of the user enrollment process, or during a fingerprint data capture phase of the user enrollment process. However, in some instances, prompts regarding the current finger force or pressure can be part of a post-enrollment authentication process. Feedback regarding the current finger force or pressure can indicate whether the current finger force or pressure is too low, too high, or within an acceptable range for obtaining fingerprint data from the fingerprint sensor. In some instances, feedback can be based on both fingerprint image quality and finger force or pressure. In some examples, the control system can be configured to determine an optimal range of finger force or pressure that corresponds to the highest level or range of fingerprint image quality. By prompting the user to apply finger force or pressure within the optimal range, fingerprint image quality can be enhanced.

[0059] Furthermore, after establishing a "normal" force or pressure range for a user (in some instances, for a single finger of the user) during the enrollment process, instances of abnormally high force or pressure on the active area of ​​the fingerprint sensor can be detected. In some implementations, these instances can be the basis for triggering one or more emergency response functions. Alternatively, the user can establish a threshold finger force or finger pressure via user input (e.g., by interacting with a GUI). Various examples are disclosed herein.

[0060] FIG1A is a block diagram illustrating example components of a device according to some disclosed embodiments. As with other disclosed embodiments, the types, quantities, and arrangements of components shown in FIG1A are presented as examples only. Other implementations may have other types, quantities, and / or arrangements of components. In this example, device 101 includes a fingerprint sensor system 102 and a control system 106. Some embodiments of device 101 may include an interface system 104, a display system, and / or a force sensor 110.

[0061] The fingerprint sensor system 102 can be any suitable type of fingerprint sensor system, such as an optical fingerprint sensor system, a capacitive fingerprint sensor system, a resistive fingerprint sensor system, a radio frequency-based fingerprint sensor system, etc. In some examples, the fingerprint sensor system can be or include an ultrasonic fingerprint sensor system. Detailed examples are provided herein.

[0062] Some embodiments of device 101 may include an interface system 104. In some examples, interface system 104 may include a wireless interface system. In some embodiments, interface system 104 may include a user interface system, one or more network interfaces, one or more interfaces between control system 106 and a memory system, and / or one or more interfaces between control system 106 and one or more external device interfaces (e.g., a port or application processor).

[0063] The interface system 104 can be configured to provide communication between components of the device 101 (which can include wired or wireless communication, such as electrical communication, radio communication, etc.). In some such examples, the interface system 104 can be configured to provide communication between the control system 106 and the fingerprint sensor system 102, between the control system 106 and the display system 108 (if present), and between the control system 106 and the force sensor 110 (if present). According to some such examples, the interface system 104 can couple at least a portion of the control system 106 to the fingerprint sensor system 102 (and the display system 108 and / or the force sensor 110 (if present)) via, for example, a conductive material (such as a conductive wire or trace).

[0064] According to some examples, interface system 104 can be configured to facilitate communication between apparatus 101 and other devices and / or humans. In some such examples, interface system 104 can include one or more user interfaces. User interface system 104 can, for example, include one or more speakers, a touch and / or gesture sensor system, a haptic feedback system, etc. Although not shown in FIG. 1A or FIG. 1B , optional display system 108 can be considered part of interface system 104.

[0065] In some examples, interface system 104 may include one or more network interfaces and / or one or more external device interfaces (such as one or more universal serial bus (USB) interfaces and / or serial peripheral interfaces (SPI)). In some embodiments, in addition to the memory that control system 106 may include, device 101 may also include a memory system. In some examples, interface system 104 may include at least one interface between control system 106 and the memory system.

[0066] The control system 106 may include one or more general-purpose single-chip or multi-chip processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) or other programmable logic elements, discrete gate or transistor logic, discrete hardware components, or a combination thereof. According to some examples, the control system 106 may include specialized components for controlling the fingerprint sensor system 102 (as well as the display system 108 and / or the force sensor 110 (if present)). The control system 106 may also include (and / or be configured to communicate with) one or more memory devices, such as one or more random access memory (RAM) devices, read-only memory (ROM) devices, and the like. Thus, the device 101 may have a memory system including one or more memory devices, although the memory system is not shown in FIG. 1A or FIG. 1B . In some embodiments, the functionality of the control system 106 may be divided between one or more controllers or processors, such as between a dedicated sensor controller and an application processor of a mobile device. Some examples are described below.

[0067] If present in device 101, force sensor 110 may be a piezoresistive sensor, a capacitive sensor, a thin film sensor (e.g., a polymer-based thin film sensor), or another suitable type of force sensor. If force sensor 110 comprises a piezoresistive sensor, the piezoresistive sensor may comprise silicon, metal, polysilicon, and / or glass. In some examples, fingerprint sensor system 102 and force sensor 110 may be mechanically coupled. In some such examples, force sensor 110 may be integrated into the circuitry of fingerprint sensor system 102. However, in other embodiments, force sensor 110 may be separate from fingerprint sensor system 102. In some examples, fingerprint sensor system 102 and force sensor 110 may be indirectly coupled. For example, fingerprint sensor system 102 and force sensor 110 may each be coupled to a portion of device 101. In some such examples, fingerprint sensor system 102 and force sensor 110 may each be coupled to a portion of a control system.

[0068] However, some embodiments may not include a force sensor 110 separate from the fingerprint sensor system 102. In some such examples, the control system 106 may be configured to perform force detection and / or pressure detection based at least in part on fingerprint sensor data from the fingerprint sensor system 102.

[0069] Device 101 can be used in a variety of contexts, some examples of which are disclosed herein. For example, in some embodiments, a mobile device may include at least a portion of device 101. In some embodiments, a wearable device may include at least a portion of device 101. A wearable device may be, for example, a bracelet, armband, wristband, ring, headwear, or badge. In some embodiments, control system 106 may reside in more than one device. For example, a portion of control system 106 may reside in a wearable device, while another portion of control system 106 may reside in another device, such as a mobile device (e.g., a smartphone). In some such examples, interface system 104 may also reside in more than one device.

[0070] FIG1B is a block diagram illustrating example components of the apparatus of FIG1A according to some disclosed implementations. In this example, apparatus 101 includes the same elements described above with reference to FIG1A . Therefore, unless otherwise noted, the elements of FIG1B may be assumed to be as described above with reference to FIG1A .

[0071] However, in this embodiment, the fingerprint sensor system 102 is or includes an ultrasonic fingerprint sensor system. In some examples, as shown by the dashed lines within the fingerprint sensor system 102, the fingerprint sensor system 102 may include an ultrasonic receiver 103 and a separate ultrasonic transmitter 105. In some such examples, the ultrasonic transmitter 105 may include an ultrasonic plane wave generator, such as those described below.

[0072] Various examples of ultrasonic fingerprint sensors 102 are disclosed herein, some of which may include an ultrasonic receiver 103 and a separate ultrasonic transmitter 105, while others may not. Although shown as separate components in FIG. 1B , in some embodiments, the ultrasonic receiver 103 and ultrasonic transmitter 105 may be combined in an ultrasonic transceiver system. For example, in some embodiments, the fingerprint sensor system 102 may include a piezoelectric receiver layer, such as a polyvinylidene fluoride (PVDF) polymer layer or a polyvinylidene fluoride-trifluoroethylene (PVDF-TrFE) copolymer layer. In some embodiments, a separate piezoelectric layer may function as an ultrasonic transmitter. In some embodiments, a single piezoelectric layer may function as both a transmitter and a receiver. In some embodiments that include a piezoelectric layer, other piezoelectric materials, such as aluminum nitride (AlN) or lead zirconate titanate (PZT), may be used in the piezoelectric layer. In some examples, the fingerprint sensor system 102 may include an array of ultrasonic transducer elements, such as a piezoelectric micromachined ultrasonic transducer (PMUT) array, a capacitive micromachined ultrasonic transducer (CMUT) array, etc. In some such examples, PMUT elements in a single-layer PMUT array or CMUT elements in a single-layer CMUT array may function as both ultrasonic transmitters and ultrasonic receivers.

[0073] If the device 101 includes an ultrasonic transmitter 105 separate from the ultrasonic receiver 103, the interface system 104 can be configured to provide communication between at least a portion of the control system 106 and the ultrasonic transmitter 105 and between at least a portion of the control system 106 and the ultrasonic receiver 103.

[0074] The control system 106 can be configured to receive and process data from the fingerprint sensor system 102, for example, data from the ultrasonic receiver 103. If the device 101 includes a separate ultrasonic transmitter 105, the control system 106 can be configured to control the ultrasonic transmitter 105, for example, as disclosed elsewhere herein.

[0075] FIG2 illustrates a cross-section of a device according to some disclosed embodiments. As with other disclosed embodiments, the type, number, and arrangement of components, as well as the dimensions of the components, are merely examples. According to this example, device 101 is configured to perform at least some of the methods disclosed herein. According to this embodiment, device 101 includes an ultrasonic sensor system 102 comprising a piezoelectric layer 208, an electrode layer 210 on one side of piezoelectric layer 208, and a sensor pixel array 206 on a second, opposite side of piezoelectric layer 208. In this embodiment, piezoelectric layer 208 is an ultrasonic transceiver layer comprising one or more piezoelectric polymers.

[0076] According to this example, electrode layer 210 resides between passivation layer 212 and piezoelectric layer 208. In some examples, passivation layer 212 may include an adhesive such as an epoxy film, a polymer layer such as a polyethylene terephthalate (PET) layer, or the like.

[0077] In this embodiment, TFT layer 204 includes a TFT substrate and circuitry for sensor pixel array 206. TFT layer 204 can be a type of metal-oxide-semiconductor field-effect transistor (MOSFET) fabricated by depositing an active semiconductor layer, along with a dielectric layer and metal contact thin films, on a TFT substrate. In some examples, the TFT substrate can be a non-conductive material such as glass.

[0078] In this example, the device 101 includes a display system 108, which in this example includes an OLED display. Here, the OLED display is attached to a TFT layer 204 via an adhesive layer 202.

[0079] According to this embodiment, the TFT layer 204, the sensor pixel array 206, and the electrode layer 210 are electrically coupled to at least a portion of the control system 106 and one side of the ultrasonic transceiver layer 208 via a portion of the interface system 104, which in this example includes conductive material and a flexible printed circuit (FPC).

[0080] In this example, device 101 is configured to perform at least some of the methods disclosed herein. In this example, control system 106 is configured to control ultrasonic sensor system 102 to transmit one or more ultrasonic waves 213. According to this example, ultrasonic wave(s) 213 are transmitted through TFT layer 204, OLED display, and cover glass 208. According to this example, at least some reflections 214 of ultrasonic wave(s) 213 are caused by acoustic impedance contrast at (or near) an interface 215 between an outer surface of cover glass 208 and any object in contact with the outer surface, which may be air or the surface of a target object, such as the ridges and grooves of a fingerprint. (As used herein, the term "finger" may refer to any digit, including a thumb. Thus, a thumbprint will be considered a type of "fingerprint.") In some examples, at least some reflections 214 of ultrasonic wave(s) 213 are caused by acoustic impedance contrast within a target object, such as a finger. This impedance contrast can correspond to subepidermal features, such as papillary layer features, reticular layer features, subcutaneous features, vascular features, lymphatic vessel features, fat lobule features, muscle tissue features, bone features, etc.

[0081] According to some examples, reflections 214 of (multiple) ultrasonic waves 213 can be detected by electrode layer 210. A corresponding ultrasonic signal can be provided to control system 106. In some such embodiments, reflections 214 corresponding to the membrane / air interface can be detected by electrode layer 210, and a corresponding background ultrasonic signal can be provided to control system 106. In some such embodiments, the ultrasonic signal used by control system 106 for fingerprint-based authentication can be based on reflections 214 from the membrane / finger interface detected by sensor pixel array 206.

[0082] In some examples, control system 106 can be configured to estimate target object force or pressure (such as finger force or pressure) based on fingerprint sensor data received from fingerprint sensor system 102. In some such examples, the fingerprint sensor data can correspond to signals received from sensor pixel array 206. Alternatively or additionally, the fingerprint sensor data can correspond to signals received from electrode layer 210. In some embodiments, control system 106 can be configured to detect or estimate finger force or pressure according to one or more of the methods described in detail below.

[0083] In some embodiments, control system 106 can be configured to detect or estimate the heart rate of a person, such as a user of device 101. According to some such embodiments, control system 106 can be configured to detect or estimate the heart rate based, at least in part, on fingerprint sensor data received from fingerprint sensor system 102. In some such examples, the fingerprint sensor data can correspond to signals received from sensor pixel array 206. Alternatively or additionally, the fingerprint sensor data can correspond to signals received from electrode layer 210. In some embodiments, control system 106 can be configured to detect or estimate the heart rate according to one or more of the methods described in detail below.

[0084] In some embodiments, the control system 106 can be configured to detect or estimate the person's heart rate during the registration process. According to some embodiments, the control system 106 can be configured to detect or estimate the person's heart rate after the registration process, for example, on a periodic basis and / or in response to a heart rate determination trigger (such as inertial sensor data indicating acceleration of the device). In some such embodiments, the control system 106 can be configured to determine one or more average or mean heart rates of the person, such as an average resting heart rate, an average heart rate when the person is at rest, and an average heart rate when the person is engaged in an activity such as walking or driving.

[0085] According to some embodiments, the control system 106 can be configured to obtain heart rate data from another device, such as a smartwatch, a health and fitness tracking device, etc. The heart rate data can include one or more of the following: average resting heart rate, average heart rate when a person is standing still, and average heart rate when a person is performing an activity, such as walking or driving.

[0086] FIG3 is a flow chart providing example blocks for some of the methods disclosed herein. The blocks of FIG3 may be performed, for example, by the apparatus 101 of FIG1A , FIG1B , or FIG2 , or by a similar apparatus. As with other methods disclosed herein, the method 300 outlined in FIG3 may include more or fewer blocks than shown. Furthermore, the blocks of the methods disclosed herein do not necessarily need to be performed in the order indicated. For example, in some instances, block 305 of FIG3 may be performed before block 303. In some examples, some blocks of the methods disclosed herein may be performed simultaneously.

[0087] According to this example, block 303 includes receiving, by the control system, fingerprint sensor data from a fingerprint sensor system. In some instances, receiving the fingerprint sensor data may include receiving ultrasonic fingerprint sensor data. In some examples, the fingerprint sensor data may correspond to signals received from a sensor pixel array (such as sensor pixel array 206 of FIG. 2 ) of the ultrasonic fingerprint sensor system. Alternatively or additionally, the fingerprint sensor data may correspond to signals received from an electrode layer (such as electrode layer 210 of FIG. 2 ) of the ultrasonic fingerprint sensor system. However, the fingerprint sensor system may or may not be (or include) an ultrasonic fingerprint sensor system, depending on the particular implementation.

[0088] In this example, block 305 includes detecting, by the control system and based on the fingerprint sensor data, the presence of a finger on the outer surface of the device within the fingerprint sensor system's area. In some alternative examples, the device may include a touch sensor system, and block 305 may include receiving input from the touch sensor system indicating whether the target object is within the fingerprint sensor system's active area on the outer surface of the device. In some examples, block 305 may include receiving input from the touch sensor system and / or the fingerprint sensor system indicating whether the target object within the fingerprint sensor system's active area on the outer surface of the device has one or more features of a finger (such as a finger shape, fingerprint features, etc.). In some examples, block 305 may include receiving input from the fingerprint sensor system indicating whether the target object within the fingerprint sensor system's active area on the outer surface of the device has one or more subepidermal features (such as papillary layer features, reticular layer features, subcutaneous features, vascular features, lymphatic vascular features, fat lobule features, muscle tissue features, bone features, etc.).

[0089] According to this example, block 307 includes determining, by the control system, a finger force or finger pressure on an external surface of the device based on the fingerprint sensor data. According to some such examples, the fingerprint sensor data may be ultrasonic fingerprint sensor data, or may include ultrasonic fingerprint sensor data. In some such examples, the ultrasonic fingerprint sensor data may be received via an electrode layer proximate to a piezoelectric layer of the ultrasonic fingerprint sensor system. Alternatively or additionally, in some examples, the ultrasonic fingerprint sensor data may be received via an ultrasonic sensor pixel array. Detailed examples for estimating finger force or finger pressure based on the fingerprint sensor data are disclosed herein. However, in some alternative implementations, block 307 may include determining the finger force or finger pressure based on force sensor data from a force sensor that may be separate from the fingerprint sensor system 102 (such as the optional force sensor 110 of FIG. 1A or FIG. 1B ).

[0090] In this example, block 309 includes determining, by the control system and based on the fingerprint sensor data, a time threshold. Depending on the embodiment, determining the time threshold includes determining whether the length of time during which the finger force exceeds the threshold finger force or the finger pressure exceeds the threshold finger pressure is greater than or equal to the threshold time length. The threshold finger force and / or threshold finger pressure may vary depending on the particular embodiment. In some instances, the threshold finger force and / or threshold finger pressure may be determined based on a range of finger force and / or finger pressure determined and stored during the enrollment process. For example, if the user's normal finger force range during the enrollment process is between 50 grams-force and 100 grams-force, the threshold finger force may be set to 100 grams-force, 110 grams-force, 120 grams-force, 130 grams-force, and so on. According to some examples, the threshold finger force may be based on an average finger force and / or threshold finger pressure during the enrollment process. In some such examples, the threshold finger force may be 110%, 115%, 120%, 125%, 130%, 135%, 140%, 145%, 150%, etc., of the average finger force during the enrollment process.

[0091] In some implementations, the threshold finger force and / or threshold finger pressure may be user selectable (eg, via a GUI). Some examples are disclosed herein.

[0092] The threshold time length may also vary depending on the specific implementation. In some examples, the threshold time length may be 1 second or less, for example, 400 milliseconds (ms), 500 ms, 600 ms, 700 ms, 800 ms, 900 ms, 1 second, etc. However, in some examples, the threshold time length may be greater than 1 second. It can be observed that examples with longer threshold time lengths may be more effective in avoiding false positives (e.g., instances of unintentional hard presses on the active area of ​​the fingerprint sensor), while examples with shorter threshold time lengths may be more effective in providing a swift emergency response during emergencies. In some embodiments, the threshold time length may be user-selectable (e.g., via a GUI). Some examples are disclosed herein.

[0093] According to this example, block 311 includes determining, by the control system and based at least in part on the time threshold, whether to enable one or more emergency response functions of the device. In some examples, block 311 may include determining whether a threshold finger force and / or threshold finger pressure occurs for a threshold length of time for a threshold number of instances (e.g., 1 instance, 2 instances, 3 instances, etc.). In some embodiments, the threshold number of instances may be user-selectable. Instances in which the threshold finger pressure persists for at least the threshold time interval may be referred to herein as "finger pressure events," which term may be used synonymously with "finger force events" herein.

[0094] The one or more emergency response functions may vary depending on the specific implementation. In some examples, the one or more emergency response functions may be user-selectable. According to some examples, the one or more emergency response functions may include one or more of the following: initiating a phone call to an emergency response phone number, initiating a text message and / or phone call to a designated emergency communication recipient, etc. In some examples, the one or more emergency response functions may include one or more of the following: initiating an audio recording session, initiating a video recording session, capturing one or more photos, or causing one or more financial institution accounts to be locked.

[0095] In some embodiments, method 300 may include identifying a specific finger. For example, method 300 may include determining which of the user's previously registered fingers was detected in block 305 and which specific finger is applying the force and / or pressure determined in block 307. As described elsewhere herein, some disclosed embodiments include determining a user's characteristic finger force range and / or finger pressure range. In some such examples, the finger force range and / or finger pressure range may vary from finger to finger. For example, a user may tend to press harder with their right thumb than with their right pinky. In some embodiments, the threshold finger force and / or threshold finger pressure described above with reference to block 309 may vary from finger to finger.

[0096] In some embodiments, the method 300 may include determining, by the control system, whether the identified finger is the finger most commonly used for the authentication process. For example, a user may typically use the left thumb for the authentication process.

[0097] According to some embodiments, method 300 may include determining, by the control system, whether the identified finger is a finger that has been selected to trigger one or more emergency response functions. For example, a user may intentionally select a different finger than the finger most commonly used for the authentication process to trigger one or more emergency response functions. For example, if the user typically uses their right thumb for the authentication process, the user (or device 101) may select a different finger (e.g., their right index finger) to trigger one or more emergency response functions. According to some such examples, determining whether to enable one or more emergency response functions (in block 311) may be based at least in part on whether the finger has been selected to trigger the one or more emergency response functions.

[0098] In some embodiments, method 300 may include a pattern determination process in which the control system determines whether a complete pattern has been entered via the fingerprint sensor system. In some such examples, determining whether to enable one or more emergency response functions may be based at least in part on the pattern determination process. In some examples, the complete pattern may be multiple instances of finger force or finger pressure applied within an area of ​​the fingerprint sensor system (e.g., within an active area of ​​the fingerprint sensor system, within a designated area of ​​the fingerprint sensor system (e.g., an area corresponding to a displayed fingerprint sensor system icon), etc.). For example, the complete pattern may be or may include multiple instances of finger force exceeding a threshold finger force and / or multiple instances of finger pressure exceeding a threshold finger pressure ("finger pressure events"), for example, during a determined time interval. In one such example, the complete pattern may be two instances of finger force exceeding the threshold finger force ("finger force events") within a time interval (e.g., 5 seconds or less, 4 seconds or less, 3 seconds or less, 2 seconds or less, etc.).

[0099] According to some embodiments, if the control system determines that a complete pattern has not been received via the fingerprint sensor system, method 300 may include controlling, by the control system, the device to provide a prompt indicating that if a specified user action is taken, at least one of the one or more emergency response functions will be enabled. In some such examples, providing the prompt may include presenting a visual prompt, such as presenting a graphical user interface (GUI) on a display device of the device and / or providing an audio prompt via a speaker system of the device. According to some examples, the specified user action may be or may include additional instances of finger force or additional instances of finger pressure to be applied in the area of ​​the fingerprint sensor system.

[0100] In some embodiments, method 300 may include the control system performing an authentication process based at least in part on fingerprint sensor data. In some such examples, the authentication process may be based at least in part on fingerprint features determined by the control system based on the received fingerprint sensor data. Fingerprint features may include, for example, fingerprint ridge ends, fingerprint ridge bifurcations, short ridges, and / or short islands, as well as the locations of such fingerprint features. The authentication process may include comparing currently acquired fingerprint features with previously acquired fingerprint features (e.g., fingerprint features acquired during an enrollment process). In some examples, the authentication process may be based at least in part on subcutaneous features determined by the control system based on the fingerprint sensor data. Subcutaneous features may include, for example, papillary layer features, reticular layer features, subcutaneous features, vascular features, lymphatic vessel features, fat lobule features, muscle tissue features, and / or bone features. The authentication process may include comparing currently acquired subcutaneous features with previously acquired subcutaneous features (e.g., subcutaneous features acquired during an enrollment process).

[0101] As described above, in some embodiments, the control system can be configured to determine a heart rate based on the received fingerprint sensor data. In some examples, method 300 can include determining whether the heart rate equals or exceeds a threshold heart rate. For example, the threshold heart rate can be based at least in part on one or more previously observed heart rates of the person, such as a previously observed resting heart rate, a previously observed heart rate while the person is performing a task such as walking, etc.

[0102] In some examples, the threshold heart rate can be set to a level at which a person's heart rate indicates that the person is likely to be fearful and / or stressed. For example, if a person's average heart rate is 90 beats per minute, the threshold heart rate can be set to a level above 90 beats per minute, such as 100, 105, 110 beats per minute, etc.

[0103] Some examples may implement more than one threshold heart rate. For example, if a person appears to be stationary (e.g., based on inertial sensor data received from an inertial sensor system), some embodiments may apply one threshold heart rate, and if the person appears to be engaging in activity, such as walking, another threshold heart rate may be applied. For example, if the person's average resting heart rate is 70 beats per minute and the person appears to be stationary, the threshold heart rate may be set to a level above 70 beats per minute, such as 80, 85, 90, etc.

[0104] Thus, method 300 may include determining a heart rate and determining whether the heart rate equals or exceeds a threshold heart rate. In some examples, the threshold heart rate may depend on the context, such as whether the person is stationary. According to some examples, the determination of whether to enable one or more emergency response functions of the device may be based at least in part on whether the heart rate equals or exceeds the threshold heart rate. For example, if the time threshold determination of block 309 indicates that the length of time that the finger force exceeds the threshold finger force or the length of time that the finger pressure exceeds the threshold finger pressure is greater than or equal to the threshold time length, and the heart rate equals or exceeds the threshold heart rate, then in some embodiments, the control system may determine that one or more emergency response functions of the device are to be enabled.

[0105] Then, according to some examples, if the control system determines that the heart rate does not equal or exceed the threshold heart rate, some embodiments of method 300 may include controlling the device, by the control system, to provide a prompt indicating that at least one of the one or more emergency response functions will still be enabled if the first specified user action is taken. The prompt may be or include an audio prompt and / or a visual prompt. In some examples, providing the prompt may include presenting a graphical user interface (GUI) on a display device of the device. Some examples are disclosed herein and described below. According to some examples, the first specified user action may be or include an additional instance of finger force or additional instance of finger pressure to be applied in the fingerprint sensor system area (e.g., at or above the threshold finger force or threshold finger pressure).

[0106] According to some embodiments, the control system can be configured to estimate a person's anxiety level based on one or more metrics other than heart rate. In some such examples, estimating the anxiety level can include detecting the presence or absence of finger sweat, for example, based on the presence or absence of finger sweat on the finger, based on the presence or absence of moisture, oil, or other residue between the finger and an external surface of the device, etc. According to some examples, if the control system determines that the heart rate equals or exceeds a threshold heart rate, method 300 can include estimating the anxiety level by the control system based on the fingerprint sensor data.

[0107] In some examples, if the control system has determined that the heart rate is equal to or exceeds a threshold heart rate and the control system detects an indicator of anxiety (e.g., the presence of finger sweating), method 300 may include, by the control system, enabling one or more emergency response functions. In some examples, method 300 may include determining user location data before enabling the one or more emergency response functions and providing at least one emergency response communication to the user location data. For example, if the emergency response function(s) include initiating a text message to a designated emergency communication recipient, the text message may include the user location data.

[0108] According to some examples, if the control system has determined that the heart rate is equal to or exceeds a threshold heart rate, and the control system has not detected an anxiety metric, method 300 may include controlling, by the control system, the device to provide a prompt indicating that if a second specified user action is taken, at least one of the one or more emergency response functions will be enabled. The prompt may be or include an audio prompt and / or a visual prompt. In some examples, the second specified user action may be or include an additional instance of finger force or finger pressure to be applied in the fingerprint sensor system area (e.g., at or above a threshold finger force or threshold finger pressure).

[0109] FIG4 is a flow chart providing example blocks for some of the methods disclosed herein. The blocks of FIG4 may be performed, for example, by the apparatus 101 of FIG1A , FIG1B , or FIG2 , or by a similar apparatus. As with other methods disclosed herein, the method 400 outlined in FIG4 may include more or fewer blocks than shown. Furthermore, the blocks of the methods disclosed herein do not necessarily need to be performed in the order indicated. For example, in some instances, block 407 of FIG4 may be performed before block 405. In some examples, some blocks of the methods disclosed herein may be performed simultaneously.

[0110] According to this example, block 403 includes determining whether a system, sometimes referred to herein as a "smart SOS system," is enabled on a device, such as the mobile device executing method 400. The smart SOS system may implement some or all aspects of the disclosed methods for determining whether to enable one or more emergency response functions, enabling such emergency response functions, and the like. As described above, while covert actions may not always correspond to a risk of harm to people or property, as used herein, covert actions are considered a subset of possible emergency response functions. Therefore, in some examples, the smart SOS system may implement one or more covert actions. In this example, block 403 includes confirming that the smart SOS system is enabled on the device. In some examples, if it is determined in block 403 that the smart SOS system is not enabled, the process may still proceed to block 405 and may include blocks 407, 408, and 411. However, if it is determined in block 403 that the smart SOS system is not enabled, the method may not include blocks 409, 413, 417, or 419.

[0111] In this example, block 405 includes detecting, by the control system, the presence of a finger on the outer surface of the device within the fingerprint sensor system's area. In some examples, the device may include a touch sensor system, and block 405 may include receiving input from the touch sensor system indicating whether the target object is on the outer surface of the device within the fingerprint sensor system's active area. In some examples, block 405 may include receiving input from the touch sensor system and / or the fingerprint sensor system indicating whether the target object on the outer surface of the device within the fingerprint sensor system's active area has one or more features of a finger (such as a finger shape, fingerprint features, etc.). In some examples, block 405 may include receiving input from the fingerprint sensor system indicating whether the target object on the outer surface of the device within the fingerprint sensor system's active area has one or more subepidermal features (such as papillary layer features, reticular layer features, subcutaneous features, vascular features, lymphatic vascular features, fat lobule features, muscle tissue features, bone features, etc.).

[0112] According to this example, block 407 includes receiving, by the control system, fingerprint sensor data from the fingerprint sensor system. In some instances, receiving the fingerprint sensor data may include receiving ultrasonic fingerprint sensor data. In some examples, the fingerprint sensor data may correspond to signals received from a sensor pixel array (such as sensor pixel array 206 of FIG. 2 ) of the ultrasonic fingerprint sensor system. Alternatively or additionally, the fingerprint sensor data may correspond to signals received from an electrode layer (such as electrode layer 210 of FIG. 2 ) of the ultrasonic fingerprint sensor system. However, the fingerprint sensor system may or may not be (or include) an ultrasonic fingerprint sensor system, depending on the particular implementation.

[0113] In this example, block 408 is an authentication process based at least in part on the fingerprint sensor data obtained in block 407. According to this example, block 408 includes determining whether the fingerprint features and / or subcutaneous features derived from the fingerprint sensor data obtained in block 407 match previously obtained fingerprint features and / or subcutaneous features stored in a database (DB). The fingerprint features and / or subcutaneous features in the database can, for example, be obtained during a registration process. In this example, if a match is determined in block 408, method 400 proceeds to block 409. In some examples, if a match is determined in block 408, method 400 may include providing a notification (e.g., an audio notification, a visual notification, and / or a tactile response) indicating the absence of a match. In some instances, if a match is determined in block 408, the user may be prompted to present the finger again, present another registered finger, clean the surface of the device in the fingerprint sensor area, etc. In some examples, block 408 may include other disclosed authentication methods.

[0114] According to this example, block 409 includes determining the current finger pressure on the outer surface of the device within the active fingerprint sensor area and determining whether the current finger pressure is at or above a threshold finger pressure. For example, block 409 can be performed as described above with reference to block 307 of FIG. 3 and / or as described above in the description of the finger pressure threshold in block 309. In this example, if it is determined in block 409 that the current finger pressure is not equal to or exceeds the threshold finger pressure, the process continues to block 411 and the device is unlocked. The device is unlocked because, in this example, the authentication process of block 408 was successfully completed.

[0115] In this example, if it is determined in block 409 that the current finger pressure equals or exceeds the threshold finger pressure, the process continues to block 413. According to this example, block 413 includes determining whether the threshold finger pressure is maintained for at least a threshold time interval. In some implementations, block 413 may include a time threshold determination such as described above with reference to block 309 of FIG. 3 .

[0116] In some embodiments, the threshold finger pressure and / or the threshold time interval may be user selectable, for example, as described below with reference to Figures 9 and 10. In this example, if it is determined in block 413 that the threshold finger pressure has not been maintained for at least the threshold time interval, the process continues to block 415 and the device is unlocked.

[0117] However, if it is determined in block 413 that the threshold finger pressure has been maintained for at least the threshold time interval, the process continues to block 417. In this example, block 417 includes providing a notification via the device that an emergency response will occur after a specified number of finger pressure events. In this context, a finger pressure event refers to an instance in which the threshold finger pressure has been maintained for at least the threshold time interval. In some examples, block 417 may include an audio prompt and / or a visual prompt. In some examples, if no additional finger pressure events are required to trigger an emergency response, the notification in block 417 may be omitted.

[0118] In some embodiments, the number of finger pressure events required to trigger the emergency response function can be user-selectable, e.g., as described below with reference to FIG9. As described above and below with reference to FIG12, in some embodiments, the number of finger pressure events required to trigger the emergency response function(s) can be dependent on the user's current heart rate (e.g., estimated by the control system based on received ultrasonic sensor data) and / or other indications of the user's anxiety level (such as the presence or absence of sweating).

[0119] Figures 5, 6, and 7 illustrate examples of visual cues that may be displayed in the context of the method of Figure 4 in some embodiments. More specifically, Figures 5, 6, and 7 illustrate examples of graphical user interfaces (GUIs) that may be displayed in some embodiments of block 417.

[0120] In the example shown in FIG5 , the control system is controlling the display of the mobile device to display GUI 500, which indicates that the mobile device is unlocking and further indicates that two more high-pressure clicks (finger pressure events) will enable one or more emergency response functions of the device. In FIG5 , the control system is controlling the display of the mobile device to display GUI 600, which indicates that the mobile device is unlocking and further indicates that one more high-pressure click (finger pressure event) will enable one or more emergency response functions of the device. In FIG5 , the control system is controlling the display of the mobile device to display GUI 700, which indicates that the mobile device is enabling one or more emergency response functions of the device (implicitly indicating that no more finger pressure events will be required to trigger the emergency response functions).

[0121] Referring again to FIG. 4 , at block 418 , a determination is made as to whether additional finger pressure events are required before the device's emergency response function is triggered. For example, if block 417 includes a notification that an emergency response will occur after three more finger pressure events, two more finger pressure events, or one more finger pressure event, then block 418 determines that more events are required before the device's emergency response function is triggered. Therefore, in this example, the process reverts to block 409 .

[0122] However, if block 417 includes a notification that no further finger pressure events are required to trigger the emergency response (e.g., "Emergency response will now be triggered"), in this example, a determination will be made in block 418 that no further events are required, and the process will continue to block 419 where the emergency response function of the device is triggered. Block 419 may include providing any one or more of the disclosed emergency response functions.

[0123] In optional block 421, the device may be unlocked. This may or may not be a desirable feature, depending on the context. For example, if the device is unlocked and subsequently stolen, the thief would be able to access the unlocked device. On the other hand, it may be advantageous for the user to access device functions in addition to those that may be enabled as part of the emergency response. Furthermore, if the emergency response is not in the context of possible personal injury or property theft (e.g., if the user merely wishes to perform one or more covert functions), it may be advantageous for the user to access certain device functions in addition to those that may be enabled as part of the emergency response. Thus, in some examples, if one or more emergency response functions are triggered, the user may have the option of unlocking the device, e.g., as described below with reference to FIG. 9 .

[0124] Figures 8, 9, and 10 illustrate examples of GUIs that may be presented according to some embodiments. In these examples, Figures 8, 9, and 10 illustrate examples of GUIs for enabling and configuring a smart SOS system, which may implement some or all aspects of the disclosed methods for determining whether to enable one or more emergency response functions, enabling such emergency response functions, and the like. As described above, certain aspects of the smart SOS system may correspond to covert activities, which may or may not correspond to situations where individuals or property are in danger, depending on the specific embodiment and / or scenario. As with other disclosed examples, the type, quantity, and arrangement of components in Figures 8, 9, and 10 are provided for illustrative purposes only. Other examples may include different types, quantities, and / or arrangements of components.

[0125] Figure 8 shows an example GUI 800 for enabling or disabling the Smart SOS system. In this example, GUI 800 is an example of a GUI for configuring features of a fingerprint sensor, which may or may not be an ultrasonic fingerprint sensor. According to this example, GUI 800 may be presented in response to user interaction with the main device setup GUI, or in response to user interaction with a lower-level GUI accessible directly or indirectly from the main device setup GUI. In other examples, the GUI for enabling or disabling the Smart SOS system may not be presented within the context of a GUI for configuring other features of the fingerprint sensor, but rather as a separate GUI.

[0126] 8 , a user can interact with GUI portion 805 to turn the Smart SOS system on or off. In this example, GUI portion 805 includes a brief text description of the Smart SOS system and notes that the user can interact with GUI portion 805 to configure the Smart SOS system.

[0127] FIG9 illustrates an example of a GUI that may be presented in response to a user enabling the Smart SOS system and indicating a desire to configure the Smart SOS system via interaction with GUI portion 805. According to this example, GUI 900 presents various categories of Smart SOS system configurations. In this example, the Smart SOS system configurations include pressure sensitivity configuration (for setting a threshold finger pressure for a finger pressure event), timer count configuration (for setting a threshold duration for a finger pressure event), and pattern mode configuration (for setting the number of finger pressure events required to activate an emergency response function, for example).

[0128] In this example, GUI 900 also includes fields for allowing the user to select whether to unlock the device after enabling one or more emergency response functions and whether to enable one or more covert activities. According to this example, GUI 900 includes fields for allowing the user to select whether the emergency response function(s) include sending a text message or initiating a phone call to an emergency recipient, whether the emergency response function(s) include locking a financial institution account, whether the emergency response function(s) include turning on a camera (in this example, the front-facing camera, but in other examples, it may be or may include one or more other cameras), whether the emergency response function(s) include turning on a microphone, and whether the emergency response function(s) include displaying a notification on the locked screen. According to the example shown in FIG9 , a user can interact (e.g., touch) any of the fields indicated within GUI portion 905 to cause one or more related GUIs to appear on the device, which the user can interact with to customize the Smart SOS system.

[0129] In this example, GUI 1000 of FIG. 10 is presented in response to a user touching the "Set Pressure Sensitivity" area of ​​GUI portion 905. In this example, a user can interact with GUI 1000 to set a threshold finger pressure for a finger pressure event. According to this example, GUI 1000 includes a fingerprint sensor area icon 1005 indicating the active area (or at least a portion of the active area) of the fingerprint sensor system, a pressure gauge 1010, and a text prompt 1015. Here, text prompt 1015 encourages the user to press fingerprint sensor area icon 1005 to set a threshold finger pressure for a finger pressure event that could potentially trigger emergency response function(s). In response to pressure on the active area of ​​the fingerprint sensor system, pressure gauge 1010 will indicate the pressure currently being applied by the finger pressing on fingerprint sensor area icon 1005. According to this example, pressure gauge 1010 indicates a recommended finger pressure range suitable for finger pressure events that could potentially trigger emergency response function(s).

[0130] FIG11 is a flow chart providing example blocks for some of the methods disclosed herein. The blocks of FIG11 may be performed, for example, by the apparatus 101 of FIG1A , FIG1B , or FIG2 , or by a similar apparatus. As with other methods disclosed herein, the method 1100 outlined in FIG11 may include more or fewer blocks than shown. Furthermore, the blocks of the methods disclosed herein do not necessarily need to be performed in the order indicated. For example, in some instances, block 1105 of FIG11 may be performed before block 1103. In some examples, some blocks of the methods disclosed herein may be performed simultaneously.

[0131] According to this example, block 1103 includes receiving, by the control system, fingerprint sensor data from a fingerprint sensor system. In some instances, receiving the fingerprint sensor data may include receiving ultrasonic fingerprint sensor data. In some examples, the fingerprint sensor data may correspond to signals received from a sensor pixel array (such as sensor pixel array 206 of FIG. 2 ) of an ultrasonic fingerprint sensor system. Alternatively or additionally, the fingerprint sensor data may correspond to signals received from an electrode layer (such as electrode layer 210 of FIG. 2 ) of an ultrasonic fingerprint sensor system. However, the fingerprint sensor system may or may not be (or include) an ultrasonic fingerprint sensor system, depending on the particular implementation.

[0132] In this example, block 1105 includes detecting, by the control system and based on the fingerprint sensor data, the presence of a finger on the outer surface of the device within the fingerprint sensor system's area. In some examples, the device may include a touch sensor system, and block 1105 may include receiving input from the touch sensor system indicating whether the target object is on the outer surface of the device within the fingerprint sensor system's active area. In some examples, block 1105 may include receiving input from the touch sensor system and / or the fingerprint sensor system indicating whether the target object on the outer surface of the device within the fingerprint sensor system's active area has one or more features of a finger (such as a finger shape, fingerprint features, etc.). In some examples, block 1105 may include receiving input from the fingerprint sensor system indicating whether the target object on the outer surface of the device within the fingerprint sensor system's active area has one or more subepidermal features (such as papillary layer features, reticular layer features, subcutaneous features, vascular features, lymphatic vascular features, fat lobule features, muscle tissue features, bone features, etc.).

[0133] According to this example, block 1107 includes determining, by the control system and based on the fingerprint sensor data, a finger force or finger pressure on the external surface of the device. According to some such examples, the fingerprint sensor data may be ultrasonic fingerprint sensor data, or may include ultrasonic fingerprint sensor data. In some such examples, the ultrasonic fingerprint sensor data may be received via an electrode layer proximate to a piezoelectric layer of the ultrasonic fingerprint sensor system. Alternatively or additionally, in some examples, the ultrasonic fingerprint sensor data may be received via an ultrasonic sensor pixel array. Detailed examples for estimating finger force or finger pressure based on the fingerprint sensor data are disclosed herein. However, in some alternative embodiments, block 1107 may include determining the finger force or finger pressure based on force sensor data from a force sensor that may be separate from the fingerprint sensor system 102 (such as the optional force sensor 110 of FIG. 1A or FIG. 1B ).

[0134] In this example, block 1109 includes determining, by the control system and based at least in part on the received fingerprint sensor data, a heart rate. In some alternative examples, method 1100 may include determining the heart rate based on input from another device, such as a smartwatch, a fitness tracker, or the like. In some examples, method 1100 may include determining whether the heart rate equals or exceeds a threshold heart rate. For example, the threshold heart rate may be based at least in part on one or more previously observed heart rates of the person, such as a previously observed resting heart rate, a previously observed heart rate while the person was performing a task, such as walking, or the like.

[0135] According to this example, block 1111 includes determining, by the control system and based at least in part on the heart rate and finger force or pressure, whether to enable one or more emergency response functions of the device. The one or more emergency response functions may vary depending on the particular implementation. In some examples, the one or more emergency response functions may be user-selectable. According to some examples, the one or more emergency response functions may include: initiating a phone call to an emergency response phone number, initiating a text message and / or phone call to a designated emergency communication recipient, etc. In some examples, the one or more emergency response functions may include one or more of: initiating an audio recording session, initiating a video recording session, capturing one or more photos, or causing one or more financial institution accounts to be locked.

[0136] If the control system determines that the heart rate does not equal or exceed the threshold heart rate, some embodiments of method 1100 may include controlling the device, by the control system, to provide a prompt indicating that at least one of the one or more emergency response functions will be enabled if a first specified user action is taken. The prompt may be or include an audio prompt and / or a visual prompt. In some examples, providing the prompt may include presenting a graphical user interface (GUI) on a display device of the device. Some examples are disclosed herein. According to some examples, the first specified user action may be or include an additional instance of finger force or additional instance of finger pressure to be applied in an area of ​​the fingerprint sensor system (e.g., at or above a threshold finger force or threshold finger pressure).

[0137] According to some embodiments, method 110 may include, by the control system, determining a time threshold, including determining whether the length of time after the finger force exceeds a threshold finger force or after the finger pressure exceeds a threshold finger pressure is greater than or equal to a threshold time length. The threshold finger force and / or threshold finger pressure may vary depending on the specific embodiment. In some examples, the threshold finger force and / or threshold finger pressure may be determined based on a range of finger force and / or finger pressure determined and stored during the enrollment process. For example, if the user's normal finger force range during the enrollment process is between 50 grams-force and 100 grams-force, the threshold finger force may be set to 100 grams-force, 110 grams-force, 120 grams-force, 130 grams-force, and so on. According to some examples, the threshold finger force may be based on an average finger force and / or the threshold finger pressure may be based on an average finger pressure during the enrollment process. In some such examples, the threshold finger force may be 110%, 115%, 120%, 125%, 130%, 135%, 140%, 145%, 150%, etc. of the average finger force during the enrollment process. In some implementations, the threshold finger force and / or threshold finger pressure may be user-selectable.

[0138] The threshold time length may also vary depending on the specific implementation. In some examples, the threshold time length may be 1 second or less, for example, 400 milliseconds (ms), 500 ms, 600 ms, 700 ms, 800 ms, 900 ms, 1 second, etc. However, in some examples, the threshold time length may be greater than 1 second. It can be observed that examples with longer threshold time lengths may be more effective in avoiding false positives (e.g., examples of unintentional hard presses on the active area of ​​the fingerprint sensor), while examples with shorter threshold time lengths may be more effective in providing a rapid emergency response during an emergency.

[0139] In some examples, method 1100 may include determining whether a threshold number of instances (e.g., 1 instance, 2 instances, 3 instances, etc.) of a threshold finger force and / or a threshold finger pressure occurs during a threshold length of time. In some implementations, the threshold number of instances may be user-selectable.

[0140] In some embodiments, method 1100 may include identifying a specific finger. For example, method 1100 may include determining which of the user's previously registered fingers is detected in block 1105, and which specific finger is applying the force and / or pressure determined in block 1107. As described elsewhere herein, some disclosed embodiments include determining a user's characteristic finger force range and / or finger pressure range. In some such examples, the finger force range and / or finger pressure range may vary from finger to finger. For example, a user may tend to press harder with their right thumb than with their right pinky. In some embodiments, the threshold finger force and / or threshold finger pressure may vary from finger to finger.

[0141] In some embodiments, the method 1100 may include determining, by the control system, whether the identified finger is the finger most commonly used for the authentication process. For example, a user may typically use the left thumb for the authentication process.

[0142] According to some implementations, method 1100 may include determining, by the control system, whether the identified finger is a finger that has been selected to trigger one or more emergency response functions. For example, a user may intentionally select a different finger than the finger most commonly used for the authentication process to trigger one or more emergency response functions. For example, if the user typically uses their right thumb for the authentication process, the user (or device 101) may select a different finger (e.g., their right index finger) to trigger one or more emergency response functions. According to some such examples, determining whether to enable one or more emergency response functions (in block 1111) may be based at least in part on whether the finger has been selected to trigger the one or more emergency response functions.

[0143] In some embodiments, method 1100 may include the control system performing an authentication process based at least in part on fingerprint sensor data. In some such examples, the authentication process may be based at least in part on fingerprint features determined by the control system based on the fingerprint sensor data. Fingerprint features may include, for example, fingerprint ridge ends, fingerprint ridge bifurcations, short ridges, and / or short islands, as well as the locations of such fingerprint features. The authentication process may include comparing currently acquired fingerprint features with previously acquired fingerprint features (e.g., fingerprint features acquired during an enrollment process). In some examples, the authentication process may be based at least in part on subcutaneous features determined by the control system based on the fingerprint sensor data. Subcutaneous features may include, for example, papillary layer features, reticular layer features, subcutaneous features, vascular features, lymphatic vessel features, fat lobule features, muscle tissue features, and / or bone features. The authentication process may include comparing currently acquired subcutaneous features with previously acquired subcutaneous features (e.g., subcutaneous features acquired during an enrollment process).

[0144] According to some examples, method 1100 may include one or more aspects described above with reference to FIG. 3 and / or aspects disclosed elsewhere herein (e.g., the details described below with reference to FIG. 12 ), even if such details are not presented in the description of FIG. 11 .

[0145] FIG12 is a flow chart providing example blocks for some of the methods disclosed herein. The blocks of FIG12 may be performed, for example, by the apparatus 101 of FIG1A , FIG1B , or FIG2 , or by a similar apparatus. As with other methods disclosed herein, the method 1200 outlined in FIG12 may include more or fewer blocks than shown. Furthermore, the blocks of the methods disclosed herein do not necessarily need to be performed in the order indicated. For example, in some instances, block 1207 of FIG12 may be performed before block 1205. In some examples, some blocks of the methods disclosed herein may be performed simultaneously.

[0146] According to this example, block 1203 includes determining whether a system, sometimes referred to herein as a "smart SOS system," is enabled on a device, such as the mobile device executing method 1200. The smart SOS system may implement some or all aspects of the disclosed methods for determining whether to enable one or more emergency response functions, enabling such emergency response functions, and the like. As described above, while covert actions may not always correspond to a risk of harm to people or property, as used herein, covert actions are considered a subset of possible emergency response functions. Therefore, in some examples, the smart SOS system may implement one or more covert actions. In this example, block 1203 includes confirming that the smart SOS system is enabled on the device. In some examples, if it is determined in block 1203 that the smart SOS system is not enabled, the process may still proceed to block 1205 and may include blocks 1207, 1208, and 1210 (e.g., block 1209 may be omitted). However, if it is determined in block 1203 that the smart SOS system is not enabled, the method may not include blocks 1209-1235.

[0147] In this example, block 1205 includes detecting, by the control system, the presence of a finger on the outer surface of the device within the fingerprint sensor system's area. In some examples, the device may include a touch sensor system, and block 1205 may include receiving input from the touch sensor system indicating whether the target object is on the outer surface of the device within the fingerprint sensor system's active area. In some examples, block 1205 may include receiving input from the touch sensor system and / or the fingerprint sensor system indicating whether the target object on the outer surface of the device within the fingerprint sensor system's active area has one or more features of a finger (such as a finger shape, fingerprint features, etc.). In some examples, block 1205 may include receiving input from the fingerprint sensor system indicating whether the target object on the outer surface of the device within the fingerprint sensor system's active area has one or more subepidermal features (such as papillary layer features, reticular layer features, subcutaneous features, vascular features, lymphatic vascular features, fat lobule features, muscle tissue features, bone features, etc.).

[0148] According to this example, block 1207 includes receiving, by the control system, fingerprint sensor data from a fingerprint sensor system. In some instances, receiving the fingerprint sensor data may include receiving ultrasonic fingerprint sensor data. In some examples, the fingerprint sensor data may correspond to signals received from a sensor pixel array (such as sensor pixel array 206 of FIG. 2 ) of an ultrasonic fingerprint sensor system. Alternatively or additionally, the fingerprint sensor data may correspond to signals received from an electrode layer (such as electrode layer 210 of FIG. 2 ) of an ultrasonic fingerprint sensor system. However, the fingerprint sensor system may or may not be (or include) an ultrasonic fingerprint sensor system, depending on the particular implementation.

[0149] In this example, block 1208 is an authentication process based at least in part on the fingerprint sensor data obtained in block 1207. According to this example, block 1208 includes determining whether fingerprint features and / or subcutaneous features derived from the fingerprint sensor data obtained in block 1207 match previously obtained fingerprint features and / or subcutaneous features stored in a database (DB). The fingerprint features and / or subcutaneous features in the database may, for example, have been obtained during a registration process. In this example, if a match is determined in block 1208, method 1200 proceeds to block 1209. In some examples, if a match is determined in block 1208, method 1200 may include providing a notification (e.g., an audio notification, a visual notification, and / or a tactile response) indicating the absence of a match. In some instances, the user may be prompted to present the finger again, present another registered finger, clean the surface of the device in the fingerprint sensor area, etc. In some examples, block 1208 may include other disclosed authentication methods.

[0150] According to this example, block 1209 includes determining a current finger pressure on an outer surface of the device within the active fingerprint sensor area and determining whether the current finger pressure is at or above a threshold finger pressure. For example, block 1209 may be performed as described above with reference to block 307 of FIG. 3 and the finger pressure threshold of block 309. According to some examples, block 1209 may also include determining whether the threshold finger pressure is maintained for at least a threshold time interval. In some embodiments, block 1209 may include a time threshold determination such as described above with reference to block 309 of FIG. In some embodiments, the threshold finger pressure and / or the threshold time interval may be user-selectable, for example, as described above with reference to FIG. 9 and FIG. 10.

[0151] In this example, if it is determined in block 1209 that the current finger pressure does not equal or exceed the threshold finger pressure, the process continues to block 1210 and the device is unlocked. The device is unlocked because, in this example, the authentication process of block 1208 is successfully completed.

[0152] In this example, if it is determined in block 1209 that the current finger pressure equals or exceeds the threshold finger pressure (and in some instances, whether the current finger pressure equals or exceeds the threshold finger pressure for at least one threshold time interval), the process continues to block 1211.

[0153] According to this example, block 1211 includes determining a current heart rate and determining whether the current heart rate deviates from a normal heart rate (e.g., the person's average resting heart rate) by more than a threshold amount. In some such examples, block 1211 may include determining whether the current heart rate deviates from the normal heart rate by more than a determined percentage, such as 10%, 15%, 20%, 25%, 30%, 35%, etc.

[0154] In the example shown in FIG12 , if it is determined in block 1211 that the current heart rate has not deviated from the normal heart rate by more than a threshold amount, then it is determined in block 1213 that the current heart rate is within the normal or optimal range, and the process continues to block 1217. In this example, if it is determined in block 1211 that the current heart rate does deviate from the normal heart rate by more than a threshold amount, but the current heart rate is below normal, then it is determined in block 1212 that the current heart rate is below the normal or optimal range, and the process continues to block 1217.

[0155] According to this example, block 1217 includes providing a prompt indicating that if a specified user action is taken, at least one of the one or more emergency response functions will be enabled. According to this embodiment, the specified user action is or includes an additional instance of finger force or additional instance of finger pressure to be applied in the fingerprint sensor system area. In this example, block 1217 includes providing an audio or visual notification via the device that an emergency response will occur after a specified number of finger pressure events. In this example, the specified number of finger pressure events is two finger pressure events. According to some examples, block 1217 may include presenting a GUI (such as GUI 500 shown in Figure 5).

[0156] According to this example, after block 1217, the process continues to block 1227 where it is determined whether additional finger pressure events are required to trigger one or more emergency response functions. In this example, additional finger pressure events are required, so the process returns to block 1209.

[0157] In this example, if it is determined in block 1211 that the current heart rate does deviate from the normal heart rate by more than a threshold amount and that the current heart rate is higher than normal, then in block 1215 it is determined that the current heart rate is higher than the normal or optimal range, and the process continues to block 1219. In some examples, the threshold heart rate used to determine a high heart rate condition in block 1215 can be set to a level at which a person's heart rate is likely to be fearful and / or stressed. For example, if the person's average heart rate is 90 beats per minute, the threshold heart rate can be set to a level above 90 beats per minute, such as 100, 105, 110 beats per minute, etc.

[0158] Some examples may implement more than one threshold heart rate for determining a high heart rate condition. For example, if a person appears to be stationary (e.g., based on inertial sensor data received from an inertial sensor system), some embodiments may apply one threshold heart rate, and apply another threshold heart rate if the person appears to be engaging in an activity, such as walking. For example, if the person's average resting heart rate is 70 beats per minute and the person appears to be stationary, the threshold heart rate for determining a high heart rate condition may be set to a level above 70 beats per minute, such as 80, 85, 90 beats per minute, and so on. In some examples, the threshold heart rate for determining a high heart rate condition may depend on the context, such as whether the person is stationary.

[0159] According to this example, block 1219 includes determining whether one or more additional indicators of user anxiety exist in addition to an abnormally high heart rate. In this example, block 1219 includes determining whether sweat or other contamination exists on the finger and / or on the device surface in contact with the finger based at least in part on the fingerprint sensor data. According to some examples, block 1219 may include determining whether sweat or other contamination is detected on the finger and / or on the device surface in contact with the finger for the first time within a time interval based at least in part on the fingerprint sensor data, for example, determining whether sweat or other contamination is detected for the first time within the last second, the last half second, etc.

[0160] According to this example, if one or more additional indicators of user anxiety are not detected in block 1219, the process continues to block 1221, where it is determined that no sweat or other contamination is detected. The process then continues to block 1225. According to this example, block 1225 includes providing a prompt indicating that if a specified user action is taken, at least one of the one or more emergency response functions will be enabled. According to this embodiment, the specified user action is or includes additional instances of finger force or additional instances of finger pressure to be applied in the fingerprint sensor system area. In this example, block 1225 includes providing an audio or visual notification via the device notifying that an emergency response will occur after a specified number of additional finger pressure events. In this example, the specified number of finger pressure events is one finger pressure event. According to some examples, block 1225 may include presenting a GUI (such as GUI 600 shown in FIG. 6 ).

[0161] According to this example, after block 1225, the process continues to block 1227 where it is determined whether additional finger pressure events are required to trigger one or more emergency response functions. In this example, additional finger pressure events are required, so the process returns to block 1209.

[0162] In this example, if one or more additional indicators of user anxiety are detected in block 1219, the process continues to block 1223 and assumes that sweat or other contamination has been detected. In this example, the process then continues to block 1229. In some alternative examples (e.g., examples where block 1235 does not include sending an emergency response communication), the process may continue from block 1223 to block 1235 (as suggested by the dashed line connecting block 1223 to block 1235).

[0163] According to this implementation, block 1229 includes determining whether any available location data can be added to the emergency response communication, such as a phone call to an emergency response phone number, a text message and / or a phone call to a designated emergency communication recipient, etc. In this example, block 1229 includes determining whether any Global Positioning System (GPS) and / or any access point information corresponding to the device is available. (The term "access point" is generally used to refer to a hub through which a wireless device accesses wireless networks and the internet.) In this example, if it is determined in block 1229 that any Global Positioning System (GPS) and / or any access point information is available, the process continues to block 1233, where such location data is added to the emergency response communication. According to this example, if it is determined in block 1229 that no Global Positioning System (GPS) and / or any access point information is available, the process continues to block 1231, where no such location data is added to the emergency response communication. After either block 1231 or block 1233, the process continues to block 1235 where one or more emergency response functions of the device are enabled.

[0164] FIG13 is a flow chart providing example blocks for some of the methods disclosed herein. The blocks of FIG13 may be performed, for example, by the apparatus 101 of FIG1A , FIG1B , or FIG2 , or by a similar apparatus. As with other methods disclosed herein, the method 1300 outlined in FIG13 may include more or fewer blocks than shown. Furthermore, the blocks of the methods disclosed herein do not necessarily need to be performed in the order indicated. In some examples, some blocks of the methods disclosed herein may be performed simultaneously.

[0165] According to this example, method 1300 is a method of controlling a device that includes a fingerprint sensor, which may or may not be an ultrasonic fingerprint sensor, depending on the particular embodiment. According to this embodiment, block 1303 includes controlling the device via a control system of the device (such as control system 106 of device 101) to provide a first prompt to place a finger on an external surface of the device in an area of ​​the fingerprint sensor system. In some examples, block 1303 may include controlling at least a portion of a user interface system (e.g., a speaker system of device 101) to provide the first prompt. In some instances, block 1303 may include controlling a display device of the device (which may be an example of optional display system 108 of FIG. 1A ) to provide the first prompt.

[0166] Figures 14A, 14B, 14C, and 14D illustrate examples of graphical user interfaces (GUIs) that may be presented during implementation of method 1300, according to some examples. In these examples, device 101 includes an instance of fingerprint sensor system 102, an instance of control system 106 (not shown), and an instance of display system 108. Figure 14A shows a dashed outline of one example of an active area of ​​fingerprint sensor system 102. (The dashed lines in Figures 14A-14D are not intended to represent the portion of the GUI that will actually be presented on display system 108 and visible to a user.) For example, the active area may correspond to the area of ​​a sensor pixel array of fingerprint sensor system 102, such as the area of ​​sensor pixel array 206 shown in Figure 2. In some embodiments, the active area of ​​fingerprint sensor system 102 may be larger or smaller than the fingerprint sensor system 102 shown in Figure 14A, may have a different aspect ratio, and so on. For example, in some instances, the active area of ​​the fingerprint sensor system 102 may occupy a majority of the display system 108, such as 10%, 20%, 30%, 40%, 50%, etc.

[0167] According to the examples shown in Figures 14A-14D, the control system 106 is controlling the display system 108 to present GUIs 1400a, 1400b, 1400c, and 1400d, respectively, each of which includes a message area 1405 and a fingerprint sensor system area icon 1410. Thus, in these examples, the display stack of the display system 108 resides between the active area of ​​the fingerprint sensor system 102 and the outer surface of the device 101 corresponding to the fingerprint sensor system area icon 1410, which in these examples is the display cover (e.g., display glass). In these examples, the active area of ​​the fingerprint sensor system 102 generally corresponds to the fingerprint sensor system area icon 1410.

[0168] Returning to FIG. 13 , in this example, block 1305 includes determining, via the control system, a finger force or pressure on an external surface of the device. In some examples, the control system may determine the finger force or pressure based on fingerprint sensor data received from a fingerprint sensor system. According to some such examples, the fingerprint sensor data may be ultrasonic fingerprint sensor data, or may include ultrasonic fingerprint sensor data. In some such examples, the ultrasonic fingerprint sensor data may be received via an electrode layer proximate to a piezoelectric layer of the ultrasonic fingerprint sensor system. Alternatively or additionally, in some examples, the ultrasonic fingerprint sensor data may be received via an ultrasonic sensor pixel array. Detailed examples for estimating finger force or pressure based on fingerprint sensor data are disclosed herein. However, in some embodiments, block 1305 may include determining the finger force or pressure based on force sensor data from a force sensor that may be separate from the fingerprint sensor system 102, such as the optional force sensor 110 of FIG. 1A or FIG. 1B .

[0169] According to this example, block 1307 includes controlling the device via the control system to provide a second prompt corresponding to the finger force or finger pressure. In some examples, the second prompt may be or may include an audio prompt provided via a speaker system of device 101 and / or tactile feedback from a tactile feedback system of device 101. Alternatively or additionally, in some examples, the second prompt may include a visual prompt provided via a display system.

[0170] For example, providing the second prompt may include presenting a GUI on a display device of the apparatus. The GUI may, for example, indicate the current finger force or the current finger pressure. In some instances, the GUI may indicate whether the current finger force or the current finger pressure is within an acceptable range. However, in some instances, the GUI may indicate that the current finger force or the current finger pressure is not within an acceptable range. According to some such examples, the GUI may include a prompt to change the current finger force or the current finger pressure.

[0171] In the example shown in FIG14B , control system 106 (not shown) is controlling display system 108 to present GUI 1400 b, which includes a message area 1405 and a fingerprint sensor system area icon 1410. According to this example, message area 1405 includes a text prompt prompting the user to press down harder on the outer surface of device 101 corresponding to fingerprint sensor system area icon 1410. Message area 1405 implicitly indicates that the current finger force or current finger pressure is not within an acceptable range, but is too low.

[0172] In the example shown in FIG14C , the message area 1405 of the GUI 1400c includes a text prompt for prompting the user to apply less pressure on the user's finger on the outer surface of the device 101 corresponding to the fingerprint sensor system area icon 1410. Implicitly, the message area 1405 indicates that the current finger force or the current finger pressure is not within an acceptable range but is too high.

[0173] 14D , the message area 1405 of the GUI 1400d includes textual feedback indicating that the user's finger is applying a satisfactory amount of pressure on the outer surface of the device 101 corresponding to the fingerprint sensor system area icon 1410. Thus, the message area 1405 indicates that the current finger force or current finger pressure is within an acceptable range.

[0174] In some examples, the first prompt and / or the second prompt referenced in FIG. 13 may be presented during the user registration process. According to some such examples, the second prompt may correspond to a force calibration phase or a pressure calibration phase of the user registration process. For example, one or more of the GUIs shown in FIG. 14A-14D may be presented during a force calibration phase or a pressure calibration phase of the user registration process.

[0175] In some examples, the first prompt and / or the second prompt may correspond to a fingerprint capture phase of a user registration process. For example, one or more GUIs shown in Figures 14A-14D may be presented during the fingerprint capture phase of the user registration process.

[0176] However, in some examples, the first prompt and / or the second prompt may be presented after the registration process, for example, as part of an authentication process. For example, one or more GUIs shown in Figures 14A-14D may be presented during the authentication process.

[0177] In some embodiments, method 1300 may include obtaining fingerprint image data based on signals received from fingerprint sensor system 102. Some embodiments of method 1300 may include determining an image quality metric corresponding to the fingerprint image data. According to some embodiments, determining the image quality metric may include evaluating the fingerprint image data and performing a signal and / or noise determination (such as a signal-to-noise ratio determination). For example, the signal-to-noise ratio (SNR) may be determined by dividing the relative amplitude of the fingerprint sensor data corresponding to the fingerprint ridges by the amplitude of the background (e.g., the grooves of the fingerprint or sensor data from a sensor platen without an object positioned thereon). In some embodiments, determining the image quality metric may include evaluating image contrast and / or image sharpness. For example, image contrast may be determined by comparing the amplitude of the ridge data to the amplitude of the groove data (e.g., by generating a ratio between one or more ridges and one or more grooves of the fingerprint image data). For example, image sharpness may be determined by comparing the amplitude of the ridge data to the amplitude of the groove data and dividing by the number of sensor pixels between the edge of the ridge and the bottom of the groove. According to some embodiments, determining an image quality metric may include evaluating fingerprint image data to determine a curvilinear topology corresponding to a ridge and groove structure. Some such embodiments may include determining a curvilinear direction field. In some examples, determining an image quality metric may include evaluating metrics such as the direction of ridge flow, the sharpness of ridge flow, and / or the continuity of ridge flow. In some embodiments, determining an image quality metric may include evaluating the fingerprint image data for the presence of one or more fingerprint features, such as minutiae. For example, the curvilinear topology corresponding to the ridges and grooves may be determined by constructing a vector field associated with the angular directions of ridges and grooves on an exterior surface of a device disposed within an active area of ​​the fingerprint sensor system 102. For example, the curvilinear direction field may be determined by constructing a vector field associated with the curvature of the ridges and grooves (e.g., relatively straight ridges or grooves may have a small curvature, while highly curved ridges or grooves, such as threads, may have a high curvature). For example, image quality metrics such as the direction of ridge flow, the sharpness of ridge flow, and / or the continuity of ridge flow can be determined by examining the angular direction, length, continuity, and curvature of ridges within the fingerprint sensor data to assess whether a sufficient number of features are available to allow successful matching and / or recognition of a good image of the enrollment template.

[0178] According to some examples, the second prompt of method 1300 can be based at least in part on the image quality metric.In some such examples, the second prompt can indicate whether the current finger force or the current finger pressure should be changed.

[0179] In some embodiments, method 1300 may include controlling the device via the control system to provide a third prompt based at least in part on the image quality metric. For example, the third prompt may indicate that the finger perspiration level should be changed. For example, the third prompt may be or include text on the GUI prompting the user to apply moisturizer to the finger.

[0180] In some embodiments, in addition to fingerprint image feature data (e.g., in addition to identifying and storing fingerprint features such as fingerprint ridge ends, fingerprint ridge bifurcations, short ridges, and / or short islands, and the locations of such fingerprint features), other types of finger features may be determined and stored during the enrollment process. These other finger features may be determined and stored as finger feature data. The finger feature data may include, for example, finger direction data, finger force data, finger pressure data, or finger dryness data.

[0181] According to some such examples, a subsequent authentication process may be based at least in part on one or more types of fingerprint feature data. If it is determined during the authentication process that the currently determined fingerprint features do not match the fingerprint features determined during the enrollment process, even if the currently acquired fingerprint features match the fingerprint features previously acquired and stored during the enrollment process, this may be an indication of a spoofing attempt. In some embodiments, this condition may trigger a more rigorous authentication process, such as requiring the user to enter a code, answer questions as part of the enrollment process, and / or provide another type of biometric data (such as facial recognition data).

[0182] Some embodiments of method 1300 may include determining (e.g., during an enrollment process) an acceptable image quality force range or an acceptable image quality pressure range associated with an image quality metric that equals or exceeds an image quality metric threshold value. In some cases, the acceptable image quality force range or the acceptable image quality pressure range may be a force or pressure range corresponding to a maximum level of observed image quality. As described elsewhere herein, due to interpersonal variations in finger characteristics, an individual (and / or a particular finger of an individual) may have a characteristic acceptable image quality force range or an acceptable image quality pressure range associated with acceptable fingerprint image quality. Some embodiments may include associating the acceptable image quality force range or the acceptable image quality pressure range with the individual (and / or with a particular finger of the individual) and storing the acceptable image quality force range or the acceptable image quality pressure range in memory.

[0183] Some such examples may include performing a subsequent authentication process and applying an acceptable image quality force range or an acceptable image quality pressure range as part of the authentication process. For example, the authentication process may be primarily based on matching the currently determined fingerprint features determined via the fingerprint sensor system with the fingerprint features stored during the enrollment process. However, if it is determined during the authentication process that the currently determined force or pressure does not match the acceptable image quality force range or the acceptable image quality pressure range determined during the enrollment process, this may be an indication of a spoofing attempt and may trigger a more stringent authentication process.

[0184] FIG15 is a flow chart providing example blocks for some additional methods disclosed herein. The blocks of FIG15 may be performed, for example, by the apparatus 101 of FIG1A , FIG1B , or FIG2 , or by a similar apparatus. As with other methods disclosed herein, the method 1500 outlined in FIG15 may include more or fewer blocks than shown. Furthermore, the blocks of the methods disclosed herein do not necessarily need to be performed in the order indicated. In some examples, some blocks of the methods disclosed herein may be performed simultaneously.

[0185] According to this example, method 1500 is a method of controlling a device including a fingerprint sensor, which may or may not be an ultrasonic fingerprint sensor, depending on the particular implementation. In this example, method 1500 corresponds to a user registration process including stages 1501a and 1501b. In this implementation, stage 1501a is the pressure calibration stage of the user registration process, and stage 1501b is the fingerprint capture stage of the user registration process. As described in more detail below, fingerprint capture stage 1501b includes pressure monitoring.

[0186] According to this embodiment, block 1503 includes controlling the device via a control system of the device (such as control system 106 of device 101) to initiate the user registration process. For example, block 1503 may include providing a prompt such as the first prompt discussed above with reference to FIG. 13 : the first prompt may be a prompt to place a finger on an external surface of the device in the area of ​​the fingerprint sensor system. In some examples, block 1503 may include controlling at least a portion of a user interface system (e.g., a speaker system of device 101) to provide the first prompt. In some instances, block 1503 may include controlling a display device of the device (which may be an example of optional display system 108 of FIG. 1A ) to provide the first prompt. For example, the first prompt may be provided via a GUI (such as GUI 1400 described above with reference to FIG. 14 ).

[0187] In this example, block 1505 includes a process for estimating the pressure of a finger on an external surface of the device within the active area of ​​the fingerprint sensor system. As described elsewhere herein, the terms "force" and "pressure" are used interchangeably herein. In some examples, block 1505 may be a force estimation process. Block 1505 may, for example, include one or more examples of force estimation processes provided below.

[0188] According to this example, block 1507 includes determining whether the pressure estimated in block 1505 is within an acceptable range. In some examples, block 1505 or block 1507 may include obtaining fingerprint image data via a fingerprint sensor system. According to some embodiments, block 1507 may include evaluating the quality of the fingerprint image data. Some embodiments may include determining an acceptable image quality force range or an acceptable image quality pressure range associated with an image quality metric that equals or exceeds an image quality metric threshold value. As described elsewhere herein, due to variations in finger characteristics between individuals, an individual (and / or a particular finger of an individual) may have a characteristic acceptable image quality force range or an acceptable image quality pressure range associated with acceptable fingerprint image quality. Therefore, in some examples, the acceptable image quality force range or acceptable image quality pressure range of the evaluation process of block 1507 may vary depending on the particular individual being enrolled, or even depending on the particular finger.

[0189] According to this example, if it is determined in block 1507 that the finger pressure is not within the acceptable range, method 1500 continues to block 1509, where the control system causes device 101 to provide a prompt (such as an audio prompt, a tactile feedback response, and / or a GUI) indicating that the finger pressure is not within the acceptable range.

[0190] In some embodiments (e.g., as described above with reference to FIG. 14D ), if it is determined in block 1507 that the finger pressure is within the acceptable range, the control system may cause the device to provide a prompt (such as an audio prompt and / or a GUI) indicating that the finger pressure is within the acceptable range. In some examples, if it is determined in block 1507 that the finger pressure is within the acceptable range, method 1500 proceeds to fingerprint capture stage 1501b. However, according to some embodiments, blocks 1505, 1507, and 1509 may need to be performed a minimum number of times (e.g., 2, 3, 4, 5, 6, etc.) before method 1500 proceeds to fingerprint capture stage 1501b. In some such examples, method 1500 may proceed from block 1507 to block 1509 even if the finger pressure is within the acceptable range.

[0191] Figures 16A, 16B, and 16C illustrate an example of a GUI that may be presented during the pressure calibration phase of the user registration process. Figures 17A, 17B, 17C, and 17D illustrate an example of a GUI that may be presented during the fingerprint capture phase of the user registration process. As with other disclosed embodiments, the type, number, and arrangement of elements in the disclosed GUI are provided as examples only and are not intended to be limiting. Other GUI embodiments within the scope of this disclosure may have different types, numbers, and / or arrangements of elements.

[0192] 16A-16C , the control system is controlling the display system to present GUIs 1600a, 1600b, and 1600c, respectively, each of which includes a message area 1605, a fingerprint sensor system area icon 1610, a current finger pressure indicator 1615, and a progress indicator 1630. In these examples, the current finger pressure indicator 1615 includes arrows 1620a, 1620b, and 1620c, and elements 1625a, 1625b, and 1625c, respectively.

[0193] 16A is an example of a GUI that may be presented during block 1509 if the finger pressure is determined not to be within an acceptable range in block 1507. In this example, the message area 1605 includes a prompt for the user to reduce finger pressure applied to the outer surface of the device in the area corresponding to the fingerprint sensor system area icon 1610.

[0194] In the examples shown in Figures 16A-17D, the positions of arrows 1620a, 1620b, 1620c, 1720a, 1720b, 1720c, and 1720d indicate the current finger pressure level. Arrow 1621 shown in Figure 16A (which is not necessarily presented in GUI 1600a) points in the direction of increasing pressure. In Figure 16A, current finger pressure indicator 1615 indicates that the current finger pressure is within an unacceptably high range. Here, arrow 1620c is positioned corresponding to element 1625c, which is located in the high-pressure region of current finger pressure indicator 1615. In this example, arrow 1620c has a pattern corresponding to element 1625c. In some examples, if current finger pressure indicator 1615 indicates that the current finger pressure is within an unacceptably high range, arrow 1620c and element 1625c may be presented in red. In this example, progress indicator 1630 shows that the pressure calibration phase is 6% complete.

[0195] GUI 1600b in FIG16B is another example of a GUI that may be presented during block 1509 if it is determined in block 1507 that the finger pressure is not within the acceptable range. In this example, message area 1605 includes a prompt for the user to increase the finger pressure applied to the outer surface of the device in the area corresponding to fingerprint sensor system area icon 1610. Current finger pressure indicator 1615 indicates that the current finger pressure is within an unacceptably low range: here, arrow 1620a is located at a position corresponding to element 1625a, which is located in the low-pressure area of ​​current finger pressure indicator 1615. Here, arrow 1620a has a pattern corresponding to element 1625a. In some examples, if current finger pressure indicator 1615 indicates that the current finger pressure is within an unacceptably low range, arrow 1620a and element 1625a may be presented in yellow.

[0196] GUI 1600c in FIG16C is an example of a GUI that may be presented if the finger pressure is determined to be within an acceptable range in block 1507. In this example, message area 1605 includes an encouraging message to the user, indicating that the finger pressure applied to the outer surface of the device in the area corresponding to fingerprint sensor system area icon 1610 is within an optimal range. Current finger pressure indicator 1615 indicates that the current finger pressure is within an acceptable range. Here, arrow 1620b is located at a position corresponding to element 1625b, which is located in the medium pressure area of ​​current finger pressure indicator 1615. Here, arrow 1620b has a pattern corresponding to element 1625b. In some examples, if current finger pressure indicator 1615 indicates that the current finger pressure is within an acceptable range, arrow 1620b and element 1625b may be presented in green.

[0197] Returning to FIG. 15 , an example of the fingerprint capture phase 1501b of the user registration process will now be described. In this example, block 1511 includes obtaining data from the fingerprint sensor system when a finger is placed on the surface of the device corresponding to the active area of ​​the fingerprint sensor system. According to some examples, block 1511 may include obtaining data from a sensor pixel array of an ultrasonic fingerprint sensor system (such as sensor pixel array 206 shown in FIG. 2 ). In some examples, block 1511 may include obtaining data from an electrode layer of an ultrasonic fingerprint sensor system (such as electrode layer 210 shown in FIG. 2 ). Other examples may include obtaining data from a sensor pixel array of a different type of fingerprint sensor system (such as one of the alternative examples described above with reference to FIG. 1A ).

[0198] According to this example, block 1513 includes determining whether the current finger force or pressure (e.g., as estimated in block 1511 or block 1513) is within an acceptable range. Some embodiments may include determining whether the current finger force or pressure is within an acceptable image quality force range or an acceptable image quality pressure range previously determined during a pressure calibration phase and saved to memory. As described above, in some examples, the acceptable image quality force range or acceptable image quality pressure range for the evaluation process of block 1513 may vary depending on the specific individual being enrolled, or even depending on the specific finger.

[0199] According to this example, if it is determined in block 1513 that the finger pressure is not within the acceptable range, method 1500 continues to block 1515, where the control system causes device 101 to provide a prompt (such as an audio prompt, a tactile feedback response, and / or a visual prompt) indicating that the finger pressure is not within the acceptable range.

[0200] In some embodiments (e.g., as described above with reference to FIG. 14D and FIG. 16C ), if it is determined in block 1513 that the finger pressure is within an acceptable range, the control system may cause the device to provide a prompt (such as an audio prompt and / or a visual prompt) indicating that the finger pressure is within an acceptable range.

[0201] According to this embodiment, if it is determined in block 1513 that the finger pressure is within an acceptable range, the process proceeds to block 1517, where it is determined whether the fingerprint capture phase 1501b of the user registration process has been completed. In this example, if it is determined in block 1517 that the fingerprint capture phase 1501b of the user registration process has not been completed, the process returns to block 1511 and acquires additional fingerprint image data. If it is determined in block 1517 that the fingerprint capture phase 1501b of the user registration process has been completed, the process proceeds to block 1520, which corresponds to the end of the user registration process. In some examples, block 1520 may include providing a message (e.g., an audio message, a text message, a video message, etc.) indicating that the user registration process has been successfully completed.

[0202] As described above, Figures 17A-17D illustrate examples of GUIs that may be presented during the fingerprint capture phase of the user registration process. According to the examples shown in Figures 17A-17D , the control system is controlling the display system to present GUIs 1700a, 1700b, 1700c, and 1700d, respectively. Each GUI includes a message area 1705, a current finger pressure indicator 1715, and a progress indicator 1730. Figures 17A-17C also include a fingerprint sensor system area icon 1710.

[0203] GUI 1700a of FIG17A is an example of a GUI that may be presented if it is determined in block 1513 that the finger pressure during the fingerprint capture phase is within an acceptable range, but additional fingerprint image data needs to be acquired from other parts of the finger currently capturing fingerprint image data. In this example, current finger pressure indicator 1715 indicates that the current finger pressure is within an acceptable range: here, arrow 1720a is located at a position corresponding to element 1725a, which is located in the medium pressure region of current finger pressure indicator 1715.

[0204] In this example, message area 1705 includes a prompt for the user to adjust the position of their finger. Additionally, message area 1705 includes a prompt for the user to press their finger on the outer surface of the device in the area corresponding to fingerprint sensor system area icon 1710 and then lift their finger when they receive tactile feedback (vibration in this example). In this case, progress indicator 1730 indicates that the fingerprint capture phase is 27% complete.

[0205] GUI 1700b of FIG17B is an example of a GUI that may be presented if it is determined in block 1513 that the finger pressure is not within an acceptable range during the fingerprint capture phase of the user enrollment process. In this example, current finger pressure indicator 1715 indicates that the current finger pressure is within a range that is too high: here, arrow 1720b is located at a position corresponding to element 1725b, which is located in the high-pressure region of current finger pressure indicator 1715.

[0206] In this example, message area 1705 includes a prompt for the user to reduce finger pressure. Additionally, message area 1705 includes a prompt for the user to press their finger on the outer surface of the device in the area corresponding to fingerprint sensor system area icon 1710 and then lift their finger when a vibration is felt. In this case, progress indicator 1730 indicates that the fingerprint capture phase is 32% complete.

[0207] GUI 1700c of FIG17C is another example of a GUI that may be presented if it is determined in block 1513 that the finger pressure during the fingerprint capture phase is within an acceptable range, but additional fingerprint image data needs to be acquired from other parts of the finger currently capturing fingerprint image data. In this example, current finger pressure indicator 1715 indicates that the current finger pressure is within an acceptable range: here, arrow 1720c is located at a position corresponding to element 1725a, which is located in the medium pressure region of current finger pressure indicator 1715.

[0208] In this example, message area 1705 includes a prompt for the user to adjust the position of their finger to fully scan the finger for which fingerprint image data is currently being captured. Additionally, message area 1705 includes a prompt for the user to press their finger on the outer surface of the device in the area corresponding to fingerprint sensor system area icon 1710 and then lift the finger upon receiving tactile feedback (vibration in this example). In this case, progress indicator 1730 indicates that the fingerprint capture phase is 32% complete.

[0209] GUI 1700d of FIG17D is an example of a GUI that may be presented if it is determined in block 1517 of FIG15 that the fingerprint capture phase of the user registration process has been successfully completed. For example, GUI 1700d may be presented in block 1520. In this case, progress indicator 1730 indicates that the fingerprint capture phase is 100% complete. According to this example, current finger pressure indicator 1715 still provides user feedback and indicates that the current finger pressure is within an acceptable range.

[0210] FIG17E is a flow chart providing example blocks of some alternative methods disclosed herein. The blocks of FIG17E may be performed, for example, by the apparatus 101 of FIG1A , FIG1B , or FIG2 , or by a similar apparatus. As with other methods disclosed herein, the method 1750 outlined in FIG17E may include more or fewer blocks than shown. Furthermore, the blocks of the methods disclosed herein do not necessarily need to be performed in the order indicated. In some examples, some blocks of the methods disclosed herein may be performed simultaneously.

[0211] According to this example, method 1750 is a method of controlling a device that includes a fingerprint sensor, which may or may not be an ultrasonic fingerprint sensor, depending on the particular implementation. According to this implementation, block 1753 includes determining, via a control system of the device (such as control system 106 of device 101), whether a finger is on an external surface of the device within a fingerprint sensor system area. In some examples, the device may include a touch sensor system, and block 1753 may include receiving input from the touch sensor system indicating whether a target object is on an external surface of the device within an active area of ​​the fingerprint sensor system. In some examples, block 1753 may include receiving input from the touch sensor system and / or the fingerprint sensor system indicating whether a target object on a surface external to the device within the active area of ​​the fingerprint sensor system has one or more characteristics of a finger (such as a finger shape, fingerprint characteristics, etc.). In some examples, block 1753 may include receiving input from the fingerprint sensor system indicating whether a target object on an outer surface of the device within an effective area of ​​the fingerprint sensor system has one or more subepidermal features (such as papillary layer features, reticular layer features, subcutaneous features, vascular features, lymphatic vascular features, fat lobule features, muscle tissue features, bone features, etc.).

[0212] In this example, in block 1755, in response to determining (in block 1753) that a finger is on the exterior surface of the device in the area of ​​the fingerprint sensor system, fingerprint sensor data corresponding to the finger is received from the fingerprint sensor system. As described above, in some instances, block 1753 may also include receiving fingerprint sensor data from the target object during the process of determining whether the target object is a finger. According to some such instances, additional fingerprint sensor data will not be obtained in block 1755. However, in some such instances, additional fingerprint sensor data may be obtained in block 1755. For example, in some instances, block 1753 may include receiving fingerprint sensor data from an electrode layer (such as electrode layer 210 of FIG. 2 ), while block 1755 may include receiving fingerprint sensor data from a sensor pixel array (such as sensor pixel array 206 of FIG. 2 ).

[0213] According to this example, block 1757 includes determining, via the control system, a finger force or finger pressure on an external surface of the device. In some examples, the control system may determine the finger force or finger pressure based on fingerprint sensor data received from a fingerprint sensor system. According to some such examples, the fingerprint sensor data may be ultrasonic fingerprint sensor data, or may include ultrasonic fingerprint sensor data. In some such examples, the ultrasonic fingerprint sensor data may be received via an electrode layer proximate to a piezoelectric layer of the ultrasonic fingerprint sensor system. Alternatively or additionally, in some examples, the ultrasonic fingerprint sensor data may be received via an ultrasonic sensor pixel array. Some detailed examples of estimating finger force or finger pressure based on the fingerprint sensor data are described below with reference to FIG. 8A and other figures. However, in some embodiments, block 1757 may include determining the finger force or finger pressure based on force sensor data from a force sensor separate from the fingerprint sensor system 102 (such as the optional force sensor 110 of FIG. 1A or FIG. 1B ).

[0214] According to this example, block 1759 includes controlling the user interface system of the device via the control system to provide a prompt corresponding to the finger force or finger pressure. In some examples, the prompt may be or may include an audio prompt provided via a speaker system of device 101 and / or tactile feedback from a tactile feedback system of device 101. Alternatively or additionally, in some examples, the prompt may include a visual prompt provided via a display system.

[0215] For example, providing a prompt may include presenting a GUI on a display device of the apparatus. The GUI may, for example, indicate the current finger force or the current finger pressure. In some instances, the GUI may indicate whether the current finger force or the current finger pressure is within an acceptable range, for example, as described above with reference to one of FIG. 14D , FIG. 16C , FIG. 17A , FIG. 17C , or FIG. 17D . However, in some instances, the GUI may indicate that the current finger force or the current finger pressure is not within an acceptable range, for example, as described above with reference to one of FIG. 14B , FIG. 14C , FIG. 16A , FIG. 16B , or FIG. 17B . According to some such examples, the GUI may include a prompt to change the current finger force or the current finger pressure.

[0216] In some examples, the prompt referenced in FIG17E may be presented during the user registration process. According to some such examples, the prompt may correspond to a force calibration phase or a pressure calibration phase of the user registration process. In some examples, the prompt may correspond to a fingerprint capture phase of the user registration process. However, in some examples, the prompt may be presented after the registration process, for example, as part of an authentication process.

[0217] In some embodiments, method 1750 may include obtaining fingerprint image data based on a signal received from fingerprint sensor system 102. Some embodiments of method 1750 may include determining an image quality metric corresponding to the fingerprint image data, e.g., as described above with reference to FIG. 13 . According to some examples, the prompt of method 1750 may be based at least in part on the image quality metric. In some such examples, the second prompt may indicate whether the current finger force or current finger pressure should be changed.

[0218] In some embodiments, method 1750 may include controlling the device via the control system to provide a second prompt based at least in part on the image quality metric. For example, the second prompt may indicate that the finger perspiration level should be changed. For example, the second prompt may be or include text on the GUI prompting the user to apply moisturizer to the finger.

[0219] In some embodiments, in addition to fingerprint image feature data (e.g., in addition to identifying and storing fingerprint features such as fingerprint ridge ends, fingerprint ridge bifurcations, short ridges, and / or short islands, and the locations of such fingerprint features), other types of finger features may be determined and stored during the enrollment process. These other finger features may be determined and stored as finger feature data. The finger feature data may include, for example, finger direction data, finger force data, finger pressure data, or finger dryness data.

[0220] According to some such examples, the subsequent authentication process can be based at least in part on one or more types of finger feature profiles. If it is determined during the authentication process that the currently determined finger features do not match the finger features determined during the enrollment process, this may be an indication of a spoofing attempt. In some implementations, this condition may trigger a more rigorous identity verification process.

[0221] Figures 18A, 18B, and 18C illustrate examples of graphs indicating changes in fingerprint images based on applied finger pressure. Figure 18A illustrates an example of how the contact area of ​​different fingers changes with increasing pressure. The curves in Figure 18A correspond to the left and right thumbs (LT and RT) of three different individuals (J, M, and H). In these examples, J_RT and J_LT correspond to normal fingers, M_RT and M_LT correspond to worn fingers, and H_RT and H_LT correspond to dry fingers. As can be seen in Figure 18A, as described above, the contact area generally increases with increasing pressure. However, each finger responds differently to increased pressure. For example, Figure 18A shows that the contact areas of these fingers vary substantially under the same pressure level. For example, the H_RT curve indicates a contact area slightly above 50% when a pressure of 100 g is applied, while the contact areas of the M_RT, M_LT, and H_LT curves indicate a contact area slightly below 30% when a pressure of 100 g is applied.

[0222] As can also be seen in Figure 18A, the slopes of the H_RT and H_LT curves increase as the pressure increases from 200 g to 300 g. Both curves are concave upward. In contrast, the slope of the J_LT curve is generally constant within the pressure range of 10-300 g. The slope of the J_RT curve changes significantly within this pressure range, resulting in a concave downward curve. The curve shown in Figure 18B illustrates the aforementioned changes in contact area with pressure. As shown in Figures 18A and 18B, these changes are characteristic of specific fingers and can vary significantly between individuals and between fingers of the same individual.

[0223] FIG18C shows an example of how the void-to-ridge ratio of a fingerprint image changes with pressure. Fingerprint "voids" are also referred to herein as fingerprint grooves. The curves in FIG18C correspond to the left and right thumbs (L and R) of individuals J, M, and H. The value and slope variations shown in FIG18C are characteristic of specific fingers. Both the value and slope can vary significantly between individuals and between fingers of the same individual.

[0224] According to some examples, the anti-spoofing process may include estimating the material properties of the target object. In some such examples, the material properties of the target object may be based on the slope of one of the multiple graphs shown in Figures 18A, 18B, and 18C. For example, the slope in Figure 18A represents the degree to which a finger deforms as the applied force increases. The stiffer the finger, the less deformation occurs. Generally, finger stiffness and dryness are positively correlated. By tracking this information, we can further derive material properties such as Young's modulus and Poisson's ratio. Under the same nominal force, changes in contact area indicate strain on the skin. The relative value of Young's modulus can be determined by calculating the strain-stress ratio. The ratio of lateral strain (which can be estimated from changes in contact area) to axial strain (which can be estimated from depth information extracted from subdermal scans) is used to obtain the Poisson's ratio.

[0225] FIG19 is a graph illustrating changes in received signal strength as a function of the force applied to a finger on an ultrasonic sensor, according to some examples. In the example shown in FIG19 , the ultrasonic sensor system used for scanning is of the general type shown in FIG2 . Thus, in this example, the ultrasonic sensor system 102 includes a piezoelectric layer 208, an electrode layer 210 on one side of the piezoelectric layer 208, and a sensor pixel array 206 on a second, opposite side of the piezoelectric layer 208. In these examples, the ultrasonic signal corresponding to the ultrasonic scan is obtained via "direct sampling": reflected ultrasonic waves are received via the electrode layer 210, rather than reading out the signal from each individual sensor pixel in the sensor pixel array 206. In the example shown in FIG19 , the horizontal axis indicates force in grams-force, and the vertical axis indicates signal strength, with "V" representing voltage and "VPP" representing peak-to-peak voltage. Each data point shown in FIG19 corresponds to the average of six independent tests. The signal strength shown in FIG19 indicates signal reflections from the finger / pad interface. The greater the contact force, the larger the contact area corresponding to the fingerprint ridges, and therefore the smaller the return signal from the finger / platen interface.

[0226] Figure 20 shows examples of fingerprint images obtained from a dry finger using an ultrasonic fingerprint sensor. In these examples, images 1 and 5 are from the same part of the finger. Images 3 and 7 each correspond to another part of the finger. Images 1 and 3 are obtained when the finger lightly touches the surface of the ultrasonic fingerprint sensor, while images 5 and 7 are obtained when the finger presses against the surface with relatively high force. In these examples, a light touch corresponds to approximately 30 grams of force, and a heavier touch corresponds to 100 grams of force or more.

[0227] Figure 21 shows an example of a fingerprint image and corresponding force. The forces indicated are in grams. Although grams are actually a unit of mass, not force, for convenience and economy of language, the discussion in this disclosure may refer to force or pressure in grams. In Figure 21, "RT" represents the right thumb, and "LT" represents the left thumb.

[0228] In Figure 21, the relatively darker portions of the image correspond to areas with relatively high-amplitude reflections. As mentioned above, relatively high-amplitude reflections typically correspond to the air / platen, or more generally, the air / external surface interface, which occurs when fingerprint grooves are adjacent to an external surface. Relatively high-amplitude reflections occur because the air / external surface interface has a higher acoustic impedance contrast than the skin / external surface interface, which would occur when the fingerprint ridges come into contact with the external surface.

[0229] As can be seen, image 2101 has a much higher percentage of dark areas than image 2105. This is because image 2101 was obtained when a normal right thumb pressed against the outer surface with a force of 10 grams, while image 2105 was obtained when a normal right thumb pressed against the outer surface with a force of 300 grams. In the latter case, the fingerprint ridges respond to the applied force by appearing to spread laterally, in part because the portions of the fingerprint ridges that were not in contact with the surface when the lower force was applied are now pressed against the surface. As a result, image 2105 is obtained when a relatively high percentage of the image corresponds to the fingerprint ridge / external surface interface, which corresponds to the lighter areas of image 2105.

[0230] The above effect may not be noticeable for oily fingers. For example, referring to the "oily finger" example of the right thumb in FIG21 , it can be observed that while image 2109 has a slightly higher percentage of dark areas compared to image 2111 , the difference is not nearly as significant as the difference between image 2101 and image 2105 .

[0231] As shown in Figure 21, when a greater force is applied, some fingerprint image features may be clearer. For example, the termination 2103 is more clearly shown in image 2105 than in image 2101.

[0232] However, other fingerprint image features may be more distinct when less force is applied. For example, fold 2107a is prominent in image 2101 but not in image 2105. Similarly, fold 2107b is easily observed in image 2113 but not in image 2115.

[0233] According to some disclosed embodiments, anti-spoofing processes can be based on one or more features or other aspects of a fingerprint image that vary according to pressure. In some such embodiments, the fingerprint registration process can include obtaining ultrasonic fingerprint image data of the same portion of a finger under multiple different applied forces. For example, after obtaining a first set of ultrasonic fingerprint image data from a portion of a user's finger at a first measured (or estimated) force, the user can be prompted (e.g., via text and / or an image provided on a display and / or via an audio prompt provided through a speaker) to press the same portion of the finger more firmly against the outer surface of the ultrasonic fingerprint sensor surface (or a surface of the device proximate to the area where the ultrasonic fingerprint sensor is located). A second applied force can be measured (or estimated), and a second set of ultrasonic fingerprint image data can be obtained from the same portion of the user's finger. In some instances, this process can be repeated to obtain third, fourth, and / or fifth sets of ultrasonic fingerprint image data when the finger is pressed against the outer surface with third, fourth, and / or fifth measured or estimated forces. According to some embodiments, this process can be repeated for multiple fingers of the user during the registration process.

[0234] As described above with reference to FIG21 , a registration process that includes obtaining fingerprint image data while applying two or more different forces can reveal features of a finger that are difficult to spoof. For example, if a hacker possesses an image similar to image 2105, the hacker would not be able to successfully represent crease 2107a shown in image 2101. Similarly, if a hacker possesses image 2115, the hacker would not be able to successfully represent crease 2107b shown in image 2113.

[0235] During "runtime" operations after the enrollment process successfully completes, the anti-spoofing process can be based at least in part on data obtained during the enrollment process. In some instances, the anti-spoofing process can also be based at least in part on a first fingerprint image of the target object corresponding to the first ultrasonic receiver signal and / or a second fingerprint image of the target object corresponding to the second ultrasonic receiver signal. Some anti-spoofing processes can include obtaining a third fingerprint image of the target object corresponding to a third ultrasonic receiver signal. In some instances, the target object can be a finger. In some embodiments, the anti-spoofing process can be based at least in part on a measured or estimated force exerted by the finger on the external surface when the ultrasonic receiver signal is obtained.

[0236] For example, some examples of method 300 and / or method 750 may include measuring and / or estimating a first force corresponding to a first ultrasonic receiver signal and measuring and / or estimating a second force corresponding to a second ultrasonic receiver signal. In some such examples, method 300 and / or method 750 may include controlling a display and / or speaker to provide a prompt to apply a different force after measuring and / or estimating the first force.

[0237] FIG22A illustrates an example embodiment of using an ultrasonic fingerprint sensor to measure heart rate and respiratory rate according to aspects of the present disclosure. In this example, a collection of one or more snapshots (or ultrasound images) at one or more depths within a user's finger can be captured sequentially in time by the ultrasonic fingerprint sensor, and a controller can be configured to determine the user's heart rate and / or respiratory rate using changes over time in the collection due to movement of one or more subdermal structures in the user's finger.

[0238] In one embodiment, control system 106 (see FIG. 1B ) responds to a user's finger being placed near the ultrasonic fingerprint sensor area of ​​device 101 by operating an ultrasonic fingerprint sensor. Specifically, the ultrasonic fingerprint sensor is operated to transmit acoustic energy at a first frequency toward the surface of the finger (e.g., see block 2202A in FIG. 22C ) and capture one or more initial snapshots (also referred to as "fingerprint snapshots") of one or more reflections of the acoustic energy from the finger surface (e.g., see block 2202B in FIG. 22C ). Depending on the embodiment, the ultrasonic fingerprint sensor may be operated indirectly by control system 106 sending commands to fingerprint sensor system 102 of FIG. 1B . In some embodiments, the acoustic energy may be emitted by the ultrasonic fingerprint sensor as unmodulated pulses having a predetermined number of sine wave cycles at the first frequency. Block 2202 in FIG. 22A , which may be implemented as blocks 2202A and 2202B in FIG. 22C , illustrates the operations just described that may be performed by control system 106 in some embodiments of device 101.

[0239] In some embodiments, the first frequency specified by control system 106 in block 2202 can be determined in advance to be high enough for acoustic energy sensed in a pixel circuit of an ultrasonic fingerprint sensor at an (x,y) location in a two-dimensional array (e.g., 80x180 pixels) to be measured with sufficient spatial resolution to identify lines representing ridges and grooves on a finger surface. One embodiment of control system 106 specifies frequency F1 (e.g., 18.5 MHz, as shown in FIG. 22B ) in block 2202 as the frequency of the ultrasonic transmitter. This frequency F1 was experimentally determined based on the occurrence of a local maximum in a graph of signal strength (measured in the reflection of the acoustic energy) on the y-axis and the frequency of the emitted acoustic energy on the x-axis (see FIG. 22B ). In some implementations, control system 106 can be configured to derive the frequency of the ultrasonic transmitter specified in block 2202 based on a change in the current temperature relative to a reference temperature at which the initial value of frequency F1 (e.g., 18.5 MHz, as shown in FIG. 22B ) was experimentally determined.

[0240] Additionally, to capture the initial snapshot in block 2202, the control system 106 may specify a time delay (also referred to as a range gate delay) between operating the ultrasonic receiver 103 and the ultrasonic transmitter 105 based on a first distance for sound to propagate from the ultrasonic transmitter to the surface of a finger (which may be placed on the surface of the pressure plate or in another area of ​​the exterior surface of the device 101) and a second distance for sound to propagate from the finger surface to the ultrasonic receiver.

[0241] Upon completion of block 2202, the ultrasonic fingerprint sensor measurements included in the one or more initial snapshots may be stored in the memory of device 101. Block 2203 in FIG. 22A illustrates the storage operation just described, which may be performed by control system 106 in some embodiments of device 101. Furthermore, control system 106 may be configured to process the one or more initial snapshots in device 101's memory in a conventional manner (e.g., extracting a fingerprint therefrom) and compare the extracted fingerprint to a reference fingerprint of an authorized user. If the extracted fingerprint matches the reference fingerprint, control system 106 may authenticate the user and enable the user to access device 101. In addition to authenticating the user based on the extracted fingerprint, as described herein, certain embodiments of control system 106 may be configured to determine the activity of the user's finger (e.g., detecting a signal oscillating at the heart rate or breathing rate) before allowing access to device 101.

[0242] Additionally, the control system 106 can be configured to repeatedly operate the ultrasonic fingerprint sensor (as shown in block 2204 in FIG. 22A ) to capture a sequence of sets over a time window (e.g., 3 seconds in duration), each set comprising one or more additional snapshots (“subdermal snapshots”) of acoustic energy emitted by the ultrasonic fingerprint sensor at a second frequency (e.g., also as unmodulated pulses having a predetermined number of sine wave cycles) reflected from one or more depths within the user's finger. Block 2204 in FIG. 22A (which can be implemented as blocks 2204A and 2204B in FIG. 22C ) illustrates the operations just described that can be performed by the control system 106 in some embodiments of the device 101.

[0243] In block 2204 of FIG. 22A (and more specifically, in block 2204A of FIG. 22C ), the control system 106 is configured not to specify the first frequency (specified in block 2202) because any reflections of acoustic energy from one or more subdermal structures in the finger at the first frequency would have an intensity too low to be distinguished from noise at the ultrasound receiver. Specifically, there is a tradeoff between resolution and scanning depth: to achieve better resolution, the frequency needs to be increased; however, as the frequency increases, the SNR (signal-to-noise ratio) decreases (signal attenuation), and the acoustic energy cannot propagate deeper into the finger. Therefore, in some embodiments, the control system 106 is configured to specify a second frequency in block 2204 that is sufficiently low for the reflections of acoustic energy from one or more subdermal structures to have an intensity high enough to be distinguished from noise at the ultrasound receiver.

[0244] In some embodiments, the second frequency specified by control system 106 in block 2204 in FIG. 22A (more specifically, block 2204A in FIG. 22C ) can be predetermined to be significantly lower (e.g., more than 30% lower, or in some embodiments, even more than 40% lower) than the first frequency used in block 2202. In several embodiments, the second frequency is predetermined to be sufficiently low to allow the acoustic energy to penetrate the skin and reach the subdermal structures within the finger. One embodiment of control system 106 specifies frequency F2 (e.g., 9.25 MHz, as shown in FIG. 22B ) as the frequency of the ultrasonic transmitter in block 2204. This frequency F2 was also experimentally determined based on the occurrence of another local maximum in a graph of signal strength (measured in the reflection of the acoustic energy) on the y-axis and the frequency of the emitted acoustic energy on the x-axis (see FIG. 22B ). In the specific embodiment shown in FIG. 22B , frequency F2 (which is used to determine the oscillations of the internal organs) is exactly half of frequency F1 (which is used to create the fingerprint), although this relationship between the two frequencies may be similar in other embodiments. In a manner similar or identical to block 2202, some embodiments of the control system 106 can additionally be configured to obtain the frequency of the ultrasonic transmitter specified in block 2204 based on a change in the current temperature relative to a reference temperature at which an initial value of frequency F2 is experimentally determined (e.g., 9.25 MHz as shown in FIG. 22B ).

[0245] Furthermore, to capture additional snapshots in block 2204, the control system 106 may specify one or more time delays (or range gate delays) based on the amount of time required for sound to propagate from the ultrasonic transmitter to a first distance at one or more depths within the finger and from the one or more depths within the finger to a second distance at the ultrasonic receiver. The one or more depths within the finger may be selected, for example, to be within a range centered around half the thickness of a human finger (e.g., 4 mm) and with a width that is also half the thickness of a human finger (e.g., also 4 mm). The number of depths used in block 2204 may be preconfigured, for example, based on the computing power and memory of the device 101.

[0246] In some embodiments, the control system 106 may be implemented with a 128 MHz system clock and may be configured to convert each depth into a time delay (or range gate delay, abbreviated as RGD) based on a sound speed of 1500 meters per second as follows: Depth [mm] = RGD / 2 / 128 [MHz] * 1500 [m / s] * 1e3 RGD=[500,110] Depth [mm] = [500,1100] / 2 / 128e6*1500*1e3 = [2.9, 6.4]

[0247] The RGD values ​​of 500 and 1100 shown above are the number of cycles of a clock oscillating at 128 MHz. However, it should be appreciated that any suitable clock speed can be used to determine RGD, and that the average speed of sound in some device materials may be greater than or less than 1500 meters per second. In the illustrative embodiment, the control system 106 uses RGD values ​​of 650-800, corresponding to depths in the range of approximately 4-4.5 mm. The values ​​of 650 and 800 just described are also expressed in terms of the number of cycles of a 128 MHz clock. Some embodiments may use RGDs in the range of 4.5-8 μsec.

[0248] Upon completion of one or more cycles of the operations of block 2204, the ultrasonic fingerprint sensor measurements, including one or more additional snapshots, may be stored in the memory of the device 101. Block 2205 in FIG. 22A illustrates the storage operation just described, which may be performed by the control system 106 in some embodiments of the device 101.

[0249] In some examples, control system 106 can be configured to process one or more additional snapshots in device 101's memory in block 2206 ( FIG. 22A ) to determine whether any signals oscillate at a rate within a predetermined range for an internal human organ. In one illustrative example, the internal organ is the heart, and the predetermined range can be selected to have a lower limit of 40 breaths per minute (or 40 cycles per minute) and an upper limit of 200 breaths per minute (or 200 cycles per minute). In another illustrative example, the internal organ is the human lungs, and the predetermined range can be selected to have a lower limit of 8 breaths per minute (or 8 cycles per minute) and an upper limit of 40 breaths per minute (or 40 cycles per minute). Other examples of predetermined ranges for human organs as described herein may use lower and upper limits that approximate the values ​​just described, for example, within 10%. According to this embodiment, control system 106 can be configured to find the signal in block 2206 in response to block 2209 in FIG. 22A by using the signal's oscillation rate in several ways. For example, when the fingerprint in the initial snapshot (see block 2202) is found to match a reference fingerprint of an authorized user, or when the oscillation rate of the signal is identified and tracked (and in some embodiments, displayed on the display system 108) as the current value of the user's heart rate (or breathing rate), block 2209 can enable a currently disabled function in the device 101 (such as turning on the power of the display system 108 in Figure 1B).

[0250] In some embodiments, when the control system 106 does not detect a signal in block 2206, the control system 106 is configured to operate block 2208, in which the duration of the aforementioned window (see block 2204) is increased, for example, by one second. When block 2206 is operated again, the control system 106 may detect a signal based on measurements captured over the increased duration window. The loop just described between blocks 2208, 2204, 2205, and 2206 may be repeated a predetermined number of times (e.g., nine times) to reach a final window size (e.g., 12 seconds). If the control system 106 does not detect a signal (or a predetermined number of signals) during the loop, the control system 106 may determine that the object placed near the fingerprint sensor is not a live finger or limb (in other words, the object is spoofed). However, if the control system 106 detects a signal (or a predetermined number of signals) in one or more loops, the control system 106 may determine that the object placed near the fingerprint sensor is a live finger of the user. In some embodiments, the control system 106 that operates one or more of blocks 2202-2209 in Figure 22A supports (and is used to implement) components for controlling the operation of the mobile device and the ultrasonic fingerprint sensor and / or components for controlling the operation of the methods described herein.

[0251] In some embodiments of the control system 106, block 2206, which includes determining whether any signal oscillating at the heart rate (or respiration rate) is present in the additional measurements (captured in block 2204), may be performed by operating one or more of blocks 2310-2330 shown in FIG. 23 . Specifically, in block 2310, the control system 106 may be configured to filter each snapshot to remove noise (e.g., by signal processing in the image domain). Thereafter, in block 2320, the control system 106 may be configured to identify the most active locations in the finger (where blood flow may be present) (e.g., by signal processing in the time domain). Finally, in block 2330, the control system 106 may be configured to measure the heart rate or respiration rate (e.g., by signal processing in the frequency domain).

[0252] Control system 106 can be configured to operate block 2310 ( FIG. 23 ) by operating one or more of blocks 2411 through 2413 ( FIG. 24 ) as follows. In block 2411, control system 106 can be configured to retrieve all snapshots ( FIG. 22A ) within the time window (e.g., a duration of 3 seconds) stored by block 2205 from the memory of device 101. In block 2412, control system 106 can be configured to apply a low-pass filter (such as a 2D median filter) to each snapshot to obtain spatially filtered measurements. In block 2413, control system 106 can be configured to store the spatially filtered measurements obtained by block 2412 in the memory of device 101.

[0253] As described above with reference to block 2204 (see Figures 22A and 22C), the ultrasonic fingerprint sensor can repeatedly operate over a time window to capture a sequence of sets, with each set comprising one or more snapshots at each of one or more depths (e.g., measured along the z-axis). Thus, the measurements of the sequence can be time-indexed at the snapshots, e.g., at a specific location in the finger, whose x,y coordinates are determined by a specific pixel circuit measuring acoustic energy at that (x,y) location in the two-dimensional array of ultrasonic receivers, and whose z coordinate is determined by the depth in the finger (and, in turn, by the time delay, also known as the range gate delay). Thus, for each (x,y,z) location sampled in the finger (also known as a "subdermal location"), the memory of device 101 contains the time-indexed sequence of measurements stored by block 2205 (see, e.g., Figure 22C). Additionally, at each (x, y, z) location sampled in the finger, there may be a sequence of spatially filtered measurements indexed by time, which may be stored by block 2413 in the memory of device 101 (if operated, depending on the embodiment).

[0254] In some embodiments, the control system 106 can be configured to operate block 2320 ( FIG. 23 ) by operating one or more of blocks 2511, block 2511, and optional block 2518 ( FIG. 25 ) as follows. In block 2511, the control system 106 can be configured to apply a bandpass filter to each sequence of measurements indexed by time (which, in some embodiments, can be spatially filtered to remove noise in block 2310). The result of block 2511 is a bandpass-filtered sequence for each location sampled within the finger, and each bandpass-filtered sequence can be generated by at least removing (or reducing the amplitude of) any signal that oscillates in time below a lower limit or above an upper limit.

[0255] In one illustrative embodiment, the control system 106 operates block 2511 to determine whether there are any signals oscillating at the person's heart rate, and in some examples, may use 40 beats per minute as the lower limit of the bandpass filter and 200 breaths per minute as the upper limit. In another illustrative embodiment, the control system 106 may operate block 2511 to determine whether there are any signals oscillating at the person's breathing rate, and in some examples, may use 8 breaths per minute as the lower limit of the bandpass filter and 40 breaths per minute as the upper limit.

[0256] In yet another embodiment, block 2206 (see FIG. 22A ) can be implemented to include two parallel branches, each for simultaneously determining heart rate and respiration rate. In one such example, these two parallel branches begin in a common block 2310, followed by two copies of block 2320 to identify two different sets of most active finger positions (see FIG. 23 ), each for determining heart rate and respiration rate (e.g., by applying two bandpass filters corresponding to predetermined ranges of 40-200 cycles per minute and 8-40 cycles per minute). Following these two copies of block 2320, two corresponding copies of block 2330 can be performed to identify corresponding peaks in the frequency domain to identify heart rate and respiration rate. In one such embodiment, the time window can be 8 seconds in duration, and both heart rate and respiration rate can be determined simultaneously from the common set of measurements. In such an embodiment, heart rate can be determined immediately after 3 seconds of measurement accumulation, while respiration rate determination may require additional time (e.g., 5 seconds) to accumulate sufficient measurements within the time window (e.g., 8 seconds). In other embodiments, a different time window (e.g., 16 seconds) may be used to provide sufficient time to measure respiratory rate.

[0257] Yet another embodiment may be configured to operate block 2206 (and therefore block 2320) twice, once to determine the heart rate and a second time to determine the respiratory rate, and these rates may be determined based on measurements in separate time windows that do not overlap with each other.

[0258] In many such embodiments, where the heart rate and respiration rate signals are determined from a subdermal snapshot in a finger, most of the blocks and operations described herein may operate and / or be performed similarly or identically to one another, except for the differences in the upper and lower limits of the predetermined ranges described above.

[0259] In block 2512, the control system 106 may be configured to calculate a variance for each bandpass filtered sequence generated in block 2511 by applying a bandpass filter. For example, in one illustrative embodiment, the control system 106 calculates the variance as follows:

[0260] Where T represents the number of samples (or measurements) in the sequence along the time axis t. Thereafter, in block 2513, the control system 106 may sort the sampled (or probed) subdermal locations based on the variance of the corresponding bandpass filtered sequence calculated in block 2512. Next, based on the sorting order in block 2513, the control system 106 may select (in block 2514) a predetermined number N of subdermal locations (e.g., 1,000 subdermal locations) that have the highest statistical variance (and therefore may be the most active).

[0261] Thereafter, at block 2515, the control system 106 can be configured to perform noise-related tests (e.g., checking whether the variance at the N selected locations exceeds a threshold or other such tests). If the test at block 2515 is not met, block 2516 can be operated to declare no signal found, followed by a transition to block 2208 (see FIG. 22A , described above). If the test at block 2515 is met, block 2517 can be operated to store the coordinates of the N selected locations in the memory of the device 101 . Finally, at optional block 2518, the N selected locations can be used to identify the location of the peak variance, and the location of the peak variance can be used to select a central depth and one or more depths surrounding the central depth for use in operating the ultrasound receiver to capture a subdermal snapshot in the next operation at block 2204 (see FIG. 22A , described above). In such an embodiment, the initial set of depths can be predetermined to be within a range of [-150, 150] around a central RGD of approximately 650, in bins of 50 or fewer.

[0262] The control system 106 can be configured to operate block 2330 ( FIG. 23 ) by operating one or more of blocks 2611 through 2616 ( FIG. 6 ) as follows. In block 2611, the control system 106 can be configured to apply a Fourier transform to each time-domain sequence (which, in some embodiments, may have been bandpass filtered as described above in block 2511) at each of the N subdermal locations selected as having the highest variance in time (e.g., as described above in block 2514 ( FIG. 25 )). Upon completing block 2611, the control system 106 can obtain N frequency-domain vectors. Thereafter, in block 2612, the control system 106 can be configured to combine the N frequency-domain vectors, for example, by aggregation (or by averaging), to obtain a single frequency-domain vector. Subsequently, in block 2613, the control system 106 can be configured to identify peaks in the single frequency-domain vector. The peak can be tested in block 2613 to determine whether the peak has a sufficient signal-to-noise ratio, and if not, the control system 106 can go to block 2614 to wait for a new set of subdermal snapshots to become available (e.g., by sliding the time window forward when an iteration of sampling is completed).

[0263] In some embodiments, block 2613 may include calculating an estimated signal-to-noise ratio and quality factor, for example based on the following formula, to determine the presence of a peak (and therefore a signal oscillating at a rate within a predetermined range for an internal human organ according to block 2206).

[0264] When a peak is found, in some embodiments, the control system 106 may be configured to operate block 2615, where the identified peak is used to track a new peak in the frequency domain. Tracking in block 2615 may be performed on measurements in one or more newly captured subdermal snapshots in the frequency domain, for example, using an increment frequency that is an order of magnitude smaller than another increment frequency used in the Fourier transform (e.g., using an Extended Kalman Filter (EKF) estimate and / or a maximum likelihood (ML) estimate). The frequency of the new peak obtained through tracking in block 2615 may be stored by the control system 106 in the memory of the device 101 in block 2616 for use, for example, as the user's heart rate (or the user's breathing rate) in block 2209 ( FIG. 22A ).

[0265] In some embodiments, the frequency stored in the memory of device 101 by block 2616 can be displayed on the display system 108 ( FIG. 1B ) of device 101, for example, as a heart rate or respiratory rate. According to embodiments, as described above, the frequency stored in the memory of device 101 by block 2616 can be used by control system 106 to determine activity and, based thereon, power the display system 108. In some embodiments, a time window of at least three seconds in duration is used to determine the heart rate as described above. Therefore, in such embodiments, after a finger is placed on the outer surface of the device in the area of ​​the ultrasonic fingerprint sensor system, and before the display is powered on and the heart rate is displayed thereon (if the user's fingerprint is determined to be authentic), pulses of a low ultrasonic frequency can be repeatedly transmitted toward the finger at at least one time interval (e.g., a three-second interval).

[0266] In some embodiments, block 2615 may be configured to use a quadratic interpolation method, for example, to compute an estimate based on a peak value and its two nearest samples, as follows: y1 = Xa(k-1); y2 = Xa(k); y3 = Xa(k+1); d =(y3 - y1) / (2 * (2 * y2 - y1 - y3)); f_interp = f(k) + d*df; where: k represents the peak index; Xa(k) represents the peak value; f(k) represents the frequency of the peak; df represents the frequency interval; and f_interp represents the final interpolation frequency.

[0267] FIG27 representatively depicts aspects of a 4x4 pixel array of sensor pixels for an ultrasonic fingerprint sensor. Each sensor pixel 2734 may be associated with, for example, a localized area of ​​piezoelectric sensor material (PSM), a pixel input electrode 2737, a peak detection diode (D1), and a readout transistor circuit (M3); many or all of these components may be formed on or in a substrate to form pixel circuitry 2736. In practice, the localized area of ​​piezoelectric sensor material in each sensor pixel 2734 converts received ultrasonic energy into electrical charge. Peak detection diode D1 records the maximum amount of charge detected by the localized area of ​​piezoelectric sensor material (PSM). Each column of pixel array 2735 can then be scanned, for example, via a column select mechanism, gate driver, or shift register, and the readout transistor circuit M3 in each row can be triggered to allow the magnitude of the peak charge for each sensor pixel 2734 to be read by additional circuitry (e.g., a multiplexer and A / D converter). Pixel circuitry 2736 may include one or more TFTs to allow gating, addressing, and resetting of sensor pixel 2734.

[0268] Each pixel circuit 2736 can provide information about a small portion of the object detected by the ultrasonic fingerprint sensor. While the example shown in FIG. 27 has a relatively coarse resolution for ease of illustration, ultrasonic sensors with a resolution of 500 pixels per inch or higher can be configured with appropriately scaled structures. The detection area of ​​the ultrasonic fingerprint sensor can be selected based on the intended detection object. For example, for a single finger, the detection area can range from approximately 8 mm x 3 mm, 5 mm x 5 mm, or 9 mm x 4 mm to approximately 3 inches x 3 inches for four fingers. Smaller and larger areas (including square, rectangular, and non-rectangular geometries) can be appropriately used for target objects.

[0269] FIG28A illustrates an example of an exploded view of an ultrasonic fingerprint sensor. In this example, ultrasonic fingerprint sensor 2800a includes an ultrasonic transmitter 20 and an ultrasonic receiver 30 beneath a pressure plate 40. According to some embodiments, ultrasonic receiver 30 may be an example of ultrasonic receiver 103 shown in FIG1B and described above. In some embodiments, ultrasonic transmitter 20 may be an example of ultrasonic transmitter 105 shown in FIG1B and described above. Ultrasonic transmitter 20 may include a substantially planar piezoelectric transmitter layer 22 and may be configured to function as a plane wave generator. Ultrasonic waves can be generated by applying a voltage to the piezoelectric layer to expand or contract the layer, thereby generating a plane wave, depending on an applied signal. In this example, control system 106 may be configured to apply a voltage to the planar piezoelectric transmitter layer 22 via first and second transmitter electrodes 24 and 26. In this manner, ultrasonic waves can be generated by varying the thickness of the layer through the piezoelectric effect. The generated ultrasonic waves can propagate through pressure plate 40 toward a finger (or other object to be detected). A portion of the waves not absorbed or transmitted by the detection object may be reflected to return through the platen 40 and be received by the ultrasonic receiver 30. The first transmitter electrode 24 and the second transmitter electrode 26 may be metallized electrodes, e.g., metal layers coating opposite sides of the piezoelectric transmitter layer 22.

[0270] The ultrasound receiver 30 may include an array of sensor pixel circuits 32 disposed on a substrate 34 (substrate 34 may also be referred to as a backplane) and a piezoelectric receiver layer 36. In some embodiments, each sensor pixel circuit 32 may include one or more TFT or silicon-based components, electrically interconnecting scan lines, and, in some embodiments, one or more additional circuit elements (such as diodes, capacitors, etc.). Each sensor pixel circuit 32 may be configured to convert surface charge generated by the piezoelectric receiver layer 36 proximate to the pixel circuit into an electrical signal. Each sensor pixel circuit 32 may include a pixel input electrode 38 electrically coupling the piezoelectric receiver layer 36 to the sensor pixel circuit 32.

[0271] In the illustrated embodiment, a receiver bias electrode 39 is disposed on the side of the piezoelectric receiver layer 36 proximal to the platen 40. The receiver bias electrode 39 can be a metallized electrode and can be grounded or biased to control which signals are passed to the sensor pixel circuit array 32. Ultrasonic energy reflected from the exposed (top) surface of the platen 40 can be converted by the piezoelectric receiver layer 36 into surface charge. The generated surface charge can couple to the pixel input electrode 38 and the underlying sensor pixel circuit 32. The charge signal can be amplified or buffered by the sensor pixel circuit 32 and provided to the control system 106.

[0272] The control system 106 can be electrically connected (directly or indirectly) to the first and second transmitter electrodes 24, 26, as well as to the receiver bias electrode 39 and the sensor pixel circuitry 32 on the substrate 34. In some embodiments, the control system 106 can operate substantially as described above. For example, the control system 106 can be configured to process the amplified signal received from the sensor pixel circuitry 32.

[0273] The control system 106 can be configured to control the ultrasonic transmitter 20 and / or the ultrasonic receiver 30 to obtain ultrasonic data, which can include fingerprint data. According to some embodiments, the control system 106 can be configured to provide functionality such as described herein.

[0274] Regardless of whether the ultrasonic fingerprint sensor 2800a includes a separate ultrasonic transmitter 20, in some embodiments, the control system 106 can be configured to obtain attribute information from the ultrasonic data. In some examples, the control system 106 can be configured to control access to one or more devices based at least in part on the attribute information. The ultrasonic fingerprint sensor 2800a (or an associated device) can include a memory system comprising one or more memory devices. In some embodiments, the control system 106 can include at least a portion of the memory system. The control system 106 can be configured to obtain attribute information from the ultrasonic data and store the attribute information in the memory system. In some embodiments, the control system 106 can be configured to capture a fingerprint image, obtain attribute information from the fingerprint image, and store the attribute information obtained from the fingerprint image (hereinafter referred to as fingerprint image information or fingerprint image data) in the memory system. According to some examples, the control system 106 can be configured to capture a fingerprint image, obtain attribute information from the fingerprint image, and store the attribute information obtained from the fingerprint image even when the ultrasonic transmitter 20 is kept in an "off" state.

[0275] In some embodiments, the control system 106 can be configured to operate the ultrasonic fingerprint sensor 2800a in either ultrasonic imaging mode or force sensing mode. In some embodiments, the control system can be configured to keep the ultrasonic transmitter 20 in an "off" state when operating the ultrasonic fingerprint sensor in force sensing mode. The ultrasonic receiver 30 can be configured to function as a force sensor when the ultrasonic fingerprint sensor 2800a is operating in force sensing mode. In some embodiments, the control system 106 can be configured to control other devices, such as a display system, a communication system, etc. In some embodiments, the control system 106 can be configured to operate the ultrasonic fingerprint sensor 2800a in capacitive imaging mode.

[0276] The pressure plate 40 can be any suitable material capable of acoustically coupling to the receiver; examples include plastic, ceramic, sapphire, metal, and glass. In some embodiments, the pressure plate 40 can be a film-coated plate, such as cover glass or lens glass for a display. In particular, when the ultrasonic transmitter 20 is in use, fingerprint detection and imaging can, if desired, be performed with a relatively thick pressure plate, e.g., 3 mm or more. However, for embodiments in which the ultrasonic receiver 30 is configured to image fingerprints in force detection mode or capacitive detection mode, a thinner and relatively more compliant pressure plate 40 may be required. According to some such embodiments, the pressure plate 40 can comprise one or more polymers (such as one or more types of paraxylene) and can be substantially thinner. In some such embodiments, the pressure plate 40 can be tens of microns thick, or even less than 10 microns thick.

[0277] Examples of piezoelectric materials that can be used to form the piezoelectric receiver layer 36 include piezoelectric polymers having suitable acoustic properties, for example, an acoustic impedance between approximately 2.5 and 5 MRayl. Specific examples of piezoelectric materials that can be used include ferroelectric polymers such as polyvinylidene fluoride (PVDF) and polyvinylidene fluoride-trifluoroethylene (PVDF-TrFE) copolymers. Examples of PVDF copolymers include 60:40 (mol%) PVDF-TrFE, 70:30 PVDF-TrFE, 80:20 PVDF-TrFE, and 90:10 PVDR-TrFE. Other examples of piezoelectric materials that can be used include polyvinylidene chloride (PVDC) homopolymers and copolymers, polytetrafluoroethylene (PTFE) homopolymers and copolymers, and diisopropylammonium bromide (DIPAB).

[0278] The thickness of each of the piezoelectric transmitter layer 22 and the piezoelectric receiver layer 36 can be selected to be suitable for generating and receiving ultrasonic waves. In one example, the PVDF planar piezoelectric transmitter layer 22 is approximately 28 μm thick, and the PVDF-TrFE receiver layer 36 is approximately 12 μm thick. Example frequencies of ultrasonic waves can range from 1 MHz to 20 MHz, with wavelengths on the order of millimeters or less.

[0279] FIG28B shows an exploded view of an alternative example of an ultrasonic fingerprint sensor. In this example, the piezoelectric receptor layer 36 has been formed into discrete elements 37. In the embodiment shown in FIG28B , each discrete element 37 corresponds to a single pixel input electrode 38 and a single sensor pixel circuit 32. However, in the alternative embodiment of ultrasonic fingerprint sensor 2800b, there is not necessarily a one-to-one correspondence between each discrete element 37, a single pixel input electrode 38, and a single sensor pixel circuit 32. For example, in some embodiments, there may be multiple pixel input electrodes 38 and sensor pixel circuits 32 for a single discrete element 37.

[0280] Figures 28A and 28B illustrate an example arrangement of ultrasonic transmitters and receivers in an ultrasonic fingerprint sensor; other arrangements are possible. For example, in some embodiments, the ultrasonic transmitter 20 may be above the ultrasonic receiver 30, and therefore closer to the object being detected. In some embodiments, the ultrasonic transmitter may be included in an ultrasonic sensor array (e.g., a single layer of transmitters and receivers). In some embodiments, the ultrasonic fingerprint sensor may include an acoustic delay layer. For example, the acoustic delay layer may be incorporated into the ultrasonic fingerprint sensor between the ultrasonic transmitter 20 and the ultrasonic receiver 30. The acoustic delay layer can be used to adjust the timing of ultrasonic pulses while also electrically insulating the ultrasonic receiver 30 from the ultrasonic transmitter 20. The acoustic delay layer can have a substantially uniform thickness, with the material and / or thickness of the delay layer selected to provide a desired delay in the time it takes for reflected ultrasonic energy to reach the ultrasonic receiver 30. This allows energy pulses, which carry information about an object due to reflection from an object, to reach the ultrasonic receiver 30 during a time period when energy reflected from other parts of the ultrasonic fingerprint sensor is unlikely to reach the ultrasonic receiver 30. In some embodiments, substrate 34 and / or press plate 40 may function as an acoustic delay layer.

[0281] FIG28C shows an exploded view of an example of an ultrasonic fingerprint sensor. In this example, ultrasonic fingerprint sensor 2800c includes an ultrasonic transceiver array 50 beneath platen 40. According to some embodiments, ultrasonic transceiver array 50 can function as both ultrasonic receiver 103 and ultrasonic transmitter 105, as shown in FIG1B and described above. Ultrasonic transceiver array 50 can include a substantially planar piezoelectric transceiver layer 56 configured to function as a plane wave generator. Ultrasonic waves can be generated by applying a voltage to transceiver layer 56. Control system 106 can be configured to generate a transceiver excitation voltage, which can be applied to piezoelectric transceiver layer 56 via one or more underlying pixel input electrodes 38 or one or more overlying transceiver bias electrodes 59. The generated ultrasonic waves can propagate through platen 40 toward a finger or other object to be detected. A portion of the wave not absorbed or transmitted by the object can be reflected, returning through platen 40 and being received by ultrasonic transceiver 50.

[0282] The ultrasound transceiver array 50 can include an array of sensor pixel circuits 32 disposed on a substrate 34. In some embodiments, each sensor pixel circuit 32 can include one or more TFT or silicon-based components, electrically interconnecting scan lines, and in some embodiments, one or more additional circuit elements (such as diodes, capacitors, etc.). Each sensor pixel circuit 32 can include a pixel input electrode 38 that electrically couples the piezoelectric transceiver layer 56 to the sensor pixel circuit 32.

[0283] In the illustrated embodiment, a transceiver bias electrode 59 is disposed on the side of the piezoelectric transceiver layer 56 proximal to the platen 40. The transceiver bias electrode 59 can be a metallized electrode and can be grounded or biased to control which signals are generated and which reflected signals are passed to the sensor pixel circuit array 32. Ultrasonic energy reflected from the exposed (top) surface of the platen 40 can be converted into surface charge by the piezoelectric transceiver layer 56. The generated surface charge can couple to the pixel input electrode 38 and the underlying sensor pixel circuit 32. The charge signal can be amplified or buffered by the sensor pixel circuit 32 and provided to the control system 106.

[0284] The control system 106 can be electrically connected (directly or indirectly) to the transceiver bias electrodes 59 and the sensor pixel circuitry 32 on the sensor substrate 34. In some embodiments, the control system 106 can operate substantially as described above. For example, the control system 106 can be configured to process the amplified signal received from the sensor pixel circuitry 32.

[0285] The control system 106 may be configured to control the ultrasonic transceiver array 50 to obtain ultrasonic data, which may include fingerprint data. According to some embodiments, the control system 106 may be configured to provide functionality such as described herein.

[0286] In other examples of ultrasonic fingerprint sensors having an array of ultrasonic transceivers, the back side of the sensor substrate 34 can be attached directly or indirectly to an overlying pressure plate 40. In operation, ultrasonic waves generated by the piezoelectric transceiver layer 56 can propagate through the sensor substrate 34 and pressure plate 40, reflect from the surface of the pressure plate 40, and return through the pressure plate 40 and sensor substrate 34 before being detected by the sensor pixel circuitry 32 on or in the sensor substrate 34.

[0287] The following numbered clauses describe implementation examples:

[0288] 1. A method for controlling a device including a fingerprint sensor system, the method comprising: receiving, by a control system, fingerprint sensor data from the fingerprint sensor system; detecting, by the control system and based on the fingerprint sensor data, the presence of a finger on an external surface of the device in an area of ​​the fingerprint sensor system; determining, by the control system and based on the fingerprint sensor data, a finger force or finger pressure of the finger on the external surface of the device; performing, by the control system and based on the fingerprint sensor data, a time threshold determination, the time threshold determination comprising determining whether a length of time during which the finger force exceeds a threshold finger force or during which the finger pressure exceeds a threshold finger pressure is greater than or equal to a threshold time length; and determining, by the control system and based at least in part on the time threshold determination, whether to enable one or more emergency response functions of the device.

[0289] 2. The method of clause 1, wherein the one or more emergency response functions include one or more of: initiating a telephone call to an emergency response telephone number, initiating a telephone call to a designated emergency communication recipient, or initiating a text message to a designated emergency communication recipient.

[0290] 3. A method according to clause 1 or clause 2, wherein the one or more emergency response functions include one or more of the following: initiating an audio recording session, initiating a video recording session, taking one or more photos, or causing one or more financial institution accounts to be locked.

[0291] 4. The method according to any one of clauses 1-3 further includes: determining the heart rate by the control system based on the fingerprint sensor data; and determining by the control system whether the heart rate is equal to or exceeds a threshold heart rate.

[0292] 5. A method according to clause 4, wherein the control system determines that the heart rate is not equal to or exceeds a threshold heart rate, and further includes controlling the device by the control system to provide a prompt indicating that at least one of the one or more emergency response functions will be enabled if a first specified user action is taken.

[0293] 6. The method of clause 5, wherein providing the prompt comprises presenting a graphical user interface (GUI) on a display device of the apparatus.

[0294] 7. The method of clause 5 or clause 6, wherein the first specified user action comprises an additional instance of finger force or an additional instance of finger pressure to be applied in the fingerprint sensor system area.

[0295] 8. The method of clause 4, wherein the control system determines that the heart rate equals or exceeds a threshold heart rate, further comprising estimating, by the control system and based on the fingerprint sensor data, an anxiety level.

[0296] 9. The method of clause 8, wherein estimating the anxiety level comprises detecting the presence or absence of finger sweating.

[0297] 10. The method of clause 9, wherein the control system detects the presence of finger sweating, further comprising enabling, by the control system, one or more emergency response functions.

[0298] 11. The method of clause 10, further comprising determining user location information prior to enabling one or more emergency response functions, and providing the user location information with at least one emergency response communication.

[0299] 12. The method of clause 9, wherein the control system does not detect the presence of finger sweat, further comprising controlling the device, by the control system, to provide a prompt indicating that at least one of the one or more emergency response functions will be enabled if a second specified user action is taken.

[0300] 13. The method of clause 12, wherein the second specified user action comprises an additional instance of finger force or an additional instance of finger pressure to be applied in the fingerprint sensor system area.

[0301] 14. The method of any one of clauses 1-13, wherein receiving fingerprint sensor data comprises receiving ultrasonic fingerprint sensor data.

[0302] 15. The method according to any of clauses 1-14, further comprising determining, by the control system, whether the finger is the finger most commonly used for the authentication process.

[0303] 16. The method according to any of clauses 1-15 further includes determining, by the control system, whether a finger has been selected for triggering one or more emergency response functions, wherein the determination of whether to enable one or more emergency response functions is based at least in part on whether a finger has been selected for triggering one or more emergency response functions.

[0304] 17. The method according to any of clauses 1-16 further includes a pattern determination process, in which the control system determines whether a complete pattern has been entered via the fingerprint sensor system, wherein determining whether to enable one or more emergency response functions is based at least in part on the pattern determination process.

[0305] 18. The method of clause 17, wherein the complete pattern comprises a plurality of instances of finger force or a plurality of instances of finger pressure applied in the fingerprint sensor system area.

[0306] 19. A method according to clause 17 or clause 18, wherein the control system determines that a complete pattern has not been received via the fingerprint sensor system, and further includes controlling the device by the control system to provide a prompt indicating that at least one of the one or more emergency response functions will be enabled if a specified user action is taken.

[0307] 20. The method of clause 19, wherein providing the prompt comprises presenting a graphical user interface (GUI) on a display device of the apparatus.

[0308] 21. The method of clause 19 or clause 20, wherein the second specified user action comprises an additional instance of finger force or an additional instance of finger pressure to be applied in the fingerprint sensor system area.

[0309] 22. The method of any of clauses 1-21, further comprising performing, by the control system, an authentication process based at least in part on fingerprint sensor data.

[0310] 23. One or more non-transitory media having software stored thereon, the software comprising instructions for controlling one or more devices to perform a method comprising: receiving, by a control system, fingerprint sensor data from a fingerprint sensor system; detecting, by the control system and based on the fingerprint sensor data, the presence of a finger on an external surface of the device in an area of ​​the fingerprint sensor system; determining, by the control system and based on the fingerprint sensor data, a finger force or finger pressure of the finger on the external surface of the device; determining, by the control system and based on the fingerprint sensor data, a heart rate; and determining, by the control system and based at least in part on the heart rate and the finger force or finger pressure, whether to enable one or more emergency response functions of the device.

[0311] 24. One or more non-transitory media according to clause 23, wherein the one or more emergency response functions include one or more of the following: initiating a telephone call to an emergency response telephone number, initiating a telephone call to a designated emergency communication recipient, initiating a text message to a designated emergency communication recipient, initiating an audio recording session, initiating a video recording session, taking one or more photographs, or causing one or more financial institution accounts to be locked.

[0312] 25. One or more non-transitory media according to clause 23 or clause 24, further comprising determining by the control system whether the heart rate equals or exceeds a threshold heart rate.

[0313] 26. One or more non-transitory media according to clause 25, wherein the control system determines that the heart rate does not equal or exceed the threshold heart rate, and also includes the control system controlling the device to provide a prompt indicating that if a first specified user action is taken, at least one of the one or more emergency response functions will be enabled.

[0314] 27. The one or more non-transitory media of clause 26, wherein providing the prompt comprises presenting a graphical user interface (GUI) on a display device of the apparatus.

[0315] 28. One or more non-transitory media according to clause 26 or clause 27, wherein the first specified user action includes an additional instance of finger force or an additional instance of finger pressure to be applied in the fingerprint sensor system area.

[0316] 29. A device comprising: a fingerprint sensor system; and a control system configured to: receive fingerprint sensor data from the fingerprint sensor system; detect the presence of a finger on an external surface of the device in an area of ​​the fingerprint sensor system based on the fingerprint sensor data; determine a finger force or finger pressure of the finger on the external surface of the device based on the fingerprint sensor data; perform a time threshold determination, the time threshold determination comprising determining whether a length of time during which the finger force exceeds a threshold finger force or during which the finger pressure exceeds a threshold finger pressure is greater than or equal to a threshold time length; and determine whether to enable one or more emergency response functions of the device based at least in part on the time threshold determination.

[0317] 30. An apparatus according to claim 29, wherein the control system is further configured to perform a pattern determination process that determines whether a complete pattern has been entered via the fingerprint sensor system, wherein the complete pattern includes multiple instances of finger force applied in the fingerprint sensor system area or additional instances of finger pressure, and wherein determining whether to enable one or more emergency response functions is based at least in part on the pattern determination process.

[0318] As used herein, a phrase referring to "at least one of" a list of items refers to any combination of those items, including individual members. For example, "at least one of a, b, or c" is intended to encompass: a, b, c, ab, ac, bc, and abc.

[0319] The various illustrative logics, logic blocks, modules, circuits, and algorithmic processes described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of both. The interchangeability of hardware and software has been generally described in terms of functionality and illustrated in the various illustrative components, blocks, modules, circuits, and processes described above. Whether such functionality is implemented as hardware or software depends on the specific application and design constraints imposed on the overall system.

[0320] The hardware and data processing devices used to implement the various illustrative logic, logic blocks, modules, and circuits described in conjunction with the aspects disclosed herein may be implemented or performed using a general-purpose single-chip or multi-chip processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device designed to perform the functions described herein, discrete gate or transistor logic, discrete hardware components, or any combination thereof. A general-purpose processor may be a microprocessor, or any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors combined with a DSP core, or any other such configuration. In some embodiments, specific processes and methods may be performed by circuits specific to a given function.

[0321] In one or more aspects, the described functions may be implemented in hardware, digital electronic circuitry, computer software, firmware (including the structures disclosed in this specification and their equivalents), or any combination thereof. The subject matter described in this specification may also be implemented as one or more computer programs (i.e., one or more computer program instruction modules) encoded on a computer storage medium for execution by a data processing device or for controlling the operation of the data processing device.

[0322] If implemented in software, these functions may be stored as one or more instructions or codes on a computer-readable medium or transmitted on a computer-readable medium (such as a non-transitory medium). The processes of the methods or algorithms disclosed herein may be implemented in a processor-executable software module residing on a computer-readable medium. Computer-readable media includes both computer storage media and communication media, including any medium capable of transferring a computer program from one location to another. Storage media can be any available medium that can be accessed by a computer. By way of example and not limitation, non-transitory media may include RAM, ROM, EEPROM, CD-ROM or other optical disk memory, magnetic disk memory or other magnetic storage devices, or any other medium that can be used to store the desired program code in the form of instructions or data structures and that can be accessed by a computer. Furthermore, any connection may be appropriately referred to as a computer-readable medium. Magnetic disk and optical disc, as used herein, include compact discs (CDs), laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, with magnetic disks typically reproducing data magnetically and optical discs reproducing data optically using lasers. The above combinations should also be included within the scope of computer-readable media. In addition, the operations of a method or algorithm may reside on machine-readable media and computer-readable media as one or any combination or set of codes and instructions, which may be incorporated into a computer program product.

[0323] Various modifications to the embodiments described in this disclosure will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the implementations shown herein but is to be accorded the widest scope consistent with the claims, principles, and novel features disclosed herein. The word "exemplary," if used, is used exclusively herein to mean "serving as an example, instance, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as better or advantageous over other embodiments.

[0324] Certain features described in this specification in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented separately in multiple embodiments or in any suitable subcombination. Furthermore, while the above features may be described as functioning in certain combinations, or even initially claimed as such, in some cases one or more features from a claimed combination may be deleted from that combination, and the claimed combination may be directed to a subcombination or variations of the subcombination.

[0325] Similarly, although operations are depicted in a particular order in the drawings, this should not be construed as requiring that such operations be performed in the particular order shown, or in a serialized order, or that all illustrated operations be performed, to achieve the desired results. In certain circumstances, multitasking and parallel processing may be advantageous. Furthermore, the separation of various system components in the above-described implementations should not be construed as requiring such separation in all implementations. Instead, it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products. Furthermore, other implementations are within the scope of the following claims. In certain circumstances, the actions listed in the claims can be performed in a different order and still achieve the desired results.

[0326] It will be understood that unless features in any of the specifically described implementations are explicitly identified as incompatible with one another or the surrounding context suggests that they are mutually exclusive and cannot be readily combined in a complementary and / or supporting sense, the overall concept of the present disclosure contemplates and envisions that specific features of those complementary implementations can be selectively combined to provide one or more comprehensive but slightly different technical solutions. Therefore, it will be further understood that the above description is given by way of example only and that modifications in detail may be made within the scope of the present disclosure.

[0327] 101: Installation 102: Fingerprint sensor system 103: Ultrasonic receiver 104: Interface System 105:Ultrasonic transmitter 106: Control System 108: Display system 110: Force sensor 202: Adhesive layer 204:TFT layer 206: sensor pixel array 208: Piezoelectric layer 210: electrode layer 212: passivation layer 213: Ultrasound 214: Reflection 215: Interface 300: Method 303, 305, 307, 309, 311: Blocks 400:Method 403, 405, 407, 408, 409, 411, 413, 415, 417, 418, 419, 421: Blocks 500, 600, 700: Graphical User Interface 800: Graphical User Interface 805:GUI part 900: Graphical User Interface 905:GUI part 1000: Graphical User Interface 1005:Sensor area icon 1010: Pressure gauge 1015: Text prompt 1100: Method 1103, 1105, 1107, 1109, 1111: Blocks 1200: Method 1203, 1205, 1207, 1208, 1209, 1210, 1211, 1212, 1213, 1215, 1217, 1219, 1221, 1223, 1225, 1227, 1229, 1231, 1233, 1235: Blocks 1300: Method 1303, 1305, 1307: Blocks 1400a, 1400b, 1400c, 1400d: Graphical user interface 1405: Message area 1410: Fingerprint sensor system area icon 1500: Method 1501a: Phase 1503, 1505, 1507, 1509: Blocks 1501b: Phase 1511, 1513, 1515, 1517, 1520: Blocks 1600a, 1600b, 1600c: Graphical User Interface 1605: Message area 1610: Fingerprint sensor system area icon 1615: Finger Pressure Indicator 1620a, 1620b, 1620c: Arrows 1621: Arrow 1625a, 1625b, 1625c: Components 1630: Progress Indicator 1700a, 1700b, 1700c, 1700d: Graphical user interface 1705: Message Area 1710: Fingerprint sensor system area icon 1715: Finger Pressure Indicator 1720a, 1720b, 1720c: Arrows 1725a, 1725b: Components 1730: Progress Indicator 1750: Method 1753, 1755, 1757, 1759: Blocks 1, 3, 5, 7: Image 2101, 2103, 2105, 2109, 2111, 2113, 2115: Image 2107a, 2107b: Pleats 2202, 2202A, 2202B, 2203, 2204, 2204A, 2204B, 2205, 2206, 2208, 2209: Blocks F1, F2: frequency 2310, 2320, 2330, 2411, 2412, 2413: Blocks 2511, 2512, 2513, 2514, 2515, 2516, 2517, 2518: Blocks 2611, 2612, 2613, 2614, 2615, 2616: Blocks 2734:Sensor pixels 2735:Pixel Array 2736:Pixel Circuit 2737:Pixel input electrode D1: Peak detection diode M3: readout transistor circuit PSM: Piezoelectric Sensor Material 2800a, 2800b, 2800c: Ultrasonic fingerprint sensors 20: Ultrasonic transmitter 22: Piezoelectric emitter layer 24: First transmitter electrode 26: Second transmitter electrode 30: Ultrasonic receiver 32: Sensor pixel circuit array 34:Sensor substrate 36: Piezoelectric receiver layer 37: Discrete components 38: Pixel input electrode 39: Receiver bias electrode 40:Press plate 50:Ultrasonic transceiver array 56: Piezoelectric transceiver layer 59: Transceiver bias electrode

Claims

1. A method for controlling an apparatus including a fingerprint sensor system, the method comprising: The control system receives fingerprint sensor data from the fingerprint sensor system; The control system detects the presence of a finger on the outer surface of the device in the fingerprint sensor system area based on the fingerprint sensor data; the control system determines the finger force or finger pressure on the outer surface of the device based on the fingerprint sensor data. The control system determines a time threshold value based on the fingerprint sensor data. This time threshold value determination includes: determining whether the duration for which the finger force exceeds a threshold finger force or the duration for which the finger pressure exceeds a threshold finger pressure is greater than or equal to a threshold time duration; determining a heart rate based on the fingerprint sensor data; and determining whether the heart rate is equal to or exceeds a threshold heart rate. Wherein, if the control system determines that the heart rate is not equal to or exceeds the threshold heart rate, the system further includes controlling the device to provide a prompt indicating that at least one of the one or more emergency response functions will be activated if a first specified user action is taken; and determining whether to activate one or more emergency response functions of the device, at least in part based on the time threshold value determination.

2. The method as described in request item 1, wherein, The one or more emergency response functions include one or more of the following: initiating a telephone call to an emergency response telephone number, initiating a telephone call to a designated emergency communication recipient, or initiating a text message to the designated emergency communication recipient.

3. The method as described in request item 1, wherein, The one or more emergency response functions include one or more of the following: initiating an audio recording session, initiating a video recording session, taking one or more photos, or locking one or more financial institution accounts.

4. The method as described in request item 1, wherein, Providing the prompts includes presenting a graphical user interface (GUI) on the display device of the device.

5. The method as described in request item 1, wherein, The first specified user action includes: an additional instance of finger force or finger pressure applied in the area of ​​the fingerprint sensor system.

6. The method as described in request item 1, wherein, The control system determines that the heart rate is equal to or exceeds the threshold heart rate, and further includes: estimating the anxiety level by the control system based on the fingerprint sensor data.

7. The method as described in claim 6, wherein, Estimating the anxiety level includes detecting the presence or absence of hand sweating.

8. The method as described in request item 7, wherein, The control system detects the presence of sweaty fingers and further includes: enabling one or more emergency response functions by the control system.

9. The method described in claim 8 further includes: Before activating the one or more emergency response functions, the user's location information is determined and provided via at least one emergency response communication.

10. The method as described in claim 7, wherein, The control system does not detect the presence of sweaty fingers, and further includes: the control system controlling the device to provide a prompt indicating that at least one of the one or more emergency response functions will be activated if a second specified user action is taken.

11. The method as described in claim 10, wherein, The second specified user action includes: an additional instance of finger force or finger pressure applied in the area of ​​the fingerprint sensor system.

12. The method as described in claim 1, wherein, Receiving the fingerprint sensor data includes receiving ultrasonic fingerprint sensor data.

13. The method as described in claim 1, further comprising: The control system determines whether the finger is the most frequently used finger in the authentication process.

14. The method as described in claim 1, further comprising: The control system determines whether the finger has been selected to trigger the one or more emergency response functions, wherein the determination of whether to enable the one or more emergency response functions is based at least in part on whether the finger has been selected to trigger the one or more emergency response functions.

15. The method as described in claim 1, further comprising: The pattern determination process, wherein the control system determines whether a complete pattern has been input via the fingerprint sensor system, wherein the determination of whether to enable the one or more emergency response functions is based at least in part on the pattern determination process.

16. The method as described in claim 15, wherein, The complete pattern includes: multiple instances of finger force or multiple instances of finger pressure applied in the area of ​​the fingerprint sensor system.

17. The method as described in claim 15, wherein, The control system determines that the complete pattern has not yet been received via the fingerprint sensor system, and further includes: controlling the device by the control system to provide a prompt indicating that at least one of the one or more emergency response functions will be enabled if a specified user action is taken.

18. The method as described in claim 17, wherein, Providing the prompts includes presenting a graphical user interface (GUI) on the display device of the device.

19. The method as described in claim 17, wherein, The specified user action includes additional instances of finger force or finger pressure applied in the area of ​​the fingerprint sensor system.

20. The method as described in claim 1, further comprising: The control system performs an authentication process that is at least partially based on the fingerprint sensor data.

21. A non-transitory storage medium having software stored thereon, the software including instructions for controlling one or more devices to perform a method, the method comprising: The control system receives fingerprint sensor data from the fingerprint sensor system. The control system detects the presence of a finger on the outer surface of the device in the fingerprint sensor system area based on the fingerprint sensor data; the control system determines the finger force or finger pressure on the outer surface of the device based on the fingerprint sensor data; the control system determines the heart rate based on the fingerprint sensor data; the control system determines the heart rate based on the fingerprint sensor data; the control system determines whether the heart rate is equal to or exceeds a threshold heart rate; wherein, the control system determines that the heart rate is not equal to or exceeds the threshold heart rate, and further includes the control system controlling the device to provide a prompt indicating that at least one of the one or more emergency response functions will be activated if a first specified user action is taken. And the control system determines whether to activate one or more emergency response functions of the device, based at least in part on the heart rate and the finger force or the finger pressure.

22. One or more non-transitory media as described in claim 21, wherein, The one or more emergency response functions include one or more of the following: initiating a telephone call to an emergency response telephone number, initiating a telephone call to a designated emergency communications recipient, initiating a text message to the designated emergency communications recipient, initiating an audio recording session, initiating a video recording session, taking one or more photos, or locking one or more financial institution accounts.

23. One or more non-transitory media as described in claim 21, wherein, Providing the prompt includes presenting a graphical user interface (GUI) on the display device of the device.

24. One or more non-transitory media as described in claim 21, wherein, The first specified user action includes: an additional instance of finger force or finger pressure applied in the area of ​​the fingerprint sensor system.

25. An apparatus including a fingerprint sensor system, comprising: Fingerprint sensor system; The control system is configured to receive fingerprint sensor data from the fingerprint sensor system. Based on the fingerprint sensor data, the presence of a finger on the outer surface of the device in the fingerprint sensor system area is detected; based on the fingerprint sensor data, the finger force or finger pressure of the finger on the outer surface of the device is determined; The process includes determining a time limit, which comprises: determining whether the duration for which the finger force exceeds a threshold finger force or the duration for which the finger pressure exceeds a threshold finger pressure is greater than or equal to a threshold duration; determining a heart rate by the control system based on the fingerprint sensor data; determining whether the heart rate is equal to or exceeds a threshold heart rate by the control system; wherein, if the control system determines that the heart rate is not equal to or exceeds the threshold heart rate, the process further includes controlling the device to provide a prompt indicating that at least one of the one or more emergency response functions will be activated if a first specified user action is taken; and determining whether to activate one or more emergency response functions of the device, at least in part based on the time limit determination.

26. The apparatus as claimed in claim 25, wherein, The control system is further configured to: execute a pattern determination process that determines whether a complete pattern has been input via the fingerprint sensor system, wherein the complete pattern includes multiple instances of finger force or multiple additional instances of finger pressure applied in the area of ​​the fingerprint sensor system, and wherein determining whether to enable the one or more emergency response functions is based at least in part on the pattern determination process.

Images