Implementation of biometric authentication

Abstract

The present disclosure generally relates to implementing biometric authentication, including providing a user interface for a biometric registration processing tutorial, aligning biometric features for registration, registering biometric features, providing prompts during a biometric registration process, biometric authentication based on an application, automatically populating biometric secure fields, unlocking a device using biometric authentication, retrying biometric authentication, managing transmissions using biometric authentication, an interpolated user interface during biometric authentication, blocking retrying biometric authentication, caching biometric authentication, automatically populating populable fields based on visibility criteria, the method includes automatically logging in using biometric authentication, retrying the biometric authentication at a credential input user interface, providing an indication of an error condition during the biometric authentication, providing an indication about a biometric sensor during the biometric authentication, and orienting the device to register a biometric feature.

Description

[0001] This application is a divisional application of an application with international application number PCT / US2018 / 049289, international filing date September 1, 2018, date of entry into the Chinese national phase February 15, 2019, and national application number 201880003211.7, with the invention title "Implementation of Biometric Authentication".

[0002] Cross - Reference to Related Applications

[0003] This application claims priority to the following patent applications: U.S. Provisional Patent Application No. 62 / 556,413, filed September 9, 2017, "FACE ENROLLMENT AND AUTHENTICATION"; No. 62 / 557,130, filed September 11, 2017, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; Danish Patent Application No. PA 2017 70712, filed September 22, 2017, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; No. PA 2017 70713, filed September 22, 2017, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; No. PA 2017 70714, filed September 22, 2017, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; No. PA 2017 70715, filed September 22, 2017, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; U.S. Provisional Patent Application No. 62 / 581,025, filed November 2, 2017, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; International Application No. PCT / US2018 / 015603, filed January 26, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; U.S. Patent Application No. 15 / 894,221, filed February 12, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; U.S. Patent Application No. 15 / 903,456, filed February 23, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; U.S. Provisional Patent Application No. 62 / 679,955, filed June 3, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; Danish Patent Application No. PA 2018 70370, filed June 12, 2018, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION"; and Danish Patent Application No. filed June 12, 2018PA 2018 70371, "IMPLEMENTATION OF BIOMETRIC AUTHENTICATION". All of these applications are incorporated herein by reference in their entirety. TECHNICAL FIELD

[0004] The present disclosure generally relates to biometric authentication and, more particularly, to interfaces and techniques for the enrollment and authentication of biometric traits. BACKGROUND OF THE DISCLOSURE

[0005] Using an electronic device to perform biometric authentication of, for example, a face, iris, or fingerprint is a convenient and effective way to authenticate a user of the electronic device. Biometric authentication allows the device to quickly and easily verify the identity of any number of users. SUMMARY OF THE DISCLOSURE

[0006] However, some techniques for implementing biometric authentication using an electronic device are generally cumbersome. For example, some prior arts such as those involving face recognition require the user to align the biometric trait nearly perfectly in the same way during both enrollment and each iteration of authentication. Deviations from the alignment of the biometric trait typically result in false negative recognition results. Thus, the user optionally needs to perform multiple iterations of biometric authentication unnecessarily, or optionally simply does not want to use biometric authentication. As another example, some prior arts rely only on two-dimensional representations of biometric traits. Thus, authentication of the user is optionally limited by the failure to analyze one or more three-dimensional features of the biometric trait and also optionally requires the user to perform additional iterations of biometric authentication unnecessarily. Given the foregoing drawbacks, the prior art takes more time than desired, which wastes the user's time and device energy. This latter consideration is particularly significant in the operation of battery-powered devices.

[0007] Accordingly, the present technology provides faster and more effective methods and interfaces for implementing biometric authentication for an electronic device. Such methods and interfaces optionally supplement or replace other methods for implementing biometric authentication. Such methods and interfaces reduce the cognitive burden imposed on the user and result in a more effective human-machine interface. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charges. Such methods and interfaces also reduce the amount of unnecessary, irrelevant, or repetitive input required at a computing device such as a smart phone and a smart watch.

[0008] According to some examples, a method is described that includes: at an electronic device having one or more input devices, one or more biometric sensors, and a display: displaying a first user interface on the display; while displaying the first user interface, detecting the occurrence of a condition corresponding to introducing a biometric registration process for registering a biometric characteristic; in response to detecting the occurrence of the condition corresponding to introducing the biometric registration process, displaying a biometric registration introduction interface, wherein displaying the biometric registration introduction interface includes simultaneously displaying: a simulated representation of the biometric characteristic; and a simulated progress indicator; while displaying the biometric registration introduction interface, displaying a teaching animation, including displaying the movement of the simulated representation of the biometric characteristic and the incremental advancement of the simulated progress indicator; after displaying at least a portion of the teaching animation, detecting the occurrence of a condition corresponding to initiating the biometric registration process; and in response to detecting the occurrence of the condition corresponding to initiating the biometric registration process: displaying a progress indicator corresponding to the simulated progress indicator; and displaying a representation of the user's biometric characteristic determined by the one or more biometric sensors of the device at a location previously occupied by the simulated representation of the biometric characteristic in the biometric registration introduction interface.

[0009] According to some examples, a non-transitory computer-readable medium is described that includes one or more programs configured to be executed by one or more processors of an electronic device having one or more input devices, one or more biometric sensors, and a display, the one or more programs including instructions for performing the following operations: displaying a first user interface on the display; while displaying the first user interface, detecting the occurrence of a condition corresponding to introducing a biometric registration process for registering a biometric characteristic; in response to detecting the occurrence of the condition corresponding to introducing the biometric registration process, displaying a biometric registration introduction interface, wherein displaying the biometric registration introduction interface includes simultaneously displaying: a simulated representation of the biometric characteristic; and a simulated progress indicator; while displaying the biometric registration introduction interface, displaying a teaching animation, including displaying the movement of the simulated representation of the biometric characteristic and the incremental advancement of the simulated progress indicator; after displaying at least a portion of the teaching animation, detecting the occurrence of a condition corresponding to initiating the biometric registration process; and in response to detecting the occurrence of the condition corresponding to initiating the biometric registration process: displaying a progress indicator corresponding to the simulated progress indicator; and displaying a representation of the user's biometric characteristic determined by the one or more biometric sensors of the device at a location previously occupied by the simulated representation of the biometric characteristic in the biometric registration introduction interface.

[0010] According to some examples, a transient computer-readable medium is described. The transient computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having one or more input devices, one or more biometric sensors, and a display. The one or more programs include instructions for performing the following operations: displaying a first user interface on the display; when the first user interface is displayed, detecting the occurrence of a condition corresponding to introducing a biometric registration process for registering biometric features; in response to detecting the occurrence of the condition corresponding to introducing the biometric registration process, displaying a biometric registration introduction interface, wherein displaying the biometric registration introduction interface includes simultaneously displaying: a simulated representation of a biometric feature; and a simulated progress indicator; when the biometric registration introduction interface is displayed, displaying a teaching animation, including displaying the movement of the simulated representation of the biometric feature and the incremental advancement of the simulated progress indicator; after at least a portion of the teaching animation is displayed, detecting the occurrence of a condition corresponding to initiating the biometric registration process; and in response to detecting the occurrence of the condition corresponding to initiating the biometric registration process: displaying a progress indicator corresponding to the simulated progress indicator; and displaying a representation of the user's biometric feature determined by the one or more biometric sensors of the device at a location previously occupied by the simulated representation of the biometric feature in the biometric registration introduction interface.

[0011] According to some examples, an electronic device is described. The electronic device includes: one or more input devices; one or more biometric sensors; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: displaying a first user interface on the display; when the first user interface is displayed, detecting the occurrence of a condition corresponding to introducing a biometric registration process for registering biometric features; in response to detecting the occurrence of the condition corresponding to introducing the biometric registration process, displaying a biometric registration introduction interface, wherein displaying the biometric registration introduction interface includes simultaneously displaying: a simulated representation of a biometric feature; and a simulated progress indicator; when the biometric registration introduction interface is displayed, displaying a teaching animation, including displaying the movement of the simulated representation of the biometric feature and the incremental advancement of the simulated progress indicator; after at least a portion of the teaching animation is displayed, detecting the occurrence of a condition corresponding to initiating the biometric registration process; and in response to detecting the occurrence of the condition corresponding to initiating the biometric registration process: displaying a progress indicator corresponding to the simulated progress indicator; and displaying a representation of the user's biometric feature determined by the one or more biometric sensors of the device at a location previously occupied by the simulated representation of the biometric feature in the biometric registration introduction interface.

[0012] According to some examples, an electronic device is described that includes: one or more input devices; one or more biometric sensors; a display; means for displaying a first user interface on the display; means for performing the following operations: when displaying the first user interface, detecting the occurrence of a condition corresponding to introducing a biometric registration process for registering biometric features; means for performing the following operations: in response to detecting the occurrence of a condition corresponding to introducing the biometric registration process, displaying a biometric registration introduction interface, wherein displaying the biometric registration introduction interface includes simultaneously displaying: a simulated representation of the biometric feature; and a simulated progress indicator; means for performing the following operations: when displaying the biometric registration introduction interface, displaying a teaching animation, including displaying the movement of the simulated representation of the biometric feature and the incremental advancement of the simulated progress indicator; means for performing the following operations: after displaying at least a portion of the teaching animation, detecting the occurrence of a condition corresponding to initiating the biometric registration process; and means for responding to detecting the occurrence of a condition corresponding to initiating the biometric registration process: means for displaying a progress indicator corresponding to the simulated progress indicator; and means for performing the following operations: displaying a representation of the user's biometric feature determined by the one or more biometric sensors of the device at a position previously occupied by the simulated representation of the biometric feature in the biometric registration introduction interface.

[0013] According to some examples, a method is described that includes: at an electronic device having one or more cameras and a display: displaying a first user interface on the display; when displaying the first user interface, detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering a corresponding type of biometric feature; in response to detecting the occurrence of a condition corresponding to initiating the biometric registration process, displaying a digital viewfinder including a preview of image data captured by the one or more cameras on the display; and after initiating the biometric registration process: highlighting a first portion of the field of view of the one or more cameras relative to a second portion of the field of view of the one or more cameras based on determining that a corresponding type of biometric feature satisfying an alignment criterion has been detected in the field of view of the one or more cameras; and maintaining the display of the digital viewfinder without highlighting the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras based on determining that a corresponding type of biometric feature satisfying the alignment criterion has not been detected in the field of view of the one or more cameras.

[0014] According to some examples, a non-transitory computer-readable medium is described. The non-transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras and a display. The one or more programs include instructions for performing the following operations: displaying a first user interface on the display; when the first user interface is being displayed, detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering a corresponding type of biometric feature; in response to detecting the occurrence of the condition corresponding to initiating the biometric registration process, displaying a digital viewfinder on the display that includes a preview of image data captured by the one or more cameras; and after initiating the biometric registration process: in accordance with determining that a corresponding type of biometric feature that meets an alignment criterion has been detected in the field of view of the one or more cameras, highlighting a first portion of the field of view of the one or more cameras relative to a second portion of the field of view of the one or more cameras; and in accordance with determining that a corresponding type of biometric feature that meets the alignment criterion has not been detected in the field of view of the one or more cameras, maintaining the display of the digital viewfinder without highlighting the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras.

[0015] According to some examples, a transitory computer-readable medium is described. The transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having one or more cameras and a display. The one or more programs include instructions for performing the following operations: displaying a first user interface on the display; when the first user interface is being displayed, detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering a corresponding type of biometric feature; in response to detecting the occurrence of the condition corresponding to initiating the biometric registration process, displaying a digital viewfinder on the display that includes a preview of image data captured by the one or more cameras; and after initiating the biometric registration process: in accordance with determining that a corresponding type of biometric feature that meets an alignment criterion has been detected in the field of view of the one or more cameras, highlighting a first portion of the field of view of the one or more cameras relative to a second portion of the field of view of the one or more cameras; and in accordance with determining that a corresponding type of biometric feature that meets the alignment criterion has not been detected in the field of view of the one or more cameras, maintaining the display of the digital viewfinder without highlighting the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras.

[0016] According to some examples, an electronic device is described. The electronic device includes: one or more cameras; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: displaying a first user interface on the display; when the first user interface is being displayed, detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering a corresponding type of biometric feature; in response to detecting the occurrence of the condition corresponding to initiating the biometric registration process, displaying on the display a digital viewfinder including a preview of image data captured by the one or more cameras; and after initiating the biometric registration process: in accordance with determining that a corresponding type of biometric feature that meets an alignment criterion has been detected in the field of view of the one or more cameras, highlighting a first portion of the field of view of the one or more cameras relative to a second portion of the field of view of the one or more cameras; and in accordance with determining that a corresponding type of biometric feature that meets the alignment criterion has not been detected in the field of view of the one or more cameras, maintaining the display of the digital viewfinder without highlighting the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras.

[0017] According to some examples, an electronic device is described. The electronic device includes: one or more cameras; a display; one or more processors; means for displaying a first user interface on the display; means for performing the following operations: when the first user interface is being displayed, detecting the occurrence of a condition corresponding to initiating a biometric registration process for registering a corresponding type of biometric feature; means for performing the following operations: in response to detecting the occurrence of the condition corresponding to initiating the biometric registration process, displaying on the display a digital viewfinder including a preview of image data captured by the one or more cameras; and after initiating the biometric registration process: means for performing the following operations: in accordance with determining that a corresponding type of biometric feature that meets an alignment criterion has been detected in the field of view of the one or more cameras, highlighting a first portion of the field of view of the one or more cameras relative to a second portion of the field of view of the one or more cameras; and means for performing the following operations: in accordance with determining that a corresponding type of biometric feature that meets the alignment criterion has not been detected in the field of view of the one or more cameras, maintaining the display of the digital viewfinder without highlighting the first portion of the field of view of the one or more cameras relative to the second portion of the field of view of the one or more cameras.

[0018] According to some examples, a method is described that includes: at an electronic device having a display and one or more biometric sensors: simultaneously displaying a biometric registration interface on the display, wherein displaying the biometric registration interface includes simultaneously displaying: a representation of a biometric feature, wherein the representation of the biometric feature has an orientation determined based on the alignment of the biometric feature relative to the one or more biometric sensors of the device; and a progress indicator, the progress indicator including a first progress indicator portion at a first position relative to the representation of the biometric feature on the display and a second progress indicator portion at a second position relative to the representation of the biometric feature on the display, wherein the representation of the biometric feature is displayed on the display between the first position and the second position; while simultaneously displaying the representation of the biometric feature and the progress indicator, detecting a change in the orientation of the biometric feature relative to the one or more biometric sensors; and in response to detecting the change in the orientation of the biometric feature relative to the one or more biometric sensors: updating one or more visual features of the first progress indicator portion based on determining that the change in the orientation of the biometric feature meets a registration criterion for a first portion of the biometric feature corresponding to the first progress indicator portion; and updating one or more visual features of the second progress indicator portion based on determining that the change in the orientation of the biometric feature meets a registration criterion for a second portion of the biometric feature corresponding to the second progress indicator portion.

[0019] According to some examples, a non-transitory computer-readable medium is described. The non-transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: simultaneously display a biometric registration interface on the display, wherein displaying the biometric registration interface includes simultaneously displaying: a representation of a biometric feature, wherein the representation of the biometric feature has an orientation determined based on the alignment of the biometric feature relative to the one or more biometric sensors of the device; and a progress indicator, the progress indicator including a first progress indicator portion at a first position relative to the representation of the biometric feature on the display and a second progress indicator portion at a second position relative to the representation of the biometric feature on the display, wherein the representation of the biometric feature is displayed on the display between the first position and the second position; while simultaneously displaying the representation of the biometric feature and the progress indicator, detect a change in the orientation of the biometric feature relative to the one or more biometric sensors; and in response to detecting the change in the orientation of the biometric feature relative to the one or more biometric sensors: update one or more visual features of the first progress indicator portion based on determining that the change in the orientation of the biometric feature meets a registration criterion for a first portion of the biometric feature corresponding to the first progress indicator portion; and update one or more visual features of the second progress indicator portion based on determining that the change in the orientation of the biometric feature meets a registration criterion for a second portion of the biometric feature corresponding to the second progress indicator portion.

[0020] According to some examples, a transient computer-readable medium is described. The transient computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: simultaneously display a biometric registration interface on the display, where displaying the biometric registration interface includes simultaneously displaying: a representation of a biometric feature, where the representation of the biometric feature has an orientation determined based on the alignment of the biometric feature relative to one or more biometric sensors of the device; and a progress indicator, the progress indicator including a first progress indicator portion at a first position relative to the representation of the biometric feature on the display and a second progress indicator portion at a second position relative to the representation of the biometric feature on the display, where the representation of the biometric feature is displayed on the display between the first position and the second position; while simultaneously displaying the representation of the biometric feature and the progress indicator, detect a change in the orientation of the biometric feature relative to the one or more biometric sensors; and in response to detecting the change in the orientation of the biometric feature relative to the one or more biometric sensors: update one or more visual features of the first progress indicator portion based on determining that the change in the orientation of the biometric feature meets a registration criterion for a first portion of the biometric feature corresponding to the first progress indicator portion; and update one or more visual features of the second progress indicator portion based on determining that the change in the orientation of the biometric feature meets a registration criterion for a second portion of the biometric feature corresponding to the second progress indicator portion.

[0021] According to some examples, an electronic device is described, the electronic device including: one or more biometric sensors; a display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: simultaneously display a biometric registration interface on the display, wherein displaying the biometric registration interface includes simultaneously displaying: a representation of a biometric feature, wherein the representation of the biometric feature has an orientation determined based on the alignment of the biometric feature relative to one or more biometric sensors of the device; and a progress indicator, the progress indicator including a first progress indicator portion at a first position relative to the representation of the biometric feature on the display and a second progress indicator portion at a second position relative to the representation of the biometric feature on the display, wherein the representation of the biometric feature is displayed on the display between the first position and the second position; while simultaneously displaying the representation of the biometric feature and the progress indicator, detect a change in the orientation of the biometric feature relative to the one or more biometric sensors; and in response to detecting the change in the orientation of the biometric feature relative to the one or more biometric sensors: update one or more visual features of the first progress indicator portion based on determining that the change in the orientation of the biometric feature satisfies a registration criterion for a first portion of the biometric feature corresponding to the first progress indicator portion; and update one or more visual features of the second progress indicator portion based on determining that the change in the orientation of the biometric feature satisfies a registration criterion for a second portion of the biometric feature corresponding to the second progress indicator portion.

[0022] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; means for performing the following operations: simultaneously displaying a biometric registration interface on the display, wherein displaying the biometric registration interface includes simultaneously displaying: a representation of a biometric feature, wherein the representation of the biometric feature has an orientation determined based on the alignment of the biometric feature relative to one or more biometric sensors of the device; and a progress indicator, the progress indicator including a first progress indicator portion at a first position relative to the representation of the biometric feature on the display and a second progress indicator portion at a second position relative to the representation of the biometric feature on the display, wherein the representation of the biometric feature is displayed on the display between the first position and the second position; means for performing the following operations: when simultaneously displaying the representation of the biometric feature and the progress indicator, detecting a change in the orientation of the biometric feature relative to the one or more biometric sensors; and means for responding to detecting a change in the orientation of the biometric feature relative to the one or more biometric sensors: means for performing the following operations: updating one or more visual features of the first progress indicator portion based on determining that the change in the orientation of the biometric feature satisfies a registration criterion for a first portion of the biometric feature corresponding to the first progress indicator portion; and means for performing the following operations: updating one or more visual features of the second progress indicator portion based on determining that the change in the orientation of the biometric feature satisfies a registration criterion for a second portion of the biometric feature corresponding to the second progress indicator portion.

[0023] According to some examples, a method is described that includes: at an electronic device having a display and one or more biometric sensors: displaying on the display a biometric registration user interface for registering a biometric feature, wherein displaying the biometric registration user interface includes displaying a representation of the biometric feature, and wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature relative to the one or more biometric sensors changes; while displaying the biometric registration user interface, detecting that registration prompt criteria have been met for one or more portions of the biometric feature; and in response to detecting that registration prompt criteria have been met for one or more portions of the biometric feature, outputting a corresponding prompt for moving the biometric feature in a corresponding manner, wherein the corresponding prompt is selected based on the registration status of one or more portions of the biometric feature, including: according to determining that registration prompt criteria have been met for a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the first manner; and according to determining that registration prompt criteria have been met for a second portion of the biometric feature that can be registered by moving the biometric feature in a second manner different from the first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the second manner.

[0024] According to some examples, a non-transitory computer-readable medium is described that includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the following operations: displaying on the display a biometric registration user interface for registering a biometric feature, wherein displaying the biometric registration user interface includes displaying a representation of the biometric feature, and wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature relative to the one or more biometric sensors changes; while displaying the biometric registration user interface, detecting that registration prompt criteria have been met for one or more portions of the biometric feature; and in response to detecting that registration prompt criteria have been met for one or more portions of the biometric feature, outputting a corresponding prompt for moving the biometric feature in a corresponding manner, wherein the corresponding prompt is selected based on the registration status of one or more portions of the biometric feature, including: according to determining that registration prompt criteria have been met for a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the first manner; and according to determining that registration prompt criteria have been met for a second portion of the biometric feature that can be registered by moving the biometric feature in a second manner different from the first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the second manner.

[0025] According to some examples, a transient computer-readable medium is described. The transient computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: displaying, on the display, a biometric registration user interface for registering a biometric feature, wherein displaying the biometric registration user interface includes displaying a representation of the biometric feature, and wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature relative to the one or more biometric sensors changes; detecting, while the biometric registration user interface is being displayed, that registration prompt criteria have been met for one or more portions of the biometric feature; and in response to detecting that registration prompt criteria have been met for one or more portions of the biometric feature, outputting a corresponding prompt for moving the biometric feature in a corresponding manner, wherein the corresponding prompt is selected based on the registration status of one or more portions of the biometric feature, including: according to determining that registration prompt criteria have been met for a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the first manner; and according to determining that registration prompt criteria have been met for a second portion of the biometric feature that can be registered by moving the biometric feature in a second manner different from the first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the second manner.

[0026] According to some examples, an electronic device is described, the electronic device including: one or more biometric sensors; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: displaying, on the display, a biometric registration user interface for registering a biometric feature, wherein displaying the biometric registration user interface includes displaying a representation of the biometric feature, wherein an appearance of the representation of the biometric feature changes as an orientation of the biometric feature relative to the one or more biometric sensors changes; detecting, while the biometric registration user interface is being displayed, that registration prompt criteria have been met for one or more portions of the biometric feature; and in response to detecting that the registration prompt criteria have been met for one or more portions of the biometric feature, outputting a corresponding prompt for moving the biometric feature in a corresponding manner, wherein the corresponding prompt is selected based on a registration state of one or more portions of the biometric feature, including: in accordance with determining that the registration prompt criteria have been met for a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the first manner; and in accordance with determining that the registration prompt criteria have been met for a second portion of the biometric feature that can be registered by moving the biometric feature in a second manner different from the first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the second manner.

[0027] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; means for performing the following operations: displaying on the display a biometric registration user interface for registering a biometric feature, wherein displaying the biometric registration user interface includes displaying a representation of the biometric feature, and wherein the appearance of the representation of the biometric feature changes as the orientation of the biometric feature relative to the one or more biometric sensors changes; means for performing the following operations: when the biometric registration user interface is being displayed, detecting that registration prompt criteria have been met for one or more portions of the biometric feature; and means for performing the following operations: in response to detecting that registration prompt criteria have been met for one or more portions of the biometric feature, outputting a corresponding prompt for moving the biometric feature in a corresponding manner, wherein the corresponding prompt is selected based on the registration status of one or more portions of the biometric feature, including: means for performing the following operations: according to determining that registration prompt criteria have been met for a first portion of the biometric feature that can be registered by moving the biometric feature in a first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the first manner; and means for performing the following operations: according to determining that registration prompt criteria have been met for a second portion of the biometric feature that can be registered by moving the biometric feature in a second manner different from the first manner, outputting the corresponding prompt includes outputting a prompt for moving the biometric feature in the second manner.

[0028] According to some examples, a method is described. The method includes: at an electronic device having a display and one or more biometric sensors: simultaneously displaying on the display: an application interface corresponding to an application; and a biometric authentication interface controlled by an operating system of the electronic device, wherein the biometric authentication interface is displayed over a portion of the application interface; when the biometric authentication interface is being displayed, obtaining biometric data corresponding to at least a portion of a biometric feature from the one or more biometric sensors; and based on determining that the at least a portion of the biometric feature satisfies biometric authentication criteria according to the biometric data: providing authentication information to the application, indicating that biometric authentication criteria have been met for the one or more portions of the biometric feature; and after providing the authentication information to the application, maintaining the display of the biometric authentication interface for a predetermined amount of time.

[0029] According to some examples, a non-transitory computer-readable medium is described. The non-transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: simultaneously display on the display: an application interface corresponding to an application program; and a biometric authentication interface controlled by an operating system of the electronic device, wherein the biometric authentication interface is displayed over a portion of the application interface; when the biometric authentication interface is displayed, obtain biometric data corresponding to at least a portion of a biometric characteristic from the one or more biometric sensors; and based on the biometric data determining that the at least a portion of the biometric characteristic meets a biometric authentication criterion: provide authentication information to the application program indicating that the one or more portions of the biometric characteristic have met the biometric authentication criterion; and after providing the authentication information to the application program, maintain the display of the biometric authentication interface for a predetermined amount of time.

[0030] According to some examples, a transitory computer-readable medium is described. The transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: simultaneously display on the display: an application interface corresponding to an application program; and a biometric authentication interface controlled by an operating system of the electronic device, wherein the biometric authentication interface is displayed over a portion of the application interface; when the biometric authentication interface is displayed, obtain biometric data corresponding to at least a portion of a biometric characteristic from the one or more biometric sensors; and based on the biometric data determining that the at least a portion of the biometric characteristic meets a biometric authentication criterion: provide authentication information to the application program indicating that the one or more portions of the biometric characteristic have met the biometric authentication criterion; and after providing the authentication information to the application program, maintain the display of the biometric authentication interface for a predetermined amount of time.

[0031] According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; a display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: simultaneously display on the display: an application interface corresponding to an application; and a biometric authentication interface controlled by an operating system of the electronic device, wherein the biometric authentication interface is displayed over a portion of the application interface; when the biometric authentication interface is displayed, obtain biometric data corresponding to at least a portion of a biometric characteristic from the one or more biometric sensors; and based on the biometric data determining that the at least a portion of the biometric characteristic meets a biometric authentication criterion: provide authentication information to the application indicating that the one or more portions of the biometric characteristic have met the biometric authentication criterion; and after providing the authentication information to the application, maintain the display of the biometric authentication interface for a predetermined amount of time.

[0032] According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; a display; means for simultaneously displaying on the display an application interface corresponding to an application; and a biometric authentication interface controlled by an operating system of the electronic device, wherein the biometric authentication interface is displayed over a portion of the application interface; means for, when the biometric authentication interface is displayed, obtaining biometric data corresponding to at least a portion of a biometric characteristic from the one or more biometric sensors; and means for, based on the biometric data determining that the at least a portion of the biometric characteristic meets a biometric authentication criterion: means for performing the following operations: providing authentication information to the application indicating that the one or more portions of the biometric characteristic have met the biometric authentication criterion; and means for performing the following operation: after providing the authentication information to the application, maintaining the display of the biometric authentication interface for a predetermined amount of time.

[0033] According to some examples, a method is described that includes: at an electronic device having a display and one or more biometric sensors: displaying an application interface including fillable fields on the display; receiving, while the application interface is displayed, a request to automatically fill the fillable fields of the application interface; and in response to receiving the request to automatically fill the fillable fields of the application interface: automatically filling the fillable fields with a first type of data based on determining that the fillable fields of the application interface are associated with the first type of data; and automatically filling the fillable fields with a second type of data based on determining that the fillable fields of the application are associated with the second type of data and at least a portion of a biometric characteristic determined based on data corresponding to the biometric characteristic obtained from the one or more biometric sensors meets a biometric authentication criterion.

[0034] According to some examples, a non-transitory computer-readable medium is described that includes one or more programs for execution by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the following operations: displaying an application interface including fillable fields on the display; receiving, while the application interface is displayed, a request to automatically fill the fillable fields of the application interface; and in response to receiving the request to automatically fill the fillable fields of the application interface: automatically filling the fillable fields with a first type of data based on determining that the fillable fields of the application interface are associated with the first type of data; and automatically filling the fillable fields with a second type of data based on determining that the fillable fields of the application are associated with the second type of data and at least a portion of a biometric characteristic determined based on data corresponding to the biometric characteristic obtained from the one or more biometric sensors meets a biometric authentication criterion.

[0035] According to some examples, a transitory computer-readable medium is described that includes one or more programs for execution by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the following operations: displaying an application interface including fillable fields on the display; receiving, while the application interface is displayed, a request to automatically fill the fillable fields of the application interface; and in response to receiving the request to automatically fill the fillable fields of the application interface: automatically filling the fillable fields with a first type of data based on determining that the fillable fields of the application interface are associated with the first type of data; and automatically filling the fillable fields with a second type of data based on determining that the fillable fields of the application are associated with the second type of data and at least a portion of a biometric characteristic determined based on data corresponding to the biometric characteristic obtained from the one or more biometric sensors meets a biometric authentication criterion.

[0036] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: displaying an application interface including fillable fields on the display; receiving, when the application interface is displayed, a request to automatically fill the fillable fields of the application interface; and in response to receiving the request to automatically fill the fillable fields of the application interface: automatically filling the fillable fields with first-type data according to determining that the fillable fields of the application interface are associated with first-type data; and automatically filling the fillable fields with second-type data according to determining that the fillable fields of the application program are associated with second-type data and at least a part of the biometric characteristics determined based on the data corresponding to the biometric characteristics obtained from the one or more biometric sensors meets the biometric authentication criteria.

[0037] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; means for displaying an application interface including fillable fields on the display; means for receiving, when the application interface is displayed, a request to automatically fill the fillable fields of the application interface; and means for responding to the received request to automatically fill the fillable fields of the application interface: means for performing the following operations: automatically filling the fillable fields with first-type data according to determining that the fillable fields of the application interface are associated with first-type data; and means for performing the following operations: automatically filling the fillable fields with second-type data according to determining that the fillable fields of the application program are associated with second-type data and at least a part of the biometric characteristics determined based on the data corresponding to the biometric characteristics obtained from the one or more biometric sensors meets the biometric authentication criteria.

[0038] According to some examples, a method is described that includes: at an electronic device having a display and one or more biometric sensors: detecting that a device wake-up criterion has been met; in response to detecting that the device wake-up criterion has been met, transitioning the electronic device from a first visual state to a second visual state; and after transitioning the device to the second visual state: transitioning the electronic device from the second visual state to a third visual state based on determining that a biometric authentication criterion has been met based on biometric data provided by the one or more biometric sensors, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and maintaining the electronic device in the second visual state based on determining that the biometric authentication criterion has not been met based on biometric data provided by the one or more biometric sensors.

[0039] According to some examples, a non-transitory computer-readable medium is described that includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the following operations: detecting that a device wake-up criterion has been met; in response to detecting that the device wake-up criterion has been met, transitioning the electronic device from a first visual state to a second visual state; and after transitioning the device to the second visual state: transitioning the electronic device from the second visual state to a third visual state based on determining that a biometric authentication criterion has been met based on biometric data provided by the one or more biometric sensors, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and maintaining the electronic device in the second visual state based on determining that the biometric authentication criterion has not been met based on biometric data provided by the one or more biometric sensors.

[0040] According to some examples, a transient computer-readable medium is described. The transient computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: detecting that a device wake-up criterion has been met; in response to detecting that the device wake-up criterion has been met, transitioning the electronic device from a first visual state to a second visual state; and after transitioning the device to the second visual state: transitioning the electronic device from the second visual state to a third visual state based on determining that a biometric authentication criterion has been met based on biometric data provided by the one or more biometric sensors, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and maintaining the electronic device in the second visual state based on determining that the biometric authentication criterion has not been met based on biometric data provided by the one or more biometric sensors.

[0041] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: detecting that a device wake-up criterion has been met; in response to detecting that the device wake-up criterion has been met, transitioning the electronic device from a first visual state to a second visual state; and after transitioning the device to the second visual state: transitioning the electronic device from the second visual state to a third visual state based on determining that a biometric authentication criterion has been met based on biometric data provided by the one or more biometric sensors, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and maintaining the electronic device in the second visual state based on determining that the biometric authentication criterion has not been met based on biometric data provided by the one or more biometric sensors.

[0042] According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; a display; means for detecting that a device wake-up criterion has been met; means for, in response to detecting that a device wake-up criterion has been met, transitioning the electronic device from a first visual state to a second visual state; and means for, after transitioning the device to the second visual state: means for performing the following operations: transitioning the electronic device from the second visual state to a third visual state according to determining that a biometric authentication criterion has been met based on biometric data provided by the one or more biometric sensors, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and means for performing the following operations: maintaining the electronic device in the second visual state according to determining that a biometric authentication criterion has not been met based on biometric data provided by the one or more biometric sensors.

[0043] According to some examples, a method is described, the method comprising: at an electronic device having a display and one or more biometric sensors: when the electronic device is in a locked state, detecting a condition associated with performing a biometric authentication check using the biometric sensors without an explicit input requesting biometric authentication from a user; and in response to detecting the condition, performing a first biometric authentication check, comprising: using the one or more biometric sensors to capture first biometric data; after capturing the first biometric data: transitioning the device from the locked state to an unlocked state according to determining that the first biometric data meets a biometric authentication criterion; and maintaining the device in the locked state according to determining that the first biometric data does not meet a biometric authentication criterion; after performing the first biometric authentication check, detecting a request to perform a corresponding operation via the device without receiving further authentication information from the user; and in response to detecting the request to perform a corresponding operation: performing the corresponding operation according to determining that the corresponding operation does not require authentication; performing the corresponding operation according to determining that the corresponding operation requires authentication and the device is in an unlocked state; and according to determining that the corresponding operation requires authentication and the device is in a locked state: capturing second biometric data using the one or more biometric sensors without an explicit input requesting a second biometric authentication check from the user; and after capturing the second biometric data, performing a second biometric authentication check, comprising: performing the corresponding operation according to determining that the second biometric data meets a biometric authentication criterion; and forgoing performing the corresponding operation according to determining that the second biometric data does not meet a biometric authentication criterion.

[0044] According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium including one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the following operations: when the electronic device is in a locked state, detecting a condition associated with performing a biometric authentication check using the biometric sensor without an explicit input of a requested biometric authentication from the user; and in response to detecting the condition, performing a first biometric authentication check, including: using the one or more biometric sensors to capture first biometric data; after capturing the first biometric data: transitioning the device from the locked state to the unlocked state according to a determination that the first biometric data meets the biometric authentication criteria; and keeping the device in the locked state according to a determination that the first biometric data does not meet the biometric authentication criteria; after performing the first biometric authentication check, detecting a request to perform a corresponding operation via the device without receiving further authentication information from the user; and in response to detecting the request to perform the corresponding operation: performing the corresponding operation according to a determination that the corresponding operation does not require authentication; performing the corresponding operation according to a determination that the corresponding operation requires authentication and the device is in the unlocked state; and according to a determination that the corresponding operation requires authentication and the device is in the locked state: capturing second biometric data using the one or more biometric sensors without an explicit input of a requested second biometric authentication check from the user; and after capturing the second biometric data, performing a second biometric authentication check, including: performing the corresponding operation according to a determination that the second biometric data meets the biometric authentication criteria; and abandoning the performance of the corresponding operation according to a determination that the second biometric data does not meet the biometric authentication criteria.

[0045] According to some examples, a transient computer-readable medium is described. The transient computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: When the electronic device is in a locked state, detect a condition associated with performing a biometric authentication check using the biometric sensor without an explicit input of a requested biometric authentication from the user; and in response to detecting the condition, perform a first biometric authentication check, including: using the one or more biometric sensors to capture first biometric data; after capturing the first biometric data: based on determining that the first biometric data meets the biometric authentication criteria, transition the device from the locked state to the unlocked state; and based on determining that the first biometric data does not meet the biometric authentication criteria, keep the device in the locked state; after performing the first biometric authentication check, detect a request to perform a corresponding operation via the device without receiving further authentication information from the user; and in response to detecting the request to perform the corresponding operation: based on determining that the corresponding operation does not require authentication, perform the corresponding operation; based on determining that the corresponding operation requires authentication and the device is in the unlocked state, perform the corresponding operation; and based on determining that the corresponding operation requires authentication and the device is in the locked state: use the one or more biometric sensors to capture second biometric data without an explicit input of a requested second biometric authentication check from the user; and after capturing the second biometric data, perform a second biometric authentication check, including: based on determining that the second biometric data meets the biometric authentication criteria, perform the corresponding operation; and based on determining that the second biometric data does not meet the biometric authentication criteria, abandon performing the corresponding operation.

[0046] According to some examples, an electronic device is described, the electronic device including: one or more biometric sensors; a display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: when the electronic device is in a locked state, detecting a condition associated with performing a biometric authentication check using the biometric sensor without an explicit input of a requested biometric authentication from the user; and in response to detecting the condition, performing a first biometric authentication check, including: using the one or more biometric sensors to capture first biometric data; after capturing the first biometric data: transitioning the device from the locked state to the unlocked state according to a determination that the first biometric data meets the biometric authentication criteria; and keeping the device in the locked state according to a determination that the first biometric data does not meet the biometric authentication criteria; after performing the first biometric authentication check, detecting a request for performing a corresponding operation via the device without receiving further authentication information from the user; and in response to detecting the request for performing the corresponding operation: performing the corresponding operation according to a determination that the corresponding operation does not require authentication; performing the corresponding operation according to a determination that the corresponding operation requires authentication and the device is in the unlocked state; and according to a determination that the corresponding operation requires authentication and the device is in the locked state: capturing second biometric data using the one or more biometric sensors without an explicit input of a requested second biometric authentication check from the user; and after capturing the second biometric data, performing a second biometric authentication check, including: performing the corresponding operation according to a determination that the second biometric data meets the biometric authentication criteria; and aborting the performance of the corresponding operation according to a determination that the second biometric data does not meet the biometric authentication criteria.

[0047] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; means for performing the following operations: when the electronic device is in a locked state, detecting a condition associated with performing a biometric authentication check using the biometric sensor without an explicit input of a requested biometric authentication from the user; and means for performing the following operations: in response to detecting the condition, performing a first biometric authentication check, including: means for using the one or more biometric sensors to capture first biometric data; means after capturing the first biometric data: means for performing the following operations: according to determining that the first biometric data meets the biometric authentication standard, transitioning the device from the locked state to the unlocked state; and means for performing the following operations: according to determining that the first biometric data does not meet the biometric authentication standard, keeping the device in the locked state; means for performing the following operations: after performing the first biometric authentication check, detecting a request to perform a corresponding operation via the device without receiving further authentication information from the user; and means for responding to detecting the request to perform the corresponding operation: means for performing the following operations: according to determining that the corresponding operation does not require authentication, performing the corresponding operation; means for performing the following operations: according to determining that the corresponding operation requires authentication and the device is in the unlocked state, performing the corresponding operation; and means for according to determining that the corresponding operation requires authentication and the device is in the locked state: means for performing the following operations: using the one or more biometric sensors to capture second biometric data without an explicit input of a requested second biometric authentication check from the user; and means for performing the following operations: after capturing the second biometric data, performing a second biometric authentication check, including: means for performing the following operations: according to determining that the second biometric data meets the biometric authentication standard, performing the corresponding operation; and means for performing the following operations: according to determining that the second biometric data does not meet the biometric authentication standard, aborting the performance of the corresponding operation.

[0048] According to some examples, a method is described. The method includes: at an electronic device having a display, a button, and one or more biometric sensors separate from the button: when the electronic device is in a first state in which a corresponding function of the device is disabled, detecting one or more activations of the button; and in response to detecting the one or more activations of the button: capturing biometric data using the one or more biometric sensors separate from the button; according to determining that the biometric data meets the biometric authentication standard, transitioning the electronic device to a second state in which the corresponding function of the device is enabled; and according to determining that the biometric data does not meet the biometric authentication standard, keeping the electronic device in the first state and displaying an indication that the biometric authentication has failed on the display.

[0049] According to some examples, a non-transitory computer-readable medium is described. The non-transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display, a button, and one or more biometric sensors separate from the button. The one or more programs include instructions for performing the following operations: when the electronic device is in a first state in which a corresponding function of the device is disabled, detecting one or more activations of the button; and in response to detecting the one or more activations of the button: capturing biometric data with the one or more biometric sensors separate from the button; converting the electronic device to a second state in which the corresponding function of the device is enabled based on determining that the biometric data meets biometric authentication criteria; and keeping the electronic device in the first state and displaying an indication that biometric authentication has failed on the display based on determining that the biometric data does not meet biometric authentication criteria.

[0050] According to some examples, a transitory computer-readable medium is described. The transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display, a button, and one or more biometric sensors separate from the button. The one or more programs include instructions for performing the following operations: when the electronic device is in a first state in which a corresponding function of the device is disabled, detecting one or more activations of the button; and in response to detecting the one or more activations of the button: capturing biometric data with the one or more biometric sensors separate from the button; converting the electronic device to a second state in which the corresponding function of the device is enabled based on determining that the biometric data meets biometric authentication criteria; and keeping the electronic device in the first state and displaying an indication that biometric authentication has failed on the display based on determining that the biometric data does not meet biometric authentication criteria.

[0051] According to some examples, an electronic device is described. The electronic device includes: a display; a button; one or more biometric sensors separate from the button; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: when the electronic device is in a first state in which a corresponding function of the device is disabled, detecting one or more activations of the button; and in response to detecting the one or more activations of the button: capturing biometric data with the one or more biometric sensors separate from the button; converting the electronic device to a second state in which the corresponding function of the device is enabled according to a determination that the biometric data meets biometric authentication criteria; and keeping the electronic device in the first state and displaying an indication that biometric authentication has failed on the display according to a determination that the biometric data does not meet biometric authentication criteria.

[0052] According to some examples, an electronic device is described. The electronic device includes: a display; a button; one or more biometric sensors separate from the button; means for detecting one or more activations of the button when the electronic device is in a first state in which a corresponding function of the device is disabled; and means for responding to detecting the one or more activations of the button: means for capturing biometric data with the one or more biometric sensors separate from the button; means for performing the following operations: converting the electronic device to a second state in which the corresponding function of the device is enabled according to a determination that the biometric data meets biometric authentication criteria; and means for performing the following operations: keeping the electronic device in the first state and displaying an indication that biometric authentication has failed on the display according to a determination that the biometric data does not meet biometric authentication criteria.

[0053] According to some examples, a method is described. The method includes: at an electronic device having a display and one or more biometric sensors: detecting a request to perform a corresponding operation that requires authentication; and in response to detecting the request to perform the corresponding operation that requires authentication: performing the corresponding operation according to a determination that the device is unlocked; and displaying an authentication indicator for a first form of authentication on the display without displaying one or more affordances for using a second form of authentication according to a determination that the device is locked and the first form of authentication is available, where the first form of authentication is a biometric authentication form based on data obtained by the one or more biometric sensors.

[0054] According to some examples, a non-transitory computer-readable medium is described. The non-transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: detecting a request to perform a corresponding operation that requires authentication; and in response to detecting a request to perform a corresponding operation that requires authentication: performing the corresponding operation based on determining that the device is unlocked; and based on determining that the device is locked and a first form of authentication is available, displaying an authentication indicator for the first form of authentication on the display without displaying one or more affordances for using a second form of authentication, wherein the first form of authentication is a biometric authentication form based on data obtained by the one or more biometric sensors.

[0055] According to some examples, a transitory computer-readable medium is described. The transitory computer-readable storage medium includes one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: detecting a request to perform a corresponding operation that requires authentication; and in response to detecting a request to perform a corresponding operation that requires authentication: performing the corresponding operation based on determining that the device is unlocked; and based on determining that the device is locked and a first form of authentication is available, displaying an authentication indicator for the first form of authentication on the display without displaying one or more affordances for using a second form of authentication, wherein the first form of authentication is a biometric authentication form based on data obtained by the one or more biometric sensors.

[0056] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: detecting a request to perform a corresponding operation that requires authentication; and in response to detecting a request to perform a corresponding operation that requires authentication: performing the corresponding operation based on determining that the device is unlocked; and based on determining that the device is locked and a first form of authentication is available, displaying an authentication indicator for the first form of authentication on the display without displaying one or more affordances for using a second form of authentication, wherein the first form of authentication is a biometric authentication form based on data obtained by the one or more biometric sensors.

[0057] According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; a display; means for detecting a request to perform a respective operation that requires authentication; and means for responding to a detected request to perform a respective operation that requires authentication: means for performing the respective operation in accordance with a determination that the device is unlocked; and means for performing the following operation: in accordance with a determination that the device is locked and a first form of authentication is available, displaying, on the display, an authentication indicator for the first form of authentication without displaying one or more affordances for using a second form of authentication, wherein the first form of authentication is a biometric authentication form based on data obtained by the one or more biometric sensors.

[0058] According to some examples, a method is described, the method comprising: at an electronic device having one or more biometric sensors: receiving a first request to perform a respective operation that requires authentication; in response to receiving the first request to perform the respective operation: using the one or more biometric sensors to determine whether biometric authentication criteria are met, wherein the biometric authentication criteria include the requirement that a respective type of biometric characteristic detected by the biometric sensor be authorized to perform the respective operation; performing the respective operation in accordance with a determination that the biometric authentication criteria are met; and forgoing performing the respective operation in accordance with a determination that the biometric authentication criteria are not met; subsequent to determining that the biometric authentication criteria are not met in response to receiving the first request, receiving a second request to perform the respective operation; and in response to receiving the second request to perform the respective operation: in accordance with a determination that the biometric authentication criteria were not met in response to the first request due to the non - presence of a respective type of biometric characteristic not detected by the one or more biometric sensors, using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criteria are met; and forgoing using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criteria are met in accordance with a determination that the biometric authentication criteria were not met in response to the first request due to the one or more biometric sensors detecting a respective type of biometric characteristic that does not correspond to an authorized biometric characteristic.

[0059] According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, the one or more programs including instructions for performing the following operations: receiving a first request to perform a corresponding operation that requires authentication; in response to receiving the first request to perform the corresponding operation: using the one or more biometric sensors to determine whether a biometric authentication criterion is met, wherein the biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the corresponding operation; performing the corresponding operation according to the determination that the biometric authentication criterion is met; and aborting the performance of the corresponding operation according to the determination that the biometric authentication criterion is not met; after determining that the biometric authentication criterion is not met in response to receiving the first request, receiving a second request to perform the corresponding operation; and in response to receiving the second request to perform the corresponding operation: in response to the determination in the first request that the biometric authentication criterion is not met because the one or more biometric sensors did not detect the presence of the corresponding type of biometric characteristic, using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criterion is met; and in response to the determination in the first request that the biometric authentication criterion is not met because the one or more biometric sensors detected a corresponding type of biometric characteristic that does not correspond to the authorized biometric characteristic, aborting using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criterion is met.

[0060] According to some examples, a transient computer-readable medium is described, the transient computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, the one or more programs including instructions for performing the following operations: receiving a first request to perform a corresponding operation that requires authentication; in response to receiving the first request to perform the corresponding operation: using the one or more biometric sensors to determine whether a biometric authentication criterion is satisfied, wherein the biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the corresponding operation; performing the corresponding operation according to a determination that the biometric authentication criterion is satisfied; and abandoning the performance of the corresponding operation according to a determination that the biometric authentication criterion is not satisfied; after determining that the biometric authentication criterion is not satisfied in response to receiving the first request, receiving a second request to perform the corresponding operation; and in response to receiving the second request to perform the corresponding operation: in response to determining in response to the first request that the biometric authentication criterion is not satisfied because the one or more biometric sensors did not detect the presence of the corresponding type of biometric characteristic, using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criterion is satisfied; and in response to determining in response to the first request that the biometric authentication criterion is not satisfied because the one or more biometric sensors detected a corresponding type of biometric characteristic that does not correspond to the authorized biometric characteristic, abandoning using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criterion is satisfied.

[0061] According to some examples, an electronic device is described, the electronic device including: one or more biometric sensors; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: receiving a first request for performing a corresponding operation that requires authentication; in response to receiving the first request for performing the corresponding operation: using the one or more biometric sensors to determine whether a biometric authentication criterion is satisfied, where the biometric authentication criterion includes a requirement that a corresponding type of biometric feature detected by the biometric sensor is authorized to perform the corresponding operation; performing the corresponding operation according to the determination that the biometric authentication criterion is satisfied; and abandoning the performance of the corresponding operation according to the determination that the biometric authentication criterion is not satisfied; after determining that the biometric authentication criterion is not satisfied in response to receiving the first request, receiving a second request for performing the corresponding operation; and in response to receiving the second request for performing the corresponding operation: in response to the determination in the first request that the biometric authentication criterion is not satisfied due to the non - detection of the presence of the corresponding type of biometric feature by the one or more biometric sensors, using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criterion is satisfied; and in response to the determination in the first request that the biometric authentication criterion is not satisfied due to the detection of a corresponding type of biometric feature by the one or more biometric sensors that does not correspond to the authorized biometric feature, abandoning using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criterion is satisfied.

[0062] According to some examples, an electronic device is described, the electronic device including: one or more biometric sensors; means for receiving a first request for performing a corresponding operation that requires authentication; means for, in response to receiving the first request for performing the corresponding operation, performing the following operations: using the one or more biometric sensors to determine whether a biometric authentication criterion is met, wherein the biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the corresponding operation; performing the corresponding operation according to the determination that the biometric authentication criterion is met; and abandoning the performance of the corresponding operation according to the determination that the biometric authentication criterion is not met; means for receiving a second request for performing the corresponding operation after determining that the biometric authentication criterion is not met in response to receiving the first request; and means for, in response to receiving the second request for performing the corresponding operation, performing the following operations: in response to the second request, using the one or more biometric sensors to determine whether the biometric authentication criterion is met according to the determination that the biometric authentication criterion is not met in response to the first request because the one or more biometric sensors do not detect the presence of the corresponding type of biometric characteristic; and abandoning using the one or more biometric sensors to determine whether the biometric authentication criterion is met in response to the second request according to the determination that the biometric authentication criterion is not met in response to the first request because the one or more biometric sensors detect a corresponding type of biometric characteristic that does not correspond to the authorized biometric characteristic.

[0063] According to some examples, a method is described, the method including: at an electronic device having one or more biometric sensors: receiving a first request for performing a first operation that requires authentication; in response to receiving the first request for performing the first operation: using the one or more biometric sensors to determine whether a first biometric authentication criterion is met, wherein the first biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the first operation; performing the first operation according to the determination that the first biometric authentication criterion is met; and abandoning the performance of the first operation according to the determination that the first biometric authentication criterion is not met; after performing the first operation, receiving a second request for performing a second operation that requires authentication; and in response to receiving the second request: using the one or more biometric sensors to determine whether a second biometric authentication criterion is met according to the determination that a re - authentication criterion has been met, wherein the second biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the second operation; and performing the second operation without performing biometric authentication and abandoning using the one or more biometric sensors to determine whether the second biometric authentication criterion is met according to the determination that the re - authentication criterion has not been met.

[0064] According to some examples, a non-transitory computer-readable medium is described that stores one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors. The one or more programs include instructions for performing the following operations: receiving a first request to perform a first operation that requires authentication; in response to receiving the first request to perform the first operation: using the one or more biometric sensors to determine whether a first biometric authentication criterion is met, where the first biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the first operation; performing the first operation according to the determination that the first biometric authentication criterion is met; and aborting the performance of the first operation according to the determination that the biometric authentication criterion is not met; after performing the first operation, receiving a second request to perform a second operation that requires authentication; and in response to receiving the second request: using the one or more biometric sensors to determine whether a second biometric authentication criterion is met according to the determination that a re-authentication criterion has been met, where the second biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the second operation; and performing the second operation without performing biometric authentication and aborting using the one or more biometric sensors to determine whether the second biometric authentication criterion is met according to the determination that the re-authentication criterion has not been met.

[0065] According to some examples, a transient computer-readable medium is described, the transient computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, the one or more programs including instructions for performing the following operations: receiving a first request to perform a first operation that requires authentication; in response to receiving the first request to perform the first operation: using the one or more biometric sensors to determine whether a first biometric authentication criterion is met, wherein the first biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the first operation; performing the first operation according to the determination that the first biometric authentication criterion is met; and aborting the performance of the first operation according to the determination that the biometric authentication criterion is not met; after performing the first operation, receiving a second request to perform a second operation that requires authentication; and in response to receiving the second request: using the one or more biometric sensors to determine whether a second biometric authentication criterion is met according to the determination that a re-authentication criterion has been met, wherein the second biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor is authorized to perform the second operation; and performing the second operation without performing biometric authentication and aborting using the one or more biometric sensors to determine whether the second biometric authentication criterion is met according to the determination that the re-authentication criterion has not been met.

[0066] According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: receiving a first request to perform a first operation that requires authentication; in response to receiving the first request to perform the first operation: using the one or more biometric sensors to determine whether a first biometric authentication criterion is met, wherein the first biometric authentication criterion includes the requirement that a corresponding type of biometric feature detected by the biometric sensor that is authorized to perform the first operation; performing the first operation according to the determination that the first biometric authentication criterion is met; and abandoning the performance of the first operation according to the determination that the biometric authentication criterion is not met; after performing the first operation, receiving a second request to perform a second operation that requires authentication; and in response to receiving the second request: using the one or more biometric sensors to determine whether a second biometric authentication criterion is met according to the determination that a re-authentication criterion has been met, wherein the second biometric authentication criterion includes the requirement that a corresponding type of biometric feature detected by the biometric sensor that is authorized to perform the second operation; and performing the second operation without performing biometric authentication and abandoning using the one or more biometric sensors to determine whether the second biometric authentication criterion is met according to the determination that the re-authentication criterion has not been met.

[0067] According to some examples, an electronic device is described, the electronic device comprising: one or more biometric sensors; means for receiving a first request to perform a first operation that requires authentication; means for performing the following operations in response to receiving the first request to perform the first operation: using the one or more biometric sensors to determine whether a first biometric authentication criterion is met, wherein the first biometric authentication criterion includes the requirement that a corresponding type of biometric feature detected by the biometric sensor that is authorized to perform the first operation; performing the first operation according to the determination that the first biometric authentication criterion is met; and abandoning the performance of the first operation according to the determination that the biometric authentication criterion is not met; means for receiving a second request to perform a second operation that requires authentication after performing the first operation; and means for performing the following operations in response to receiving the second request: using the one or more biometric sensors to determine whether a second biometric authentication criterion is met according to the determination that a re-authentication criterion has been met, wherein the second biometric authentication criterion includes the requirement that a corresponding type of biometric feature detected by the biometric sensor that is authorized to perform the second operation; and performing the second operation without performing biometric authentication and abandoning using the one or more biometric sensors to determine whether the second biometric authentication criterion is met according to the determination that the re-authentication criterion has not been met.

[0068] According to some examples, a method is described that includes: at an electronic device having a display: receiving a request to display a first portion of corresponding content; and in response to the request to display the first portion of the corresponding content: displaying at least the first portion of the corresponding content on the display, the corresponding content including an element associated with an authentication operation; initiating biometric authentication based on determining that the element associated with the authentication operation meets a visibility criterion; and aborting the initiation of biometric authentication based on determining that the element associated with the authentication operation does not meet the visibility criterion.

[0069] According to some examples, a non-transitory computer-readable medium is described that stores one or more programs configured to be executed by one or more processors of an electronic device having a display, the one or more programs including instructions for performing the following operations: receiving a request to display a first portion of corresponding content; and in response to the request to display the first portion of the corresponding content: displaying at least the first portion of the corresponding content on the display, the corresponding content including an element associated with an authentication operation; initiating biometric authentication based on determining that the element associated with the authentication operation meets a visibility criterion; and aborting the initiation of biometric authentication based on determining that the element associated with the authentication operation does not meet the visibility criterion.

[0070] According to some examples, a transient computer-readable medium is described that includes one or more programs configured to be executed by one or more processors of an electronic device having a display, the one or more programs including instructions for performing the following operations: receiving a request to display a first portion of corresponding content; and in response to the request to display the first portion of the corresponding content: displaying at least the first portion of the corresponding content on the display, the corresponding content including an element associated with an authentication operation; initiating biometric authentication based on determining that the element associated with the authentication operation meets a visibility criterion; and aborting the initiation of biometric authentication based on determining that the element associated with the authentication operation does not meet the visibility criterion.

[0071] According to some examples, an electronic device is described, the electronic device comprising: a display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: receiving a request to display a first portion of corresponding content; and in response to the request to display a first portion of corresponding content: displaying at least the first portion of the corresponding content on the display, the corresponding content including an element associated with an authentication operation; initiating biometric authentication based on determining that the element associated with the authentication operation meets a visibility criterion; and foregoing initiating biometric authentication based on determining that the element associated with the authentication operation does not meet the visibility criterion.

[0072] According to some examples, an electronic device is described, the electronic device comprising: a display; means for receiving a request to display a first portion of corresponding content; and means for performing the following operations in response to the request to display a first portion of corresponding content: displaying at least the first portion of the corresponding content on the display, the corresponding content including an element associated with an authentication operation; initiating biometric authentication based on determining that the element associated with the authentication operation meets a visibility criterion; and foregoing initiating biometric authentication based on determining that the element associated with the authentication operation does not meet the visibility criterion.

[0073] According to some examples, a method is described, the method comprising: at an electronic device having a display and one or more biometric sensors: detecting a predefined operation corresponding to a credentials submission user interface having a credentials submission user interface element; and in response to detecting the predefined operation: displaying, on the display, a credentials submission user interface having a visual indication that presenting a biometric characteristic that meets biometric authentication criteria to the one or more biometric sensors will cause credentials to be submitted via the credentials submission user interface element, based on determining that biometric authentication via the one or more biometric sensors is available.

[0074] According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the following operations: detecting a predefined operation corresponding to a credentials submission user interface having a credentials submission user interface element; and in response to detecting the predefined operation: displaying, on the display, a credentials submission user interface having a visual indication that presenting a biometric characteristic that meets biometric authentication criteria to the one or more biometric sensors will cause credentials to be submitted via the credentials submission user interface element, based on determining that biometric authentication via the one or more biometric sensors is available.

[0075] In accordance with some examples, a transient computer-readable medium is described that stores one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for performing the following operations: detecting a predefined operation corresponding to a credential submission user interface having a credential submission user interface element; and in response to detecting the predefined operation: based on determining that biometric authentication via the one or more biometric sensors is available, displaying on the display a credential submission user interface having a visual indication that presenting a biometric characteristic that meets biometric authentication criteria to the one or more biometric sensors will enable submission of a credential via the credential submission user interface element.

[0076] In accordance with some examples, an electronic device is described that includes: a display; one or more biometric sensors; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: detecting a predefined operation corresponding to a credential submission user interface having a credential submission user interface element; and in response to detecting the predefined operation: based on determining that biometric authentication via the one or more biometric sensors is available, displaying on the display a credential submission user interface having a visual indication that presenting a biometric characteristic that meets biometric authentication criteria to the one or more biometric sensors will enable submission of a credential via the credential submission user interface element.

[0077] In accordance with some examples, an electronic device is described that includes: a display; one or more biometric sensors; means for detecting a predefined operation corresponding to a credential submission user interface having a credential submission user interface element; and means for performing the following operations in response to detecting the predefined operation: based on determining that biometric authentication via the one or more biometric sensors is available, displaying on the display a credential submission user interface having a visual indication that presenting a biometric characteristic that meets biometric authentication criteria to the one or more biometric sensors will enable submission of a credential via the credential submission user interface element.

[0078] According to some examples, a method is described that includes: at an electronic device having a touch-sensitive display and one or more biometric sensors: displaying, on the touch-sensitive display, a credentials input user interface having a plurality of character input keys; while displaying the credentials input user interface, receiving, via the touch-sensitive display, a touch gesture input that includes movement of a contact on the touch-sensitive display; and in response to receiving the touch gesture input that includes movement of a contact on the touch-sensitive display: attempting to biometrically authenticate a user of the electronic device based on biometric information captured using the one or more biometric sensors, according to determining that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes the requirement that biometric authentication is currently enabled on the electronic device.

[0079] According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium including one or more programs configured to be executed by one or more processors of an electronic device having a touch-sensitive display and one or more biometric sensors, the one or more programs including instructions for: displaying, on the touch-sensitive display, a credentials input user interface having a plurality of character input keys; while displaying the credentials input user interface, receiving, via the touch-sensitive display, a touch gesture input that includes movement of a contact on the touch-sensitive display; and in response to receiving the touch gesture input that includes movement of a contact on the touch-sensitive display: attempting to biometrically authenticate a user of the electronic device based on biometric information captured using the one or more biometric sensors, according to determining that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes the requirement that biometric authentication is currently enabled on the electronic device.

[0080] According to some examples, a transient computer-readable medium is described, the transient computer-readable storage medium including one or more programs configured to be executed by one or more processors of an electronic device having a touch-sensitive display and one or more biometric sensors, the one or more programs including instructions for: displaying, on the touch-sensitive display, a credentials input user interface having a plurality of character input keys; while displaying the credentials input user interface, receiving, through the touch-sensitive display, a touch gesture input that includes movement of a contact on the touch-sensitive display; and in response to receiving the touch gesture input that includes movement of a contact on the touch-sensitive display: attempting to biometrically authenticate a user of the electronic device based on biometric information captured using the one or more biometric sensors, according to determining that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes the requirement that biometric authentication is currently enabled on the electronic device.

[0081] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a touch-sensitive display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: displaying, on the touch-sensitive display, a credentials input user interface having a plurality of character input keys; receiving, via the touch-sensitive display, a touch gesture input while the credentials input user interface is being displayed, the touch gesture input including movement of a contact on the touch-sensitive display; and in response to receiving the touch gesture input including movement of a contact on the touch-sensitive display: attempting to biometrically authenticate a user of the electronic device based on biometric information captured using the one or more biometric sensors, according to determining that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a requirement that biometric authentication is currently enabled on the electronic device.

[0082] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a touch-sensitive display; means for displaying, on the touch-sensitive display, a credentials input user interface having a plurality of character input keys; means for receiving, via the touch-sensitive display, a touch gesture input while the credentials input user interface is being displayed, the touch gesture input including movement of a contact on the touch-sensitive display; and means for, in response to receiving the touch gesture input including movement of a contact on the touch-sensitive display: attempting to biometrically authenticate a user of the electronic device based on biometric information captured using the one or more biometric sensors, according to determining that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a requirement that biometric authentication is currently enabled on the electronic device.

[0083] According to some embodiments, a method is described. The method includes: at an electronic device having a display and one or more input devices: receiving, via the one or more input devices, a request to perform an operation that requires authentication; and in response to the request to perform an operation that requires authentication: performing the operation according to determining that authentication is successful; and according to determining that authentication is not successful and that a set of error condition criteria is satisfied: displaying, on the display, an indication of the error condition, wherein the indication includes information about the reason for the error condition; and aborting the performance of the operation.

[0084] According to some examples, a non-transitory computer-readable medium is described. The non-transitory computer-readable storage medium includes one or more programs, and the one or more programs are configured to be executed by one or more processors of an electronic device having a display and one or more input devices. The one or more programs include instructions for: receiving, via the one or more input devices, a request to perform an operation that requires authentication; and in response to the request to perform an operation that requires authentication: performing the operation according to a determination that authentication is successful; and according to a determination that authentication is not successful and a set of error condition criteria are met: displaying an indication of the error condition on the display, where the indication includes information about the reason for the error condition; and aborting the execution of the operation.

[0085] According to some examples, a transitory computer-readable medium is described. The transitory computer-readable storage medium includes one or more programs, and the one or more programs are configured to be executed by one or more processors of an electronic device having a display and one or more input devices. The one or more programs include instructions for: receiving, via the one or more input devices, a request to perform an operation that requires authentication; and in response to the request to perform an operation that requires authentication: performing the operation according to a determination that authentication is successful; and according to a determination that authentication is not successful and a set of error condition criteria are met: displaying an indication of the error condition on the display, where the indication includes information about the reason for the error condition; and aborting the execution of the operation.

[0086] According to some examples, an electronic device is described. The electronic device includes: one or more input devices; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: receiving, via the one or more input devices, a request to perform an operation that requires authentication; and in response to the request to perform an operation that requires authentication: performing the operation according to a determination that authentication is successful; and according to a determination that authentication is not successful and a set of error condition criteria are met: displaying an indication of the error condition on the display, where the indication includes information about the reason for the error condition; and aborting the execution of the operation.

[0087] According to some examples, an electronic device is described. The electronic device includes: one or more input devices; a display; means for receiving, via the one or more input devices, a request to perform an operation that requires authentication; and means for responding to the request to perform an operation that requires authentication: performing the operation according to a determination that authentication is successful; and according to a determination that authentication is not successful and a set of error condition criteria are met: displaying an indication of the error condition on the display, where the indication includes information about the reason for the error condition; and aborting the execution of the operation.

[0088] According to some examples, a method is described that includes: at an electronic device having a display and a biometric sensor located at a first portion of the electronic device: detecting whether there is an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; in response to detecting the presence of the error condition, displaying an error indication on the display, wherein the error indication is displayed at a location near the first portion of the electronic device, including: displaying the error indication at a first location in the user interface near the first portion of the electronic device based on determining that the user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location in the user interface near the first portion of the electronic device based on determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, wherein the first orientation is different from the second orientation.

[0089] According to some examples, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium including one or more programs, the one or more programs being configured to be executed by one or more processors of an electronic device having a display and a biometric sensor located at a first portion of the electronic device, the one or more programs including instructions for: detecting whether there is an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; in response to detecting the presence of the error condition, displaying an error indication on the display, wherein the error indication is displayed at a location near the first portion of the electronic device, including: displaying the error indication at a first location in the user interface near the first portion of the electronic device based on determining that the user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location in the user interface near the first portion of the electronic device based on determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, wherein the first orientation is different from the second orientation.

[0090] According to some examples, a transient computer-readable medium is described. The transient computer-readable storage medium includes one or more programs, the one or more programs being configured to be executed by one or more processors of an electronic device. The electronic device has a display and a biometric sensor located at a first portion of the electronic device. The one or more programs include instructions for: detecting whether there is an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; in response to detecting the presence of the error condition, displaying an error indication on the display, wherein the error indication is displayed at a location near the first portion of the electronic device, including: displaying the error indication at a first location in the user interface near the first portion of the electronic device according to determining that the user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location in the user interface near the first portion of the electronic device according to determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, wherein the first orientation is different from the second orientation.

[0091] According to some examples, an electronic device is described. The electronic device includes: a biometric sensor located at a first portion of the electronic device; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: detecting whether there is an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; in response to detecting the presence of the error condition, displaying an error indication on the display, wherein the error indication is displayed at a location near the first portion of the electronic device, including: displaying the error indication at a first location in the user interface near the first portion of the electronic device according to determining that the user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location in the user interface near the first portion of the electronic device according to determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, wherein the first orientation is different from the second orientation.

[0092] According to some examples, an electronic device is described. The electronic device includes: a biometric sensor at a first portion of the electronic device; a display; means for detecting the presence of an error condition that prevents the biometric sensor from obtaining biometric information about a user of the device; means for displaying an error indication on the display in response to detecting the presence of the error condition, wherein the error indication is displayed at a location near the first portion of the electronic device. Displaying the error indication on the display includes: displaying the error indication at a first location in the user interface near the first portion of the electronic device according to determining that the user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location in the user interface near the first portion of the electronic device according to determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, wherein the first orientation is different from the second orientation.

[0093] According to some examples, a method is described. The method includes: at an electronic device having a display and one or more biometric sensors: displaying a biometric registration user interface on the display for initiating biometric registration using the one or more biometric sensors; receiving, while the biometric registration user interface is displayed, an input corresponding to a request to initiate biometric registration; and in response to receiving the input: initiating a process of registering biometric characteristics using the one or more biometric sensors according to determining that the orientation of the electronic device meets a set of registration criteria; and outputting one or more prompts to change the orientation of the electronic device to a different orientation that meets the set of registration criteria according to determining that the orientation of the electronic device does not meet the set of registration criteria.

[0094] According to some examples, a non-transitory computer-readable medium is described. The non-transitory computer-readable storage medium includes one or more programs, the one or more programs being configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for: displaying a biometric registration user interface on the display for initiating biometric registration using the one or more biometric sensors; receiving, while the biometric registration user interface is displayed, an input corresponding to a request to initiate biometric registration; and in response to receiving the input: initiating a process of registering biometric characteristics using the one or more biometric sensors according to determining that the orientation of the electronic device meets a set of registration criteria; and outputting one or more prompts to change the orientation of the electronic device to a different orientation that meets the set of registration criteria according to determining that the orientation of the electronic device does not meet the set of registration criteria.

[0095] According to some examples, a transient computer-readable medium is described. The transient computer-readable storage medium includes one or more programs, and the one or more programs are configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors. The one or more programs include instructions for: displaying a biometric registration user interface on the display for initiating biometric registration using one or more biometric sensors; receiving, when the biometric registration user interface is displayed, an input corresponding to a request to initiate biometric registration; and in response to receiving the input: initiating a process of registering biometric characteristics using one or more biometric sensors based on determining that the orientation of the electronic device meets a set of registration criteria; and outputting one or more prompts to change the orientation of the electronic device to a different orientation that meets the set of registration criteria based on determining that the orientation of the electronic device does not meet the set of registration criteria.

[0096] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for: displaying a biometric registration user interface on the display for initiating biometric registration using one or more biometric sensors; receiving, when the biometric registration user interface is displayed, an input corresponding to a request to initiate biometric registration; and in response to receiving the input: initiating a process of registering biometric characteristics using one or more biometric sensors based on determining that the orientation of the electronic device meets a set of registration criteria; and outputting one or more prompts to change the orientation of the electronic device to a different orientation that meets the set of registration criteria based on determining that the orientation of the electronic device does not meet the set of registration criteria.

[0097] According to some examples, an electronic device is described. The electronic device includes: one or more biometric sensors; a display; means for displaying a biometric registration user interface on the display for initiating biometric registration using one or more biometric sensors; means for receiving, when the biometric registration user interface is displayed, an input corresponding to a request to initiate biometric registration; and means for performing the following operations in response to receiving the input: initiating a process of registering biometric characteristics using one or more biometric sensors based on determining that the orientation of the electronic device meets a set of registration criteria; and outputting one or more prompts to change the orientation of the electronic device to a different orientation that meets the set of registration criteria based on determining that the orientation of the electronic device does not meet the set of registration criteria.

[0098] The executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors. The executable instructions for performing these functions are optionally included in a transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.

[0099] Accordingly, faster and more efficient methods and interfaces are provided for a device to implement biometric authentication, thereby enhancing the effectiveness, efficiency, and user satisfaction of such devices. Such methods and interfaces optionally supplement or replace other methods for implementing biometric authentication. BRIEF DESCRIPTION OF THE DRAWINGS

[0100] To better understand the various described examples, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which like reference numerals indicate corresponding parts throughout the drawings.

[0101] Figure 1A is a block diagram showing a portable multifunctional device having a touch-sensitive display in accordance with some embodiments.

[0102] Figure 1B is a block diagram showing exemplary components for event handling in accordance with some embodiments.

[0103] Figure 1C is a block diagram showing exemplary components for generating tactile output in accordance with some embodiments.

[0104] Figure 2 shows a portable multifunctional device having a touch screen in accordance with some embodiments.

[0105] Figure 3 is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface in accordance with some embodiments.

[0106] Figure 4A shows an exemplary user interface for a menu of an application on a portable multifunctional device in accordance with some embodiments.

[0107] Figure 4B shows an exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display in accordance with some embodiments.

[0108] Figures 4C through 4H shows an exemplary tactile output pattern having a specific waveform in accordance with some embodiments.

[0109] Figure 5A shows a personal electronic device in accordance with some embodiments.

[0110] Figure 5B is a block diagram showing a personal electronic device according to some embodiments.

[0111] Figures 5C - 5D Exemplary components of a personal electronic device having a touch-sensitive display and an intensity sensor are shown according to some embodiments.

[0112] Figures 5E - 5H Exemplary components and user interfaces of a personal electronic device are shown according to some embodiments.

[0113] Figure 6 Exemplary devices connected via one or more communication channels are shown according to some embodiments.

[0114] Figures 7A through 7S An exemplary user interface for a biometric registration process tutorial is shown according to some embodiments.

[0115] Figures 8A through 8C is a flowchart of a method showing a biometric registration process tutorial.

[0116] Figures 9A through 9AE An exemplary user interface for aligning biometric features for registration is shown.

[0117] Figures 10A through 10F is a flowchart of a method for aligning biometric features for registration.

[0118] Figures 11A through 11O An exemplary user interface for registering biometric features is shown.

[0119] Figures 12A through 12B is a flowchart of a method for registering biometric features.

[0120] Figures 13A through 13R An exemplary user interface for providing a reminder during a biometric registration process is shown.

[0121] Figures 14A through 14C is a flowchart of a method for providing a reminder during a biometric registration process.

[0122] Figures 15A through 15T An exemplary user interface for application-based biometric authentication is shown.

[0123] Figures 16A through 16E is a flowchart of a method for application-based biometric authentication.

[0124] Figures 17A through 17AI An exemplary user interface for automatically filling in biometric security fields is shown.

[0125] Figures 18A through 18DIt is a flowchart showing a method of automatically filling fields for biometric security.

[0126] Figures 19A through 19AB It shows an exemplary user interface for unlocking a device using biometric authentication.

[0127] Figures 20A through 20F It is a flowchart showing a method of unlocking a device using biometric authentication.

[0128] Figures 21A through 21AQ It shows an exemplary user interface for retrying biometric authentication.

[0129] Figures 22A through 22F It is a flowchart showing a method of retrying biometric authentication.

[0130] Figures 23A through 23Q It shows an exemplary user interface for managing a transmission using biometric authentication.

[0131] Figures 24A through 24BC It shows an exemplary user interface for managing a transmission using biometric authentication.

[0132] Figures 25A through 25C It is a flowchart showing a method of managing a transmission using biometric authentication.

[0133] Figures 26A through 26AS It shows an exemplary user interface for providing an interstitial user interface during biometric authentication.

[0134] Figures 27A through 27E It is a flowchart showing a method of providing an interstitial user interface during biometric authentication.

[0135] Figures 28A through 28AA It shows an exemplary user interface for avoiding retrying biometric authentication.

[0136] Figures 29A through 29B It is a flowchart showing a method of avoiding retrying biometric authentication.

[0137] Figures 30A through 30AL It shows an exemplary user interface for cached biometric authentication.

[0138] Figures 31A through 31B It is a flowchart showing a method of cached biometric authentication.

[0139] Figures 32A through 32W It shows an exemplary user interface for automatically filling fillable fields based on visibility criteria.

[0140] Figure 33 It is a flowchart showing a method of automatically filling fillable fields based on visibility criteria.

[0141] Figures 34A through 34N Illustrates an exemplary user interface for automatic login using biometric authentication.

[0142] Figure 35 Is a flowchart showing a method of automatic login using biometric authentication.

[0143] Figures 36A through 36L Illustrates an exemplary user interface for retrying biometric authentication at a credentials input user interface according to some examples.

[0144] Figures 37A through 37B Is a flowchart showing a method for retrying biometric authentication at a credentials input user interface according to some examples.

[0145] Figures 38A through 38AD Illustrates an exemplary user interface for providing an indication of an error condition during biometric authentication according to some examples.

[0146] Figures 39A through 39B Is a flowchart showing a method for providing an indication of an error condition during biometric authentication according to some examples.

[0147] Figures 40A through 40U Illustrates an exemplary user interface for providing an indication regarding a biometric feature sensor during biometric authentication according to some examples.

[0148] Figures 41A through 41C Is a flowchart showing a method for providing an indication regarding a biometric feature sensor during biometric authentication according to some examples.

[0149] Figures 42A through 42P Illustrates an exemplary user interface for orienting a device to register a biometric feature according to some examples.

[0150] Figures 43A through 43C Is a flowchart showing a method for orienting a device to register a biometric feature according to some examples. Detailed Description

[0151] The following description sets forth exemplary methods, parameters, etc. However, it should be recognized that such description is not intended to limit the scope of the present disclosure, but rather is provided as a description of exemplary embodiments.

[0152] An electronic device needs to provide effective methods and interfaces for implementing biometric authentication of biometric features. For example, the electronic device needs to provide convenient and effective methods for registering one or more parts of a biometric feature. Also, for example, the electronic device needs to provide fast and intuitive techniques for selectively accessing secure data based on biometric authentication. Also, for example, the electronic device needs to provide fast and intuitive techniques for enabling functions of the device based on biometric authentication. Such techniques can reduce the cognitive burden on users who use the device to register biometric features and / or perform biometric authentication, thereby improving overall productivity. In addition, such techniques can reduce the processor power and battery power that would otherwise be wasted on redundant user input.

[0153] Below Figures 1A through 1C 、 Figure 2 、 Figure 3 、 Figures 4A through 4B and Figures 5A through 5H provide a description of an exemplary device for performing techniques for implementing biometric authentication. Figure 6 An exemplary device connected via one or more communication channels is shown according to some embodiments. Figures 7A through 7S An exemplary user interface for a biometric registration process tutorial is shown according to some embodiments. Figures 8A through 8C is a flowchart showing a method for a biometric registration process tutorial.

[0154] Figures 7A through 7S The user interface in is for showing the processes described below, including Figures 8A through 8C the processes in . Figures 9A through 9AE An exemplary user interface for aligning a biometric feature for registration is shown. Figures 10A through 10F is a flowchart showing a method for aligning a biometric feature for registration. Figures 9A through 9AE The user interface in is for showing the processes described below, including Figures 10A through 10F the processes in . Figures 11A through 11O An exemplary user interface for registering a biometric feature is shown. Figures 12A through 12B is a flowchart showing a method for registering a biometric feature. Figures 11A through 11O The user interface in is for showing the processes described below, including Figures 12A through 12B the processes in . Figures 13A through 13R An exemplary user interface for providing a reminder during a biometric registration process is shown. Figures 14A through 14C is a flowchart showing a method for providing a reminder during a biometric registration process. Figures 13A through 13R The user interface in is for showing the processes described below, including Figures 14A through 14C the processes in . Figures 15A through 15T An exemplary user interface for application-based biometric authentication is shown.Figures 16A through 16E is a flowchart showing a method of application-based biometric authentication. Figures 15A through 15T The user interface in is used to show the processes described below, including Figures 16A through 16E the processes in. Figures 17A through 17AI shows an exemplary user interface for automatically filling in biometric security fields. Figures 18A through 18D is a flowchart showing a method of automatically filling in biometric security fields. Figures 17A through 17AI The user interface in is used to show the processes described below, including Figures 18A through 18D the processes in. Figures 19A through 19AB shows an exemplary user interface for unlocking a device using biometric authentication. Figures 20A through 20F is a flowchart showing a method of unlocking a device using biometric authentication. Figures 19A through 19AB The user interface in is used to show the processes described below, including Figures 20A through 20F the processes in. Figures 21A through 21AQ shows an exemplary user interface for retrying biometric authentication. Figures 22A through 22F is a flowchart showing a method of retrying biometric authentication. Figures 21A through 21AQ The user interface in is used to show the processes described below, including Figures 22A through 22F the processes in. Figures 23A through 23Q shows an exemplary user interface for managing a transmission using biometric authentication. Figures 24A through 24BC shows an exemplary user interface for managing a transmission using biometric authentication. Figures 25A through 25C is a flowchart showing a method of managing a transmission using biometric authentication. Figures 23A through 23Q and Figures 24A through 24BC The user interfaces in are used to show the processes described below, including Figures 25A through 25C the processes in. Figures 26A through 26AS shows an exemplary user interface for providing an interstitial user interface during biometric authentication. Figures 27A through 27E is a flowchart showing a method of providing an interstitial user interface during biometric authentication. Figures 26A through 26AS The user interface in is used to show the processes described below, including Figures 27A through 27E the processes in. Figures 28A through 28AA shows an exemplary user interface for avoiding retrying biometric authentication. Figures 29A through 29B is a flowchart showing a method of avoiding retrying biometric authentication. Figures 28A through 28AA The user interface in is used to show the processes described below, including Figures 29A through 29B the processes in. Figures 30A through 30AL shows an exemplary user interface for cached biometric authentication. Figures 31A through 31B is a flowchart showing a method of cached biometric authentication. Figures 30A through 30ALThe user interface in is used to show the processes described below, including Figures 31A through 31B the processes in. Figures 32A through 32W shows an exemplary user interface for automatically filling in fillable fields based on visibility criteria. Figure 33 is a flowchart showing a method for automatically filling in fillable fields based on visibility criteria. Figures 32A through 32W The user interface in is used to show the processes described below, including Figure 33 the processes in. Figures 34A through 34N shows an exemplary user interface for automatic login using biometric authentication. Figure 35 is a flowchart showing a method for automatic login using biometric authentication. Figures 34A through 34N The user interface in is used to show the processes described below, including Figure 35 the processes in. Figures 36A through 36L shows an exemplary user interface for retrying biometric authentication at a credential input user interface according to some examples. Figures 37A through 37B is a flowchart showing a method for retrying biometric authentication at a credential input user interface using an electronic device according to some examples. Figures 38A through 38AD shows an exemplary user interface for providing an indication of an error condition during biometric authentication according to some examples. Figures 39A through 39B is a flowchart showing a method for providing an indication of an error condition during biometric authentication according to some examples. Figures 40A through 40U shows an exemplary user interface for providing an indication of a biometric sensor during biometric authentication according to some examples. Figures 41A through 41C is a flowchart showing a method for providing an indication of a biometric sensor during biometric authentication according to some examples. Figures 42A through 42P shows an exemplary user interface for orienting a device to register a biometric feature according to some examples.

[0155] Although the following description uses terms such as "first", "second", etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch could be named a second touch and similarly a second touch could be named a first touch, without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.

[0156] The terms used in the description of the various embodiments herein are for the purpose of describing particular embodiments only and are not intended to be limiting. As used in the description of the various embodiments and the appended claims, the singular forms "a" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will also be understood that the term "comprises" ("includes", "including", "comprises" and / or "comprising") when used in this specification specifies the presence of the stated features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0157] Depending on the context, the term "if" is optionally interpreted to mean "when", "at the time of", or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrase "if determined..." or "if detected [the stated condition or event]" is optionally interpreted to mean "when determining..." or "in response to determining..." or "at the time of detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]".

[0158] Embodiments of electronic devices, user interfaces for such devices, and related processes for using such devices are described herein. In some embodiments, the device is a portable communication device that also includes other functions such as PDA and / or music player functions, such as a mobile phone. Exemplary embodiments of the portable multifunctional device include, but are not limited to, devices from Apple Inc. (Cupertino, California), devices, iPod devices, and devices. Other portable electronic devices are optionally used, such as a laptop or tablet computer having a touch-sensitive surface (e.g., a touch screen display and / or a touchpad). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touchpad).

[0159] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, a mouse, and / or a joystick.

[0160] The device generally supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, gaming applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0161] The various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications and / or within the respective application. Thus, a common physical architecture of the device, such as a touch-sensitive surface, optionally supports the various applications with a user interface that is intuitive and clear to the user.

[0162] Attention is now turned to an embodiment of a portable device having a touch-sensitive display. Figure 1A FIG. is a block diagram of a portable multifunctional device 100 having a touch-sensitive display system 112 in accordance with some embodiments. The touch-sensitive display 112 is sometimes called a "touch screen" for convenience and is sometimes referred to as or called a "touch-sensitive display system". The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more contact intensity sensors 165 for detecting the intensity of contacts on the device 100 (e.g., a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100). The device 100 optionally includes one or more tactile output generators 167 for generating tactile outputs on the device 100 (e.g., generating tactile outputs on a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100 or the touchpad 355 of the device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0163] As used in this specification and the claims, the “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four different values and more typically includes hundreds of different values (e.g., at least 256). The intensity of a contact is optionally determined (or measured) using a variety of methods and a variety of sensors or combinations of sensors. For example, one or more force sensors beneath or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated contact force. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or its change of the contact area detected on the touch-sensitive surface, the capacitance and / or its change of the touch-sensitive surface adjacent to the contact, and / or the resistance and / or its change of the touch-sensitive surface adjacent to the contact are optionally used as surrogates for the force or pressure of a contact on the touch-sensitive surface. In some embodiments, the surrogate measurements of the contact force or pressure are used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the surrogate measurements). In some embodiments, the surrogate measurements of the contact force or pressure are converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of a contact as an attribute of user input allows a user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with a limited physical area in some cases, the smaller device being used to (e.g., on a touch-sensitive display) display affordance representations and / or receive user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or physical / mechanical controls such as a knob or button).

[0164] As used in this specification and the claims, the term "haptic output" refers to a physical displacement of a device relative to a previous position of the device detected by a user using the user's sense of touch, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device. For example, in the case of contact between the device or a component of the device and a surface of the user that is sensitive to touch (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a sense of touch that corresponds to a perceived change in a physical characteristic of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or a touchpad) is optionally interpreted by the user as a "press click" or "release click" of a physical actuation button. In some cases, the user will sense a sense of touch, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically depressed (e.g., displaced) by the user's movement does not move. As another example, even when there is no change in the smoothness of the touch-sensitive surface, movement of the touch-sensitive surface will optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. Although such interpretations of touch by the user will be limited by the user's individual sensory perception, many sensory perceptions of touch are common to most users. Thus, when a haptic output is described as corresponding to a particular sensory perception of the user (e.g., "press click", "release click", "roughness"), unless otherwise stated, the generated haptic output corresponds to a physical displacement of the device or a component thereof that will generate the stated sensory perception of a typical (or ordinary) user. Providing haptic feedback to the user using haptic output enhances the operability of the device and makes the user device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), thereby further reducing power usage and extending the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0165] In some embodiments, the haptic output pattern specifies characteristics of the haptic output, such as the amplitude of the haptic output, the shape of the motion waveform of the haptic output, the frequency of the haptic output, and / or the duration of the haptic output.

[0166] When a device (e.g., one or more haptic output generators that generate haptic output by moving a movable mass) generates haptic output with different haptic output patterns, the haptic output can cause different tactile sensations for a user who is holding or touching the device. Although the user's senses are based on the user's perception of the haptic output, most users will be able to discern changes in the waveform, frequency, and amplitude of the haptic output generated by the device. Thus, the waveform, frequency, and amplitude can be adjusted to indicate to the user that different operations have been performed. In this way, haptic output having a haptic output pattern that is designed, selected, and / or arranged to simulate the characteristics (e.g., size, material, weight, stiffness, smoothness, etc.); behaviors (e.g., oscillation, displacement, acceleration, rotation, stretching, etc.); and / or interactions (e.g., collision, adhesion, repulsion, attraction, friction, etc.) of objects in a given environment (e.g., a user interface including graphical features and objects, a simulated physical environment having virtual boundaries and virtual objects, a real physical environment having physical boundaries and physical objects, and / or any combination of the foregoing) will, in some cases, provide helpful feedback to the user, which reduces input errors and improves the efficiency of the user's operation of the device. Additionally, the haptic output is optionally generated to correspond to feedback that is independent of the simulated physical characteristics (such as input thresholds or object selection). Such haptic output will, in some cases, provide helpful feedback to the user, which reduces input errors and improves the efficiency of the user's operation of the device.

[0167] In some embodiments, haptic output having an appropriate haptic output pattern serves as a cue for an event of interest that occurs in the user interface or behind the screen in the device. Examples of events of interest include the activation of an affordance representation (e.g., a real or virtual button, or a toggle switch) provided on the device or in the user interface, the success or failure of a requested operation, reaching or crossing a boundary in the user interface, entering a new state, switching the input focus between objects, activating a new mode, reaching or crossing an input threshold, detecting or recognizing a type of input or gesture, and so on. In some embodiments, haptic output is provided to serve as a warning or cue about an impending event or outcome that will occur unless a change in direction or interruption of the input is detected in a timely manner. Haptic output is also used in other contexts to enrich the user experience, improve the accessibility of the device for users with visual or motor difficulties or other accessibility needs, and / or improve the efficiency and functionality of the user interface and / or the device. Optionally, the haptic output is compared with audio input and / or visual user interface changes, which further enhances the user's experience when interacting with the user interface and / or the device, facilitates better transmission of information about the state of the user interface and / or the device, and which reduces input errors and improves the efficiency of the user's operation of the device.

[0168] Figures 4C through 4EProvide a set of sample haptic output patterns that can be used, individually or in combination, as is or through one or more transformations (such as modulation, amplification, truncation, etc.), for various purposes in various scenarios (such as those described above and those described with respect to the user interfaces and methods discussed herein) to generate suitable haptic feedback. This example of a haptic output control board shows how a set of three waveforms and eight frequencies can be used to generate an array of haptic output patterns. In addition to the haptic output patterns shown in this figure, each of these haptic output patterns can optionally be adjusted in terms of amplitude by changing the gain value of the haptic output pattern, as shown, for example, for Figures 4F through 4H FullTap 80Hz, FullTap 200Hz, MiniTap 80Hz, MiniTap 200Hz, MicroTap 80Hz, and MicroTap 200Hz in Figures 4F through 4H which each are shown with variants having gains of 1.0, 0.75, 0.5, and 0.25. As

[0169] Figures 4C to 4H shown, changing the gain of a haptic output pattern changes the amplitude of the pattern without changing the frequency of the pattern or the shape of the waveform. In some embodiments, changing the frequency of a haptic output pattern also results in a lower amplitude because some haptic output generators are limited in how much force can be applied to a movable mass, and thus higher frequency movements of the mass are constrained to lower amplitudes to ensure that the acceleration required to generate the waveform does not require a force outside the operating force range of the haptic output generator (e.g., the peak amplitudes of FullTap at 230Hz, 270Hz, and 300Hz are lower than the amplitudes of FullTap at 80Hz, 100Hz, 125Hz, and 200Hz).

[0169] Figures 4C to 4H A haptic output pattern having a specific waveform is shown. The waveform of a haptic output pattern represents the pattern of physical displacement over time relative to a neutral position (e.g., x zero ), through which a movable mass generates a haptic output having that haptic output pattern. For example, Figure 4C each of the first set of haptic output patterns shown (e.g., the haptic output patterns of "FullTap") has a waveform that includes an oscillation having two full cycles (e.g., an oscillation that starts and ends at the neutral position and crosses the neutral position three times). Figure 4D each of the second set of haptic output patterns shown (e.g., the haptic output patterns of "MiniTap") has a waveform that includes an oscillation having one full cycle (e.g., an oscillation that starts and ends at the neutral position and crosses the neutral position once). Figure 4EEach of the third set of haptic output patterns shown (e.g., the haptic output pattern of “MicroTap”) has a waveform including an oscillation having a half complete cycle (e.g., an oscillation that starts and ends at a neutral position and does not cross the neutral position). The waveform of the haptic output pattern also includes a start buffer and an end buffer representing the gradual acceleration and deceleration of the moveable mass at the start and end of the haptic output. Figures 4C to 4H The example waveform shown includes x values representing the maximum and minimum degrees of movement of the moveable mass. min and x max values. For larger electronic devices with a larger moveable mass, the minimum and maximum degrees of movement of the mass can be greater or less. Figures 4C to 4H The example described shows the movement of the mass in one dimension, but similar principles can also apply to the movement of a moveable mass in two or three dimensions.

[0170] As Figures 4C to 4E shown, each haptic output pattern also has a corresponding characteristic frequency that affects the “pitch” of the tactile sensation that a user feels from the haptic output having that characteristic frequency. For continuous haptic output, the characteristic frequency represents the number of cycles (e.g., cycles per second) completed by the moveable mass of the haptic output generator in a given time period. For discrete haptic output, a discrete output signal is generated (e.g., having 0.5, 1, or 2 cycles), and the characteristic frequency value specifies how fast the moveable mass needs to move to generate the haptic output having that characteristic frequency. As Figures 4C - 4H shown, for each type of haptic output (e.g., defined by a corresponding waveform such as FullTap, MiniTap, or MicroTap), a higher frequency value corresponds to a faster movement of the moveable mass, and thus generally corresponds to a shorter haptic output completion time (e.g., the time including the number of cycles required to complete the discrete haptic output plus the start and end buffer times). For example, a FullTap with a characteristic frequency of 80 Hz takes longer to complete than a FullTap with a characteristic frequency of 100 Hz (e.g., at Figure 4FAmong them, 35.4 ms vs. 28.3 ms). In addition, for a given frequency, a haptic output having more cycles in its waveform takes longer to complete than a haptic output having fewer cycles in its waveform at the same corresponding frequency. For example, a FullTap at 150 Hz takes longer to complete than a MiniTap at 150 Hz (e.g., 19.4 ms vs. 12.8 ms), and a MiniTap at 150 Hz takes longer to complete than a MicroTap at 150 Hz (e.g., 12.8 ms vs. 9.4 ms). However, for haptic output patterns having different frequencies, this rule may not apply (e.g., a haptic output having more cycles but a higher frequency may take a shorter amount of time to complete than a haptic output having fewer cycles but a lower frequency, and vice versa). For example, at 300 Hz, a FullTap takes the same amount of time as a MiniTap (e.g., 9.9 ms).

[0171] As Figures 4C to 4E shown, a haptic output pattern also has a characteristic amplitude, which affects the amount of energy contained in the haptic signal or the "intensity" of the tactile sensation that a user can feel through the haptic output having that characteristic amplitude. In some embodiments, the characteristic amplitude of a haptic output pattern refers to an absolute or normalized value representing the maximum displacement of a movable mass relative to a neutral position when generating the haptic output. In some embodiments, the characteristic amplitude of a haptic output pattern can be adjusted according to various conditions and / or pre-configured metrics (e.g., input-based metrics, and / or user interface-based metrics, such as those customized based on user interface context and behavior), for example, by a gain coefficient (e.g., a value between 0 and 1) determined fixedly or dynamically. In some embodiments, an input-based metric (e.g., an intensity change metric or an input speed metric) measures the characteristics of the input (e.g., the rate of change of the characteristic intensity of contact in a press input or the rate of movement of the contact on a touch-sensitive surface) during the input that triggers the generation of the haptic output. In some embodiments, a user interface-based metric (e.g., a cross-boundary speed metric) measures the characteristics of a user interface element (e.g., the speed at which the element moves across a hidden or visible boundary in the user interface) during a change in the user interface that triggers the generation of the haptic output. In some embodiments, the characteristic amplitude of a haptic output pattern can be modulated by an "envelope", and the peaks of adjacent cycles can have different amplitudes, where one of the waveforms shown above is further modified by multiplying by an envelope parameter that changes over time (e.g., from 0 to 1) to gradually adjust the amplitude of a portion of the haptic output over time when generating the haptic output.

[0172] Although in Figures 4C to 4EFor purposes of illustration, a particular frequency, amplitude, and waveform are shown in the exemplary haptic output pattern, but haptic output patterns having other frequencies, amplitudes, and waveforms can be used for similar purposes. For example, a waveform having between 0.5 and 4 cycles can be used. Other frequencies in the range of 60 Hz to 400 Hz can also be used. Table 1 provides examples of particular tactile feedback behaviors, configurations, and their usage examples.

[0173] It should be understood that device 100 is merely one example of a portable multifunctional device, and device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0174] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0175] Peripheral device interface 118 can be used to couple input and output peripheral devices of the device to CPU 120 and memory 102. The one or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform the various functions of device 100 and process data. In some embodiments, peripheral device interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0176] The RF (Radio Frequency) circuit 108 receives and transmits RF signals, which are also known as electromagnetic signals. The RF circuit 108 converts electrical signals into electromagnetic signals / converts electromagnetic signals into electrical signals, and communicates with a communication network and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, a memory, and so on. The RF circuit 108 optionally communicates with the network and other devices via wireless communication, and these networks are such as the Internet (also known as the World Wide Web (WWW)), an intranet, and / or wireless networks such as a cellular phone network, a wireless local area network (LAN), and / or a metropolitan area network (MAN). The RF circuit 108 optionally includes well-known circuits for detecting a near field communication (NFC) field, such as via a short-range communication radio component. The wireless communication optionally uses any one of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed Downlink Packet Access (HSDPA), High-Speed Uplink Packet Access (HSUPA), Evolution-Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long-Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), WiMAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols not yet developed as of the date of submission of this document.

[0177] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into audible sound waves for humans. The audio circuit 110 also receives the electrical signal converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits the audio data to the peripheral interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral interface 118. In some embodiments, the audio circuit 110 also includes an earphone jack (e.g., Figure 2 212 in

[0178] ). The earphone jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or an earphone with both output (e.g., mono or stereo earphones) and input (e.g., microphone).

[0178] The I / O subsystem 106 couples input / output peripheral devices on the device 100, such as the touch screen 112 and other input control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, a depth camera controller 169, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / transmit electrical signals to the other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller 160 is optionally coupled to (or not coupled to) any of the following: a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. The one or more buttons (e.g., Figure 2 208 in Figure 2 optionally include increase / decrease buttons for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include push buttons (e.g., Figure 2 206 in

[0179] Rapidly pressing the depress button optionally unlocks the touch screen 112 or optionally starts the process of unlocking the device by using gestures on the touch screen, as described in U.S. Patent Application No. 11 / 322,549, filed on December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image" (i.e., U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. Long pressing the depress button (e.g., 206) optionally powers on or powers off the device 100. The functions of one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0180] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0181] The touch screen 112 has a touch-sensitive surface, sensor, or group of sensors that accepts input from the user based on tactile and / or haptic contact. The touch screen 112 and the display controller 156 (along with any associated modules and / or instruction sets in the memory 102) detect contact (and any movement or interruption of the contact) on the touch screen 112 and convert the detected contact into an interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0182] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light-emitting polymer display) technology, or LED (light-emitting diode) technology, but in other embodiments uses other display technologies. The touch screen 112 and the display controller 156 optionally use any of a variety of touch-sensing technologies now known or later to be developed, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. The variety of touch-sensing technologies includes, but is not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in and iPod The technology used in

[0183] In some embodiments of the touchscreen 112, the touch-sensitive display is optionally similar to the multi-touch touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.) and / or 6,677,932 (Westerman et al.) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.

[0184] In some embodiments, the touch-sensitive display of the touchscreen 112 is as described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, entitled "Multipoint Touch Surface Controller"; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, entitled "Multipoint Touchscreen"; (3) U.S. Patent Application No. 10 / 903,964, filed Jul. 30, 2004, entitled "Gestures For Touch Sensitive Input Devices"; (4) U.S. Patent Application No. 11 / 048,264, filed Jan. 31, 2005, entitled "Gestures For Touch Sensitive Input Devices"; (5) U.S. Patent Application No. 11 / 038,590, filed Jan. 18, 2005, entitled "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices"; (6) U.S. Patent Application No. 11 / 228,758, filed Sep. 16, 2005, entitled "Virtual Input Device Placement On A Touch Screen User Interface"; (7) U.S. Patent Application No. 11 / 228,700, filed Sep. 16, 2005, entitled "Operation Of A Computer With A Touch Screen Interface"; (8) U.S. Patent Application No. 11 / 228,737, filed Sep. 16, 2005, entitled "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard"; and (9) U.S. Patent Application No. 11 / 367,749, filed Mar. 3, 2006, entitled "Multi-Functional Hand-Held Device". All of these applications are hereby incorporated by reference in their entirety.

[0185] The touch screen 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or attachment such as a stylus, finger, etc. to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contact and gestures, which may not be as precise as stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device converts the rough finger-based input into an accurate pointer / cursor position or command for performing the action desired by the user.

[0186] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device, which, unlike the touch screen, does not display a visual output. The touchpad is optionally a touch-sensitive surface separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0187] The device 100 also includes a power system 162 for powering various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0188] The device 100 optionally further includes one or more optical sensors 164. Figure 1AAn optical sensor coupled to the optical sensor controller 158 in the I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In combination with the imaging module 143 (also referred to as a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite the touch screen display 112 on the front of the device, such that the touch screen display can be used as a viewfinder for still image and / or video image capture. In some embodiments, the optical sensor is located on the front of the device such that an image of the user can optionally be obtained while the user views other video conference participants on the touch screen display, for video conferencing. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing), such that a single optical sensor 164 can be used with the touch screen display for both video conferencing and still image and / or video image capture.

[0189] The device 100 optionally further includes one or more contact intensity sensors 165. Figure 1A A contact intensity sensor coupled to the intensity sensor controller 159 in the I / O subsystem 106 is shown. The contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors for measuring the force (or pressure) of a contact on a touch-sensitive surface). The contact intensity sensor 165 receives contact intensity information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., the touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the rear of the device 100, opposite the touch screen display 112 located on the front of the device 100.

[0190] The device 100 optionally further includes one or more proximity sensors 166. Figure 1AA proximity sensor 166 is shown coupled to the peripheral device interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 optionally operates as described in the following U.S. patent applications: 11 / 241,839, titled "Proximity Detector In Handheld Device"; No. 11 / 240,788, titled "Proximity Detector In Handheld Device"; No. 11 / 620,702, titled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; No. 11 / 586,862, titled "Automated Response To And Sensing Of User Activity In Portable Devices"; and No. 11 / 638,251, titled "Methods And Systems For Automatic Configuration Of Peripherals", which U.S. patent applications are hereby incorporated by reference in their entirety. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor turns off and disables the touch screen 112.

[0191] Device 100 optionally further includes one or more haptic output generators 167. Figure 1AIllustrated is a haptic output generator coupled to haptic feedback controller 161 in I / O subsystem 106. The haptic output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components that convert an electrical signal into a haptic output on the device). The contact intensity sensor 165 receives haptic feedback generation instructions from the haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112), and optionally generates a haptic output by moving the touch-sensitive surface vertically (e.g., into / out of the surface of device 100) or laterally (e.g., backward and forward in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of device 100, opposite the touch screen display 112 located on the front of device 100.

[0192] Device 100 optionally further includes one or more accelerometers 168. Figure 1A Illustrated is an accelerometer 168 coupled to peripheral device interface 118. Alternatively, accelerometer 168 is optionally coupled to input controller 160 in I / O subsystem 106. Accelerometer 168 optionally operates as described in the following U.S. Patent Publications: U.S. Patent Publication 20050190059, titled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication 20060017692, titled "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer", both of which are hereby incorporated by reference in their entireties. In some embodiments, information is displayed in a portrait or landscape view on the touch screen display based on an analysis of data received from one or more accelerometers. Device 100 optionally further includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) in addition to accelerometer 168 for obtaining information about the location and orientation (e.g., portrait or landscape) of device 100.

[0193] In some embodiments, device 100 further includes one or more fingerprint sensors (or communicates therewith). The one or more fingerprint sensors are coupled to the peripheral device interface 118. Alternatively, the one or more fingerprint sensors are optionally coupled to the input controller 160 in the I / O system 106. However, in a common embodiment, a security-specific computing hardware (e.g., one or more processors, memories, and / or communication buses) with additional security features is used to perform fingerprint recognition operations in order to enhance the security of fingerprint information determined by the one or more fingerprint sensors. As used herein, a fingerprint sensor is a sensor that can distinguish fingerprint features (sometimes called "minutiae") of the ridges and valleys of the skin, such as those found on human fingers and toes. The fingerprint sensor can use any of a variety of techniques to distinguish fingerprint features, including but not limited to: optical fingerprint imaging, ultrasonic fingerprint imaging, active capacitance fingerprint imaging, and passive capacitance fingerprint imaging. In some embodiments, in addition to distinguishing fingerprint features in a fingerprint, the one or more fingerprint sensors are also capable of tracking the movement of fingerprint features over time, thereby determining / characterizing the movement of the fingerprint over the one or more fingerprint sensors over time. Although the one or more fingerprint sensors can be separate from the touch-sensitive surface (e.g., the touch-sensitive display system 112), it should be understood that in some specific implementations, the touch-sensitive surface (e.g., the touch-sensitive display system 112) has a spatial resolution high enough to detect fingerprint features formed by individual fingerprint ridges and is used as a fingerprint sensor instead of or in addition to the one or more fingerprint sensors. In some embodiments, device 100 includes a set of one or more orientation sensors for determining the orientation of a finger or hand on or adjacent to the device (e.g., the orientation of a finger over the one or more fingerprint sensors). Additionally, in some embodiments, in addition to or instead of fingerprint sensors, the set of one or more orientation sensors is used to detect the rotation of a contact that is interacting with the device (e.g., in one or more of the methods described below, instead of using a fingerprint sensor to detect the rotation of a fingerprint / contact, the set of one or more orientation sensors is used to detect the rotation of a contact that includes a fingerprint, where the features of the fingerprint are detected or not detected).

[0194] In some embodiments, the comparison between the features of a fingerprint and the features of a detected fingerprint with the features of a stored fingerprint is performed by a security-specific computing hardware (e.g., one or more processors, memories, and / or communication buses) separate from the processor 120 in order to enhance the security of fingerprint data generated, stored, and processed by the one or more fingerprint sensors. In some embodiments, the comparison between the features of a fingerprint and the features of a detected fingerprint with the features of a registered fingerprint is performed by the processor 120 using a fingerprint analysis module.

[0195] In some embodiments, during a registration process, a device (e.g., a fingerprint analysis module or a separate security module communicating with the one or more fingerprint sensors) collects biometric information about one or more fingerprints of a user (e.g., identifying relative positions of multiple nodes in the user's fingerprint). After the registration process has been completed, the biometric information is stored at the device (e.g., in a secure fingerprint module) for later use in authenticating a detected fingerprint. In some embodiments, the biometric information stored at the device excludes an image of the fingerprint and also excludes information of an image from which the fingerprint can be reconstructed, such that an image of the fingerprint does not inadvertently become available if the security of the device is compromised. In some embodiments, during an authentication process, a device (e.g., a fingerprint analysis module or a separate security module communicating with the one or more fingerprint sensors) determines whether a finger input detected by the one or more fingerprint sensors includes a fingerprint that matches a previously registered fingerprint registered by collecting biometric information about a fingerprint detected on the one or more fingerprint sensors (e.g., identifying relative positions of multiple nodes in the fingerprint detected on the one or more fingerprint sensors) and compares the biometric information corresponding to the detected fingerprint with the biometric information corresponding to the registered fingerprint. In some embodiments, comparing the biometric information corresponding to the detected fingerprint with the biometric information corresponding to the registered fingerprint includes comparing the types and positions of nodes in the biometric information corresponding to the detected fingerprint with the types and positions of nodes in the biometric information corresponding to the registered fingerprint. However, the determination as to whether the finger input includes a fingerprint that matches a previously registered fingerprint registered using the device is optionally performed using any one of a variety of well-known fingerprint authentication techniques to determine whether the detected fingerprint matches the registered fingerprint.

[0196] Device 100 optionally further includes one or more depth camera sensors 175. Figure 1A A depth camera sensor coupled to a depth camera controller 169 in the I / O subsystem 106 is shown. The depth camera sensor 175 receives data projected from the environment through the sensor. In combination with the imaging module 143 (also referred to as the camera module), the depth camera sensor 175 is optionally used to determine depth maps of different portions of an image captured by the imaging module 143. In some embodiments, the depth camera sensor is located in front of the device 100 such that user images with depth information are available for different functions of the device, such as video conferencing to capture a selfie with depth map data and authenticating a user of the device. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (e.g., by rotating lenses and sensors in the device housing) such that the depth camera sensor 175 is used with the touchscreen display for both video conferencing and still image and / or video image capture.

[0197] In some embodiments, the software components stored in the memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and application programs (or instruction sets) 136. Additionally, in some embodiments, the memory 102 ( Figure 1A ) or the memory 370 ( Figure 3 ) stores a device / global internal state 157, as Figure 1A and Figure 3 shown. The device / global internal state 157 includes one or more of the following: an active application state indicating which applications (if any) are currently active; a display state indicating what applications, views, or other information occupy the respective regions of the touch screen display 112; a sensor state including information obtained from the various sensors of the device and the input control device 116; and location information regarding the location and / or orientation of the device.

[0198] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between the various hardware components and software components.

[0199] The communication module 128 facilitates communication with other devices through one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is adapted to be directly coupled to other devices or indirectly coupled through a network (e.g., the Internet, a wireless LAN, etc.). In some embodiments, the external port is the same as or similar to and / or compatible with the 30-pin connector used on (a trademark of Apple Inc.) devices and / or a multi-pin (e.g., 30-pin) connector.

[0200] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or a physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to the detection of contact, such as determining whether contact has occurred (e.g., detecting a finger press event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of the contact point being represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact) or multi-point simultaneous contact (e.g., "multi-touch" / multiple finger contact). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0201] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by the user (e.g., determining whether the user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds is determined according to software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of the touchpad or touchscreen can be set to any one of a wide range of predefined thresholds. Additionally, in some implementations, software settings are provided to the user of the device for adjusting one or more of the intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by using a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0202] The contact / motion module 130 optionally detects gesture inputs from the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensities of the detected contact). Thus, gestures are optionally detected by detecting a particular contact pattern. For example, detecting a finger tap gesture includes detecting a finger press event and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and subsequently detecting a finger lift (lift-off) event.

[0203] The graphics module 132 includes various known software components for presenting and displaying graphics on the touch screen 112 or other displays, including components for changing the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual attributes). As used herein, the term "graphics" includes any object that can be displayed to a user, which non - restrictively includes text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0204] In some embodiments, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes specifying the graphics to be displayed from an application program, etc., and also receives coordinate data and other graphic attribute data as necessary, and then generates screen image data for output to the display controller 156.

[0205] The haptic feedback module 133 includes various software components for generating instructions that are used by the haptic output generator 167 to produce haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0206] The text input module 134, which is optionally a component of the graphics module 132, provides a soft keyboard for entering text in various application programs (e.g., contacts 137, - - email 140, IM 141, browser 147, and any other application that requires text input).

[0207] The GPS module 135 determines the location of the device and provides this information for use in various application programs (e.g., provided to the phone 138 for location - based dialing; provided to the camera 143 as picture / video metadata; and provided to applications that provide location - based services, such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0208] The application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof:

[0209] · The contacts module 137 (sometimes referred to as an address book or contact list);

[0210] · The phone module 138;

[0211] · The video conferencing module 139;

[0212] · The email client module 140;

[0213] · The instant messaging (IM) module 141;

[0214] · Fitness support module 142;

[0215] · Camera module 143 for still images and / or video images;

[0216] · Image management module 144;

[0217] · Video player module;

[0218] · Music player module;

[0219] · Browser module 147;

[0220] · Calendar module 148;

[0221] · Desktop widget module 149, optionally including one or more of the following: weather desktop widget 149-1, stock market desktop widget 149-2, calculator desktop widget 149-3, alarm clock desktop widget 149-4, dictionary desktop widget 149-5, and other desktop widgets obtained by the user, as well as user-created desktop widget 149-6;

[0222] · Desktop widget creator module 150 for forming user-created desktop widget 149-6;

[0223] · Search module 151;

[0224] · Video and music player module 152, which combines the video player module and the music player module;

[0225] · Notepad module 153;

[0226] · Map module 154; and / or

[0227] · Online video module 155.

[0228] Examples of other applications 136 optionally stored in the memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-supported applications, encryption, digital rights management, speech recognition, and speech reproduction.

[0229] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the contacts module 137 is optionally used to manage an address book or contact list (e.g., the application internal state 192 of the contacts module 137 stored in the memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating a phone number, email address, physical address, or other information with a name; associating an image with a name; categorizing and classifying names; providing a phone number or email address to initiate and / or facilitate communication via the phone 138, video conferencing module 139, email 140, or IM 141; and so on.

[0230] In combination with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the phone module 138 is optionally used to input a character sequence corresponding to a phone number, access one or more phone numbers in the contacts module 137, modify an entered phone number, dial the corresponding phone number, conduct a session, and disconnect or hang up when the session is completed. As described above, wireless communication optionally uses any one of a variety of communication standards, protocols, and technologies.

[0231] In combination with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contacts module 137, and phone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting, and terminating a video conference between the user and one or more other participants according to user instructions.

[0232] In combination with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In combination with the image management module 144, the email client module 140 makes it very easy to create and send emails with static images or video images captured by the camera module 143.

[0233] In combination with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the instant messaging module 141 includes executable instructions for the following operations: inputting a character sequence corresponding to an instant message, modifying a previously input character, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant message" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0234] In combination with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, the fitness support module 142 includes executable instructions for creating a fitness (e.g., having time, distance, and / or calorie burn goals); communicating with fitness sensors (exercise equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for fitness; and displaying, storing, and transmitting fitness data.

[0235] In combination with touch screen 112, display controller 156, one or more optical sensors 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0236] In combination with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for the following operations: arranging, modifying (e.g., editing), or otherwise manipulating, tagging, deleting, presenting (e.g., in a digital slide show or album), and storing still images and / or video images.

[0237] In combination with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for browsing the Internet according to user instructions (including searching, linking to, receiving, and displaying web pages or portions thereof, as well as linking to attachments and other files of web pages).

[0238] In combination with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with calendars (e.g., calendar entries, to-do items, etc.) according to user instructions.

[0239] In combination with RF circuit 108, touch screen 112, display system controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, desktop widget module 149 is a mini - application optionally downloaded and used by the user (e.g., weather desktop widget 149 - 1, stock market desktop widget 149 - 2, calculator desktop widget 149 - 3, alarm clock desktop widget 149 - 4, and dictionary desktop widget 149 - 5) or a mini - application created by the user (e.g., user - created desktop widget 149 - 6). In some embodiments, desktop widgets include HTML (HyperText Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, desktop widgets include XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! desktop widgets).

[0240] In combination with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, desktop widget creator module 150 is optionally used by the user to create desktop widgets (e.g., transfer a user - specified portion of a web page into a desktop widget).

[0241] In combination with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, search module 151 includes executable instructions for searching for text, music, sound, images, videos, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user - specified search terms) according to user instructions.

[0242] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, the video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable instructions for displaying, presenting, or otherwise playing back video (e.g., on the touch screen 112 or on an external display connected via the external port 124). In some embodiments, the device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0243] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the notepad module 153 includes executable instructions for creating and managing notepads, to-do lists, etc. according to user instructions.

[0244] In combination with the RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 is optionally used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data related to stores and other points of interest at or near a particular location, and other location-based data) according to user instructions.

[0245] In combination with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, e-mail client module 140, and browser module 147, online video module 155 includes instructions for performing the following operations: allowing a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on the touch screen or on an external display connected via external port 124), send an e-mail with a link to a particular online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, the instant messaging module 141 is used instead of the e-mail client module 140 to send a link to a particular online video. Other descriptions of the online video application can be found in U.S. Provisional Patent Application 60 / 936,562, filed Jun. 20, 2007, and entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," and U.S. Patent Application 11 / 968,067, filed Dec. 31, 2007, and entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," the contents of both of which are hereby incorporated by reference in their entirety.

[0246] Each of the above modules and applications corresponds to a set of executable instructions for performing one or more of the above functions and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as separate software programs, processes, or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, the video player module is optionally combined with the music player module into a single module (e.g., Figure 1A the video and music player module 152 in). In some embodiments, memory 102 optionally stores a subset of the above modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.

[0247] In some embodiments, device 100 is a device that uniquely performs operations of a predefined set of functions thereon via a touch screen and / or a touchpad. By using the touch screen and / or the touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on device 100 is optionally reduced.

[0248] The predefined set of functions uniquely performed via the touch screen and / or the touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to a main menu, a home menu, or a root menu. In such embodiments, the touchpad is used to implement a "menu button". In some other embodiments, the menu button is a physical push button or other physical input control device rather than a touchpad.

[0249] Figure 1B is a block diagram showing exemplary components for event handling according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 ) includes an event classifier 170 (e.g., in operating system 126) and corresponding application 136-1 (e.g., any one of the foregoing applications 137 to 151, 155, 380 to 390).

[0250] Event classifier 170 receives event information and determines application 136-1 to which the event information is to be delivered and application view 191 of application 136-1. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is / are currently active, and application internal state 192 is used by event classifier 170 to determine application view 191 to which the event information is to be delivered.

[0251] In some embodiments, application internal state 192 includes additional information, such as one or more of the following: recovery information to be used when application 136-1 resumes execution, user interface state information indicating information being displayed by or ready for display by application 136-1, a state queue for enabling a user to return to a previous state or view of application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0252] The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information about sub-events (e.g., a user touch on the touch-sensitive display 112, as part of a multi-touch gesture). The peripheral device interface 118 transmits information that it receives from the I / O subsystem 106 or sensors such as proximity sensor 166, accelerometer 168, and / or microphone 113 (via the audio circuitry 110). The information that the peripheral device interface 118 receives from the I / O subsystem 106 includes information from the touch-sensitive display 112 or a touch-sensitive surface.

[0253] In some embodiments, the event monitor 171 sends requests to the peripheral device interface 118 at predetermined intervals. In response, the peripheral device interface 118 transmits event information. In other embodiments, the peripheral device interface 118 transmits event information only when there is a significant event (e.g., an input received above a predetermined noise threshold and / or an input received for longer than a predetermined duration).

[0254] In some embodiments, the event classifier 170 further includes a hit view determination module 172 and / or an active event recognizer determination module 173.

[0255] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where within one or more of the views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0256] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct inputs is optionally determined at least in part based on the hit view of the initial touch that begins the touch-based gesture.

[0257] The hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest view in the hierarchical structure that should handle the sub-event. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or a potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view generally receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0258] The active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and thus determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with a particular view, higher views in the hierarchy will still remain as actively participating views.

[0259] The event dispatcher module 174 distributes event information to event recognizers (e.g., event recognizer 180). In embodiments that include the active event recognizer determination module 173, the event dispatcher module 174 delivers the event information to the event recognizer determined by the active event recognizer determination module 173. In some embodiments, the event dispatcher module 174 stores the event information in an event queue, which is retrieved by the corresponding event receiver 182.

[0260] In some embodiments, the operating system 126 includes the event classifier 170. Alternatively, the application 136-1 includes the event classifier 170. In yet another embodiment, the event classifier 170 is an independent module or part of another module (such as the contact / motion module 130) stored in the memory 102.

[0261] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, where each application view includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of the event recognizers 180 are part of an independent module that is a higher-level object such as a user interface toolkit (not shown) or from which application 136-1 inherits methods and other properties. In some embodiments, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. The event handler 190 optionally utilizes or invokes the data updater 176, the object updater 177, or the GUI updater 178 to update the internal state 192 of the application. Alternatively, one or more of the application views 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in the corresponding application view 191.

[0262] A corresponding event recognizer 180 receives event information (e.g., event data 179) from an event classifier 170 and identifies an event from the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognizer 180 further includes at least a subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0263] The event receiver 182 receives event information from the event classifier 170. The event information includes information about sub-events such as a touch or a touch movement. Depending on the sub-event, the event information further includes additional information such as the location of the sub-event. When the sub-event involves the movement of a touch, the event information optionally further includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device pose).

[0264] The event comparator 184 compares the event information with predefined event or sub - event definitions and determines an event or sub - event based on the comparison, or determines or updates the status of an event or sub - event. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 contains definitions of events (e.g., predefined sequences of sub - events), such as event 1 (187 - 1), event 2 (187 - 2), and other events. In some embodiments, the sub - events within an event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi - touch. In one example, the definition of event 1 (187 - 1) is a double - tap on a displayed object. For example, a double - tap includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift - off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on the displayed object, and a second lift - off (touch end) of a predetermined duration. In another example, the definition of event 2 (187 - 2) is a drag on a displayed object. For example, a drag includes a touch (or contact) of a predetermined duration on the displayed object, movement of the touch on the touch - sensitive display 112, and lift - off of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0265] In some embodiments, the event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, the event comparator 184 performs a hit test to determine which user interface object is associated with a sub - event. For example, in an application view where three user interface objects are displayed on the touch display 112, when a touch is detected on the touch - sensitive display 112, the event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub - event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, the event comparator 184 selects the event handler associated with the sub - event and the object that triggered the hit test.

[0266] In some embodiments, the definition of the corresponding event 187 also includes a delay action that delays the delivery of event information until it has been determined whether the sub - event sequence does or does not correspond to the event type of the event recognizer.

[0267] When the corresponding event recognizer 180 determines that the sub - event sequence does not match any event in the event definition 186, the corresponding event recognizer 180 enters an event - impossible, event - failed, or event - ended state, after which subsequent sub - events of the touch - based gesture are ignored. In such a case, other event recognizers (if any) that remain active for the hit view continue to track and process the ongoing sub - events of the touch - based gesture.

[0268] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists indicating how the event delivery system should perform sub - event delivery to the active participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists indicating how event recognizers interact with each other or can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists indicating whether sub - events are delivered to different levels in the view or the programmatic hierarchy.

[0269] In some embodiments, when one or more specific sub - events of an event are recognized, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferring to send) sub - events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the recognized event, and the event handler 190 associated with the flag receives the flag and executes a predefined process.

[0270] In some embodiments, the event delivery instruction 188 includes a sub - event delivery instruction to deliver event information about the sub - event without activating the event handler. Instead, the sub - event delivery instruction delivers the event information to the event handler associated with the sub - event sequence or to the actively participating view. The event handler associated with the sub - event sequence or with the actively participating view receives the event information and executes a predetermined process.

[0271] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates the telephone numbers used in contact module 137, or stores video files used in the video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positions of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on the touch-sensitive display.

[0272] In some embodiments, event handler 190 includes data updater 176, object updater 177, and GUI updater 178, or has access to the data updater, the object updater, and the GUI updater. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0273] Figure 1C is a block diagram showing a haptic output module according to some embodiments. In some embodiments, I / O subsystem 106 (e.g., haptic feedback controller 161 ( Figure 1A )) and / or other input controllers 160 ( Figure 1A )) includes Figure 1C at least some of the example components shown. In some embodiments, peripheral device interface 118 includes Figure 1C at least some of the example components shown.

[0274] In some embodiments, the haptic output module includes a haptic feedback module 133. In some embodiments, haptic feedback module 133 aggregates and combines haptic outputs of user interface feedback from software applications on the electronic device (e.g., feedback in response to user input corresponding to the displayed user interface and prompts and other notifications indicating the execution of an operation or the occurrence of an event in the user interface of the electronic device). Haptic feedback module 133 includes one or more of waveform module 123 (for providing waveforms for generating haptic outputs), mixer 125 (for mixing waveforms, such as waveforms in different channels), compressor 127 (for reducing or compressing the dynamic range of the waveforms), low-pass filter 129 (for filtering high-frequency signal components from the waveforms), and thermal controller 131 (for adjusting the waveforms according to thermal conditions). In some embodiments, haptic feedback module 133 is included in haptic feedback controller 161 ( Figure 1A) In some embodiments, individual units of the haptic feedback module 133 (or individual embodiments of the haptic feedback module 133) are also included in the audio controller (e.g., Figure 1A the audio circuit 110 therein) and are used to generate audio signals. In some embodiments, a single haptic feedback module 133 is used to generate audio signals as well as generate waveforms for haptic output.

[0275] In some embodiments, the haptic feedback module 133 further includes a trigger module 121 (e.g., a software application, operating system, or other software module that determines to generate a haptic output and initiates a process for generating the corresponding haptic output). In some embodiments, the trigger module 121 generates a trigger signal for initiating the generation of a waveform (e.g., by the waveform module 123). For example, the trigger module 121 generates a trigger signal based on a pre-set timing criterion. In some embodiments, the trigger module 121 receives a trigger signal from outside the haptic feedback module 133 (e.g., in some embodiments, the haptic feedback module 133 receives a trigger signal from a hardware input processing module 146 located outside the haptic feedback module 133) and relays the trigger signal to other components within the haptic feedback module 133 (e.g., the waveform module 123) or a software application that triggers an operation (e.g., using the trigger module 121) based on the activation of a user interface element (e.g., an application icon or affordance within an application) or a hardware input device (e.g., a home button or an intensity-sensitive input surface, such as an intensity-sensitive touch screen). In some embodiments, the trigger module 121 also (e.g., from Figure 1A and Figure 3 the haptic feedback module 133 therein) receives a haptic feedback generation instruction. In some embodiments, the trigger module 121 generates a trigger signal in response to the haptic feedback module 133 (or the trigger module 121 within the haptic feedback module 133) (e.g., from Figure 1A and Figure 3 the haptic feedback module 133 therein) receiving a haptic feedback instruction.

[0276] The waveform module 123 receives the trigger signal as an input (e.g., from the trigger module 121) and provides a waveform for generating one or more haptic outputs in response to receiving the trigger signal (e.g., a waveform selected from a predefined set of waveforms assigned for use by the waveform module 123, such as the waveforms described in more detail below with reference to Figures 4C to 4D ).

[0277] The mixer 125 receives waveforms as inputs (e.g., from the waveform module 123) and mixes these waveforms together. For example, when the mixer 125 receives two or more waveforms (e.g., a first waveform in a first channel and a second waveform in a second channel that at least partially overlaps the first waveform), the mixer 125 outputs a combined waveform corresponding to the sum of the two or more waveforms. In some embodiments, the mixer 125 also modifies one or more of the two or more waveforms to emphasize a particular waveform relative to the remaining waveforms of the two or more waveforms (e.g., by increasing the scale of the particular waveform and / or decreasing the scale of the other waveforms of the waveforms). In some cases, the mixer 125 selects one or more waveforms to remove from the combined waveform (e.g., when there are waveforms from more than three sources that have been requested to be output simultaneously by the haptic output generator 167, the waveform from the oldest source is discarded).

[0278] The compressor 127 receives waveforms (e.g., the combined waveform from the mixer 125) as inputs and modifies these waveforms. In some embodiments, the compressor 127 reduces these waveforms (e.g., according to the physical specifications of the haptic output generator 167( Figure 1A ) or 357( Figure 3 )) such that the haptic output corresponding to these waveforms is reduced. In some embodiments, the compressor 127 limits the waveforms, such as by imposing a predefined maximum amplitude on the waveforms. For example, the compressor 127 reduces the amplitude of the waveform portion that exceeds a predefined amplitude threshold while maintaining the amplitude of the waveform portion that does not exceed the predefined amplitude threshold. In some embodiments, the compressor 127 reduces the dynamic range of the waveforms. In some embodiments, the compressor 127 dynamically reduces the dynamic range of the waveforms such that the combined waveform remains within the performance specifications (e.g., force and / or movable mass displacement limits) of the haptic output generator 167.

[0279] The low-pass filter 129 receives waveforms (e.g., the compressed waveforms from the compressor 127) as inputs and filters (e.g., smoothes) the waveforms (e.g., removes or reduces high-frequency signal components in the waveforms). For example, in some cases, the compressor 127 includes in the compressed waveforms spurious signals (e.g., high-frequency signal components) that impede haptic output generation and / or exceed the performance specifications of the haptic output generator 167 when generating a haptic output based on the compressed waveforms. The low-pass filter 129 reduces or removes such spurious signals in the waveforms.

[0280] The thermal controller 131 receives a waveform (e.g., the filtered waveform from the low-pass filter 129) as an input and adjusts the waveform based on the thermal conditions of the device 100 (e.g., based on the internal temperature detected within the device 100, such as the temperature of the haptic feedback controller 161, and / or the external temperature detected by the device 100). For example, in some cases, the output of the haptic feedback controller 161 varies according to temperature (e.g., in response to receiving the same waveform, the haptic feedback controller 161 generates a first haptic output when the haptic feedback controller 161 is at a first temperature and a second haptic output when the haptic feedback controller 161 is at a second temperature different from the first temperature). For example, the magnitude (or amplitude) of the haptic output can vary according to temperature. To reduce the effect of temperature variations, the waveform is modified (e.g., the amplitude of the waveform is increased or decreased based on temperature).

[0281] In some embodiments, the haptic feedback module 133 (e.g., the trigger module 121) is coupled to the hardware input processing module 146. In some embodiments, Figure 1A the other input controllers 160 in [[]] include the hardware input processing module 146. In some embodiments, the hardware input processing module 146 receives inputs from the hardware input device 145 (e.g., Figure 1A the other input or control devices 116 in [[]], such as the home button, or an intensity-sensitive input surface, such as an intensity-sensitive touch screen). In some embodiments, the hardware input device 145 is any of the input devices described herein, such as the touch-sensitive display system 112 ( Figure 1A ), the keyboard / mouse 350 ( Figure 3 ), the touchpad 355 ( Figure 3 ), the other input or control devices 116 ( Figure 1A ) or an intensity-sensitive home button. In some embodiments, the hardware input device 145 consists of an intensity-sensitive home button rather than the touch-sensitive display system 112 ( Figure 1A ), the keyboard / mouse 350 ( Figure 3 ) or the touchpad 355 ( Figure 3 ). In some embodiments, in response to an input from the hardware input device 145 (e.g., an intensity-sensitive home button or a touch screen), the hardware input processing module 146 provides one or more trigger signals to the haptic feedback module 133 to indicate that a user input satisfying a predefined input criterion has been detected, such as an input corresponding to a "click" on the home button (e.g., a "press click" or a "release click"). In some embodiments, the haptic feedback module 133 provides a waveform corresponding to a "click" on the main button in response to an input corresponding to a "click" on the main button, thereby simulating the haptic feedback of pressing a physical main button.

[0282] In some embodiments, the tactile output module includes a tactile feedback controller 161 (e.g., Figure 1A the tactile feedback controller 161 in ), which controls the generation of tactile output. In some embodiments, the haptic feedback controller 161 is coupled to a plurality of tactile output generators, and selects one or more of the plurality of tactile output generators and sends waveforms to the selected one or more tactile output generators for generating tactile output. In some embodiments, the haptic feedback controller 161 coordinates tactile output requests corresponding to activation of the hardware input device 145 and tactile output requests corresponding to software events (e.g., tactile output requests from the haptic feedback module 133), and modifies one or more of the two or more waveforms to emphasize a particular waveform relative to the remaining waveforms of the two or more waveforms (e.g., by increasing the scale of the particular waveform and / or decreasing the scale of the remaining waveforms of these waveforms to prioritize tactile output corresponding to activation of the hardware input device 145 over tactile output corresponding to software events).

[0283] In some embodiments, as Figure 1C shown, the output of the tactile feedback controller 161 is coupled to the audio circuit of the device 100 (e.g., Figure 1A the audio circuit 110 in ), and provides an audio signal to the audio circuit of the device 100. In some embodiments, the haptic feedback controller 161 provides both a waveform for generating tactile output and an audio signal for providing audio output in conjunction with the generation of tactile output. In some embodiments, the haptic feedback controller 161 modifies the audio signal and / or the waveform (for generating tactile output) such that the audio output and the tactile output are synchronized (e.g., by delaying the audio signal and / or the waveform). In some embodiments, the haptic feedback controller 161 includes a digital-to-analog converter for converting a digital waveform into an analog signal, and the analog signal is received by the amplifier 163 and / or the tactile output generator 167.

[0284] In some embodiments, the tactile output module includes an amplifier 163. In some embodiments, the amplifier 163 receives a waveform (e.g., from the tactile feedback controller 161), amplifies the waveform, and then sends the amplified waveform to the tactile output generator 167 (e.g., the tactile output generator 167( Figure 1A ) or 357( Figure 3) any one of). For example, the amplifier 163 amplifies the received waveform to a signal level that conforms to the physical specifications of the haptic output generator 167 (e.g., amplifies to the voltage and / or current required for the haptic output generator 167 to generate a haptic output such that the signal sent to the haptic output generator 167 generates a haptic output corresponding to the waveform received from the haptic feedback controller 161) and sends the amplified waveform to the haptic output generator 167. In response, the haptic output generator 167 generates a haptic output (e.g., by shifting the movable mass back and forth relative to the neutral position of the movable mass in one or more dimensions).

[0285] In some embodiments, the haptic output module includes a sensor 169 that is coupled to the haptic output generator 167. The sensor 169 detects the state or change in state (e.g., mechanical position, physical displacement, and / or movement) of the haptic output generator 167 or one or more components of the haptic output generator 167 (e.g., one or more moving components for generating a haptic output, such as a membrane). In some embodiments, the sensor 169 is a magnetic field sensor (e.g., a Hall effect sensor) or other displacement and / or motion sensor. In some embodiments, the sensor 169 provides information (e.g., the position, displacement, and / or movement of one or more components in the haptic output generator 167) to the haptic feedback controller 161, and, based on the information provided by the sensor 169 regarding the state of the haptic output generator 167, the haptic feedback controller 161 adjusts the waveform output from the haptic feedback controller 161 (e.g., the waveform optionally sent to the haptic output generator 167 via the amplifier 163).

[0286] It should be understood that the above discussion regarding event handling of user touches on a touch-sensitive display also applies to other forms of user input for operating the multifunctional device 100 using an input device, and not all user input is initiated on a touchscreen. For example, mouse movement and mouse button presses optionally in cooperation with single or multiple keyboard presses or holds; contact movement on a touchpad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; voice commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as input corresponding to sub-events that define the event to be recognized.

[0287] Figure 2FIG. 0 shows a portable multifunctional device 100 having a touch screen 112, according to some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this and other embodiments described below, a user can select one or more of the graphics by making gestures on the graphics, such as by using one or more fingers 202 (not drawn to scale in the figures) or one or more styli 203 (not drawn to scale in the figures). In some embodiments, selection of one or more of the graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gestures optionally include one or more taps, one or more swipes (from left to right, right to left, up, and / or down), and / or rolling of a finger that has made contact with the device 100 (from right to left, left to right, up, and / or down). In some implementations or in some cases, inadvertently contacting a graphic does not select the graphic. For example, when the gesture corresponding to selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0288] The device 100 optionally further includes one or more physical buttons, such as a “home” or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any of a set of applications 136 optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

[0289] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a depressible button 206 for powering on / off the device and for locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. The depressible button 206 is optionally used to power on / off the device by depressing the button and holding the button in the depressed state for a predefined time interval; to lock the device by depressing the button and releasing the button before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating some functions via a microphone 113. The device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating a tactile output for a user of the device 100.

[0290] Figure 3FIG. 0 is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface, in accordance with some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), a gaming system, or a control device (e.g., a home or industrial controller). Device 300 generally includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects the system components and controls the communication between the system components. Device 300 includes an input / output (I / O) interface 330 having a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the haptic output generator 167 described above with reference to Figure 1A ), sensors 359 (e.g., optical sensors, acceleration sensors, proximity sensors, touch-sensitive sensors, and / or contact intensity sensors (similar to the contact intensity sensor 165 described above with reference to Figure 1A ). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 370 optionally includes one or more storage devices located remotely from the CPU 310. In some embodiments, memory 370 stores programs, modules, and data structures similar to or a subset of the programs, modules, and data structures stored in the memory 102 of the portable multifunctional device 100 ( Figure 1A ). Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable multifunctional device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the memory 102 of the portable multifunctional device 100 ( Figure 1A ) optionally does not store these modules.

[0291] Figure 3Each of the above elements in [the above] is optionally stored in one or more of the memory devices of the previously mentioned memory device. Each of the above modules corresponds to an instruction set for performing the above functions. The above modules or programs (e.g., instruction sets) need not be implemented as separate software programs, procedures, or modules, and thus various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, the memory 370 optionally stores a subgroup of the above modules and data structures. Additionally, the memory 370 optionally stores additional modules and data structures not described above.

[0292] Attention is now turned to an embodiment of a user interface optionally implemented on, for example, the portable multifunctional device 100.

[0293] Figure 4A An exemplary user interface for a menu of an application on the portable multifunctional device 100 is shown according to some embodiments. A similar user interface is optionally implemented on the device 300. In some embodiments, the user interface 400 includes the following elements or a subset or superset thereof:

[0294] · One or more signal strength indicators 402 for one or more wireless communications (such as cellular signals and Wi-Fi signals);

[0295] · Time 404;

[0296] · Bluetooth indicator 405;

[0297] · Battery status indicator 406;

[0298] · A tray 408 with icons of common applications, such as common application icons:

[0299] ○ An icon 416 marked "Phone" for the phone module 138, which optionally includes an indicator 414 of the number of missed calls or voicemails;

[0300] ○ An icon 418 marked "Mail" for the email client module 140, which optionally includes an indicator 410 of the number of unread emails;

[0301] ○ An icon 420 marked "Browser" for the browser module 147; and

[0302] ○ An icon 422 marked "iPod" for the video and music player module 152 (also referred to as the iPod (trademark of Apple Inc.) module 152); and

[0303] · Icons of other applications, such as:

[0304] ○ The icon 424 of the IM module 141 labeled "Message";

[0305] ○ The icon 426 of the calendar module 148 labeled "Calendar";

[0306] ○ The icon 428 of the image management module 144 labeled "Photo";

[0307] ○ The icon 430 of the camera module 143 labeled "Camera";

[0308] ○ The icon 432 of the online video module 155 labeled "Online Video";

[0309] ○ The icon 434 of the stock market desktop applet 149-2 labeled "Stock Market";

[0310] ○ The icon 436 of the map module 154 labeled "Map";

[0311] ○ The icon 438 of the weather desktop applet 149-1 labeled "Weather";

[0312] ○ The icon 440 of the alarm clock desktop applet 149-4 labeled "Clock";

[0313] ○ The icon 442 of the fitness support module 142 labeled "Fitness Support";

[0314] ○ The icon 444 of the notepad module 153 labeled "Notepad"; and

[0315] ○ The icon 446 labeled "Settings" for setting up the application or module, which provides access to the settings of the device 100 and its various applications 136.

[0316] It should be noted that Figure 4A The icon labels shown in

[0317] Figure 4B are merely exemplary. For example, the icon 422 of the video and music player module 152 is labeled "Music" or "Music Player". Other labels may be optionally used for various application icons. In some embodiments, the label of the corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a specific application icon is different from the name of the application corresponding to the specific application icon. Figure 3 A device (e.g., Figure 3Exemplary user interfaces on a device 300). The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) for detecting the intensity of contacts on the touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of the device 300.

[0318] Although some of the following examples will be given with reference to inputs on a touch screen display 112 (where the touch-sensitive surface and the display are combined), in some embodiments, the device detects inputs on a touch-sensitive surface separate from the display, as Figure 4B shown. In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451 in ) has a major axis (e.g., Figure 4B 452 in ) corresponding to the major axis (e.g., Figure 4B 453 in ) on the display (e.g., 450). According to these embodiments, the device detects contacts (e.g., Figure 4B 460 and 462 in ) with the touch-sensitive surface 451 at positions corresponding to the respective positions on the display (e.g., in Figure 4B 460 corresponds to 468 and 462 corresponds to 470). Thus, when the touch-sensitive surface (e.g., Figure 4B 451 in ) is separate from the display of the multifunctional device ( Figure 4B 450 in ), user inputs detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movements) are used by the device to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0319] Additionally, although the following examples are mainly given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by inputs from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of a contact), followed by a movement of the cursor along the path of the swipe (e.g., instead of a movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is located above the position of the tap gesture (e.g., instead of detecting a contact, followed by stopping the detection of the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or a mouse and a finger contact are optionally used simultaneously.

[0320] Figure 5AAn exemplary personal electronic device 500 is shown. The device 500 includes a body 502. In some embodiments, the device 500 may include some or all of the features described with respect to devices 100 and 300 (e.g., Figures 1A to 4B ). In some embodiments, the device 500 has a touch-sensitive display screen 504 hereinafter referred to as a touch screen 504. Alternatively or in addition to the touch screen 504, the device 500 also has a display and a touch-sensitive surface. As in the case of devices 100 and 300, in some embodiments, the touch screen 504 (or the touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of an applied contact (e.g., a touch). One or more intensity sensors of the touch screen 504 (or the touch-sensitive surface) may provide output data representing the intensity of the touch. The user interface of the device 500 may respond to the touch based on its intensity, meaning that touches of different intensities may invoke different user interface operations on the device 500.

[0321] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, filed May 8, 2013, entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application", published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed November 11, 2013, entitled "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships", published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.

[0322] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508 (if included) can be in physical form. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) may allow device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watch bands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear device 500.

[0323] Figure 5B An exemplary personal electronic device 500 is shown. In some embodiments, device 500 may include some or all of the components described with respect to Figure 1A , Figure 1B and Figure 3 . Device 500 has a bus 512 that operatively couples the I / O section 514 to one or more computer processors 516 and a memory 518. The I / O section 514 may be connected to a display 504, which may have a touch-sensitive component 522 and optionally an intensity sensor 524 (e.g., a contact intensity sensor). Additionally, the I / O section 514 may be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 is optionally a rotatable input device or a pushable input device and a rotatable input device. In some examples, input mechanism 508 is optionally a button.

[0324] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to the I / O section 514.

[0325] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform, for example, the following techniques, including process 800 (FIG. 8), process 1000 (FIG. 10), process 1200 (FIG. 12), process 1400 (FIG. 14), process 1600 (FIG. 16), process 1800 (FIG. 18), process 2000 (FIG. 20), process 2200 (FIG. 22), process 2500 (FIG. 25), process 2700 (FIG. 27), process 2900 (FIG. 29), process 3100 (FIG. 31), process 3300( Figure 33 ), and process 3500( Figure 35 ), 3700 (FIG. 37), 3900 (FIG. 39), 4100 (FIG. 41), 4300 (FIG. 43). A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transient computer-readable storage medium. Non-transient computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory, solid-state drives, etc. The personal electronic device 500 is not limited to Figure 5B the components and configurations shown, but may include other components or additional components in a variety of configurations.

[0326] As used herein, the term "indicative representation" refers to a user-interactive graphical user interface object optionally displayed on the display screen of devices 100, 300, and / or 500( Figure 1A , Figure 3 and Figures 5A to 5B ). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each optionally constitute an indicative representation.

[0327] As used herein, the term "focus selector" refers to an input element that indicates the current part of the user interface with which the user is interacting. In some embodiments that include a cursor or other position marker, the cursor serves as the "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element) on a touch-sensitive surface (e.g., Figure 3 the touchpad 355 in Figure 4BWhen an input (e.g., a press input) is detected on the touch-sensitive surface 451), the particular user interface element is adjusted according to the detected input. In some specific implementations including a touch screen display (e.g., Figure 1A the touch-sensitive display system 112 in Figure 4A or the touch screen 112 in

[0328] ), which can enable direct interaction with user interface elements on the touch screen display, the detected contact on the touch screen acts as a "focus selector" such that when an input (e.g., a press input made by a contact) is detected at the position of a particular user interface element (e.g., a button, a window, a slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some specific implementations, the focus moves from one area of the user interface to another area of the user interface without a corresponding movement of the cursor or a movement of the contact on the touch screen display (e.g., moving the focus from one button to another button by using the tab key or arrow keys); in these specific implementations, the focus selector moves according to the movement of the focus between different areas of the user interface. Regardless of the specific form taken by the focus selector, the focus selector is generally a user interface element (or a contact on the touch screen display) that is controlled by the user to deliver the interaction with the user interface expected by the user (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or a touch screen), the position of the focus selector (e.g., a cursor, a contact, or a selection box) above the corresponding button will indicate that the user desires to activate the corresponding button (rather than other user interface elements shown on the device display).As used in the specification and claims, the term "feature intensity" of a contact refers to a feature of the contact based on one or more intensities of the contact. In some embodiments, the feature intensity is based on a plurality of intensity samples. The feature intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predefined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after detecting the contact, before detecting the lift-off of the contact, before or after detecting the start of movement of the contact, before detecting the end of the contact, before or after detecting an increase in the intensity of the contact, and / or before or after detecting a decrease in the intensity of the contact). The feature intensity of the contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the feature intensity (e.g., when the feature intensity is the average value of the intensity of the contact over time). In some embodiments, the feature intensity is compared with a set of one or more intensity thresholds to determine whether the user has performed an operation. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, a contact whose feature intensity does not exceed the first threshold results in a first operation, a contact whose feature intensity exceeds the first intensity threshold but does not exceed the second intensity threshold results in a second operation, and a contact whose feature intensity exceeds the second threshold results in a third operation. In some embodiments, the comparison between the feature intensity and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to forgo performing the corresponding operation) rather than to determine whether to perform a first operation or a second operation.

[0329] Figure 5C Illustrated is the detection of a plurality of contacts 552A - 552E on a touch-sensitive display screen 504 using a plurality of intensity sensors 524A - 524D. Figure 5C Also included is an intensity map that shows the current intensity measurements of the intensity sensors 524A - 524D relative to intensity units. In this example, the intensity measurements of both intensity sensors 524A and 524D are 9 intensity units, and the intensity measurements of both intensity sensors 524B and 524C are 7 intensity units. In some specific implementations, the cumulative intensity is the sum of the intensity measurements of the plurality of intensity sensors 524A - 524D, which is 32 intensity units in this example. In some embodiments, each contact is assigned a corresponding intensity, i.e., a portion of the cumulative intensity. Figure 5DShows the assignment of cumulative intensity to contacts 552A - 552E based on their distance from the center of force 554. In this example, each of contacts 552A, 552B, and 552E is assigned an intensity of 8 intensity units of cumulative intensity, and each of contacts 552C and 552D is assigned an intensity of 4 intensity units of cumulative intensity. More generally, in some embodiments, each contact j is assigned a corresponding intensity Ij according to a predefined mathematical function Ij = A·(Dj / ΣDi), which is a part of the cumulative intensity A, where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i = 1 to the last) from the center of force. An electronic device similar to or equivalent to devices 100, 300, or 500 can perform the operations referred to Figures 5C to 5D above. In some embodiments, the characteristic intensity of a contact is based on one or more intensities of the contact. In some embodiments, intensity sensors are used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). It should be noted that the intensity map is not part of the displayed user interface, but is included in Figures 5C - 5D to assist the reader.

[0330] In some embodiments, a portion of the recognized gesture is used to determine the characteristic intensity. For example, the touch-sensitive surface optionally receives a continuous swipe contact that transitions from a starting position and reaches an ending position, at which the contact intensity increases. In this example, the characteristic intensity of the contact at the ending position is optionally based only on a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the ending position). In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of the following: an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow spikes or dips in the intensity of the swipe contact for the purpose of determining the characteristic intensity.

[0331] Optionally, characterize the contact intensity on the touch-sensitive surface relative to one or more intensity thresholds such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or touchpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from an operation typically associated with clicking a button of a physical mouse or touchpad. In some embodiments, when a contact is detected with a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact detection intensity threshold, contacts below the nominal contact detection intensity threshold are no longer detected), the device will move a focus selector based on the movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different sets of user interface figures.

[0332] An increase in contact characteristic intensity from an intensity below the light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in contact characteristic intensity from an intensity below the deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in contact characteristic intensity from an intensity below the contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting a contact on the touch surface. A decrease in contact characteristic intensity from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting a lift-off of the contact from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0333] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or contacts), where the corresponding press input is detected at least in part based on the detected intensity of the contact (or contacts) increasing above a press input intensity threshold. In some embodiments, a corresponding operation is performed in response to detecting the intensity of the corresponding contact increasing above the press input intensity threshold (e.g., the "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the intensity of the corresponding contact above the press input intensity threshold and a subsequent decrease in the intensity of the contact below the press input intensity threshold, and a corresponding operation is performed in response to detecting the subsequent decrease in the intensity of the corresponding contact below the press input threshold (e.g., the "up stroke" of the corresponding press input).

[0334] Figures 5E - 5HDetection of a gesture is shown, the gesture comprising contact 562 with an intensity from below Figure 5E The light press intensity threshold in L ”) increases to a strength higher than Figure 5H The deep compression intensity threshold in D ”) corresponding to a press input with an intensity of a deep press. On the displayed user interface 570 including application icons 572A-572D displayed in the predefined area 574, a cursor 576 is displayed over the application icon 572B corresponding to application 2, and a gesture performed using contact 562 is detected on the touch-sensitive surface 560. In some embodiments, gestures are detected on the touch-sensitive display 504. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines that the intensity of the contact 562 is within a deep press intensity threshold (for example, “IT D ”) reaches a peak above. Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, and according to the increase in intensity during the gesture to a deep press intensity threshold (e.g., “IT D ”) above contact 562, displays reduced-scale representations 578A-578C (e.g., thumbnails) of documents recently opened for application 2, such as Figures 5F - 5H In some embodiments, the intensity is a characteristic intensity of the contact compared to one or more intensity thresholds. It should be noted that the intensity map for contact 562 is not part of the displayed user interface, but is included in the Figures 5E - 5H To help readers.

[0335] In some embodiments, the display of representations 578A-578C includes animation. For example, representation 578A is initially displayed near application icon 572B, such as Figure 5F As the animation progresses, representation 578A moves upward and representation 578B is displayed near application icon 572B, as shown. Figure 5G Then, representation 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed near application icon 572B, as shown in FIG. Figure 5H 578A-578C form an array above icon 572B. In some embodiments, the animation progresses according to the intensity of contact 562, such as Figures 5F - 5G , where representations 578A-578C appear and increase as the strength of contact 562 approaches a deep press strength threshold (eg, “IT D ”) increases and moves upward. In some embodiments, the intensity according to which the animation progresses is the characteristic intensity of the contact. The reference may be performed using an electronic device similar to or equivalent to device 100, 300, or 500. Figures 5E - 5H The operation described.

[0336] In some embodiments, the device employs strength hysteresis to avoid unexpected inputs sometimes referred to as “jitter,” where the device defines or selects a hysteresis strength threshold having a predefined relationship to a press input strength threshold (e.g., the hysteresis strength threshold is X strength units lower than the press input strength threshold, or the hysteresis strength threshold is 75%, 90%, or some reasonable proportion of the press input strength threshold). Thus, in some embodiments, a press input includes an increase in the strength of the corresponding contact to above the press input strength threshold and a subsequent decrease in the strength of that contact to below the hysteresis strength threshold corresponding to the press input strength threshold, and a corresponding operation is performed in response to detecting that the strength of the corresponding contact subsequently decreases to below the hysteresis strength threshold (e.g., the “upstroke” of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects an increase in contact strength from a strength equal to or lower than the hysteresis strength threshold to a strength equal to or higher than the press input strength threshold and optionally the contact strength subsequently decreases to a strength equal to or lower than the hysteresis strength, and a corresponding operation is performed in response to detecting the press input (e.g., depending on the context, an increase in contact strength or a decrease in contact strength).

[0337] For ease of explanation, optionally, a description of an operation performed in response to a press input associated with a press input strength threshold or in response to a gesture including a press input is triggered in response to detecting any one of the following various conditions: an increase in contact strength to above the press input strength threshold, an increase in contact strength from a strength below the hysteresis strength threshold to a strength above the press input strength threshold, a decrease in contact strength to below the press input strength threshold, and / or a decrease in contact strength to below the hysteresis strength threshold corresponding to the press input strength threshold. Additionally, in an example where an operation is described as being performed in response to detecting a decrease in the strength of a contact to below the press input strength threshold, the operation is optionally performed in response to detecting a decrease in the strength of the contact to below the hysteresis strength threshold corresponding to and less than the press input strength threshold.

[0338] As used herein, an “installed application” refers to a software application that has been downloaded to an electronic device (e.g., devices 100, 300, and / or 500) and is ready to be launched (e.g., become open) on the device. In some embodiments, a downloaded application becomes an installed application using an installer that extracts program portions from the downloaded software package and integrates the extracted portions with the operating system of the computer system.

[0339] As used herein, the term "open application" or "executing application" refers to a software application that maintains state information (e.g., as part of the device / global internal state 157 and / or the application internal state 192). An open or executing application is optionally any one of the following types of applications:

[0340] · An active application that is currently displayed on the display screen of the device on which the application is being used;

[0341] · A background application (or background process) that is not currently displayed but one or more processes of the application are being processed by one or more processors; and

[0342] · A paused or dormant application that is not running but has state information stored in memory (volatile and non-volatile respectively) and is available for resuming the execution of the application.

[0343] As used herein, the term "closed application" refers to a software application that does not maintain state information (e.g., the state information of a closed application is not stored in the memory of the device). Thus, closing an application includes stopping and / or removing the application process and removing the state information of the application from the memory of the device. Generally speaking, when in a first application, opening a second application does not close the first application. When the second application is displayed and the first application stops being displayed, the first application becomes a background application.

[0344] Attention is now turned to an implementation of a user interface ("UI") and associated processes implemented on an electronic device (such as the portable multifunctional device 100, device 300, or device 500).

[0345] Figure 6 An exemplary device configured to participate in a transaction via one or more communication channels is shown. One or more exemplary electronic devices (e.g., devices 100, 300, and 500) are configured to optionally detect an input (e.g., a specific user input, an NFC field), and optionally transmit payment information (e.g., using NFC). The one or more electronic devices optionally include NFC hardware and are configured to support NFC.

[0346] An electronic device (e.g., devices 100, 300, and 500) is optionally configured to store payment account information associated with each of one or more payment accounts. The payment account information includes, for example, one or more of the following: a person's name or company name, a billing address, a login name, a password, an account number, an expiration date, a security code, a phone number, a bank associated with the payment account (e.g., the issuing bank), and a card network identifier. In some examples, the payment account information includes an image, such as a photograph of a payment card (e.g., a photograph taken by and / or received by the device). In some examples, the electronic device receives user input that includes at least some payment account information (e.g., receives a credit card number, debit card number, account number, or shopping card number and an expiration date as user input). In some examples, the electronic device detects at least some payment account information from an image (e.g., of a payment card captured by a camera sensor of the device). In some examples, the electronic device receives at least some payment account information from another device (e.g., another user device or a server). In some examples, the electronic device receives payment account information from a server associated with another service (e.g., an application for renting or selling audio files and / or video files) for which the user's or user device's account has previously shopped or had payment account data identified.

[0347] In some embodiments, a payment account is added to the electronic device (e.g., devices 100, 300, and 500) such that the payment account information is securely stored on the electronic device. In some examples, after the user initiates such a process, the electronic device transmits the information of the payment account to a transaction coordination server, which then communicates with a server operated by the payment network of the account (e.g., a payment server) to ensure the validity of the information. The electronic device is optionally configured to receive a script from a server that allows the electronic device to program the payment information of the account onto a secure element.

[0348] In some embodiments, communication between devices 100, 300, and 500 facilitates transactions (e.g., general transactions or specific transactions). For example, a first electronic device (e.g., 100) can act as a configuration device or a management device and can send new or updated payment account data (e.g., information about a new account, updated information about an existing account, and / or warnings regarding an existing account) to a second electronic device (e.g., 500). As another example, a first electronic device (e.g., 100) can send data to a second electronic device, where the data reflects information about a payment transaction facilitated at the first electronic device. The information optionally includes one or more of the following: payment amount, account used, time of purchase, and whether the default account was changed. The second device (e.g., 500) optionally uses such information to update the default payment account (e.g., based on a learning algorithm or explicit user input).

[0349] The electronic devices (e.g., 100, 300, 500) are configured to communicate with each other via any one of a variety of networks. For example, the devices communicate using a Bluetooth connection 608 (e.g., which includes a classic Bluetooth connection or a Bluetooth Low Energy connection) or using a WiFi network 606. Communication between user devices is optionally adjusted to reduce the likelihood of improper sharing of information between the devices. For example, communication regarding payment information requires the communicating devices to be paired (e.g., associated with each other via an explicit user interaction) or associated with the same user account.

[0350] In some embodiments, the electronic devices (e.g., 100, 300, 500) are used to communicate with a point-of-sale (POS) payment terminal 600, which optionally supports NFC. The communication optionally occurs using various communication channels and / or technologies. In some examples, the electronic devices (e.g., 100, 300, 500) use an NFC channel 610 to communicate with the payment terminal 600. In some embodiments, the payment terminal 600 uses a peer-to-peer NFC mode to communicate with the electronic devices (e.g., 100, 300, 500). The electronic devices (e.g., 100, 300, 500) are optionally configured to transmit a signal to the payment terminal 600 that includes payment information for a payment account (e.g., the default account or the account selected for a specific transaction).

[0351] In some embodiments, proceeding with the transaction includes transmitting a signal that includes payment information for an account (such as a payment account). In some embodiments, proceeding with the transaction includes reconfiguring an electronic device (e.g., 100, 300, 500) to respond as a contactless payment card (such as an NFC-enabled contactless payment card), and then transmitting credentials for the account via NFC to a payment terminal such as 600. In some embodiments, after transmitting the credentials for the account via NFC, the electronic device is reconfigured not to respond as a contactless payment card (e.g., authorization is required before it can be reconfigured again to respond as a contactless payment card via NFC).

[0352] In some embodiments, generation and / or transmission of the signal is controlled by a secure element in the electronic device (e.g., 100, 300, 500). Optionally, the secure element requires a specific user input before releasing the payment information. For example, the secure element optionally requires: detecting the electronic device being worn, detecting a button press, detecting a password entry, detecting a touch, detecting one or more option selections (e.g., option selections received when interacting with an application), detecting a fingerprint signature, detecting speech or a voice command, and / or detecting a gesture or movement (e.g., rotation or acceleration). In some examples, the secure element releases the payment information to be transmitted to another device (e.g., payment terminal 600) if a communication channel (e.g., an NFC communication channel) is established with another device (e.g., payment terminal 600) within a defined time period from the detection of the input. In some examples, the secure element is a hardware component that controls the release of secure information. In some examples, the secure element is a software component that controls the release of secure information.

[0353] In some embodiments, the protocol associated with transaction participation depends on, for example, the device type. For example, for a wearable device (e.g., device 500) and a phone (e.g., device 100), the conditions for generating and / or transmitting payment information can be different. For example, the generation conditions and / or transmission conditions for the wearable device include detecting that a button has been pressed (e.g., after security verification), while the corresponding conditions for the phone do not require a button press but instead require detecting a specific interaction with an application. In some embodiments, the conditions for transmitting and / or releasing payment information include receiving a specific input on each of a plurality of devices. For example, release of the payment information optionally requires detecting a fingerprint and / or password at a device (e.g., device 100), and detecting a mechanical input (e.g., a button press) on another device (e.g., device 500).

[0354] The payment terminal 600 optionally uses the payment information to generate a signal for transmission to the payment server 604 to determine whether the payment is authorized. The payment server 604 optionally includes any device or system configured to receive payment information associated with a payment account and determine whether the proposed purchase is authorized. In some examples, the payment server 604 includes a server of an issuing bank. The payment terminal 600 communicates directly with the payment server 604 or indirectly via one or more devices or systems (e.g., a server of an acquiring bank and / or a server of a card network).

[0355] The payment server 604 optionally uses at least some of the payment information to identify a user account from a database of user accounts (e.g., 602). For example, each user account includes payment information. The account is optionally located by locating an account having specific payment information that matches the information communicated from the POS. In some examples, the payment is rejected when the provided payment information is inconsistent (e.g., the expiration date does not correspond to the credit card number, the debit card number, or the shopping card number) or when no account includes payment information that matches the information communicated from the POS.

[0356] In some embodiments, the data of the user account also identifies one or more restrictions (e.g., credit limit); current balance or previous balance; previous transaction date, location, and / or amount; account status (e.g., active or frozen) and / or authorization instructions. In some examples, the payment server (e.g., 604) uses such data to determine whether to authorize the payment. For example, the payment server rejects the payment when the purchase amount added to the current balance will result in exceeding the account limit, when the account is frozen, when the previous transaction amount exceeds a threshold, or when the previous transaction count or frequency exceeds a threshold.

[0357] In some embodiments, the payment server 604 uses an indication of whether the proposed purchase is authorized or rejected to respond to the POS payment terminal 600. In some examples, the POS payment terminal 600 transmits a signal to an electronic device (e.g., 100, 300, 500) to identify the result. For example, when the purchase (e.g., via a transaction coordination server that manages a transaction application on the user device) is authorized, the POS payment terminal 600 sends a receipt to the electronic device (e.g., 100, 300, 500). In some cases, the POS payment terminal 600 presents an output (e.g., a visual output or an audio output) indicating the result. The payment may be transmitted to the merchant as part of the authorization process or may be transmitted later.

[0358] In some embodiments, an electronic device (e.g., 100, 300, 500) participates in a transaction that is completed without involving a POS payment terminal 600. For example, upon detecting a mechanical input that has been received, a security element in the electronic device (e.g., 100, 300, 500) releases payment information to allow an application on the electronic device to access the information ...

Claims

1. A method, comprising: At an electronic device having a display and one or more biometric sensors: Simultaneously display a biometric registration interface on the display, wherein displaying the biometric registration interface includes simultaneously displaying: A representation of a biometric feature, wherein the representation of the biometric feature has an orientation determined based on an alignment of the biometric feature with one or more biometric sensors of the device; And A progress indicator, the progress indicator including a first progress indicator portion at a first position relative to the representation of the biometric feature on the display and a second progress indicator portion at a second position relative to the representation of the biometric feature on the display, wherein the representation of the biometric feature is displayed on the display between the first position and the second position; When simultaneously displaying the representation of the biometric feature and the progress indicator, detect a change in the orientation of the biometric feature relative to the one or more biometric sensors; And In response to detecting the change in the orientation of the biometric feature relative to the one or more biometric sensors: Update one or more visual features of the first progress indicator portion based on determining that the change in the orientation of the biometric feature satisfies a registration criterion for a first portion of the biometric feature corresponding to the first progress indicator portion; And Update one or more visual features of the second progress indicator portion based on determining that the change in the orientation of the biometric feature satisfies a registration criterion for a second portion of the biometric feature corresponding to the second progress indicator portion.

2. The method according to claim 1, further comprising: In response to detecting the change in the orientation of the biometric feature relative to the one or more biometric sensors, update the representation of the biometric feature based on the change in the orientation of the biometric feature relative to the one or more biometric sensors.

3. The method according to any one of claims 1 to 2, wherein the progress indicator comprises a plurality of progress indicator portions, the plurality of progress indicator portions comprising the first progress indicator portion and the second progress indicator portion, wherein the plurality of progress indicator portions surround at least a portion of the representation of the biometric feature.

4. The method according to any one of claims 1 to 3, wherein the registration criterion for the first portion of the biometric feature corresponding to the first progress indicator portion comprises the requirement that the first portion of the biometric feature be oriented relative to the one or more biometric sensors in a predetermined manner.

5. The method according to any one of claims 1 to 4, wherein the registration criterion for the first portion of the biometric feature corresponding to the first progress indicator portion comprises the requirement that the first portion of the biometric feature has not been registered.

6. The method according to any one of claims 1 to 5, wherein: When the biometric feature turns towards the first progress indicator portion, the first progress indicator portion indicates a registration status of a first portion of the biometric feature detected by the one or more biometric sensors; And When the biometric feature turns towards the first progress indicator portion, the second progress indicator portion indicates a registration status of a second portion of the biometric feature detected by the one or more biometric sensors that is different from the first portion of the biometric feature.

7. The method according to any one of claims 1 to 6, wherein displaying the representation of the biometric feature comprises displaying a digital viewfinder including a representation of the field of view of one or more cameras of the electronic device.

8. The method according to claim 4, wherein one or more of the plurality of progress indicator portions comprise a plurality of corresponding progress elements.

9. The method according to any one of claims 1 to 8, wherein the registration criterion for the first part of the biometric characteristic corresponding to the first progress indicator part includes the requirement that the first part of the biometric characteristic changes its orientation relative to the one or more biometric sensors by at least a threshold amount.

10. The method according to any one of claims 1 to 9, wherein displaying the biometric registration interface further includes displaying a prompt to move the biometric characteristic.

11. The method according to claim 10, wherein displaying the prompt to move the biometric characteristic includes displaying a prompt indicating a direction of movement.

12. The method according to claim 11, wherein displaying the prompt indicating a direction of movement includes overlaying a three-dimensional object on the representation of the biometric characteristic.

13. The method according to any one of claims 1 to 12, in response to detecting the change in the orientation of the biometric characteristic relative to the one or more biometric sensors, rotating the prompt according to the change in the orientation of the biometric characteristic relative to the one or more biometric sensors.

14. The method according to any one of claims 1 to 13, wherein updating one or more visual features of the first progress indicator part includes updating the one or more visual features of the first progress indicator from a first state to a second state, the second state indicating that the first progress indicator part meets the registration criterion.

15. The method according to claim 14, further comprising: After updating one or more visual features of the first progress indicator portion, a change in the orientation of the biometric feature relative to the one or more biometric sensors is detected, such that the biometric feature no longer satisfies the registration criterion for the first portion of the biometric feature corresponding to the first progress indicator portion; And In response to detecting the change in the orientation of the biometric feature relative to the one or more biometric sensors, update one or more visual features of the first progress indicator portion from the second state to a third state, the third state indicating that the first portion of the biometric feature has been registered but no longer meets the registration criteria.

16. The method according to any one of claims 1 to 15, wherein updating one or more visual features of the first progress indicator part includes updating the one or more visual features of the first progress indicator part in a first manner based on the registration state of the first part of the biometric characteristic, and updating the one or more visual features of the first progress indicator part in a second manner based on the alignment of the biometric characteristic with the one or more biometric sensors of the device.

17. The method according to any one of claims 1 to 16, wherein updating one or more visual features of the first progress indicator part includes updating the one or more visual features of the first progress indicator part based on the rate of change of the orientation of the biometric characteristic relative to the one or more biometric sensors.

18. The method according to any one of claims 1 to 17, wherein the first progress indicator portion includes a plurality of display elements having a corresponding order, and updating one or more visual features of the first progress indicator portion includes: Based on determining that the change in the orientation of the biometric feature relative to the one or more biometric sensors is a change in a first direction, change the appearance of the display element starting from the first end of the corresponding order; And Based on determining that the change in the orientation of the biometric feature relative to the one or more biometric sensors is a change in a second direction, change the appearance of the display element starting from the second end of the corresponding order, the second end of the corresponding order being different from the first end of the corresponding order.

19. The method according to claim 17, wherein updating the one or more visual features of the first progress indicator portion in a second manner includes updating the one or more visual features of the first progress indicator portion in a second manner based on a change direction of the biometric feature relative to the orientation of the one or more biometric sensors.

20. The method according to any one of claims 1 to 16, further comprising: Based on determining that the registration completion criteria are met, output an indication of the completion of the registration of the biometric feature.

21. The method according to claim 20, wherein outputting an indication of completion of registration of the biometric feature includes updating one or more visual features of the progress indicator.

22. The method according to claim 21, wherein: Before detecting the change in the orientation of the biometric feature relative to the one or more biometric sensors, the first progress indicator portion and the second progress indicator portion are visually discrete, and Updating one or more visual features of the progress indicator includes visually merging the first progress indicator portion and the second progress indicator portion.

23. The method according to any one of claims 20 to 22, wherein outputting an indication of completion of registration of the biometric feature includes modifying the representation of the biometric feature.

24. The method according to any one of claims 20 to 23, wherein outputting an indication of completion of registration of the biometric feature includes displaying a confirmation affordance representation, wherein selection of the confirmation affordance representation causes the electronic device to display a completion interface.

25. The method according to any one of claims 20 to 24, wherein outputting an indication of completion of registration of the biometric feature includes displaying a simulation of the representation of the biometric feature.

26. The method according to any one of claims 20 to 25, wherein outputting an indication of completion of registration of the biometric feature includes outputting a haptic output indicating successful registration of the biometric feature.

27. The method according to any one of claims 20 to 24, further comprising: After outputting the indication of the completion of the registration of the biometric feature, display a second biometric registration interface, wherein displaying the second biometric registration interface includes simultaneously displaying: A second representation of the biometric feature, wherein the representation of the biometric feature has an orientation determined based on the alignment of the biometric feature with the one or more biometric sensors of the device; And A second progress indicator, the second progress indicator including a Third progress indicator portion at a first position relative to the representation of the biometric feature on the display and a fourth progress indicator portion at a second position relative to the representation of the biometric feature on the display, wherein the second representation of the biometric feature is displayed on the display between the third position and the fourth position.

28. The method according to any one of claims 20 to 27, further comprising: After outputting the indication of the completion of the registration of the biometric feature, output an indication of the completion of the registration procedure.

29. The method according to any one of claims 27 to 28, wherein the registration status of the first progress indicator portion does not correspond to the registration status of the third progress indicator portion.

30. The method according to any one of claims 27 to 29, wherein the first progress indicator portion of the progress indicator includes a first number of progress elements, and the third progress indicator portion of the second progress indicator includes a second number of progress elements different from the first number.

31. The method according to any one of claims 27 to 30, further comprising: While simultaneously displaying the second representation of the biometric feature and the second progress indicator, detect a second change in the orientation of the biometric feature relative to the one or more biometric sensors; and In response to detecting the second change in the orientation of the biometric feature relative to the one or more biometric sensors: Based on determining that the change in the orientation of the biometric feature meets the registration criteria for the first portion of the biometric feature, update one or more visual features of the third progress indicator portion; And Update one or more visual features of the fourth progress indicator portion based on determining that the change in the orientation of the biometric characteristic satisfies the enrollment criteria for the second portion of the biometric characteristic.

32. The method according to claim 31, further comprising: After detecting the second change in the orientation of the biometric characteristic relative to the one or more biometric sensors, output a second indication of completion of enrollment of the biometric characteristic based on determining that a second set of enrollment completion criteria is satisfied.

33. The method according to any one of claims 1 to 32, wherein the one or more biometric sensors include one or more of the following: a visible light sensor, an infrared sensor, a time-of-flight sensor, and / or a camera sensor.

34. An electronic device, comprising: One or more biometric sensors; A display; One or more processors; And A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 33.

35. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 1 to 33.

36. An electronic device, comprising: One or more biometric sensors; A display; And An apparatus for performing the method according to any one of claims 1 to 33.

37. A computer program product, the computer program product including one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 1 to 33.

38. A method, comprising: At an electronic device having a display and one or more biometric sensors: Simultaneously display on the display: An application interface corresponding to an application; And A biometric authentication interface controlled by an operating system of the electronic device, wherein the biometric authentication interface is displayed over a portion of the application interface; When displaying the biometric authentication interface, obtain biometric data corresponding to at least a portion of a biometric characteristic from the one or more biometric sensors; And Based on determining that the at least a portion of the biometric characteristic satisfies biometric authentication criteria based on the biometric data: Provide authentication information to the application indicating that the biometric authentication criteria have been satisfied for the one or more portions of the biometric characteristic; and After providing the authentication information to the application, maintain the display of the biometric authentication interface for a predetermined amount of time.

39. The method according to claim 38, wherein the biometric authentication interface is at least partially translucent.

40. The method according to any one of claims 38 to 39, further comprising: Load the application before displaying the application interface and the biometric authentication interface; And Wherein the biometric authentication interface is displayed in response to the loading of the application.

41. The method according to any one of claims 38 to 39, wherein the biometric authentication interface is displayed in response to detecting a user interaction with the application interface corresponding to a request to access content that requires authentication.

42. The method according to claim 41, further comprising: Prepare to use the one or more biometric sensors when displaying the authentication enabling indication and before obtaining the biometric data corresponding to at least a portion of the biometric characteristic.

43. The method according to any one of claims 38 to 42, further comprising: In response to obtaining biometric data corresponding to at least a portion of a biometric characteristic from the one or more biometric sensors, determine whether the at least a portion of the biometric characteristic satisfies biometric authentication criteria based on the biometric data.

44. The method according to any one of claims 38 to 43, further comprising: In response to obtaining biometric data from the one or more biometric sensors: Change the size of a user interface object of the biometric authentication interface from a first size to a second size; and Change the size of the user interface object from the second size to the first size.

45. The method according to claim 43, wherein determining whether at least a portion of the biometric characteristics meets a biometric authentication criterion based on the biometric data includes displaying a biometric authentication analysis animation.

46. The method according to claim 45, wherein displaying the biometric authentication analysis animation includes rotating one or more rings around an interface object of the biometric authentication animation.

47. The method according to any one of claims 45 to 46, wherein displaying the biometric authentication analysis animation includes changing the appearance of an animation object on a disk surface, wherein the disk surface has an appearance based on the following content, and as the appearance of the animation object changes, the appearance of the disk surface changes.

48. The method according to any one of claims 45 to 47, wherein one or more colors of the biometric authentication analysis animation are based on one or more colors of the application interface.

49. The method according to any one of claims 38 to 48, further comprising: After maintaining the display of the biometric authentication interface for a predetermined amount of time, stop displaying the biometric authentication interface.

50. The method according to any one of claims 38 to 49, comprising: During the display of the biometric authentication interface for up to the predetermined amount of time, display the change in the user interface of the application due to the provision of the authentication information to the application.

51. The method according to any one of claims 38 to 50, further comprising: Further, based on determining that at least a portion of the biometric characteristic satisfies the biometric authentication criteria from the biometric data, display a biometric authentication success animation including a first representation simulating the biometric characteristic to indicate that at least a portion of the biometric characteristic satisfies the biometric authentication criteria.

52. The method according to any one of claims 38 to 51, further comprising: Based on determining that at least a portion of the biometric characteristic does not satisfy the biometric authentication criteria from the biometric data, display a biometric authentication failure animation including a second representation simulating the biometric characteristic to indicate that at least a portion of the biometric characteristic does not satisfy the biometric authentication criteria.

53. The method according to claim 52, wherein the second representation of the simulation of the biometric feature is a three-dimensional object, and wherein displaying the biometric authentication failure animation includes alternating the rotation of the second representation between a first direction of rotation around an axis parallel to the display and a second direction of rotation around the axis parallel to the display.

54. The method according to any one of claims 52 to 53, wherein displaying the biometric failure animation includes highlighting the boundary of the biometric authentication interface relative to the application interface.

55. The method according to claim 54, the method further comprising: Based on determining that at least a portion of the biometric characteristic does not satisfy the biometric authentication criteria from the biometric data, display a failure interface.

56. The method according to claim 55, wherein the failure interface includes a retry enabling representation, the method further comprising: Receive an input corresponding to a selection of the retry-enabled representation; In response to receiving the input corresponding to the selection of the retry-enabled representation, obtain second biometric data corresponding to at least a portion of a second biometric characteristic from the one or more biometric sensors; And After obtaining the second biometric data corresponding to at least a portion of the second biometric characteristic, based on determining that at least a portion of the second biometric characteristic satisfies second biometric authentication criteria: Provide second authentication information to the application indicating that one or more portions of the second biometric characteristic have satisfied the second biometric authentication criteria.

57. The method according to any one of claims 54 to 56, wherein the failure interface includes a cancellation enabling indication, and the method further comprises: Receive an input corresponding to a selection of the cancel-enabled representation; And In response to receiving the input corresponding to the selection of the cancel-enabled representation, stop displaying the biometric authentication interface.

58. The method according to any one of claims 55 to 57, wherein the failure interface includes an alternative authentication enabling indication, and the method further comprises: Receive an input corresponding to a selection of the alternative authentication-enabled representation; And In response to receiving the input corresponding to the selection of the alternative authentication-enabled representation, display an alternative authentication interface.

59. The method according to claim 58, wherein the alternative authentication interface is an application-level authentication interface, and the method further comprises: Further in response to receiving the input corresponding to the selection of the alternative authentication-enabled representation, stop displaying the biometric authentication interface.

60. The method according to any one of claims 38 to 59, further comprising: Further, based on determining that at least a portion of the biometric characteristic satisfies the biometric authentication criteria from the biometric data, provide a success haptic output indicating that at least a portion of the biometric characteristic satisfies the biometric authentication criteria.

61. The method according to claim 60, the method further comprising: Based on determining that at least a portion of the biometric characteristic does not satisfy the biometric authentication criteria from the biometric data, provide a failure haptic output different from the success haptic output.

62. An electronic device, comprising: One or more biometric sensors; A display; One or more processors; And A memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 38 to 61.

63. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 38 to 61.

64. An electronic device, comprising: One or more biometric sensors; A display; and Apparatus for performing the method according to any one of claims 38 to 61.

65. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 38 to 61.

66. A method, comprising: At an electronic device having a display and one or more biometric sensors: Display an application interface including fillable fields on the display; When displaying the application interface, receive a request to automatically fill the fillable fields of the application interface; and In response to receiving the request to automatically fill the fillable fields of the application interface: Automatically fill the fillable fields with the first type of data according to determining that the fillable fields of the application interface are associated with the first type of data; and Automatically fill the fillable fields with the second type of data according to determining that the fillable fields of the application program are associated with the second type of data and at least a part of the biometric characteristics determined based on the data corresponding to the biometric characteristics obtained from the one or more biometric sensors satisfies the biometric authentication criteria.

67. The method according to claim 66, further comprising, in response to receiving the request to automatically fill the fillable fields of the application interface: Based on determining that the fillable fields of the application are associated with a second type of data and at least a portion of the biometric characteristic does not meet the biometric authentication criteria, forgoing automatically filling the fillable fields with the second type of data.

68. The method according to claim 67, further comprising: Further display an indication that at least a part of the biometric characteristics does not satisfy the biometric authentication criteria according to determining that at least a part of the biometric characteristics based on the data obtained from the one or more biometric sensors does not satisfy the biometric authentication criteria.

69. The method according to any one of claims 66 to 68, wherein: The one or more biometric sensors include a camera; and The data corresponding to the biometric characteristics obtained from the one or more biometric sensors includes biometric data obtained using the camera.

70. The method according to any one of claims 66 to 69, wherein: The biometric characteristic is a face; The data corresponding to the biometric characteristics obtained from the one or more biometric sensors includes biometric data associated with a part of the face; and The biometric authentication criteria includes the requirement that the biometric data associated with the face matches the biometric data associated with an authorized face to satisfy the biometric authentication criteria.

71. The method according to any one of claims 66 to 70, wherein displaying an application interface including fillable fields on the display comprises: Display the fillable fields with a first visual treatment according to the fillable fields being associated with the second type of data; and Display the fillable fields with a second visual treatment different from the first visual treatment according to the fillable fields being associated with the first type of data.

72. The method according to claim 71, wherein the first visual processing includes a first color scheme and the second visual processing includes a second color scheme different from the first color scheme.

73. The method according to any one of claims 71 to 72, wherein the first visual processing includes a biometric authentication interface object associated with the fillable fields.

74. The method according to any one of claims 66 to 73, further comprising: Display a biometric authentication interface when obtaining data corresponding to the biometric characteristics from the one or more biometric sensors.

75. The method according to claim 74, wherein the biometric authentication interface includes a simulated representation of the biometric feature.

76. The method according to any one of claims 74 to 75, wherein displaying the biometric authentication interface includes displaying a biometric authentication animation.

77. The method according to any one of claims 66 to 76, wherein receiving the request for automatically filling at least one fillable field of the application interface includes receiving a selection of an autofill affordance representation displayed on the display of the electronic device.

78. The method according to claim 77, further comprising: Before receiving the request to automatically fill the at least one fillable field, receive a selection of the fillable field; and In response to the selection of the fillable field, display the automatic fill enabling indication.

79. The method according to any one of claims 66 to 76, wherein receiving the request for automatically filling at least one fillable field of the application interface includes receiving a selection of the fillable field.

80. The method according to any one of claims 66 to 79, wherein automatically filling the fillable field occurs in response to the request for automatically filling the fillable field without displaying an input interface.

81. The method according to any one of claims 66 to 76, wherein receiving the request for automatically filling at least one fillable field of the application interface includes receiving a selection of an index corresponding to a candidate input associated with the second type of data.

82. The method according to any one of claims 66 to 76, wherein: Displaying an application interface including fillable fields on the display includes displaying a web page including the fillable fields; and Receiving the request to automatically populate the at least one fillable field of the application interface includes selection of the fillable field of the web page.

83. The method according to claim 81, wherein the selection of the index of the candidate input is a selection of an affordance representation of a software keyboard.

84. The method according to any one of claims 66 to 83, wherein the fillable field is a first fillable field and the application interface includes a second fillable field, and the method further comprises: Based on determining that at least a portion of the biometric characteristic satisfies a biometric authentication criterion according to the data obtained from the one or more biometric sensors, automatically populate a second fillable field with data.

85. The method according to claim 82, wherein the request for automatically filling the fillable field is based on a detection of loading a web page including the fillable field; and The method includes, after responding to the request for automatically filling the fillable field of the application interface: Receive a subsequent request to load the web page; and In response to the subsequent request to load the web page: Based on determining that the subsequent request to load the web page meets authentication retry criteria, attempt biometric authentication to automatically fill the fillable fields in the application interface; and Based on determining that the subsequent request to load the web page does not meet the authentication retry criteria, abandon the attempt to use biometric authentication to automatically fill the fillable fields in the application interface.

86. The method according to claim 85, wherein the authentication retry criteria includes at least one of the following: A requirement that the web page has not been loaded within a predetermined amount of time; or A requirement that the web page has not been loaded during the same session.

87. The method according to any one of claims 66 to 86, wherein the application interface is a first interface generated by the application program, and wherein the application interface further includes a submission affordance associated with the fillable fields, the method further comprising: After automatically populating the fillable field with the first type of data or the second type of data, receive a selection of the submit affordance; And In response to receiving the selection of the submit affordance: Stop displaying the application interface; And Display a second interface generated by the application.

88. The method according to claim 74, further comprising: Based on determining that at least a portion of the biometric characteristic does not satisfy the biometric authentication criterion according to the data corresponding to the biometric characteristic obtained from the one or more biometric sensors, stop displaying the biometric authentication interface.

89. The method according to any one of claims 66 to 88, wherein automatically filling the fillable fields with the second type of data includes: Based on determining that the electronic device has access to a single candidate value of the second type for populating the fillable field, automatically populate the fillable field with the second type of data; And Based on determining that the electronic device has access to multiple candidate values of the second type for automatically populating the fillable field: Display representations of multiple of the multiple candidate values; When displaying the representations of the multiple of the multiple candidate values, receive a selection of the representation of a corresponding candidate value of the multiple candidate values; And Automatically populate the fillable field with the corresponding candidate value.

90. The method according to any one of claims 66 to 88, further comprising: Further in response to the request to automatically populate the fillable field of the application interface and based on determining that the fillable field of the application is associated with the second type of data: Determine whether a plurality of candidate inputs associated with the second type of data are stored on the electronic device; Based on determining that a plurality of candidate inputs associated with the second type of data are stored on the electronic device, display the plurality of candidates; Receive a selection of a candidate input from the plurality of displayed candidate inputs; And In response to receiving the selection of the candidate input, obtain data corresponding to at least a portion of a biometric characteristic from the one or more biometric sensors, wherein automatically populating the fillable field with the second type of data includes automatically populating the fillable field with the selected candidate input.

91. The method according to any one of claims 66 to 90, further comprising: In response to receiving the request to automatically populate the fillable field of the application interface, based on determining that biometric authentication is unavailable, prompt the user for an alternative form of authentication; And After prompting the user for an alternative form of authentication: Receive an alternative form of authentication; And In response to receiving the alternative form of authentication: Based on determining that the alternative form of authentication is consistent with authorized authentication information, automatically populate the fillable field; And Based on determining that the alternative form of authentication is inconsistent with authorized authentication information, refrain from automatically populating the fillable field.

92. The method according to any one of claims 66 to 76, 82, 84, 87 to 88 and 91, further comprising: Detect a selection of the fillable field; And In response to detecting the selection of the fillable field, display an input interface including a plurality of user interface objects corresponding to candidate inputs for the fillable field, wherein receiving the request to automatically fill the fillable field of the application interface includes receiving a selection of a user interface object corresponding to a respective candidate input among the plurality of candidate inputs.

93. The method according to claim 92, further comprising: Based on determining that at least a portion of the biometric feature does not meet the biometric authentication criteria according to the data obtained from the one or more biometric sensors, display an input interface.

94. An electronic device, comprising: One or more biometric sensors; A display; One or more processors; and A memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 66 to 93.

95. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 66 to 93.

96. An electronic device, comprising: One or more biometric sensors; A display; and An apparatus for performing the method according to any one of claims 66 to 93.

97. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 66 to 93.

98. A method, comprising: At an electronic device having a display and one or more biometric sensors: Detect that a device wake-up criterion has been met; In response to detecting that the device wake-up criterion has been met, transition the electronic device from a first visual state to a second visual state; and After transitioning the device to the second visual state: Based on determining that a biometric authentication criterion has been met according to biometric data provided by the one or more biometric sensors, transition the electronic device from the second visual state to a third visual state, wherein the transition from the second visual state to the third visual state is a continuation of the transition from the first visual state to the second visual state; and Based on determining that a biometric authentication criterion has not been met according to biometric data provided by the one or more biometric sensors, maintain the electronic device in the second visual state.

99. The method according to claim 98, wherein the second visual state includes a first introduction screen displayed at a first brightness, and wherein the third visual state includes a second introduction screen at a second brightness higher than the first brightness.

100. The method according to any one of claims 98 to 99, wherein transitioning from the second visual state to the third visual state includes adjusting the size of a first user interface object displayed on the display of the electronic device.

101. The method according to any one of claims 98 to 100, wherein transitioning from the second visual state to the third visual state includes changing the degree of blurriness of a second user interface object displayed on the display of the electronic device.

102. The method according to any one of claims 98 to 101, wherein transitioning from the second visual state to the third visual state includes translating the position of a third user interface object displayed on the display of the electronic device from a first position to a second position.

103. The method according to claim 100, wherein the first user interface object is a lock icon, and adjusting the size of the first user interface object includes increasing the size of the first user interface object.

104. The method according to any one of claims 98 to 103, further comprising: When in the second visual state, display a fourth user interface object indicating the visual state of the electronic device; and Further based on determining that a biometric authentication criterion has not been met according to biometric data provided by the one or more biometric sensors, alternate the position of the fourth user interface object between a first position and a second position.

105. The method according to any one of claims 98 to 103, further comprising: When in the second visual state, display a fifth user interface object indicating the visual state of the electronic device; and Further based on determining that a biometric authentication criterion has been met according to biometric data provided by the one or more biometric sensors, display an unlocking animation including the fifth user interface object, wherein the fifth user interface object has a first state when the electronic device is in the second visual state and a second state when the electronic device is in the third visual state, and wherein the visual state element transitions from the first state to the second state during the unlocking animation.

106. The method according to claim 105, wherein transitioning the device from the second visual state to the third visual state includes outputting a haptic output.

107. The method according to any one of claims 98 to 106, wherein the third visual state corresponds to an unlocked state, and the method further comprises: When in the third visual state, receive a lock input; and In response to receiving the lock input, transition from the third visual state to a locked state.

108. The method according to claim 107, wherein transitioning the device from the third visual state to the locked state includes displaying a lock animation, the lock animation including a sixth user interface object indicative of a visual state of the electronic device, wherein the sixth user interface object has a first appearance when the electronic device is in the third visual state and a second appearance when the electronic device is in the locked state, and wherein the sixth user interface element transitions from the first appearance to the second appearance during the lock animation.

109. The method according to any one of claims 107 to 108, wherein transitioning the device from the third visual state to the locked state includes outputting a haptic output.

110. The method according to any one of claims 98 to 109, comprising: When the device is in an unlocked state, it is detected that a locking condition has been met; And In response to detecting that the locking condition has been met: Based on determining that the locking condition is an explicit locking input, transition the device from the unlocked state to the locked state and output a corresponding locking indication; And Based on determining that the locking condition is an implicit locking condition, transition the device from the unlocked state to the locked state without outputting the corresponding locking indication.

111. The method according to any one of claims 108 to 109, wherein displaying the lock animation includes displaying the current time.

112. The method according to any one of claims 98 to 111, wherein the biometric authentication criteria includes the requirement that the user is looking at the display of the electronic device with a face that is consistent with one or more authorized faces.

113. The method according to claim 112, further comprising: Before detecting that a device wake-up criterion has been met, perform a biometric registration process, wherein during the biometric registration, the device requires that the face being registered should include facial features indicating that the face is looking at the electronic device during the registration of the face in order to continue the biometric registration of the face.

114. The method according to any one of claims 98 to 111, further comprising when determining whether the biometric authentication criteria have been met: Using a first set of criteria as the biometric authentication criteria according to a determination that an optional option of the electronic device is enabled, wherein the first set of criteria includes the requirement that the user's face is looking at the display of the electronic device; and Based on determining that the optional option of the electronic device is not enabled, use a second set of criteria as the biometric authentication criteria, where the second set of criteria does not include the requirement that the user's face is looking directly at the display of the electronic device.

115. The method according to any one of claims 98 to 114, the method further comprising: After detecting that the device wake-up criterion has been met, detect a request to display a biometric authentication settings interface; In response to the request to display the biometric authentication settings interface, display the biometric authentication settings interface; When the biometric authentication settings interface is displayed, receive a first user input corresponding to a request to disable biometric authentication; In response to receiving the first user input, disable biometric authentication; When biometric authentication is disabled and the device is in a locked state, receive a request to unlock the device; And In response to receiving the request to unlock the device, output a prompt for authenticating using an authentication in a different form from the biometric authentication.

116. The method according to any one of claims 98 to 115, wherein when the electronic device is in the first visual state, one or more features of the electronic device are disabled.

117. The method according to claim 116, wherein transitioning to the second visual state includes enabling one or more disabled functions of the electronic device.

118. The method according to any one of claims 98 to 117, the method further comprising: After transitioning to the second visual state: Determine whether a biometric capture criterion is met by the one or more biometric sensors; And Based on determining that the biometric capture criterion is met, provide biometric data associated with biometric features by the one or more biometric sensors.

119. The method according to claim 118, wherein determining whether the biometric capture criteria are met by the one or more biometric sensors includes determining whether the biometric capture criteria are met during a first predetermined amount of time after transitioning to the second visual state.

120. The method according to claim 119, the method further comprising: Based on determining that the biometric capture criterion is not met within a first predetermined amount of time after transitioning to the second visual state, determine whether the biometric capture criterion is met within a second predetermined amount of time after the first predetermined amount of time has elapsed.

121. An electronic device, comprising: One or more biometric sensors; A display; One or more processors; And A memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 98 to 120.

122. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 98 to 120.

123. An electronic device, comprising: One or more biometric sensors; A display; And Apparatus for performing the method according to any one of claims 98 to 120.

124. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 98 to 120.

125. A method, comprising: At an electronic device having a display, a button, and one or more biometric sensors separate from the button: When the electronic device is in a first state in which the corresponding functions of the device are disabled, detect one or more activations of the button; and In response to detecting the one or more activations of the button: Capture biometric data using the one or more biometric sensors separate from the button; Based on determining that the biometric data meets the biometric authentication criteria, convert the electronic device to a second state in which the corresponding function of the device is enabled; And Based on determining that the biometric data does not meet the biometric authentication criteria, maintain the electronic device in the first state and display an indication on the display that biometric authentication has failed.

126. The method according to claim 125, wherein the one or more biometric sensors include a face recognition sensor, and the biometric data corresponds to at least a part of a face.

127. The method according to any one of claims 125 to 126, wherein: The corresponding function of the electronic device is to participate in a transaction, When in the first state, the electronic device is unable to participate in the transaction, and When in the second state, the electronic device is able to participate in the transaction.

128. The method according to claim 127, wherein participating in the transaction includes transmitting security data from the electronic device.

129. The method according to claim 127, wherein: The information enabling the device to participate in the transaction is securely stored in a secure element; When the device is in the first state, the information enabling the device to participate in the transaction cannot be accessed at the device outside the secure element; And When the device is in the second state, the secure element temporarily enables the information enabling the device to participate in the transaction to be accessed at the device outside the secure element.

130. The method according to any one of claims 125 to 128, wherein: The one or more biometric sensors include a camera, and Capturing biometric data includes using the camera to capture the biometric data.

131. The method according to any one of claims 125 to 130, wherein the one or more activations of the button include two presses of the button.

132. The method according to any one of claims 125 to 131, wherein the button has a fixed position relative to the display of the electronic device.

133. The method according to any one of claims 125 to 132, wherein the button is a mechanical button.

134. The method according to any one of claims 125 to 132, wherein the button is a solid-state button.

135. The method according to any one of claims 125 to 134, further comprising: Before detecting the one or more activations of the button, output a prompt for providing the one or more activations of the button.

136. The method according to claim 135, wherein the prompt is displayed on the display of the electronic device, and wherein outputting a prompt to the user to provide one or more activations of the button includes highlighting the prompt relative to one or more elements displayed on the display of the electronic device.

137. The method according to any one of claims 125 to 136, further comprising: In response to detecting the one or more activations of the button: Display a biometric authentication interface that includes a representation of user credentials that are restricted from use without proper biometric authentication.

138. The method according to claim 137, comprising: Before detecting the one or more activations of the button, display a prompt for providing the one or more activations of the button at a first position in the biometric authentication interface on the display; And After displaying the prompt, move the representation of the user credentials from a second position on the display to the first position on the display.

139. The method according to claim 138, wherein moving the representation of the user credentials from the second position to the first position includes displaying a biometric authentication symbol at a portion of the display that is occupied by the user credentials when the user credentials are displayed at the second position.

140. The method according to any one of claims 125 to 139, further comprising: After converting the electronic device to the second state: Maintain the device in the second state for a first predetermined period of time; And After the first predetermined period of time has elapsed, convert the electronic device from the second state to the first state.

141. The method according to any one of claims 125 to 140, wherein the one or more activations of the button are detected while a first application is active on the electronic device, the method further comprising: When the device is in the second state, detect a user input corresponding to a request to exit the first application; And In response to detecting the user input corresponding to the request to exit the first application: Exit the first application; And Convert to the first state.

142. The method according to any one of claims 125 to 141, wherein capturing biometric data with the one or more biometric sensors includes activating the one or more biometric sensors for up to a second predetermined period of time.

143. The method according to any one of claims 125 to 142, further comprising: Further based on determining that the biometric data does not meet the biometric authentication criteria, display an alternative authentication enabling representation.

144. The method according to claim 143, further comprising: After determining that the biometric data does not meet the biometric authentication criteria, detect a selection of the alternative authentication enabling representation; And In response to detecting the selection of the alternative authentication enabling representation, display an alternative authentication interface on the display.

145. The method according to claim 144, wherein the biometric data is first biometric data, and the method further comprises: In response to detecting the selection of the alternative authentication enabling representation: Capture second biometric data using the one or more biometric sensors; Convert the electronic device to the second state based on determining that the second biometric data meets the biometric authentication criteria; And Based on determining that the second biometric data does not meet the biometric authentication criteria, maintain the electronic device in the first state and display the alternative authentication interface on the display.

146. The method according to any one of claims 143 to 145, wherein: The biometric data is first biometric data, and The method includes, after determining that the first biometric data does not meet the biometric authentication criteria: Detect a corresponding user input corresponding to a request to retry biometric authentication; and In response to detecting the user input corresponding to the request to retry biometric authentication: Capture third biometric data using the one or more biometric sensors; Convert the electronic device to the second state in which the corresponding function of the device is enabled based on determining that the third biometric data meets the biometric authentication criteria; And Based on determining that the third biometric data does not meet the biometric authentication criteria, maintain the electronic device in the first state.

147. The method according to claim 146, wherein the user input corresponding to the request for retrying biometric authentication includes one or more activations of the button.

148. The method according to any one of claims 146 to 147, wherein the user input corresponding to the request for retrying biometric authentication includes movement of the electronic device.

149. The method according to any one of claims 125 to 148, further comprising: Detect another activation or multiple activations of the button; Based on determining that the biometric capture criteria are met, capture second biometric data using the one or more biometric sensors separate from the button; and Based on determining that the biometric capture criteria are not met, abandon capturing the second biometric data.

150. The method according to any one of claims 135 to 138, wherein the output of the prompt occurs in response to detecting an external signal of a predetermined type.

151. The method according to any one of claims 135 to 138 and 150, wherein the output of the prompt includes displaying a teaching interface, the teaching interface including a prompt element adjacent to the button.

152. The method according to claim 151, further comprising: Before outputting the prompt, display a tutorial interface including an enabling representation, Wherein outputting the prompt occurs in response to a selection of the enabling representation.

153. The method according to claim 152, wherein the detection of the one or more activations of the button occurs while the tutorial interface is being displayed.

154. The method according to any one of claims 125 to 153, wherein the corresponding function of the device is a function of providing information associated with an action via a short-range communication radio of the electronic device.

155. The method according to any one of claims 125 to 154, wherein the one or more activations of the button occur at least partially when the display of the device is turned off or is displaying a user interface not related to payment.

156. The method according to any one of claims 125 to 149, further comprising: Before detecting the one or more activations of the button: Detect an activation of an enabling representation of a first application, and In response to detecting the activation of the enabling representation of the first application, provide information associated with an action from the first application to a second application; And After converting the electronic device to the second state in which the corresponding function of the device is enabled, use the corresponding function of the electronic device to perform the action based on the information.

157. The method according to claim 156, further comprising: In response to detecting a selection of the enabling representation of the first application, simultaneously display on the display: At least a portion of the information associated with the action at a first location; And A second prompt at a second location for providing the one or more activations of the button, wherein the second location is closer to the button than the first location.

158. The method according to any one of claims 125 to 149, further comprising: Receive a request to continue an action from a second device, wherein the request includes information associated with one or more options selected at the second device; And After converting the electronic device to the second state in which the corresponding function of the device is enabled, use the corresponding function of the device to perform the action based on the information.

159. An electronic device, comprising: Display; Button; One or more biometric sensors separate from the button; One or more processors; And A memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 125 to 158.

160. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display, buttons, and one or more biometric sensors separate from the buttons, the one or more programs including instructions for performing the method according to any one of claims 125 to 158.

161. An electronic device, comprising: A display; Buttons; One or more biometric sensors separate from the buttons; One or more processors; And Apparatus for performing the method according to any one of claims 125 to 158.

162. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having a display, buttons, and one or more biometric sensors separate from the buttons, the one or more programs including instructions for performing the method according to any one of claims 125 to 158.

163. A method, comprising: At an electronic device having one or more biometric sensors: Receiving a first request to perform a corresponding operation that requires authentication; In response to receiving the first request to perform the corresponding operation: Using the one or more biometric sensors to determine whether a biometric authentication criterion is met, wherein the biometric authentication criterion includes the requirement that a corresponding type of biometric characteristic detected by the biometric sensor be an authorized biometric characteristic for performing the corresponding operation; Performing the corresponding operation according to a determination that the biometric authentication criterion is met; and Aborting the performance of the corresponding operation according to a determination that the biometric authentication criterion is not met; After determining that the biometric authentication criterion is not met in response to receiving the first request, receiving a second request to perform the corresponding operation; And In response to receiving the second request to perform the corresponding operation: According to a determination that in response to the first request, the biometric authentication criterion is not met because the one or more biometric sensors did not detect the presence of the corresponding type of biometric characteristic, using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criterion is met; And According to a determination that in response to the first request, the biometric authentication criterion is not met because the one or more biometric sensors detected a corresponding type of biometric characteristic that does not correspond to an authorized biometric characteristic, aborting using the one or more biometric sensors in response to the second request to determine whether the biometric authentication criterion is met.

164. The method according to claim 163, further comprising, after determining that the biometric authentication criteria are not met in response to receiving the first request: Receive a third request for performing the corresponding operation, where the third request is a request of a different type from the first request and the second request; and In response to receiving the third request for performing the corresponding operation, in response to the third request, use the one or more biometric sensors to determine whether the biometric authentication criteria are met.

165. The method according to any one of claims 163 to 164, wherein the device further comprises a display, and the method further comprises: In response to receiving the first request to perform the corresponding operation and according to a determination that the biometric authentication criterion is not met, aborting displaying an indication on the display to re-attempt authentication using the one or more biometric sensors.

166. The method according to any one of claims 163 to 165, wherein determining that the biometric authentication criteria are not met in response to the first request due to the absence of the corresponding type of biometric feature detected by the one or more biometric sensors is determining that the biometric authentication criteria are not met in response to the first request due to the absence of the corresponding type of biometric feature detected by the one or more biometric sensors for at least a pre-determined period of time.

167. The method according to any one of claims 163 to 166, further comprising: In response to receiving the second request to perform the corresponding operation: Prompting for an alternative form of authentication according to a determination that biometric authentication is unavailable.

168. The method according to any one of claims 163 to 167, wherein: The device imposes a corresponding limit on the number of unsuccessful biometric authentication attempts allowed before requiring an alternative form of authentication; and After a predetermined number of requests to perform the corresponding operation have resulted in failed biometric authentication attempts, the device stops using the one or more biometric sensors to determine whether the biometric authentication criterion is met in response to requests to perform the corresponding operation, wherein the predefined number of requests is less than the corresponding limit.

169. The method according to any one of claims 163 to 168, wherein the first request is also a request for performing an operation that does not require biometric authentication, and the method further comprises: In response to receiving the first request, performing the operation that does not require biometric authentication.

170. The method according to any one of claims 163 to 169, wherein the first request is a request for opening a web page.

171. The method according to any one of claims 163 to 170, wherein in response to receiving the second request for performing the corresponding operation, automatically in response to the second request, use the one or more biometric sensors to determine whether the biometric authentication criteria are met.

172. The method according to any one of claims 163 to 171, wherein the one or more biometric sensors are non-contact biometric sensors configured to perform biometric authentication without physical contact from the user.

173. The method according to any one of claims 163 to 172, further comprising: In response to the second request and based on determining that the biometric authentication criteria are met in response to the second request, perform the corresponding operation.

174. The method according to any one of claims 163 to 173, wherein the corresponding operation is to automatically fill one or more fillable fields with credential information.

175. The method according to any one of claims 163 to 173, wherein the corresponding operation is to provide access to restricted content.

176. The method according to any one of claims 163 to 173, wherein the corresponding operation is to convert the electronic device from a locked state to an unlocked state.

177. The method according to any one of claims 163 to 173, wherein the corresponding operation enables the electronic device to participate in a transaction.

178. The method according to any one of claims 163 to 173, wherein the device further comprises a display, and the method further comprises: When using the one or more biometric sensors to determine whether the biometric authentication criteria are met, display an indication on the display that biometric authentication is being performed.

179. An electronic device, comprising: One or more biometric sensors; One or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 163 to 178.

180. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 163 to 178.

181. An electronic device, comprising: One or more biometric sensors; and an apparatus for performing the method according to any one of claims 163 to 178.

182. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 163 to 178.

183. A method, comprising: At an electronic device having one or more biometric sensors: Receive a first request to perform a first operation that requires authentication; In response to receiving the first request to perform the first operation: Use the one or more biometric sensors to determine whether a first biometric authentication criteria is met, wherein the first biometric authentication criteria includes the requirement that the biometric sensor detects a corresponding type of biometric characteristic that is authorized to perform the first operation; Based on determining that the first biometric authentication criteria are met, perform the first operation; and Based on determining that the biometric authentication criteria are not met, refrain from performing the first operation; After performing the first operation, receive a second request to perform a second operation that requires authentication; and In response to receiving the second request: Based on determining that re - authentication criteria have been met, use the one or more biometric sensors to determine whether a second biometric authentication criteria is met, wherein the second biometric authentication criteria includes the requirement that the biometric sensor detects a corresponding type of biometric characteristic that is authorized to perform the second operation; and Based on determining that the re - authentication criteria have not been met, perform the second operation without performing biometric authentication and refrain from using the one or more biometric sensors to determine whether the second biometric authentication criteria are met.

184. The method according to claim 183, wherein the first operation and the second operation occur when the electronic device is in an unlocked state.

185. The method according to any one of claims 183 to 184, further comprising: In response to receiving the second request and based on determining that the second biometric authentication criteria are not met, refrain from performing the second operation.

186. The method according to any one of claims 183 to 185, wherein in response to receiving the second request, the second operation is performed regardless of whether the biometric sensor detects the corresponding type of biometric characteristic authorized to perform the second operation.

187. The method according to any one of claims 183 to 186, wherein: The first operation is to log in to a first web domain; and The second operation is to log in to a second web domain corresponding to the first web domain.

188. The method according to any one of claims 183 to 187, wherein the re - authentication criterion includes the requirement that the device has been in a locked state between when the first operation is performed and when the second request is received.

189. The method according to any one of claims 183 to 188, wherein: Perform the first operation in an application; and The re - authentication criteria includes the requirement that the application has been closed between when the first operation was performed and when the second request was received.

190. The method according to any one of claims 183 to 189, wherein the re - authentication criterion includes the requirement that the application has been in an inactive state for a period exceeding a threshold amount of time between when the first operation is performed and when the second request is received.

191. The method according to any one of claims 183 to 190, wherein in response to receiving the second request for performing the second operation that requires authentication, automatically using the one or more biometric sensors to determine whether the second biometric authentication criterion is met.

192. The method according to any one of claims 183 to 191, wherein the one or more biometric sensors are contactless biometric sensors configured to perform biometric authentication without physical contact from the user.

193. The method according to any one of claims 183 to 192, wherein the electronic device further includes a display, and the method further includes: When using the one or more biometric sensors to determine whether the first biometric authentication criteria or the second biometric authentication criteria are met, display an indication on the display that biometric authentication is being performed.

194. An electronic device, comprising: One or more biometric sensors; One or more processors; and A memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 183 to 193.

195. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 183 to 193.

196. An electronic device, comprising: One or more biometric sensors; and An apparatus for performing the method according to any one of claims 183 to 193.

197. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 183 to 193.

198. A method, comprising: At an electronic device having a display: Receiving a request to display a first portion of corresponding content; and In response to the request to display the first portion of the corresponding content: Displaying at least the first portion of the corresponding content on the display, the corresponding content including an element associated with an authentication operation; Initiating biometric authentication based on determining that the element associated with the authentication operation meets a visibility criterion; and Aborting the initiation of biometric authentication based on determining that the element associated with the authentication operation does not meet the visibility criterion.

199. The method according to claim 198, wherein the first portion of the corresponding content is displayed, while the second portion of the corresponding content is not displayed on the display.

200. The method according to any one of claims 198 to 199, wherein biometric authentication automatically occurs based on determining that the element associated with the authentication operation meets a visibility criterion.

201. The method according to any one of claims 198 to 200, further comprising: Detecting an input while displaying the first portion of the corresponding content; and In response to detecting the input: Initiating biometric authentication based on determining that the input causes the element associated with the authentication operation to meet the visibility criterion; and Aborting the initiation of biometric authentication based on determining that the input does not cause the element associated with the authentication operation to meet the visibility criterion.

202. The method according to claim 201, wherein: The input is a request to perform a zoom operation; and The visibility criterion includes the requirement that the element associated with the authentication operation has a size greater than a threshold size.

203. The method according to claim 201, wherein: The input is a request to perform a scroll operation, and The visibility criterion includes the requirement that at least a predetermined amount of the element associated with the authentication operation is displayed on the display.

204. The method according to claim 201, wherein: The input is a request to perform a hidden interface area display operation; and The visibility criterion includes the requirement that the element associated with the authentication operation is not designated to be displayed in the hidden interface area.

205. The method according to any one of claims 198 to 204, wherein: The electronic device further includes one or more biometric sensors; and Initiating biometric authentication includes using the one or more biometric sensors to initiate biometric authentication.

206. The method according to claim 205, wherein: The one or more biometric sensors include one or more non-contact biometric sensors configured to perform biometric authentication without physical contact from the user; and Initiating biometric authentication occurs without receiving an explicit request to initiate biometric authentication.

207. The method according to any one of claims 205 to 206, wherein: The one or more biometric sensors include one or more facial recognition sensors; and Initiating biometric authentication includes using the one or more facial recognition sensors to determine whether a facial authentication criterion has been met.

208. The method according to claim 205, wherein: The one or more biometric sensors include one or more fingerprint sensors; and Initiating biometric authentication includes: Detecting contact with the one or more fingerprint sensors; and Determining whether the contact meets a fingerprint authentication criterion.

209. The method according to any one of claims 198 to 208, wherein initiating biometric authentication includes displaying a progress indicator on the display indicating the status of the biometric authentication process.

210. The method according to any one of claims 198 to 209, wherein the element associated with the authentication operation is a fillable field, and the method further comprises: In response to initiating biometric authentication: Automatically populating the fillable fields with credential information based on determining that the biometric authentication criterion has been met; and Based on determining that the biometric authentication criteria have not been met, abandon automatically filling the fillable fields with credential information.

211. The method according to any one of claims 198 to 210, further comprising: In response to initiating biometric authentication: Based on determining that the biometric authentication criteria have been met, provide access to restricted content; And Based on determining that the biometric authentication criteria have not been met, abandon providing access to restricted content.

212. The method according to claim 210, wherein the credential information includes login information.

213. The method according to any one of claims 210 and 212, wherein the credential information includes information associated with payment account information.

214. An electronic device, comprising: A display; One or more processors; And A memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 198 to 213.

215. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display, the one or more programs including instructions for performing the method according to any one of claims 198 to 213.

216. An electronic device, comprising: A display; And An apparatus for performing the method according to any one of claims 198 to 213.

217. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having a display, the one or more programs including instructions for performing the method according to any one of claims 198 to 213.

218. A method, comprising: At an electronic device having a display and one or more biometric sensors: Detect a predefined operation corresponding to a credential submission user interface having a credential submission user interface element; And In response to detecting the predefined operation: Based on determining that biometric authentication via the one or more biometric sensors is available, display on the display the credential submission user interface with a visual indication indicating that presenting biometric characteristics that meet the biometric authentication criteria to the one or more biometric sensors will cause submission of credentials via the credential submission user interface element.

219. The method according to claim 218 further comprises: In response to detecting the predefined operation and based on determining that biometric authentication via the one or more biometric sensors is not available, display the credential submission user interface on the display without the visual indication.

220. The method according to any one of claims 218 to 219 further comprises: Further in response to detecting the predefined operation: Based on determining that biometric authentication via the one or more biometric sensors is not available, display on the display a credential submission enabling representation, wherein receiving an input corresponding to a selection of the credential submission enabling representation causes submission of credentials via the credential submission user interface element; And Further based on determining that biometric authentication via the one or more biometric sensors is available, abandon displaying the credential submission enabling representation on the display.

221. The method according to any one of claims 218 to 220 further comprises: When displaying the credential submission user interface: Detect, via the one or more biometric sensors, biometric characteristics of a corresponding type; In response to detecting the biometric characteristics of the corresponding type: Based on determining that the biometric characteristics meet the biometric authentication criteria, submit credentials via the credential submission user interface element; and Based on determining that the biometric characteristics do not meet the biometric authentication criteria, abandon submitting credentials via the credential submission user interface element.

222. The method according to any one of claims 218 to 221, wherein the credential submission user interface element comprises one or more fillable fields.

223. The method according to claim 222, wherein displaying the credential submission user interface comprises displaying the credential submission user interface element pre-filled with the credential to be submitted via the credential submission user interface element.

224. The method according to any one of claims 222 to 223 further comprises: Receive a selection of a fillable field among the one or more fillable fields; And In response to receiving the selection of the fillable field, display a character input interface on the display.

225. The method according to claim 224 further comprises: Receive, via the character input interface, an input corresponding to inputting one or more characters in the fillable field; Subsequent to receiving the input, receive a selection of a second credential submission enabling representation; And In response to receiving the selection of the second credential submission enabling representation, submit the one or more characters in the fillable field for credential verification.

226. The method according to any one of claims 222 to 225, wherein indicating that presenting a biometric characteristic that meets the biometric authentication criteria to the one or more biometric sensors will cause the visual indication of submitting the credential via the credential submission user interface element to be displayed in a fillable field of the one or more fillable fields.

227. The method according to any one of claims 218 to 226, wherein the predefined operation is a request to display the credential submission interface on the display.

228. The method according to any one of claims 218 to 227, wherein the predefined operation is detected when the credential submission interface is displayed and the predefined operation includes an input pointing to a part of the credential submission user interface.

229. The method according to claim 224, further comprising: Provide a first result based on submitting the one or more characters in the fillable field for credential verification and in response to receiving the selection of the second credential submission enabling representation; and Provide the first result based on submitting credentials via the credential submission user interface element and in response to determining that biometric characteristics detected via the one or more biometric sensors meet the biometric authentication criteria.

230. An electronic device, comprising: A display; One or more biometric sensors; One or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 218 to 229.

231. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 218 to 229.

232. An electronic device, comprising: A display; One or more biometric sensors; and An apparatus for performing the method according to any one of claims 218 to 229.

233. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for performing the method according to any one of claims 218 to 229.

Images