Implementation of biometric authentication

Abstract

To provide electronic devices with faster, more efficient methods and interfaces for implementing biometric authentication.SOLUTION: A method for implementing biometric authentication on an electronic device with a display and one or more biometric sensors includes: receiving a request to perform an operation that requires authentication; in response to the request, performing user authentication; when the authentication is successful, performing the operation; when the authentication is not successful and when a set of error condition criteria is met, displaying, through the display, an indication of positions of the one or more biometric sensor; and forgoing performing the operation. The indication includes graphical indicators displayed in positions located at a first distance from a first end and at a second distance from a second end of the electronic device. The first end corresponds to positions of the one or more biometric sensors. The second end is opposite to the first end. The second distance is larger than the first distance.SELECTED DRAWING: Figure 8A

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. patent application Ser. No. 16 / 369,355, filed March 29, 2019, entitled "Biometric Authentication Implementations," U.S. patent application Ser. No. 62 / 752,234, filed October 29, 2018, entitled "Biometric Authentication Implementations," and U.S. patent application Ser. No. 62 / 679,955, filed June 3, 2018, entitled "Biometric Authentication Implementations."

[0002] [Technical field] The present disclosure relates generally to biometric authentication, and more particularly to interfaces and techniques for enrolling and authenticating biometric characteristics. [Background technology]

[0003] Biometric authentication using an electronic device, for example, face, iris, or fingerprint, is a convenient and efficient way to authenticate users of the electronic device. Biometric authentication allows a device to quickly and easily verify the identities of any number of users. Summary of the Invention

[0004] However, some techniques for implementing biometric authentication using electronic devices are generally cumbersome. When a user is unable to enroll a biometric feature for biometric authentication or is unable to perform biometric authentication, the user is often unaware of the underlying cause of the failure. Thus, the user may be prevented from using biometric authentication altogether. Furthermore, when a user enrolls a biometric feature or performs a further attempt to perform biometric authentication after a failure, the user often performs the biometric authentication without the knowledge to correct the underlying cause of the failure. In light of the above drawbacks, existing techniques take longer than necessary, wasting both the user's time and the device's energy. This latter problem is particularly significant in the operation of battery-operated devices.

[0005] The present techniques thus provide electronic devices with faster and more efficient methods and interfaces for performing biometric authentication. Such methods and interfaces optionally complement or replace other methods for performing biometric authentication. Such methods and interfaces reduce the cognitive burden on users and create a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and extend the time between battery charges. Such methods and interfaces also reduce the number of unnecessary, redundant, or repetitive inputs required in computing devices such as smartphones and smartwatches.

[0006] According to some embodiments, a method is described, at an electronic device having a display and one or more input devices, the method including: receiving, via the one or more input devices, a request to perform an operation requiring authentication; in response to the request to perform the operation requiring authentication, performing the operation in accordance with a determination that the authentication is successful; and, in accordance with a determination that the authentication is not successful and a set of error condition criteria is met, displaying on the display an indication of an error condition, the indication including information regarding a cause of the error condition; and forgoing performing the operation.

[0007] According to some embodiments, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, the one or more programs including instructions to: receive, via the one or more input devices, a request to perform an operation requiring authentication; in response to the request to perform the operation requiring authentication, perform the operation in accordance with a determination that the authentication is successful; and, in accordance with a determination that the authentication is not successful and a set of error condition criteria is met, display an indication of an error condition on the display, the indication including information regarding a cause of the error condition; and forgo performing the operation.

[0008] According to some embodiments, a temporary computer-readable medium is described, the temporary computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, the one or more programs including instructions to: receive, via the one or more input devices, a request to perform an operation requiring authentication; in response to the request to perform the operation requiring authentication, perform the operation in accordance with a determination that the authentication is successful; and, in accordance with a determination that the authentication is not successful and a set of error condition criteria is met, display an indication of an error condition on the display, the indication including information regarding a cause of the error condition; and forgo performing the operation.

[0009] According to some embodiments, an electronic device is described, the electronic device comprising: one or more input devices; a display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions to: receive, via the one or more input devices, a request to perform an operation requiring authentication; in response to the request to perform the operation requiring authentication, perform the operation in accordance with a determination that the authentication is successful; and, in accordance with a determination that the authentication is not successful and a set of error condition criteria is met, display an indication of an error condition on the display, the indication including information regarding a cause of the error condition; and forgo performing the operation.

[0010] According to some embodiments, an electronic device is described, the electronic device comprising: one or more input devices; a display; means for receiving, via the one or more input devices, a request to perform an operation requiring authentication; and means for, in response to the request to perform the operation requiring authentication, performing the operation in accordance with a determination that the authentication is successful; and, in accordance with a determination that the authentication is not successful and a set of error condition criteria is met, displaying an indication of an error condition on the display, the indication including information regarding a cause of the error condition; and forgoing performing the operation.

[0011] According to some embodiments, a method is described, the method including: detecting, in an electronic device having a display and a biometric sensor at a first portion of the electronic device, the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; and displaying an error indication on the display in response to detecting the presence of the error condition, the error indication being displayed at a position proximate to the first portion of the electronic device, the error indication including: displaying the error indication at a first position within a user interface proximate to the first portion of the electronic device in accordance with a determination that a user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second position within the user interface proximate to the first portion of the electronic device in accordance with a determination that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation.

[0012] According to some embodiments, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and a biometric sensor at a first portion of the electronic device, the one or more programs comprising instructions for: detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; and, in response to detecting the presence of the error condition, displaying an error indication on the display, the error indication being displayed at a location proximate to the first portion of the electronic device, including: displaying the error indication at a first location within the user interface proximate to the first portion of the electronic device in accordance with a determination that a user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location within the user interface proximate to the first portion of the electronic device in accordance with a determination that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation.

[0013] According to some embodiments, a temporary computer-readable medium is described, the temporary computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and a biometric sensor located at a first portion of the electronic device, the one or more programs comprising instructions for: detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; and, in response to detecting the presence of the error condition, displaying an error indication on the display, the error indication being displayed at a location proximate to the first portion of the electronic device, including: displaying the error indication at a first location within the user interface proximate to the first portion of the electronic device in accordance with a determination that a user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location within the user interface proximate to the first portion of the electronic device in accordance with a determination that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation.

[0014] According to some embodiments, an electronic device is described, the electronic device comprising: a biometric sensor at a first portion of the electronic device; a display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; and, in response to detecting the presence of the error condition, displaying an error indication on the display, the error indication being displayed at a location proximate to the first portion of the electronic device, the error indication including: displaying the error indication at a first location within a user interface proximate to the first portion of the electronic device in accordance with a determination that a user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location within the user interface proximate to the first portion of the electronic device in accordance with a determination that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation.

[0015] According to some embodiments, an electronic device is described comprising: a biometric sensor at a first portion of the electronic device; a display; means for detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; and means for displaying an error indication on the display in response to detecting the presence of the error condition, the error indication being displayed at a location proximate to the first portion of the electronic device, the error indication including: displaying the error indication at a first location within a user interface proximate to the first portion of the electronic device in accordance with a determination that a user interface of the electronic device is in a first orientation relative to the biometric sensor; and displaying the error indication at a second location within the user interface proximate to the first portion of the electronic device in accordance with a determination that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation.

[0016] According to some embodiments, a method is described in an electronic device having a display and one or more biometric sensors, the method including: displaying a biometric enrollment user interface on the display that initiates biometric enrollment on the one or more biometric sensors; receiving, while displaying the biometric enrollment user interface, an input corresponding to a request to initiate biometric enrollment; in response to receiving the input, initiating a process of enrolling biometric features on the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; and, in accordance with a determination that the orientation of the electronic device does not satisfy the set of enrollment criteria, outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

[0017] According to some embodiments, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for: displaying a biometric enrollment user interface on the display for initiating biometric enrollment on the one or more biometric sensors; receiving, while displaying the biometric enrollment user interface, an input corresponding to a request to initiate biometric enrollment; in response to receiving the input, initiating a process for enrolling biometric features on the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; and in accordance with a determination that the orientation of the electronic device does not satisfy the set of enrollment criteria, outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

[0018] According to some embodiments, a temporary computer-readable medium is described, the temporary computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biometric sensors, the one or more programs including instructions for: displaying a biometric enrollment user interface on the display for initiating biometric enrollment on the one or more biometric sensors; receiving, while displaying the biometric enrollment user interface, an input corresponding to a request to initiate biometric enrollment; in response to receiving the input, initiating a process for enrolling biometric features on the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; and in accordance with a determination that the orientation of the electronic device does not satisfy the set of enrollment criteria, outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

[0019] According to some embodiments, an electronic device is described, the electronic device comprising: one or more biometric sensors; a display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying a biometric enrollment user interface on the display for initiating biometric enrollment on the one or more biometric sensors; receiving, while displaying the biometric enrollment user interface, an input corresponding to a request to initiate biometric enrollment; in response to receiving the input, initiating a process for enrolling biometric features on the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; and in accordance with a determination that the orientation of the electronic device does not satisfy the set of enrollment criteria, outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

[0020] According to some embodiments, an electronic device is described that includes one or more biometric sensors; a display; means for displaying a biometric enrollment user interface on the display that initiates biometric enrollment on the one or more biometric sensors; means for receiving input corresponding to a request to initiate biometric enrollment while displaying the biometric enrollment user interface; and means for, in response to receiving the input, initiating a process of enrolling biometric features on the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; and, in accordance with a determination that the orientation of the electronic device does not satisfy the set of enrollment criteria, outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria.

[0021] According to some embodiments, a method is described in an electronic device having a biometric sensor and a touch-sensitive display, the method including: detecting the occurrence of an error condition for detecting biometric information in the biometric sensor; responsive to detecting the occurrence of the error condition, displaying an indication of a location of the biometric sensor on the electronic device on the touch-sensitive display; detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; responsive to detecting the request to unlock the electronic device using the biometric sensor, ceasing to display the indication of the location of the biometric sensor in accordance with a determination that the error condition is still occurring at each time occurring after detecting the request to unlock the electronic device; displaying a touch-based user interface for entering touch-based authentication information; and responsive to determining that the error condition is no longer occurring, attempting to unlock the electronic device using the biometric sensor.

[0022] According to some embodiments, a non-transitory computer-readable medium is described, the non-transitory computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a biometric sensor and a touch-sensitive display, the one or more programs including instructions for detecting the occurrence of an error condition in the biometric sensor for detecting biometric information; displaying an indication of the location of the biometric sensor on the touch-sensitive display in response to detecting the occurrence of the error condition; detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; in response to detecting the request to unlock the electronic device using the biometric sensor, ceasing to display the indication of the location of the biometric sensor in accordance with a determination that the error condition is still occurring at each time occurring after detecting the request to unlock the electronic device; displaying a touch-based user interface for entering touch-based authentication information; and in accordance with a determination that the error condition is no longer occurring, attempting to unlock the electronic device using the biometric sensor.

[0023] According to some embodiments, a temporary computer-readable medium is described, the temporary computer-readable storage medium comprising one or more programs configured to be executed by one or more processors of an electronic device having a biometric sensor and a touch-sensitive display, the one or more programs including instructions for detecting the occurrence of an error condition in the biometric sensor for detecting biometric information; displaying an indication of the location of the biometric sensor on the electronic device on the touch-sensitive display in response to detecting the occurrence of the error condition; detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; in response to detecting the request to unlock the electronic device using the biometric sensor, ceasing to display the indication of the location of the biometric sensor in accordance with a determination that the error condition is still occurring at each time occurring after detecting the request to unlock the electronic device; displaying a touch-based user interface for entering touch-based authentication information; and in accordance with a determination that the error condition is no longer occurring, attempting to unlock the electronic device using the biometric sensor.

[0024] According to some embodiments, an electronic device is described, the electronic device comprising: a biometric sensor; a touch-sensitive display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting the occurrence of an error condition in the biometric sensor for detecting biometric information; responsive to detecting the occurrence of the error condition, displaying an indication of a location of the biometric sensor on the electronic device on the touch-sensitive display; detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; responsive to detecting the request to unlock the electronic device using the biometric sensor, ceasing to display the indication of the location of the biometric sensor in accordance with a determination that the error condition is still occurring at each time occurring after detecting the request to unlock the electronic device; displaying a touch-based user interface for entering touch-based authentication information; and responsive to a determination that the error condition is no longer occurring, attempting to unlock the electronic device using the biometric sensor.

[0025] According to some embodiments, an electronic device is described comprising: a biometric sensor; a touch-sensitive display; means for detecting the occurrence of an error condition for detecting biometric information at the biometric sensor; means for displaying an indication of a location of the biometric sensor on the electronic device on the touch-sensitive display in response to detecting the occurrence of the error condition; means for detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; and means for detecting the request to unlock the electronic device using the biometric sensor in response to detecting the request to unlock the electronic device: ceasing to display the indication of the location of the biometric sensor in accordance with a determination that the error condition is still occurring at each time occurring after detecting the request to unlock the electronic device; displaying a touch-based user interface for entering touch-based authentication information; and means for attempting to unlock the electronic device using the biometric sensor in accordance with a determination that the error condition is no longer occurring.

[0026] Executable instructions to perform these functions are optionally contained in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions to perform these functions are optionally contained in a transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0027] Thus, devices are provided that have faster and more efficient methods and interfaces for performing biometric authentication, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices, which optionally complement or replace other methods of performing biometric authentication. [Brief explanation of the drawings]

[0028] For a better understanding of the various embodiments described, reference should be made to the following detailed description in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout the drawings, in which:

[0029] [Figure 1A] 1 is a block diagram illustrating a portable multifunction device having a touch-sensitive display in accordance with some embodiments.

[0030] [Figure 1B] FIG. 2 is a block diagram illustrating exemplary components for event processing according to some embodiments.

[0031] [Figure 1C] FIG. 1 is a block diagram illustrating exemplary components for generating a tactile output, according to some embodiments.

[0032] [Figure 2] FIG. 1 illustrates a portable multifunction device with a touch screen in accordance with some embodiments.

[0033] [Figure 3] FIG. 1 is a block diagram of an exemplary multifunction device having a display and a touch-sensitive surface in accordance with some embodiments.

[0034] [Figure 4A] 1 illustrates an exemplary user interface for a menu of applications on a portable multifunction device in accordance with some embodiments.

[0035] [Figure 4B] 1A-1C illustrate exemplary user interfaces for multifunction devices having a touch-sensitive surface separate from a display in accordance with some embodiments.

[0036] [Figure 4C] FIG. 10 illustrates an exemplary tactile output pattern having a particular waveform, according to some embodiments. [Figure 4D] FIG. 10 illustrates an exemplary tactile output pattern having a particular waveform, according to some embodiments. [Figure 4E] FIG. 10 illustrates an exemplary tactile output pattern having a particular waveform, according to some embodiments. [Figure 4F] FIG. 10 illustrates an exemplary tactile output pattern having a particular waveform, according to some embodiments. [Figure 4G] FIG. 10 illustrates an exemplary tactile output pattern having a particular waveform, according to some embodiments. [Figure 4H] FIG. 10 illustrates an exemplary tactile output pattern having a particular waveform, according to some embodiments.

[0037] [Figure 5A] FIG. 1 illustrates a personal electronic device according to some embodiments.

[0038] [Figure 5B] FIG. 1 is a block diagram illustrating a personal electronic device according to some embodiments.

[0039] [Figure 5C] FIG. 1 illustrates exemplary components of a personal electronic device having a touch-sensitive display and an intensity sensor in accordance with some embodiments. [Figure 5D] FIG. 1 illustrates exemplary components of a personal electronic device having a touch-sensitive display and an intensity sensor in accordance with some embodiments.

[0040] [Figure 5E] FIG. 1 illustrates exemplary components and a user interface of a personal electronic device according to some embodiments. [Figure 5F] FIG. 1 illustrates exemplary components and a user interface of a personal electronic device according to some embodiments. [Figure 5G]FIG. 1 illustrates exemplary components and a user interface of a personal electronic device according to some embodiments. [Figure 5H] FIG. 1 illustrates exemplary components and a user interface of a personal electronic device according to some embodiments.

[0041] [Figure 6] FIG. 1 illustrates exemplary devices connected via one or more communication channels, according to some embodiments.

[0042] [Figure 7A] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7B] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7C] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7D] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7E] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7F] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7G] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7H] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7I]FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7J] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7K] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7L] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7M] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7N] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7O] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7P] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7Q] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7R] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7S] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7T] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7U] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7V] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7W] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7X] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7Y] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7Z] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7AA] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7AB] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7AC] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments. [Figure 7AD] FIG. 10 illustrates an exemplary user interface that provides an indication of an error condition during biometric authentication, according to some embodiments.

[0043] [Figure 8A] FIG. 1 is a flow diagram illustrating a method for providing an indication of an error condition during biometric authentication, according to some embodiments. [Figure 8B]FIG. 1 is a flow diagram illustrating a method for providing an indication of an error condition during biometric authentication, according to some embodiments.

[0044] [Figure 9A] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9B] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9C] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9D] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9E] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9F] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9G] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9H] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9I] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9J] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9K]FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9L] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9M] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9N] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9O] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9P] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9Q] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9R] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9S] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9T] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 9U] FIG. 10 illustrates an example user interface that provides an indication regarding a biometric sensor during biometric authentication, according to some embodiments.

[0045] [Figure 10A] FIG. 1 is a flow diagram illustrating a method for providing an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 10B] FIG. 1 is a flow diagram illustrating a method for providing an indication regarding a biometric sensor during biometric authentication, according to some embodiments. [Figure 10C] FIG. 1 is a flow diagram illustrating a method for providing an indication regarding a biometric sensor during biometric authentication, according to some embodiments.

[0046] [Figure 11A] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11B] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11C] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11D] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11E] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11F] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11G] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11H] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11I] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11J] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11K] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11L] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11M] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11N] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11O] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11P] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11Q] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11R] FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments. [Figure 11S]FIG. 10 illustrates an exemplary user interface for orienting a device to enroll a biometric feature, according to some embodiments.

[0047] [Figure 12A] FIG. 1 is a flow diagram illustrating a method for orienting a device to enroll biometric features, according to some embodiments. [Figure 12B] FIG. 1 is a flow diagram illustrating a method for orienting a device to enroll biometric features, according to some embodiments. [Figure 12C] FIG. 1 is a flow diagram illustrating a method for orienting a device to enroll biometric features, according to some embodiments.

[0048] [Figure 13A] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13B] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13C] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13D] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13E] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13F] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13G] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13H] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13I] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13J] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13K] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13L] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13M] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13N] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13O] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13P] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13Q] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13R] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13S] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13T] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13U] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13V] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13W] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13X] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13Y] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 13Z] FIG. 10 illustrates an exemplary user interface that provides an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments.

[0049] [Figure 14A] FIG. 1 is a flow diagram illustrating a method for providing an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. [Figure 14B] FIG. 1 is a flow diagram illustrating a method for providing an indication of the location of a biometric sensor to correct a detected error condition, according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0050] The following description describes example methods, parameters, etc. However, it should be recognized that such description is not intended as a limitation on the scope of the present disclosure, but is instead provided as a description of example embodiments.

[0051] There is a need for an electronic device that provides an efficient method and interface for performing biometric authentication of a biometric feature. For example, there is a need for an electronic device that provides a convenient and efficient method for enrolling one or more portions of a biometric feature. In another example, there is a need for an electronic device that provides a quick and intuitive technique for selectively accessing secure data pursuant to a biometric authentication. In another example, there is a need for an electronic device that provides a quick and intuitive technique for enabling device functionality pursuant to a biometric authentication. Such techniques can reduce the cognitive burden on a user enrolling a biometric feature and / or performing a biometric authentication with the device, thereby improving overall productivity. Furthermore, such techniques can reduce processor and battery power that would otherwise be wasted on redundant user input.

[0052] Below, FIGS. 1A-1C, 2, 3, 4A-4B, and 5A-5H provide a description of an example device that performs techniques for implementing biometric authentication. FIG. 6 illustrates an example device connected via one or more communication channels, according to some embodiments. FIGS. 7A-7AD illustrate an example user interface for providing an indication of an error condition during biometric authentication. FIGS. 8A-8B are a flow diagram illustrating a method for providing an indication of an error condition during biometric authentication. The user interfaces of FIGS. 7A-7AD are used to illustrate processes described below, including the processes of FIGS. 8A-8B. FIGS. 9A-9U illustrate an example user interface for providing an indication related to a biometric sensor during biometric authentication. FIGS. 10A-10C are a flow diagram illustrating a method for providing an indication related to a biometric sensor during biometric authentication. The user interfaces of FIGS. 9A-9U are used to illustrate processes described below, including the processes of FIGS. 10A-10C. FIGS. 11A-11S illustrate an example user interface for orienting a device to register a biometric feature. 12A-12C are flow diagrams illustrating a method for orienting a device to enroll a biometric feature. The user interfaces of FIGS. 11A-11S are used to illustrate processes described below, including the processes of FIGS. 12A-12C. FIGS. 13A-13Z illustrate exemplary user interfaces that provide an indication of the position of a biometric sensor to correct a detected error condition. FIGS. 14A-14B are flow diagrams illustrating a method for providing an indication of the position of a biometric sensor to correct a detected error condition. The user interfaces of FIGS. 13A-13Z are used to illustrate processes described below, including the processes of FIGS. 14A-14B.

[0053] In the following description, terms such as "first" and "second" are used to describe various elements, but these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, a first touch can be referred to as a second touch, and similarly, a second touch can be referred to as a first touch, without departing from the scope of the various embodiments described. Although a first touch and a second touch are both touches, they are not the same touch.

[0054] The terminology used in the description of the various embodiments set forth herein is for the purpose of describing particular embodiments only and is not intended to be limiting. In the description of the various embodiments set forth and in the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. Also, as used herein, the term "and / or" should be understood to refer to and include any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms "includes," "including," "comprises," and / or "comprising," as used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0055] The term "if" is interpreted, optionally, depending on the context, to mean "when" or "upon," or "in response to determining" or "in response to detecting." Similarly, the phrase "if it is determined" or "if [a stated condition or event] is detected" is interpreted, optionally, depending on the context, to mean "upon determining" or "in response to determining," or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]."

[0056] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as PDA and / or music player functions. Exemplary embodiments of portable multifunction devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Optionally, other portable electronic devices, such as laptops or tablet computers having a touch-sensitive surface (e.g., a touchscreen display and / or touchpad), are also used. It should also be understood that in some embodiments, the device is not a portable communication device, but rather a desktop computer having a touch-sensitive surface (e.g., a touchscreen display and / or touchpad).

[0057] In the following discussion, electronic devices are described that include a display and a touch-sensitive surface, however, it should be understood that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse, and / or a joystick.

[0058] The device typically supports a variety of applications such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0059] Various applications running on the device optionally use at least one common physical user-interface device, such as a touch-sensitive surface. One or more features of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or changed for each application and / or within each application. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports various applications with user interfaces that are intuitive and transparent to the user.

[0060] Attention now turns to embodiments of portable devices with touch-sensitive displays. FIG. 1A is a block diagram illustrating portable multifunction device 100 having touch-sensitive display system 112, according to some embodiments. Touch-sensitive display 112 may conveniently be referred to as a "touch screen" and may also be known or referred to as a "touch-sensitive display system." Device 100 includes memory 102 (optionally including one or more computer-readable storage media), memory controller 122, one or more processing units (CPUs) 120, peripherals interface 118, RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, input / output (I / O) subsystem 106, other input control devices 116, and external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 that detect the intensity of a contact on device 100 (e.g., a touch-sensitive surface, such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 that generate tactile output on device 100 (e.g., generate tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0061] As used herein and in the claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or a proxy for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four distinct values ​​and more typically includes hundreds (e.g., at least 256) distinct values. The intensity of a contact is optionally determined (or measured) using various techniques and various sensors or combinations of sensors. For example, one or more force sensors under or adjacent to the touch-sensitive surface are optionally used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the capacitance of the touch-sensitive surface proximate the contact, and / or the resistance and / or change in the capacitance of the touch-sensitive surface proximate the contact are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the surrogate measurement for contact force or pressure is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is stated in units corresponding to the surrogate measurement). In some implementations, the surrogate measurement for contact force or pressure is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of contact as an attribute of user input may, in some circumstances, enable a user to access additional device functionality that would not otherwise be accessible to a user on a reduced-size device with a limited area for displaying affordances (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls such as knobs or buttons).

[0062] As used herein and in the claims, the term “tactile output” refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, that will be detected by a user with the user's sense of touch. For example, in a situation where a device or a component of a device is in contact with a touch-sensitive surface of a user (e.g., the fingers, palm, or other part of the user's hand), the tactile output produced by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical property of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a “downclick” or “upclick” of a physical actuator button. In some cases, a user feels a tactile sensation such as a “downclick” or “upclick” even when there is no movement of a physical actuator button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's action. As another example, movement of a touch-sensitive surface is optionally interpreted or perceived by a user as "roughness" of the touch-sensitive surface, even when there is no change in the smoothness of the touch-sensitive surface. While such user interpretation of touch depends on the user's personal sensory perception, there are many sensory perceptions of touch that are common to the majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "upclick," "downclick," "roughness"), unless otherwise specified, the generated tactile output corresponds to a physical displacement of the device, or a component of the device, that produces the described sensory perception for a typical (or average) user.Using tactile output to provide haptic feedback to the user improves usability of the device, provides a more efficient user-device interface (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the device), and additionally reduces power usage and improves the device's battery life by allowing the user to use the device more quickly and efficiently.

[0063] In some embodiments, the tactile output pattern specifies characteristics of the tactile output, such as the amplitude of the tactile output, the shape of the movement waveform of the tactile output, the frequency of the tactile output, and / or the duration of the tactile output.

[0064] When tactile outputs having different tactile output patterns are generated by a device (e.g., via one or more tactile output generators that move a movable mass to generate the tactile output), the tactile outputs can induce different tactile sensations to a user holding or touching the device. When a user's sensation is based on the user's perception of the tactile output, most users are able to distinguish changes in waveform, frequency, and amplitude of the tactile output generated by the device. Thus, the waveform, frequency, and amplitude can be adjusted to indicate to the user that different actions have been performed. Thus, in some situations, tactile output having a tactile output pattern designed, selected, and / or developed to simulate the properties (e.g., size, material, weight, stiffness, smoothness, etc.), behaviors (e.g., vibration, displacement, acceleration, rotation, expansion, etc.), and / or interactions (e.g., collision, adhesion, repulsion, attraction, friction, etc.) of objects in a given environment (e.g., a user interface including graphical features and objects, a simulated physical environment having virtual boundaries and virtual objects, an actual physical environment having physical boundaries and physical objects, and / or any combination of the above) provides useful feedback to the user that reduces input errors and increases the efficiency of the user's operation of the device. Additionally, the tactile output is optionally generated to correspond to feedback unrelated to simulated physical properties, such as input thresholds or object selection. In some situations, such tactile output provides useful feedback to the user that reduces input errors and increases the efficiency of the user's operation of the device.

[0065] In some embodiments, a tactile output having a suitable tactile output pattern serves as a cue to the occurrence of an event of interest behind the scenes in a user interface or device. Examples of events of interest include activation of an affordance provided on the device or in the user interface (e.g., a real or virtual button, or a toggle switch), success or failure of a requested action, reaching or crossing a boundary in the user interface, entering a new state, switching input focus between objects, activating a new mode, reaching or crossing an input threshold, detection or recognition of a type of input or gesture, etc. In some embodiments, a tactile output is provided to serve as a warning or alert of an impending event or outcome that will occur unless a redirection or interrupting input is detected in a timely manner. Tactile output is also used in other contexts to enhance the user experience, improve the accessibility of a device for users with visual or motor impairments or other accessibility needs, and / or improve the efficiency and functionality of the user interface and / or device. The tactile output, optionally accompanied by an audio output and / or a change in the visible user interface, further enhances the user's experience when interacting with the user interface and / or device, facilitates better communication of information about the state of the user interface and / or device, reduces input errors, and increases the efficiency of the user's operation of the device.

[0066] 4C-4E provide a set of sample tactile output patterns that can be used individually or in combination, either as is or through one or more variations (e.g., modulation, amplification, truncation, etc.), to create suitable tactile feedback for a variety of scenarios and purposes, such as those described above and with respect to the user interfaces and methods discussed herein. This example palette of tactile outputs illustrates how a set of three waveforms and eight frequencies can be used to create an array of tactile output patterns. In addition to the tactile output patterns shown in this figure, each of these tactile output patterns is optionally adjusted in amplitude by varying the gain value for the tactile output pattern, as shown, for example, in FIGS. 4F-4H for FullTap 80 Hz, FullTap 200 Hz, MiniTap 80 Hz, MiniTap 200 Hz, MicroTap 80 Hz, and MicroTap 200 Hz, shown with gain variations of 1.0, 0.75, 0.5, and 0.25, respectively. As shown in Figures 4F-4H, varying the gain of the tactile output pattern varies the amplitude of the pattern without changing the frequency or waveform shape of the pattern. In some embodiments, varying the frequency of the tactile output pattern results in lower amplitudes because some tactile output generators are limited by how much force they can apply to a moving mass; thus, the greater the frequency movement of the mass, the lower the amplitude is constrained to ensure that the acceleration required to create the waveform does not require forces outside the operating force range of the tactile output generator (e.g., the peak amplitudes of full taps at 230 Hz, 270 Hz, and 300 Hz are lower than the amplitudes of full taps at 80 Hz, 100 Hz, 125 Hz, and 200 Hz).

[0067] 4C-4H illustrate tactile output patterns having particular waveforms. The waveforms of the tactile output patterns represent a relationship between the physical displacement relative to a neutral position (e.g., xzero) and the time traversed by the moving mass to generate a tactile output having that tactile output pattern. For example, a first set of tactile output patterns (e.g., "full tap" tactile output patterns) shown in FIG. 4C each have waveforms that include two complete cycles of vibration (e.g., vibrations that start and end at a neutral position and cross the neutral position three times). A second set of tactile output patterns (e.g., "mini tap" tactile output patterns) shown in FIG. 4D each have waveforms that include one complete cycle (e.g., vibrations that start and end at a neutral position and cross the neutral position once). A third set of tactile output patterns (e.g., "micro tap" tactile output patterns) shown in FIG. 4E each have waveforms that include one-half of a complete cycle (e.g., vibrations that start and end at a neutral position and do not cross the neutral position). The waveform of the tactile output pattern also includes a start buffer and an end buffer, which represent the gradual acceleration and deceleration of the movable mass at the beginning and end of the tactile output. The example waveforms shown in Figures 4C-4H include xmin and xmax values, which represent the maximum and minimum range of motion of the movable mass. For larger electronic devices with larger movable masses, there may be larger or smaller minimum and maximum ranges of motion of the mass. While the examples shown in Figures 4C-4H describe the movement of the mass in one dimension, similar principles should apply to the movement of the movable mass in two or three dimensions.

[0068] As shown in FIGS. 4C-4E, each tactile output pattern also has a corresponding characteristic frequency that affects the tactile "pitch" felt by the user from a tactile output having that characteristic frequency. For continuous tactile outputs, the characteristic frequency represents the number of cycles (e.g., cycles per second) completed by the moving mass of the tactile output generator within a given time period. For discrete tactile outputs, discrete output signals (e.g., having 0.5, 1, or 2 cycles) are generated, and the characteristic frequency value specifies how fast the moving mass must move to generate a tactile output having that characteristic frequency. As shown in FIGS. 4C-4H, for each type of tactile output (defined by a respective waveform, such as a full tap, mini tap, or micro tap), a higher frequency value corresponds to faster movement by the moving mass and therefore generally corresponds to a shorter time to complete the tactile output (e.g., the time to complete the number of cycles required for the discrete tactile output plus the start and end buffer times). For example, a full tap with a characteristic frequency of 80 Hz takes longer to complete than a full tap with a characteristic frequency of 100 Hz (e.g., 35.4 ms vs. 28.3 ms in FIG. 4C ). Additionally, for a given frequency, a tactile output with more cycles in its waveform at each frequency takes longer to complete than a tactile output with fewer cycles in its waveform at the same respective frequency. For example, a full tap at 150 Hz takes longer to complete than a mini-tap at 150 Hz (e.g., 19.4 ms vs. 12.8 ms), which in turn takes longer to complete than a micro-tap at 150 Hz (e.g., 12.8 ms vs. 9.4 ms). However, for tactile output patterns with different frequencies, this rule may not hold true (e.g., a tactile output with more cycles but a higher frequency may take a shorter amount of time to complete than a tactile output with fewer cycles but a lower frequency, and vice versa). For example, at 300 Hz, a full tap takes just as long as a mini tap (eg, 9.9 ms).

[0069] As shown in FIGS. 4C-4E , a tactile output pattern also has a characteristic amplitude that affects the amount of energy contained in the tactile signal, or the tactile “intensity” that a user may feel due to a tactile output having that characteristic amplitude. In some embodiments, the characteristic amplitude of a tactile output pattern refers to an absolute or normalized value that represents the maximum displacement of the movable mass from a neutral position when generating a tactile output. In some embodiments, the characteristic amplitude of a tactile output pattern is adjustable, for example, by a fixed or dynamically determined gain factor (e.g., a value between 0 and 1) and / or a pre-set metric (e.g., an input-based metric and / or a user-interface-based metric) according to various conditions (e.g., customized based on the context and behavior of the user interface). In some embodiments, an input-based metric (e.g., an intensity change metric or an input velocity metric) indicates a characteristic of the input (e.g., the rate of change of the characteristic intensity of a contact in a press input or the velocity of movement of the contact on the touch-sensitive surface during input that triggers generation of a tactile output). In some embodiments, a user interface-based metric (e.g., a boundary crossing velocity metric) indicates a characteristic of a user interface element during a change in the user interface that triggers the generation of a tactile output (e.g., the velocity of movement of an element across a hidden or visible boundary within the user interface). In some embodiments, the characteristic amplitude of the tactile output pattern can be modulated by an "envelope," where the peaks of adjacent cycles can have different amplitudes, and one of the waveforms shown above is further modified by multiplication by an envelope parameter that varies over time (e.g., from 0 to 1) to progressively adjust the amplitude of portions of the tactile output over time as the tactile output is generated.

[0070] While Figures 4C-4E depict specific frequencies, amplitudes, and waveforms within sample tactile output patterns for illustrative purposes, tactile output patterns with other frequencies, amplitudes, and waveforms can be used for similar purposes. For example, waveforms with 0.5 to 4 cycles can be used. Other frequencies within the range of 60 Hz to 400 Hz can be used as well. Table 1 provides examples of specific tactile feedback behaviors, configurations, and their uses.

[0071] It should be understood that device 100 is only one example of a portable multifunction device, and that device 100 optionally has more or fewer components than those shown, optionally combines two or more components, or optionally has a different configuration or arrangement of its components. The various components shown in Figure 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or application specific integrated circuits.

[0072] Memory 102 optionally includes high-speed random access memory, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0073] Peripheral interface 118 may be used to couple input and output peripherals of the device to CPU 120 and memory 102. One or more processors 120 operate or execute various software programs and / or instruction sets stored in memory 102 to perform various functions and process data for device 100. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0074] RF (radio frequency) circuitry 108 transmits and receives RF signals, also called electromagnetic signals. RF circuitry 108 converts electrical signals to or from electromagnetic signals and communicates with communication networks and other communication devices via electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. RF circuitry 108 optionally communicates wirelessly with networks, such as the Internet, also known as the World Wide Web (WWW), an intranet, and / or wireless networks, such as cellular telephone networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs), and with other devices. RF circuitry 108 optionally includes well-known circuitry for detecting near field communication (NFC) fields, such as by short-range radios. Wireless communication optionally includes, but is not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPA), Long Term Evolution (LTE), and other standards.Wireless technology includes, but is not limited to, wireless technology such as LTE evolution, near field communications (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth®, Bluetooth Low Energy (BTLE®), Wireless Fidelity (Wi-Fi®) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and / or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX®, email protocols (e.g., Internet message access protocol (IMAP) and / or post office protocol (POP)), instant messaging (e.g., extensible messaging and presence protocol), and the like. The present invention may use any of a number of communication standards, protocols, and technologies, including the Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (XMPP), the Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), the Instant Messaging and Presence Service (IMPS), and / or the Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this application.

[0075] Audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and device 100. Audio circuit 110 receives audio data from peripherals interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves audible to humans. Audio circuit 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuit 110 converts the electrical signals into audio data and transmits the audio data to peripherals interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to memory 102 and / or RF circuit 108 by peripherals interface 118. In some embodiments, audio circuit 110 also includes a headset jack (e.g., 212 in FIG. 2 ). The headset jack provides an interface between audio circuitry 110 and a detachable audio input / output peripheral, such as an output-only headphone or a headset with both an output (e.g., single or double ear headphones) and an input (e.g., a microphone).

[0076] I / O subsystem 106 couples input / output peripherals on device 100, such as touchscreen 112 and other input control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, light sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, depth camera controller 169, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive / send electrical signals from / to other input control devices 116. Other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, input controller 160 is optionally coupled to any (or none) of a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208 in FIG. 2) optionally include up and down buttons for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., 206 in FIG. 2).

[0077] A quick press of a push button optionally unlocks the touchscreen 112 or, optionally, initiates the process of unlocking the device using gestures on the touchscreen, as described in U.S. Patent Application Serial No. 11 / 322,549, filed December 23, 2005, "Unlocking a Device by Performing Gestures on an Unlock Image," U.S. Patent No. 7,657,849, which is incorporated herein by reference in its entirety. A longer press of a push button (e.g., 206) optionally turns power on or off to the device 100. The functionality of one or more of the buttons is optionally customizable by the user. The touchscreen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0078] Touch-sensitive display 112 provides an input and output interface between the device and a user. Display controller 156 receives and / or sends electrical signals to touchscreen 112. Touchscreen 112 displays visual output to the user. This visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0079] Touchscreen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and / or tactile contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction sets in memory 102) detects contacts (and any movement or cessation of contact) on touchscreen 112 and translates the detected contacts into interactions with user interface objects (e.g., one or more softkeys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the point of contact between touchscreen 112 and the user corresponds to the user's finger.

[0080] Touchscreen 112 optionally uses LCD (liquid crystal display), LPD (light emitting polymer display), or LED (light emitting diode) technology, although other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally detect contact and any movement or disruption thereof using any of a number of now known or later developed touch sensing technologies, including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements that determine one or more points of contact with touchscreen 112. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, California.

[0081] The touch-sensitive display in some embodiments of touchscreen 112 is optionally similar to the multi-touch-sensing touchpad described in U.S. Patent Nos. 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman), and / or U.S. Patent Publication No. 2002 / 0015024 (A1), each of which is incorporated by reference herein in its entirety. However, touchscreen 112 displays visual output from device 100, whereas touch-sensitive touchpads do not provide visual output.

[0082] The touch-sensitive display in some embodiments of touch screen 112 may be any of the touch-sensitive displays described in U.S. patent application Ser. No. 11 / 381,313, filed May 2, 2006, entitled "Multipoint Touch Surface Controller," (2) U.S. patent application Ser. No. 10 / 840,862, filed May 6, 2004, entitled "Multipoint Touchscreen," (3) U.S. patent application Ser. No. 10 / 903,964, filed July 30, 2004, entitled "Gestures For Touch Sensitive Input Devices," (4) U.S. patent application Ser. No. 11 / 048,264, filed January 31, 2005, entitled "Gestures For Touch Sensitive Input Devices," and (5) U.S. patent application Ser. No. 11 / 038,590, filed January 18, 2005, entitled "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices." No. 11 / 228,758, filed September 16, 2005, entitled "Virtual Input Device Placement On A Touch Screen User Interface," (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, entitled "Operation Of A Computer With A Touch Screen Interface," (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, entitled "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard," and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, entitled "Multi-Functional Hand-Held Device," all of which are incorporated herein by reference in their entirety.

[0083] Touchscreen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. A user optionally contacts touchscreen 112 using any suitable object or accessory, such as a stylus, a finger, or the like. In some embodiments, the user interface is designed to primarily handle finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​a finger on the touchscreen. In some embodiments, the device translates the coarse finger input into precise pointer / cursor positions or commands to perform the action desired by the user.

[0084] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad for activating or deactivating certain functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from touchscreen 112 or an extension of the touch-sensitive surface formed by the touchscreen.

[0085] Device 100 also includes a power system 162 that provides power to the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, power failure detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of electrical power within a portable device.

[0086] Device 100 also optionally includes one or more light sensors 164. FIG. 1A shows a light sensor coupled to light sensor controller 158 in I / O subsystem 106. Light sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. Light sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. Light sensor 164 optionally works in conjunction with imaging module 143 (also called a camera module) to capture still images or video. In some embodiments, the light sensor is located on the back of device 100, as opposed to touchscreen display 112, which is on the front of the device, so that the touchscreen display can be used as a viewfinder for capturing still and / or video images. In some embodiments, the light sensor is located on the front of the device so that an image of a user is optionally acquired for a videoconference while the user views other videoconference participants on the touchscreen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), so that a single optical sensor 164 is used for both video conferencing and capturing still and / or video images, along with a touchscreen display.

[0087] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to intensity sensor controller 159 in I / O subsystem 106. Contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). Contact intensity sensor 165 receives contact intensity information (e.g., pressure information, or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed with or proximate to the touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the back of device 100, opposite touchscreen display 112, which is located on the front of device 100.

[0088] Device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows proximity sensor 166 coupled to peripheral interface 118. Alternatively, proximity sensor 166 is optionally coupled to input controller 160 within I / O subsystem 106. Proximity sensor 166 optionally functions as described in U.S. patent application Ser. Nos. 11 / 241,839, "Proximity Detector In Handheld Device," 11 / 240,788, "Proximity Detector In Handheld Device," 11 / 620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output," 11 / 586,862, "Automated Response To And Sensing Of User Activity In Portable Devices," and 11 / 638,251, "Methods And Systems For Automatic Configuration Of Peripherals," which are incorporated by reference herein in their entireties. In some embodiments, when the multifunction device is placed near the user's ear (eg, when the user is making a phone call), the proximity sensor turns off and disables touchscreen 112.

[0089] Device 100 also optionally includes one or more tactile output generators 167. FIG. 1A shows tactile output generators coupled to haptic feedback controller 161 in I / O subsystem 106. Tactile output generator 167 optionally includes one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components that convert electrical signals into tactile output on the device). Contact intensity sensor 165 receives tactile feedback generation instructions from haptic feedback module 133 and generates a tactile output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one tactile output generator is juxtaposed with or proximate to a touch-sensitive surface (e.g., touch-sensitive display system 112) and generates a tactile output, optionally by moving the touch-sensitive surface vertically (e.g., in / out of the surface of device 100) or horizontally (e.g., back and forth in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back of device 100, opposite touchscreen display 112, which is located on the front of device 100.

[0090] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows accelerometer 168 coupled to peripherals interface 118. Alternatively, accelerometer 168 is optionally coupled to input controller 160 within I / O subsystem 106. Accelerometer 168 optionally functions as described in U.S. Patent Publication No. 20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices," and U.S. Patent Publication No. 20060017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entireties. In some embodiments, information is displayed on the touchscreen display in portrait or landscape view based on analysis of data received from the one or more accelerometers. In addition to the accelerometer 168, the device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for obtaining information about the location and orientation (e.g., vertical or horizontal) of the device 100.

[0091] In some embodiments, device 100 also includes (or communicates with) one or more fingerprint sensors. The one or more fingerprint sensors are coupled to peripherals interface 118. Alternatively, the one or more fingerprint sensors are optionally coupled to input controller 160 in I / O subsystem 106. However, in one general embodiment, fingerprint identification operations are performed using fixed, dedicated computing hardware (e.g., one or more processors, memory, and / or communication buses) that have additional security features to improve the security of the fingerprint information determined by the one or more fingerprint sensors. As used herein, a fingerprint sensor is a sensor capable of distinguishing ridge and valley fingerprint features (sometimes referred to as “miniature features”) of the skin of human fingers and toes, etc. The fingerprint sensor may use any of a variety of techniques for distinguishing fingerprint features, including, but not limited to, optical fingerprint imaging, ultrasonic fingerprint imaging, active capacitive fingerprint imaging, and passive capacitive fingerprint imaging. In addition to distinguishing fingerprint features within a fingerprint, in some embodiments, the one or more fingerprint sensors are capable of tracking the movement of the fingerprint features over time, thereby determining / characterizing the movement of the fingerprint on the one or more fingerprint sensors over time. It should be understood that the one or more fingerprint sensors can be separate from the touch-sensitive surface (e.g., touch-sensitive display system 112), although in some implementations the touch-sensitive surface (e.g., touch-sensitive display system 112) has a spatial resolution high enough to detect fingerprint features formed by individual fingerprint ridges and is used as a fingerprint sensor instead of or in addition to the one or more fingerprint sensors. In some embodiments, device 100 includes a set of one or more direction sensors that are used to determine the orientation of a finger or hand on or in proximity to the device (e.g., the orientation of a finger on one or more fingerprint sensors).Additionally, in some embodiments, a set of one or more directional sensors are used in addition to or instead of a fingerprint sensor to detect rotation of a contact interacting with the device (e.g., in one or more of the methods described below, rather than using a fingerprint sensor to detect rotation of the fingerprint / contact, a set of one or more directional sensors are used to detect rotation of a contact including a fingerprint, whether or not they detect fingerprint features).

[0092] In some embodiments, fingerprint features and comparisons between detected and stored fingerprint features are performed by fixed, dedicated computing hardware (e.g., one or more processors, memory, and / or communication buses) separate from processor 120 to improve the security of fingerprint data generated, stored, and processed by one or more fingerprint sensors. In some embodiments, fingerprint features and comparisons between detected and enrolled fingerprint features are performed by processor 120 using a fingerprint analysis module.

[0093] In some embodiments, during the enrollment process, the device (e.g., a fingerprint analysis module or a separate secure module in communication with one or more fingerprint sensors) collects biometric information about one or more fingerprints of the user (e.g., identifies the relative locations of multiple minisure points in the user's fingerprint). After the enrollment process is complete, the biometric information is stored on the device (e.g., in the secure fingerprint module) for later use in authenticating detected fingerprints. In some embodiments, the biometric information stored on the device excludes images of the fingerprints and excludes information from which the images of the fingerprints can be reconstructed, so that the images of the fingerprints are not unintentionally available if the security of the device is compromised. In some embodiments, during the authentication process, the device (e.g., a fingerprint analysis module or a separate secure module in communication with one or more fingerprint sensors) collects biometric information about fingerprints detected on one or more fingerprint sensors (e.g., identifies the relative locations of multiple minisure points in the detected fingerprints on the one or more fingerprint sensors) and compares the biometric information corresponding to the detected fingerprints with the biometric information corresponding to enrolled fingerprints to determine whether the finger input detected by the one or more fingerprint sensors includes a fingerprint that matches a previously enrolled fingerprint. In some embodiments, comparing the biometric information corresponding to the detected fingerprint with the biometric information corresponding to the enrolled fingerprint includes comparing the type and location of minisure points in the biometric information corresponding to the detected fingerprint with the type and location of minisure points in the biometric information corresponding to the enrolled fingerprint, However, the determination as to whether the finger input includes a fingerprint that matches a previously enrolled fingerprint that is enrolled on the device is optionally performed using any of a number of well-known fingerprint authentication techniques that determine whether a detected fingerprint matches a enrolled fingerprint.

[0094] Device 100 also optionally includes one or more depth camera sensors 175. FIG. 1A shows a depth camera sensor coupled to depth camera controller 169 in I / O subsystem 106. Depth camera sensor 175 receives data from the environment and creates a three-dimensional model of an object (e.g., a face) in a scene from a viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with imaging module 143 (also referred to as a camera module), depth camera sensor 175 is optionally used to determine a depth map of various portions of an image captured by imaging module 143. In some embodiments, depth camera sensor 175 is located on the front of device 100 so that an image of the user with depth information is optionally obtained for video conferencing and to capture selfie images with depth map data while the user views other video conference participants on a touchscreen display. In some embodiments, depth camera sensor 175 is located on the back of the device, or on both the back and front of device 100. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), so that the depth camera sensor 175 is used for both video conferencing and capturing still and / or video images, along with a touchscreen display.

[0095] In some embodiments, software components stored in memory 102 include operating system 126, communication module (or instruction set) 128, touch / motion module (or instruction set) 130, graphics module (or instruction set) 132, text input module (or instruction set) 134, Global Positioning System (GPS) module (or instruction set) 135, and applications (or instruction sets) 136. Additionally, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) stores device / global internal state 157, as shown in FIGS. 1A and 3. Device / global internal state 157 includes one or more of: active application state indicating which applications, if any, are currently active; display state indicating what applications, views, or other information occupy various regions of touchscreen display 112; sensor state including information obtained from the device's various sensors and input control devices 116; and location information regarding the device's position and / or orientation.

[0096] Operating system 126 (e.g., Darwin®, RTXC®, LINUX®, UNIX®, OS X®, iOS®, WINDOWS®, or an embedded operating system such as VxWorks®) includes various software components and / or drivers that control and manage general system tasks (e.g., memory management, storage control, power management, etc.) and facilitate communication between various hardware and software components.

[0097] Communications module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by RF circuitry 108 and / or external port 124. External port 124 (e.g., Universal Serial Bus (USB), FIREWIRE®, etc.) is adapted to couple to other devices directly or indirectly via a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, similar to, and / or compatible with the 30-pin connector used on iPod® (trademark of Apple Inc.) devices.

[0098] Contact / motion module 130, optionally in conjunction with display controller 156, detects contact with touchscreen 112 and other touch-sensing devices (e.g., a touchpad or physical click wheel). Contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact occurs (e.g., detecting a finger-down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is contact movement and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger-drag events), and determining whether the contact has stopped (e.g., detecting a finger-up event or an interruption of the contact). Contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point represented by the series of contact data optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions are optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, contact / motion module 130 and display controller 156 detect contacts on the touchpad.

[0099] In some embodiments, contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., whether a user has “clicked” on an icon). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator, but can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a trackpad or touchscreen display can be set to any of a wide range of pre-defined thresholds without changing the trackpad or touchscreen display hardware. Additionally, in some implementations, a user of the device is provided with a software setting to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or multiple intensity thresholds at once via a system-level click “intensity” parameter).

[0100] Contact / motion module 130 optionally detects gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timing, and / or intensities of detected contacts). Thus, gestures are optionally detected by detecting particular contact patterns. For example, detecting a finger tap gesture includes detecting a finger down event, followed by detecting a finger up (lift off) event at the same location (or substantially the same location) as the finger down event (e.g., the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger down event, followed by one or more finger drag events, followed by detecting a finger up (lift off) event.

[0101] Graphics module 132 includes various known software components that render and display graphics on touchscreen 112 or other display, including components that vary the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, characters, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0102] In some embodiments, graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. Graphics module 132 receives one or more codes specifying the graphics to be displayed, including coordinate data and other graphic characteristic data, as needed, from an application or the like, and then generates screen image data to output to display controller 156.

[0103] The haptic feedback module 133 includes various software components for generating instructions used by the tactile output generator 167 to generate tactile outputs at one or more locations on the device 100 in response to user interaction with the device 100.

[0104] Text input module 134 is optionally a component of graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0105] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing, to the camera 143 as photo / video metadata, and to applications that provide location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0106] Application 136 optionally includes the following modules (or instruction sets), or a subset or superset thereof: • a contacts module 137 (sometimes called an address book or contact list); ●Telephone module 138, ●Videoconferencing module 139, ● an email client module 140; ● Instant messaging (IM) module 141, ●Training support module 142, a camera module 143 for still and / or video images, ● Image management module 144; ●Video player module, ●Music player module, ● Browser module 147, ● Calendar module 148, • A widget module 149 optionally including one or more of a weather widget 149-1, a stock price widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, and a user-created widget 149-6; a widget creator module 150 for creating user-created widgets 149-6; ● Search module 151, A video and music player module 152 that integrates a video player module and a music player module; ● Memo module 153, Map module 154, and / or ●Online video module 155.

[0107] Optionally, examples of other applications 136 stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA® enabled applications, encryption, digital rights management, voice recognition, and voice duplication.

[0108] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, contacts module 137 is used to manage an address book or contact list (e.g., stored in memory 102 or in the application internal state 192 of contacts module 137 in memory 370), including, optionally, adding names to the address book, removing names from the address book, associating phone numbers, email addresses, physical addresses, or other information with names, associating images with names, categorizing and sorting names, providing phone numbers or email addresses to initiate and / or facilitate communication by phone 138, videoconferencing module 139, email 140, or IM 141, etc.

[0109] Telephone module 138, in conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, is optionally used to enter character sequences corresponding to telephone numbers, access one or more telephone numbers in contacts module 137, modify entered telephone numbers, dial respective telephone numbers, conduct conversations, and terminate or hang up when the conversation is completed. As previously mentioned, wireless communication optionally uses any of a number of communication standards, protocols, and technologies.

[0110] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, light sensor 164, light sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, videoconferencing module 139 includes executable instructions for initiating, conducting, and terminating a videoconference between a user and one or more other participants in accordance with the user's instructions.

[0111] In cooperation with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 contains executable instructions for composing, sending, receiving, and managing emails in response to user instructions. In cooperation with image management module 144, email client module 140 greatly facilitates the creation and sending of emails with still or video images captured by camera module 143.

[0112] In cooperation with RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for entering character sequences corresponding to instant messages, modifying previously entered characters, sending respective instant messages (e.g., using Short Message Service (SMS) or Multimedia Message Service (MMS) protocols for telephony-based instant messaging, or XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, sent and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both telephony-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0113] In conjunction with the RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, the training support module 142 includes executable instructions for creating workouts (e.g., with time, distance, and / or calorie burn goals), communicating with training sensors (sports devices), receiving training sensor data, calibrating sensors used to monitor workouts, selecting and playing music for workouts, and displaying, storing, and transmitting workout data.

[0114] In conjunction with touch screen 112, display controller 156, light sensor 164, light sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, camera module 143 contains executable instructions for capturing and storing still images or video (including video streams) in memory 102, modifying the characteristics of the still images or video, or deleting the still images or video from memory 102.

[0115] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 contains executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slide show or album), and storing still and / or video images.

[0116] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, browser module 147 contains executable instructions for browsing the Internet according to user directions, including retrieving, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0117] In cooperation with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with the calendars (e.g., calendar items, to-do lists, etc.) according to user instructions.

[0118] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 optionally represents mini-applications (e.g., weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) downloaded and used by a user, or mini-applications (e.g., user-created widget 149-6) created by a user. In some embodiments, a widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, a widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! Widgets).

[0119] In conjunction with RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 is optionally used by a user to create a widget (e.g., turn a user-specified portion of a web page into a widget).

[0120] In cooperation with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, search module 151 includes executable instructions for searching memory 102 for text, music, sound, images, video, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with a user's instructions.

[0121] In conjunction with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 contains executable instructions that enable a user to download and play pre-recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing videos (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (a trademark of Apple Inc.).

[0122] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, notes module 153 contains executable instructions for creating and managing notes, to-do lists, and the like, as directed by a user.

[0123] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 is used to receive, display, modify, and store maps and data associated with maps (e.g., driving directions, data regarding businesses and other points of interest at or near a particular location, and other location-based data), optionally in accordance with user instructions.

[0124] In cooperation with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, online video module 155 contains instructions that enable a user to access, browse for, receive (e.g., by streaming and / or downloading), and play (e.g., on the touchscreen or on an external display connected via external port 124) particular online videos, send emails with links to particular online videos, and otherwise manage online videos in one or more file formats, such as H.264. In some embodiments, instant messaging module 141 is used to send links to particular online videos, rather than email client module 140. Additional description of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," the contents of which are incorporated herein by reference in their entireties.

[0125] The above-identified modules and applications each correspond to a set of executable instructions that perform one or more of the functions previously described and methods described herein (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as separate software programs, procedures, or modules; thus, in various embodiments, various subsets of these modules are optionally combined or otherwise rearranged. For example, a video player module is optionally combined with a music player module into a single module (e.g., video and music player module 152 of FIG. 1A). In some embodiments, memory 102 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.

[0126] In some embodiments, device 100 is a device in which operation of a predetermined set of functions on the device is performed solely via a touchscreen and / or touchpad. Using the touchscreen and / or touchpad as the primary input control device for operation of device 100 optionally reduces the number of physical input control devices (push buttons, dials, etc.) on device 100.

[0127] The set of predefined functions performed only via the touchscreen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 to a main menu, home menu, or root menu from any user interface displayed on device 100. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device rather than a touchpad.

[0128] 1B is a block diagram illustrating exemplary components for event processing, according to some embodiments. In some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) includes event sorter 170 (e.g., within operating system 126) and a respective application 136-1 (e.g., any of applications 137-151, 155, 380-390 described above).

[0129] Event sorter 170 receives the event information and determines application 136-1 and application view 191 for application 136-1 to deliver the event information to. Event sorter 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192 that indicates the current application view that is displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event sorter 170 to determine which application is currently active, and application internal state 192 is used by event sorter 170 to determine which application is currently active, and application view 191 to deliver the event information to.

[0130] In some embodiments, application internal state 192 includes additional information such as one or more of resume information to be used when application 136-1 resumes execution, user interface state information indicating or ready to display information being displayed by application 136-1, state cues that allow the user to return to a previous state or view of application 136-1, and redo / undo cues of previous actions taken by the user.

[0131] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about a sub-event (e.g., a user touch on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, accelerometer 168, and / or microphone 113 (via audio circuitry 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0132] In some embodiments, event monitor 171 sends requests to peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only when there is a significant event (e.g., receipt of an input above a predetermined noise threshold and / or for more than a predetermined duration).

[0133] In some embodiments, event sorter 170 also includes a hit view determination module 172 and / or an active event recognizer determination module 173 .

[0134] Hit view determination module 172 provides software procedures that determine where a sub-event occurred within one or more views when touch-sensitive display 112 displays more than one view. A view consists of the controls and other elements that a user can see on the display.

[0135] Another aspect of a user interface associated with an application is the set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the respective application) in which the touch is detected optionally corresponds to a programmatic level within the application's programmatic or view hierarchy. For example, the lowest-level view in which the touch is detected is optionally referred to as the hit view, and the set of events that are recognized as suitable inputs is optionally determined based at least in part on the hit view of the initial touch that initiates the touch gesture.

[0136] Hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized hierarchically, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should process the sub-events. In most situations, the hit view is the lowest-level view in which an initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source as the one identified as the hit view.

[0137] Active event recognizer determination module 173 determines which views in the view hierarchy should receive the particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive the particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that contain the physical location of the sub-events are actively participating views, and therefore determines that all actively participating views should receive the particular sequence of sub-events. In other embodiments, even if the touch sub-event is completely confined to the area associated with one particular view, views higher in the hierarchy remain actively participating views.

[0138] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores event information obtained by each event receiver 182 in an event queue.

[0139] In some embodiments, operating system 126 includes event sorter 170. Alternatively, application 136-1 includes event sorter 170. In still other embodiments, event sorter 170 is a stand-alone module or is part of another module stored in memory 102, such as contact / motion module 130.

[0140] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each containing instructions for processing touch events that occur within a respective view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, each application view 191 includes multiple event recognizers 180. In other embodiments, one or more of event recognizers 180 are part of a separate module, such as a user interface kit or a higher-level object from which application 136-1 inherits methods and other attributes. In some embodiments, each event handler 190 includes one or more of data updater 176, object updater 177, GUI updater 178, and / or event data 179 received from event sorter 170. Event handler 190 optionally utilizes or invokes data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in each application view 191.

[0141] Each event recognizer 180 receives event information (e.g., event data 179) from event sorter 170 and identifies an event from the event information. Event recognizer 180 includes event receiver 182 and event comparator 184. In some embodiments, event recognizer 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (optionally including sub-event delivery instructions).

[0142] Event receiver 182 receives event information from event sorter 170. The event information includes information about a sub-event, e.g., a touch or a movement of a touch. Depending on the sub-event, the event information also includes additional information, such as the position of the sub-event. When the sub-event involves a movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., from portrait to landscape or vice versa), and the event information includes corresponding information about the current orientation of the device (also called the device's attitude).

[0143] The event comparator 184 compares the event information with predefined event or sub-event definitions and determines the event or sub-event, or determines or updates the state of the event or sub-event, based on the comparison. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes a definition of an event (e.g., a predefined sequence of sub-events), such as Event 1 (187-1) and Event 2 (187-2). In some embodiments, sub-events within Event 1 (187) include, for example, touch start, touch end, touch movement, touch cancellation, and multiple touches. In one example, the definition for Event 1 (187-1) is a double tap on a displayed object. The double tap includes, for example, a first touch on a displayed object relative to a predetermined stage (touch start), a first lift-off (touch end) relative to the predetermined stage, a second touch on a displayed object relative to the predetermined stage (touch start), and a second lift-off (touch end) relative to the predetermined stage. In another example, a definition of event 2 (187-2) is a drag on a displayed object. Drag includes, for example, a touch (or contact) on the displayed object to a predetermined stage, a movement of the touch across the touch-sensitive display 112, and a lift-off of the touch (touch end). In some embodiments, the event also includes information about one or more associated event handlers 190.

[0144] In some embodiments, event definition 187 includes a definition of the event for each user interface object. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, when a touch is detected on touch-sensitive display 112 in an application view in which three user interface objects are displayed on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a respective event handler 190, event comparator 184 uses the results of the hit test to determine which event handler 190 to activate. For example, event comparator 184 selects the event handler associated with the sub-event and object that triggers the hit test.

[0145] In some embodiments, each event 187 definition also includes a delay action that delays delivery of the event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognizer.

[0146] If the respective event recognizer 180 determines that the sequence of sub-events does not match any of the events in the event definition 186, the respective event recognizer 180 enters an event disabled, event failed, or event finished state and then ignores the next sub-event of the touch-based gesture. In this situation, any other event recognizers that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0147] In some embodiments, each event recognizer 180 includes metadata 183 with configurable properties, flags, and / or lists that indicate to actively participating event recognizers how the event delivery system should perform sub-event delivery. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact with each other or how event recognizers are enabled to interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how sub-events are delivered to various levels in the view or programmatic hierarchy.

[0148] In some embodiments, each event recognizer 180 activates an event handler 190 associated with an event when one or more specific sub-events of the event are recognized. In some embodiments, each event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is separate from sending (and postponing sending) sub-events to the respective hit view. In some embodiments, the event recognizer 180 pops a flag associated with the recognized event, and the event handler 190 associated with the flag captures the flag and performs a predetermined process.

[0149] In some embodiments, the event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a set of sub-events or to an actively participating view. The event handler associated with the set of sub-events or the actively participating view receives the event information and performs predetermined processing.

[0150] In some embodiments, data updater 176 creates and updates data used by application 136-1. For example, data updater 176 updates phone numbers used by contacts module 137 or stores video files used by a video player module. In some embodiments, object updater 177 creates and updates objects used by application 136-1. For example, object updater 177 creates new user interface objects or updates the positions of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on the touch-sensitive display.

[0151] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0152] 1C is a block diagram illustrating a tactile output module, according to some embodiments. In some embodiments, I / O subsystem 106 (e.g., haptic feedback controller 161 (FIG. 1A) and / or other input controller 160 (FIG. 1A)) includes at least some of the example components shown in FIG. 1C. In some embodiments, peripherals interface 118 includes at least some of the example components shown in FIG. 1C.

[0153] In some embodiments, the tactile output module includes a haptic feedback module 133. In some embodiments, the haptic feedback module 133 aggregates and combines tactile output in response to user interface feedback from software applications on the electronic device (e.g., user input corresponding to a displayed user interface, and feedback responsive to alerts and other notifications indicating the performance of an action or the occurrence of an event in the user interface of the electronic device). The haptic feedback module 133 includes one or more of a waveform module 123 (which provides the waveforms used to generate the tactile output), a mixer 125 (which mixes waveforms, such as waveforms on different channels), a compressor 127 (which reduces or compresses the dynamic range of the waveforms), a low-pass filter 129 (which filters high-frequency signal components in the waveforms), and a thermal controller 131 (which adjusts the waveform according to thermal conditions). In some embodiments, the haptic feedback module 133 is included in a haptic feedback controller 161 (FIG. 1A). In some embodiments, a separate unit of (or a separate implementation of) haptic feedback module 133 is also included in the audio controller (e.g., audio circuit 110 of FIG. 1A) and is used to generate the audio signal. In some embodiments, a single haptic feedback module 133 is used to generate the waveforms for the audio signal and the tactile output.

[0154] In some embodiments, haptic feedback module 133 also includes trigger module 121 (e.g., a software application, operating system, or other software module that determines a tactile output to be generated and initiates the process of generating the corresponding tactile output). In some embodiments, trigger module 121 generates a trigger signal that initiates the generation of a waveform (e.g., by waveform module 123). For example, trigger module 121 generates the trigger signal based on pre-set timing criteria. In some embodiments, trigger module 121 receives trigger signals from outside haptic feedback module 133 (e.g., in some embodiments, haptic feedback module 133 receives trigger signals from hardware input processing module 146, which is located outside haptic feedback module 133) based on the activation of a user interface element (e.g., an application icon or affordance within an application) or a hardware input device (e.g., an intensity-sensitive input surface such as a home button or an intensity-sensitive touchscreen), and relays those trigger signals to other components within haptic feedback module 133 (e.g., waveform module 123) or a software application that triggers an action (e.g., via trigger module 121). In some embodiments, trigger module 121 also receives a tactile feedback generation command (e.g., from haptic feedback module 133 of FIGS. 1A and 3). In some embodiments, trigger module 121 generates a trigger signal in response to haptic feedback module 133 (or trigger module 121 within haptic feedback module 133) receiving a tactile feedback command (e.g., from haptic feedback module 133 of FIGS. 1A and 3).

[0155] Waveform module 123 receives a trigger signal as an input (e.g., from trigger module 121) and, in response to receiving the trigger signal, provides a waveform (e.g., a waveform selected from a predetermined set of waveforms designated for use by waveform module 123, such as the waveforms described in more detail below with reference to Figures 4C-4D) for generating one or more tactile outputs.

[0156] Mixer 125 receives waveforms as inputs (e.g., from waveform module 123) and mixes the waveforms together. For example, when mixer 125 receives two or more waveforms (e.g., a first waveform in a first channel and a second waveform in a second channel that at least partially overlaps with the first waveform), mixer 125 outputs a combined waveform that corresponds to the sum of the two or more waveforms. In some embodiments, mixer 125 also modifies one or more of the two or more waveforms to emphasize a particular waveform relative to the rest of the two or more waveforms (e.g., by increasing the scale of a particular waveform and / or decreasing the scale of the rest of the waveforms). In some situations, mixer 125 selects one or more waveforms to remove from the combined waveform (e.g., when there are waveforms from four or more sources requested to be output simultaneously by tactile output generator 167, the waveform from the oldest source is dropped).

[0157] Compressor 127 receives a waveform (e.g., the composite waveform from mixer 125) as an input and modifies the waveform. In some embodiments, compressor 127 reduces the waveform (e.g., according to the physical specifications of tactile output generator 167 (FIG. 1A) or 357 (FIG. 3)), resulting in a reduced tactile output corresponding to the waveform. In some embodiments, compressor 127 limits the waveform, such as by enforcing a predetermined maximum amplitude for the waveform. For example, compressor 127 reduces the amplitude of portions of the waveform that exceed a predetermined amplitude threshold, while maintaining the amplitude of portions of the waveform that do not exceed the predetermined amplitude threshold. In some embodiments, compressor 127 reduces the dynamic range of the waveform. In some embodiments, compressor 127 dynamically reduces the dynamic range of the waveform so that the combined waveform remains within the performance specifications of tactile output generator 167 (e.g., force and / or displacement limits of a moving mass).

[0158] Low-pass filter 129 receives waveforms (e.g., compressed waveforms from compressor 127) as inputs and filters (e.g., smooths) these waveforms (e.g., removes or reduces high-frequency signal components within the waveforms). For example, in some cases, when a tactile output is generated according to a compressed waveform, compressor 127 includes extraneous signals (e.g., high-frequency signal components) within the compressed waveform that interfere with the generation of the tactile output and / or exceed the performance specifications of tactile output generator 167. Low-pass filter 129 reduces or removes such extraneous signals within the waveform.

[0159] Thermal controller 131 receives waveforms (e.g., filtered waveforms from low-pass filter 129) as inputs and adjusts these waveforms according to the thermal state of device 100 (e.g., based on an internal temperature detected within device 100, such as the temperature of haptic feedback controller 161, and / or an external temperature detected by device 100). For example, in some cases, the output of haptic feedback controller 161 varies with temperature (e.g., haptic feedback controller 161 generates a first tactile output when haptic feedback controller 161 is at a first temperature and a second tactile output when haptic feedback controller 161 is at a second temperature different from the first temperature, in response to receiving the same waveform). For example, the magnitude (or amplitude) of the tactile output can vary with temperature. The waveform is modified (e.g., the amplitude of the waveform is increased or decreased based on temperature) to reduce the effects of temperature fluctuations.

[0160] In some embodiments, haptic feedback module 133 (e.g., trigger module 121) is coupled to hardware input processing module 146. In some embodiments, other input controller 160 of FIG. 1A includes hardware input processing module 146. In some embodiments, hardware input processing module 146 receives input from hardware input device 145 (e.g., other input or control device 116 of FIG. 1A, such as a home button, or an intensity-sensitive input surface such as an intensity-sensitive touchscreen). In some embodiments, hardware input device 145 is any input device described herein, such as touch-sensitive display system 112 (FIG. 1A), keyboard / mouse 350 (FIG. 3), touchpad 355 (FIG. 3), one of other input or control devices 116 (FIG. 1A), or an intensity-sensitive home button. In some embodiments, hardware input device 145 consists of an intensity-sensitive home button rather than touch-sensitive display system 112 (FIG. 1A), keyboard / mouse 350 (FIG. 3), or touchpad 355 (FIG. 3). In some embodiments, in response to input from hardware input device 145 (e.g., an intensity-sensitive home button or a touchscreen), hardware input processing module 146 provides one or more trigger signals to haptic feedback module 133 to indicate that a user input that meets predetermined input criteria has been detected, such as an input corresponding to a home button "click" (e.g., a "down click" or an "up click"). In some embodiments, haptic feedback module 133, in response to an input corresponding to a home button "click," provides a waveform corresponding to a home button "click" to simulate the haptic feedback of pressing a physical home button.

[0161] In some embodiments, the tactile output module includes a haptic feedback controller 161 (e.g., haptic feedback controller 161 of FIG. 1A ) that controls the generation of the tactile output. In some embodiments, the haptic feedback controller 161 is coupled to a plurality of tactile output generators, selects one or more of the plurality of tactile output generators, and sends waveforms to the selected one or more tactile output generators that generate the tactile output. In some embodiments, the haptic feedback controller 161 aggregates tactile output requests corresponding to activation of the hardware input device 145 and tactile output requests corresponding to software events (e.g., tactile output requests from the haptic feedback module 133), and modifies one or more of the two or more waveforms to emphasize a particular waveform relative to the rest of the two or more waveforms (e.g., by increasing the scale of a particular waveform and / or decreasing the scale of the rest of the waveforms, such as to prioritize tactile output corresponding to activation of the hardware input device 145 over tactile output corresponding to the software event).

[0162] In some embodiments, as shown in FIG. 1C , the output of haptic feedback controller 161 is coupled to an audio circuit of device 100 (e.g., audio circuit 110 of FIG. 1A ) and provides an audio signal to the audio circuit of device 100. In some embodiments, haptic feedback controller 161 provides both a waveform used to generate the tactile output and an audio signal used to provide the audio output in conjunction with generating the tactile output. In some embodiments, haptic feedback controller 161 modifies the audio signal and / or the waveform (used to generate the tactile output) so that the audio output and the tactile output are synchronized (e.g., by delaying the audio signal and / or waveform). In some embodiments, haptic feedback controller 161 includes a digital-to-analog converter used to convert the digital waveform to an analog signal, which is received by amplifier 163 and / or tactile output generator 167.

[0163] In some embodiments, tactile output module includes amplifier 163. In some embodiments, amplifier 163 receives a waveform (e.g., from haptic feedback controller 161), amplifies the waveform, and then transmits the amplified waveform to tactile output generator 167 (e.g., either tactile output generator 167 (FIG. 1A) or 357 (FIG. 3)). For example, amplifier 163 amplifies the received waveform to a signal level that complies with the physical specifications of tactile output generator 167 (e.g., the voltage and / or current required by tactile output generator 167 such that the signal transmitted to tactile output generator 167 generates a tactile output that corresponds to the waveform received from tactile feedback controller 161) and transmits the amplified waveform to tactile output generator 167. In response, tactile output generator 167 generates a tactile output (e.g., by shifting the movable mass back and forth in one or more dimensions relative to the movable mass's neutral position).

[0164] In some embodiments, tactile output module includes sensor 169 coupled to tactile output generator 167. Sensor 169 detects the state or state change (e.g., mechanical position, physical displacement, and / or movement) of tactile output generator 167 or one or more components of tactile output generator 167 (e.g., one or more moving parts, such as a membrane used to generate the tactile output). In some embodiments, sensor 169 is a magnetic field sensor (e.g., a Hall Effect sensor) or other displacement and / or movement sensor. In some embodiments, sensor 169 provides information (e.g., the position, displacement, and / or movement of one or more parts within tactile output generator 167) to tactile feedback controller 161, and tactile feedback controller 161 adjusts the waveform output from tactile feedback controller 161 (e.g., the waveform sent to tactile output generator 167, optionally via amplifier 163) according to the information provided by sensor 169 regarding the state of tactile output generator 167.

[0165] It should be understood that the foregoing description of event processing of a user's touch on a touch-sensitive display also applies to other forms of user input for operating multifunction device 100 using input devices, although not all of them are initiated on the touchscreen. For example, mouse movements and mouse button presses, contact movements such as tapping, dragging, scrolling on a touchpad, optionally coordinated with single or multiple keyboard presses or holds, pen stylus input, device movement, verbal commands, detected eye movement, biometric input, and / or any combination thereof are optionally utilized as inputs corresponding to sub-events that define the recognized event.

[0166] FIG. 2 illustrates portable multifunction device 100 having touchscreen 112, according to some embodiments. The touchscreen optionally displays one or more graphics within user interface (UI) 200. In this embodiment, as well as other embodiments described below, a user can select one or more of the graphics by performing a gesture on the graphics, for example, using one or more fingers 202 (not drawn to scale) or one or more styluses 203 (not drawn to scale). In some embodiments, selection of one or more graphics is performed when the user breaks contact with one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (left to right, right to left, upward and / or downward), and / or rolling of a finger in contact with device 100 (right to left, left to right, upward and / or downward). In some implementations or situations, inadvertent contact with a graphic does not select that graphic. For example, if the gesture corresponding to selection is a tap, a swipe gesture sweeping over an application icon optionally does not select the corresponding application.

[0167] Device 100 also optionally includes one or more physical buttons, such as a "home" button or menu button 204. As previously mentioned, menu button 204 is optionally used to navigate to any application 136 within a set of applications running on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key within a GUI displayed on touchscreen 112.

[0168] In some embodiments, device 100 includes touchscreen 112, menu button 204, pushbuttons 206 for powering the device on / off and locking the device, volume control buttons 208, subscriber identity module (SIM) card slot 210, headset jack 212, and external docking / charging port 124. Pushbutton 206 is optionally used to power the device on / off by pressing and holding the button down for a predetermined time interval, to lock the device by pressing and releasing the button before the predetermined time interval has elapsed, and / or to unlock the device or initiate the unlocking process. In alternative embodiments, device 100 also accepts verbal input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of a contact on touchscreen 112 and / or one or more tactile output generators 167 for generating a tactile output for a user of device 100.

[0169] FIG. 3 is a block diagram of an exemplary multifunction device having a display and a touch-sensitive surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 interconnecting these components. Communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects and controls communication between system components. Device 300 includes input / output (I / O) interface 330, including display 340, which is typically a touchscreen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350, a touchpad 355, a tactile output generator 357 (e.g., similar to tactile output generator 167 described above with reference to FIG. 1A ) that generates tactile output on device 300, and sensors 359 (e.g., light, acceleration, proximity, touch-sensing, and / or contact intensity sensors similar to contact intensity sensor 165 described above with reference to FIG. 1A ). Memory 370 includes high-speed random-access memory such as DRAM, SRAM, DDR RAM, or other random-access solid-state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU 310. In some embodiments, memory 370 stores programs, modules, and data structures similar to, or a subset of, the programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A).Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores drawing module 380, presentation module 382, ​​word processing module 384, website creation module 386, disc authoring module 388, and / or spreadsheet module 390, whereas memory 102 of portable multifunction device 100 (FIG. 1A) optionally does not store these modules.

[0170] Each of the above-identified elements of FIG. 3 is optionally stored in one or more of the memory devices mentioned above. Each of the above-identified modules corresponds to an instruction set that performs the function described above. The above-identified modules or programs (e.g., instruction sets) need not be implemented as separate software programs, procedures, or modules; thus, in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. In some embodiments, memory 370 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 370 optionally stores additional modules and data structures not described above.

[0171] Attention is now optionally directed to user interface embodiments, for example, as implemented on portable multifunction device 100.

[0172] 4A shows an exemplary user interface for a menu of applications on portable multifunction device 100, according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof: signal strength indicators 402 for wireless communications such as cellular and Wi-Fi® signals; ●Time 404, ●Bluetooth (registered trademark) indicator 405, ● Battery status indicator 406, • A tray 408 with icons for frequently used applications, such as: an icon 416 for the phone module 138 labeled "Phone," optionally including an indicator 414 of the number of missed calls or voicemail messages; an icon 418 for the email client module 140 labeled "Mail" that optionally includes an indicator 410 of the number of unread emails; ○ An icon 420 for the browser module 147, labeled "Browser", and ○ An icon 422 labeled "iPod" for the video and music player module 152, also known as the iPod (trademark of Apple Inc.) module 152; and ● Icons for other applications, such as: ○ Icon 424 for IM module 141, labeled "Messages"; ○ An icon 426 for the calendar module 148, labeled "Calendar"; ○ Icon 428 for the image management module 144, labeled "Photos" ○ Icon 430 for camera module 143, labeled "Camera" ○ Icon 432 for the online video module 155, labeled "Online Video" Icon 434 for stock price widget 149-2, labeled "Stock Price" ○ Icon 436 for map module 154, labeled "Map" ○ Icon 438 for weather widget 149-1, labeled "Weather" ○ Icon 440 for alarm clock widget 149-4, labeled "Clock" ○ Icon 442 for Training Support Module 142, labeled "Training Support"; ○ An icon 444 for the notes module 153, labeled "Notes," and An icon 446 for a settings application or module, labeled "Settings," that provides access to settings for the device 100 and its various applications 136.

[0173] 4A are merely exemplary. For example, icon 422 for video and music player module 152 is labeled "Music" or "Music Player," although other labels are optionally used for the various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label for a particular application icon is different from the name of the application corresponding to that particular application icon.

[0174] 4B shows an example user interface on a device (e.g., device 300 of FIG. 3 ) that has touch-sensitive surface 451 (e.g., tablet or touchpad 355 of FIG. 3 ) that is separate from display 450 (e.g., touchscreen display 112). Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) that detect the intensity of a contact on touch-sensitive surface 451, and / or one or more tactile output generators 357 that generate a tactile output for a user of device 300.

[0175] Although some of the following examples are given with reference to input on touchscreen display 112 (which combines a touch-sensitive surface and a display), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display shown in FIG. 4B . In some embodiments, the touch-sensitive surface (e.g., 451 in FIG. 4B ) has a primary axis (e.g., 452 in FIG. 4B ) that corresponds to a primary axis (e.g., 453 in FIG. 4B ) on the display (e.g., 450). According to these embodiments, the device detects contact with touch-sensitive surface 451 (e.g., 460 and 462 in FIG. 4B ) at locations that correspond to respective locations on the display (e.g., in FIG. 4B , 460 corresponds to 468 and 462 corresponds to 470). In this way, user input (e.g., contacts 460 and 462 and their movement) detected by the device on the touch-sensitive surface (e.g., 451 in FIG. 4B ) is used by the device to operate a user interface on the display (e.g., 450 in FIG. 4B ) of the multifunction device when the touch-sensitive surface is separate from the display. It should be understood that similar methods are optionally used for the other user interfaces described herein.

[0176] Additionally, while the following examples are given primarily with reference to finger input (e.g., finger contacts, finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of the finger inputs are replaced with input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced with a mouse click (e.g., instead of a contact) followed by movement of a cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced with a mouse click while the cursor is located over the location of the tap gesture (e.g., instead of detecting a contact and then ceasing contact detection). Similarly, it should be understood that when multiple user inputs are detected simultaneously, multiple computer mice are optionally used simultaneously, or a mouse and finger contacts are optionally used simultaneously.

[0177] FIG. 5A shows an exemplary personal electronic device 500. Device 500 includes a main body 502. In some embodiments, device 500 can include some or all of the features described with respect to devices 100 and 300 (e.g., FIGS. 1A-4B ). In some embodiments, device 500 has a touch-sensitive display screen 504, hereafter touch screen 504. Alternatively, or in addition to touch screen 504, device 500 has a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors that detect the intensity of contact (e.g., touch) being applied. The one or more intensity sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of the touch. A user interface of device 500 can respond to a touch based on the intensity of the touch, meaning that touches of different intensities can invoke different user interface actions on device 500.

[0178] Exemplary techniques for detecting and processing touch intensity can be found, for example, in International Patent Application No. PCT / US2013 / 040061, filed May 8, 2013, entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application," published as International Patent Application No. WO / 2013 / 169849, and related applications, including International Patent Application No. PCT / US2013 / 069483, filed November 11, 2013, entitled "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships," published as International Patent Application No. WO / 2014 / 105276, each of which is incorporated herein by reference in its entirety.

[0179] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, may be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, may allow device 500 to be attached to, for example, hats, eyewear, earrings, necklaces, shirts, jackets, bracelets, watch bands, chains, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow device 500 to be worn by a user.

[0180] FIG. 5B illustrates an exemplary personal electronic device 500. In some embodiments, device 500 can include some or all of the components described with respect to FIGS. 1A, 1B, and 3. Device 500 has a bus 512 that operably couples an I / O section 514 to one or more computer processors 516 and a memory 518. I / O section 514 can be connected to a display 504, which can have touch-sensing components 522 and, optionally, an intensity sensor 524 (e.g., a contact intensity sensor). Additionally, I / O section 514 can be connected to a communication unit 530 that receives application and operating system data using Wi-Fi, Bluetooth, near-field communication (NFC), cellular, and / or other wireless communication techniques. Device 500 can include input mechanisms 506 and / or 508. Input mechanism 506 is optionally a rotatable input device or a depressible and rotatable input device, for example. In some examples, input mechanism 508 is optionally a button.

[0181] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which may be operably connected to the I / O section 514.

[0182] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, can cause the computer processors to perform the techniques described below, including, for example, processes 800, 1000, 1200, and 1400 (FIGS. 8, 10, 12, and 14). A computer-readable storage medium may be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments, the storage medium is a transient computer-readable storage medium. In some embodiments, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic, optical, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CDs, DVDs, or Blu-ray technology, as well as resident solid-state memory such as flash, solid-state drives, and the like. Personal electronic device 500 is not limited to the components and configuration of FIG. 5B and may include other or additional components in multiple configurations.

[0183] As used herein, the term "affordance" optionally refers to a user-interactive graphical user interface object displayed on a display screen of device 100, 300, and / or 500 (FIGS. 1A, 3, and 5A-5B). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each, optionally, constitute an affordance.

[0184] As used herein, the term “focus selector” refers to an input element that indicates the current portion of the user interface with which the user is interacting. In some implementations involving a cursor or other position marker, the cursor acts as the “focus selector,” such that when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 of FIG. 3 or touch-sensitive surface 451 of FIG. 4B) while the cursor is positioned over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations involving a touchscreen display (e.g., touch-sensitive display system 112 of FIG. 1A or touchscreen 112 of FIG. 4A) that allows direct interaction with user interface elements on the touchscreen display, a detected contact on the touchscreen acts as the “focus selector,” such that when input (e.g., a press input by contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, the particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one region of the user interface to another region of the user interface without a corresponding cursor movement or contact movement on the touchscreen display (e.g., by using the tab key or arrow keys to move focus from one button to another), and in these implementations, the focus selector moves to follow the movement of focus between various regions of the user interface. Regardless of the particular form the focus selector takes, the focus selector is generally a user interface element (or contact on a touchscreen display) that is controlled by the user (e.g., by indicating to the device the element of the user interface with which the user intends to interact) to communicate the user's intended interaction with the user interface.For example, the position of a focus selector (e.g., a cursor, touch, or selection box) over a respective button while a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen) indicates that the user intends to activate the respective button (rather than other user interface elements shown on the device's display).

[0185] As used herein and in the claims, the term "characteristic intensity" of a contact refers to a characteristic of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on a plurality of intensity samples. The characteristic intensity is optionally based on a predetermined number of intensity samples, i.e., a set of intensity samples collected during a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predetermined event (e.g., after detecting the contact, before detecting lift-off of the contact, before or after detecting the start of contact movement, before detecting the end of the contact, before or after detecting an increase in the intensity of the contact, and / or before or after detecting a decrease in the intensity of the contact). The characteristic intensity of the contact is optionally based on one or more of the maximum intensity of the contact, the mean intensity of the contact, the average intensity of the contact, the top 10 percentile intensity of the contact, half the maximum intensity of the contact, 90 percent of the maximum intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action is performed by the user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, a contact having a characteristic intensity that does not exceed the first threshold results in a first action, a contact having a characteristic intensity that exceeds the first intensity threshold but not the second intensity threshold results in a second action, and a contact having a characteristic intensity that exceeds the second threshold results in a third action. In some embodiments, the comparison between the characteristic intensity and the one or more thresholds is not used to determine whether the first action or the second action should be performed, but rather is used to determine whether one or more actions should be performed (e.g., whether to perform the respective action or to forgo performing the respective action).

[0186] FIG. 5C illustrates detecting multiple contacts 552A-552E on the touch-sensitive display screen 504 by multiple intensity sensors 524A-524D. FIG. 5C also includes an intensity diagram showing the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, intensity sensors 524A and 524D each measure 9 intensity units, and intensity sensors 524B and 524C each measure 7 intensity units. In some implementations, the aggregate intensity is the sum of the intensity measurements of multiple intensity sensors 524A-524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned a respective intensity that is a fraction of the aggregate intensity. FIG. 5D illustrates assigning aggregate intensities to contacts 552A-552E based on their distance from the center of force 554. In this example, contacts 552A, 552B, and 552E are each assigned a contact intensity of 8 intensity units of aggregate intensity, and contacts 552C and 552D are each assigned a contact intensity of 4 intensity units of aggregate intensity. More generally, in some implementations, each contact j is assigned a respective intensity Ij, which is a fraction of a total intensity A, according to a predetermined mathematical function Ij=A·(Dj / ΣDi), where Dj is the distance from the center of force to the respective contact j, and ΣDi is the sum of the distances from the center of force to all respective contacts (e.g., i=1 through last). The operations described with reference to FIGS. 5C-5D can be performed using electronic devices similar to or identical to device 100, 300, or 500. In some embodiments, the characteristic intensity of a contact is based on one or more intensities of the contact. In some embodiments, an intensity sensor is used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). Note that the intensity diagrams are not part of the displayed user interface, but are included in FIGS. 5C-5D as an aid to the reader.

[0187] In some embodiments, a portion of the gesture is identified for purposes of determining the characteristic intensity. For example, the touch-sensitive surface optionally receives successive swipe contacts that transition from a start position to an end position, at which point the intensity of the contacts increases. In this example, the characteristic intensity of the contacts at the end position is optionally based on only a portion of the successive swipe contacts (e.g., only the portion of the swipe contacts at the end position) rather than the entire swipe contact. In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contacts before determining the characteristic intensity of the contacts. For example, the smoothing algorithm optionally includes one or more of an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms eliminate small increases or decreases in the intensity of the swipe contacts for purposes of determining the characteristic intensity.

[0188] The intensity of a contact on the touch-sensitive surface is optionally characterized with respect to one or more intensity thresholds, such as a contact-detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device performs an action typically associated with clicking a physical mouse button or trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device performs an action different from an action typically associated with clicking a physical mouse button or trackpad. In some embodiments, when a contact is detected having a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact-detection intensity threshold below which the contact is not detected), the device moves the focus selector in accordance with the movement of the contact on the touch-sensitive surface without performing an action associated with the light press intensity threshold or the deep press intensity threshold. In general, unless otherwise specified, these intensity thresholds are consistent across the various sets of user interface diagrams.

[0189] An increase in the characteristic intensity of a contact from an intensity below the light pressure intensity threshold to an intensity between the light pressure intensity threshold and the deep pressure intensity threshold may be referred to as inputting a "light press." An increase in the characteristic intensity of a contact from an intensity below the deep pressure intensity threshold to an intensity above the deep pressure intensity threshold may be referred to as inputting a "deep press." An increase in the characteristic intensity of a contact from an intensity below the contact-detection intensity threshold to an intensity between the contact-detection intensity threshold and the light pressure intensity threshold may be referred to as detecting a contact on the touch surface. A decrease in the characteristic intensity of a contact from an intensity above the contact-detection intensity threshold to an intensity below the contact-detection intensity threshold may be referred to as detecting a lift-off of the contact from the touch surface. In some embodiments, the contact-detection intensity threshold is zero. In some embodiments, the contact-detection intensity threshold is greater than zero.

[0190] In some embodiments described herein, one or more actions are performed in response to detecting a gesture including the respective pressure input or in response to detecting the respective pressure input performed by the respective contact(s), where the respective pressure inputs are detected based at least in part on detecting an increase in intensity of the contact(s) above a pressure input intensity threshold. In some embodiments, the respective actions are performed in response to detecting an increase in intensity of the respective contact(s) above a pressure input intensity threshold (e.g., a “downstroke” of the respective pressure input). In some embodiments, the pressure input includes an increase in intensity of the respective contact(s) above a pressure input intensity threshold followed by a decrease in intensity of the contact(s) below the pressure input intensity threshold, and the respective actions are performed in response to detecting a subsequent decrease in intensity of the respective contact(s) below the pressure input threshold (e.g., an “upstroke” of the respective pressure input).

[0191] 5E-5H illustrate the detection of a gesture including a press input corresponding to an increase in the intensity of contact 562 from an intensity below a light press intensity threshold (e.g., "ITL") in FIG. 5E to an intensity above a deep press intensity threshold (e.g., "ITD") in FIG. 5H. The gesture performed by contact 562 is detected on touch-sensitive surface 560, and cursor 576 is displayed over application icon 572B corresponding to app2 on display user interface 570, which includes application icons 572A-572D displayed within predetermined region 574. In some embodiments, the gesture is detected on touch-sensitive display 504. An intensity sensor detects the intensity of the contact on touch-sensitive surface 560. The device determines that the intensity of contact 562 peaks above a deep press intensity threshold (e.g., "ITD"). Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, following contact 562 having an intensity above a deep press intensity threshold (e.g., "ITD") during the gesture, reduced representations 578A-578C (e.g., thumbnails) of recently opened documents are displayed for app2, as shown in FIGS. 5F-5H. In some embodiments, this intensity, which is compared to one or more intensity thresholds, is a characteristic intensity of the contact. Note that the intensity diagrams for contact 562 are not part of the displayed user interface, but are included in FIGS. 5E-5H as an aid to the reader.

[0192] In some embodiments, the display of representations 578A-578C includes animation. For example, as shown in FIG. 5F, representation 578A is first displayed adjacent to application icon 572B. As the animation progresses, representation 578A moves upward and representation 578B is displayed adjacent to application icon 572B, as shown in FIG. 5G. Then, as shown in FIG. 5H, representation 578A moves upward, representation 578B moves upward toward representation 578A, and representation 578C is displayed adjacent to application icon 572B. Representations 578A-578C form an array above icon 572B. In some embodiments, the animation progresses according to the intensity of contact 562, as shown in FIGS. 5F-5G, with representations 578A-578C appearing and moving upward as the intensity of contact 562 increases toward a deep press intensity threshold (e.g., "ITD"). In some embodiments, the intensity on which the animation progression is based is a characteristic intensity of the contact. The operations described with reference to FIGS. 5E-5H may be performed using an electronic device similar to or identical to device 100, 300, or 500.

[0193] In some embodiments, the device employs intensity hysteresis to avoid accidental input, sometimes referred to as “jitter,” and the device defines or selects a hysteresis intensity threshold that has a predetermined relationship to the pressure input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units below the pressure input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the pressure input intensity threshold). Thus, in some embodiments, the pressure input includes an increase in the intensity of each contact above the pressure input intensity threshold, followed by a decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the pressure input intensity threshold, and a respective action is performed in response to detecting a subsequent decrease in the intensity of each contact below the hysteresis intensity threshold (e.g., an “upstroke” of each pressure input). Similarly, in some embodiments, a pressure input is detected only when the device detects an increase in the intensity of the contact from an intensity below the hysteresis intensity threshold to an intensity above the pressure input intensity threshold, and optionally a subsequent decrease in the intensity of the contact to an intensity below the hysteresis intensity, and a respective action is performed in response to detecting the pressure input (e.g., an increase in the intensity of the contact or a decrease in the intensity of the contact, as the case may be).

[0194] For ease of explanation, descriptions of operations performed in response to a pressure input associated with a pressure input intensity threshold, or a gesture including a pressure input, are optionally triggered in response to detecting any of: an increase in the intensity of the contact above the pressure input intensity threshold, an increase in the intensity of the contact from an intensity below a hysteresis intensity threshold to an intensity above the pressure input intensity threshold, a decrease in the intensity of the contact below the pressure input intensity threshold, and / or a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to the pressure input intensity threshold. Further, in examples where an operation is described as being performed in response to detecting a decrease in the intensity of the contact below a pressure input intensity threshold, the operation is optionally performed in response to detecting a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to and lower than the pressure input intensity threshold.

[0195] As used herein, an "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to run (e.g., opened) on the device. In some embodiments, a downloaded application becomes an installed application by an installation program that extracts program portions from a downloaded package and integrates the extracted portions with the computer system's operating system.

[0196] As used herein, the terms "open application" or "running application" refer to a software application that has state information maintained (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or running application is, optionally, any one of the following types of application: ● the active application currently displayed on the display screen of the device on which the application is being used; background applications (or background processes) that are not currently displayed, but for which one or more processes are being processed by one or more processors; and A suspended or hibernated application that is not running but has state information stored in memory (volatile and non-volatile, respectively) and that can be used to resume execution of the application.

[0197] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., no state information for a closed application is stored in the device's memory). Thus, closing an application includes stopping and / or removing the application process for the application and removing state information for the application from the device's memory. Generally, opening a second application during a first application does not close the first application. When the second application is displayed and the first application ceases to display, the first application becomes a background application.

[0198] Attention is now directed to embodiments of user interfaces (“UIs”) and associated processes implemented in an electronic device such as portable multifunction device 100, device 300, or device 500.

[0199] 6 illustrates exemplary devices connected via one or more communication channels to engage in a transaction, according to some embodiments. One or more exemplary electronic devices (e.g., devices 100, 300, and 500) are optionally configured to detect input (e.g., specific user input, NFC field) and optionally transmit payment information (e.g., using NFC). One or more electronic devices are optionally configured to include NFC hardware and be NFC-enabled.

[0200] An electronic device (e.g., devices 100, 300, and 500) is optionally configured to store payment account information associated with each of one or more payment accounts. The payment account information includes, for example, one or more of a person's or company's name, a billing address, a login, a password, an account number, an expiration date, a security code, a telephone number, a bank (e.g., an issuing bank) associated with the payment account, and a card network identifier. In some examples, the payment account information includes an image, such as a photo of a payment card (e.g., taken by and / or received at the device). In some examples, the electronic device receives user input including at least some payment account information (e.g., receives a credit, debit, account, or gift card number and expiration date entered by a user). In some examples, the electronic device detects at least some payment account information from an image (e.g., of a payment card captured by a camera sensor of the device). In some examples, the electronic device receives at least some payment account information from another device (e.g., another user device or a server). In some examples, the electronic device receives payment account information from a server associated with another service (e.g., an app for renting or selling audio and / or video files) to which the user or user device or account for the identified payment account data previously made a purchase.

[0201] In some embodiments, a payment account is added to an electronic device (e.g., devices 100, 300, and 500), whereby the payment account information is securely stored on the electronic device. In some examples, after a user initiates such a process, the electronic device transmits information about the payment account to a transaction coordination server, which then communicates with a server operated by the payment network for the account (e.g., a payment server) to ensure the validity of the information. The electronic device is optionally configured to receive a script from the server that enables the electronic device to program the payment information for the account onto the secure element.

[0202] In some embodiments, communication between electronic devices 100, 300, and 500 facilitates transactions (e.g., general or specific transactions). For example, a first electronic device (e.g., 100) can act as a provisioning or management device and send notifications of new or updated payment account data (e.g., information about new accounts, updated information about existing accounts, and / or alerts for existing accounts) to a second electronic device (e.g., 500). In another example, a first electronic device (e.g., 100) can send data to a second electronic device, the data reflecting information about a payment transaction facilitated at the first electronic device. The information optionally includes one or more of the payment amount, the account used, the time of purchase, and whether the default account has changed. The second device (e.g., 500) optionally uses such information to update the default payment account (e.g., based on a learning algorithm or explicit user input).

[0203] The electronic devices (e.g., 100, 300, 500) are configured to communicate with each other over any of a variety of networks. For example, the devices communicate using a Bluetooth connection 608 (including, e.g., a conventional Bluetooth connection or a Bluetooth low energy connection) or a WiFi network 606. Communications between user devices are optionally coordinated to reduce the likelihood of inappropriate sharing of information between devices. For example, communications regarding payment information require the communicating devices to be paired (e.g., associated with each other through explicit user interaction) or associated with the same user account.

[0204] In some embodiments, the electronic device (e.g., 100, 300, 500) is used to communicate with a point-of-sale (POS) payment terminal 600, which is optionally NFC-enabled. This communication optionally occurs using various communication channels and / or technologies. In some examples, the electronic device (e.g., 100, 300, 500) communicates with the payment terminal 600 using an NFC channel 610. In some examples, the payment terminal 600 communicates with the electronic device (e.g., 100, 300, 500) using a peer-to-peer NFC mode. The electronic device (e.g., 100, 300, 500) is optionally configured to send a signal to the payment terminal 600 that includes payment information for a payment account (e.g., a default account or an account selected for a particular transaction).

[0205] In some embodiments, proceeding with the transaction includes transmitting a signal including payment information for an account, such as a payment account. In some embodiments, proceeding with the transaction includes reconfiguring the electronic device (e.g., 100, 300, 500) to respond as a contactless payment card, such as an NFC-enabled contactless payment card, and then transmitting the account credentials via NFC to the payment terminal 600, etc. In some embodiments, after transmitting the account credentials via NFC, the electronic device reconfigures itself to not respond as a contactless payment card (e.g., requires authorization before again reconfiguring to respond as a contactless payment card via NFC).

[0206] In some embodiments, the generation and / or transmission of the signal is controlled by a secure element within the electronic device (e.g., 100, 300, 500). The secure element optionally requires a specific user input before releasing the payment information. For example, the secure element optionally requires detecting that the electronic device is being worn, detecting a button press, detecting the entry of a passcode, detecting a touch, detecting the selection of one or more options (e.g., received during interaction with an application), detecting a fingerprint signature, detecting a voice or voice command, and / or detecting a gesture or movement (e.g., rotation or acceleration). In some examples, if a communication channel (e.g., an NFC communication channel) with another device (e.g., payment terminal 600) is established within a defined period of time from detecting the input, the secure element releases the payment information to be transmitted to the other device (e.g., payment terminal 600). In some examples, the secure element is a hardware component that controls the release of the secure information. In some examples, the secure element is a software component that controls the release of the secure information.

[0207] In some embodiments, the protocols involved in engaging in a transaction depend, for example, on the device type. For example, the states for generating and / or transmitting payment information may be different for a wearable device (e.g., device 500) and a phone (e.g., device 100). For example, the generate and / or transmit state for a wearable device may include detecting a button press (e.g., after security verification), while a corresponding state for a phone may not require a button press but instead detection of a specific interaction with an application. In some examples, the states for transmitting and / or publishing payment information may include receiving specific inputs on each of multiple devices. For example, publishing payment information optionally requires detection of a fingerprint and / or passcode on a device (e.g., device 100) and detection of a mechanical input (e.g., a button press) on another device (e.g., device 500).

[0208] The payment terminal 600 optionally uses the payment information to generate a signal that it sends to a payment server 604 to determine whether the payment is authorized. The payment server 604 optionally includes any device or system configured to receive payment information associated with a payment account and determine whether the proposed purchase is authorized. In some examples, the payment server 604 includes a server of an issuing bank. The payment terminal 600 communicates with the payment server 604 directly or indirectly via one or more other devices or systems (e.g., a server of an acquiring bank and / or a server of a card network).

[0209] The payment server 604 optionally uses at least some of the payment information to identify a user account in a database of user accounts (e.g., 602). For example, each user account includes payment information. The account is optionally identified by identifying an account with specific payment information that matches the payment information from the POS communication. In some examples, the payment is denied when the provided payment information does not match (e.g., the expiration date does not correspond to a credit, debit, or gift card number) or when there is no account with payment information that matches the payment information from the POS communication.

[0210] In some embodiments, the data about the user account further identifies one or more limits (e.g., credit limit), current or previous balance, previous transaction date, location, and / or amount, account status (e.g., active or frozen), and / or authorization instructions. In some examples, the payment server (e.g., 604) uses such data to determine whether to authorize a payment. For example, the payment server denies a payment when the purchase amount added to the current balance would exceed the account limit, when the account is frozen, when the previous transaction amount exceeds a threshold, or when the number or frequency of previous transactions exceeds a threshold.

[0211] In some embodiments, the payment server 604 responds to the POS payment terminal 600 with an indication as to whether the proposed purchase was authorized or denied. In some examples, the POS payment terminal 600 sends a signal to the electronic device (e.g., 100, 300, 500) to identify the outcome. For example, the POS payment terminal 600 sends a receipt to the electronic device (e.g., 100, 300, 500) (e.g., via a transaction collaboration server managing a transaction app on the user device) when the purchase is authorized. In some cases, the POS payment terminal 600 presents an output (e.g., a visual or audio output) indicating the outcome. Payment can be sent to the merchant as part of the authorization process or can be sent at a later time.

[0212] In some embodiments, the electronic device (e.g., 100, 300, 500) participates in a transaction that is completed without the intervention of the POS payment terminal 600. For example, upon detecting that machine input has been received, a secure element within the electronic device (e.g., 100, 300, 500) exposes payment information and allows an application on the electronic device to access the information (e.g., transmit the information to a server associated with the application).

[0213] In some embodiments, the electronic device (e.g., 100, 300, 500) is in a locked or unlocked state. In the locked state, the electronic device is powered on and operational, but is prevented from performing a predetermined set of operations in response to user input. The predetermined set of operations optionally includes navigation between user interfaces, activation or deactivation of a predetermined set of functions, and activation or deactivation of specific applications. The locked state can be used to prevent unintended or unauthorized use of some functionality of the electronic device, or activation or deactivation of certain functions on the electronic device. In the unlocked state, the electronic device 100 is powered on and operational, and is not prevented from performing at least a portion of the predetermined set of operations that cannot be performed in the locked state.

[0214] When a device is in a locked state, the device is said to be locked. In some embodiments, a device in a locked state is responsive to a limited set of user inputs, optionally including inputs corresponding to an attempt to transition the device from an unlocked state or inputs corresponding to powering off the device.

[0215] In some examples, the secure element (e.g., 115) is a hardware component (e.g., a secure microcontroller chip) configured to securely store data or algorithms, such that the securely stored data cannot be accessed by a device without proper authentication information from a user of the device. Keeping the securely stored data within the secure element separate from other storage on the device prevents access to the securely stored data even if other storage locations on the device are compromised (e.g., by malicious code or other attempts to compromise information stored on the device). In some examples, the secure element provides (or reveals) payment information (e.g., account number and / or transaction-specific dynamic security code). In some examples, the secure element provides (or discloses) payment information in response to the device receiving authentication, such as user authentication (e.g., fingerprint authentication, passcode authentication, detecting a double press of a hardware button when the device is in an unlocked state and, optionally, when the device is continuously on the user's wrist since the device was unlocked by providing authentication credentials to the device; the continuous presence of the device on the user's wrist is determined by periodically checking that the device is in contact with the user's skin). For example, the device detects a fingerprint with a fingerprint sensor (e.g., a fingerprint sensor integrated into a button) on the device. The device determines whether the fingerprint matches a registered fingerprint. Following a determination that the fingerprint matches the registered fingerprint, the secure element provides (or discloses) payment information. Following a determination that the fingerprint does not match the registered fingerprint, the secure element refrains from providing (or disclosing) payment information.

[0216] Attention is now directed to embodiments of user interfaces (“UIs”) and related processes implemented on an electronic device such as portable multifunction device 100, device 300, or device 500.

[0217] 7A-7AD illustrate example user interfaces that provide an indication of an error condition during biometric authentication, according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS. 8A-8B.

[0218] FIG. 7A illustrates electronic device 700 (e.g., portable multifunction device 100, device 300, or device 500). In the exemplary implementations illustrated in FIGS. 7A-7AD, electronic device 700 is a smartphone. In other implementations, electronic device 700 may be a different type of electronic device, such as a tablet (e.g., electronic device 900). Electronic device 700 includes a display 702, one or more input devices (e.g., a touchscreen on display 702, buttons 704, and a microphone), a wireless radio, and a biometric sensor 703. Electronic device 700 includes biometric sensor 703. In some implementations, biometric sensor 703 includes one or more biometric sensors that may include a camera, such as a depth camera (e.g., an infrared camera), a thermographic camera, or a combination thereof. In some examples, biometric sensor 703 includes a biometric sensor (e.g., a facial recognition sensor) such as those described in U.S. Patent Application No. 14 / 341,860, "Overlapping Pattern Projector," filed July 14, 2014, U.S. Patent Publication No. 2016 / 0025993, and U.S. Patent Application No. 13 / 810,451, "Scanning Projects and Image Capture Modules For 3D Mapping," U.S. Patent No. 9,098,931, which are incorporated by reference herein in their entireties for all purposes. In some examples, biometric sensor 703 includes one or more fingerprint sensors (e.g., a fingerprint sensor integrated into a button). In some examples, electronic device 700 further includes a lighting device (e.g., a light projector), such as an IR flood light, a structured light projector, or a combination thereof. The lighting device is optionally used to illuminate a biometric feature (e.g., a face) during capture of biometric data of the biometric feature by biometric sensor 703. In some embodiments, electronic device 700 includes multiple cameras that are separate from biometric sensor 703. In some embodiments, electronic device 700 includes only one camera that is separate from biometric sensor 703.

[0219] In FIG. 7A , a user learns from notification 708 that they have received a message from John Appleseed. The user wants to view the restricted content of notification 708 (e.g., the message from John Appleseed), but is unable to do so because electronic device 700 is currently in a locked state. Electronic device 700 displays a locked user interface (UI) with a lock icon 706, which provides an indication that electronic device 700 is in a locked state. Viewing the restricted content of notification 708 requires successful authentication (e.g., a determination that information (or data) about a biometric characteristic acquired using biometric sensor 703 corresponds to (or matches) a stored authorized credential). To view the restricted content of notification 708, the user lifts (or raises) electronic device 700 (e.g., from a substantially horizontal orientation to an orientation of the device as depicted in the user's hand in FIG. 7A ). Electronic device 700 detects the change in orientation of electronic device 700 and, in response, initiates biometric authentication. In some examples, the electronic device 700 determines that the biometric authentication is successful after the biometric authentication is initiated. In some examples, the electronic device 700 transitions from a locked state to an unlocked state and displays the restricted content of the notification 708 upon determining that the biometric authentication is successful.

[0220] After initiating biometric authentication (e.g., before successful authentication), the electronic device 700 determines whether a face is detected by the biometric sensor 703. In FIG. 7B , upon determining that a face is detected, the electronic device 700 displays an authentication glyph 710 including multiple rings rotating in a spherical shape. The authentication glyph 710 provides an indication that biometric authentication is being performed. In some embodiments, the electronic device 700 displays an animation of the lock icon 706 morphing into the authentication glyph 710. In some embodiments, upon determining that a face is not detected using the biometric sensor 703, the electronic device 700 remains locked and does not display the authentication glyph 710.

[0221] After detecting the presence of a face, the electronic device 700 determines that authentication failed due to a failure to acquire sufficient information about the user's face using the biometric sensor 703. Specifically, as shown in FIG. 7B , the biometric sensor 703 is positioned outside the allowed distance range 712 (e.g., beyond a maximum threshold range), resulting in a failure to acquire sufficient information about the user's face. When the electronic device 700 determines that biometric authentication failed due to the user's face being outside the allowed distance range 712, the electronic device 700 maintains the device in a locked state and does not display the restricted content of the notification 708. In some embodiments, when the electronic device 700 determines that authentication failed and no error condition exists, the electronic device 700 maintains the device in a locked state and does not display the restricted content of the notification 708. In some embodiments, when the electronic device 700 determines that authentication failed (e.g., due to the captured biometric information not matching an authorized biometric profile (e.g., a stored authorized credential)) and no error condition exists (e.g., no condition preventing the capture of sufficient biometric information), the electronic device 700 maintains the locked state and automatically retries biometric authentication. In some embodiments, while retrying biometric authentication, the electronic device 700 continues to display the authentication glyph 710 of FIG. 7B.

[0222] As shown in FIGS. 7C-7G, when the electronic device 700 determines that biometric authentication has failed because the user's face is outside the acceptable distance range 712, the electronic device 700 displays an animation in which the authentication glyph 710 morphs into an error indication 714A, replacing the display of the authentication glyph 710. In FIG. 7G, the electronic device 700 displays the error indication 714A, which prompts the user to take action to correct the error condition underlying the error indication 714A. Specifically, the user indication 714A prompts the user to move their face closer to the biometric sensor 703. The error indication 714A also suggests to the user that the user's face is too far from the biometric sensor 703, which is the cause of the error indication 714A. As long as the user's face is outside the acceptable distance range 712, the electronic device 700 continues to determine that the error indication 714A is present. If the electronic device 700 determines that the error indication 714A is still present, the electronic device 700 does not attempt to retry the biometric authentication. Note that the electronic device 700 displays the error indication 714A in a location consistent with the location of the lock icon 706 in Figure 7A. Additionally, the electronic device 700 displays the error indication 714A in a portion of the display 702 adjacent to the biometric sensor 703 to indicate to the user that the error indication 714A is associated with (or corresponds to) the biometric sensor 703.

[0223] As shown in Figure 7H, after being prompted to correct the error indication 714A, the user moves their face closer to the biometric sensor 703 so that their face is within the acceptable distance range 712. In Figure 7H, the electronic device determines that the error indication 714A is no longer present. Upon determining that the error indication 714A is no longer present, the electronic device 700 enables biometric authentication on the device and automatically retries the biometric authentication using the biometric sensor 703.

[0224] In response to automatically retrying biometric authentication, the electronic device 700 displays an error indication 714A with a shimmer effect (e.g., animating the error indication so that one or more portions of the error indication move from side to side to create a glowing effect) to indicate that the electronic device 700 is again attempting to biometrically authenticate the user. FIGS. 7H-7L depict an animation of the error indication 714A with a shimmer effect. In some examples, instead of displaying the error indication 714A with a shimmer effect, the electronic device 700 displays an authentication glyph 710 indicating that the electronic device 700 is again attempting to biometrically authenticate the user (e.g., replacing the display of the error indication 714A with the authentication glyph 710). Thus, in some examples, instead of the error indication 714A morphing into the lock icon 706, the electronic device 700 displays an animation of the authentication glyph 710 morphing into the lock icon 706.

[0225] In FIG. 7L, after retrying biometric authentication, the electronic device 700 successfully authenticates the user. In response to the successful biometric authentication, the electronic device 700 transitions the device from a locked state to an unlocked state. During the transition from the locked state to the unlocked state, the electronic device 700 displays an animation of the error indication 714A morphing into a lock icon 706, as depicted in FIGS. 7L-7N. After displaying the animation of the error indication 714A morphing into the lock icon 706, the electronic device 700 displays an animation of the lock icon 706 transitioning into an unlock icon 716, as depicted in FIGS. 7N-7O. The unlock icon 716 provides an indication that the electronic device 700 is in the unlocked state. Furthermore, as depicted in FIG. 7O, the electronic device 700 displays restricted content of the notification 708 (e.g., "Hey, is our meeting still going?") in response to the successful biometric authentication.

[0226] In Figure 7P, instead of determining that the user's face is outside the acceptable distance range 712 as described above with respect to Figure 7B, the electronic device 700 determines that biometric authentication is not enabled on the device. Upon determining that biometric authentication is not enabled, the electronic device 700 displays the error indication 714B of Figure 7P to provide an indication that biometric authentication is not currently enabled on the device. Biometric authentication can become disabled for a variety of reasons, including more than a predetermined number of failed biometric authentication attempts (e.g., 5, 10, 15) since the last successful authentication.

[0227] With biometric authentication unavailable, the user must use an alternative method to authenticate the user. For example, the user may authenticate by entering a passcode on the electronic device 700. While displaying the error indication 714B of FIG. 7P, the electronic device 700 receives input 720 at the error indication 714B.

[0228] In FIG. 7Q, in response to receiving input 720 at error indication 714B, electronic device 700 displays passcode entry UI 722A having multiple input affordances for entering a passcode (or password).

[0229] In some embodiments, instead of determining that authentication was successful as a result of a biometric authentication retry, as described above with respect to Figures 7L-7O, the electronic device 700 determines that authentication failed. In some embodiments, if the electronic device 700 determines that authentication failed, the electronic device 700 remains locked and displays an animation of the lock icon 706 of Figure 7R moving back and forth between different positions to simulate a "shake" effect. The shake animation provides an indication to the user that biometric authentication failed and that the electronic device 700 remains locked.

[0230] After determining that authentication has failed, the user can perform an action on the electronic device 700 to trigger a biometric authentication retry. In FIG. 7S, the user triggers a biometric authentication retry with an upward swipe starting from an area near the bottom edge of the display 702. The electronic device 700 receives input 724 and responsively retries the biometric authentication. In some embodiments, after retrying the biometric authentication, the electronic device 700 determines that the authentication was successful. In some embodiments, upon determining that the authentication was successful as a result of the biometric authentication retry, the electronic device 700 transitions from a locked state to an unlocked state.

[0231] 7S-7T, the electronic device 700 determines that the authentication has failed as a result of the biometric authentication retry in response to the input 724. If the electronic device 700 determines that the authentication has failed as a result of the biometric authentication retry, the electronic device 700 displays a passcode input UI 722B in FIG.

[0232] In FIG. 7U, the electronic device 700 determines that authentication was successful as a result of retrying biometric authentication in the passcode entry UI 722B. Upon determining that authentication was successful, the electronic device transitions from the locked state to the unlocked state, as depicted in FIGS. 7U-7W. In some embodiments, in FIG. 7U, the electronic device determines that authentication was not successful as a result of retrying biometric authentication in the passcode entry UI 722B. In some embodiments, upon making this determination, the electronic device remains in the locked state.

[0233] 7X-7AD illustrate various error conditions that electronic device 700 can detect while attempting to biometrically authenticate a user. Instead of displaying error indication 714A as described above with respect to FIG. 7G, electronic device 700 can display any one of the error indications described below (e.g., error indications 714C-I). 7X-7AD also depict electronic device 700 prompting the user (e.g., via error indications 714C-I) to take action to correct the detected error condition so that electronic device 700 can retry biometric authentication of the user.

[0234] 7X, the user's face is positioned too close to the biometric sensor 703. As a result, the electronic device 700 determines that the user's face is located outside the allowable distance range 712 (e.g., below a minimum threshold range). Upon determining that the user's face is located outside the allowable distance range 712, the electronic device 700 displays an error indication 714C prompting the user to move their face away from the biometric sensor 703. The error indication 714C also provides an indication of the cause of the error condition (e.g., an indication that the user's face is too close to the biometric sensor 703).

[0235] 7Y, the user's hand is covering the biometric sensor 703. As a result, the electronic device 700 determines that an object (e.g., the user's hand) is covering the biometric sensor 703, preventing the sensor from acquiring information about the user's face. Upon determining that an object is covering the biometric sensor 703, the electronic device 700 displays an error indication 714D prompting the user to remove their hand from the biometric sensor 703. The error indication 714D also provides an indication of the cause of the error condition (e.g., an indication that the biometric sensor 703 is covered).

[0236] 7Z, the user is not looking at the electronic device 700. As a result, the electronic device 700 determines that the user's eyes are not looking at the device. Upon determining that the user's eyes are not looking at the device, the electronic device 700 displays an error indication 714E that prompts the user to look at the device and correct the error condition. The error indication 714E also provides an indication of the cause of the error condition (e.g., an indication that the user is not looking at the device).

[0237] 7AA, the user's face is within the field of view 728, but the user is wearing a hat. As a result, the electronic device 700 determines that a portion of the user's face is obscured (or occluded). For example, the electronic device 700 obtains partial information about the user's face using the biometric sensor 703, and the partial information is less than a threshold amount required for comparison to stored authorized credentials. Upon determining that a portion of the user's face is obscured, the electronic device 700 displays an error indication 714F prompting the user to remove the hat. The error indication 714F also provides an indication of the cause of the error condition (e.g., an indication that a portion of the user's face is obscured).

[0238] 7AB, the user's face is outside the field of view 728 of the biometric sensor 703. As a result, the electronic device 700 determines that the user's face is outside the field of view 728 of the biometric sensor 703. In some embodiments, the user's face is outside the field of view 728 if more than a threshold portion of the face is outside the field of view. In some embodiments, the user's face is outside the field of view 728 if no face is detected within the field of view. Upon determining that the user's face is outside the field of view 728, the electronic device 700 displays an error indication 714G that prompts the user to move their face into the field of view 728. The error indication 714G also provides an indication of the cause of the error condition (e.g., an indication that the user's face is outside the field of view 728).

[0239] 7AC, the user's face is within field of view 728 but is not facing toward biometric sensor 703. As a result, electronic device 700 determines that the user's face is not facing toward biometric sensor 703. Upon determining that the user's face is not facing toward biometric sensor 703, electronic device 700 displays error indication 714H prompting the user to face toward the sensor. Error indication 714H also provides an indication of the cause of the error condition (e.g., an indication that the user's face is not facing toward biometric sensor 703).

[0240] 7AD, the user's face is properly positioned within the field of view and within the acceptable distance range of the biometric sensor 703. However, the lighting conditions in the environment in which the user is located are not suitable for performing biometric authentication. Specifically, there is too much light, preventing biometric authentication from being performed. As a result, the electronic device 700 determines (e.g., via one or more ambient light sensors) that the amount of light exceeds a predetermined threshold. Upon determining that the amount of light exceeds the threshold, the electronic device 700 displays an error indication 714I that prompts the user to seek improved lighting conditions with less light. The error indication 714I also provides an indication of the cause of the error condition (e.g., an indication that the lighting conditions are not suitable for performing biometric authentication).

[0241] 8A-8B are flow diagrams illustrating a method for providing an indication of an error condition during biometric authentication, according to some embodiments. Method 800 is performed on an electronic device (e.g., 100, 300, 500, 700) having a display (e.g., 702) and one or more input devices (e.g., an accelerometer (e.g., 168), a touchscreen on the display (e.g., 702)). In some embodiments, the electronic device includes one or more biometric sensors (e.g., a fingerprint sensor, a contactless biometric sensor (e.g., a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris scanner). In some embodiments, the one or more biometric sensors include one or more cameras. Some operations of method 800 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0242] As described below, method 800 provides an intuitive way to provide an indication of an error condition during biometric authentication. The method reduces the cognitive burden on a user performing biometric authentication, thereby creating a more efficient human-machine interface. In battery-operated computing devices, allowing a user to perform biometric authentication more quickly and efficiently conserves power and extends the time between battery charges.

[0243] An electronic device (e.g., 100, 300, 500, 700) receives (802) a request to perform an action requiring authentication (e.g., biometric authentication) via one or more input devices (e.g., an accelerometer (e.g., 168), a touchscreen of a display (e.g., 702). In some examples, the request to perform an action requiring authentication includes a request to unlock the device (e.g., a swipe in place). In some examples, the request is triggered by lifting the device from a substantially horizontal position.

[0244] In response to 804 a request to perform an operation requiring authentication (e.g., biometric authentication), and pursuant to a determination 806 that the authentication (e.g., biometric authentication) is successful, the electronic device performs the operation. In some embodiments, authentication is successful when a user input (e.g., data obtained from one or more biometric sensors corresponding to a user's biometric features (e.g., face, finger), passcode) corresponds to (e.g., matches) an authorized credential (e.g., a registered fingerprint, face, or passcode). In some embodiments, the user input corresponds to an authorized credential when the user input matches the authorized credential.

[0245] In response to a request to perform an operation requiring authentication (e.g., biometric authentication) (804), and pursuant to a determination that the authentication (e.g., biometric authentication) was not successful and a set of error condition criteria is met (e.g., an error condition exists) (808), the electronic device (e.g., 100, 300, 500, 700) displays (810) an indication (e.g., 714A-I) of the error condition (e.g., of the set of error condition criteria) on a display (e.g., 702) and forgoes performing the operation (816). The indication includes information regarding the cause of the error condition (812). In some embodiments, authentication is not successful when user input (e.g., data obtained from one or more biometric sensors corresponding to the user's biometric features (e.g., face, finger), passcode) does not correspond to (e.g., match) an authorized credential (e.g., an enrolled fingerprint, face, or passcode). In some embodiments, when the user input does not match the authorized credentials, the user input does not correspond to the authorized credentials. In some embodiments, the set of error condition criteria includes only one criterion. Displaying an indication of the error condition provides the user with feedback regarding the current state of the device (e.g., that an error condition is preventing successful biometric authentication) and prompts the user to take further action to correct the error condition. Providing improved feedback to the user improves device usability, provides a more efficient user-device interface (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and allows the user to use the device more quickly and efficiently, thereby reducing power usage and improving device battery life. Forgoing performing an action when a biometric authentication fails and an error condition is detected also improves security and reduces instances of multiple, resource-intensive retries of a biometric authentication that is deemed to have failed due to an error condition.It improves device usability by providing improved security, makes the user-device interface more efficient (e.g., by restricting unauthorized access), and also reduces power usage and improves device battery life by limiting the execution of restricted operations.

[0246] In some embodiments, in response to a request to perform an operation requiring authentication (804), and following a determination that the authentication (e.g., biometric authentication) was not successful and a set of error condition criteria has not been met (826), the electronic device (e.g., 100, 300, 500, 700) forgoes displaying (828) an indication of the error condition on a display (e.g., 702) and forgoes performing (830) the operation.

[0247] In some examples, the indication of the error condition (e.g., 714A-I) includes an indication (e.g., a visual indication (e.g., graphic or text) 814) of a user action that can be taken to correct the error condition (e.g., for the next authentication attempt). In some examples, the indication of the user action shows how to correct the error condition for the next authentication attempt. Displaying an indication of the user action that can be taken to correct the error condition provides feedback to the user as to what action to take so that the user can biometrically authenticate on subsequent authentication attempts. Providing improved visual feedback to the user improves device usability and makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), as well as allowing the user to use the device more quickly and efficiently, thereby reducing power usage and improving device battery life. In some examples, no indicator is displayed during biometric authentication.

[0248] In some examples, the indication of the error condition (e.g., 714A-I) includes information about the cause of the error condition (e.g., an indication of a user action and / or a device state, a visual indication (e.g., graphical or textual)). Displaying an indication of the cause of the error condition provides feedback to the user as to what action to take so that the user can biometrically authenticate in a subsequent authentication attempt. Providing improved visual feedback to the user improves device usability, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

[0249] In some examples, the set of error condition criteria includes a requirement that is met when a biometric feature (e.g., a fingerprint, a face) of a first type (e.g., a type corresponding to an authorized biometric feature) is detected using one or more biometric sensors (e.g., 703) of the electronic device. In some examples, if a potentially valid biometric feature is not detected (e.g., indicating that the user is not currently engaged with the device), no error condition indication (e.g., 714A-I) is displayed. Because it is assumed that the user is not attempting biometric authentication if no biometric feature is detected, forgoing display of the error condition indication when no biometric feature is detected avoids potentially confusing the user. Thus, forgoing display of the indication in this scenario provides a more efficient user-device interface (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), as well as allowing the user to use the device more quickly and efficiently, thereby reducing power usage and improving the device's battery life.

[0250] In some embodiments, the electronic device (e.g., 100, 300, 500, 700) refrains from displaying an indication of an error condition (e.g., 714A-I) on a display (e.g., 702) following a determination that authentication (e.g., biometric authentication) is successful.

[0251] In some embodiments, after displaying an indication of the error condition (e.g., 714A-I), in accordance with a determination that the set of error condition criteria continues to be met, the electronic device (e.g., 100, 300, 500, 700) forgoes (818) any attempts at biometric authentication on the electronic device (and, optionally, disables further attempts at biometric authentication) (e.g., biometric authentication functionality is disabled on the device while the set of error condition is met). In some embodiments, after displaying an indication of the error condition, in accordance with a determination that the set of error condition criteria is no longer met, the electronic device enables (822) a retry of biometric authentication on the electronic device (e.g., the error condition no longer exists (e.g., has been corrected (e.g., by the user taking an action that corrects the error condition)). Automatically retrying biometric authentication when the set of error condition criteria is no longer met allows a user to quickly attempt biometric authentication on their own without having to explicitly request biometric authentication. By performing an optimized action when a set of conditions is met without requiring further user input, the device's usability is improved, the user's interface with the device is made more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and the device's battery life is improved by allowing the user to use the device more quickly and efficiently, thereby reducing power usage.

[0252] In some embodiments, after displaying the error condition indication, the electronic device retries (824) authentication (e.g., biometric authentication) (e.g., automatically retries authentication) in response to determining that a set of error condition criteria is no longer met. In some embodiments, retrying authentication includes attempting to match biometric information acquired by one or more biometric sensors with authorized credentials (e.g., stored data authorized for use in biometric authentication). In some embodiments, the determination that the error condition is not met occurs after (or in response to) receiving input to correct the error condition. In some embodiments, the authentication retry occurs pursuant to (or occurs only pursuant to) a determination that the error condition is not met by detecting user input that causes the error condition to not be met.

[0253] In some examples, following a determination that a set of error condition criteria is no longer satisfied (e.g., detecting that the error condition has been corrected), the electronic device (e.g., 100, 300, 500, 700) receives input (e.g., 724, 726) via one or more input devices corresponding to a request to retry authentication. In some examples, the input is a touch gesture input (e.g., a tap, a swipe (e.g., an upward swipe)), or activation of a hardware button (e.g., a power button). In some examples, in response to receiving the input corresponding to the request to retry authentication, the electronic device retries the authentication (e.g., biometric authentication) (e.g., automatically retries the authentication). In some examples, retrying the authentication includes attempting to match biometric information acquired by one or more biometric sensors with authorized credentials (e.g., stored data authorized for use in biometric authentication). In some examples, retrying the authentication includes acquiring biometric feature (e.g., face, fingerprint) data of the user using one or more biometric sensors.

[0254] In some examples, the display of the error condition indication (e.g., 714A-I) includes an animation (e.g., a flickering motion) indicating that an authentication attempt is in progress. In some examples, the authentication attempt includes attempting to detect biometric information using one or more biometric sensors. Displaying the flickering motion animation indicating that an authentication attempt is in progress provides feedback to the user regarding the current state of the device and that no further action is currently required. Providing improved visual feedback to the user improves device usability, provides a more efficient user-device interface (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and allows the user to use the device more quickly and efficiently, thereby reducing power usage and improving device battery life. In some examples, no indicator is displayed during biometric authentication.

[0255] In some embodiments, after receiving (or in response to) a request to perform an operation requiring authentication and before displaying an indication of an error condition (e.g., 714A-I), the electronic device (e.g., 100, 300, 500, 700) performs the authentication. In some embodiments, while performing the authentication, the electronic device 700 displays a first indication (e.g., 710, 714A-I) (e.g., a ring rotating around a sphere, a flickering user interface object including an indication of the error condition) on a display (e.g., 702) that the electronic device is acquiring information about the biometric feature using one or more biometric sensors (e.g., 703) of the electronic device. In some embodiments, displaying the indication of the error condition includes replacing the display of the first indication with a display of the indication of the error condition. Displaying the indication that biometric authentication is occurring provides feedback to the user regarding the current state of the device (e.g., that biometric authentication is being performed) and that the user does not need to take any action at this time. Providing improved feedback to the user improves usability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves the device's battery life by allowing the user to use the device more quickly and efficiently.

[0256] In some examples, while performing authentication, the electronic device (e.g., 100, 300, 500, 700) displays on a display (e.g., 702) a first lock icon (e.g., 706) (e.g., an icon indicating a locked state of the electronic device) and a first animation transitioning from the first lock icon to the first indication. In some examples, after displaying an indication of an error state (e.g., and pursuant to a determination that authentication was successful) and after displaying the first animation, the electronic device displays on the display (e.g., 702) a second animation (e.g., an icon indication of a locked state of the electronic device) transitioning from the indication of the error state to an unlocked icon (e.g., 716). In some examples, the first animation and the second animation depict a morphing from one object to the next. In some examples, the second animation includes displaying the first lock icon after the indication of the error state and before the unlocked icon.

[0257] In some examples, after displaying the indication of the error condition, the electronic device displays an animation on the display (e.g., 702) transitioning from the indication of the error condition to a second lock icon (e.g., 706) or from a second indication (e.g., 710, 714A-I) that the electronic device is acquiring information about the biometric feature using one or more biometric sensors of the electronic device (e.g., a ring rotating around a sphere) to a second lock icon (e.g., an icon indicating a locked state of the electronic device). In some examples, the second lock icon is the first lock icon. In some examples, the second indication is the first indication.

[0258] In some embodiments, after displaying the indication of the error condition during the authentication retry, pursuant to a determination that there is no error condition, the electronic device displays on the display a third indication (e.g., 710, 714A-I) that the electronic device is acquiring information about the biometric feature using one or more biometric sensors of the electronic device (e.g., a ring rotating around a sphere, a flickering user interface object including an indication of the error condition). In some embodiments, the third indication is the first indication.

[0259] In some embodiments, before displaying the indication of the error condition, the electronic device (e.g., 100, 300, 500, 700) displays a third lock icon (e.g., 706) on the display (e.g., 702) at a location on the display (e.g., an icon indicating a lock status of the electronic device). In some embodiments, the indication of the error condition (e.g., 714A-I) is displayed proximate to (e.g., near, adjacent to, at, within a predetermined distance from) the location on the display. In some embodiments, the third lock icon is the first lock icon and / or the second lock icon.

[0260] In some embodiments, if the electronic device is in a locked state while receiving a request to perform an operation requiring authentication, the electronic device (e.g., 100, 300, 500, 700) transitions from the locked state to the unlocked state pursuant to a determination that authentication is successful. In some embodiments, the operation requiring authentication transitions the electronic device from the locked state to the unlocked state. In some embodiments, if the electronic device is in a locked state while receiving a request to perform an operation requiring authentication, the electronic device remains in the locked state pursuant to a determination that authentication is not successful. Maintaining the device in the locked state when authentication is not successful prevents fraudulent and / or unauthorized access to the device and improves the security of the device. Improving the security measures of the device improves the usability of the device by preventing unauthorized access to content and operations, as well as allowing users to use the device more efficiently, thereby reducing power usage and improving the battery life of the device.

[0261] In some examples, if the electronic device is in a locked state while receiving a request to perform an operation requiring authentication, the electronic device (e.g., 100, 300, 500, 700) maintains the locked state and retries authentication (e.g., biometric authentication) (e.g., automatically retries authentication) in accordance with a determination that the authentication was not successful. In some examples, retrying authentication includes attempting to acquire information about a biometric feature (e.g., face, fingerprint) using one or more biometric sensors of the electronic device. In some examples, retrying authentication includes attempting to match biometric information acquired by the one or more biometric sensors with authorized credentials (e.g., stored data authorized for use in biometric authentication). In some examples, after retrying authentication, in accordance with a determination that the authentication resulting from the authentication retry was successful, the electronic device transitions from the locked state to an unlocked state. In some examples, after retrying authentication, in accordance with a determination that the authentication resulting from the authentication retry was not successful, the electronic device maintains the locked state.

[0262] In some embodiments, an electronic device (e.g., 100, 300, 500, 700) attempts authentication (e.g., biometric authentication) after receiving (or in response to) a request to perform an operation requiring authentication. In some embodiments, while attempting authentication, the electronic device displays a third indication (e.g., 710, 714A-I) (e.g., a ring rotating around a sphere) on a display (e.g., 702) that the electronic device is acquiring information about a biometric feature (e.g., face, fingerprint) using one or more biometric sensors of the electronic device. In some embodiments, this indication is a scanning animation. In some embodiments, the third indication is the first indication and / or the second indication. In some embodiments, while retrying authentication, the electronic device maintains display of the third indication on the display (e.g., 702).

[0263] In some examples, following a determination that authentication was unsuccessful resulting from an authentication retry, the electronic device displays an animation on a display (e.g., 702) having a lock icon (e.g., 706) (e.g., an icon indicating a locked state of the electronic device) oscillating between a first position and a second position, the second position being different from the first position. In some examples, the animation with the lock icon is an animation of the lock icon shaking (e.g., rotating side to side, back and forth). In some examples, the electronic device displays an animation including the lock icon to indicate a biometric authentication failure. In some examples, a tactile output is provided in combination with the shaking lock icon. In some examples, no tactile output is provided. In some examples, the electronic device (e.g., 100, 300, 500, 700) maintains a locked state of the electronic device following a determination that biometric information captured using one or more biometric sensors does not correspond to or match an authorized credential. Displaying the animation of the shaking lock icon provides feedback to the user regarding the current state of the device (e.g., that biometric authentication failed) and prompts the user to take further action. Providing improved feedback to the user improves usability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves the device's battery life by allowing the user to use the device more quickly and efficiently.

[0264] In some examples, the electronic device (eg, 100, 300, 500, 700) includes a biometric sensor (eg, 703), and the set of error condition criteria includes one or more of the following error condition criteria: The distance of the biometric feature from the biometric sensor exceeds a first predetermined threshold distance (e.g., the biometric feature (e.g., face) is too far from the biometric sensor) or exceeds a maximum distance range (e.g., 712). In some examples, exceeding the first predetermined threshold or maximum distance range correlates with a decrease or reduction in the accuracy of the information about the biometric feature acquired by the biometric sensor. In some examples, the user can correct this error condition by moving the user's face closer to the biometric sensor. The distance of the biometric feature from the biometric sensor is less than a second predetermined threshold distance (e.g., the biometric feature (e.g., face) is too close to the biometric sensor) or is below a minimum distance range (e.g., 712). In some embodiments, falling below the second predetermined threshold or minimum distance range correlates with a decrease or reduction in accuracy of the information about the biometric feature acquired by the biometric sensor. In some embodiments, the user can correct this error condition by moving their face farther away from the biometric sensor. The biometric sensor (e.g., 703) is occluded (e.g., partially occluded, fully occluded, occluded enough to inhibit operation of the sensor) (e.g., occluded by a part of the user (e.g., hand) while interacting with the electronic device). In some examples, the user can correct this error condition by removing their hand from the biometric sensor. A subportion of the detected biometric feature (e.g., the eyes of a detected face) is not pointed toward the biometric sensor (e.g., one or more eyes are not focused on the electronic device (e.g., the biometric sensor)). In some examples, the user can correct this error condition by opening the user's eyes or looking at the electronic device (e.g., the biometric sensor). At least a portion of the detected biometric feature is occluded (e.g., partially occluded, completely occluded, occluded enough to result in incomplete information about the biometric feature). In some embodiments, the user can correct this error condition by removing accessories (e.g., sunglasses) or clothing (e.g., scarf, hat) that are obscuring the user's face. • No biometric feature is detected within the field of view (e.g., 728) of the biometric sensor. The pose (e.g., orientation relative to the biometric sensor) of the detected biometric feature exceeds a threshold range (e.g., the biometric feature (e.g., face) is not facing the biometric sensor). In some examples, exceeding the threshold range correlates with a decrease or reduction in the accuracy of the information about the biometric feature acquired by the biometric sensor. In some examples, the user can correct this error condition by turning the user's face toward the electronic device (e.g., the biometric sensor). The electronic device detects (e.g., via one or more ambient light sensors) an amount of light (e.g., ambient light) that exceeds a predetermined light threshold (e.g., exceeding the predetermined light threshold is highly correlated with a decrease or reduction in accuracy of information about the biometric feature obtained by the biometric sensor). In some examples, the user can correct this error condition by turning their back to the sun to reduce the amount of light detected by the electronic device or by moving to a new location (e.g., indoors) with less ambient light.

[0265] In some embodiments, the set of error condition criteria may be a first subset of the above error conditions. For example, the first subset may include one or more error condition criteria selected from the group consisting of: a biometric feature distance exceeding a first predetermined threshold distance; a biometric feature distance less than a second predetermined threshold distance; a biometric feature being outside the field of view of a biometric sensor; and a biometric feature pose exceeding a threshold range. The first subset focuses on guiding the user to correct an error condition involving facial positioning and / or orientation. As a further example, the second subset may include one or more error condition criteria selected from the group consisting of: a biometric sensor being occluded; and a biometric feature not being detected within the field of view of a biometric sensor. The second subset focuses on guiding the user to correct an error condition in which the biometric sensor is unable to acquire information about the user's biometric feature. In another embodiment, the third subset may include one or more error condition criteria selected from the group consisting of: a detected biometric feature pose exceeding a threshold range; and a biometric sensor being occluded. The third subset focuses on error conditions that are likely to occur for devices of a particular form factor / size (eg, tablet devices (eg, iPads)).

[0266] In some examples, an electronic device (e.g., 100, 300, 500, 700) includes a biometric sensor (e.g., 703) located on a portion (e.g., location) of the electronic device (e.g., a portion not on the display). In some examples, in response to a request to perform an operation requiring authentication, the electronic device displays a progress indicator (e.g., 714A-I) on the display (e.g., 702) that includes an indication of an error condition and is proximate to (e.g., adjacent to, near, within a predetermined distance of) the portion of the electronic device. Displaying the progress indicator near the biometric sensor provides the user with feedback regarding the association of the biometric sensor with a process (e.g., an attempted authentication) occurring on the device. Specifically, the user becomes aware of the biometric sensor during biometric authentication so that the user is less likely to perform actions that interfere with the biometric sensor or, alternatively, prompts the user to take corrective action. Providing improved feedback to the user improves usability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves the device's battery life by allowing the user to use the device more quickly and efficiently.

[0267] In some examples, the indication of the error condition (e.g., 714B) includes an indication that biometric authentication is not currently enabled on the electronic device according to a determination that biometric authentication is not currently enabled on the electronic device. In some examples, biometric authentication may be disabled (or may not be enabled on the electronic device) if one or more of the following conditions are met: no successful authentication has occurred since the electronic device was turned on or restarted; the electronic device has not been unlocked for more than a predetermined time (e.g., 48 hours); a passcode has not been used to unlock the device for more than a predetermined time (e.g., 156 hours); biometric authentication using a biometric feature (e.g., face, fingerprint) has not been used to unlock the device for more than a predetermined time (e.g., 4 hours); the electronic device has received a remote lock command; biometric authentication has failed more than a predetermined number of times (e.g., 5, 10, 15) since the last successful authentication on the device; or the electronic device has received a power off and / or emergency SOS command, detecting an explicit request by the user to disable biometric authentication. Displaying an indication that biometric authentication is not currently possible provides the user with feedback on the device's current state and prompts the user to pursue alternative methods for authenticating the user. Providing improved feedback to the user improves device usability, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently.

[0268] In some embodiments, the indication that biometric authentication is not currently possible includes an affordance (e.g., 714B) (e.g., the indication is the affordance). In some embodiments, the electronic device (e.g., 100, 300, 500, 700) receives an input (e.g., 720) corresponding to the affordance, and in response to receiving the input corresponding to the affordance, the electronic device (e.g., 100, 300, 500, 700) displays a credential entry user interface (e.g., 722A) having a plurality of character input keys on a display (e.g., 702). In some embodiments, the credential entry user interface includes a virtual keypad or virtual keyboard. In some embodiments, the virtual keypad or virtual keyboard includes a plurality of character input keys.

[0269] In some examples, an electronic device (e.g., 100, 300, 500, 700) detects a condition that triggers an authentication (e.g., biometric) attempt. In some examples, the request to perform an operation requiring authentication includes a request to unlock the device (e.g., swiping in a predefined position). In some examples, in response to detecting the condition that triggers an authentication (e.g., biometric) attempt, and following a determination that the condition corresponds to an alert (e.g., 708) generated by the device without user input directed at the device (e.g., based on fulfillment of criteria other than detecting user input) while the biometric feature is available for detection by one or more biometric sensors (e.g., a face is detected within the field of view of one or more face detection sensors, such as a depth camera), the electronic device displays a fifth indication (e.g., 710) (e.g., a ring rotating around a sphere) that the electronic device is obtaining information about the biometric feature using one or more biometric sensors of the electronic device. In some examples, pursuant to a determination that the condition corresponds to an alert generated by the device without user input directed to the device (e.g., based on fulfillment of criteria other than detection of user input) while the biometric feature is not available for detection by one or more biometric sensors (e.g., no face is detected within the field of view of one or more face detection sensors, such as a depth camera), the electronic device forgoes displaying a fifth indication (e.g., a ring rotating around a sphere) that the electronic device is obtaining information about the biometric feature using one or more biometric sensors of the electronic device.In some examples, pursuant to a determination that the condition corresponds to user input directed to the device (e.g., a request not related to a notification, a request that is a touch gesture input (e.g., a tap, a swipe (e.g., 724) (e.g., an upward swipe), or activation of a hardware button (e.g., a power button))), the electronic device displays a fifth indication that the electronic device is acquiring information about the biometric feature using one or more biometric sensors of the electronic device (e.g., regardless of whether the biometric feature is available for detection by the one or more biometric sensors). Because the user likely does not intend to initiate biometric authentication if no biometric feature is detected, forgoing displaying the indication when no face is detected avoids potentially confusing the user. Thus, forgoing displaying the indication in this scenario provides a more efficient user-device interface (e.g., by assisting the user in providing appropriate input when operating / interacting with the device and reducing user errors) and, in addition, allows the user to use the device more quickly and efficiently, thereby reducing power usage and improving the device's battery life.

[0270] It should be noted that the process details described above with respect to method 800 (e.g., FIGS. 8A-C) apply equally to the methods described below. For example, method 1000, method 1200, and / or method 1400 optionally include one or more of the various method features described above with respect to method 800. For example, the error indications described with respect to method 800 (e.g., 714A-I) can be used to provide an indication of an error condition during the biometric authentication performed in the processes described with respect to methods 1000, 1200, and 1400. For the sake of brevity, these details will not be repeated below.

[0271] 9A-9U show example user interfaces that provide indications related to biometric sensors during biometric authentication, according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS. 10A-10C.

[0272] FIG. 9A illustrates electronic device 900 (e.g., portable multifunction device 100, device 300, device 500). In the illustrative example illustrated in FIGS. 9A-9U, electronic device 900 is a tablet computer. In other examples, electronic device 900 may be a different type of electronic device, such as a smartphone (e.g., electronic device 700). Electronic device 900 includes a display 902, one or more input devices (e.g., a touchscreen on display 902, button 904, and a microphone), a wireless radio, and a biometric sensor 903. Electronic device 900 includes biometric sensor 903. In some examples, biometric sensor 903 includes one or more biometric sensors that may include a camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, biometric sensor 903 includes some or all of the features of biometric sensor 703. In some examples, biometric sensor 903 includes one or more fingerprint sensors (e.g., a fingerprint sensor integrated into a button). In some examples, electronic device 900 further includes a lighting device (e.g., a light projector), such as an IR flood light, a structured light projector, or a combination thereof. The lighting device is optionally used to illuminate a biometric feature (e.g., a face) during capture of biometric data of the biometric feature by biometric sensor 903. In some examples, electronic device 900 includes multiple cameras separate from biometric sensor 903. In some examples, electronic device 900 includes only one camera separate from biometric sensor 903.

[0273] 9A , a user wishes to purchase an item using payment information stored on electronic device 900. As depicted in FIG. 9A , electronic device 900 is in split-screen (e.g., multitasking) mode. When in split-screen mode, electronic device 900 simultaneously displays an app store user interface (UI) 906 in a left region 907 of display 902 and a browser UI 908 in a right region 909 of display 902. While simultaneously displaying app store UI 906 and browser UI 908, electronic device 900 receives input 910 at a purchase affordance 912.

[0274] 9B , in response to receiving input 910 at purchase affordance 912, electronic device 900 shuffles the applications displayed in left region 907 and right region 909 of display 902. Specifically, electronic device 900 displays browser UI 908 in left region 907 and app store UI 906 in right region 909. Electronic device 900 shuffles these applications to place the application associated with the item being purchased in an area closer to biometric sensor 903. By placing browser UI 908 in left region 907, electronic device 900 provides the user with an indication of the location of biometric sensor 903, which is used to authenticate the user before authorizing payment to purchase the item. As shown in FIG. 9B , shuffling the applications also places the application associated with the item being purchased in an area closer to button 904. In some examples, if the button 904 and the biometric sensor 903 are not in close proximity (e.g., not on the same side), the electronic device 900 shuffles applications, if necessary, to place the application associated with the item being purchased in an area closer to the biometric sensor 903. In some examples, if the button 904 and the biometric sensor 903 are not in close proximity (e.g., not on the same side), the electronic device 900 shuffles applications, if necessary, to place the application associated with the item being purchased in an area closer to the button 904.

[0275] 9B , in response to receiving input 910 at purchase affordance 912, electronic device 900 dims browser UI 908 while dimming app store UI 906 more than browser UI 908. By dimming browser UI 908 less than app store UI 906, electronic device 900 indicates to the user which applications are associated with paysheet interface 914 and the product the user wishes to purchase.

[0276] Further, in response to receiving input 910 at purchase affordance 912, electronic device 900 simultaneously displays a paysheet interface 914 having information about the item being purchased and a prompt 916 prompting the user to double-click button 904 to begin the process of authorizing payment for the item. Further, in response to receiving input 910 at purchase affordance 912, electronic device 900 displays dynamic indication 918 to highlight the location of button 904. While displaying paysheet interface 914, the electronic device receives input 920 at button 904 (e.g., a double press of button 904). Prompt 916 instructs the user to provide one or more activations of button 904 (e.g., a double press of button 904). In some examples, prompt 916 is highlighted relative to one or more other displayed objects (on paysheet interface 914). In some embodiments, the dynamic indication 918 emphasizes the location of the button 904 on the device by continuously changing size (e.g., continuously becoming wider, narrower, or otherwise continuously changing in size) adjacent to the location of the button 904 on the display, thereby allowing the user to more easily identify the location of the button that corresponds to the request of the prompt 916. In some embodiments, the paysheet interface 914 includes the name of the application to which it corresponds (e.g., the name of the application with which the user initiated the process of authorizing the payment).

[0277] 9C , in response to receiving input 920 at button 904, electronic device 900 initiates a process to authorize payment for the goods. Authorizing payment for the goods requires successful authentication of the user. As a result, in response to receiving input 920, electronic device 900 initiates biometric authentication using biometric sensor 903. After initiating biometric authentication, electronic device 900 displays face glyph 922, which provides an indication that electronic device 900 is attempting biometric authentication (e.g., acquiring biometric information about the user using biometric sensor 903). In some embodiments, face glyph 922 includes a simulation of a representation of a biometric feature. In some embodiments, in response to receiving input 920 at button 904, electronic device 900 displays an animation of face glyph 922 moving from the location of prompt 916 to the location of face glyph 922, as depicted in FIG. 9C . In some embodiments, the animation appears to cause face glyph 922 to slide out of prompt 916.

[0278] 9D , after displaying face glyph 922, the electronic device transitions to displaying authentication glyph 924, which provides an indication that the electronic device 900 is attempting biometric authentication (e.g., continuing to attempt to acquire biometric information and attempting to match the acquired information against stored authorized credentials). Authentication glyph 924 includes multiple rings rotating in a spherical shape. In some examples, authentication glyph 924 provides an indication that biometric data is being processed (e.g., compared against stored authorized credentials).

[0279] While displaying the authentication glyph 924, the electronic device 900 detects that an error condition exists (e.g., a condition in which the biometric sensor 903 is unable to acquire sufficient information about the user's face). Specifically, the electronic device 900 detects that the biometric sensor 903 is covered by a physical object (e.g., the user's hand). In some examples, the electronic device 900 does not detect the error condition and is able to acquire sufficient information about the user's face. In some examples, after acquiring sufficient information about the user's face, the electronic device 900, while displaying the authentication glyph 924, determines whether the acquired information meets biometric authentication criteria (e.g., determines whether the acquired biometric information matches, within a threshold, a biometric template associated with the user (e.g., a stored authorized credential)). In some examples, upon determining that the biometric authentication was successful (e.g., the biometric criteria are met), the electronic device 900 transitions to an unlocked state.

[0280] 9E , in response to detecting that an error condition exists, electronic device 900 displays error indication 926 at a location above display 902 (e.g., relative to the ground, relative to the user). Error indication 926 provides an indication of the currently existing error condition. Further, in response to detecting that an error condition exists, electronic device 900 displays error icon 928 at a location on display 902 adjacent biometric sensor 903, thereby providing an indication of the location of biometric sensor 903. By providing an indication of the location of biometric sensor 903, error icon 928 suggests to the user the cause of the error condition. In some embodiments, in response to detecting that an error condition exists, electronic device 900 displays error indication 926 at a location adjacent biometric sensor 903. In some embodiments, error indication 926 includes some or all of the features of error indication 714A, including a shimmer effect.

[0281] In Figure 9F, further responsive to detecting that an error condition exists, electronic device 900 displays an animation of paysheet interface 914 moving from its initial position in Figure 9E to a position in Figure 9F closer to biometric sensor 903. By moving the paysheet interface toward biometric sensor 903, electronic device 900 indicates to the user the presence of error icon 928 (thus indicating to the user the cause of the error condition) in addition to indicating the location of biometric sensor 903.

[0282] In some examples, the error icon 928 is displayed at different locations on the display 902 depending on the positioning of the user's hand on the display 902. As shown in FIG. 9F , the user's hand covers a portion of the display 902 adjacent to the biometric sensor 903. While the user's hand is in contact with the display 902, the electronic device 900 detects an input as a result of the contact with the user's hand. In response to detecting this input, the electronic device 900 displays the error icon 928 at a location where no input was detected. As another example, in FIG. 9G , the user's hand covers less of the display 902 than the user's hand does in FIG. 9F . In some examples, in response to detecting the user's hand input in FIG. 9G , the electronic device 900 displays the error icon 928 at a different location than in FIG. 9F , which is closer to the biometric sensor 903 than the location in FIG. 9F . As yet another example, in FIG. 9H , the user's hand covers a majority of the upper left side of the display 902. In some examples, in response to detecting a user's hand input in Figure 9H, the electronic device 900 displays the error icon 928 at a location different from the location in Figures 9F-9G. Specifically, in some examples, the electronic device 900 displays the error icon 928 at a location proximate (or sufficiently close) to the biometric sensor 903, rather than at the location where the user's hand input was detected.

[0283] 9I, the user removes their hand so that it no longer covers biometric sensor 903. Electronic device 900 detects that the error condition no longer exists while displaying error icon 926 and error icon 928.

[0284] 9J, in response to detecting that the error condition no longer exists, the electronic device 900 automatically retries the biometric authentication. While retrying the biometric authentication, the electronic device 900 displays an authentication glyph 924. While displaying the authentication glyph 924, the electronic device 900 attempts to biometrically authenticate the user. Specifically, the electronic device 900 acquires information about the user's face using the biometric sensor 903 and determines whether the biometric authentication was successful (e.g., the acquired information matches stored authorized credentials).

[0285] During the biometric authentication retry, the electronic device 900 determines that the biometric authentication is successful. In FIG. 9K, upon determining that the biometric authentication is successful, the electronic device 900 displays a success glyph 930, which provides an indication that the biometric authentication was successful. In some examples, the success glyph 930 replaces the authentication glyph 924.

[0286] 9L , further in response to determining that the biometric authentication was successful, the electronic device 900 displays a processing indicator 932, which provides an indication that the payment transaction is being processed (e.g., the electronic device 900 is sending payment information (e.g., credentials) to an external device (e.g., a server) to authorize the payment). In some embodiments, the processing indicator 932 has a pattern similar to or identical to the authentication glyph 924.

[0287] 9M, upon receiving an indication that the payment is complete (e.g., authorized), the electronic device 900 displays a completion indication 934, which provides an indication that the payment is complete. The completion indication 934 includes a check mark to indicate completion.

[0288] 9N-9S illustrate techniques for displaying an error indication 926 and an error icon 928 when the error indication 926 and the error icon 928 are about to be displayed in approximately the same position. In FIG. 9N, a user wants to unlock the device to access restricted content (e.g., a home screen, recently used applications). FIG. 9N shows the electronic device 900 in a portrait orientation relative to the ground with the user's hand covering the biometric sensor 903. Additionally, the electronic device 900 displays a lock state UI 936 with a lock icon 938. The lock icon 938 provides an indication that the electronic device 900 is in a locked state.

[0289] While displaying the lock status UI 936, the electronic device 900 receives a request to unlock the device. For example, the electronic device 900 detects that the user has lifted the device from a substantially horizontal position.

[0290] 9O, the electronic device 900 attempts to biometrically authenticate a user in response to receiving a request to unlock the device. While attempting to biometrically authenticate the user, the electronic device 900 displays an authentication glyph 924. Further, while attempting to biometrically authenticate the user, the electronic device 900 detects that an error condition exists (e.g., a condition in which the biometric sensor 903 is unable to acquire sufficient information about the user's face). Specifically, the electronic device 900 detects that the biometric sensor 903 is covered by a physical object (e.g., the user's hand).

[0291] 9P, in response to detecting that an error condition exists, the electronic device 900 displays an error icon 928 at a location on the display 902 near the biometric sensor 903 (e.g., at the top of the display 902). Further in response to detecting that an error condition exists, the electronic device 900 determines to display an error indication 926 at approximately the same location as the error icon 928. Upon determining to display the error indication 926 at approximately the same location, the electronic device 900 does not immediately display the error indication 926, but instead displays the error indication 926 on the lock icon 938 as part of an animation that transitions from the error icon 928 to the error indication 926, as described below with respect to FIGS.

[0292] In FIG. 9Q, after displaying the error icon 928, the electronic device 900 displays (e.g., replaces) the error indication 926, which, as described above, provides an indication of the cause of the error condition.

[0293] While displaying the error indication 926, the user removes their hand from the biometric sensor 903 so that their hand no longer covers the biometric sensor 903. In response to detecting that the error condition no longer exists, the electronic device 900 automatically retries the biometric authentication.

[0294] 9R-9S, upon determining that authentication is successful as a result of a biometric authentication retry, the electronic device 900 transitions from the locked state to the unlocked state. Specifically, the electronic device 900 displays an animation of the lock icon 938 transitioning to the unlocked icon 940 (e.g., replacing the display of the error indication 926), providing an indication to the user that the electronic device 900 has transitioned to the unlocked state. In some examples, the electronic device 900 determines that authentication failed as a result of a biometric authentication retry rather than successful biometric authentication. In some examples, upon determining that authentication failed, the electronic device 900 displays a passcode entry UI having an affordance that, when activated, triggers a biometric authentication retry. In some examples, during the biometric authentication retry, the electronic device 900 darkens all portions of the display 902 except for a user interface associated with the biometric authentication retry.

[0295] FIG. 9T illustrates a technique for displaying the error icon 928 when the error icon 928 would be displayed in approximately the same position as one of the displayed notifications (e.g., 944A-D). In some examples, the user desires to view restricted content in one or more of the displayed notifications (e.g., 944A-D) while the electronic device 900 is in a locked state. As shown in FIG. 9T, the biometric sensor 903 is located near the bottom of the device, and the user covers the biometric sensor 903 with their hand when the electronic device is in portrait orientation. In some examples, while attempting to biometrically authenticate the user to access the restricted content of the notification, the electronic device 900 detects that an error condition exists as a result of the user covering the biometric sensor 903 with their hand. In response to detecting that the error condition exists, the electronic device 900 determines to display the error icon 928 in approximately the same position as one of the notifications (e.g., 944A-D). Upon making this determination, in response to detecting that an error condition exists, the electronic device 900 displays a UI element 942 (e.g., a background) concurrently with the error icon 928 to provide a background upon which to superimpose the display of the error icon 928. As shown in FIG. 9T, the UI element 942 is opaque so that the notification (e.g., 944D) overlaid with the error icon 928 is not visible to the user. In some examples, the UI element 942 is transparent so that the notification overlaid with the error icon 928 is visible to the user.

[0296] FIG. 9T also illustrates a technique for hiding the unlocked indication 905 of FIG. 9U when an error icon 928 is about to be displayed in approximately the same location as the unlocked indication 905. In some examples, the electronic device 900 displays the unlocked indication 905, which provides an indication of an approximate location on the display 902 where a user can initiate an upward swipe to initiate biometric authentication. In some examples, while displaying the unlocked indication 905, the electronic device 900 detects that an error condition exists as a result of the user covering the biometric sensor 903 with their hand. In some examples, in response to detecting that the error condition exists, the electronic device 900 determines that the error icon 928 should be displayed in approximately the same location as the unlocked indication 905. In some examples, upon making this determination, in response to detecting that the error condition exists, the electronic device 900 ceases displaying the unlocked indication 905 and displays the error icon 928 in approximately the same location where the unlocked indication 905 was displayed.

[0297] While displaying the error icon 928, the electronic device 900 detects that the error condition no longer exists (e.g., because the user removes their hand from the biometric sensor 903). As shown in FIG. 9U, the user removes their hand from the biometric sensor 903. In FIG. 9U, upon detecting that the error condition no longer exists, the electronic device 900 ceases displaying the error icon 928 and re-displays the unlock indication 905 in the position where it was previously displayed.

[0298] 10A-10C are flow diagrams illustrating a method for providing an indication related to a biometric sensor during biometric authentication, according to some embodiments. Method 1000 is performed in an electronic device (e.g., 100, 300, 500, 900) having a display (e.g., 902) and a biometric sensor (e.g., 903) (e.g., a first biometric sensor of a device having multiple biometric sensors) (e.g., a fingerprint sensor, a non-contact biometric sensor (e.g., a biometric sensor that does not require physical contact, such as a thermal or optical facial recognition sensor), an iris scanner) in a first portion (e.g., a portion that is not part of the display) of the electronic device. In some embodiments, the biometric sensor includes one or more cameras. Some operations of method 1000 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0299] As described below, method 1000 provides an intuitive way to provide indications about a biometric sensor during biometric authentication. The method reduces the cognitive burden on a user performing biometric authentication, thereby creating a more efficient human-machine interface. In battery-operated computing devices, allowing a user to perform biometric authentication more quickly and efficiently conserves power and extends the time between battery charges.

[0300] An electronic device (e.g., 100, 300, 500, 900) detects (1002) the presence of an error condition that prevents a biometric sensor from acquiring biometric information about a user of the device (e.g., a non-contact biometric sensor, such as a thermal or optical facial recognition sensor, is occluded (e.g., partially occluded, completely occluded, occluded sufficiently to inhibit operation of the sensor) (e.g., occluded by a part of the user (e.g., a hand) while interacting with the electronic device) (e.g., detected in response to a request to perform an action requiring authentication).

[0301] In response to detecting 1004 the existence of an error condition, the electronic device (e.g., 100, 300, 500, 900) displays an error indication (e.g., 928) (e.g., a graphical icon) on the display (e.g., 902). In some embodiments, the error indication includes text (e.g., indicating that the sensor is blocked). In some embodiments, the error indication does not include text. The error indication is displayed 1006 at a location proximate to a first portion of the electronic device. In some embodiments, the location is at or near a portion of the display closest to the location of the biometric sensor (e.g., 903). Displaying the error indication provides feedback to the user regarding the current state of the device (e.g., that an error condition is preventing successful biometric authentication) and prompts the user to take further action to correct the error condition. Providing improved feedback to the user improves device usability, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently. Displaying an error indication near the biometric sensor provides the user with feedback regarding the association of the biometric sensor with a process (e.g., an authentication attempt) occurring on the device. Specifically, the user becomes aware of the biometric sensor during biometric authentication so that the user is less likely to perform actions that interfere with the biometric sensor or, alternatively, prompts the user to take corrective action.Providing improved feedback to the user improves usability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves the device's battery life by allowing the user to use the device more quickly and efficiently.

[0302] In some examples, the error indication (e.g., 928) includes a biometric sensor occlusion icon and reticle (1008), where the error indication provides an indication that the biometric sensor is occluded. In some examples, the error indication is associated with an electronic device that performs biometric authentication (e.g., uses a biometric sensor to acquire biometric information related to a biometric feature (e.g., face, fingerprint)). Providing an indication that the biometric sensor is occluded provides the user with feedback regarding the current state of the device (e.g., that the biometric sensor is occluded) and prompts the user to take further action to correct the error condition. Thus, providing improved feedback with instructions for the appropriate movement of the biometric feature improves device usability and makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), as well as allowing the user to use the device more quickly and efficiently, thereby reducing power usage and improving the device's battery life.

[0303] In accordance with determining 1010 that a user interface of the electronic device is in a first orientation relative to the biometric sensor, the electronic device (e.g., 100, 300, 500, 900) displays an error indication at a first location within the user interface that is proximate to (e.g., adjacent to, near, within a predetermined distance of) a first portion of the electronic device.

[0304] In accordance with determining 1012 that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the electronic device (e.g., 100, 300, 500, 900) displays an error indication (e.g., 928) at a second location within the user interface that is proximate to (e.g., adjacent to, near, within a predetermined distance from) a first portion of the electronic device, wherein the first orientation is different from the second orientation.

[0305] In some examples, while attempting to acquire biometric information using the biometric sensor (e.g., 903) (1014), the electronic device (e.g., 100, 300, 500, 900) displays (1016) a first progress indicator (e.g., 924, 926, 938, 940) on the display (e.g., 902). In some examples, the first progress indicator provides an indication of a current state of the electronic device (e.g., locked state, unlocked state, performing biometric authentication, error state, error state). In some examples, pursuant to determining (1018) that a user interface (e.g., 906, 908) of the electronic device is in a third orientation relative to the biometric sensor and the user interface in the third orientation has a first top edge, the electronic device displays the first progress indicator proximate to (e.g., adjacent to, near, within a predetermined distance from) the first top edge of the user interface in the third orientation. In some examples, pursuant to determining 1020 that the user interface of the electronic device is in a fourth orientation relative to the biometric sensor and that the user interface in the fourth orientation has a second top edge, the electronic device displays a first progress indicator proximate to the second top edge of the user interface in the fourth orientation (e.g., adjacent to the second top edge, near the second top edge, within a predetermined distance from the second top edge), and the third orientation is different from the fourth orientation. In some examples, the first progress indicator is displayed on the display at a location closest to or proximate to the biometric sensor (e.g., adjacent to the biometric sensor, close to the biometric sensor, within a predetermined distance from the biometric sensor). Displaying the first progress indicator near the top of the display regardless of orientation ensures that the feedback (e.g., progress indicator) provided to the user is more easily recognized by the user.Providing improved visual feedback to the user improves usability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

[0306] In some examples, an electronic device (e.g., 100, 300, 500, 900) displays a second progress indicator (e.g., 924, 926, 938, 940) of the electronic device on a display (e.g., 902). In some examples, the second progress indicator provides an indication of a current state of the electronic device (e.g., locked, unlocked, performing biometric authentication, error state). In some examples, the first progress indicator is the second progress indicator. In some examples, the second progress indicator is an animation having a first portion (e.g., an indication that the electronic device is performing biometric authentication using a biometric sensor (e.g., 924) (e.g., a rotating ring)) and a second portion different from the first portion (e.g., an indication of an error state or error state (e.g., 926), an indication of the current locked or unlocked state of the electronic device (e.g., a lock icon (e.g., 938), an unlock icon (e.g., 940))). In some examples, pursuant to a determination that the second progress indicator is displayed in a position proximate to the first portion of the electronic device, the electronic device displays an error indication (e.g., 928) as part of the animation after the first portion and before the second portion.

[0307] In some examples, an electronic device (e.g., 100, 300, 500, 900) displays a home affordance (e.g., 905) on a display (e.g., 902) (e.g., an indication of the location of a gesture that, when performed, results in the display of a home screen, such as an upward swipe gesture from the edge of the display or a tap gesture on the affordance) at a third location within the user interface (e.g., a location proximate an edge (e.g., bottom) of the user interface). In some examples, following a determination that an error indication (e.g., 928) is displayed at the third location, the electronic device ceases displaying the home affordance (e.g., 905) while displaying the error indication at the third location. Ceasing display of the home affordance while displaying the error indication allows a user to quickly realize that the home affordance is not accessible because an error exists and prompts the user to take further action to correct the error condition. Providing improved visual feedback to the user improves usability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

[0308] In some examples, after ceasing to display the home affordance (e.g., 905), the electronic device (e.g., 100, 300, 500, 900) detects a correction of the error condition that prevents the biometric sensor (e.g., 903) from acquiring biometric information about a user of the device. In some examples, the electronic device detects the absence of the error condition after displaying the error indication (e.g., 928) at a third location. In some examples, in response to detecting the correction of the error condition, the electronic device displays the home affordance on the display (e.g., 902) at a third location within the user interface (e.g., and ceasing to display the error indication (e.g., 928)).

[0309] In some examples, an electronic device (e.g., 100, 300, 500, 900) detects an input (e.g., palm, finger) at a location proximate to a first portion of the electronic device (e.g., adjacent to, close to, within a predetermined distance from the first portion). In some examples, in response to detecting the input at a location proximate to the first portion of the electronic device, the electronic device displays an error indication (e.g., 928) at a different location on the display. In some examples, the different location is a location where no input is detected. In some examples, the electronic device determines a different location based on the location of the input relative to the display before displaying the error indication at the new location. In some examples, the different location is proximate to a location proximate to the first portion of the electronic device. In some examples, the error indication is initially displayed at a first location proximate to the first portion of the electronic device and then moved to a different location. In some examples, the error indication is initially displayed at a location selected to be away from any areas of the display known to be occluded (e.g., occluded by the detected touch input). Displaying the error indication in different locations depending on the location of the input (e.g., the user's hand) provides the user with feedback regarding the device's current state (e.g., that an error condition is preventing successful biometric authentication) and prompts the user to take further action to correct the error condition. Furthermore, by adjusting the location, the device ensures that the error indication is visible to the user, thereby making it easier for the user to take corrective action on the device. Providing improved feedback to the user improves device usability and makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), as well as reducing power usage and improving the device's battery life by allowing the user to use the device more quickly and efficiently.

[0310] In some examples, an electronic device (e.g., 100, 300, 500, 900) displays a first transaction interface (e.g., 914) (e.g., a transaction (or payment) interface that is separate from (or superimposed on) the user interface and includes transaction information such as a credit card number, a billing address, etc.) on a display (e.g., 902) in proximity to (e.g., adjacent to, near, within a predetermined distance of) a first portion of the electronic device. In some examples, the first transaction interface is displayed in response to receiving an input (e.g., 910) that corresponds to an affordance (e.g., 912) of the user interface (e.g., 908) (e.g., an affordance to make a payment or complete a transaction).

[0311] In some examples, displaying the first trading interface (e.g., 914) includes displaying an animation of the first trading interface transitioning (e.g., translating) from an initial position approximately centered with respect to the display to a position proximate to a first portion of the electronic device. In some examples, the animation includes displaying (e.g., maintaining) the first trading interface while the first trading interface transitions (e.g., translates) from the initial position to a position proximate to the first portion of the electronic device. In some examples, the animation includes a visual effect that causes the first trading interface to appear to float while it transitions.

[0312] In some embodiments, an electronic device (e.g., 100, 300, 500, 900) displays a prompt (e.g., 916) on a display (e.g., 902) to activate one or more hardware buttons (e.g., 904) of the electronic device. In some embodiments, the electronic device prompts the user by displaying "Double Click to Apple Pay." In some embodiments, the prompt is displayed adjacent to the button. In some embodiments, the prompt is displayed when the device is displaying a transaction user interface area (e.g., 914) but has not received an indication that a transaction terminal is nearby and requesting transaction credentials (e.g., the prompt to activate one or more buttons is displayed before the device is placed in the NFC field of an NFC reader requesting payment information). In some embodiments, the hardware button is a mechanical button or a solid-state button. In some embodiments, the button is a switch or any other type of toggle. In some embodiments, the button has a fixed position relative to the electronic device, particularly relative to the display of the electronic device, such that the electronic device may display the prompt based on the button's position. In some examples, the button is a solid-state button that operates in response to capacitive and / or resistive touch and / or that does not have a mechanical switch that activates the button when pressed but instead responds to changes in input intensity by monitoring whether the input intensity exceeds an intensity threshold that corresponds to activation of the solid-state button. In some examples, an electronic device (e.g., 100, 300, 500, 900) receives one or more activations (e.g., 920) of hardware buttons on the electronic device, and in response to receiving the one or more activations of the hardware buttons, the electronic device displays authentication progress indicators (e.g., 922, 924, 930, 932, 934) on a display (e.g., 902). In some examples, displaying the authentication progress indicators includes displaying an animation in which the authentication progress indicator transitions from a position of the prompt (e.g., 916) to a final position of the authentication progress indicator.In some examples, the authentication indicator provides the status of the authentication (e.g., in progress, successful, failed). In some examples, animation includes displaying (e.g., maintaining the display of) the authentication progress indicator while it transitions (parallels) from a prompt location to a final location. In some examples, animation includes a visual effect in which the authentication progress indicator appears to slide out of the prompt. In some examples, the authentication progress indicator is displayed along with (or overlaid on) a user interface (e.g., 914) (or a transaction user interface area). Prompting the user to activate a hardware button guides the user to perform an action at the device to complete the transaction. Prompting the user in this manner improves device usability and makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), as well as allowing the user to use the device more quickly and efficiently, thereby reducing power usage and improving device battery life. Displaying the authentication progress indicator provides feedback to the user regarding the status of the authentication. The improved feedback improves usability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves the device's battery life by allowing the user to use the device more quickly and efficiently.

[0313] In some embodiments, an electronic device (e.g., 100, 300, 500, 900) simultaneously displays (1022) on a display (e.g., 902) a first application (e.g., corresponding to 906, 908) in a first region (e.g., 907, 909) and a second application (e.g., corresponding to 906, 908) in a second region (e.g., 907, 909), where the second application is adjacent to the first application (e.g., next to the first application, proximate to the first application, within a predetermined distance from the first application). In some embodiments, the electronic device displays (1024) a second trading interface (e.g., 914) on the display. In some embodiments, the second trading interface is the first trading interface. In some embodiments, the second trading interface is displayed overlaid on top of the first application and / or the second application. In some embodiments, in response to a determination that the second trading interface corresponds to the first application (1026), the electronic device modifies (e.g., obscures, dims, blurs) a first visual characteristic of the first application. In some embodiments, the second trading interface corresponds to the first application if the first application includes information regarding a good or service (or transaction) being purchased (or completed) using (or through) the second trading interface. In some embodiments, this determination is made while displaying the second trading interface. In some embodiments, in response to a determination that the second trading interface corresponds to the second application (1030), the electronic device (e.g., 100, 300, 500, 900) modifies (e.g., obscures, dims, blurs) a first visual characteristic of the second application. In some embodiments, the second trading interface corresponds to the first application if the first application includes information regarding a good or service (or transaction) being purchased (or completed) using (or through) the second trading interface. In some embodiments, this determination is made while displaying the second trading interface.

[0314] In some examples, modifying the first visual characteristic of the first application includes modifying the second visual characteristic of the second application. In some examples, modifying the second visual characteristic of the second application includes increasing the darkening and / or increasing the blur radius of a blur effect applied to the second application to a greater degree (or amount) than with respect to the first application. In some examples, modifying the first visual characteristic of the second application includes modifying the second visual characteristic of the first application. In some examples, modifying the second visual characteristic of the first application includes increasing the darkening and / or increasing the blur radius of a blur effect applied to the first application to a greater degree (or amount) than with respect to the second application. Modifying the visual characteristic of one application to a greater degree than with respect to another application provides feedback to the user as to which application is more relevant at the time. Providing improved visual feedback to the user improves usability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and also reduces power usage and improves device battery life by allowing the user to use the device more quickly and efficiently. In some examples, no indicator is displayed during biometric authentication.

[0315] In some examples, modifying the first visual characteristic of the first application includes displaying the first application in the second region in accordance with a determination that the second region is closer (e.g., closer) to the first portion of the electronic device (e.g., a biometric sensor) than the first region (1028). In some examples, displaying the first application in the second region includes ceasing to display the first application in the first region. In some examples, modifying the first visual characteristic of the second application includes displaying the second application in the first region in accordance with a determination that...

Claims

1. In an electronic device having a display and one or more input devices, receiving, via the one or more input devices, a request to perform an action requiring authentication; in response to the request to perform the action requiring authentication; performing said action in response to a determination that authentication was successful; and pursuant to a determination that the authentication was not successful and a set of error condition criteria is met, displaying an indication of an error condition on the display, the indication including information regarding a cause of the error condition; and forgoing performing said action; and A method comprising:

2. in response to the request to perform the action requiring authentication; pursuant to a determination that authentication was not successful and that the set of error condition criteria is not satisfied, forgoing displaying the indication of the error condition on the display; and forgoing performing said action; and The method of claim 1 further comprising:

3. The method of claim 1 or 2, wherein the indication of the error condition includes an indication of a user action that can be taken to correct the error condition.

4. The method of claim 1 , wherein the indication of the error condition includes information regarding a cause of the error condition.

5. 5. The method of claim 1, wherein the set of error condition criteria includes a requirement that is met when a first type of biometric feature is detected using one or more biometric sensors of the electronic device.

6. pursuant to determining that authentication is successful, forgoing displaying the indication of the error condition on the display; The method of claim 1 , further comprising:

7. after displaying said indication of said error condition; forgoing attempting biometric authentication on the electronic device in accordance with a determination that the set of error condition criteria continues to be satisfied; enabling a retry of the biometric authentication on the electronic device pursuant to a determination that the set of error condition criteria is no longer satisfied; and The method of claim 1 , further comprising:

8. retrying authentication after displaying the indication of the error condition in response to the determination that the set of error condition criteria is no longer satisfied; The method of claim 7 further comprising:

9. receiving, via the one or more input devices, input corresponding to a request to retry authentication after the determination that the set of error condition criteria is no longer satisfied; retrying authentication in response to receiving the input corresponding to the request to retry authentication; The method of claim 7 further comprising:

10. The method of claim 1 , wherein displaying the indication of the error condition includes an animation indicating that an authentication attempt is in progress.

11. performing an authentication after receiving the request to perform the operation requiring authentication and prior to displaying the indication of the error condition, wherein performing the authentication includes displaying a first indication on the display that the electronic device is obtaining information regarding a biometric feature using one or more biometric sensors of the electronic device; displaying the indication of the error condition includes replacing the display of the first indication with the display of the indication of the error condition.

11. The method according to any one of claims 1 to 10.

12. displaying a first lock icon on the display while performing the authentication, the method comprising: displaying a first animation on the display transitioning from the first lock icon to the first indication; displaying on the display a second animation, after displaying the indication of the error condition and after displaying the first animation, the second animation transitioning from the indication of the error condition to an unlock icon; The method of claim 11 further comprising:

13. after displaying the indication of the error condition, displaying on the display an animation transitioning from the indication of the error condition to a second lock icon or an animation transitioning from a second indication that the electronic device is acquiring information regarding a biometric feature using one or more biometric sensors of the electronic device to the second lock icon; The method of claim 11 further comprising:

14. During authentication retry, after displaying the indication of the error condition, in accordance with a determination that the error condition does not exist, displaying on the display a third indication that the electronic device is acquiring information regarding a biometric feature using one or more biometric sensors of the electronic device; The method of claim 8 or 9, comprising:

15. displaying a third lock icon on the display at a location on the display prior to displaying the indication of the error condition, the indication of the error condition being displayed proximate to the location on the display. The method of claim 1 , further comprising:

16. The electronic device is in a locked state while receiving the request to perform the operation requiring authentication, the method comprising: transitioning the electronic device from the locked state to an unlocked state in accordance with the determination that authentication is successful; maintaining the electronic device in the locked state in accordance with the determination that authentication was unsuccessful; and 16. The method of claim 1, further comprising:

17. The electronic device is in a locked state while receiving the request to perform the operation requiring authentication, the method comprising: pursuant to said determination that authentication was not successful; maintaining the electronic device in the locked state; Retry authentication, After retrying authentication, transitioning the electronic device from the locked state to an unlocked state in response to a determination that the authentication is successful as a result of retrying the authentication; maintaining the electronic device in the locked state in response to a determination that the authentication retry is unsuccessful; and 17. The method of claim 1, further comprising:

18. attempting authentication after receiving the request to perform the operation requiring authentication, wherein during the authentication attempt, displaying a third indication on the display that the electronic device is obtaining information regarding a biometric feature using one or more biometric sensors of the electronic device; and maintaining display of the third indication on the display during authentication retries. The method of claim 17 further comprising:

19. pursuant to said determination that the authentication retry resulted in unsuccessful authentication, displaying on said display an animation having a lock icon moving back and forth between a first position and a second position, said second position being different from said first position. The method of claim 17 further comprising:

20. the electronic device includes a biosensor; the set of error condition criteria includes one or more error condition criteria selected from the group consisting of: a distance of the biometric feature from the biometric sensor exceeding a first predetermined threshold distance; a distance of the biometric feature from the biometric sensor being less than a second predetermined threshold distance; the biometric sensor being occluded; a subportion of a detected biometric feature not facing the biometric sensor; at least a portion of the detected biometric feature being occluded; a biometric feature not being detected within a field of view of the biometric sensor; a pose of the detected biometric feature exceeding a threshold range; and the electronic device detecting an amount of light exceeding a predetermined light threshold.

20. The method according to any one of claims 1 to 19.

21. and wherein the electronic device includes a biometric sensor in a portion of the electronic device, and the method further comprises, in response to the request to perform the action requiring authentication, displaying a progress indicator on the display proximate to the portion of the electronic device, the progress indicator including the indication of the error condition.

21. The method of any one of claims 1 to 20, further comprising:

22. 22. The method of claim 1, wherein the indication of the error condition includes an indication that biometric authentication is not currently enabled on the electronic device pursuant to a determination that biometric authentication is not currently enabled on the electronic device.

23. The indication that biometric authentication is not currently possible includes an affordance, and the method further comprises: receiving an input corresponding to the affordance; In response to receiving the input corresponding to the affordance, displaying a credential input user interface on the display having a plurality of character input keys; 23. The method of claim 22, further comprising:

24. Detecting a condition at the device that triggers an authentication attempt; in response to detecting the condition that triggers an authentication attempt; displaying a fifth indication that the electronic device is obtaining information regarding a biometric feature using the one or more biometric sensors of the electronic device in accordance with a determination that the condition corresponds to an alert generated by the device without user input directed to the device while a biometric feature is available for detection by the one or more biometric sensors; forgoing displaying the fifth indication that the electronic device is obtaining information regarding a biometric feature using the one or more biometric sensors of the electronic device in accordance with a determination that the condition corresponds to an alert generated by the device without user input directed to the device while a biometric feature is not available for detection by the one or more biometric sensors; displaying the fifth indication that the electronic device is acquiring information regarding a biometric feature using one or more biometric sensors of the electronic device in accordance with a determination that the state corresponds to a user input directed to the device; and 24. The method of any one of claims 1 to 23, further comprising:

25. 25. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 1 to 24.

26. A display and one or more input devices; one or more processors; and a memory storing one or more programs configured to be executed by said one or more processors, said one or more programs being instructions for performing the method of any one of claims 1 to 24; 2. An electronic device comprising:

27. A display and one or more input devices; Means for carrying out the method according to any one of claims 1 to 24; An electronic device comprising:

28. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, the one or more programs comprising: receiving, via the one or more input devices, a request to perform an action requiring authentication; in response to the request to perform the action requiring authentication; performing said action in response to a determination that authentication was successful; and pursuant to a determination that the authentication was not successful and a set of error condition criteria is met, displaying an indication of an error condition on the display, the indication including information regarding a cause of the error condition; and and forgoing performing said action. A non-transitory computer-readable storage medium containing instructions.

29. A display and one or more input devices; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: receiving, via the one or more input devices, a request to perform an action requiring authentication; in response to the request to perform the action requiring authentication; performing said action in response to a determination that authentication was successful; and pursuant to a determination that the authentication was not successful and a set of error condition criteria is met, displaying an indication of an error condition on the display, the indication including information regarding a cause of the error condition; and and forgo performing said action. Electronic devices.

30. A display and one or more input devices; means for receiving, via said one or more input devices, a request to perform an action requiring authentication; in response to the request to perform the action requiring authentication; performing said action in response to a determination that authentication was successful; and pursuant to a determination that the authentication was not successful and a set of error condition criteria is met, displaying an indication of an error condition on the display, the indication including information regarding a cause of the error condition; and and forgoing performing said action. Electronic devices.

31. 1. An electronic device having a display and a biosensor in a first portion of the electronic device, detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; displaying an error indication on the display in response to detecting the existence of the error condition, the error indication being displayed in a location proximate to the first portion of the electronic device; displaying the error indication at a first location within the user interface proximate to the first portion of the electronic device in accordance with determining that a user interface of the electronic device is in a first orientation relative to the biometric sensor; displaying the error indication at a second location within the user interface proximate to the first portion of the electronic device in accordance with determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation. and

32. 32. The method of claim 31, wherein the error indication includes a biosensor occlusion icon and reticle, the error indication providing an indication that the biosensor is occluded.

33. While attempting to acquire biometric information using the biometric sensor, displaying a first progress indicator on the display; displaying the first progress indicator proximate to the first top surface of the user interface in the third orientation in accordance with a determination that the user interface of the electronic device is in a third orientation relative to the biometric sensor, the user interface in the third orientation having a first top surface; displaying the first progress indicator proximate to the second top surface of the user interface in the fourth orientation in accordance with a determination that the user interface of the electronic device is in a fourth orientation relative to the biometric sensor, the user interface in the fourth orientation having a second top surface, the third orientation being different from the fourth orientation.

33. The method of claim 31 or 32, further comprising:

34. displaying a second progress indicator of the electronic device on the display, the second progress indicator being an animation having a first portion and a second portion different from the first portion; pursuant to determining that the second progress indicator is displayed at the location proximate to the first portion of the electronic device, displaying the error indication as part of the animation after the first portion and before the second portion.

34. The method of any one of claims 31 to 33, further comprising:

35. displaying on the display a home affordance at a third position within the user interface; and ceasing to display the home affordances while displaying the error indication at the third location according to a determination that the error indication is displayed at the third location; and 35. The method of any one of claims 31 to 34, further comprising:

36. detecting a correction of the error condition that prevents the biometric sensor from acquiring biometric information about the user of the device after ceasing to display the home affordances; in response to detecting the correction of the error condition, displaying on the display the home affordance at the third location within the user interface; and 36. The method of claim 35, further comprising:

37. Detecting an input at the location proximate to the first portion of the electronic device; in response to detecting the input at the location proximate to the first portion of the electronic device, displaying the error indication on the display at a different location, the different location being a location where the input was not detected.

37. The method of any one of claims 31 to 36, further comprising:

38. displaying a first trading interface on the display proximate to the first portion of the electronic device; 38. The method of any one of claims 31 to 37, further comprising:

39. 40. The method of claim 38, wherein displaying the first trading interface includes displaying an animation of the first trading interface transitioning from an initial position that is approximately centered relative to the display to the position proximate the first portion of the electronic device.

40. displaying a prompt on the display to activate one or more hardware buttons of the electronic device; and receiving the activation of the one or more hardware buttons of the electronic device. displaying an authentication progress indicator on the display in response to receiving the activation of the one or more of the hardware buttons, wherein displaying the authentication progress indicator includes displaying an animation of the authentication progress indicator transitioning from a position of the prompt to a final position of the authentication progress indicator.

40. The method of any one of claims 31 to 39, further comprising:

41. simultaneously displaying on the display a first application in a first region and a second application in a second region, the second application adjacent to the first application; displaying a second trading interface on the display; and modifying a first visual characteristic of the first application according to a determination that the second trading interface corresponds to the first application; modifying a first visual characteristic of the second application in accordance with a determination that the second trading interface corresponds to the second application; 41. The method of any one of claims 31 to 40, further comprising:

42. modifying the first visual characteristic of the first application includes modifying a second visual characteristic of the second application, and modifying the first visual characteristic of the second application includes modifying a second visual characteristic of the first application.

42. The method of claim 41.

43. modifying the first visual characteristic of the first application includes displaying the first application within the second region according to a determination that the second region is closer to the first portion of the electronic device than the first region; modifying the first visual characteristic of the second application includes displaying the second application within the first region according to a determination that the first region is closer to the first portion of the electronic device than the second region.

42. The method of claim 41.

44. Displaying the second trading interface includes: in response to the determination that the second trading interface corresponds to the first application, the second trading interface including an indication of the first application; in accordance with the determination that the second trading interface corresponds to the second application, the second trading interface including an indication of the second application; 42. The method of claim 41 , comprising:

45. 45. A non-transitory computer readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and a biosensor in a first portion of the electronic device, the one or more programs including instructions for performing the method of any one of claims 31 to 44.

46. 1. An electronic device comprising: A display and a biosensor in a first portion of the electronic device; one or more processors; and a memory storing one or more programs configured to be executed by said one or more processors, said one or more programs including instructions for performing the method of any one of claims 31 to 44. Electronic devices.

47. 1. An electronic device comprising: A display and a biosensor in a first portion of the electronic device; and means for carrying out the method according to any one of claims 31 to 44. Electronic devices.

48. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and a biosensor in a first portion of the electronic device, the one or more programs comprising: detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; displaying an error indication on the display in response to detecting the existence of the error condition, the error indication being displayed in a location proximate to the first portion of the electronic device; displaying the error indication at a first location within the user interface proximate to the first portion of the electronic device in accordance with determining that a user interface of the electronic device is in a first orientation relative to the biometric sensor; displaying the error indication at a second location within the user interface proximate to the first portion of the electronic device in accordance with determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation. and A non-transitory computer-readable storage medium.

49. 1. An electronic device comprising: A display and a biosensor in a first portion of the electronic device; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; displaying an error indication on the display in response to detecting the existence of the error condition, the error indication being displayed in a location proximate to the first portion of the electronic device; displaying the error indication at a first location within the user interface proximate to the first portion of the electronic device in accordance with determining that a user interface of the electronic device is in a first orientation relative to the biometric sensor; displaying the error indication at a second location within the user interface proximate to the first portion of the electronic device in accordance with determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation. and and Electronic devices.

50. 1. An electronic device comprising: A display and a biosensor in a first portion of the electronic device; means for detecting the presence of an error condition that prevents the biometric sensor from acquiring biometric information about a user of the device; displaying an error indication on the display in response to detecting the existence of the error condition, the error indication being displayed in a location proximate to the first portion of the electronic device; displaying the error indication at a first location within the user interface proximate to the first portion of the electronic device in accordance with determining that a user interface of the electronic device is in a first orientation relative to the biometric sensor; displaying the error indication at a second location within the user interface proximate to the first portion of the electronic device in accordance with determining that the user interface of the electronic device is in a second orientation relative to the biometric sensor, the first orientation being different from the second orientation. and and Electronic devices.

51. 1. An electronic device having a display and one or more biosensors, displaying on the display a biometric enrollment user interface for initiating biometric enrollment on the one or more biometric sensors; receiving an input corresponding to a request to initiate a biometric enrollment while displaying the biometric enrollment user interface; In response to receiving the input, initiating a process of enrolling a biometric feature in the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; outputting one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria in accordance with a determination that the orientation of the electronic device does not meet the set of enrollment criteria; A method comprising:

52. outputting the one or more prompts outputting a first prompt to orient the electronic device in a first orientation; and outputting a second prompt after outputting the first prompt to orient the electronic device in the different orientation that satisfies the set of enrollment criteria, the first prompt being different from the second prompt. and b.

53. 53. The method of claim 51 or 52, wherein outputting the one or more prompts includes outputting a third prompt to rotate the electronic device to the different orientation that satisfies the set of enrollment criteria, the third prompt being based on the orientation of the electronic device while receiving the input.

54. 54. The method of any one of claims 51 to 53, wherein outputting the one or more prompts includes outputting a fourth prompt to rotate the electronic device to the different orientation that satisfies the set of registration criteria, the fourth prompt being based on an alignment of a base plane of the device relative to a predetermined plane.

55. receiving a request to perform an action requiring authentication after initiating the process of enrolling the biometric feature; in response to receiving the request to perform the operation requiring authentication, attempting authentication using the one or more biometric sensors; and, after attempting authentication using the one or more biometric sensors, forgoing retrying authentication in accordance with a determination that data acquired by the one or more biometric sensors corresponds to less than a threshold amount of biometric features.

55. The method of any one of claims 51 to 54, further comprising:

56. retrying authentication in accordance with a determination, after attempting authentication using the one or more biometric sensors, that the data acquired by the one or more biometric sensors corresponds to greater than or equal to the threshold amount of the biometric feature; 56. The method of claim 55, further comprising:

57. You can retry authentication. performing an action corresponding to the request in response to a determination that the authentication is successful as a result of the authentication retry; in response to a determination that authentication was unsuccessful as a result of retrying authentication, forgoing performing the action corresponding to the request; 57. The method of claim 56, comprising:

58. after outputting the one or more prompts to change the orientation of the electronic device to the different orientation that satisfies the set of enrollment criteria; Detecting that the current orientation of the electronic device satisfies the set of registration criteria; initiating the process of enrolling the biometric feature in the one or more biometric sensors in response to determining that the current orientation of the electronic device satisfies the set of enrollment criteria; 58. The method of any one of claims 51 to 57, further comprising:

59. Initiating the process of enrolling the biometric feature in the one or more biometric sensors includes successfully enrolling the biometric feature, the method comprising: after successfully enrolling the biometric feature, outputting a prompt to the one or more biometric sensors to enroll the biometric feature a second time; 59. The method of any one of claims 51 to 58, further comprising:

60. Initiating the process of enrolling the biometric feature in the one or more biometric sensors includes successfully enrolling the biometric feature, the method comprising: receiving a request to perform an action requiring authentication after successful enrollment of the biometric characteristic; in response to receiving the request to perform the action requiring authentication; performing the action requiring authentication in accordance with a determination that data acquired by the one or more biometric sensors corresponds to the enrolled biometric characteristic; forgoing performing the action requiring authentication in accordance with a determination that data acquired by the one or more biometric sensors does not correspond to the enrolled biometric characteristic; 60. The method of any one of claims 51 to 59, further comprising:

61. the orientation of the electronic device does not satisfy the set of enrollment criteria due to the orientation resulting in the one or more biometric sensors being located near a right side of the electronic device; the one or more prompts include an animation of a representation of a device rotating in a first direction less than a first amount; 61. The method of any one of claims 51 to 60.

62. the orientation of the electronic device does not satisfy the set of enrollment criteria due to the orientation resulting in the one or more biometric sensors being located near a left side of the electronic device; the one or more prompts include an animation of a representation of a device rotating in a second direction different from the first direction by less than the first amount; 62. The method of claim 61.

63. the orientation of the electronic device does not satisfy the set of enrollment criteria due to the orientation resulting in the one or more biometric sensors being located near an underside of the electronic device; the one or more prompts include an animation of a representation of a device rotating an amount greater than the first amount.

63. The method of claim 61 or 62.

64. detecting a change in orientation of the electronic device after outputting the one or more prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria; in response to detecting the change in the orientation of the electronic device. outputting one or more new prompts to change the orientation of the electronic device to a different orientation that satisfies the set of enrollment criteria in accordance with a determination that the orientation of the electronic device does not yet satisfy the set of enrollment criteria; 64. The method of any one of claims 51 to 63, further comprising:

65. 65. The method of any one of claims 51 to 64, wherein initiating the process of enrolling a biometric feature in the one or more biometric sensors includes displaying a biometric enrollment introduction interface.

66. 66. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biosensors, the one or more programs including instructions for performing the method of any one of claims 51 to 65.

67. A display and one or more biosensors; one or more processors; and a memory storing one or more programs configured to be executed by said one or more processors, said one or more programs being instructions for performing the method of any one of claims 51 to 65; 2. An electronic device comprising:

68. A display and one or more biosensors; Means for carrying out the method according to any one of claims 51 to 65; An electronic device comprising:

69. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more biosensors, the one or more programs comprising: displaying on the display a biometric enrollment user interface for initiating biometric enrollment on the one or more biometric sensors; receiving an input corresponding to a request to initiate a biometric enrollment while displaying the biometric enrollment user interface; In response to receiving the input, initiating a process of enrolling a biometric feature in the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; and outputting, in accordance with a determination that the orientation of the electronic device does not meet the set of enrollment criteria, one or more prompts to change the orientation of the electronic device to a different orientation that meets the set of enrollment criteria. A non-transitory computer-readable storage medium.

70. A display and one or more biosensors; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: displaying on the display a biometric enrollment user interface for initiating biometric enrollment on the one or more biometric sensors; receiving an input corresponding to a request to initiate a biometric enrollment while displaying the biometric enrollment user interface; In response to receiving the input, initiating a process of enrolling a biometric feature in the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; and outputting, in accordance with a determination that the orientation of the electronic device does not meet the set of enrollment criteria, one or more prompts to change the orientation of the electronic device to a different orientation that meets the set of enrollment criteria. Electronic devices.

71. 1. An electronic device comprising: A display and one or more biosensors; means for displaying on the display a biometric registration user interface for initiating biometric registration to the one or more biometric sensors; means for receiving an input corresponding to a request to initiate a biometric enrollment while displaying the biometric enrollment user interface; In response to receiving the input, initiating a process of enrolling a biometric feature in the one or more biometric sensors in accordance with a determination that an orientation of the electronic device satisfies a set of enrollment criteria; outputting one or more prompts to change the orientation of the electronic device to a different orientation that meets the set of enrollment criteria in accordance with a determination that the orientation of the electronic device does not meet the set of enrollment criteria; An electronic device comprising:

72. 1. An electronic device having a biosensor and a touch-sensitive display, Detecting an occurrence of an error state for detecting biological information in the biological sensor; in response to detecting the occurrence of the error condition, displaying on the touch-sensitive display an indication of a location of the biosensor on the electronic device; detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; in response to detecting the request to unlock the electronic device using the biometric sensor; in response to a determination that the error condition still occurs at each time occurring after detecting the request to unlock the electronic device, ceasing to display the indication of the location of the biosensor; and Displaying a touch-based user interface for inputting touch-based authentication information; pursuant to a determination that the error condition is no longer occurring, attempting to unlock the electronic device using the biometric sensor; A method comprising:

73. detecting a touch input sequence on the touch-sensitive display while displaying the touch-based user interface for entering touch-based authentication information; in response to detecting the touch input sequence; transitioning the electronic device from a locked state to an unlocked state in response to a determination that the touch input sequence matches an authorized credential; maintaining the electronic device in a locked state in accordance with a determination that the touch input sequence does not match an authorized credential; 73. The method of claim 72, further comprising:

74. 74. A method according to claim 72 or 73, wherein the respective times occur after a predetermined delay period from when the request to unlock the electronic device is detected using the biometric sensor.

75. Attempting to unlock the electronic device unlocking the electronic device in accordance with a determination that the biometric authentication is successful; and displaying an alternative authentication user interface on the touch-sensitive display in accordance with a determination that the biometric authentication was not successful; 75. The method of any one of claims 72 to 74, comprising:

76. 76. The method of any one of claims 72 to 75, wherein the occurrence of the error condition includes a requirement that the biosensor be covered for the error condition to occur.

77. 77. The method of any one of claims 72 to 76, wherein the occurrence of the error condition includes a requirement that the touch-sensitive display be on for the error condition to occur.

78. 78. A method according to any one of claims 72 to 77, wherein the occurrence of the error condition includes a requirement that input corresponding to a request to attempt biometric authentication be satisfied for the error condition to occur.

79. 79. A method according to any one of claims 72 to 78, wherein the occurrence of the error condition comprises a requirement that a maximum number of failed authentication attempts for the error condition to occur has not yet been reached.

80. 80. The method of any one of claims 72 to 79, wherein the occurrence of the error condition includes a requirement that the electronic device be oriented such that the biometric sensor is not facing a portion of a biometric feature that can be used for biometric authentication for the error condition to occur.

81. 81. The method of any one of claims 72 to 80, wherein the indication comprises an instruction to change a position of a biometric feature toward the biometric sensor.

82. 82. The method of any one of claims 72 to 81, wherein the indication includes a textual description of where the biosensor is located.

83. 83. The method of any one of claims 72 to 82, wherein the indication comprises a graphical indication located proximate the biosensor.

84. 84. The method of any one of claims 72 to 83, wherein the indication includes a pictorial representation of the location of the biosensor.

85. 85. The method of any one of claims 72 to 84, wherein the indication includes an animation indicating a position of the biosensor.

86. The occurrence of the error condition is detected when the error condition is of a first type, and the method further comprises: in response to detecting an occurrence of a second type of error condition, displaying an indication of the occurrence of the second type of error condition without displaying an indication of the location of the biosensor; 86. The method of any one of claims 72 to 85, further comprising:

87. 87. The method of any one of claims 72 to 86, wherein the determination that the error condition is no longer occurring is made after detecting the request to unlock the electronic device using the biometric sensor and while displaying the indication of the location of the biometric sensor.

88. 88. A non-transitory computer readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a biosensor and a touch-sensitive display, the one or more programs including instructions for performing the method of any one of claims 72 to 87.

89. A biosensor; A touch-sensitive display; one or more processors; and a memory storing one or more programs configured to be executed by said one or more processors, said one or more programs being instructions for performing the method of any one of claims 72 to 87; 2. An electronic device comprising:

90. A biosensor; A touch-sensitive display; Means for carrying out the method according to any one of claims 72 to 87; An electronic device comprising:

91. 1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a biometric sensor and a touch-sensitive display, the one or more programs comprising: Detecting an occurrence of an error state for detecting biological information in the biological sensor; in response to detecting the occurrence of the error condition, displaying on the touch-sensitive display an indication of a location of the biosensor on the electronic device; detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; in response to detecting the request to unlock the electronic device using the biometric sensor; in response to a determination that the error condition still occurs at each time occurring after detecting the request to unlock the electronic device, ceasing to display the indication of the location of the biosensor; and Displaying a touch-based user interface for inputting touch-based authentication information; and attempting to unlock the electronic device using the biometric sensor in response to a determination that the error condition is no longer occurring. A non-transitory computer-readable storage medium.

92. A biosensor; A touch-sensitive display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: Detecting an occurrence of an error state for detecting biological information in the biological sensor; in response to detecting the occurrence of the error condition, displaying on the touch-sensitive display an indication of a location of the biosensor on the electronic device; detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; in response to detecting the request to unlock the electronic device using the biometric sensor; in response to a determination that the error condition still occurs at each time occurring after detecting the request to unlock the electronic device, ceasing to display the indication of the location of the biosensor; and Displaying a touch-based user interface for inputting touch-based authentication information; and attempting to unlock the electronic device using the biometric sensor in response to a determination that the error condition is no longer occurring. Electronic devices.

93. 1. An electronic device comprising: A biosensor; A touch-sensitive display; means for detecting an occurrence of an error state for detecting biological information in the biological sensor; means for displaying on the touch-sensitive display an indication of a location of the biosensor on the electronic device in response to detecting the occurrence of the error condition; means for detecting a request to unlock the electronic device using the biometric sensor while displaying the indication of the location of the biometric sensor on the electronic device; in response to detecting the request to unlock the electronic device using the biometric sensor; in response to a determination that the error condition still occurs at each time occurring after detecting the request to unlock the electronic device, ceasing to display the indication of the location of the biosensor; and Displaying a touch-based user interface for inputting touch-based authentication information; and attempting to unlock the electronic device using the biometric sensor in response to a determination that the error condition is no longer occurring. An electronic device comprising:

Images