User input interface

Abstract

This disclosure relates to user input interfaces. This disclosure as a whole relates to managing user input. In some examples, the device receives user input via a biometric sensor such as a fingerprint sensor. In some examples, the device receives user input via a button. In some examples, the device receives user input via a touch sensor. In some examples, the biometric sensor and / or the touch sensor is integrated into the button.

Description

[0001] This application is a divisional application of Chinese invention patent application filed on August 31, 2021, with application number 2021800537221 and title "User Input Interface". Technical Field

[0002] This disclosure relates in general to computer user interfaces, and more specifically to techniques for managing user input. Background Technology

[0003] Electronic devices receive user input in various ways, such as via touchscreens, voice commands, and keyboards. For example, an electronic device may be configured to receive a password via keyboard before granting the user access to information. Summary of the Invention

[0004] However, some technologies used to manage user input using electronic devices are often cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may involve multiple keystrokes or button presses. Also, users may need to provide one type of input for authorization operations (such as unlocking) and another type of input for switching to a specific display. Existing technologies require more time than necessary, resulting in wasted user time and device power. This latter consideration is particularly important in battery-powered devices.

[0005] Therefore, this technology provides electronic devices with faster and more efficient methods and interfaces for managing user input. Such methods and interfaces can optionally supplement or replace other methods for managing user input. These methods and interfaces reduce the cognitive burden on users and result in more effective human-computer interfaces. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charging sessions.

[0006] According to some embodiments, a method is described. The method is performed at a computer system having a touch sensor integrated into a button, wherein the computer system communicates with a display generation component. The method includes: detecting input pointing to a button while a wake-up screen is displayed via the display generation component; and in response to detecting the input: maintaining the display of the wake-up screen via the display generation component based on determining that the input includes touching the touch sensor for less than the corresponding time threshold and does not include button activation; displaying a second user interface via the display generation component based on determining that the input includes touching the touch sensor for more than the corresponding time threshold and the computer system is unlocked, wherein the second user interface is different from the wake-up screen in the unlocked state; and stopping the display of at least a portion of the wake-up screen via the display generation component and switching the display generation component to a low-power state based on determining that the input includes button activation.

[0007] According to some embodiments, a non-transitory computer-readable storage medium is described. This non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a touch sensor integrated into a button, wherein the computer system communicates with a display generating component. The one or more programs include instructions for performing the following operations: detecting input pointing to the button when a wake-up screen is displayed via the display generating component; and in response to detecting the input: maintaining the display of the wake-up screen via the display generating component based on determining that the input includes touching the touch sensor for less than a corresponding time threshold and does not include button activation; displaying a second user interface via the display generating component based on determining that the input includes touching the touch sensor for more than the corresponding time threshold and the computer system is unlocked, wherein the second user interface is different from the wake-up screen in the unlocked state; and stopping the display of at least a portion of the wake-up screen via the display generating component and switching the display generating component to a low-power state based on determining that the input includes button activation.

[0008] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a touch sensor integrated into a button, wherein the computer system communicates with a display generating component, the one or more programs including instructions for performing the following operations: detecting input pointing to the button when a wake-up screen is displayed via the display generating component; and in response to detecting the input: maintaining the display of the wake-up screen via the display generating component based on determining that the input includes touching the touch sensor for less than a corresponding time threshold and does not include button activation; displaying a second user interface via the display generating component based on determining that the input includes touching the touch sensor for more than the corresponding time threshold and the computer system is unlocked, wherein the second user interface is different from the wake-up screen in the unlocked state; and stopping the display of at least a portion of the wake-up screen via the display generating component and switching the display generating component to a low-power state based on determining that the input includes button activation.

[0009] According to some embodiments, a computer system is described. The computer system includes: a touch sensor integrated into a button; a display generation component; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: detecting input to the button when a wake-up screen is displayed via the display generation component; and in response to detecting the input: maintaining the display of the wake-up screen via the display generation component based on determining that the input includes touching the touch sensor for less than the corresponding time threshold and does not include button activation; displaying a second user interface via the display generation component based on determining that the input includes touching the touch sensor for more than the corresponding time threshold and the computer system is unlocked, wherein the second user interface is different from the wake-up screen in the unlocked state; and stopping the display of at least a portion of the wake-up screen via the display generation component and switching the display generation component to a low-power state based on determining that the input includes button activation.

[0010] According to some embodiments, a computer system is described. The computer system includes: a touch sensor integrated into a button; a display generation component; means for detecting input pointing to the button when a wake-up screen is displayed via the display generation component; and means for performing the following operations in response to detecting the input: maintaining the display of the wake-up screen via the display generation component if the input includes touching the touch sensor for less than the corresponding time threshold and does not include button activation; displaying a second user interface via the display generation component if the input includes touching the touch sensor for more than the corresponding time threshold and the computer system is unlocked, wherein the second user interface is different from the wake-up screen in the unlocked state; and stopping the display of at least a portion of the wake-up screen via the display generation component and switching the display generation component to a low-power state if the input includes button activation.

[0011] According to some embodiments, a method is described. The method is performed at a computer system having a fingerprint sensor, wherein the computer system communicates with a display generation component. The method includes: detecting input directed at the fingerprint sensor; and in response to detecting the input: based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is less than an input threshold, displaying a wake-up screen in an unlocked state via the display generation component; and based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is greater than the input threshold, displaying a second user interface via the display generation component, wherein the second user interface is different from the wake-up screen in the unlocked state.

[0012] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a fingerprint sensor, wherein the computer system communicates with a display generation component. The one or more programs include instructions for performing the following operations: detecting input directed at the fingerprint sensor; and in response to detecting the input: based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is less than an input threshold, displaying a wake-up screen in an unlocked state via the display generation component; and based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is greater than the input threshold, displaying a second user interface via the display generation component, wherein the second user interface is different from the wake-up screen in an unlocked state.

[0013] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a fingerprint sensor, wherein the computer system communicates with a display generation component, the one or more programs including instructions for performing the following operations: detecting input directed at the fingerprint sensor; and in response to detecting the input: based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is less than an input threshold, displaying a wake-up screen in an unlocked state via the display generation component; and based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is greater than the input threshold, displaying a second user interface via the display generation component, wherein the second user interface is different from the wake-up screen in an unlocked state.

[0014] According to some embodiments, a computer system is described. The computer system includes: a fingerprint sensor; a display generation component; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: detecting input directed at the fingerprint sensor; and in response to detecting the input: based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is less than an input threshold, displaying a wake-up screen in an unlocked state via the display generation component; and based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is greater than the input threshold, displaying a second user interface via the display generation component, wherein the second user interface is different from the wake-up screen in an unlocked state.

[0015] According to some embodiments, a computer system is described. The computer system includes: a fingerprint sensor; a display generation unit; means for detecting input directed at the fingerprint sensor; and means for performing the following operations in response to detecting the input: displaying a wake-up screen in an unlocked state via the display generation unit based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is less than an input threshold; and displaying a second user interface via the display generation unit based on determining that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and is greater than the input threshold, wherein the second user interface is different from the wake-up screen in the unlocked state.

[0016] According to some embodiments, a method is described. The method is performed at a computer system having a biometric sensor, wherein the computer system communicates with a display generation component. The method includes: displaying a user interface for registering a biometric feature via the display generation component; receiving one or more registration inputs via the biometric sensor while the user interface for registering the biometric feature is displayed; registering a first biometric feature in response to receiving the one or more registration inputs; and prompting the user to register a second biometric feature different from the first biometric feature after successful registration of the first biometric feature.

[0017] According to some embodiments, a non-transitory computer-readable storage medium is described. This non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a biometric sensor, wherein the computer system communicates with a display generation component, the one or more programs including instructions for performing the following operations: displaying a user interface for registering a biometric feature via the display generation component; receiving one or more registration inputs via the biometric sensor while displaying the user interface for registering the biometric feature; registering a first biometric feature in response to receiving the one or more registration inputs; and prompting the user to register a second biometric feature different from the first biometric feature after successful registration of the first biometric feature.

[0018] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a biometric sensor, wherein the computer system communicates with a display generation component, the one or more programs including instructions for performing the following operations: displaying a user interface for registering a biometric feature via the display generation component; receiving one or more registration inputs via the biometric sensor while displaying the user interface for registering the biometric feature; registering a first biometric feature in response to receiving the one or more registration inputs; and prompting the user to register a second biometric feature different from the first biometric feature after successful registration of the first biometric feature.

[0019] According to some embodiments, a computer system is described. The computer system includes: a biometric sensor; a display generation component; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: displaying a user interface for registering a biometric feature via the display generation component; receiving one or more registration inputs via the biometric sensor while displaying the user interface for registering the biometric feature; registering a first biometric feature in response to receiving the one or more registration inputs; and prompting the user to register a second biometric feature different from the first biometric feature after successful registration of the first biometric feature.

[0020] According to some embodiments, a computer system is described. The computer system includes: a biometric sensor; a display generation component; means for displaying a user interface for registering a biometric feature via the display generation component; means for receiving one or more registration inputs via the biometric sensor while displaying the user interface for registering the biometric feature; means for registering a first biometric feature in response to receiving the one or more registration inputs; and means for prompting the user to register a second biometric feature different from the first biometric feature after successful registration of the first biometric feature.

[0021] According to some embodiments, a method is described. The method is performed at a computer system having a biometric sensor, wherein the computer system communicates with a display generation component and one or more input devices. The method includes: receiving, via one or more input devices, a request to initiate a process for registering a biometric feature, wherein the registration will be performed using biometric information collected via the biometric sensor; and in response to receiving the request to initiate the process for registering the biometric feature: based on determining that the computer system is in a first orientation, displaying via the display generation component a first user interface element indicating the location of the biometric sensor on the computer system; and based on determining that the computer system is in a second orientation, displaying via the display generation component a second user interface element indicating the location of the biometric sensor on the computer system, wherein the second user interface element is different from the first user interface element.

[0022] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a biometric sensor, wherein the computer system communicates with a display generation component and one or more input devices. The one or more programs include instructions for performing the following operations: receiving, via one or more input devices, a request to initiate a process for registering a biometric feature, wherein the registration will be performed using biometric information collected via the biometric sensor; and in response to receiving the request to initiate the process for registering the biometric feature: based on determining that the computer system is in a first orientation, displaying via the display generation component a first user interface element indicating the location of the biometric sensor on the computer system; and based on determining that the computer system is in a second orientation, displaying via the display generation component a second user interface element indicating the location of the biometric sensor on the computer system, wherein the second user interface element is different from the first user interface element.

[0023] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a biometric sensor, wherein the computer system communicates with a display generation component and one or more input devices, the one or more programs including instructions for performing the following operations: receiving, via one or more input devices, a request to initiate a process for registering a biometric feature, wherein the registration will be performed using biometric information collected via the biometric sensor; and in response to receiving the request to initiate the process for registering the biometric feature: based on determining that the computer system is in a first orientation, displaying via the display generation component a first user interface element indicating the location of the biometric sensor on the computer system; and based on determining that the computer system is in a second orientation, displaying via the display generation component a second user interface element indicating the location of the biometric sensor on the computer system, wherein the second user interface element is different from the first user interface element.

[0024] According to some embodiments, a computer system is described. The computer system includes: a biometric component; a display generation component; one or more input devices; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: receiving, via the one or more input devices, a request to initiate a process for registering a biometric feature, wherein the registration will be performed using biometric information collected via the biometric sensor; and in response to receiving the request to initiate the process for registering the biometric feature: based on determining that the computer system is in a first orientation, displaying via the display generation component a first user interface element indicating the location of the biometric sensor on the computer system; and based on determining that the computer system is in a second orientation, displaying via the display generation component a second user interface element indicating the location of the biometric sensor on the computer system, wherein the second user interface element is different from the first user interface element.

[0025] According to some embodiments, a computer system is described. The computer system includes: a biometric sensor; a display generation component; means for receiving, via one or more input devices, a request to initiate a process for registering a biometric feature, wherein the registration will be performed using biometric information collected via the biometric sensor; and means for performing the following operations in response to receiving the request to initiate the process for registering the biometric feature: based on determining that the computer system is in a first orientation, displaying via the display generation component a first user interface element indicating the location of the biometric sensor on the computer system; and based on determining that the computer system is in a second orientation, displaying via the display generation component a second user interface element indicating the location of the biometric sensor on the computer system, wherein the second user interface element is different from the first user interface element.

[0026] According to some embodiments, a method is described. The method is performed at a computer system having a fingerprint sensor, wherein the computer system communicates with a display generation component and one or more input devices. The method includes: detecting a request to perform an operation via the one or more input devices; and, in response to receiving the request to perform the operation when the fingerprint sensor is available to receive fingerprint input but no finger is currently detected on the fingerprint sensor: based on determining that the operation requires authentication and the computer system is in a first orientation, displaying a graphical indication of the location of the fingerprint sensor in a first portion of the user interface via the display generation component; and based on determining that the operation requires authentication and the computer system is in a second orientation different from the first orientation, displaying a graphical indication of the location of the fingerprint sensor in a second portion of the user interface, different from the first portion of the user interface, via the display generation component.

[0027] According to some embodiments, a non-transitory computer-readable storage medium is described. This non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a fingerprint sensor, wherein the computer system communicates with a display generation component and one or more input devices. The one or more programs include instructions for performing the following operations: receiving a request to perform an operation via the one or more input devices; and, in response to receiving the request to perform the operation when the fingerprint sensor is available to receive fingerprint input but no finger is currently detected on the fingerprint sensor: based on determining that the operation requires authentication and the computer system is in a first orientation, displaying a graphical indication of the location of the fingerprint sensor in a first portion of the user interface via the display generation component; and based on determining that the operation requires authentication and the computer system is in a second orientation different from the first orientation, displaying a graphical indication of the location of the fingerprint sensor in a second portion of the user interface, different from the first portion of the user interface, via the display generation component.

[0028] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system having a fingerprint sensor, wherein the computer system communicates with a display generation component and one or more input devices. The one or more programs include instructions for performing the following operations: receiving a request to perform an operation via the one or more input devices; and in response to receiving the request to perform the operation when the fingerprint sensor is available to receive fingerprint input but no finger is currently detected on the fingerprint sensor: based on determining that the operation requires authentication and the computer system is in a first orientation, displaying a graphical indication of the location of the fingerprint sensor in a first portion of the user interface via the display generation component; and based on determining that the operation requires authentication and the computer system is in a second orientation different from the first orientation, displaying a graphical indication of the location of the fingerprint sensor in a second portion of the user interface, different from the first portion of the user interface, via the display generation component.

[0029] According to some embodiments, a computer system is described. The computer system includes: a fingerprint sensor; a display generating component; one or more input devices; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: receiving a request to perform an operation via the one or more input devices; and responding to receiving the request to perform the operation when the fingerprint sensor is available to receive fingerprint input but no finger is currently detected on the fingerprint sensor: based on determining that the operation requires authentication and the computer system is in a first orientation, displaying a graphical indication of the location of the fingerprint sensor in a first portion of the user interface via the display generating component; and based on determining that the operation requires authentication and the computer system is in a second orientation different from the first orientation, displaying a graphical indication of the location of the fingerprint sensor in a second portion of the user interface different from the first portion of the user interface via the display generating component.

[0030] According to some embodiments, a computer system is described. The computer system includes: a fingerprint sensor; a display generating component; means for receiving a request to perform an operation via the one or more input devices; and means for performing the following operations in response to receiving the request to perform the operation when the fingerprint sensor is available to receive fingerprint input but no finger is currently detected on the fingerprint sensor: based on determining that the operation requires authentication and the computer system is in a first orientation, displaying a graphical indication of the location of the fingerprint sensor in a first portion of the user interface via the display generating component; and based on determining that the operation requires authentication and the computer system is in a second orientation different from the first orientation, displaying a graphical indication of the location of the fingerprint sensor in a second portion of the user interface, different from the first portion of the user interface, via the display generating component.

[0031] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0032] Therefore, devices are provided with faster and more efficient methods and interfaces for managing user input, thereby improving the effectiveness, efficiency, and user satisfaction of such devices. These methods and interfaces can complement or replace other methods used for managing user input. Attached Figure Description

[0033] To better understand the various embodiments described, reference should be made to the following detailed description in conjunction with the accompanying drawings, wherein similar reference numerals indicate corresponding parts in all the drawings.

[0034] Figure 1A This is a block diagram illustrating a portable multi-functional device with a touch-sensitive display according to some embodiments.

[0035] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some implementation schemes.

[0036] Figure 2 A portable multi-functional device with a touchscreen is shown according to some embodiments.

[0037] Figure 3 This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some implementation schemes.

[0038] Figure 4A An exemplary user interface for a menu applied to a portable multi-functional device, according to some implementation schemes, is shown.

[0039] Figure 4B An exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display is shown according to some embodiments.

[0040] Figure 5A A personal electronic device according to some implementation schemes is shown.

[0041] Figure 5B This is a block diagram illustrating a personal electronic device according to some implementation schemes.

[0042] Figures 5C-5D Exemplary components of a personal electronic device having a touch-sensitive display and an intensity sensor according to some embodiments are shown.

[0043] Figures 5E-5H Exemplary components and user interfaces of a personal electronic device according to some implementation schemes are shown.

[0044] Figures 6A-6AY Exemplary devices and user interfaces for detecting press input and touch input, as well as for performing biometric authentication, are shown.

[0045] Figure 7 This is a flowchart illustrating a method for disambiguating between touch input for displaying a user interface and press input for transitioning to a low-power state, according to some embodiments.

[0046] Figure 8This is a flowchart illustrating a method for disambiguating inputs that are greater than or less than an input threshold, according to some implementation schemes.

[0047] Figures 9A-9AH An exemplary user interface is shown for prompting users to register biometric features for various device orientations and performing actions based on authentication requirements.

[0048] Figure 10 This is a flowchart illustrating a method for prompting the registration of a second biometric feature after registering a first biometric feature, according to some implementation schemes.

[0049] Figure 11 This is a flowchart illustrating a method for managing device orientation during biometric registration according to some implementation schemes.

[0050] Figure 12 This is a flowchart illustrating a method for managing requests that perform operations based on authentication requirements, according to some implementation schemes. Detailed Implementation

[0051] The following description illustrates exemplary methods, parameters, etc. However, it should be understood that such description is not intended to limit the scope of this disclosure, but is provided as a description of exemplary embodiments.

[0052] Electronic devices need to provide efficient methods and interfaces for managing user input. For example, some technologies enable devices to disambiguate between different types of commands while simultaneously providing biometric authorization. Others allow multiple biometric features to be registered during the device setup process. Still others enable the provision of device orientation-specific information when registering biometric information. And still others enable the display of information used to collect biometric information to perform authorized operations.

[0053] Such technologies can reduce the cognitive burden on users providing input to devices, such as authorized input, thereby increasing productivity. Furthermore, these technologies can reduce processor and battery power that would otherwise be wasted on redundant user input.

[0054] under Figure 1A-Figure 1B , Figure 2 , Figure 3 , Figures 4A-4B and Figures 5A-5H A description of an exemplary device for performing techniques for managing user input is provided. Figures 6A-6AY Exemplary devices and user interfaces for detecting press input and touch input, as well as for performing biometric authentication, are shown. Figure 7This is a flowchart illustrating a method for disambiguating between touch input for displaying a user interface and press input for transitioning to a low-power state, according to some embodiments. Figure 8 This is a flowchart illustrating a method for disambiguating inputs that are greater than or less than an input threshold, according to some implementation schemes. Figures 6A-6AY The user interface in the document is used to display including Figures 7-8 The process described below is the process in the middle. Figures 9A-9P An exemplary user interface is shown for prompting users to register biometric features and for managing device orientation during biometric registration. Figure 10 This is a flowchart illustrating a method for prompting the registration of a second biometric feature after registering a first biometric feature, according to some implementation schemes. Figure 11 This is a flowchart illustrating a method for managing device orientation during biometric registration. Figures 9A-9P The user interface in the document is used to display including Figures 10-11 The process described below is the process in the middle. Figure 9Q-Figure 9AH An exemplary user interface is shown for managing requests to perform operations based on authentication requirements. Figure 12 This is a flowchart illustrating a method for managing requests that perform operations based on authentication requirements, according to some implementation schemes. Figure 9Q-Figure 9AH The user interface in the document is used to display including Figure 12 The process described below is the process in the middle.

[0055] Furthermore, in methods described herein where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the method may be repeated in multiple repetitions such that, during the repetitions, all conditions determining the steps in the method are satisfied in different repetitions of the method. For example, if a method requires performing a first step (if a condition is satisfied) and a second step (if a condition is not satisfied), those skilled in the art will know that the stated steps are repeated until both conditions are satisfied and not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method is satisfied. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing discretionary operations based on the satisfaction of the corresponding one or more conditions, and thus to determine whether possible conditions have been satisfied without explicitly repeating the steps of the method until all conditions determining the steps in the method are satisfied. Those skilled in the art will also understand that, similar to methods having discretionary steps, a system or computer-readable storage medium may repeat the steps of the method multiple times as needed to ensure that all discretionary steps have been performed.

[0056] Although the following description uses the terms "first," "second," etc., to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch may be named a second touch and similarly, a second touch may be named a first touch, without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.

[0057] The terminology used in the description of the various embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various embodiments and the appended claims, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms “includes”, “including”, “comprises”, and / or “comprising”, when used in this specification, specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0058] Depending on the context, the term "if" may optionally be interpreted as meaning "when," "in response to," or "in response to detection." Similarly, depending on the context, the phrases "if it is determined..." or "if [the stated condition or event] is detected" may optionally be interpreted as meaning "in response to determining..." or "in response to detecting [the stated condition or event]."

[0059] This document describes implementations of electronic devices, user interfaces for such devices, and related processes for using such devices. In some implementations, the device is a portable communication device, such as a mobile phone, that also includes other functions such as PDA and / or music player functionality. Exemplary implementations of portable multi-functional devices include, but are not limited to, those from Apple Inc. (Cupertino, California). Devices, iPod Equipment, and Device. Optionally, other portable electronic devices may be used, such as laptops or tablets with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). In some embodiments, the electronic device is a computer system that communicates with a display generating component (e.g., via wireless or wired communication). The display generating component is configured to provide visual output, such as a display via a CRT monitor, a display via an LED monitor, or a display via image projection. In some embodiments, the display generating component is integrated with the computer system. In some embodiments, the display generating component is separate from the computer system. As used herein, “display” content includes displaying content (e.g., video data rendered or decoded by display controller 156) by transmitting data (e.g., image data or video data) to an integrated or external display generating component via a wired or wireless connection to visually generate content.

[0060] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device may optionally include one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.

[0061] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, gaming applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camcorder applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0062] Various applications running on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally utilizes a user interface that is intuitive and clear to the user to support various applications.

[0063] Now let’s turn our attention to implementation schemes for portable devices with touch-sensitive displays. Figure 1AThis is a block diagram illustrating a portable multi-functional device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a “touchscreen” for convenience, and is sometimes referred to as or called a “touch-sensitive display system.” Device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more haptic output generators 167 for generating haptic output on device 100 (e.g., generating haptic output on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0064] As used in this specification and claims, the term "intensity" of contact on a tactile surface refers to the force or pressure (force per unit area) of a contact (e.g., finger contact) on a tactile surface, or to a substitute (alternative) for the force or pressure of a contact on a tactile surface. The intensity of contact has a range of values ​​that includes at least four different values ​​and more typically hundreds of different values ​​(e.g., at least 256). The intensity of contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the tactile surface are optionally used to measure the force at different points on the tactile surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the tactile surface. Alternatively, the size and / or variation of the contact area detected on the touch-sensitive surface, the capacitance and / or variation of the touch-sensitive surface near the contact, and / or the resistance and / or variation of the touch-sensitive surface near the contact may optionally be used as substitutes for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold (e.g., the intensity threshold is described in units corresponding to the substitute measurement) has been exceeded. In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in units of pressure) has been exceeded. Using the intensity of the contact as an attribute of user input allows the user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited physical space, which is used (e.g., on a touch-sensitive display) to display an indication and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0065] As used in this specification and claims, the term "haptic output" refers to a physical displacement of the device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of mass of the device, which is detected by the user using the user's tactile sense. For example, when the device or a component of the device comes into contact with a touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touchpad) may optionally be interpreted by the user as a "press-click" or "release-click" on a physically actuated button. In some cases, the user will feel a tactile sensation, such as a "press-click" or "release-click," even when a physically actuated button associated with a touch-sensitive surface that has been physically pressed (e.g., displaced) by the user's movement does not move. For example, even when the smoothness of the tactile surface remains unchanged, the movement of the tactile surface can optionally be interpreted or sensed by the user as the "roughness" of the tactile surface. While such interpretations of touch by users will be limited by the individualized sensory perceptions of the user, many sensory perceptions of touch are common to most users. Therefore, when a tactile output is described as corresponding to a specific sensory perception of a user (e.g., "press click", "release click", "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or its components that will generate the sensory perception of a typical (or ordinary) user.

[0066] It should be understood that device 100 is merely an example of a portable multifunctional device, and device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application-specific integrated circuits.

[0067] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls other components of device 100 to access memory 102.

[0068] Peripheral interface 118 can be used to couple the device's input and output peripherals to CPU 120 and memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0069] RF (Radio Frequency) circuit 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuit 108 converts electrical signals into electromagnetic signals and vice versa, and communicates with communication networks and other communication devices via these electromagnetic signals. RF circuit 108 optionally includes well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, Subscriber Identity Module (SIM) cards, memory, etc. RF circuit 108 optionally communicates wirelessly with networks and other devices, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via near-field communication radio components. Wireless communication may optionally employ any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolution, Pure Data (EV-DO), HSPA, HSPA+, Dual-Unit HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), and Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE...). 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Messaging Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence with Extended Utility (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol that has not been developed as of the date of this document submission.

[0070] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves that are audible to humans. Audio circuitry 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuitry 110 converts the electrical signals into audio data and transmits the audio data to peripheral interface 118 for processing. Audio data is optionally retrieved by peripheral interface 118 from and / or transmitted to memory 102 and / or RF circuitry 108. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., ...). Figure 2 (212 in the text). The headset jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device, such as an output-only headphone or a headset with both output (e.g., a single-ear or dual-ear headphone) and input (e.g., a microphone).

[0071] I / O subsystem 106 couples input / output peripherals on device 100, such as touchscreen 112 and other input control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, optical sensor controller 158, depth camera controller 169, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / send electrical signals to the other input control device 116. The other input control device 116 optionally includes physical buttons (e.g., push-buttons, rocker buttons, etc.), dial pads, slide switches, joysticks, click dials, etc. In some embodiments, input controller 160 is optionally coupled to (or not coupled to) any of the following: keyboard, infrared port, USB port, and pointing device such as mouse. One or more buttons (e.g., Figure 2 Optionally, 208) includes an increase / decrease button for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push-button (e.g., Figure 2(Ref. 206 in the original text). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad, as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking user gestures (e.g., hand gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.

[0072] A quick press of the push button optionally disengages the touchscreen 112 from its lock or optionally initiates a process of unlocking the device using gestures on the touchscreen, as described in U.S. Patent Application 11 / 322,549 (i.e., U.S. Patent No. 7,657,849), filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," the entire contents of which are incorporated herein by reference. A long press of the push button (e.g., 206) optionally powers the device 100 on or off. The function of one or more buttons is optionally user-customizable. The touchscreen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0073] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or sends electrical signals to the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively, "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0074] Touchscreen 112 has a touch-sensitive surface, sensor, or sensor array that accepts input from a user based on tactile and / or haptic contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction set in memory 102) detect contact on touchscreen 112 (and any movement or interruption of that contact) and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the contact point between touchscreen 112 and the user corresponds to the user's finger.

[0075] Touchscreen 112 optionally employs LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally employ any of a variety of touch sensing technologies now known or to be developed hereafter, along with other proximity sensor arrays or other elements for determining one or more points of contact with touchscreen 112, to detect contact and any movement or interruption thereof. These various touch sensing technologies include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that from Apple Inc. (Cupertino, California). and iPod The technology used.

[0076] In some embodiments of the touchscreen 112, the touch-sensitive display optionally resembles a multi-touch touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is incorporated herein by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.

[0077] The touch-sensitive display in some embodiments of the touchscreen 112 is described in the following applications: (1) U.S. Patent Application 11 / 381,313, filed May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. Patent Application 10 / 840,862, filed May 6, 2004, “Multipoint Touchscreen”; (3) U.S. Patent Application 10 / 903,964, filed July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application 11 / 048,264, filed January 31, 2005, “Gestures For Touch Sensitive Input Devices”; and (5) U.S. Patent Application 11 / 038,590, filed January 18, 2005, “Mode-Based Graphical User Interfaces For Touch Sensitive Input”. (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, “Multi-Functional Hand-Held Device”. The full text of all these applications is incorporated herein by reference.

[0078] Touchscreen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. Users optionally use any suitable object or accessory such as a stylus, finger, etc., to interact with touchscreen 112. In some embodiments, the user interface is designed to operate primarily through finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​a finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positions or commands to perform the user-desired actions.

[0079] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. Optionally, the touchpad is a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.

[0080] The device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., light-emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power in the portable device.

[0081] The device 100 may optionally also include one or more optical sensors 164. Figure 1AAn optical sensor 164 is shown coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with an imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to a touchscreen display 112 on the front of the device, allowing the touchscreen display to be used as a viewfinder for still image and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing images of the user to be optionally acquired for video conferencing while the user views other video conferencing participants on the touchscreen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lenses and sensor within the device housing), allowing a single optical sensor 164 to be used in conjunction with the touchscreen display for both video conferencing and still image and / or video image acquisition.

[0082] The device 100 optionally also includes one or more depth camera sensors 175. Figure 1A A depth camera sensor is shown coupled to a depth camera controller 169 in I / O subsystem 106. Depth camera sensor 175 receives data from the environment to create a 3D model of an object (e.g., a face) within the scene from a viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with imaging module 143 (also referred to as a camera module), depth camera sensor 175 may optionally be used to determine depth maps of different portions of an image captured by imaging module 143. In some embodiments, the depth camera sensor is located at the front of device 100, such that user images with depth information are optionally acquired for video conferencing while the user views other video conferencing participants on a touchscreen display, and selfies with depth map data are captured. In some embodiments, depth camera sensor 175 is located at the rear of the device, or both the rear and front of device 100. In some embodiments, the position of depth camera sensor 175 may be changed by the user (e.g., by rotating a lens and sensor within the device housing), such that depth camera sensor 175 is used in conjunction with a touchscreen display for both video conferencing and still image and / or video image acquisition.

[0083] In some implementations, the depth map (e.g., a depth map image) contains information (e.g., values) relating to the distance of objects in the scene from the viewpoint (e.g., a camera, optical sensor, depth camera sensor). In one implementation of the depth map, each depth pixel defines the location of its corresponding two-dimensional pixel on the Z-axis of the viewpoint. In some implementations, the depth map consists of pixels, where each pixel is defined by a value (e.g., 0 to 255). For example, a "0" value represents the pixel furthest from the viewpoint (e.g., a camera, optical sensor, depth camera sensor) in the "3D" scene, and a "255" value represents the pixel closest to the viewpoint in the "3D" scene. In other implementations, the depth map represents the distance between objects in the scene and the plane of the viewpoint. In some implementations, the depth map includes information about the relative depth of various features of the object of interest within the field of view of the depth camera (e.g., the relative depth of the eyes, nose, mouth, and ears of a user's face). In some implementations, the depth map includes information that enables the device to determine the contour of the object of interest in the z-direction.

[0084] The device 100 may optionally also include one or more contact strength sensors 165. Figure 1A A contact strength sensor is shown coupled to a strength sensor controller 159 in I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-force sensors, piezoelectric sensors, optical force sensors, capacitive touch-sensitive surfaces, or other strength sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a substitute for pressure information) from the environment. In some embodiments, at least one contact strength sensor is arranged juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the rear of device 100, opposite to the touchscreen display 112 located on the front of device 100.

[0085] The device 100 optionally also includes one or more proximity sensors 166. Figure 1AA proximity sensor 166 coupled to a peripheral device interface 118 is shown. Alternatively, the proximity sensor 166 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The proximity sensor 166 may optionally perform as described in the following U.S. patent applications: No. 11 / 241,839, entitled "Proximity Detector In Handheld Device"; No. 11 / 240,788, entitled "Proximity Detector In Handheld Device"; No. 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; No. 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and No. 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", the entire contents of which are incorporated herein by reference. In some implementations, the proximity sensor is turned off and the touchscreen 112 is disabled when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call).

[0086] The device 100 may optionally also include one or more tactile output generators 167. Figure 1AA haptic output generator coupled to a haptic feedback controller 161 in I / O subsystem 106 is shown. The haptic output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components for converting electrical signals into haptic outputs on the device). A contact intensity sensor 165 receives haptic feedback generation instructions from a haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a haptic surface (e.g., haptic display system 112) and optionally generates the haptic output by moving the haptic surface vertically (e.g., in / outward from the surface of device 100) or laterally (e.g., backward and forward in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of the device 100, opposite to the touch screen display 112 located on the front of the device 100.

[0087] The device 100 may optionally also include one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to a peripheral device interface 118 is shown. Alternatively, the accelerometer 168 may be coupled to an input controller 160 in an I / O subsystem 106. The accelerometer 168 may optionally perform as described in the following U.S. patent publications: U.S. Patent Publication No. 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication No. 20060017692, entitled "Methods and Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on analysis of data received from one or more accelerometers. Device 100 may optionally include, in addition to the accelerometer 168, a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for acquiring information about the location and orientation (e.g., portrait or landscape) of device 100.

[0088] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, in some embodiments, memory 102 ( Figure 1A ) or 370 ( Figure 3 Storage device / global internal state 157, such as Figure 1A and Figure 3 As shown in the figure. Device / global internal state 157 includes one or more of the following: active application state, which indicates which applications (if any) are currently active; display state, indicating what applications, views or other information occupy various areas of the touch screen display 112; sensor state, including information obtained from the device's various sensors and input control devices 116; and position information relating to the device's position and / or orientation.

[0089] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or embedded operating systems such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0090] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled via a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is connected to… (Trademark of Apple Inc.) The same or similar and / or compatible multi-pin (e.g., 30-pin) connectors used in Apple Inc. devices.

[0091] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., touchpads or physical click-based rotary dials). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (e.g., detecting a finger press event), determining the contact intensity (e.g., the force or pressure of the contact, or an alternative to force or pressure), determining whether there is movement of the contact and tracking movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or a contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact) or multi-point simultaneous contact (e.g., "multi-touch" / multiple-finger contact). In some implementations, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0092] In some implementations, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., determining whether the user has “clicked” an icon). In some implementations, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a specific physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a touchpad or touchscreen can be set to any threshold in a wide range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some specific implementations, the user of the device is provided with software settings for adjusting one or more intensity thresholds in a set (e.g., by adjusting the individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using system-level clicks on the “intensity” parameter).

[0093] The touch / motion module 130 optionally detects gesture input performed by the user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensities of the detected contact). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event and then detecting a finger lift-off (lift-away) event at the same (or substantially the same) location as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and subsequently detecting a finger lift-off (lift-away) event.

[0094] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other displays, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0095] In some implementations, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from applications, etc., specifying the graphics to be displayed, and also receives coordinate data and other graphic attribute data if necessary, and then generates screen image data for output to the display controller 156.

[0096] The haptic feedback module 133 includes various software components for generating instructions which are used by the haptic output generator 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0097] Optionally, the text input module 134, a component of the graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).

[0098] GPS module 135 determines the location of the device and provides that information for use in various applications (e.g., to telephone 138 for use in location-based dialing; to camera 143 as image / video metadata; and to applications that provide location-based services, such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0099] Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof:

[0100] • Contacts module 137 (sometimes called address book or contact list);

[0101] • Telephone module 138;

[0102] • Video conferencing module 139;

[0103] • Email client module 140;

[0104] • Instant Messaging (IM) module 141;

[0105] Fitness support module 142;

[0106] • Camera module 143 for still images and / or video images;

[0107] • Image management module 144;

[0108] • Video player module;

[0109] Music player module;

[0110] • Browser module 147;

[0111] • Calendar module 148;

[0112] • Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets acquired by the user, and user-created widgets 149-6;

[0113] • Widget creator module 150 for creating user-created widgets 149-6;

[0114] • Search module 151;

[0115] • Video and music player module 152, which combines a video player module and a music player module;

[0116] • Notes module 153;

[0117] • Map module 154; and / or

[0118] • Online video module 155.

[0119] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, Java-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.

[0120] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., in application internal state 192 of the contact module 137 stored in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and so on.

[0121] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, telephone module 138 is optionally used to input character sequences corresponding to telephone numbers, access one or more telephone numbers in contact module 137, modify entered telephone numbers, dial corresponding telephone numbers, initiate conversations, and disconnect or hang up when a conversation is completed. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0122] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, video conferencing module 139 includes executable instructions to initiate, conduct, and terminate video conferences between the user and one or more other participants based on user instructions.

[0123] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. Combined with image management module 144, email client module 140 makes it very easy to create and send emails containing still images or video images captured by camera module 143.

[0124] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting a corresponding instant message (e.g., using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving an instant message, and viewing a received instant message. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Services (EMS). As used herein, "instant message" refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0125] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, fitness support module 142 includes executable instructions for creating fitness activities (e.g., with time, distance, and / or calorie burning goals); communicating with fitness sensors (executive devices); receiving fitness sensor data; calibrating sensors used to monitor fitness; selecting and playing music for fitness activities; and displaying, storing, and transmitting fitness data.

[0126] In conjunction with the touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, the camera module 143 includes executable instructions for: capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0127] Incorporating the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, tagging, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0128] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for browsing the Internet according to user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as links to attachments and other files on web pages.

[0129] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and associated data (e.g., calendar entries, to-dos, etc.) according to user instructions.

[0130] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is optionally a micro-application downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or a user-created micro-application (e.g., user-created widget 149-6). In some embodiments, the widget includes HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widget includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).

[0131] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 can optionally be used by the user to create widgets (e.g., to convert user-specified portions of a webpage into widgets).

[0132] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0133] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions allowing users to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0134] Incorporating the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the note-taking module 153 includes executable instructions for creating and managing notes, to-do items, etc., according to user instructions.

[0135] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 is optionally used to receive, display, modify, and store maps and map-related data (e.g., driving directions, data related to shops and other points of interest at or near a specific location, and other location-based data) according to user instructions.

[0136] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions for performing the following actions: allowing users to access, browse, receive (e.g., via streaming and / or downloading), play back (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Further descriptions of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are incorporated herein by reference in their entirety.

[0137] Each of the above modules and applications corresponds to an executable set of instructions for performing one or more of the functions described above and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods as described herein). These modules (e.g., instruction sets) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules; therefore, various subsets of these modules may optionally be combined or otherwise rearranged in various embodiments. For example, a video player module may optionally be combined with a music player module into a single module (e.g., Figure 1A (e.g., video and music player module 152). In some embodiments, memory 102 optionally stores subgroups of the aforementioned modules and data structures. Additionally, memory 102 optionally stores other modules and data structures not described above.

[0138] In some implementations, device 100 is a device on which the operation of a predefined set of functions is performed solely via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push-buttons, dials, etc.) on device 100 can be optionally reduced.

[0139] A predefined set of functions, uniquely performed via a touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to the main menu, home menu, or root menu. In such embodiments, a "menu button" is implemented using a touchpad. In some other embodiments, the menu button is a physical push-button or other physical input control device, rather than a touchpad.

[0140] Figure 1B This is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 This includes an event classifier 170 (e.g., in operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0141] Event classifier 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which the event information should be delivered. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information should be delivered.

[0142] In some implementations, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or ready to be displayed by the application 136-1, a state queue for enabling the user to return to the previous state or view of the application 136-1, and a repeat / undo queue for the user's previous actions.

[0143] Event monitor 171 receives event information from peripheral device interface 118. The event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripheral device interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuitry 110). The information received by peripheral device interface 118 from I / O subsystem 106 includes information from touch-sensitive display 112 or touch-sensitive surfaces.

[0144] In some implementations, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other implementations, peripheral device interface 118 transmits event information only when a significant event occurs (e.g., receiving input above a predetermined noise threshold and / or receiving input for a predetermined duration).

[0145] In some implementations, the event classifier 170 also includes a hit view determination module 172 and / or an activity event recognizer determination module 173.

[0146] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views. A view consists of controls and other elements that the user can see on the display.

[0147] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a procedural level within the application's procedural or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct input is optionally determined at least in part based on the hit view of the initial touch that initiates a touch-based gesture.

[0148] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchical structure from which the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events forming an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source to which it was identified as the hit view.

[0149] The activity event recognizer determination module 173 determines which views(s) within the view hierarchy should receive a specific sub-event sequence. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should receive the specific sub-event sequence. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive the specific sub-event sequence. In other embodiments, even if the touch sub-event is entirely confined to the area associated with a particular view, higher views in the hierarchy will still remain actively participating views.

[0150] Event assigner module 174 assigns event information to event identifiers (e.g., event identifier 180). In embodiments that include active event identifier determination module 173, event assigner module 174 delivers event information to the event identifier determined by active event identifier determination module 173. In some embodiments, event assigner module 174 stores event information in an event queue, which is retrieved by the corresponding event receiver 182.

[0151] In some implementations, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another implementation, event classifier 170 is a standalone module or part of another module (such as contact / motion module 130) stored in memory 102.

[0152] In some implementations, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other implementations, one or more of the event recognizers 180 are part of a separate module, such as a user interface toolkit or a higher-level object from which application 136-1 inherits methods and other properties. In some implementations, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handlers 190 optionally utilize or invoke the data updater 176, the object updater 177, or the GUI updater 178 to update the application's internal state 192. Alternatively, one or more application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0153] The corresponding event recognizer 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognizer 180 also includes at least one subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0154] Event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events, such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a longitudinal orientation to a lateral orientation, or vice versa), and the event information includes corresponding information about the device's current orientation (also referred to as device orientation).

[0155] Event comparator 184 compares event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains definitions of events (e.g., predefined sequences of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, event 1 (187-1) is defined as a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off of a predetermined duration (touch end), a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off of a predetermined duration (touch end). In another example, event 2 (187-2) is defined as a drag on a displayed object. For example, dragging includes a touch (or contact) on the displayed object for a predetermined duration, movement of the touch on the touch-sensitive display 112, and lifting off the touch (end of touch). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0156] In some implementations, event definition 187 includes definitions of events for corresponding user interface objects. In some implementations, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and the object that triggered the hit test.

[0157] In some implementations, the definition of the corresponding event (187) also includes a delay action that delays the delivery of event information until it has been determined whether the sub-event sequence actually corresponds to or does not correspond to the event type of the event recognizer.

[0158] When the corresponding event recognizer 180 determines that the sub-event sequence does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events based on touch gestures are ignored. In this case, other event recognizers (if any) that remain active in the hit view continue to track and process the ongoing sub-events based on touch gestures.

[0159] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists instructing how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing how or how event recognizers can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0160] In some implementations, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some implementations, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and delaying) the sub-event to the corresponding hit view. In some implementations, the event recognizer 180 throws a tag associated with the identified event, and the event handler 190 associated with that tag retrieves the tag and executes a predefined procedure.

[0161] In some implementations, event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and performs a predetermined procedure.

[0162] In some implementations, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some implementations, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the location of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on touch-sensitive display.

[0163] In some implementations, event handler 190 includes, or has access to, a data updater 176, an object updater 177, and a GUI updater 178. In some implementations, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other implementations, they are included in two or more software modules.

[0164] It should be understood that the above discussion regarding event handling for user touch on a touch-sensitive display also applies to other forms of user input used to operate the multifunction device 100 using an input device, and not all user input is initiated on the touchscreen. For example, mouse movement and mouse button presses optionally in conjunction with single or multiple keyboard presses or holds; touch movements on the touchpad, such as taps, drags, scrolls, etc.; stylus input; device movement; verbal commands; detected eye movements; biometric input; and / or any combination thereof may optionally be used as input corresponding to sub-events that define the event to be identified.

[0165] Figure 2A portable multifunction device 100 with a touchscreen 112 is shown according to some embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more graphics by gesturing over the graphics, for example, using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or scrolling (from right to left, from left to right, up and / or down) of a finger already in contact with the device 100. In some specific embodiments or in some cases, unintentional contact with a graphic does not select the graphic. For example, a swipe gesture over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0166] Device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, menu button 204 is optionally used to navigate to any application 136 of a set of applications optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touchscreen 112.

[0167] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push-button 206 for powering on / off and locking the device, one or more volume control buttons 208, a SIM card slot 210, a headset jack 212, and a docking / charging external port 124. The push-button 206 is optionally used to power on / off the device by pressing the button and holding it in the pressed state for a predefined time interval; to lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In another embodiment, device 100 also accepts voice input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more haptic output generators 167 for generating haptic outputs for a user of device 100.

[0168] Figure 3This is a block diagram of an exemplary multi-functional device with a display and a touch-sensitive surface according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (e.g., a home controller or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, and a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the reference above). Figure 1A The tactile output generator 167 and sensor 359 (e.g., optical sensor, accelerometer, proximity sensor, touch sensor and / or contact intensity sensor (similar to the one mentioned above)) are described. Figure 1A The contact strength sensor 165 is described above. The memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. The memory 370 optionally includes one or more storage devices located remotely from the CPU 310. In some embodiments, the memory 370 stores information related to the portable multifunction device 100. Figure 1A The memory 370 stores programs, modules, and data structures similar to those in the memory 102 of the portable multifunction device 100, or subsets thereof. Additionally, the memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a rendering module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the portable multifunction device 100 (… Figure 1A The memory 102 may optionally not store these modules.

[0169] Figure 3Each of the elements described above is optionally stored in one or more memory devices of the previously mentioned memory devices. Each of the modules described above corresponds to a set of instructions for performing the functions described above. The modules or computer programs described above (e.g., instruction sets or including instructions) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules, and therefore various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subgroup of the modules and data structures described above. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0170] Now let’s turn our attention to the implementation of the user interface, which is optionally implemented on, for example, a portable multifunction device 100.

[0171] Figure 4A An exemplary user interface for an application menu on a portable multifunction device 100 according to some embodiments is shown. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements or a subset or superset thereof:

[0172] • Signal strength indicator 402 for wireless communications such as cellular signals and Wi-Fi signals;

[0173] • Time 404;

[0174] Bluetooth indicator 405;

[0175] • Battery status indicator 406;

[0176] • Tray icon 408 with icons for frequently used applications, such as:

[0177] The telephone module 138 has an icon 416 labeled "telephone", which optionally includes an indicator 414 indicating the number of missed calls or voicemail messages.

[0178] The email client module 140 has an icon 418 labeled "Mail", which optionally includes an indicator 410 for the number of unread emails;

[0179] The browser module 147 has an icon 420 labeled "Browser"; and

[0180] The video and music player module 152 (also known as the iPod module 152, a trademark of Apple Inc.) with an icon 422 labeled "iPod"; and

[0181] • Icons of other applications, such as:

[0182] Icon 424 of the οIM module 141, labeled "Message";

[0183] ○The calendar module 148 has an icon 426 labeled "Calendar";

[0184] ○ The icon 428 of the image management module 144 is labeled "Photo".

[0185] ○ The icon 430 of camera module 143, which is labeled "camera";

[0186] ○ The icon 432 of the online video module 155, which is labeled "Online Video";

[0187] ○ The icon 434 labeled "Stock Market" in the Stock Market widget 149-2;

[0188] ○The icon 436 of the map module 154 that is labeled "map";

[0189] ○The weather widget 149-1 has icon 438 labeled "weather";

[0190] ○ The alarm clock widget 149-4 has an icon 440 labeled "clock";

[0191] ○ The icon 442 of the fitness support module 142 is labeled "fitness support";

[0192] ○ The icon 444 labeled "Notes" in Notes module 153; and

[0193] ○ The icon 446, labeled "Settings," is used to set up an application or module that provides access to settings for the device 100 and its various applications 136.

[0194] It should be pointed out that, Figure 4A The icon labels shown are merely exemplary. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels may be optionally used for various application icons. In some embodiments, the label of a particular application icon includes the name of the application corresponding to that particular application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to that particular application icon.

[0195] Figure 4B A touch-sensitive surface 451 (e.g., separate from the display 450 (e.g., touchscreen display 112)) is shown. Figure 3 Devices such as tablets or touchpads (e.g., 355) Figure 3An exemplary user interface on the device 300. The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) for detecting the intensity of contact on the tactile surface 451 and / or one or more tactile output generators 357 for generating tactile outputs for the user of the device 300.

[0196] While some examples of input on a reference touchscreen display 112 (which combines a touch-sensitive surface and a display) are given below, in some implementations the device detects input on a touch-sensitive surface separate from the display, such as... Figure 4B As shown in the diagram. In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a spindle (e.g., on the display (e.g., 450)). Figure 4B The spindle corresponding to 453 in the middle (e.g., Figure 4B (452 in the example). According to these embodiments, the device detects the position corresponding to the corresponding position on the display (e.g., in the example). Figure 4B In the middle, 460 corresponds to 468 and 462 corresponds to 470) is in contact with the touch-sensitive surface 451 (e.g., Figure 4B (460 and 462 in the text). Thus, when the touch-sensitive surface (e.g., ...) Figure 4B 451) and the display of a multi-functional device (e.g., Figure 4B When 450 is separated from the touch-sensitive surface, user input detected by the device on that touch-sensitive surface (e.g., touches 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods may optionally be used for other user interfaces described herein.

[0197] Additionally, while the examples below are primarily given with reference to finger input (e.g., finger touch, single-finger tap, finger swipe), it should be understood that in some implementations, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of a touch), followed by movement of the cursor along the swipe path (e.g., instead of movement of the touch). Similarly, a tap gesture may optionally be replaced by a mouse click while the cursor is over the location of the tap gesture (e.g., instead of detection of touch, followed by cessation of touch detection). Likewise, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.

[0198] Figure 5AAn exemplary personal electronic device 500 is illustrated. Device 500 includes a body 502. In some embodiments, device 500 may include components relative to devices 100 and 300 (e.g., Figures 1A to 4B Some or all of the features described herein. In some embodiments, device 500 has a touch-sensitive display 504, referred to below as touchscreen 504. As an alternative to or complement to touchscreen 504, device 500 has a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, touchscreen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of an applied contact (e.g., touch). The one or more intensity sensors of touchscreen 504 (or touch-sensitive surface) can provide output data representing the intensity of the touch. The user interface of device 500 can respond to touches based on the intensity of the touch, meaning that touches of different intensities can invoke different user interface operations on device 500.

[0199] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is incorporated herein by reference in its entirety.

[0200] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508 (if included) may be physical. Examples of physical input mechanisms include push-buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) allow device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watch straps, bangles, trousers, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow a user to wear device 500.

[0201] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, device 500 may include a reference retrieval system. Figure 1A , Figure 1B and Figure 3 Some or all of the components described herein. Device 500 has a bus 512 that operatively couples I / O portion 514 to one or more computer processors 516 and memory 518. I / O portion 514 may be connected to display 504, which may have touch-sensitive components 522 and optionally have an intensity sensor 524 (e.g., a contact intensity sensor). Furthermore, I / O portion 514 may be connected to communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 may optionally be a rotatable input device or a pressable input device and a rotatable input device. In some examples, input mechanism 508 may optionally be a button.

[0202] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to the I / O section 514.

[0203] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including processes 700, 800, 1000, 1100, and 1200. Figure 7 , Figure 8 , Figure 10 , Figure 11 and Figure 12A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state storage such as flash memory, solid-state drives, etc. Personal electronic devices are not limited to... Figure 5B It can be the components and configurations, or it can include other components or additional components in a variety of configurations.

[0204] As used herein, the term "power indication" refers optionally to the power indication in devices 100, 300, and / or 500 ( Figure 1A , Figure 3 and Figures 5A to 5B A user-interactive graphical user interface object displayed on a screen. For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) optionally each constitute a functional representation.

[0205] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some specific implementations that include a cursor or other positional marker, the cursor acts as a "focus selector," such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the cursor is positioned on a touch-sensitive surface (e.g., a...). Figure 3 The touchpad 355 or Figure 4B When an input (e.g., a press input) is detected on the touch-sensitive surface 451 of the display, the specific user interface element is adjusted according to the detected input. This applies to touchscreen displays (e.g., those capable of enabling direct interaction with user interface elements on the touchscreen display) Figure 1A The touch-sensitive display system 112 or Figure 4AIn some embodiments of the touchscreen 112, a touch detected on the touchscreen acts as a "focus selector," such that when input (e.g., a press input by touch) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, that particular user interface element is adjusted according to the detected input. In some embodiments, focus moves from one area of ​​the user interface to another without corresponding movement of the cursor or movement of a touch on the touchscreen display (e.g., moving focus from one button to another using tab keys or arrow keys); in these embodiments, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user-controlled user interface element (or a touch on the touchscreen display) that delivers the user-expected interaction with the user interface (e.g., by indicating to the device the element of the user interface that the user expects to interact with). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of the focus selector (e.g., a cursor, touch, or selection box) above the corresponding button will indicate to the user that they expect to activate the corresponding button (rather than other user interface elements shown on the device's display).

[0206] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected over a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted away, before or after contact begins to move, before contact ends, before or after contact intensity is detected to increase and / or before or after contact intensity decreases). The characteristic intensity of the contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the value at the top 10% of the contact intensity, the half maximum value of the contact intensity, the 90% maximum value of the contact intensity, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the contact intensity over time). In some implementations, the feature intensity is compared to a set of one or more intensity thresholds to determine whether the user has performed an action. For example, the set of one or more intensity thresholds may optionally include a first intensity threshold and a second intensity threshold. In this example, contact with a feature intensity not exceeding the first threshold results in a first action, contact with a feature intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a feature intensity exceeding the second threshold results in a third action. In some implementations, a comparison between the feature intensity and one or more thresholds is used to determine whether to perform one or more actions (e.g., whether to perform the corresponding action or abandon performing the corresponding action) rather than to determine whether to perform the first action or the second action.

[0207] Figure 5C This illustrates the use of multiple intensity sensors 524A-524D to detect multiple contacts 552A-552E on a touch-sensitive display 504. Figure 5C It also includes an intensity graph, which shows the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, the intensity measurements of intensity sensors 524A and 524D are both 9 intensity units, and the intensity measurements of intensity sensors 524B and 524C are both 7 intensity units. In some embodiments, the cumulative intensity is the sum of the intensity measurements of the multiple intensity sensors 524A-524D, which is 32 intensity units in this example. In some implementations, each contact is assigned a corresponding intensity, i.e., a portion of the cumulative intensity. Figure 5DThe diagram illustrates the allocation of cumulative intensity to contacts 552A-552E based on their distance from the center of force 554. In this example, each of contacts 552A, 552B, and 552E is assigned a contact intensity of 8 intensity units of the cumulative intensity, and each of contacts 552C and 552D is assigned a contact intensity of 4 intensity units of the cumulative intensity. More generally, in some specific implementations, each contact j is assigned a corresponding intensity Ij according to a predefined mathematical function Ij = A·(Dj / ΣDi), which is a portion of the cumulative intensity A, where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i = 1 to the last) from the center of force. Reference operations can be performed using electronic devices similar to or equivalent to devices 100, 300, or 500. Figures 5C-5D The operation described above. In some embodiments, the characteristic intensity of the contact is based on one or more intensities of the contact. In some embodiments, an intensity sensor is used to determine the intensity of a single characteristic (e.g., a single characteristic intensity of a single contact). It should be noted that the intensity map is not part of the displayed user interface, but is included within... Figures 5C-5D This is intended to assist readers.

[0208] In some implementations, a portion of the gesture is identified to determine the characteristic intensity. For example, a touch-sensitive surface optionally receives a series of swipe contacts that transition from a starting position to an ending position, where the contact intensity increases. In this example, the characteristic intensity of the contact at the ending position is optionally based only on a portion of the series of swipe contacts, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the ending position). In some implementations, a smoothing algorithm is optionally applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of the following: unweighted moving average smoothing algorithm, triangular smoothing algorithm, median filter smoothing algorithm, and / or exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow spikes or dips in the intensity of the swipe contact to achieve the purpose of determining the characteristic intensity.

[0209] Optionally, the contact intensity on a touch-sensitive surface is characterized relative to one or more intensity thresholds, such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device performs an operation typically associated with clicking a button on a physical mouse or touchpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device performs an operation different from the operation typically associated with clicking a button on a physical mouse or touchpad. In some embodiments, when a contact with a characteristic intensity lower than the light press intensity threshold (e.g., and higher than the nominal contact detection intensity threshold, where contacts lower than the nominal contact detection intensity threshold are no longer detected) is detected, the device will move the focus selector based on the movement of the contact on the touch-sensitive surface without performing the operation associated with the light press intensity threshold or the deep press intensity threshold. Generally, unless otherwise stated, these intensity thresholds are consistent across different groups of user interface figures.

[0210] An increase in contact intensity from below a light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in contact intensity from below a deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in contact intensity from below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting a contact on the touch surface. A decrease in contact intensity from above a contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting a contact being lifted off the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0211] In some embodiments described herein, one or more operations are performed in response to detecting a gesture including a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the intensity of the contact (or multiple contacts) increases to above a press input intensity threshold. In some embodiments, the corresponding operation is performed in response to detecting that the intensity of the corresponding contact increases to above a press input intensity threshold (e.g., a "downward stroke" of the corresponding press input). In some embodiments, the press input includes the intensity of the corresponding contact increasing to above a press input intensity threshold and the intensity of the contact subsequently decreasing to below the press input intensity threshold, and the corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the press input threshold (e.g., an "upward stroke" of the corresponding press input).

[0212] Figures 5E-5HThe detection of gestures is shown, including gestures involving contact 562 with an intensity ranging from less than... Figure 5E The light press intensity threshold (e.g., "IT") L The intensity of ”) increases to higher than Figure 5H The deep press intensity threshold (e.g., "IT") D The intensity of the press input corresponds to the strength of the press. On the user interface 570, which includes application icons 572A-572D displayed in the predefined area 574, when the cursor 576 is displayed above the application icon 572B corresponding to application 2, the gesture performed by contact 562 is detected on the touch-sensitive surface 560. In some embodiments, the gesture is detected on the touch-sensitive display 504. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines the intensity of the contact 562 within a deep press intensity threshold (e.g., "IT"). D The intensity reaches its peak value above 562. Contact is maintained on the touch-sensitive surface 560. In response to a detected gesture, and based on the intensity increasing to a deep press intensity threshold (e.g., "IT") during the gesture... D The above contact 562 displays the scale representation 578A-578C (e.g., thumbnails) of the document recently opened for application 2, such as... Figures 5F-5H As shown. In some embodiments, the intensity is a characteristic intensity of the contact compared to one or more intensity thresholds. It should be noted that the intensity map for contact 562 is not part of the displayed user interface, but is included in... Figures 5E-5H This is intended to assist readers.

[0213] In some implementations, the display of icons 578A-578C includes animation. For example, icon 578A might initially appear near application icon 572B, such as... Figure 5F As shown, as the animation progresses, icon 578A moves upwards, and icon 578B appears near application icon 572B, as shown. Figure 5G As shown in the diagram. Then, representation 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed near application icon 572B, as shown. Figure 5H As shown in the diagram. This indicates that 578A-578C form an array above icon 572B. In some implementations, the animation progresses according to the intensity of contact 562, such as... Figures 5F-5G As shown, where 578A-578C appear and increase with the intensity of contact 562 towards the pressure threshold (e.g., "IT"). D The animation progresses upwards as it increases in intensity. In some implementations, the intensity upon which the animation progresses is based is the characteristic intensity of the contact. Reference can be performed using electronic devices similar to or equivalent to devices 100, 300, or 500. Figures 5E to 5H The aforementioned operation.

[0214] In some implementations, the device employs intensity hysteresis to avoid unintended inputs sometimes referred to as "jitter," wherein the device defines or selects a hysteresis intensity threshold that has a predefined relationship with a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the press input intensity threshold). Therefore, in some implementations, a press input includes an increase in the intensity of the corresponding contact above the press input intensity threshold and a subsequent decrease in the intensity of that contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases below the hysteresis intensity threshold (e.g., an "upstroke" of the corresponding press input). Similarly, in some implementations, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and optionally the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity threshold, and a corresponding operation is performed in response to detecting a press input (e.g., an increase or decrease in contact intensity depending on the environment).

[0215] In some embodiments, the buttons described throughout this specification (e.g., button 602) are optionally mechanical buttons or solid-state buttons.

[0216] In some embodiments, the mechanical button is a pressable button. In some embodiments, the computer system monitors whether the mechanical button is pressed (e.g., beyond a press threshold). Based on determining that the mechanical button has been pressed (press input), the computer system determines that the mechanical button has been activated. Based on determining that the mechanical button has not been pressed (not a press input), the computer system determines that the mechanical button has not been activated (or activation of the button has not been detected). In some embodiments, the duration of activation is the duration of the mechanical button being pressed. In some embodiments, the mechanical button detects touch input separately (e.g., detected on the surface of a solid button). Therefore, even when both touch and activation are achieved using the same input (e.g., touch by a finger), touch on the mechanical button (and the duration of touch) can be detected separately from the activation (and duration of activation) of the mechanical button. In some embodiments, in addition to detecting touch and activation, the mechanical button also includes a biometric sensor (e.g., a fingerprint sensor configured to detect a fingerprint used for fingerprint authentication of the finger used to touch / activate the button).

[0217] In some implementations, solid-state buttons are distinguished from the rest of the computer system by ridges or other physical boundaries. For example, a user can use their finger to touch the ridges or physical boundaries to more easily locate the solid-state buttons on the computer system. In some implementations, the computer system monitors (e.g., using one or more intensity sensors) the intensity of tactile input to the solid-state buttons (e.g., when the computer system is turned on and / or when a capacitive object (such as a finger) is detected on the surface of the solid-state buttons). Based on determining that the characteristic intensity of the tactile input on the solid-state button exceeds an intensity threshold (press input), the computer system determines that the solid-state button has been activated and optionally provides tactile output (e.g., a first tactile output when the characteristic intensity exceeds the intensity threshold, and / or a second tactile output when the characteristic intensity stops exceeding the intensity threshold, thereby providing tactile feedback to the user about the intensity of the touch). Based on determining that the characteristic intensity of the tactile input on the solid-state button does not exceed the intensity threshold (not a press input), the computer system determines that the solid-state button has not been activated and optionally refrains from providing tactile output. In some implementations, the duration of activation is the duration for which the characteristic intensity exceeds the intensity threshold. Therefore, even when the same input (e.g., finger contact) is used to achieve both touch and activation, touch (and duration of touch) on the solid-state button can be detected separately from activation (and duration of activation). In some implementations, in addition to detecting touch and activation, the solid-state button also includes a biometric sensor (e.g., a fingerprint sensor, a face sensor, and / or an iris sensor, the fingerprint sensor being configured to detect a fingerprint used for fingerprint authentication of the finger used to touch / activate the button).

[0218] In some implementations, the computer system (e.g., 100, 300, 500, and / or 600) is in a locked or unlocked state. In the locked state, the computer system is powered on and operable, but it is prevented from performing a predefined set of operations in response to user input. This predefined set of operations optionally includes navigating between user interfaces, activating or deactivating a predefined set of functions, and activating or deactivating certain applications. The locked state can be used to prevent unintentional or unauthorized use of a function of the computer system, or to activate or deactivate some functions on the computer system. In the unlocked state, the computer system is powered on and operable, and is not prevented from performing at least a portion of a predefined set of operations that cannot be performed when in the locked state. In some implementations, when the computer system is in the unlocked state, sensitive information of the computer system is accessible to the user, allowing the performance of computer system configuration operations (e.g., clearing memory and / or changing passwords), and / or the modification (e.g., reversal) of destructive operations (e.g., previously marked files for deletion).

[0219] A computer system is said to be locked when it is in a locked state. In some embodiments, a locked computer system optionally responds to user input from a restricted group, including input corresponding to an attempt to unlock the computer system or input corresponding to shutting down the computer system and / or switching the computer system to a low-power operating mode. In some embodiments, when the computer system is locked, sensitive information of the computer system is not accessible to the user, computer system configuration operations (e.g., clearing memory and / or changing passwords) cannot be performed, and / or destructive operations (e.g., undoing) cannot be altered (e.g., reversing) (e.g., files previously marked for deletion).

[0220] In some implementations, a secure element is a hardware component (e.g., a secure microcontroller chip) configured to securely store data or algorithms such that the computer system cannot access the securely stored data without the correct authentication information from the user of the computer system. Keeping the securely stored data in a secure element, separate from other storage devices on the computer system, prevents access to the securely stored data even if other storage locations on the computer system are compromised (e.g., by malicious code or other attempts to compromise information stored on the computer system). In some implementations, the secure element provides (or publishes) payment information (e.g., account and / or transaction-specific dynamic security codes). In some implementations, the secure element provides (or publishes) payment information in response to the computer system receiving authorization, such as user authentication (e.g., fingerprint authentication; facial authentication; iris authentication; password authentication). For example, the computer system detects a fingerprint at a fingerprint sensor (e.g., a fingerprint sensor integrated into a button). The computer system determines whether the fingerprint matches a registered fingerprint. If the fingerprint matches the registered fingerprint, the secure element provides (or publishes) payment information. If the fingerprint does not match the registered fingerprint, the secure element abandons providing (or publishing) payment information.

[0221] As used herein, a wake-up screen is the screen initially displayed when a computer system receives an input that causes the display generating components to transition from a low-power state to a higher (e.g., standard) power state (e.g., a state in which more of the display device is active). In some embodiments, the wake-up screen transitions between not displaying security content of the notification when the computer system is locked and displaying security content of the notification when the computer system becomes unlocked. In some embodiments, in conjunction with transitioning the display generating components to a higher (e.g., standard) power state, the computer system also transitions inactive input devices to an active state or transitions to a state where input is detected at a higher frequency (e.g., detecting touches and / or button presses at a lower frequency to save energy). In some embodiments, when in a low-power state, the display generating components are turned off (e.g., no content is displayed or reduced content is displayed). In some embodiments, when in a low-power state, the display generating components are turned on and display content, but with reduced brightness, reduced amount of display content, and / or reduced energy consumption compared to a higher-power state. Therefore, the same or similar information may optionally be displayed as part of the wake-up screen (e.g., when the display generating component is not in a low-power state) or as part of the non-wake-up screen (e.g., when the display generating component is in a low-power state).

[0222] In some implementations, when displaying the wake-up screen, the computer system receives a request to switch to a different user interface (e.g., an application user interface, and / or a user interface including multiple icons corresponding to the application). In response to receiving the request to switch to a different user interface: if it is determined that the computer system is unlocked, the computer system displays the different user interface; and if it is determined that the computer system is locked, the computer system abandons displaying the different user interface.

[0223] For ease of explanation, optionally, the description of an operation triggered in response to a press input associated with a press input strength threshold or in response to a gesture including a press input is provided in response to detecting any of the following conditions: the contact strength increases to above the press input strength threshold, the contact strength increases from below a hysteresis strength threshold to above the press input strength threshold, the contact strength decreases to below the press input strength threshold, and / or the contact strength decreases to below the hysteresis strength threshold corresponding to the press input strength threshold. Additionally, in the example where the operation is described as being performed in response to detecting a decrease in contact strength below the press input strength threshold, the operation is optionally performed in response to detecting a decrease in contact strength below a hysteresis strength threshold corresponding to and less than the press input strength threshold.

[0224] Now let’s turn our attention to the implementation of user interfaces (“UIs”) and associated processes on electronic devices (such as portable multifunction devices 100, 300 or 500).

[0225] Figures 6A-6AY Exemplary user interfaces for detecting press input and touch input, and for performing biometric authentication, are shown according to some embodiments. The user interfaces in these figures are used to illustrate... Figure 7 and Figure 8 The process described below is the process in the middle.

[0226] Figure 6A An electronic device 600 (e.g., a tablet computer, smartphone) is shown, which includes a display 610, a housing 612, and buttons 602, 604a, and 604b. In some embodiments, a touch-sensitive surface is integrated into the display 610, and the display 610 is a touch-sensitive display. In some embodiments, device 600 includes one or more features of devices 100, 300, and / or 500.

[0227] The display 610 can operate in a low-power state and a standard-power state. For example, in a low-power state, the display 610 may optionally be off or in a low-power state that displays less information (e.g., at least a portion of the display is off (e.g., the display portion of the display 610 is off while the touch-sensitive surface of the display 610 remains active to detect touch), and / or the display dims). In a standard-power state, the display is not off and is not in a low-power state. Figures 6A-6AY In the example, display 610 is off when in a low-power state. When display 610 is not off, the display is not in a low-power state.

[0228] Button 602 is optionally a mechanical button or a solid button, as described above. A user press input on button 602 activates button 602 for a period of time less than a long press threshold (e.g., less than the activation duration). A user long press input on button 602 activates button 602 for a period of time longer than the long press threshold (e.g., longer than the activation duration). Button 602 includes an integrated fingerprint sensor that enables electronic device 600 to detect the fingerprint features of a finger when it touches button 602 (e.g., a touch input where a finger is placed on button 602 without providing a press input) and when the finger is providing a press input to button 602.

[0229] Buttons 604a and 604b optionally do not include an integrated fingerprint sensor. When activated, buttons 604a and 604b respectively increase and decrease the volume of the electronic device 600.

[0230] exist Figure 6A At this point, display 610 is off. A press input is detected when the device 600 is in a low-power state (e.g., display off), causing it to display a wake-up screen. When display 610 is off, electronic device 600 detects a press input 650a of button 602. Figure 6B At this point, in response to the detection of a press input 650a, the display 610 transitions to a low-power state and the device 600 displays the wake-up screen 630. Figure 6B At this location, the wake-up screen 630 includes a lock icon 632a indicating that the device 600 is locked, the current date and time 634, and unread notifications 636a and 636b. Unread notifications 636a and 636b include indications from applications (e.g., messages, emails) and the time the notification was received. Because the device 600 is locked, the security content of unread notifications 636a and 636b is not displayed.

[0231] The press input 650a (and any subsequent touch on button 602 before the contact is broken) is not long enough for device 600 to detect the fingerprint features of the finger and determine whether the fingerprint corresponds to an authorized fingerprint (that corresponds to a registered fingerprint) or not (that does not correspond to any registered fingerprint). Therefore, device 600 displays wake-up screen 630 and remains locked. Device 600 determines that the finger has not touched the fingerprint sensor of button 602, and therefore displays touch graphic element 640a, which indicates that touch input is required to unlock device 600 and / or switch to a different user interface. Touch graphic element 640a is displayed.

[0232] exist Figure 6C At this point, device 600 detects touch input 650b of a fingerprint that does not correspond to an authorized fingerprint on the fingerprint sensor of button 602. In response to detecting touch input 650b of a fingerprint that does not correspond to an authorized fingerprint while device 600 is locked, device 600 remains locked and provides feedback to the user, such as by displaying an animation of a back-and-forth shaking lock icon 632a, that the fingerprint does not correspond to an authorized fingerprint. In some embodiments, device 600 replaces the display of touch graphical element 640a with an indication that the fingerprint does not correspond to an authorized fingerprint (e.g., a text message). Because device 600 is locked, the security content of unread notifications 636a and 636b is not displayed.

[0233] exist Figure 6DAt this point, device 600 determines that a finger has not touched the fingerprint sensor of button 602, and therefore displays a touch graphic element 640a ("Touch" in this example) indicating that touch input can be used to unlock device 600 and / or transition to a different user interface (e.g., a home screen with app icons and / or an app's user interface). Since the button's position can change relative to the user interface as device 600 is oriented, device 600 displays touch graphic element 640a next to button 602 to provide the user with an indication of the button's location. The placement of touch graphic element 640a within wake-up screen 630 is based on the orientation of device 600. Figure 6D Since the user interface is displayed in a landscape orientation (based on the detected landscape orientation of device 600), and the volume buttons 604a and 604b are located at the top of the user interface, the touch graphic element 640a is displayed in the upper left corner of the wake-up user interface 630, adjacent to button 602.

[0234] exist Figure 6E At this point, device 600 detects touch input 650c and determines that the input on the fingerprint sensor of button 602 includes fingerprint information corresponding to an authorized finger. In response to detecting touch input 650c corresponding to an authorized fingerprint when device 600 is locked (and since touch input 650 is determined to be authorized), device 600 unlocks device 600 and replaces touch graphic element 640a with a hold graphic element 640b (e.g., "Hold to Open," displayed in the same location in the user interface, and / or using the same placement standard as touch graphic element 640a). Hold graphic element 640b instructs the user that they should provide touch input (by holding their finger on the fingerprint sensor) to transition to the subsequent user interface (e.g., the home screen with application icons and / or the application's user interface). In some examples, a crossfade animation is used to replace touch graphic element 640a with hold graphic element 640b. In further response to detecting touch input 650c corresponding to an authorized fingerprint when the device 600 is locked, the device 600 replaces the lock icon 632a with an unlock icon 632b (e.g., via an unlock animation) and displays the security content of unread notifications 636a and 636b (e.g., the sender's name and / or part of the notification content).

[0235] exist Figure 6F At this point, while device 600 continues to detect touch input from a finger on the fingerprint sensor of button 602, device 600 updates the dwell graphic element 640b to reflect the duration of the detected touch input. The dwell graphic element 640b is a threshold indicator that updates over time (e.g., by sequentially updating letters, such as...). Figure 6AYAs shown, visual changes (e.g., color change, brightness change, sharpness change) are made across the dwell graphic element 640b to indicate the progress toward reaching the input time threshold. The progress of the visual changes to the dwell graphic element 640b corresponds to the progress toward reaching the input time threshold. This is because when the display is not operating in a low-power state (in... Figure 6E The touch input is initially detected (and optionally, due to a notification being displayed), so the input time threshold is a first time amount (e.g., 0.2 seconds, 0.25 seconds, 0.375 seconds, 0.5 seconds, or 1 second).

[0236] exist Figure 6G While device 600 continues to detect touch input on the fingerprint sensor of button 602 (e.g., no lift-off of touch input detected, and / or no interruption of touch input detected), device 600 continues to update the dwell graphic element 640b to reflect the duration of the detected touch input, such as by sequentially updating or highlighting the letters of the dwell graphic element 640b. A first time interval (e.g., 0.2 seconds, 0.25 seconds, 0.375 seconds, 0.5 seconds, or 1 second) provides the user with a review notification of security content to decide whether to continue providing touch input to navigate away from the wake-up screen.

[0237] exist Figure 6H At this point, device 600 detects touch input being lifted off the fingerprint sensor of button 602. In response, device 600 resets the progression of input that tended to reach a threshold (e.g., device 600 will navigate away from the wake screen based on subsequent touch input after detecting that touch input has reached a full input time threshold (uninterrupted)). In response to detecting the lifting off of touch input, the progression of visual changes to the held graphic element 640b stops and optionally rewinds (e.g., the animation of sequentially updating or highlighting letters is reversed). Device 600 remains unlocked (e.g., for 3 minutes, 5 minutes, 8 minutes and / or until a pause condition is met).

[0238] exist Figure 6I At this point, after a predetermined amount of time, device 600 stops displaying the dwell graphic element 640b and optionally replaces it with the touch graphic element 640a (e.g., using a crossfade animation) to indicate to the user that touch input is required to transition to the subsequent user interface. Device 600 remains unlocked and therefore continues to display the security content of unread notifications 636a and 636b.

[0239] exist Figures 6J-6KAt this point, device 600 detects touch input 650d of an authorized finger on the fingerprint sensor corresponding to button 602. In response to detecting touch input 650d, device 600 replaces touch graphic element 640a with a dwell graphic element 640b and progresses towards a threshold input that reaches a first time value. Since device 600 is unlocked when touch input 650d is detected, device 600 proceeds towards the threshold input regardless of whether touch input 650d is made with a finger corresponding to or not corresponding to an authorized finger. Figure 6K At this point, device 600 determines the full duration of the touch input 650d provided up to a first time value, as indicated by the fully highlighted dwell graphic element 640b. Therefore, when input on button 602 is initially detected when device 600 is unlocked, display 610 is turned on, and a notification is displayed, device 600 uses the first time value (e.g., 0.2 seconds, 0.25 seconds, 0.375 seconds, 0.5 seconds, or 1 second) as a threshold input.

[0240] In response to the determination of the complete duration of the first time value provided by the touch input 650d, the device 600 transitions to the subsequent user interface, such as... Figure 6L As shown. In this example, device 600 transitions to displaying a main screen 660, which includes multiple icons, wherein a tap on a corresponding icon causes device 600 to display a user interface corresponding to the application on that icon.

[0241] exist Figure 6L At the location where the main screen 660 (or alternatively, another user interface) is displayed, device 600 detects a press input 650e of button 602. In response to detecting the press input 650e when display 610 is turned on, device 600 turns off display 610, as... Figure 6M As shown, it becomes locked.

[0242] exist Figure 6N At the location where the display 610 is off, the electronic device 600 detects the pressed input 650f of the button 602.

[0243] exist Figure 6O In response to the detection of a press input 650f, device 600 displays a wake-up screen 630. The press input 650f (and any subsequent touch of button 602) is not long enough for device 600 to detect the fingerprint's characteristics and determine whether the finger corresponds to an authorized or unauthorized finger. Therefore, the wake-up screen 630 includes a lock icon 632a indicating that device 600 is locked, as well as unread notifications 636a and 636b. Because device 600 is locked, the security content of unread notifications 636a and 636b is not displayed. Figure 6OIn addition, device 600 also displays a touch graphic element 640a, which indicates that touch input can be used to unlock device 600 and / or switch to a different user interface.

[0244] Figures 6P-6V An exemplary scenario is shown in which device 600 receives input pointing to button 602, which begins when device 600 is locked, display 610 is turned on and a wake-up screen 630 with notifications is displayed.

[0245] exist Figure 6P At this point, device 600 detects touch input 650g of a fingerprint corresponding to an authorized fingerprint on the fingerprint sensor of button 602. In response to detecting touch input 650g of a fingerprint corresponding to an authorized fingerprint (when device 600 is locked), device 600 unlocks, displays an unlock icon 632b, displays security content of unread notifications 636a and 636b, replaces touch graphic element 640a with a dwell graphic element 640b, and progresses toward reaching a threshold input.

[0246] like Figure 6Q As shown, device 600 continues to detect touch input 650g, and therefore device 600 continues to progress toward reaching the threshold input time, as reflected by the highlighting of the dwell graphic element 640b. In response to the determination that the touch input 650g has reached the threshold input time, device 600 transitions to the subsequent user interface, such as... Figure 6R and Figure 6S Alternatively, when input on button 602 is initially detected, display 610 is turned on, and a notification is displayed when device 600 is locked, device 600 uses a first time value (e.g., 0.2 seconds, 0.25 seconds, 0.375 seconds, 0.5 seconds, or 1 second) as a threshold input.

[0247] exist Figure 6R The subsequent user interface is the main screen 660, which includes multiple icons, where a tap on a corresponding icon causes the device 600 to display the user interface of the application corresponding to that icon. Figure 6SAt this point, the subsequent user interface is the user interface of the application. The application is optionally selected based on selection criteria. In some embodiments, the selection criteria specify that the application is the most recently displayed (or accessed) application, and therefore the user interface of the most recently displayed application (e.g., the first application when it is most recently displayed, the second application when it is most recently displayed) is displayed. In some embodiments, the selection criteria specify that the application is the most recently selected application (e.g., via user input used to display the application), and therefore the user interface of the most recently selected application (e.g., the third application when it is most recently selected, the fourth application when it is most recently selected) is displayed. The subsequent user interface continues to be displayed regardless of whether the user continues to provide touch input 650g. Pressing button 602 while the subsequent user interface is displayed causes device 600 to lock and causes display 610 to turn off.

[0248] Figure 6T A device 600 is shown in portrait orientation, where volume buttons 604a, 604b are located at the top of the user interface, based on the user having rotated the device 600 to portrait orientation (e.g., due to a detected rotation of 90 degrees or approximately 90 degrees). Because of the portrait orientation, the device 600 displays a wake-up screen 630 in portrait orientation and displays a touch graphic element 640a to indicate that touch input is available to unlock the device 600. The touch graphic element 640a is displayed in a different portion of the wake-up screen 630 compared to when the wake-up screen 630 is displayed in landscape orientation. Since the position of button 602 (and therefore touch graphic element 640a) changes relative to the user interface as the orientation of the device 600 changes, the device 600 displays touch graphic element 640a next to button 602 to provide the user with an indication of the button's location. The placement of touch graphic element 640a within the wake-up screen 630 is based on the orientation of the device 600. In this example, (based on the detected vertical orientation of device 600), a touch graphic element 640a is displayed in the upper right corner of the display next to button 602.

[0249] exist Figure 6TWhen device 600 is locked, device 600 detects touch input 650h on button 602. In response to detecting touch input 650h and determining, based on the fingerprint on the fingerprint sensor, that it corresponds to an unauthorized fingerprint, device 600 remains locked and provides feedback to the user, such as by displaying an animation of a back-and-forth shaking lock icon 632a, that the fingerprint does not correspond to an authorized fingerprint (e.g., it is unauthorized). In some embodiments, device 600 replaces the display of touch graphic element 640a with an indication that the fingerprint does not correspond to an authorized fingerprint (e.g., a text message) (or stops displaying touch graphic element 640a when a fingerprint is detected). Because device 600 remains locked, the security content of unread notifications 636a and 636b continues not to be displayed. If a fingerprint corresponding to an authorized fingerprint has been used to provide touch input 650h, the device 600 will unlock and replace the touch graphic element 640a with a dwell graphic element 640b (at the same location as the touch graphic element 640a in the user interface), and will tend to reach a threshold input progress of a first time amount, as indicated by a visual change of the dwell graphic element 640b displayed in the (same) upper right corner of the display (based on the orientation of the displayed wake-up screen 630).

[0250] exist Figure 6U At this point, the user has rotated device 600 back to landscape orientation (with volume buttons 604a, 604b at the top), and in response, device 600 updates wake screen 630 to be displayed in landscape orientation while maintaining device 600 in a locked state. For example, device 600 displays an animation of wake screen rotation and / or rearrangement, which optionally includes an animation of touch graphic element 640a rotating relative to other elements of wake screen 600 to remain next to button 602.

[0251] exist Figure 6U At the same time, when the wake-up screen 630 is displayed in landscape orientation, the device 600 detects a press input 650i on the button 602. In response to detecting the press input 650i when the display 610 is turned on, the device 600 turns off the display 610, as... Figure 6V As shown, it becomes locked.

[0252] Figure 6V-Figure 6AA An exemplary scenario is illustrated, in which device 600 receives input directed to button 602, which begins when device 600 is locked, display 610 is turned off, and a notification indicates that the device is available for display. Figure 6V At the location where the display 610 is off, the device 600 receives input 650j directed to button 602. Input 650j includes a press input that causes the display 610 to turn on and display the wake-up screen 630. Figure 6V (place), such as Figure 6W As shown.

[0253] exist Figure 6W In response to a press input portion of input 650j, device 600 displays a wake-up screen 630, which includes unread notifications 636a and 636b, a lock icon 632a, and a touch graphic element 640a. Device 600 determines that input 650j was made with a fingerprint corresponding to an authorized fingerprint (e.g., via the fingerprint sensor of button 602). In response to detecting that input 650j was made with a fingerprint corresponding to an authorized fingerprint, device 600 unlocks the security content of unread notifications 636a and 636b and replaces the display of touch graphic element 640a with a hold graphic element 640b (e.g., "Hold to open," displayed in the same location in the user interface, and / or using the same placement standard as touch graphic element 640a). Figure 6X As shown. In response to detecting input 650j (e.g., a touch portion of input 650j), device 600 progresses toward a threshold input that reaches a first time interval (e.g., 0.2 seconds, 0.25 seconds, 0.375 seconds, 0.5 seconds, or 1 second), as indicated by... Figures 6X-6Z The device 600 displays the stay graphic element 640b at a location next to button 602 to indicate to the user where button 602 is located and that the user should continue to keep their finger on button 602. The position of the stay graphic element 640b is based on the orientation of the device 600. For example, Figure 6Y and Figure 6AU It is in the horizontal direction ( Figure 6Y Orientation and longitudinal ( Figure 6AU A corresponding example of the same orientation of the interface is provided because the user provides input that allows the orientation to progress to a threshold. Device 600 optionally updates the user interface in response to detecting a change in the orientation of device 600, and displays a dwell graphic element 640b in different parts of the user interface based on the orientation of device 600 (e.g., from... when the orientation of device 600 changes). Figure 6Y UI transformation to Figure 6AU UI and / or from Figure 6AU UI transformation to Figure 6Y (UI). When the dwell graphic element 640b is displayed, the device 600 determines the orientation of the device 600 and displays the dwell graphic element 640b at a position close to or adjacent to the button 602.

[0254] The first time interval (e.g., 0.2 seconds, 0.25 seconds, 0.375 seconds, 0.5 seconds, or 1 second) provides the user with the security content of the review notification to decide whether to continue providing touch input (to navigate to the subsequent user interface) or to stop providing touch input (to remain at the wake screen 630 and, for example, to read the security content of the notification).

[0255] Once input 650j is detected (e.g., a touch portion of input 650j, starting after unlocking device 650, and / or once the graphical element 640b is held), device 600 transitions to the subsequent user interface, such as the home screen 660, as... Figure 6AA As shown. Therefore, when input on button 602 is initially detected when device 600 is locked, display 610 is turned off, and notification is given that it is available for display, device 600 uses a first time value as a threshold input.

[0256] In some implementations, the device detects that the user has read, deleted, and / or rejected notifications 636a and 636b. Therefore, the notification is no longer considered unread. Device 600 is now in a state where no unread notifications are to be displayed.

[0257] exist Figure 6AA At the location where the main screen 660 (or alternatively, another user interface) is displayed, device 600 detects a press input 650k of button 602. In response to detecting the press input 650k when display 610 is turned on, device 600 turns off display 610, as... Figure 6AB As shown, it becomes locked.

[0258] Figures 6AB-6AE An exemplary scenario is illustrated, in which device 600 receives input directed to button 602, which begins when device 600 is locked, display 610 is off, and no unread notifications are available for display. Figure 6AB At the location where the display 610 is off, the electronic device 600 detects input 650f pointing to button 602, which includes an initial press input. In response to detecting the press input 650f, the device 600 displays a wake-up screen 630, such as... Figure 6AC As shown.

[0259] exist Figure 6AC At the point where the touch input portion of input 650l continues to be detected and the device 600 is still locked (e.g., the device 600 is still detecting the fingerprint features to determine if it corresponds to an authorized fingerprint), the wake-up screen 630 does not include notifications (because there are no unread notifications available for display). The wake-up screen 630 also optionally includes a touch graphic element 640a and / or a lock icon 632a located next to button 602 (e.g., each optionally indicating that the device 600 is locked).

[0260] exist Figure 6ADAt this point, device 600 has determined that input 650l includes an authorized fingerprint corresponding to the fingerprint sensor on button 602. In response to the determination that the fingerprint corresponds to the authorized fingerprint, device 600 unlocks and displays an unlock icon 632b, without displaying any security notification content (because there are no unread notifications available for display).

[0261] In some implementations, in response to the determination that the fingerprint corresponds to an authorized fingerprint, device 600 stops displaying touch graphic element 640a and does not display hover graphic element 640b, such as Figure 6AC-Figure 6AD As shown. Device 600 determines whether a touch input portion of input 650l has been detected (e.g., starting once the device is unlocked, once the touch graphic element 640a stops displaying, or once input 650l is detected) for a second time amount (as a threshold input) less than a first time amount (e.g., 0.1 seconds, 0.2 seconds, 0.250 seconds, 0.3 seconds, or 0.35 seconds). Device 600 does not display the dwell graphic element 640b (which would visually indicate progress toward the threshold input of the second time amount) and uses a shorter threshold input (e.g., a second time amount, such as 0.1 seconds, 0.2 seconds, 0.250 seconds, 0.3 seconds, or 0.35 seconds) to determine whether to transition to the subsequent user interface because no unread notification is displayed on the wake-up screen for user review.

[0262] In some implementations, in response to the determination that the fingerprint corresponds to an authorized fingerprint, device 600 replaces the display of touch graphic element 640a with the display of stationary graphic element 640b. Device 600 determines whether a portion of touch input 650l has been detected (e.g., starting once the device is unlocked, once the touch graphic element 640a stops displaying, or once input 650l is detected) for a second time amount less than a first time amount (as a threshold input) (e.g., 0.1 seconds, 0.2 seconds, 0.250 seconds, 0.3 seconds, or 0.35 seconds). Device 600 uses a shorter threshold input to determine whether to transition to the subsequent user interface because no unread notifications are displayed on the wake-up screen for user review.

[0263] In response to the determination of the threshold input time (e.g., a second time amount) provided for touch input 650l, device 600 transitions to a subsequent user interface, such as... Figure 6AE The main screen 660 is shown. Therefore, when input on button 602 is initially detected when device 600 is locked, display 610 is off, and no unread notifications are available for display, device 600 uses a second time value as a threshold input.

[0264] exist Figure 6AFAt the location where the main screen 660 (or alternatively, another user interface) is displayed, device 600 detects a press input 650m of button 602. In response to detecting the press input 650m when display 610 is turned on, device 600 turns off display 610, as... Figure 6AG As shown, it becomes locked.

[0265] exist Figure 6AG At the location where the display 610 is off, the electronic device 600 detects a pressed input 650n of the button 602. In response to detecting the pressed input 650n, the device 600 displays a wake-up screen 630, such as... Figure 6AH As shown.

[0266] The press input 650n (and any subsequent touch of input 602) is not long enough for device 600 to detect the fingerprint's features and determine whether the fingerprint corresponds to an authorized fingerprint. Therefore, Figure 6AH The wake-up screen 630 includes a lock icon 632a indicating that the device 600 is locked, but does not display any notifications (because there are no unread notifications available for display). Figure 6AH In addition, device 600 also displays a touch graphical element 640a that indicates that touch input is required to unlock device 600 and / or switch to a different user interface.

[0267] Figures 6I-6AJ An exemplary scenario is shown in which device 600 receives input pointing to button 602, which begins when device 600 is locked and display 610 is turned on and displays a wake-up screen 630 without notification.

[0268] exist Figure 6AI At this point, device 600 detects touch input 650o of a fingerprint corresponding to an authorized fingerprint on the fingerprint sensor of button 602. In response to detecting touch input 650o of a fingerprint corresponding to an authorized fingerprint (when device 600 is locked), device 600 unlocks, displays an unlock icon 632b, replaces touch graphic element 640a with a stay graphic element 640b, and progresses toward reaching a threshold input.

[0269] like Figure 6AJ As shown, device 600 continues to detect touch input 650o, and therefore device 600 continues to progress toward reaching a threshold input time, as reflected by the highlighting of the dwell graphic element 640b. In response to the determination that the touch input 650g has reached the threshold input time, device 600 transitions to the subsequent user interface, such as... Figure 6AK The main screen shown is 660.

[0270] In some implementations, when input on button 602 is initially detected, display 610 is turned on, and no notification is displayed when device 600 is locked, device 600 uses a first time value (e.g., 0.2 seconds, 0.25 seconds, 0.375 seconds, 0.5 seconds, or 1 second) as a threshold input. In some implementations, when input on button 602 is initially detected, display 610 is turned on, and no notification is displayed when device 600 is locked, device 600 uses a second time value (e.g., 0.1 seconds, 0.2 seconds, 0.250 seconds, 0.3 seconds, or 0.35 seconds) as a threshold input (e.g., because no unread notification is displayed on the wake-up screen for user review).

[0271] exist Figure 6AL At the location where the main screen 660 (or alternatively, another user interface) is displayed, device 600 detects a press input 650p of button 602. In response to detecting the press input 650p when display 610 is turned on, device 600 turns off display 610, as... Figure 6AM As shown, it becomes locked.

[0272] exist Figure 6AM At the location where the display 610 is off, the device 600 detects input 650q of button 602, which includes an initial press input. In response to detecting the press input portion of input 650q, the device 600 displays the wake-up screen 630 without displaying any notification (because there are no unread notifications available for display), such as Figure 6AN As shown.

[0273] exist Figure 6AN At this point, device 600 continues to receive the touch input portion of input 650q and determines that the fingerprint input 650q corresponds to an authorized fingerprint. Therefore, device 600 unlocks and displays the unlock icon 632b, as shown. Figure 6AO As shown.

[0274] exist Figure 6AO-Figure 6AP Before device 600 determines that the touch input (e.g., detected on the fingerprint sensor of button 602) has been maintained for a sufficient time to reach the input threshold (e.g., 0.1 seconds, 0.2 seconds, 0.250 seconds, 0.3 seconds, or 0.35 seconds and / or a second time amount), device 600 detects the lift-off of input 650q and therefore does not transition to displaying the subsequent user interface.

[0275] Figure 6AQ-Figure 6AS An exemplary scenario is shown in which device 600 receives input pointing to button 602, which begins when device 600 is unlocked and display 610 is turned on and displays a wake-up screen 630 without notification.

[0276] exist Figure 6AQAt this location, device 600 detects touch input 650r on button 602. In response to detecting touch input 650r, device 600 replaces touch graphic element 640a with a dwell graphic element 640b and progresses toward reaching a threshold input, as indicated by... Figure 6AQ-Figure 6AR The visual change indication of the stationary graphic element 640b in the text.

[0277] like Figure 6AR As shown, device 600 continues to detect touch input 650r, and therefore device 600 continues to progress toward reaching a threshold input time, as reflected by the highlighting of the dwell graphic element 640b. In response to the determination that touch input 650r has reached the threshold input time, device 600 transitions to the subsequent user interface, such as... Figure 6AS The main screen shown is 660.

[0278] In some implementations, when input on button 602 is initially detected when device 600 is unlocked, display 610 is turned on, and no notification is displayed, device 600 uses a first time value (e.g., 0.2 seconds, 0.25 seconds, 0.375 seconds, 0.5 seconds, or 1 second) as a threshold input (e.g., because no unread notification is displayed on the wake-up screen for user review).

[0279] Generally, in response to a long press input to button 602 (e.g., regardless of whether the display is off or on, what user interface is being displayed, whether device 600 is locked or unlocked, and / or the amount of progress made toward the threshold input), device 600 provides a digital assistant (e.g., by outputting audio corresponding to the digital assistant and / or by (optionally turning on display 610 and) displaying a digital assistant user interface). For example... Figure 6AT An exemplary user interface for a digital assistant is shown, which is optionally displayed when a long press input of button 602 is detected.

[0280] In some implementations, when device 600 is unlocked (e.g., when it is initially received upon receiving a long press input, or becomes unlocked due to confirmation of a long press input with a finger corresponding to an authorized fingerprint), the digital assistant has access to more information about device 600 (and / or is able to provide security information such as phone number, address, or other personalized information).

[0281] Figure 6AV-Figure 6AWExemplary techniques for unlocking device 600 using button 602 and facial recognition (or alternatively, iris recognition) via cameras 164 and 175 (or alternatively, an iris sensor) are shown. Figure 6AV At this point, the display of device 600 is turned on and device 600 is locked, as reflected by the lock icon 632a. Device 600 displays a touch graphic element 64a to indicate that touch input should be provided to transition to a user interface other than the wake screen (e.g., home screen, application user interface). Device 600 detects touch input 650s via a touch sensor integrated into button 602. Device 600 detects (e.g., in response to the detection of touch input 650s) facial attributes (e.g., facial information) (or alternatively, iris information) of the face via cameras 164 and 175. A face recognition indicator 672a indicates that device 600 is detecting facial attributes (or alternatively, iris information). If the detected facial attributes of the face do not correspond to an authorized face, device 600 maintains device 600 in a locked state. If the detected facial attributes of the face correspond to an authorized face, device 600 unlocks device 600, as indicated by the lock icon 632a. Figure 6AW As shown.

[0282] exist Figure 6AW At this point, device 600 displays an unlock icon 632b to indicate that device 600 has been unlocked. A face recognition indicator 672b indicates that the detected facial attributes correspond to an authorized face. While device 600 continues to detect touch input for 650 seconds, device 600 also displays a dwell graphic element 640b. While device 600 continues to detect touch input for 650 seconds, device 600 updates the dwell graphic element 640b to reflect the duration of the detected touch input for 650 seconds. The progression of the visual change in the dwell graphic element 640b corresponds to the progression toward reaching an input time threshold.

[0283] exist Figure 6AX At this point, device 600 has progressed to reaching the input time threshold (based on touch input 650s) and thus transitions to displaying the main screen 660.

[0284] Figure 6AY An exemplary animation for updating the stationary graphic element 640b is shown. Figure 6AY On the left (from top to bottom), the dwell graphic element 640b is shown as an update reflecting the duration of touch input. The dwell graphic element 640b is a threshold indicator that indicates progress toward reaching an input time threshold by visually changing (e.g., color, brightness, saturation) across the dwell graphic element 640b over time (e.g., by sequentially updating letters). The progression of visual changes in the dwell graphic element 640b corresponds to the progress toward reaching the input time threshold. Figure 6AYOn the right side (from top to bottom), the dwell graphic element 640b is shown as an animation reflecting when the device 600 no longer detects touch input before reaching the input threshold. The dwell graphic element 640b reverses the animation by making visual changes (e.g., color changes, brightness changes, saturation changes) across the dwell graphic element 640b over time (e.g., by updating letters sequentially in opposite directions).

[0285] Generally, in response to receiving a press input of button 602 when display 610 is turned on (e.g., regardless of what user interface is being displayed, whether device 600 is locked or unlocked, and / or the amount of progress made toward the threshold input), device 600 turns off display 610 and optionally locks the computer system. Generally, in response to receiving a press input of button 602 when display 610 is turned off, device 600 turns on display 610.

[0286] Figure 7 This is a flowchart illustrating a method, according to some embodiments, for disambiguating input on a touch sensor integrated into a button (e.g., 602) using a computer system (e.g., 100, 300, 500, 600). Method 700 is executed at a computer system (e.g., 100, 300, 500, 600) having a touch sensor integrated into a button (e.g., a mechanical button, e.g., an actuable button) or a solid-state button). The computer system (e.g., 600) communicates with a display generation component (e.g., 610). Some operations in method 700 are optionally combined, some operations are optionally changed in order, and some operations are optionally omitted.

[0287] As described below, method 700 provides an intuitive way to disambiguate input from a touch sensor integrated into a button (e.g., 602). This method reduces the cognitive load on the user, thereby creating a more efficient human-machine interface. For battery-powered computing devices, disambiguating input from a touch sensor integrated into a button allows for faster and more efficient use of electronic devices, saving power and increasing the time between battery charging.

[0288] When the wake-up screen (e.g., 630) is displayed via the display generation component (e.g., 610), the computer system (e.g., 600) detects (702) input to the button.

[0289] In response to the detection of input (704), and based on (706) the determination that the input (e.g., 650b) includes a touch sensor reaching a time threshold less than a corresponding time threshold (e.g., the touch sensor lifting off is detected before the duration of the touch reaches the corresponding time threshold) and does not include button activation (e.g., button press input is excluded), the computer system (e.g., 600) maintains (708) the wake-up screen (e.g., via the display generation component) Figure 6D The display at 630).

[0290] In response to the detection of input (704), and based on the determination (710) that the input (e.g., 650g, 650j) includes touching the touch sensor for a period greater than a corresponding time threshold (e.g., no touch lift-off of the touch sensor is detected before the duration of the touch reaches the corresponding time threshold) and the computer system (e.g., 600) is unlocked, a second user interface (e.g., 660) is displayed (712) via the display generation component. Figure 6S The second user interface is different from the wake-up screen in the unlocked state (e.g., the user interface in the unlocked state; a state in which one or more user interface functions that are not available in the unlocked state are available).

[0291] In response to the detection of input (704), and based on the determination (714) that the input (e.g., 650k, 650m) includes activation (e.g., the input includes a press input) of a button (e.g., a short press input), the display of at least a portion of the wake-up screen via the display generating component is stopped (716) and the display generating component is switched to a low-power state (e.g., an off state or a low-power state that displays less information via the display of the display generating component compared to when an input to a button is received).

[0292] Performing different functions based on touch duration and button activation allows devices to use the same button to perform various different functions, thereby reducing the need for additional hardware components. Providing additional control options without adding extra buttons or cluttering the UI with additional displayed controls enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0293] In some implementations, in response to the detection of input (704), and based on the determination that the computer system (e.g., 600) is in an unlocked state (e.g., a user interface unlocked state; a state in which one or more user interface functions that are unavailable in the unlocked state are available) and the input (e.g., 650k, 650m) includes an activation button (e.g., 602), the computer system (e.g., 600) is switched to a locked state (e.g., a state in which one or more user interface functions are unavailable) (e.g., except that the display generation component is switched to a low power state).

[0294] In some implementations, when the computer system (e.g., 600) is locked upon receiving input pointing to a button, the computer system remains locked in response to the detected input (e.g., except for the display generation component switching to a low-power state).

[0295] Performing different functions based on device status and button activation allows the device to use the same button to perform various different functions, thereby reducing the need for additional hardware components. Providing additional control options without adding extra buttons or cluttering the UI with additional displayed controls enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0296] In some implementations, before displaying the wake-up screen via the display generating component (e.g., when the display generating component is not displaying content), the computer system (e.g., 600) detects a second input (e.g., 650a, 650f) including activation (e.g., short press input) of a button (e.g., 602). In response to detecting the second input (and, for example, based on determining that the display generating component is in a low-power state), the computer system (e.g., 600) displays the wake-up screen (e.g., 630) via the display generating component (e.g., turning on the display and displaying the wake-up screen or transitioning from a user interface displayed when the display is in a low-power state to the wake-up screen).

[0297] Using button activation to perform different functions allows devices to use the same button to perform various functions, thereby reducing the need for additional hardware components. Providing additional control options without adding extra buttons or cluttering the UI with additional displayed controls enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0298] In some implementations, in response to detecting input to the pointing button (704), and based on the determination that the input (e.g., 650b) includes touching the touch sensor for a period greater than a corresponding time threshold (e.g., no lifting of the touch sensor is detected before the duration of the touch reaches the time threshold) and the computer system (e.g., 600) is locked (e.g., because the computer system (e.g., 600) is locked when the input to the pointing button is detected and the finger used to touch the button does not correspond to a fingerprint authorized to unlock the computer system (e.g., 600), therefore the detected face does not correspond to an authorized / registered face, and the detected iris does not correspond to an authorized / registered iris), the computer system (e.g., 600) maintains a wake-up screen via the display generation component (e.g., Figure 6C The display at 630 (and the second user interface is not displayed).

[0299] Executing different functions based on device status and button touch duration allows devices to use the same button to perform various different functions, thereby reducing the need for additional hardware components. Providing additional control options enhances device operability without adding extra buttons or cluttering the UI with additional displayed controls, and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0300] In some embodiments, the computer system (e.g., 600) includes a biometric sensor (e.g., a fingerprint sensor, such as a fingerprint sensor combined with, integrated into, or embedded in a mechanical or solid button, a facial recognition sensor, or an iris recognition sensor). In some embodiments, based on (and optionally, in response to the detection of input) a determination that the computer system (e.g., 600) is in a locked state and that the biometric input collected by the biometric sensor (e.g., a detected fingerprint of the finger used to provide input, a detected face, and / or a detected iris; and / or an input) matches a registered biometric feature (e.g., a previously registered face, iris, or fingerprint authorized to unlock the computer system (e.g., 600)), the computer system (e.g., 600) (e.g., in response to the detection of input) transitions the computer system (e.g., 600) to an unlocked state (e.g., ...). Figure 6E , Figure 6PIn some implementations, based on (and optionally, in response to the detection of input) a determination that the received biometric input (e.g., a detected fingerprint of the finger used when providing input, a detected face, and / or a detected iris) collected by the biometric sensors does not match a registered biometric feature (e.g., a previously registered face, iris, or fingerprint authorized to unlock the computer system), the computer system (e.g., 600) abandons transitioning the computer system (e.g., 600) to an unlocked state (e.g., ...). Figure 6C ).

[0301] Biometric input-based unlocking systems or systems that remain locked provide security by preventing unauthorized access to information on a computer system.

[0302] In some implementations, the biometric sensor is a fingerprint sensor.

[0303] Fingerprint-based unlocking systems or systems that remain locked provide security by preventing unauthorized access to information on the computer system. Additionally, the computer system can use the same input to determine authorization, the duration of the touch, and button activation.

[0304] In some implementations, the biometric sensor is integrated into the button (e.g., 602).

[0305] Fingerprint-based unlocking systems or systems that remain locked provide security by preventing unauthorized access to information on the computer system. Additionally, the computer system can use the same input to determine authorization, the duration of the touch, and button activation.

[0306] In some implementations, a first time threshold is used when it is determined that the wake-up screen includes one or more notifications (e.g., 636a, 636b). In some implementations, a second time threshold, different from the first time threshold, is used when it is determined that the wake-up screen does not include one or more notifications.

[0307] In some implementations, the first time threshold is longer than the second time threshold, thus giving the user a longer opportunity to view the notification and ceasing touch input before the time threshold is met. Ceasing touch input before the corresponding time threshold is met causes the computer system to maintain the wake-up screen and the display of the corresponding notification without transitioning to displaying a second user interface.

[0308] When a notification is available for reading, the computer system performs actions based on different (e.g., longer) time thresholds, allowing the user to easily review the notification and having sufficient time to decide whether to stop providing input before the time threshold is reached. Different (e.g., shorter) durations when a notification is unavailable for reading allow the user to transition away from the wake-up screen more quickly and access different user interfaces of interest. Therefore, these techniques make user-device interfaces more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0309] In some implementations, a first time threshold is used when the wake-up screen (e.g., 630) is determined to include one or more unread notifications (e.g., 636a, 636b). In some implementations, a second time threshold is used when the wake-up screen (e.g., 630) is determined not to include one or more unread notifications (e.g., the wake-up screen does not include any notifications or the wake-up screen only includes read notifications and does not include any unread notifications).

[0310] In some implementations, when the wake screen is initially displayed after the device switches from a low-power state, the wake screen includes only unread notifications (if any unread notifications exist) (e.g., notifications that do not meet a set of criteria (e.g., have been displayed for a predetermined period of time; have been displayed on a specific interface of a computer system or another computer system associated with an account logged into that computer system; have been previously rejected by the user; have been unlocked when the notification is displayed on the wake screen and the user is navigated away from the wake screen; or have otherwise interacted with the notification (e.g., pressing and holding input on the notification to display details of the notification)) (regardless of whether the user has actually read these notifications) for display on the wake screen (as part of one or more notifications), and read notifications are not included for display on the wake screen (as part of one or more notifications). Therefore, a first time threshold is used when one or more unread notifications are displayed on the wake screen, and a second time threshold is used when there are no unread notifications (and therefore no notifications to be displayed on the wake screen).

[0311] When an unread notification exists on the wake-up screen, the computer system provides the user with extra time to easily review it and decide whether to stop providing input before a time threshold is reached. Different (e.g., shorter) durations of unread notifications when they are unavailable for reading allow the user to transition away from the wake-up screen more quickly and access different user interfaces of interest. Therefore, these techniques make the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0312] In some implementations, based on the determination that the computer system is in a locked state, the wake-up screen (e.g., 630) includes the display of a notification (e.g., 636a, 636b) (e.g., a notification corresponding to an application has been received and / or the notification includes an indication of the application's identifier), and does not include security content corresponding to the displayed notification (e.g., as in...). Figure 6B , Figure 6O (e.g., the name of the sender of the received message and / or the body of the received message).

[0313] In some implementations, upon determining that the computer system is unlocked, the wake-up screen includes a notification and a display of security content corresponding to the displayed notification (e.g., the name of the sender of the received message and / or the body of the received message). In some implementations, when the computer system is locked, the computer system displays a wake-up screen, including displaying a notification without displaying the notification's security content. While displaying a notification without displaying its security content, the computer system receives input that causes the computer system to transition from a locked state to an unlocked state. In response to receiving input that causes the computer system to be in an unlocked state, the computer system updates the wake-up screen display to include the notification's security content (e.g., along with the notification).

[0314] Computer systems that do not provide security content corresponding to the displayed notification offer visual feedback to the user that the notification is readable, while maintaining the security of the notification content. Not displaying security content corresponding to the notification also provides visual feedback to the user that the system is locked. Providing improved visual feedback to the user enhances device operability and makes the user interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0315] In some implementations, activation of the button (e.g., 602) (e.g., for a mechanical button) requires confirmation that the button has been pressed. In some implementations, activation of the button (e.g., 602) (e.g., a solid-state button) requires confirmation that the characteristic intensity of the touch input on the button exceeds a non-zero intensity threshold.

[0316] It should be noted that the above description is in contrast to the process described in method 700 (e.g., Figure 7 The details of the above also apply in a similar manner to the methods described below. For example, methods 800, 1000, 1100, and 1200 optionally include one or more features of the various methods described with reference to method 700 above. For example, the computer system is the same, and the touch sensor, biometric sensor, and fingerprint sensor are optionally the same components and optionally integrated into the button. Also, the wake-up screen is the same screen. Also, the registration process is used to register fingerprints that are checked for matching throughout the process. Also, the indications of the positions of the fingerprint sensor, biometric sensor, touch sensor, and button are the same indicators throughout the process. For the sake of brevity, these details will not be repeated below.

[0317] Figure 8 This is a flowchart illustrating a method for disambiguating input on a fingerprint sensor using a computer system (e.g., 100, 300, 500, 600) according to some embodiments. Method 800 is executed at a computer system (e.g., 100, 300, 500, 600) having a fingerprint sensor (e.g., a fingerprint sensor integrated into a button such as a mechanical button or a solid-state button). The computer system (e.g., 600) communicates with a display generation component (e.g., 610). Some operations in method 800 are optionally combined, some operations are optionally changed in order, and some operations are optionally omitted.

[0318] As described below, method 800 provides an intuitive way to disambiguate input on a fingerprint sensor. This method reduces the cognitive burden on the user, thereby creating a more efficient human-machine interface. For battery-powered computing devices, disambiguating input on a touch sensor integrated into a button allows for faster and more efficient use of electronic devices, while saving power and increasing the time between battery charging.

[0319] The computer system (e.g., 600) detects (800) input directed at the fingerprint sensor.

[0320] In response to (804) detecting input, and based on (806) the determination that the input (e.g., 650c, 650q) includes fingerprint information detected by a fingerprint sensor that matches one or more registered fingers (e.g., the fingerprint of the finger matches the registered fingerprint) and is less than an input threshold (e.g., a time threshold, a distance threshold, and / or an intensity threshold), the computer system (e.g., 600) displays (808) a wake-up screen (e.g., 630) in an unlocked state via a display generation component (e.g., a screen that displays one or more notifications when available; and / or includes one or more display screens that are available in the locked state and also available in the unlocked state).

[0321] In response to (804) detecting input, and based on (810) a determination that the input (e.g., 650g, 650j) includes fingerprint information detected by a fingerprint sensor that matches one or more registered fingers (e.g., the fingerprint of the finger matches the registered fingerprint) and reaches an input threshold, the computer system (e.g., 600) displays (812) a second user interface (e.g., 660) via a display generation component, wherein the second user interface is different from the wake-up screen in the unlocked state.

[0322] By matching the input fingerprint information with the registered fingerprint and meeting an input threshold, different functions can be executed. This allows the device to use the same fingerprint sensor to perform various functions, reducing the need for additional hardware components. Providing additional control options without adding extra buttons or cluttering the UI due to additional displayed controls enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by allowing users to use the device more quickly and efficiently. Matching a finger with a registered fingerprint also provides security by restricting access to authorized users, thus making the system more secure.

[0323] In some implementations, a second user interface (e.g., Figure 6S The wake-up screen (UIS) is the application UI. In some implementations, the wake-up screen is the operating system's UI, not the application's UI. In some implementations, the wake-up screen includes notifications corresponding to multiple different applications on the computer system, while the application UI does not include notifications corresponding to multiple different applications. In some implementations, the second UI is visually updated by the application.

[0324] Displaying the application's user interface when a finger matching the registered finger and an input threshold is met allows the system to quickly and securely provide access to the application's user interface. Performing an action when a set of conditions have been met without further user input enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0325] In some implementations, the second user interface (e.g., 660) includes multiple icons corresponding to multiple applications. When the second user interface is displayed, the computer system (e.g., 600) receives a selection of one of the multiple icons (e.g., a tap input on that icon). In response to receiving the selection of the icon, the computer system (e.g., 600) displays the application user interface corresponding to that icon.

[0326] In some implementations, the second user interface is the system user interface rather than the application interface. In some implementations, the multiple icons include one or more icons from icons 416-446.

[0327] Displaying a user interface with multiple icons corresponding to multiple applications when a finger matching the registered finger is used and the input threshold is met allows the system to quickly and securely provide access to launch multiple applications. Performing an operation when a set of conditions have been met without further user input enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0328] In some implementations, in response to (804) detecting input, and based on determining that the input (e.g., 650b, 650h) includes fingerprint information detected by a fingerprint sensor that does not match one or more registered fingers (e.g., the fingerprint of a finger does not match any of the registered fingerprints), the computer system (e.g., 600) displays a wake-up screen in a locked state (e.g., 630) via a display generation component (e.g., a screen that displays one or more notifications when available; and / or includes one or more display screens that are available in the locked state and also available in the unlocked state).

[0329] When a finger does not match the registered finger, a wake-up screen is displayed while the computer system is locked to provide feedback to the user that a finger has been detected. This simultaneously prevents unauthorized access to the computer system's security information, thus providing feedback to the user that the finger is not an authorized one, thereby increasing system security. Providing improved visual feedback to the user enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0330] In some embodiments, upon determining that the computer system is in a first orientation (e.g., portrait or landscape), the computer system (e.g., 600) displays a visual indication requiring fingerprint authentication (e.g., 640a) as part of a locked wake-up screen at a first location (e.g., relative to the wake-up screen user interface) via a display generating component. In some embodiments, upon determining that the computer system is in a second orientation different from the first orientation (e.g., portrait or landscape), the computer system (e.g., 600) displays a visual indication requiring fingerprint authentication (e.g., 640a) as part of a locked wake-up screen at a second location different from the first location (e.g., relative to the wake-up screen user interface) via a display generating component.

[0331] In some implementations, when the computer system is in a first orientation, a first position is adjacent to the fingerprint sensor, and when the computer system is in a second orientation, a second position is adjacent to the fingerprint sensor.

[0332] In some implementations, the locked wake-up screen includes a visual indication that fingerprint authentication is required at a location on the display adjacent to the fingerprint sensor.

[0333] In some implementations, the location of the visual indicator requiring fingerprint authentication is based on the orientation of the computer system (and changes in conjunction with changes in the orientation of the computer system). In some implementations, the wake-up screen in the unlocked state does not include a visual indicator requiring fingerprint authentication.

[0334] Displaying an indication that fingerprint authentication is required provides the user with visual feedback that the system is locked and fingerprint authentication is needed to access security information. A visual indication displayed adjacent to the fingerprint sensor provides the user with visual feedback about the sensor's location, which is particularly relevant when the device can operate in multiple orientations, otherwise making it difficult for the user to quickly assess the sensor's position. Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0335] In some implementations, in response to (804) detecting input, and based on determining that the input (e.g., 650c) includes fingerprint information detected by a fingerprint sensor that matches one or more registered fingers (e.g., the fingerprint of the finger matches the registered fingerprint), the computer system (e.g., 600) updates the display on the wake-up screen via a display generation component to indicate (e.g., 632b) that the computer system is in an unlocked state.

[0336] In some implementations, the computer system detects input (a finger) pointing at the fingerprint sensor and detects the fingerprint of the finger. The computer system determines whether the finger has a fingerprint that matches a registered finger (with a registered fingerprint). If the finger matches the registered finger, the computer system unlocks the computer system and displays an indication that the computer system is unlocked. If the finger does not match the registered finger, the system does not unlock the computer system and does not display an indication that the computer system is unlocked. Optionally, the computer system displays an indication that the finger does not match the registered finger and / or that the system is locked.

[0337] Displaying an indication that the computer system is unlocked provides the user with visual feedback on the system's unlock status. Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0338] In some implementations, updating the display on the wake-up screen via the display generation component to indicate that the computer system (e.g., 600) is in an unlocked state includes changing the appearance of the lock indicator from a locked appearance (e.g., 632a) to an unlocked appearance (e.g., 632b) (e.g., at the same location).

[0339] Changing the appearance of the lock indicator from locked to unlocked provides the user with visual feedback that the device's status has changed from locked (e.g., based on user input) to unlocked. Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0340] In some implementations, in response to (802) detecting input, and based on the determination that the input (e.g., 650c) includes fingerprint information detected by a fingerprint sensor that matches one or more registered fingers (e.g., the fingerprint of a finger matches a registered fingerprint), the computer system (e.g., 600) updates the display on the wake-up screen (e.g., 630) via a display generation component to include the security content of the displayed notification (e.g., 636a, 636b).

[0341] In some implementations, the computer system does not update the wake-up screen to include the security content of the displayed notification if it determines that the input does not include fingerprint information that matches one or more registered fingers (e.g., the fingerprint of the finger matches the registered fingerprint).

[0342] When a finger matches a registered finger, the wake screen updates to include security content corresponding to the notification, providing the authorized user with access to security information and a visual indication that the computer system has matched the finger with the registered finger. Providing improved visual feedback to the user enhances device operability and makes the user interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0343] In some implementations, updating the wake-up screen to indicate that the computer system has been unlocked (e.g., displaying the content of one or more notifications 636a, 636b and / or changing the lock indicator 632a to an unlocked appearance 632b) occurs simultaneously with the display of a threshold indicator (e.g., 640b), which indicates progress toward reaching an input threshold by visually changing across the threshold indicator over time (e.g., color change, brightness change), the progress of the visual change corresponding to the progress toward reaching the input threshold.

[0344] In some implementations, a threshold indicator indicates progress over time toward reaching a time-based input threshold (the threshold duration of the touch). As the computer system continues to detect input directed at the fingerprint sensor, the threshold indicator continues to update to reflect the duration of the input.

[0345] Displaying a threshold indicator provides the user with visual feedback on their progress toward reaching the input threshold. Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0346] In some implementations, upon detecting input directed at a fingerprint sensor, the computer system (e.g., 600) displays a threshold indicator (e.g., 640b) indicating progress toward reaching an input threshold. In some implementations, as input directed at the fingerprint sensor continues to be detected, the computer system (e.g., 600) updates the threshold indicator (e.g., 640b) over time to indicate progress toward reaching the input threshold.

[0347] In some embodiments, displaying a threshold indicator includes replacing the display of a visual indicator requiring fingerprint authentication with the display of a threshold indicator. In some embodiments, when the computer system is unlocked upon detecting input, the threshold indicator is displayed in response to the detection of input. In some embodiments, when the computer system is locked upon detecting input, the threshold indicator is displayed in response to the determination that the input directed at the fingerprint sensor includes a finger matching (and thus authenticated) one or more registered fingers.

[0348] Displaying a threshold indicator provides the user with visual feedback on their progress toward reaching the input threshold. Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0349] In some implementations, displaying a threshold indicator (e.g., 640b) indicating progress toward reaching an input threshold includes: displaying the threshold indicator (e.g., 640b) at a first location in the user interface displayed via the display generation component, based on determining that the computer system (e.g., 600) is in a first orientation (e.g., portrait or landscape); and displaying the threshold indicator (e.g., 640b) at a second location in the user interface displayed via the display generation component, different from the first location, based on determining that the computer system (e.g., 600) is in a second orientation (e.g., portrait or landscape) different from the first orientation (e.g., portrait or landscape). Figure 6Y and Figure 6AU (As shown).

[0350] In some implementations, when the computer system is in a first orientation, a first position is adjacent to the fingerprint sensor, and when the computer system is in a second orientation, a second position is adjacent to the fingerprint sensor.

[0351] In some implementations, a threshold indicator is displayed on the display adjacent to the fingerprint sensor (e.g., as part of the wake-up screen when the device is unlocked).

[0352] In some implementations, the position of the threshold indicator is based on the orientation of the computer system (and changes in conjunction with changes in the orientation of the computer system). In some implementations, the wake-up screen in a locked state does not include a threshold indicator.

[0353] The threshold indicator displayed adjacent to the fingerprint sensor provides the user with visual feedback on what input caused the threshold indicator to advance, which is particularly relevant when the system can receive input using various input mechanisms.

[0354] In some implementations, the display shows a tendency to reach an input threshold (e.g., as in...). Figure 6G When a threshold indicator (e.g., 640b) indicating the (e.g., partial or non-zero) progress of input towards the fingerprint sensor is detected, the computer system (e.g., 600) detects the end of input towards the fingerprint sensor (e.g., 650c) (e.g., finger removal). In response to detecting the end of input towards the fingerprint sensor (e.g., 650c) before reaching the input threshold, the computer system (e.g., 600) updates the threshold indicator (e.g., 640b) over time to indicate that the progress toward reaching the input threshold has stopped (e.g., as in...). Figure 6H (For example, an animation of a threshold indicator that reverses the progression toward the input threshold).

[0355] Visually updating the threshold indicator over time to indicate progress toward reaching the input threshold and stopping the input has stopped provides visual feedback to the user that the input has stopped and progress has resumed. Providing improved visual feedback to the user enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0356] In some implementations, when a threshold indicator (e.g., 640b) is displayed indicating a tendency to reach an input threshold (e.g., partially or non-zero), the computer system (e.g., 600) detects input directed at the fingerprint sensor (e.g., as shown in [the context]). Figure 6H The end of input (e.g., finger lifting off) is detected. In response to detecting the end of input to the fingerprint sensor: the computer system (e.g., 600) detects the end of input (e.g., at...) Figure 6H After the threshold indicator (e.g., 640b) continues to be displayed for a predetermined time, and after the threshold indicator (e.g., 640b) continues to be displayed for a predetermined time, the computer system (e.g., 600) stops displaying the threshold indicator (e.g., as in...). Figure 6I In the middle, 640b was replaced by 640a.

[0357] In some implementations, when the second input is directed to the fingerprint sensor before a predetermined time has elapsed, the computer system continues to display a threshold indicator even after the predetermined time has elapsed while continuing to detect the second input.

[0358] After the end of input is detected, the threshold indicator continues to be displayed for a predetermined time to provide the user with visual feedback on the effect of the input termination (e.g., by showing the amount of progress achieved (e.g., zero)). Providing the user with improved visual feedback enhances the operability of the device and makes the user device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends the device's battery life by enabling the user to use the device more quickly and effectively.

[0359] In some implementations, the threshold indicator (e.g., 640b) is a text string, and the visual attributes of this text string (e.g., letters) are sequentially updated over time (e.g., highlighted, changed color, brightened, resized, and / or changed opacity) to indicate progress toward reaching the input threshold (e.g., as in...). Figure 6AY or Figures 6X-6Z middle).

[0360] Sequentially updating the visual attributes of a text string, such as the letters of the text string, to indicate progress provides the user with visual feedback on the progress toward reaching an input threshold, while simultaneously providing the text message, allowing the user to evaluate both the text message and the progress. Sequentially updating the visual attributes of the text string also draws attention to the content of the text string (e.g., instructions), thus emphasizing that content. Including indications of both instructions and progress within the same graphical element (threshold indicator) reduces clutter on the display and allows more information to be displayed on the user interface. Providing users with improved visual feedback without cluttering the user interface enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0361] In some embodiments, the input threshold is a first time threshold based on determining that input is detected when the display generating component is in a low-power state (e.g., the start of input). In some embodiments, the input threshold is a second time threshold, different from the first time threshold, based on determining that input is detected when the display generating component is not in a low-power state (e.g., in a standard power state; and / or not in a powered-off state or a low-power state that displays less information via the display of the display generating component compared to when input to a button is received). In some embodiments, the first time threshold is not longer than the second time threshold. In some embodiments, the first time threshold is shorter than the second time threshold.

[0362] Power state change time thresholds enable computer systems to transition to a second user interface more quickly when certain power state conditions are met. For example, a user can more easily view the display's content when it is not in a low-power state before (or when) user input is provided. Executing operations more quickly when a set of conditions have been met and no further user input is required enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by allowing users to use the device more quickly and efficiently.

[0363] In some implementations, the input threshold is a first time threshold, based on the determination that input is detected when one or more unread notifications (e.g., 636a, 636b) are available for display. In some implementations, the input threshold is a second time threshold, different from the first time threshold, based on the determination that input is detected when unread notifications (e.g., notifications that do not meet a set of criteria (e.g., have been displayed for a predetermined period of time; and / or have been displayed on a specific interface of a computer system or another computer system associated with an account associated with the computer system) are not available for display (e.g., no unread notifications).

[0364] In some implementations, the first time threshold is longer than the second time threshold, thus giving the user a longer opportunity to view the notification and ceasing touch input before the time threshold is met. In some implementations, the first time threshold is shorter than the second time threshold. Ceasing touch input before the time threshold is met allows the wake-up screen and corresponding notification to continue being displayed without transitioning to a second user interface.

[0365] When unread notifications are available for reading, the computer system performs actions based on different (e.g., longer) time thresholds, allowing the user to easily review the notification and having sufficient time to decide whether to stop providing input before the time threshold is reached. Different (e.g., shorter) durations when unread notifications are unread allow the user to transition away from the wake screen more quickly and access different user interfaces of interest. Therefore, these techniques make user-device interfaces more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0366] In some embodiments, while input detection continues and before the input exceeds an input threshold, based on the determination that one or more unread notifications (e.g., 636a, 636b) are available for display (e.g., displaying one or more unread notifications), the computer system (e.g., 600) displays a first graphical indicator (e.g., 640b) (e.g., a threshold indicator) at a first location in the user interface displayed via the display generation component (e.g., not displaying a second graphical indicator). In some embodiments, while input detection continues and before the input exceeds an input threshold, based on the determination that unread notifications are not available for display (e.g., no unread notification or no unread notification displayed), the display of the first graphical indicator at the first location in the user interface displayed via the display generation component is abandoned (e.g., as in...). Figure 6AD-Figure 6AE (For example, the first graphic indicator is not displayed, and optionally, the second graphic indicator is displayed instead at the first position).

[0367] The graphical indicator displays visual feedback to the user regarding the availability of unread notifications based on their presence. Furthermore, when the graphical indicator provides an indication of progress toward a threshold before transitioning to a second user interface, the system provides the user with additional feedback on the amount of progress required and, consequently, the time remaining to review the unread notification before ceasing its display (due to the transition to the second user interface). Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0368] In some implementations, the fingerprint sensor is part of a button (e.g., 602) of the computer system (e.g., the fingerprint sensor is integrated into a button such as a mechanical button or a solid-state button). In some implementations, in response to (804) detecting input, and based on determining that the input (e.g., 650a, 650f, 650j, 650l) includes activation (e.g., short press input) of a button (e.g., 602) for a duration less than the activation duration and displaying the generating component as being in a low-power state, the computer system (e.g., 600) will display the generating component transitioning from a low-power state to a higher (e.g., standard) power state (and optionally, displaying a wake-up screen).

[0369] Performing different functions based on button activation duration and power status allows the same button to perform various functions, reducing the need for additional hardware components. Providing additional control options enhances device operability without adding extra buttons or cluttering the UI with additional displayed controls, and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0370] In some implementations, the fingerprint sensor is part of a button in the computer system (e.g., 602) (e.g., the fingerprint sensor is integrated into a button such as a mechanical button or a solid-state button). In some implementations, in response to (804) detecting input, and based on determining that the input (e.g., 650e, 650i, 650k, 650m) includes button activation (e.g., short press input) for a duration less than the activation duration and indicating that the generating component is not in a low-power state, the computer system (e.g., 600) will indicate that the generating component has transitioned to a low-power state.

[0371] Performing different functions based on button activation duration and power status allows the same button to perform various functions, reducing the need for additional hardware components. Providing additional control options enhances device operability without adding extra buttons or cluttering the UI with additional displayed controls, and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0372] In some implementations, the fingerprint sensor is part of a button in the computer system (e.g., 602) (e.g., the fingerprint sensor is integrated into a button such as a mechanical button or a solid-state button). In some implementations, in response to (804) detecting input, and based on determining that the input includes activation of the button for a duration greater than the activation duration (e.g., a long press input) (and regardless of whether the display generating component is in a low-power state or not), the computer system (e.g., 600) invokes a virtual assistant (e.g., such as...). Figure 6AT (As shown) (for example, enabling a computer system's microphone to receive speech, and performing operations based on natural language processing of the speech).

[0373] In some implementations, button activation shorter than the activation duration is considered short activation (e.g., caused by a short press), and button activation longer than the activation duration is considered long activation (e.g., caused by a long press). In some implementations, long activation when the computer system is unlocked (or using a registered finger that causes the computer system to unlock) invokes a virtual assistant with access to private information (e.g., contact information, home address information), while long activation when the computer system is locked (and using an unregistered finger) invokes a virtual assistant without access to private information.

[0374] Performing different functions based on button activation duration allows the same button to perform various functions, thereby reducing the need for additional hardware components, lowering manufacturing costs, and reducing the number of components in a computer system that fail due to repeated use. Providing additional control options without adding extra buttons or cluttering the UI due to additional displayed controls enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0375] In some implementations, in response to (804) detecting input, and based on determining that the computer system (e.g., 600) is in an unlocked state and the input (e.g., 650d, 650r) includes touching the fingerprint sensor to a value greater than the input threshold regardless of whether the fingerprint input detected by the fingerprint sensor matches one or more registered fingers, the computer system (e.g., 600) displays a second user interface (e.g., 660) via a display generation component.

[0376] Therefore, when the device is unlocked (for example, when a computer system is displaying a wake-up screen while it is unlocked), any finger (not even a finger with fingerprint information that matches the registered finger) can be used to access the second user interface.

[0377] Using touch thresholds based on fingerprint sensors to perform different functions allows the same button to be used for various functions, reducing the need for additional hardware components. Providing additional control options enhances device operability without adding extra buttons or cluttering the UI with additional displayed controls, and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by allowing users to use the device more quickly and efficiently. Furthermore, the fact that matching a finger to a registered finger is not required when the computer system is unlocked allows the use of additional devices (e.g., different fingers) to cause a transition to a second user interface while maintaining system security.

[0378] In some embodiments, prior to input detection, based on the determination that the computer system (e.g., 600) is locked, the computer system (e.g., 600) displays a visual indication (e.g., 640a) of the location of the fingerprint sensor on the computer system (e.g., 600) via a display generating component. In some embodiments, the visual indication of the fingerprint sensor's location is displayed on the display adjacent to a button as part of a wake-up screen in a locked state, and this visual indication includes a visual indication requiring fingerprint authentication.

[0379] In some implementations, the location of the fingerprint sensor is visually indicated based on the orientation of the computer system (and changes in conjunction with changes in the orientation of the computer system).

[0380] The visual indication displayed adjacent to the fingerprint sensor provides the user with visual feedback about the sensor's location. This is particularly relevant when the device can operate in numerous orientations, otherwise it would make it difficult for the user to quickly assess the fingerprint sensor's position. Providing the user with improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends the device's battery life by enabling the user to use the device more quickly and effectively.

[0381] In some implementations, in response to (804) detecting input, and based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers (e.g., the fingerprint of a finger matches a registered fingerprint) (and optionally, while continuing to detect touch of the fingerprint sensor and / or after the determination that a finger matches one or more registered fingers), the computer system (e.g., 600) replaces the display of a visual indication (e.g., 640a) via a display generating component of the fingerprint sensor with a threshold indicator (e.g., 640b) indicating progress toward reaching an input threshold.

[0382] In some implementations, the technology stops displaying a visual indication of the fingerprint sensor's location and instead displays a threshold indicator indicating the progress toward reaching the input threshold.

[0383] Displaying a threshold indicator provides the user with visual feedback on their progress toward reaching the input threshold. Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0384] In some implementations, after input detection begins, the computer system (e.g., 600) stops detecting input (e.g., detecting that a finger has been lifted from the fingerprint sensor). In some implementations, in response to stopping input detection and based on determining that the input has not reached an input threshold, the computer system (e.g., 600) resets the progress toward reaching the input threshold (e.g., clears the progress) (e.g., as per [reference]). Figure 6H The above).

[0385] In some implementations, after the progress toward the input threshold is reset, the computer system detects additional input directed at the fingerprint sensor. Because the progress toward the input threshold is reset when the computer system stops detecting input, once the additional input meets the input threshold, the additional input will cause a transition to displaying a second user interface, regardless of the progress made by the initial input toward the input threshold (e.g., regardless of how close the input was to the input threshold before stopping input detection).

[0386] Resetting the progression toward the input threshold allows the computer system to require the full threshold to be met when subsequent user input is detected, thus eliminating the need for the user to track the progress toward the input threshold using previous input. For input thresholds that are time thresholds, the computer system can provide information to the user during periods when the time threshold is not met, allowing the user to stop providing input to avoid meeting the time threshold. Resetting the progression toward the input threshold also reduces the likelihood of unintentionally reaching the input threshold when the progress of accumulated storage is close to reaching the input threshold, making small (e.g., short duration and / or short distance) or accidental touches possible, causing the input threshold to be met and thus unintentionally triggering the operation. Providing improved visual feedback to the user and reducing unintentional triggering of operations enhances device operability and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and efficiently.

[0387] In some implementations, the computer system (e.g., 600) detects multiple (e.g., three) finger touches during a locked session (e.g., a period during which the computer system remains locked) that do not include fingerprint information matching one or more registered fingers. In response to detecting multiple finger touches during a locked session that do not include fingerprint information matching one or more registered fingers, the computer system (e.g., 600) displays a password entry user interface (e.g., an interface requesting password entry to unlock the computer system) via a display generation component.

[0388] In some implementations, the computer system receives password input (e.g., via a virtual keyboard) when the password input user interface is displayed. If the entered password matches a registered password, the computer system is unlocked. If the entered password does not match a registered password, the computer system remains locked.

[0389] After receiving multiple unsuccessful finger inputs, the password entry user interface displays visual feedback that an alternative authentication process is available, and provides this alternative authentication process, thereby reducing the amount of input required to access the alternative process. Providing users with improved visual feedback and reducing the amount of input required to perform the operation enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends the device's battery life by enabling users to use the device more quickly and efficiently.

[0390] It should be noted that the above description is relative to the process described in method 800 (e.g., Figure 8 The details of the methods described below / above also apply in a similar manner. For example, methods 700, 1000, 1100, and 1200 optionally include one or more features of the various methods described above with reference to method 800. For example, the computer system is the same, and the touch sensor, biometric sensor, and fingerprint sensor are optionally the same components and optionally integrated into the button. Also, the wake-up screen is the same screen. Also, the registration process is used to register fingerprints that are checked for matching throughout the process. Also, the indications of the positions of the fingerprint sensor, biometric sensor, touch sensor, and button are the same indicators throughout the process. For the sake of brevity, these details will not be repeated below.

[0391] Figures 9A-9AH Exemplary user interfaces for receiving user input are shown according to some embodiments. The user interfaces in these figures are used to illustrate including... Figure 10 , Figure 11 and Figure 12 The process described below is the process in the middle.

[0392] Figure 9A An electronic device 600 (e.g., a tablet computer, a smartphone) is shown, which includes a display 610, a housing 612, and buttons 602, 604a, and 604b.

[0393] Button 602 is optionally a mechanical button or a solid button, as described above. A user press input on button 602 activates button 602 for a period of time less than a long press threshold (e.g., less than the activation duration). A user long press input on button 602 activates button 602 for a period of time longer than the long press threshold (e.g., longer than the activation duration). Button 602 includes an integrated fingerprint sensor that enables electronic device 600 to detect the fingerprint features of a finger when it touches button 602 (e.g., a touch input where a finger is placed on button 602 without providing a press input) and when the finger is providing a press input to button 602.

[0394] Buttons 604a and 604b optionally do not include an integrated fingerprint sensor. When activated, buttons 604a and 604b respectively increase and decrease the volume of the electronic device 600.

[0395] exist Figure 9A During setup, the electronic device 600 is landscape-oriented to configure itself for use, and therefore the device setup user interface 920 is displayed in landscape orientation. The device setup user interface 920 does not include touch graphical elements because the device 600 does not request fingerprint input from the user at the fingerprint sensor integrated into the button 602. The device setup user interface 920 includes a continue option 920a. Figure 9A At this point, device 600 detects a tap gesture 950a on the continue option 920a via a touch-sensitive surface. In response to detecting the tap gesture 950a, device 600 proceeds to the next step of the setup process, such as... Figure 9B As shown.

[0396] exist Figure 9B In response to the detection of a tap gesture 950a, device 600 displays a user interface 922 for registering a fingerprint for fingerprint authentication. The user interface 922 includes video 924 (or an image) showing device 600 in the same orientation (e.g., landscape orientation) as it is currently positioned. Video 924 shows the location of a button with an integrated fingerprint sensor at representation 924a and displays a highlight 924b (e.g., a circle, a color filter) superimposed on the button at representation 924a to further provide feedback to the user regarding the location of the fingerprint sensor. User interface 922 also includes a continue option 922a and a later setup option 922b. In response to the detection of a tap gesture on the later setup option 922b, device 600 stops the fingerprint registration process of the setup process and optionally continues the remainder of the setup process. In response to the detection of a tap gesture on the continue option 922a, device 600 proceeds to the next step of the setup process, such as... Figure 9F As shown. User interface 922 optionally does not include touch graphical element 640a because device 600 does not request the user to provide fingerprint input at the fingerprint sensor integrated into button 602.

[0397] Figures 9C-9D The user interface is shown when the device 600 is in portrait orientation. Figures 9C-9D The user interface corresponds to Figures 9A-9B The user interface. Figure 9CIn response to a detected tap gesture 950a, device 600 displays user interface 922. User interface 922 includes video 926 (or an image) showing device 600 in the same orientation (e.g., portrait orientation) as it is currently positioned. Video 924 shows the location of a button with an integrated fingerprint sensor, representing 926a, and displays a highlight 926b (e.g., a circle, a color filter) superimposed on the button representing 926a to further provide the user with feedback on the location of the fingerprint sensor in that particular orientation. For example, in landscape orientation and displaying... Figure 9B When the user interface is accessed, device 600 detects a change in orientation from portrait to landscape and, in response, displays... Figure 9D The user interface. For example, in a portrait orientation and displaying... Figure 9D When the user interface is accessed, device 600 detects a change in orientation from horizontal to horizontal and, in response, displays... Figure 9B User interface.

[0398] exist Figure 9E At this point, when device 600 is in landscape orientation and user interface 922 is displayed, device 600 detects a tap gesture 950b on the continue option 922a. In response to detecting the tap gesture 950b on the continue option 922a, device 600 proceeds to the next step of the setup process, such as... Figure 9F As shown.

[0399] exist Figure 9F At this location, device 600 displays a user interface 926, which includes instructions 926a for the user to place their finger on the fingerprint sensor of button 602. Additionally, device 600 displays a touch graphic element 640a next to button 602 (e.g., before the user's finger is detected on the fingerprint sensor) to provide the user with a visual indication of where they should place their finger on the fingerprint sensor of button 602, and to provide a visual indication of the location of button 602. Figure 9F In this device 600, the user's fingerprint is detected by the fingerprint sensor on the button 602, which detects a portion of the user's fingerprint by the user pointing their finger at the button via touch input 950c.

[0400] exist Figure 9G At the location where a fingerprint is detected, device 600 displays a touch authentication user interface 928, which includes video 924 (as described above, based on the orientation selection of device 600) and prompts the user to provide additional fingerprint information from the same finger. Figure 9G At this point, the device 600 continues the detection option 928a with a tap gesture 950d.

[0401] exist Figure 9HIn response to detecting a tap gesture 950d, device 600 displays a user interface 930, which includes instructions 930a for the user to place their finger on the fingerprint sensor of button 602. Additionally, device 600 displays a touch graphic element 640a next to button 602 (e.g., before detecting the user's finger) to provide a visual indication of where the user should place their finger on the fingerprint sensor of button 602, and to provide a visual indication of the location of button 602. Figure 9H In this device 600, additional portions of the user's fingerprint are detected by the fingerprint sensor on button 602, based on the user pointing their finger to the button via touch input 950u (e.g., multiple consecutive touch inputs).

[0402] exist Figure 9I In response to the detection of an additional portion of a fingerprint via touch input 950u, device 600 displays user interface 932, which indicates that the fingerprint of the finger has been registered (and is therefore available for future authentication requests). User interface 932 also includes a continue option 932a. Device 600 detects a tap gesture 950e on continue option 932a.

[0403] exist Figures 9J-9K In response to a detected tap gesture 950e, device 600 displays a user interface 934. This user interface includes a video 936 showing a representation 936a of device 600 rotating from its current orientation to a different orientation, and an option to register a second finger for fingerprint authentication. For example, since device 600 is in landscape orientation, video 936 shows a representation 936a rotated from landscape to portrait orientation. Similarly, if device 600 is in portrait orientation, the video may optionally show a representation 936a rotated from portrait to landscape orientation. Therefore, device 600 selects video 936 for display based on the orientation of device 600 (e.g., from multiple videos) to encourage the user to rotate device 600 from its current orientation to a different orientation.

[0404] In some implementations, video 936 includes a highlight (e.g., a circle, a color filter) superimposed on the button representing 936a to further provide the user with feedback on the location of the fingerprint sensor. In some implementations, video 936 does not include a highlight superimposed on the button representing 936a when 936a is in the initial (e.g., current) orientation of device 600, and does include a highlight 936b superimposed on the button representing 936a when 936a is in a new (e.g., different) orientation. Figure 9J and Figure 9K The transition between them is shown.

[0405] User interface 934 also includes a continue option 934a and a later option 934b. In response to detecting a tap gesture on the later option 934b, device 600 does not continue the fingerprint registration process for the second finger and optionally continues the remainder of the setup process. In response to detecting a tap gesture 950f on the continue option 934a, device 600 proceeds to the next step of the setup process to register the second finger, such as... Figure 9L As shown. User interface 934 optionally does not include touch graphical element 640a because device 600 does not request the user to provide fingerprint input at the fingerprint sensor integrated into button 602.

[0406] exist Figure 9L In this configuration, device 600 displays user interface 938 in a portrait orientation, based on the device 600 being in a portrait orientation. The portrait-oriented user interface 938 corresponds to a landscape-oriented user interface 926. User interface 938 includes instructions 938a for the user to place their finger (e.g., a second finger) on the fingerprint sensor of button 602 to begin the process of registering the second finger. Additionally, device 600 displays a touch graphical element 640a next to button 602 (e.g., before the user's finger is detected on the fingerprint sensor) to provide the user with a visual indication that the user should place their finger on the fingerprint sensor of button 602, and to provide a visual indication of the location of button 602. Based on the orientation of device 600, touch graphical element 640a is displayed in a different portion of user interface 926 (e.g., in the upper left corner) compared to user interface 938 (e.g., in the upper right corner). Figure 9L In this device 600, a portion of the user's second fingerprint is detected by the fingerprint sensor on button 602, based on the user pointing their finger at button 602 via touch input 950g.

[0407] exist Figure 9M At the location where a second fingerprint is detected, device 600 displays a touch authentication user interface 940, which includes video 936 (as described above, based on the orientation selection of device 600) and prompts the user to provide additional fingerprint information from the same finger. Figure 9M At this point, the device 600 continues the detection option 940a with a tap gesture 950h.

[0408] exist Figure 9NIn response to the detection of a tap gesture 950h, device 600 displays a user interface 942, which includes instructions 942a for the user to place their finger (e.g., a second finger) on the fingerprint sensor of button 602. Additionally, device 600 displays a touch graphic element 640a next to button 602 (e.g., before detecting the user's finger) to provide a visual indication that the user should place their finger on the fingerprint sensor of button 602 and to provide a visual indication of the location of button 602. Depending on the orientation of device 600, touch graphic element 640a is displayed in a different part of user interface 930 (e.g., in the upper left corner) compared to user interface 942 (e.g., in the upper right corner). Figure 9N In this device 600, the additional portion of the user's second fingerprint is detected by the fingerprint sensor of the button 602 based on the user pointing their finger to the button via touch input 950i (e.g., multiple consecutive touch inputs).

[0409] exist Figure 9O In response to the detection of an additional portion of the second fingerprint via touch input 950i, device 600 displays user interface 944, which indicates that the second fingerprint of the finger has been registered (and is therefore available for future authentication requests). User interface 944 also includes a continue option 944a, which, when activated, causes device 600 to continue to the next part of the setup process.

[0410] Figure 9P The devices 600 in four different orientations are shown as devices 600a, 600b, 600c, and 600d. Devices 600a and 600b are both in a horizontal orientation, although they are oriented differently from each other. The button 602 of device 600a is on the upper left side of the device, while the button 602 of device 600b is on the upper right side of the device. Although devices 600a and 600b are oriented differently, the same video 924 is displayed during the setup process as part of their user interface (e.g., as part of the user interface of devices 9B and 9D). Similarly, devices 600c and 600d are both in a vertical orientation, although they are oriented differently from each other. The button 602 of device 600c is on the top side of the device, while the button 602 of device 600d is on the bottom side of the device. Although devices 600c and 600d are oriented differently, the same video 926 is displayed during the setup process as part of their user interface (e.g., as part of the user interface of devices 9B and 9D).

[0411] exist Figure 9Q At this point, device 600 has completed the setup process, and multiple user fingers have been registered for authorized operations and are therefore available for authorized operations (e.g., unlocking device 600, downloading / installing applications, and / or making payments). Figure 9QWhen the display of device 600 is off, device 600 detects a tap input 950j on the touch screen of device 600 (e.g., via the touch-sensitive surface of device 600).

[0412] exist Figure 9R In response to the detection of a tap input 950j, the display of device 600 turns on and wake-up screen 630 is displayed when device 600 is locked (as indicated by lock icon 632a). Wake-up screen 630 includes multiple unread notifications 636a, 636b. In some embodiments, Figure 9R The wake-up screen 630 includes a touch graphic element 640a located next to button 602 to indicate that the device is locked and / or to indicate the location of button 602.

[0413] exist Figure 9R At this point, when device 600 is locked, it detects an input gesture 950k (e.g., a tap gesture, a swipe gesture) on notification 636a, where the input gesture 950k is a request to display the application corresponding to notification 636a. Because device 600 is locked, authorization is required to access / display the application corresponding to notification 636a.

[0414] exist Figure 9S In response to the detection of an input gesture 950k and the need for authorization, the portrait-oriented device 600 displays a touch graphic element 640a next to the button 602 (e.g., in the upper right corner of the wake-up screen 630) to indicate the location of the fingerprint sensor and that the registered fingerprint is available to authorize the requested operation. The device 600 also optionally displays an additional indication 960a that authorization is required. The touch graphic element 640a in... Figure 9S The position of the wake-up screen 630 is based on the orientation of device 600.

[0415] and Figure 9S In comparison, when a gesture of 950k was detected, Figure 9T The device 600 is landscape-oriented, and in response, the device 600 displays a touch graphic element 640a in different parts of the wake-up screen 630 (e.g., next to button 602, in the upper left corner of the wake-up screen 630). The touch graphic element 640a in... Figure 9T The position of the wake-up screen 630 is based on the orientation of device 600.

[0416] Return to Figure 9T When a request to display the application corresponding to notification 636a is pending, device 600 detects an authorized fingerprint on the fingerprint sensor corresponding to button 602 via touch input 950k, and in response, displays the application corresponding to the notification (e.g., a messaging application), such as... Figure 9V As shown.

[0417] Figure 9U An example is shown where device 600 is unlocked when a request is made to display the application corresponding to notification 636a. Figure 9U At this point, device 600 is displaying wake screen 630 and device 600 is unlocked (e.g., using the above description regarding...). Figures 6A-6AY The aforementioned technique, as indicated by the unlock icon 632b. When device 600 is unlocked, device 600 detects an input gesture 950m (e.g., a tap gesture, a swipe gesture) on notification 636a, where the input gesture 950m is a request to display the application corresponding to notification 636a. Since device 600 is unlocked, authorization has been provided and therefore no authorization is required to access / display the application corresponding to notification 636a. Since no authorization is required, device 600 displays the application corresponding to the notification (e.g., a messaging application), such as... Figure 9V As shown, touch graphic element 640a is not displayed.

[0418] Figures 9W-9Z An exemplary procedure for performing password autofill is shown. Figure 9W At this point, device 600 detects a tap 950n on the password field 970a of user interface 970. In response, device 600 displays an option 970b for autofilling the password and detects input 950 requesting autofill. Although device 600 is unlocked, the password autofill operation requires authorization. In response to input 950o, device 600 displays an authorization request 970c and displays a touch graphical element 640a located next to button 602 based on the orientation of device 600, as for... Figure 9Y The horizontal and vertical orientations are shown in the figure.

[0419] Figure 9Z-Figure 9AA The device 600 is shown to receive authorization via a registered fingerprint on touch input 950p on button 602, and in response, performs an autofill operation for the password.

[0420] Figures 9AB-9AE An exemplary process for performing a payment operation is shown. Figure 9AB At this point, device 600 detects a tap 950q on the purchase option 970d. Although device 600 is unlocked, the payment operation requires authorization. In response to input 950q, device 600 displays an authorization request 970e and displays a touch graphic element 640a located next to button 602, based on the orientation of device 600, as for... Figure 9AC The horizontal and vertical orientations are shown in the figure.

[0421] Figure 9AD-Figure 9AE The device 600 is shown to receive authorization via a registered fingerprint through a touch input 950r on a button 602, and in response, to perform a payment operation.

[0422] Figure 9AF-Figure 9AH An exemplary process for downloading an application is shown. Figure 9AF At this point, device 600 detects a tap 950s on option 970f. Although device 600 is unlocked, the download operation requires authorization. In response to input 950s, device 600 displays an authorization request 970g and displays a touch graphic element 640a located next to button 602 based on the orientation of device 600, as for... Figure 9AG The horizontal and vertical orientations are shown in the figure.

[0423] Figure 9AH The device 600 is shown to receive input via a fingerprint that does not correspond to an authorized fingerprint via touch input 950t on button 602, and in response, does not perform a download operation.

[0424] Figure 10 This is a flowchart illustrating a method for displaying a user interface for registering biometric features using a computer system (e.g., 100, 300, 500, 600) according to some embodiments. Method 1000 is performed at a computer system (e.g., 100, 300, 500, 600) having a biometric sensor (e.g., a fingerprint sensor, such as a fingerprint sensor combined with a physical button or solid-state button, integrated into or embedded therein, a facial recognition sensor, or an iris recognition sensor). The computer system (e.g., 600) communicates with a display generation component (e.g., 610). Some operations in method 1000 are optionally combined, some operations are optionally changed in order, and some operations are optionally omitted.

[0425] As described below, Method 1000 provides an intuitive way to register biometric features. This method reduces the cognitive burden on the user, thereby creating a more efficient human-machine interface. For battery-powered computing devices, disambiguation of input from touch sensors integrated into buttons allows for faster and more efficient use of electronic devices, while saving power and increasing the time between battery charging cycles.

[0426] The computer system (e.g., 600) displays (1002) a user interface for registering biometric features (e.g., registering fingerprints, registering faces, or registering irises) via a display generation component (e.g., 610).

[0427] When displaying (1004) a user interface for registering biometric features, the computer system (e.g., 600) receives (1006) one or more registration inputs (e.g., 950c, 950d) via a biometric sensor (e.g., 602).

[0428] In response to receiving one or more registration inputs (1008), the computer system (e.g., 600) registers (1010) a first biometric feature (e.g., a first finger or a first iris) (e.g., completing the registration of the first biometric feature).

[0429] After successful registration (1012) of the first biometric feature (e.g., in response to successful registration of the first biometric feature), the computer system (e.g., 600) prompts (1014) (e.g., as in...). Figure 9J (In China) Users register a second biometric feature that is different from the first biometric feature (e.g., a second finger that is different from the first finger, or a second iris that is different from the first iris).

[0430] After successfully registering the first biometric feature, prompting the user to register a second biometric feature provides feedback that additional biometric features can be registered. Registering multiple biometric features is particularly helpful for computer systems that can be used in various orientations (e.g., lateral or longitudinal orientation), allowing the computer system to receive biometric information (e.g., to authenticate the user) from any of the registered biometric features that is more accessible or convenient when the system is in a particular orientation (e.g., near the biometric sensor, and / or within the sensing area of ​​the biometric sensor) after the registration process. Providing improved feedback to the user and enabling the device to authenticate using various biometric features enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends the device's battery life by allowing the user to use the device more quickly and efficiently.

[0431] In some implementations, the fingerprint sensor uses capacitive touch to capture one or more high-resolution images of a fingerprint (e.g., from the subepidermal layer of the skin). As part of registering the finger, a computer system creates and securely stores (e.g., in a secure compartment) fingerprint information that includes a mathematical representation of the fingerprint (e.g., representing the orientation and width of ridges extracted from a portion of the fingerprint) but does not include an image of the finger itself. For subsequent authentication, the fingerprint sensor again uses capacitive touch to capture one or more high-resolution images of the provided fingerprint. The computer system creates a mathematical representation of the fingerprint and compares it to the registered fingerprint information to determine if a match exists. When a match exists, the fingerprint is authenticated, and the required authentication action (e.g., unlocking the computer system and / or transferring funds) is performed. In some implementations, the computer system never stores images of the finger or the fingerprint itself. The computer system optionally incrementally updates the mathematical representation of the registered fingerprint over time to improve matching accuracy.

[0432] In some implementations, for authentication using a facial recognition sensor, a computer system projects and analyzes invisible points (e.g., 30,000 invisible points) in the sensor's field of view to create a depth map of the face. The computer system captures an infrared image of the face. As part of registering a finger, the computer system creates and securely stores (e.g., in a secure compartment) facial information, including a mathematical representation of the face. For subsequent authentication via the facial recognition sensor, the computer system again projects and analyzes invisible points (e.g., 30,000 invisible points) in the sensor's field of view to create a depth map of the face within the sensor's field of view. The computer system creates a mathematical representation of the face and compares it to the registered facial information to determine if a match exists. When a match exists, the face is authenticated, and the required authentication action (e.g., unlocking the computer system and / or transferring funds) is performed. In some implementations, the computer system never stores an image of the face itself. The computer system optionally incrementally updates the mathematical representation of the registered face over time to improve matching accuracy.

[0433] In some implementations, an electronic device receives biometric input and determines whether the received biometric input matches a registered first biometric feature, regardless of (e.g., a registered) second biometric feature. Based on the determination that the received biometric input matches the registered first biometric feature, the received biometric input is authenticated (e.g., thereby unlocking the computer system and / or providing access to security information). Based on the determination that the received biometric input does not match the registered first biometric feature, the received biometric input is not authenticated (e.g., thereby not unlocking the computer system and / or not providing access to security information). Therefore, in some implementations, each of the registered biometric features can be used independently of other registered biometric features to authenticate a user's biometric input as authenticated.

[0434] In some embodiments, prompting a user to register a second biometric feature different from the first biometric feature (e.g., a second finger different from the first finger, or a second iris different from the first iris) includes simultaneously displaying an option (e.g., 934b) not to register the second biometric feature via a display generation component along with the prompt to register the second biometric feature (e.g., 936, 934a). In some embodiments, while simultaneously displaying the prompt to register the second biometric feature and the option not to register the second biometric feature, the computer system (e.g., 600) receives user input selecting the option not to register the second biometric feature. In response to receiving user input selecting the option not to register the second biometric feature, the computer system (e.g., 600) stops displaying the prompt to register the second biometric feature.

[0435] Displaying the option not to register a second biometric feature provides users with feedback that they do not need to register an additional biometric feature to continue using the registered first biometric feature. Providing users with improved feedback enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and improves device battery life by enabling users to use the device more quickly and efficiently.

[0436] In some implementations, a prompt to register a second biometric feature is displayed via a display generation component. Two selectable options are also displayed: (a) to continue registering the second biometric feature and (b) to not register the second biometric feature.

[0437] In some implementations, displaying a user interface for registering biometric features and receiving one or more registration inputs via a biometric sensor are setup procedures for configuring a computer system (e.g., 600) for use (e.g., for initial use). Figures 9A-9D (As shown) (for example, as part of the settings for a user's personalized computer system).

[0438] Displaying a user interface for registering biometric features and receiving corresponding registration input during the computer system setup process enables the computer system to configure biometric authentication before the user stores sensitive information on the system, thereby increasing system security. Encouraging users to register multiple biometric features during computer system setup is particularly helpful for computer systems that can be used in a variety of different orientations (e.g., lateral or longitudinal orientation), so that after the registration process, the computer system can receive biometric information (e.g., to authenticate the user) from any of the registered biometric features that is most accessible or convenient when the system is in a particular orientation (e.g., located near the biometric sensor and / or within the sensing area of ​​the biometric sensor).

[0439] In some implementations, the computer system can transition between a locked state and an unlocked state. Registered biometric features can be used to transition the computer system from a locked state to an unlocked state.

[0440] In some implementations, after registering the first biometric feature and before registering the second biometric feature, the computer system (e.g., 600) prompts (e.g., as in...) Figure 9J (e.g., via displaying the generating component and / or simultaneously displaying a prompt to register a second biometric feature) the user rotates the computer system (e.g., 600) from a first orientation to a second orientation different from the first orientation (e.g., rotating the computer system from a vertical orientation to a horizontal orientation, rotating the computer system from a horizontal orientation to a vertical orientation, and / or rotating the computer system by approximately 90 degrees or 90 degrees).

[0441] Prompting users to rotate the computer system between different biometric registrations provides feedback to the user that the computer system can be used in different orientations and enables the computer system to collect different biometric information when the system is in various orientations. For example, collecting biometric information when the system is in various orientations better enables the system to authenticate input when input is provided in those various orientations, thereby improving the system's security and ease of use. Encouraging users to register multiple biometrics in different orientations is particularly helpful for computer systems that can be used in multiple different orientations (e.g., lateral or longitudinal orientations), enabling the computer system to receive biometric information (e.g., to authenticate the user) from any of the registered biometrics that is most accessible or convenient when the system is in a particular orientation (e.g., located near the biometric sensor and / or within the sensing area of ​​the biometric sensor).

[0442] In some implementations, prompting a user to rotate the computer system (e.g., 600) includes displaying a movement representation (e.g., 936) (e.g., video or representative animation) of the computer system (e.g., 600) rotating from a first orientation (e.g., portrait orientation) to a second orientation (e.g., lateral orientation) different from the first orientation.

[0443] Displaying a movement indicator showing the computer system's rotation provides visual feedback to the user regarding orientation options. Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0444] In some embodiments, the user interface for registering biometric features includes visual indications (e.g., 924b, 926b, 640a) of the location of a biometric sensor on a computer system (e.g., 600), such as on the housing 612 of the computer system. In some embodiments, the visual indication of the biometric sensor's location is displayed as part of an image and / or video representation of the computer system with buttons. In some embodiments, the visual indication (or a second visual indication of the biometric sensor's location) is displayed adjacent to the biometric sensor via a display generating component. In some embodiments, the location of the visual indication (and / or the second visual indication) of the biometric sensor's location is based on the orientation of the computer system.

[0445] Visual indicators showing the location of biometric sensors provide users with visual feedback about their position, which is particularly relevant when the system can operate in numerous orientations, otherwise making it difficult for users to quickly assess the location of the biometric sensors. Providing users with improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0446] In some implementations, when a user interface for registering biometric features, displaying a visual indication of the location of a biometric sensor via a display generation component, detects a change in the orientation of the computer system (e.g., 600). In response to detecting the change in the orientation of the computer system (e.g., 600), the computer system (e.g., 600) changes (e.g., as...) Figure 9P(as shown) Visual indication of the location of the biometric sensor (e.g., changing the position and / or orientation of the indication).

[0447] When the system's orientation changes, visual cues that alter the position of the biometric sensor provide the user with visual feedback on the sensor's location relative to the new orientation. This is particularly relevant when the system can operate in numerous orientations, and otherwise, it would make it difficult for the user to quickly assess the sensor's position. Providing improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0448] In some embodiments, the visual indication of changing the position of the biometric sensor includes a second image and / or a second video displaying a representation of a computer system with buttons. In some embodiments, the orientation of the representation of the computer system in the second image and / or the second video corresponds to a new orientation of the computer system. In some embodiments, the visual indication of the position of the biometric sensor includes two components: a text component and a non-text component. In some embodiments, the visual indication of changing the position of the biometric sensor includes rotating the text component without rotating the non-text component.

[0449] In some embodiments, the user interface for registering biometric features includes a visual indication (e.g., 924a, 926a) of the orientation of a computer system (e.g., 600). In some embodiments, the visual indication of the computer system's orientation is part of an image and / or video representing the computer system with buttons. In some embodiments, the orientation of the computer system's representation in the image and / or video corresponds to the orientation of the computer system.

[0450] Visual indicators of a computer system's orientation provide users with visual feedback on how the system is detecting the current orientation, which is particularly relevant when the system can operate in multiple orientations. Providing users with improved visual feedback enhances device operability and makes the user interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0451] In some implementations, when a user interface for registering biometric features, having a visual indication of the orientation of a computer system (e.g., 600), is displayed via a display generation component, the computer system (e.g., 600) detects (e.g., such as) the orientation of the computer system (e.g., 600). Figure 9P (The orientation of the computer system) changes. In response to detecting a change in the orientation of the computer system (e.g., 600), the computer system (e.g., 600) changes the visual indication of the orientation of the computer system (e.g., 924, 926).

[0452] When a computer system's orientation changes, visual cues indicating this change provide the user with visual feedback on how the system has detected the orientation change. This is particularly relevant when the system can operate in multiple orientations. Providing improved visual feedback to the user enhances device operability and makes the user interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device). This, in turn, reduces power consumption and extends device battery life by enabling users to use the device more quickly and effectively.

[0453] In some embodiments, the visual indication of changing the orientation of the computer system includes displaying a second image and / or a second video of a device having buttons. In some embodiments, the orientation of the device in the second image and / or the second video corresponds to a new orientation of the computer system. In some embodiments, the computer system switches between four orientations (e.g., a first portrait, a second portrait, a first landscape, and a second landscape), and a first visual indication of the computer system's orientation is used for two of the four orientations (e.g., a first portrait and a second portrait), and a second visual indication of the computer system's orientation is used for two of the four orientations (e.g., a first landscape and a second landscape).

[0454] Note that the above reference method 1000 (for example, Figure 10 The details of the process described herein also apply in a similar manner to the methods described below / above. For example, methods 700, 800, 1100, and 1200 optionally include one or more features of the various methods described above with reference to method 1000. For example, the computer system is the same, and the touch sensor, biometric sensor, and fingerprint sensor are optionally the same components and optionally integrated into the button. Also, the wake-up screen is the same screen. Also, the registration process is used to register fingerprints that are checked for matching throughout the process. Also, the indications of the positions of the fingerprint sensor, biometric sensor, touch sensor, and button are the same indicators throughout the process. For the sake of brevity, these details will not be repeated below.

[0455] Figure 11This is a flowchart illustrating a method for displaying a user interface indicating the location of a biometric sensor using a computer system (e.g., 100, 300, 500, 600) according to some embodiments. Method 1100 is performed at a computer system (e.g., 100, 300, 500, 600) having a biometric sensor (e.g., a fingerprint sensor, such as a fingerprint sensor combined with a mechanical or solid button, integrated into or embedded therein, a facial recognition sensor, or an iris recognition sensor). The computer system (e.g., 600) communicates with a display generation component (e.g., 610) and one or more input devices (e.g., a button 602, a touch-sensitive surface). Some operations in method 1100 are optionally combined, some operations are optionally changed in order, and some operations are optionally omitted.

[0456] As described below, method 1100 provides an intuitive way to indicate the location of a biometric sensor. This method reduces the cognitive burden on the user, thereby creating a more efficient human-machine interface. For battery-powered computing devices, disambiguation of input from touch sensors integrated into buttons allows for faster and more efficient use of electronic devices, while saving power and increasing the time between battery charging.

[0457] A computer system (e.g., 600) receives (1102) a request (e.g., 950a) via one or more input devices to initiate a process for registering biometric features, wherein biometric information collected via biometric sensors will be used to perform the registration.

[0458] In response to (1104) receiving a request to initiate a process for registering biometric features and based on (1106) the determination that the computer system (e.g., 600) is in a first orientation, the computer system (e.g., 600) displays (1108) a first user interface element (e.g., 924, 926) (e.g., image, video and / or text) indicating the position of the biometric sensor on the computer system (e.g., 600) via a display generation component (without displaying a second user interface element).

[0459] In response to (1104) receiving a request to initiate a process for registering biometric features and based on (1110) a determination that the computer system (e.g., 600) is in a second orientation, the computer system (e.g., 600) displays a second user interface element (e.g., 924, 926) (e.g., images, videos, and / or text) indicating the location of the biometric sensor on the computer system via a display generation component (without displaying the first user interface element), wherein the second user interface element is different from the first user interface element. In some embodiments, the first orientation is different from the second orientation.

[0460] Different user interface elements displaying the location of the biometric sensor, indicating the orientation detected by the computer system, provide the user with visual feedback on how the system is detecting the current orientation of the biometric sensor. This is particularly relevant when the system can operate in numerous orientations. Additionally, different user interface elements provide feedback to the user on the location of the biometric sensor, enabling the user to access the biometric sensor more quickly. Providing improved visual feedback to the user enhances the operability of the device and makes the user device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power consumption and extends the device's battery life by enabling the user to use the device more quickly and efficiently. In some embodiments, the first user interface element includes a representation of the computer system (e.g., 600) in a first orientation (e.g., in a portrait orientation) (e.g., 924a, 926a).

[0461] The representation of the computer system in a first orientation, as part of a first user interface element, provides the user with visual feedback on how the system is detecting its current orientation, which is particularly relevant when the system can operate in multiple orientations. Additionally, different user interface elements can provide the user with feedback on the location of biometric sensors, enabling the user to access the biometric sensors more quickly. Providing the user with improve...

Claims

1. A method comprising: In a computer system equipped with a fingerprint sensor, wherein the computer system communicates with a display generation component: Detect input directed at the fingerprint sensor; as well as In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and that the input is less than an input threshold, a wake-up screen in an unlocked state is displayed via the display generation component; as well as Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and that the input is greater than the input threshold, a second user interface is displayed via the display generation component, wherein the second user interface is different from the wake-up screen in the unlocked state.

2. The method according to claim 1, wherein the second user interface is an application user interface.

3. The method according to claim 1, wherein the second user interface includes a plurality of icons corresponding to a plurality of applications, and the method further includes: When the second user interface is displayed, a selection of one of the plurality of icons is received; as well as In response to receiving a selection of the icon, the application user interface corresponding to the icon is displayed.

4. The method according to any one of claims 1 to 3, further comprising: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that does not match the one or more registered fingers, the wake-up screen in a locked state is displayed via the display generation component.

5. The method according to claim 4, further comprising: Based on the determination that the computer system is in a first orientation, a visual indication requiring fingerprint authentication is displayed at a first position via the display generation component as part of the wake-up screen in the locked state; as well as Based on the determination that the computer system is in a second orientation different from the first orientation, a visual indication requiring fingerprint authentication is displayed via the display generation component at a second location different from the first location as part of the wake-up screen in the locked state.

6. The method according to any one of claims 1 to 3, further comprising: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display on the wake-up screen via the display generation component is updated to indicate that the computer system is in an unlocked state.

7. The method of claim 6, wherein updating the display of the wake-up screen via the display generation component to indicate that the computer system is in an unlocked state comprises: Change the appearance of the lock indicator from locked to unlocked.

8. The method according to claim 6, further comprising: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display on the wake-up screen via the display generation component is updated to include the security content of the displayed notification.

9. The method of claim 6, wherein updating the display of the wake-up screen to indicate that the computer system is unlocked occurs simultaneously with displaying a threshold indicator, the threshold indicator indicating progress toward reaching the input threshold by visually changing across the threshold indicator over time, the progress of the visual change corresponding to the progress toward reaching the input threshold.

10. The method according to any one of claims 1 to 3, further comprising: When the input is detected directed at the fingerprint sensor, a threshold indicator is displayed to indicate the progress toward reaching the input threshold; as well as As input to the fingerprint sensor continues to be detected, the threshold indicator is updated over time to indicate progress toward reaching the input threshold.

11. The method of claim 10, wherein the threshold indicator displaying a progression toward reaching the input threshold comprises: Based on determining that the computer system is in a first orientation, the threshold indicator is displayed at a first position in the user interface displayed via the display generation component; as well as Based on the determination that the computer system is in a second orientation different from the first orientation, the threshold indicator is displayed at a second position different from the first position in the user interface displayed via the display generation component.

12. The method of claim 10, further comprising: When the threshold indicator, which shows a progression toward reaching the input threshold, is displayed, the end of the input directed at the fingerprint sensor is detected; as well as In response to the detection of the end of the input directed at the fingerprint sensor before reaching the input threshold, the threshold indicator is updated over time to indicate that progress toward reaching the input threshold has stopped.

13. The method of claim 10, further comprising: When the threshold indicator, which shows a progression toward reaching the input threshold, is displayed, the end of the input directed at the fingerprint sensor is detected; as well as The end in response to detecting the input directed at the fingerprint sensor: After the end of the input is detected, the threshold indicator continues to be displayed for a predetermined time; and After the threshold indicator has been displayed for the predetermined time, the display of the threshold indicator shall be stopped.

14. The method of claim 10, wherein the threshold indicator is a text string, and wherein the visual properties of the text string are sequentially updated over time to indicate progress toward reaching the input threshold.

15. The method according to any one of claims 1 to 3, wherein: Based on the determination that the input was detected when the display generating component was in a low-power state, the input threshold is a first time threshold; and Based on the determination that the input was detected when the display generating component was not in a low-power state, the input threshold is a second time threshold that is different from the first time threshold.

16. The method according to any one of claims 1 to 3, wherein: The input threshold is a first time threshold, which is determined to be detected when one or more unread notifications are available for display. as well as The input threshold is a second time threshold that is different from the first time threshold, based on the determination that the input was detected when the unread notification was not available for display.

17. The method of claim 16, further comprising: While continuing to detect the input and before the input exceeds the input threshold: Based on determining that one or more unread notifications are available for display, a first graphical indicator is displayed at a first location in the user interface displayed via the display generation component; as well as Based on the determination that the unread notification is not available for display, the display of the first graphic indicator at the first location in the user interface displayed via the display generation component is abandoned.

18. The method according to any one of claims 1 to 3, wherein the fingerprint sensor is part of a button in the computer system, the method further comprising: In response to the detection of the input: Based on the determination that the input includes the activation of the button for a duration less than the activation duration and that the display generation component is in a low-power state, the display generation component is switched from the low-power state to a higher-power state.

19. The method according to any one of claims 1 to 3, wherein the fingerprint sensor is part of a button in the computer system, the method further comprising: In response to the detection of the input: Based on the determination that the input includes activation of the button for a duration less than the activation duration and that the display generation component is not in a low-power state, the display generation component is switched to the low-power state.

20. The method according to any one of claims 1 to 3, wherein the fingerprint sensor is part of a button in the computer system, the method further comprising: In response to the detection of the input: The virtual assistant is invoked based on the determination that the input includes the activation of the button for a duration greater than the activation duration.

21. The method according to any one of claims 1 to 3, further comprising: In response to the detection of the input: Based on the determination that the computer system is in an unlocked state and that the input includes touching the fingerprint sensor to a value greater than the input threshold, regardless of whether the fingerprint input detected by the fingerprint sensor matches one or more registered fingers, the second user interface is displayed via the display generation component.

22. The method according to any one of claims 1 to 3, further comprising: Before the input is detected: Based on the determination that the computer system is in a locked state, a visual indication of the location of the fingerprint sensor on the computer system is displayed via the display generation component.

23. The method of claim 22, further comprising: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display of the visual indication of the location of the fingerprint sensor via the display generation component is replaced with a threshold indicator indicating a progression toward reaching the input threshold.

24. The method according to any one of claims 1 to 3, further comprising: After starting to detect the input, stop detecting the input; as well as In response to stop detecting the input: Based on the determination that the input has not reached the input threshold, the progress toward reaching the input threshold is reset.

25. The method according to any one of claims 1 to 3, further comprising: Detect multiple finger touches during a locked session that do not include fingerprint information matching one or more registered fingers; as well as In response to the detection of multiple finger touches during the locked session that do not include fingerprint information matching the one or more registered fingers, a password entry user interface is displayed via the display generation component.

26. A computer system, the computer system comprising: Fingerprint sensor; Display generated components; and Apparatus for performing the method according to any one of claims 1 to 3.

27. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system having a fingerprint sensor and a display generation component, said one or more programs comprising instructions for performing the method according to any one of claims 1 to 3.

28. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system having a fingerprint sensor, wherein the computer system communicates with a display generation component, the one or more programs including instructions for performing the following operations: Detecting input directed at the fingerprint sensor; and In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor matching one or more registered fingers and that the input is less than an input threshold, a wake-up screen in an unlocked state is displayed via the display generation component; and Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and that the input is greater than the input threshold, a second user interface is displayed via the display generation component, wherein the second user interface is different from the wake-up screen in the unlocked state.

29. The computer-readable storage medium of claim 28, wherein the second user interface is an application user interface.

30. The computer-readable storage medium of claim 28, wherein the second user interface comprises a plurality of icons corresponding to a plurality of applications, and wherein the one or more programs further comprises instructions for performing the following operations: When the second user interface is displayed, a selection of one of the plurality of icons is received; and In response to receiving a selection of the icon, the application user interface corresponding to the icon is displayed.

31. The computer-readable storage medium according to any one of claims 28 to 30, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that does not match the one or more registered fingers, the wake-up screen in a locked state is displayed via the display generation component.

32. The computer-readable storage medium of claim 31, wherein the one or more programs further include instructions for performing the following operations: Based on the determination that the computer system is in a first orientation, a visual indication requiring fingerprint authentication is displayed at a first location via the display generation component as part of the wake-up screen in the locked state; and Based on the determination that the computer system is in a second orientation different from the first orientation, a visual indication requiring fingerprint authentication is displayed via the display generation component at a second location different from the first location as part of the wake-up screen in the locked state.

33. The computer-readable storage medium according to any one of claims 28 to 30, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display on the wake-up screen via the display generation component is updated to indicate that the computer system is in an unlocked state.

34. The computer-readable storage medium of claim 33, wherein updating the display of the wake-up screen via the display generation component to indicate that the computer system is in an unlocked state comprises: Change the appearance of the lock indicator from locked to unlocked.

35. The computer-readable storage medium of claim 33, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display on the wake-up screen via the display generation component is updated to include the security content of the displayed notification.

36. The computer-readable storage medium of claim 33, wherein updating the display of the wake-up screen to indicate that the computer system is unlocked occurs simultaneously with displaying a threshold indicator, the threshold indicator indicating progress toward reaching the input threshold by visually changing across the threshold indicator over time, the progress of the visual change corresponding to the progress toward reaching the input threshold.

37. The computer-readable storage medium according to any one of claims 28 to 30, wherein the one or more programs further include instructions for performing the following operations: When the input is detected directed at the fingerprint sensor, a threshold indicator is displayed indicating the progress toward reaching the input threshold; and As input to the fingerprint sensor continues to be detected, the threshold indicator is updated over time to indicate progress toward reaching the input threshold.

38. The computer-readable storage medium of claim 37, wherein the threshold indicator displaying an indication of progress toward reaching the input threshold comprises: Based on determining that the computer system is in a first orientation, the threshold indicator is displayed at a first position in the user interface displayed via the display generation component; as well as Based on the determination that the computer system is in a second orientation different from the first orientation, the threshold indicator is displayed at a second position different from the first position in the user interface displayed via the display generation component.

39. The computer-readable storage medium of claim 37, wherein the one or more programs further include instructions for performing the following operations: While displaying the threshold indicator showing a progression toward reaching the input threshold, the end of the input directed at the fingerprint sensor is detected; and In response to the detection of the end of the input directed at the fingerprint sensor before reaching the input threshold, the threshold indicator is updated over time to indicate that progress toward reaching the input threshold has stopped.

40. The computer-readable storage medium of claim 37, wherein the one or more programs further include instructions for: While displaying the threshold indicator showing a progression toward reaching the input threshold, the end of the input directed at the fingerprint sensor is detected; and The end in response to detecting the input directed at the fingerprint sensor: After the end of the input is detected, the threshold indicator continues to be displayed for a predetermined time; and After the threshold indicator has been displayed for the predetermined time, the display of the threshold indicator shall be stopped.

41. The computer-readable storage medium of claim 37, wherein the threshold indicator is a text string, and wherein the visual properties of the text string are sequentially updated over time to indicate progress toward reaching the input threshold.

42. The computer-readable storage medium according to any one of claims 28 to 30, wherein: Based on the determination that the input was detected when the display generating component was in a low-power state, the input threshold is a first time threshold; as well as Based on the determination that the input was detected when the display generating component was not in a low-power state, the input threshold is a second time threshold that is different from the first time threshold.

43. The computer-readable storage medium according to any one of claims 28 to 30, wherein: The input threshold is a first time threshold, which is determined to be detected when one or more unread notifications are available for display. as well as The input threshold is a second time threshold that is different from the first time threshold, based on the determination that the input was detected when the unread notification was not available for display.

44. The computer-readable storage medium of claim 43, wherein the one or more programs further include instructions for performing the following operations: While continuing to detect the input and before the input exceeds the input threshold: Based on determining that one or more unread notifications are available for display, a first graphical indicator is displayed at a first location in the user interface displayed via the display generation component; and Based on the determination that the unread notification is not available for display, the display of the first graphic indicator at the first location in the user interface displayed via the display generation component is abandoned.

45. The computer-readable storage medium according to any one of claims 28 to 30, wherein the fingerprint sensor is part of a button in the computer system, and wherein the one or more programs further include instructions for: In response to the detection of the input: Based on the determination that the input includes the activation of the button for a duration less than the activation duration and that the display generation component is in a low-power state, the display generation component is switched from the low-power state to a higher-power state.

46. ​​The computer-readable storage medium of any one of claims 28 to 30, wherein the fingerprint sensor is part of a button in the computer system, and wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes activation of the button for a duration less than the activation duration and that the display generation component is not in a low-power state, the display generation component is switched to the low-power state.

47. The computer-readable storage medium of any one of claims 28 to 30, wherein the fingerprint sensor is part of a button in the computer system, and wherein the one or more programs further include instructions for: In response to the detection of the input: The virtual assistant is invoked based on the determination that the input includes the activation of the button for a duration greater than the activation duration.

48. The computer-readable storage medium according to any one of claims 28 to 30, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the computer system is in an unlocked state and that the input includes touching the fingerprint sensor to a value greater than the input threshold, regardless of whether the fingerprint input detected by the fingerprint sensor matches one or more registered fingers, the second user interface is displayed via the display generation component.

49. The computer-readable storage medium according to any one of claims 28 to 30, wherein the one or more programs further include instructions for: Before the input is detected: Based on the determination that the computer system is in a locked state, a visual indication of the location of the fingerprint sensor on the computer system is displayed via the display generation component.

50. The computer-readable storage medium of claim 49, wherein the one or more programs further include instructions for: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display of the visual indication of the location of the fingerprint sensor via the display generation component is replaced with a threshold indicator indicating a progression toward reaching the input threshold.

51. The computer-readable storage medium according to any one of claims 28 to 30, wherein the one or more programs further include instructions for performing the following operations: After starting to detect the input, stop detecting the input; and In response to stop detecting the input: Based on the determination that the input has not reached the input threshold, the progress toward reaching the input threshold is reset.

52. The computer-readable storage medium according to any one of claims 28 to 30, wherein the one or more programs further include instructions for performing the following operations: Detecting multiple finger touches during a locked session that do not include fingerprint information matching one or more registered fingers; and In response to the detection of multiple finger touches during the locked session that do not include fingerprint information matching the one or more registered fingers, a password entry user interface is displayed via the display generation component.

53. A computer system, the computer system comprising: Fingerprint sensor; Display generated components; One or more processors; and The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: Detecting input directed at the fingerprint sensor; and In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and that the input is less than an input threshold, a wake-up screen in an unlocked state is displayed via the display generation component; as well as Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers and that the input is greater than the input threshold, a second user interface is displayed via the display generation component, wherein the second user interface is different from the wake-up screen in the unlocked state.

54. The computer system of claim 53, wherein the second user interface is an application user interface.

55. The computer system of claim 53, wherein the second user interface comprises a plurality of icons corresponding to a plurality of applications, and wherein the one or more programs further comprises instructions for performing the following operations: When the second user interface is displayed, a selection of one of the plurality of icons is received; and In response to receiving a selection of the icon, the application user interface corresponding to the icon is displayed.

56. The computer system according to any one of claims 53 to 55, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that does not match the one or more registered fingers, the wake-up screen in a locked state is displayed via the display generation component.

57. The computer system of claim 56, wherein the one or more programs further include instructions for performing the following operations: Based on the determination that the computer system is in a first orientation, a visual indication requiring fingerprint authentication is displayed at a first location via the display generation component as part of the wake-up screen in the locked state; and Based on the determination that the computer system is in a second orientation different from the first orientation, a visual indication requiring fingerprint authentication is displayed via the display generation component at a second location different from the first location as part of the wake-up screen in the locked state.

58. The computer system according to any one of claims 53 to 55, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display on the wake-up screen via the display generation component is updated to indicate that the computer system is in an unlocked state.

59. The computer system of claim 58, wherein updating the display of the wake-up screen via the display generation component to indicate that the computer system is in an unlocked state comprises: Change the appearance of the lock indicator from locked to unlocked.

60. The computer system of claim 58, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display on the wake-up screen via the display generation component is updated to include the security content of the displayed notification.

61. The computer system of claim 58, wherein updating the display of the wake-up screen to indicate that the computer system is unlocked occurs simultaneously with displaying a threshold indicator, the threshold indicator indicating progress toward reaching the input threshold by visually changing across the threshold indicator over time, the progress of the visual change corresponding to the progress toward reaching the input threshold.

62. The computer system according to any one of claims 53 to 55, wherein the one or more programs further include instructions for performing the following operations: When the input is detected directed at the fingerprint sensor, a threshold indicator is displayed indicating the progress toward reaching the input threshold; and As input to the fingerprint sensor continues to be detected, the threshold indicator is updated over time to indicate progress toward reaching the input threshold.

63. The computer system of claim 62, wherein the threshold indicator displaying a progression toward reaching the input threshold comprises: Based on determining that the computer system is in a first orientation, the threshold indicator is displayed at a first position in the user interface displayed via the display generation component; as well as Based on the determination that the computer system is in a second orientation different from the first orientation, the threshold indicator is displayed at a second position different from the first position in the user interface displayed via the display generation component.

64. The computer system of claim 62, wherein the one or more programs further include instructions for performing the following operations: While displaying the threshold indicator showing a progression toward reaching the input threshold, the end of the input directed at the fingerprint sensor is detected; and In response to the detection of the end of the input directed at the fingerprint sensor before reaching the input threshold, the threshold indicator is updated over time to indicate that progress toward reaching the input threshold has stopped.

65. The computer system of claim 62, wherein the one or more programs further include instructions for performing the following operations: While displaying the threshold indicator showing a progression toward reaching the input threshold, the end of the input directed at the fingerprint sensor is detected; and The end in response to detecting the input directed at the fingerprint sensor: After the end of the input is detected, the threshold indicator continues to be displayed for a predetermined time; and After the threshold indicator has been displayed for the predetermined time, the display of the threshold indicator shall be stopped.

66. The computer system of claim 62, wherein the threshold indicator is a text string, and wherein the visual properties of the text string are sequentially updated over time to indicate progress toward reaching the input threshold.

67. The computer system according to any one of claims 53 to 55, wherein: Based on the determination that the input was detected when the display generating component was in a low-power state, the input threshold is a first time threshold; as well as Based on the determination that the input was detected when the display generating component was not in a low-power state, the input threshold is a second time threshold that is different from the first time threshold.

68. The computer system according to any one of claims 53 to 55, wherein: The input threshold is a first time threshold, which is determined to be detected when one or more unread notifications are available for display. as well as The input threshold is a second time threshold that is different from the first time threshold, based on the determination that the input was detected when the unread notification was not available for display.

69. The computer system of claim 68, wherein the one or more programs further include instructions for performing the following operations: While continuing to detect the input and before the input exceeds the input threshold: Based on determining that one or more unread notifications are available for display, a first graphical indicator is displayed at a first location in the user interface displayed via the display generation component; and Based on the determination that the unread notification is not available for display, the display of the first graphic indicator at the first location in the user interface displayed via the display generation component is abandoned.

70. The computer system according to any one of claims 53 to 55, wherein the fingerprint sensor is part of a button of the computer system, and wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes the activation of the button for a duration less than the activation duration and that the display generation component is in a low-power state, the display generation component is switched from the low-power state to a higher-power state.

71. The computer system according to any one of claims 53 to 55, wherein the fingerprint sensor is part of a button of the computer system, and wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes activation of the button for a duration less than the activation duration and that the display generation component is not in a low-power state, the display generation component is switched to the low-power state.

72. The computer system according to any one of claims 53 to 55, wherein the fingerprint sensor is part of a button of the computer system, and wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: The virtual assistant is invoked based on the determination that the input includes the activation of the button for a duration greater than the activation duration.

73. The computer system according to any one of claims 53 to 55, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the computer system is in an unlocked state and that the input includes touching the fingerprint sensor to a value greater than the input threshold, regardless of whether the fingerprint input detected by the fingerprint sensor matches one or more registered fingers, the second user interface is displayed via the display generation component.

74. The computer system according to any one of claims 53 to 55, wherein the one or more programs further include instructions for performing the following operations: Before the input is detected: Based on the determination that the computer system is in a locked state, a visual indication of the location of the fingerprint sensor on the computer system is displayed via the display generation component.

75. The computer system of claim 74, wherein the one or more programs further include instructions for performing the following operations: In response to the detection of the input: Based on the determination that the input includes fingerprint information detected by the fingerprint sensor that matches one or more registered fingers, the display of the visual indication of the location of the fingerprint sensor via the display generation component is replaced with a threshold indicator indicating a progression toward reaching the input threshold.

76. The computer system according to any one of claims 53 to 55, wherein the one or more programs further include instructions for performing the following operations: After starting to detect the input, stop detecting the input; and In response to stop detecting the input: Based on the determination that the input has not reached the input threshold, the progress toward reaching the input threshold is reset.

77. The computer system according to any one of claims 53 to 55, wherein the one or more programs further include instructions for performing the following operations: Detecting multiple finger touches during a locked session that do not include fingerprint information matching one or more registered fingers; and In response to the detection of multiple finger touches during the locked session that do not include fingerprint information matching the one or more registered fingers, a password entry user interface is displayed via the display generation component.

Images