User interface for easier operation
By dynamically adapting user interface elements based on hardware configurations and input conditions, the methods enhance efficiency and reduce power consumption in electronic devices, addressing the inefficiencies of existing interfaces.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- APPLE INC
- Filing Date
- 2026-02-16
- Publication Date
- 2026-06-23
AI Technical Summary
Existing user interfaces for electronic devices are cumbersome and inefficient, often requiring multiple key presses or keystrokes, wasting time and energy, particularly in battery-operated devices, and lacking in cognitive efficiency and power conservation.
The implementation of methods and interfaces that dynamically display and hide graphical user interface objects based on hardware input device configurations and user input conditions, optimizing operations and reducing unnecessary power consumption.
Faster and more efficient user interactions are achieved, reducing cognitive burden, improving security, and extending battery life by minimizing redundant inputs and optimizing power usage.
Smart Images

Figure 2026102562000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to computer user interfaces and, more particularly, to techniques for facilitating operations.
Background Art
[0002] An electronic device includes input control that enables the electronic device to perform operations in response to detecting user input. For example, an electronic device can include hardware devices that can display visual elements and / or cause the electronic device to perform individual operations when selection and / or interaction occurs. The electronic device can also display notifications to the user. The electronic device also includes various operating modes that enable the electronic device to conserve battery power.
Summary of the Invention
[0003] Some techniques for facilitating operations by an electronic device are generally cumbersome and inefficient. For example, some existing techniques use complex and time-consuming user interfaces that may involve multiple key presses or keystrokes. Existing techniques take more time than necessary and waste the user's time and the device's energy. This latter consideration is particularly important in battery-operated devices.
[0004] Therefore, the present technology provides faster and more efficient methods and interfaces for an electronic device to facilitate operations. Such methods and interfaces optionally complement or replace other methods for facilitating operations. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. Further, such methods and interfaces can also improve the security features of the electronic device. In the case of battery-operated computing devices, such methods and interfaces conserve power and increase the battery charging interval.
[0005] A method is described according to several embodiments. The method is performed in a computer system communicating with a display generation component and one or more hardware input devices. The method includes: detecting the occurrence of a condition associated with displaying a first user interface associated with a first operation; and, in response to detecting the occurrence of the condition, displaying a graphical user interface object via the display generation component indicating that the first hardware input device can perform a first operation, while the first user interface is being displayed, according to a determination that the first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform a first operation; and ceasing to display the graphical user interface object indicating that the first hardware input device can perform a first operation, according to a determination that the first hardware input device among the one or more hardware input devices is not configured in a first configuration that enables the first hardware input device to perform a first operation.
[0006] According to some embodiments, a non-temporary computer-readable storage medium is described. The non-temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generating component and one or more hardware input devices, the one or more programs include instructions for displaying a first user interface, which include detecting the occurrence of a condition associated with displaying a first user interface associated with a first operation, and in response to detecting the occurrence of the condition, displaying a graphical user interface object via the display generating component indicating that the first hardware input device can perform a first operation, in accordance with a determination that the first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform a first operation, and ceasing to display the graphical user interface object indicating that the first hardware input device can perform a first operation, in accordance with a determination that the first hardware input device among the one or more hardware input devices is not configured in a first configuration that enables the first hardware input device to perform a first operation.
[0007] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generating component and one or more hardware input devices, the one or more programs include instructions for displaying a first user interface, which include detecting the occurrence of a condition associated with displaying a first user interface associated with a first operation, and in response to detecting the occurrence of the condition, displaying a graphical user interface object via the display generating component indicating that the first hardware input device can perform a first operation, in accordance with a determination that the first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform a first operation, and ceasing to display the graphical user interface object indicating that the first hardware input device can perform a first operation, in accordance with a determination that the first hardware input device among the one or more hardware input devices is not configured in a first configuration that enables the first hardware input device to perform a first operation.
[0008] A computer system is described according to several embodiments. The computer system communicates with a display generation component and one or more hardware input devices. The computer system comprises one or more processors and a memory storing one or more programs configured to be executed by one or more processors, the one or more programs including instructions for displaying a first user interface, which include detecting the occurrence of a condition associated with displaying a first user interface associated with a first operation, and in response to detecting the occurrence of the condition, displaying a graphical user interface object via the display generation component indicating that the first hardware input device can perform a first operation, in accordance with a determination that the first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform a first operation, and ceasing to display the graphical user interface object indicating that the first hardware input device can perform a first operation, in accordance with a determination that the first hardware input device among the one or more hardware input devices is not configured in a first configuration that enables the first hardware input device to perform a first operation.
[0009] A computer system is described according to several embodiments. The computer system communicates with a display generation component and one or more hardware input devices. The computer system includes means for detecting the occurrence of a condition associated with displaying a first user interface associated with a first operation, and means for displaying the first user interface, which, in response to detecting the occurrence of the condition, displays a graphical user interface object via the display generation component indicating that the first hardware input device can perform a first operation, while the first user interface is being displayed, according to a determination that the first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform a first operation, and discontinues displaying the graphical user interface object indicating that the first hardware input device can perform a first operation, according to a determination that the first hardware input device among the one or more hardware input devices is not configured in a first configuration that enables the first hardware input device to perform a first operation.
[0010] According to some embodiments, a computer program product is described. The computer program product stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, and includes instructions for displaying a first user interface, which include detecting the occurrence of a condition associated with displaying a first user interface associated with a first operation, and in response to detecting the occurrence of the condition, displaying a graphical user interface object via the display generation component indicating that the first hardware input device can perform a first operation, in accordance with a determination that the first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform a first operation, and ceasing to display the graphical user interface object indicating that the first hardware input device can perform a first operation, in accordance with a determination that the first hardware input device among the one or more hardware input devices is not configured in a first configuration that enables the first hardware input device to perform a first operation.
[0011] A method is described according to several embodiments. The method is performed in a computer system communicating with a display generation component and one or more hardware input devices. The method includes detecting user input corresponding to a first hardware input device among one or more hardware input devices; displaying a first indication of a first operation configured to be performed by the first hardware input device via the display generation component in response to the detection of user input; detecting the end of user input after displaying the first indication of the first operation; performing a first operation in response to the detection of the end of user input, in accordance with the determination that the end of user input was detected while the first indication was being displayed; and ceasing to perform the first operation in accordance with the determination that the end of user input was detected after displaying the first indication and then ceasing to display the first indication.
[0012] According to some embodiments, a non-temporary computer-readable storage medium is described. The non-temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, the one or more programs include instructions for detecting user input corresponding to a first hardware input device of one or more hardware input devices, displaying a first indication of a first operation configured to be performed by the first hardware input device via the display generation component in response to the detection of user input, detecting the end of user input after displaying the first indication of the first operation, and executing a first operation and displaying the first indication in response to the detection of the end of user input, in accordance with the determination that the end of user input was detected while the first indication was being displayed, and then ceasing to execute the first operation in accordance with the determination that the end of user input was detected after ceasing to display the first indication.
[0013] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, the one or more programs include instructions for detecting user input corresponding to a first hardware input device of one or more hardware input devices, displaying a first indication of a first operation configured to be performed by the first hardware input device via the display generation component in response to the detection of user input, detecting the end of user input after displaying the first indication of the first operation, and executing a first operation and displaying the first indication in response to the detection of the end of user input, in accordance with the determination that the end of user input was detected while the first indication was being displayed, and then ceasing to execute the first operation in accordance with the determination that the end of user input was detected after ceasing to display the first indication.
[0014] According to several embodiments, a computer system is described. The computer system communicates with a display generation component and one or more hardware input devices. The computer system includes one or more processors and a memory that stores one or more programs configured to be executed by one or more processors, the one or more programs including instructions for detecting user input corresponding to a first hardware input device among one or more hardware input devices, displaying a first indication of a first operation configured to be performed by the first hardware input device via the display generation component in response to the detection of user input, detecting the end of user input after displaying the first indication of the first operation, and executing a first operation and displaying the first indication in response to the detection of the end of user input, in accordance with the determination that the end of user input was detected while the first indication was being displayed, and then ceasing to execute the first operation in accordance with the determination that the end of user input was detected after ceasing to display the first indication.
[0015] A computer system is described according to several embodiments. The computer system communicates with a display generation component and one or more hardware input devices. The computer system includes means for detecting user input corresponding to a first hardware input device among one or more hardware input devices; means for displaying a first indication of a first operation configured to be performed by the first hardware input device via the display generation component in response to the detection of user input; means for detecting the end of user input after displaying the first indication of the first operation; means for executing a first operation in response to the detection of the end of user input, in accordance with the determination that the end of user input was detected while the first indication was being displayed; and means for displaying the first indication, then stopping the display of the first indication, and then ceasing to execute the first operation in accordance with the determination that the end of user input was detected.
[0016] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, the one or more programs including instructions to detect user input corresponding to a first hardware input device among the one or more hardware input devices, to display a first indication of a first operation configured to be performed by the first hardware input device via the display generation component in response to the detection of user input, to detect the end of user input after displaying the first indication of the first operation, to execute a first operation and display the first indication in response to the detection of the end of user input, to stop displaying the first indication and then to stop executing the first operation in response to the determination that the end of user input has been detected.
[0017] A method is described according to several embodiments. The method is performed on a computer system that communicates with a display generation component. The method includes detecting the occurrence of an event and, in response to detecting the occurrence of the event, displaying a notification corresponding to the event, which includes, via the display generation component, a first notification corresponding to the event, which obscures a first amount of display area used to display a user interface before the display of the first notification, in accordance with a determination that the computer system meets one or more separate sets of criteria indicating that user input is occurring or is likely to occur, and a second notification corresponding to the event, which obscures a second amount greater than the first amount of a second amount of display area used to display a user interface before the display of the second notification, in accordance with a determination that the computer system does not meet one or more separate sets of criteria indicating that user input is occurring or is likely to occur.
[0018] According to some embodiments, a non-temporary computer-readable storage medium is described. The non-temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generating component, and includes instructions for displaying event-responding notifications, which include: detecting the occurrence of an event and, in response to detecting the occurrence of an event, displaying a first notification corresponding to an event via the display generating component, in accordance with a determination that the computer system meets one or more separate sets of criteria indicating that user input is occurring or is likely to occur, the first notification covering a first amount of display area used to display a user interface before the display of the first notification; and displaying a second notification corresponding to an event via the display generating component, in accordance with a determination that the computer system does not meet one or more separate sets of criteria indicating that user input is occurring or is likely to occur, the second notification covering a second amount of display area used to display a user interface before the display of the second notification, the second notification covering a second amount of display area greater than the first amount.
[0019] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generating component, and includes instructions for displaying event-responding notifications, which include: detecting the occurrence of an event and, in response to detecting the occurrence of an event, displaying a first notification corresponding to an event via the display generating component, in accordance with a determination that the computer system meets one or more separate sets of criteria indicating that user input is occurring or is likely to occur, the first notification covering a first amount of display area used to display a user interface before the display of the first notification; and displaying a second notification corresponding to an event via the display generating component, in accordance with a determination that the computer system does not meet one or more separate sets of criteria indicating that user input is occurring or is likely to occur, the second notification covering a second amount of display area used to display a user interface before the display of the second notification, the second notification covering a second amount of display area greater than the first amount.
[0020] According to several embodiments, a computer system is described. The computer system communicates with a display generation component. The computer system comprises one or more processors and a memory storing one or more programs configured to be executed by the one or more processors, and includes an instruction to display an event-responding notification, which includes: one or more programs detecting the occurrence of an event and, in response to detecting the occurrence of an event, the computer system displays a first notification corresponding to the event, which obscures a first amount of display area used to display a user interface before the display of the first notification, in accordance with a determination that the computer system satisfies one or more separate sets of criteria indicating that user input is occurring or is likely to occur, via the display generation component; and a second notification corresponding to the event, which obscures a second amount of a second amount of display area used to display a user interface before the display of the second notification, which is greater than the first amount, in accordance with a determination that the computer system does not satisfy one or more separate sets of criteria indicating that user input is occurring or is likely to occur.
[0021] According to several embodiments, a computer system is described. The computer system communicates with a display generation component. The computer system includes means for detecting the occurrence of an event, and means for displaying a notification corresponding to the event in response to the detection of the occurrence of the event, the means for displaying a first notification corresponding to the event, via the display generation component, in accordance with a determination that the computer system satisfies one or more separate sets of criteria indicating that user input is occurring or is likely to occur, and for displaying a second notification corresponding to the event, via the display generation component, in accordance with a determination that the computer system does not satisfy one or more separate sets of criteria indicating that user input is occurring or is likely to occur, and for displaying a second notification corresponding to the event, via the display generation component, in accordance with a determination that the computer system does not satisfy one or more separate sets of criteria indicating that user input is occurring or is likely to occur, and for displaying a second notification, which covers a second amount of a second amount of display area used to display the user interface before the display of the second notification, that is greater than the first amount.
[0022] According to some embodiments, a computer program product is described. The computer program product stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component, and includes instructions for displaying notifications corresponding to an event, which include: detecting the occurrence of an event and, in response to detecting the occurrence of an event, displaying a first notification corresponding to an event via the display generation component, in accordance with a determination that the computer system meets one or more separate sets of criteria indicating that user input is occurring or is likely to occur, the first notification covering a first amount of display area used to display a user interface before the display of the first notification; and displaying a second notification corresponding to an event via the display generation component, in accordance with a determination that the computer system does not meet one or more separate sets of criteria indicating that user input is occurring or is likely to occur, the second notification covering a second amount of display area used to display a user interface before the display of the second notification, the second notification covering a second amount of display area greater than the first amount.
[0023] A method is described according to several embodiments. The method is performed on a computer system communicating with an audio output device. The method includes detecting an event while outputting audio corresponding to an emergency siren via the audio output device; adjusting the output of the audio corresponding to the emergency siren while the computer system performs a first action associated with the event, in accordance with the determination that the event is of a first type, and maintaining the output of the audio corresponding to the emergency siren while the computer system performs a second action associated with the event, in accordance with the determination that the event is of a second type different from the first type.
[0024] According to some embodiments, a non-temporary computer-readable storage medium is described. The non-temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with an audio output device, the one or more programs include instructions for detecting an event while outputting audio corresponding to an emergency siren via the audio output device, adjusting the output of the audio corresponding to the emergency siren while the computer system performs a first action associated with the event in accordance with the determination that the event is of a first type, and maintaining the output of the audio corresponding to the emergency siren while the computer system performs a second action associated with the event in accordance with the determination that the event is of a second type different from the first type.
[0025] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with an audio output device, the one or more programs include instructions for detecting an event while outputting audio corresponding to an emergency siren via the audio output device, adjusting the output of the audio corresponding to the emergency siren while the computer system performs a first action associated with the event in accordance with the determination that the event is of a first type, and maintaining the output of the audio corresponding to the emergency siren while the computer system performs a second action associated with the event in accordance with the determination that the event is of a second type different from the first type.
[0026] According to several embodiments, a computer system is described. The computer system communicates with an audio output device. The computer system comprises one or more processors and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for detecting an event while outputting audio corresponding to an emergency siren via the audio output device, adjusting the output of the audio corresponding to the emergency siren while the computer system performs a first action associated with the event according to a determination that the event is of a first type, and maintaining the output of the audio corresponding to the emergency siren while the computer system performs a second action associated with the event according to a determination that the event is of a second type different from the first type.
[0027] According to several embodiments, a computer system is described. The computer system communicates with an audio output device. The computer system includes means for detecting an event while outputting audio corresponding to an emergency siren via the audio output device; means for adjusting the output of the audio corresponding to the emergency siren while the computer system performs a first action associated with the event in accordance with the determination that the event is of a first type, and means for maintaining the output of the audio corresponding to the emergency siren while the computer system performs a second action associated with the event in accordance with the determination that the event is of a second type different from the first type.
[0028] According to some embodiments, a computer program product is described. The computer program product stores one or more programs configured to be executed by one or more processors of a computer system in communication with an audio output device, the one or more programs detecting an event while outputting audio corresponding to an emergency siren via the audio output device, and in response to detecting the event, adjusting the output of the audio corresponding to the emergency siren while the computer system executes a first operation associated with the event according to a determination that the event is of a first type, and maintaining the output of the audio corresponding to the emergency siren while the computer system executes a second operation associated with the event according to a determination that the event is of a second type different from the first type, including instructions.
[0029] According to some embodiments, a method is described. The method is executed in a computer system in communication with a display generation component and one or more sensors. The method includes detecting a user input corresponding to a request to execute a first operation associated with the one or more sensors, and based on a first set of one or more sensor measurements from the one or more sensors, executing the first operation regardless of whether the computer system is in a first operation mode or a second operation mode that is a lower power operation mode than the first operation mode in response to detecting the user input, monitoring a second set of one or more sensor measurements from the one or more sensors while the computer system is operating in the first operation mode, and executing a second operation based on the second set of one or more sensor measurements from the one or more sensors according to a determination that an individual condition has occurred, detecting the occurrence of an event corresponding to a transition of the computer system from the first operation mode to the second operation mode, and in response to detecting the occurrence of the event, stopping monitoring the sensor measurements from the one or more sensors and disabling the ability of the computer system to execute the second operation based on the sensor measurements from the one or more sensors if the individual condition has occurred.
[0030] According to some embodiments, a non - transitory computer - readable storage medium is described. The non - transitory computer - readable storage medium includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors. The one or more programs detect user input corresponding to a request to perform a first operation associated with the one or more sensors, and in response to detecting the user input, based on a first set of one or more sensor measurements from the one or more sensors, perform the first operation regardless of whether the computer system is in a first operation mode or in a second operation mode that is a lower - power operation mode than the first operation mode. While the computer system is operating in the first operation mode, monitor a second set of one or more sensor measurements from the one or more sensors, and in accordance with a determination that an individual condition has occurred, perform a second operation based on the second set of one or more sensor measurements from the one or more sensors, detect the occurrence of an event corresponding to the transition of the computer system from the first operation mode to the second operation mode, and in response to detecting the occurrence of the event, stop monitoring the sensor measurements from the one or more sensors, and if an individual condition has occurred, disable the computer's ability to perform the second operation based on the sensor measurements from the one or more sensors, including instructions.
[0031] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium includes one or more programs configured to be executed by one or more processors of a computer system communicating with a display generating component and one or more sensors, the one or more programs including instructions to detect user input in response to a request to perform a first operation associated with one or more sensors, and in response to detecting user input, to perform a first operation based on one or more sensor measurements of a first set from one or more sensors, regardless of whether the computer system is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode, the computer system monitors one or more sensor measurements of a second set from one or more sensors while operating in the first operating mode, and in response to a determination that a particular condition has occurred, to perform a second operation based on one or more sensor measurements of a second set from one or more sensors, the computer system includes instructions to detect the occurrence of an event corresponding to a transition of the computer system from the first operating mode to the second operating mode, and in response to detecting the occurrence of an event, to stop monitoring sensor measurements from one or more sensors, and to disable the computer system's ability to perform a second operation based on sensor measurements from one or more sensors if a particular condition has occurred.
[0032] According to several embodiments, a computer system is described. The computer system communicates with a display generation component and one or more sensors. The computer system includes one or more processors and a memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for detecting user input in response to a request to perform a first operation associated with one or more sensors, and in response to detecting user input, performing a first operation based on one or more sensor measurements of a first set from one or more sensors, regardless of whether the computer system is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode, the computer system monitoring one or more sensor measurements of a second set from one or more sensors while operating in the first operating mode, and performing a second operation based on one or more sensor measurements of a second set from one or more sensors in response to a determination that a particular condition has occurred, the computer system detecting the occurrence of an event corresponding to a transition of the computer system from the first operating mode to the second operating mode, and in response to detecting the occurrence of an event, stopping monitoring of sensor measurements from one or more sensors, and disabling the computer system's ability to perform a second operation based on sensor measurements from one or more sensors if a particular condition has occurred.
[0033] According to several embodiments, a computer system is described. The computer system communicates with a display generation component and one or more sensors. The computer system includes means for detecting user input corresponding to a request to perform a first operation associated with one or more sensors; means for performing a first operation based on one or more sensor measurements of a first set from one or more sensors, regardless of whether the computer system is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode, in response to detecting the user input; means for monitoring one or more sensor measurements of a second set from one or more sensors while the computer system is operating in the first operating mode, and performing a second operation based on one or more sensor measurements of a second set from one or more sensors, in accordance with a determination that a specific condition has occurred; means for detecting the occurrence of an event corresponding to a transition of the computer system from the first operating mode to the second operating mode; and means for stopping monitoring of sensor measurements from one or more sensors and disabling the computer system's ability to perform a second operation based on sensor measurements from one or more sensors, in case a specific condition has occurred, in response to detecting the occurrence of an event.
[0034] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more sensors, the one or more programs including instructions to detect user input in response to a request to perform a first operation associated with one or more sensors, and in response to detecting user input, to perform a first operation based on one or more sensor measurements of a first set from one or more sensors, regardless of whether the computer system is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode, the computer system monitors one or more sensor measurements of a second set from one or more sensors while operating in the first operating mode, and in response to a determination that a particular condition has occurred, to perform a second operation based on one or more sensor measurements of a second set from one or more sensors, the computer system includes instructions to detect the occurrence of an event corresponding to a transition of the computer system from the first operating mode to the second operating mode, and in response to detecting the occurrence of an event, to stop monitoring sensor measurements from one or more sensors, and to disable the computer system's ability to perform a second operation based on sensor measurements from one or more sensors if a particular condition has occurred.
[0035] The executable instructions that perform these functions are optionally contained within a non-temporary computer-readable storage medium or other computer program product configured to be executed by one or more processors.
[0036] Therefore, faster and more efficient methods and interfaces for operation are provided to the device, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices. Such methods and interfaces can complement or replace other methods for operation. [Brief explanation of the drawing]
[0037] To better understand the various embodiments described, the following “Modes for Carrying Out the Invention” should be referenced in conjunction with the following drawings, and similar reference numbers throughout the following drawings refer to the corresponding parts.
[0038] [Figure 1A] This is a block diagram showing a portable multifunctional device with a touch-sensitive display, according to several embodiments.
[0039] [Figure 1B] This is a block diagram showing exemplary components for event handling according to several embodiments.
[0040] [Figure 2] This figure shows a portable multifunctional device having a touchscreen, according to several embodiments.
[0041] [Figure 3] This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface, according to several embodiments.
[0042] [Figure 4A] The following are exemplary user interfaces for application menus on a portable multifunction device, according to several embodiments.
[0043] [Figure 4B] This document illustrates an exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display, according to several embodiments.
[0044] [Figure 5A] A personal electronic device according to several embodiments is shown.
[0045] [Figure 5B] This is a block diagram showing a personal electronic device according to several embodiments.
[0046] [Figure 6A] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6B] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6C] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6D] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6E] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6F] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6G] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6H] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6I] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6J] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6K] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6L] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6M] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6N] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. [Figure 6O] The following are exemplary user interfaces that provide guidance on starting the operation, according to several embodiments.
[0047] [Figure 7] This flowchart illustrates a method for providing instructions regarding the start of operation, according to several embodiments.
[0048] [Figure 8A] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8B] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8C] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8D] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8E] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8F] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8G] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8H] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8I] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8J] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8K] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8L] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8M] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8N] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8O] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8P] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8Q] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8R] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8S] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8T]The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8U] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8V] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. [Figure 8W] The following are exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments.
[0049] [Figure 9] This is a flowchart illustrating a method for performing a first operation according to several embodiments.
[0050] [Figure 10] This flowchart illustrates a method for adjusting the audio output of an emergency operation according to several embodiments.
[0051] [Figure 11A] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11B] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11C] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11D] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11E] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11F] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11G]The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11H] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11I] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11J] The following are exemplary user interfaces for displaying notifications according to several embodiments. [Figure 11K] The following are exemplary user interfaces for displaying notifications according to several embodiments.
[0052] [Figure 12] This flowchart illustrates how to display a notification according to several embodiments.
[0053] [Figure 13A] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13B] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13C] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13D] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13E] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13F] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13G] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13H] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13I] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13J] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13K] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13L] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13M] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13N] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13O] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13P] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13Q] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13R] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13S] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13T] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown. [Figure 13U] An exemplary user interface for a low-power operation mode, according to several embodiments, is shown.
[0054] [Figure 14]A flowchart illustrating a method for performing operations in low-power operation mode according to several embodiments. [Modes for carrying out the invention]
[0055] The following description includes exemplary methods, parameters, etc. However, it should be noted that such descriptions are not intended to limit the scope of this disclosure, but rather are provided to describe exemplary embodiments.
[0056] There is a need for electronic devices that provide efficient methods and interfaces to facilitate operation. For example, there is a need for electronic devices that teach and / or guide the user of the functions of an electronic device that perform actions in response to shortcut user input. There is also a need for electronic devices that perform various actions in response to user input corresponding to hardware input devices. Furthermore, there is a need for electronic devices that display notifications without interrupting user interaction with the electronic device. In addition, there is a need for electronic devices that can adjust the output of safety and / or emergency functions so that the user can continue to interact with the electronic device while requesting assistance through safety and / or emergency functions. Furthermore, there is a need for electronic devices that can disable operations such as background processing in low-power mode, but can still perform one or more actions in response to user requests. Such technologies can reduce the cognitive burden on the user performing the actions, thereby improving productivity. In addition, such technologies can reduce the power of the processor and battery that would normally be wasted on redundant user input.
[0057] Figures 1A-1B, 2, 3, 4A-4B, and 5A-5B below provide a description of exemplary devices for performing techniques to facilitate operation. Figures 6A-6O show exemplary user interfaces for guiding the user to start an operation. Figure 7 is a flowchart showing a method for guiding the user to start an operation according to one embodiment. The user interfaces in Figures 6A-6O are used to illustrate a later process, including the process in Figure 7. Figures 8A-8W show exemplary user interfaces for starting a first operation and / or emergency operation. Figure 9 is a flowchart showing a method for performing a first operation according to one embodiment. Figure 10 is a flowchart showing a method for adjusting the audio output of an emergency operation according to one embodiment. The user interfaces in Figures 8A-8W are used to illustrate a later process, including the process in Figures 9-10. Figures 11A-11K show exemplary user interfaces for displaying notifications. Figure 12 is a flowchart showing a method for displaying notifications according to one embodiment. The user interfaces in Figures 11A to 11K are used to illustrate the processes described later, including the process in Figure 12. Figures 13A to 13U show exemplary user interfaces for low-power operation modes. Figure 14 is a flowchart illustrating how to perform operations in low-power operation modes according to several embodiments. The user interfaces in Figures 13A to 13U are used to illustrate the processes described later, including the process in Figure 14.
[0058] The processes described below improve the usability of the device and streamline the user-device interface by providing users with improved visual feedback, reducing the number of inputs required to perform actions, offering additional control options without cluttering the user interface with additional displayed controls, performing actions without requiring further user input when a set of conditions is met, thereby improving the safety features of the computer system, improving the battery life of the computer system, and / or additional technologies. These technologies also reduce power consumption and improve the battery life of the device by enabling users to use the device more quickly and efficiently.
[0059] Furthermore, in any method described herein where one or more steps are conditional on one or more conditions being met, it should be understood that the method can be repeated many times in various iterations of the method such that all the conditions of the conditional steps of the method are met in the iteration. For example, if a method requires that a first step be performed if a condition is met, and a second step be performed if the condition is not met, a person skilled in the art will understand that the claimed steps are repeated in no particular order until the conditions are met and until they are no longer met. Thus, a method described for one or more steps that are conditional on one or more conditions being met can be rewritten as a method that is repeated until each of the conditions described in the method is met. However, this is not necessary for claims of a system or computer-readable medium that include instructions for a system or computer-readable medium to perform a conditional action based on the fact that the corresponding one or more conditions are met, and therefore the system or computer-readable medium can determine whether the conditions are met without explicitly repeating the method step until all the conditions that the method step is conditional on are met. Those skilled in the art will also understand that, as with the method using conditional steps, the method steps can be repeated as many times as necessary to ensure that the system or computer-readable storage medium has performed all conditional steps.
[0060] In the following description, terms such as “first,” “second,” etc., are used to describe various elements, but these elements should not be limited by these terms. In some embodiments, these terms are used to distinguish one element from another. For example, without departing from the scope of the various embodiments described, the first touch may be called the second touch, and similarly, the second touch may be called the first touch. In some embodiments, the first touch and the second touch are two distinct names for the same touch. In some embodiments, both the first touch and the second touch are touches, but they are not the same touch.
[0061] The terminology used in the descriptions of the various embodiments described herein is intended solely to describe specific embodiments and is not intended to be limiting. In the descriptions of the various embodiments and the accompanying claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless otherwise explicitly stated in the context. Furthermore, it should be understood that, as used herein, the term “and / or” refers to and includes any and all possible combinations of one or more of the enumerated items relating to the description. It will be further understood that, as used herein, the terms “includes,” “comprises,” and / or “comprising” specify the presence of the described features, integers, steps, actions, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, actions, elements, components, and / or groups thereof.
[0062] The phrase "if" can be interpreted, at will, depending on the context, as "when" or "upon," or "in response to determining" or "in response to detecting." Similarly, the phrases "if it is determined" or "if [a stated condition or event] is detected" can be interpreted, at will, depending on the context, as "upon determining" or "in response to determining," or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]."
[0063] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, which also includes other functions such as PDA functionality and / or music player functionality. Exemplary embodiments of portable multifunction devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Optionally, other portable electronic devices such as laptop computers or tablet computers having a touch-sensitive surface (e.g., a touchscreen display and / or touchpad) are also used. It should also be understood that in some embodiments, the device is not a portable communication device but a desktop computer having a touch-sensitive surface (e.g., a touchscreen display and / or touchpad). In some embodiments, the electronic device is a computer system communicating (e.g., via wired communication, via wireless communication) with a display generating component. The display generating component is configured to provide a visual output, such as a display via a CRT display, a display via an LED display, or a display via image projection. In some embodiments, the display generating component is integrated with the computer system. In some embodiments, the display generation component is separate from the computer system. As used herein, "display" content includes displaying content (e.g., video data rendered or decoded by the display controller 156) by transmitting data (e.g., image data or video data) via a wired or wireless connection to an integrated or external display generation component in order to visually generate the content.
[0064] The following discussion describes electronic devices including displays and touch-sensitive surfaces. However, it should be understood that electronic devices optionally include one or more other physical user interface devices such as physical keyboards, mice, and / or joysticks.
[0065] The device typically supports a variety of applications, including drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.
[0066] Various applications running on this device optionally utilize at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface, as well as the corresponding information displayed on the device, are optionally adjusted and / or modified on an application-by-application basis and / or within individual applications. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally supports a variety of applications with intuitive and transparent user interfaces for the user.
[0067] Here, we turn our attention to embodiments of portable devices having a touch-sensitive display. Figure 1A is a block diagram of a portable multifunction device 100 having a touch-sensitive display system 112 according to several embodiments. The touch-sensitive display 112 may be conveniently referred to as a “touchscreen” and may be known or referred to as a “touch-sensitive display system”. Device 100 includes a memory 102 (optionally including one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 (e.g., touch-sensitive surfaces such as the touch-sensitive display system 112 of Device 100) that detect the intensity of contact on Device 100. Device 100 optionally includes one or more tactile output generators 167 that generate tactile outputs on Device 100 (for example, on touch-sensitive surfaces such as the touch-sensitive display system 112 of Device 100 or the touchpad 355 of Device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0068] As used herein and in the claims, the term “strength” of contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of contact on the touch-sensitive surface (e.g., finger contact), or a proxy for the force or pressure of contact on the touch-sensitive surface. The strength of contact has a range of values, including at least four distinct values, and more typically, including several hundred (e.g., at least 256) distinct values. The strength of contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure forces at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated force of contact. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or variation of the contact area detected on the touch-sensing surface, the capacitance and / or variation of the touch-sensing surface adjacent to the contact, and / or the resistance and / or variation of the touch-sensing surface adjacent to the contact may optionally be used as a substitute for the force or pressure of the contact on the touch-sensing surface. In some implementations, the substitute measurement of the contact force or pressure is used directly to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some implementations, the substitute measurement of the contact force or pressure is converted into an estimate of the force or pressure, which is then used to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in units of pressure). By using the intensity of contact as an attribute of user input, it becomes possible for users to access additional device functions that might otherwise be inaccessible (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical control such as a knob or button) on reduced-size devices where the implementation area for displaying affordances is limited.
[0069] As used herein and in the claims, the term “tactile output” means a physical displacement of the device relative to its previous position, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by the user through the user’s sense of touch. For example, in a situation where the device or a component of the device is in contact with the touch-sensitive surface of the user (e.g., the user’s fingers, palm, or other part of their hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) may be optionally interpreted by the user as a “down-click” or “up-click” of a physical actuator button. In some cases, the user may feel a tactile sensation such as a “down-click” or “up-click” even when there is no movement of a physical actuator button associated with a touch-sensitive surface that is physically pressed (e.g., displaced) by the user’s action. As another example, movement of a touch-sensitive surface may be interpreted or perceived by the user as "roughness" of that surface, even if there is no change in the smoothness of the touch-sensitive surface. Such user interpretations of touch depend on the user's personal sensory perception, but there are many touch sensory perceptions common to the majority of users. Therefore, when a tactile output is described as corresponding to a user's specific sensory perception (e.g., "up-click," "down-click," "roughness"), unless otherwise stated, the generated tactile output corresponds to the physical displacement of the device or its components that produce the described sensory perception of a typical (or average) user.
[0070] It should be understood that device 100 is merely an example of a portable multifunction device, and that device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of those components. The various components shown in Figure 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or application-specific integrated circuits.
[0071] Memory 102 optionally includes high-speed random-access memory and optionally includes non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.
[0072] The peripheral interface 118 can be used to connect the device's input and output peripherals to the CPU 120 and memory 102. One or more processors 120 operate or execute various software programs and / or instruction sets (such as computer programs containing instructions) stored in memory 102 to perform various functions for device 100 and process data. In some embodiments, the peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.
[0073] The RF (radio frequency) circuit 108 transmits and receives RF signals, also known as electromagnetic signals. The RF circuit 108 converts electrical signals to electromagnetic signals or electromagnetic signals to electrical signals and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing these functions, which include, but are not limited to, antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, subscriber identity module (SIM) cards, and memory. The RF circuit 108 optionally communicates wirelessly with networks such as the Internet, also known as the World Wide Web (WWW), intranets, and / or wireless networks such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs), as well as with other devices. The RF circuit 108 optionally includes a well-known circuit for detecting a near-field communication (NFC) field using a short-range communication radio. Wireless communication is not limited to this, but optionally includes Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), and long-term evolution.Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, Email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), Instant messaging (e.g., Extensible Messaging and Presence Protocol) Using any of several communication standards, protocols, and technologies, including the XMPP protocol, the Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), the Instant Messaging and Presence Service (IMPS), and / or the Short Message Service (SMS), or any other suitable communication protocol, including a communication protocol not yet developed as of the filing date of this specification.
[0074] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral interface 118, converts this audio data into an electrical signal, and transmits this electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. The audio circuit 110 also receives the electrical signal converted from the sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits this audio data to the peripheral interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or RF circuit 108 by the peripheral interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., 212 in Figure 2). The headset jack provides an interface between the audio circuit 110 and detachable audio input / output peripherals such as output-only headphones or headsets that have both output (e.g., headphones for one or both ears) and input (e.g., a microphone).
[0075] The I / O subsystem 106 connects input / output peripherals on device 100, such as the touchscreen 112 and other input control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive electrical signals from / transmit electrical signals to other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons), dials, slider switches, joysticks, click wheels, etc. In some embodiments, one or more input controllers 160 are optionally connected to (or not connected to) one of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. One or more buttons (e.g., 208 in Figure 2) optionally include up / down buttons for volume control of speaker 111 and / or microphone 113. One or more buttons optionally include push buttons (e.g., 206 in Figure 2). In some embodiments, the electronic device is a computer system communicating with one or more input devices (e.g., via wireless communication over wired communication). In some embodiments, one or more input devices include a touch-sensitive surface (e.g., a trackpad as part of a touch-sensitive display). In some embodiments, one or more input devices include one or more camera sensors (e.g., one or more light sensors 164 and / or one or more depth camera sensors 175), for example, to track user gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, one or more input devices are integrated with the computer system. In some embodiments, one or more input devices are separate from the computer system.In some embodiments, an air gesture is a gesture detected without the user touching (or independently of) an input element that is part of the device, and is based on the movement of a part of the user's body detected via the air, including the movement of a part of the user's body relative to an absolute reference (e.g., the angle of the user's shoulders relative to the ground or the distance of the user's hands relative to the ground), the movement of a part of the user's body relative to another part of the user's body (e.g., the movement of the user's hands relative to the user's shoulders, the movement of one hand relative to the user's other hand, the movement of the user's fingers relative to another finger or part of the user's hand), and / or the absolute movement of a part of the user's body (e.g., a tap gesture involving moving a hand in a given pose by a predetermined amount and / or speed, or a shake gesture involving rotating a part of the user's body by a predetermined speed or amount).
[0076] As described in U.S. Patent Application No. 11 / 322,549, “Unlocking a Device by Performing Gestures on an Unlock Image,” filed December 23, 2005, U.S. Patent No. 7,657,849, which is incorporated herein by reference in its entirety, a quick press of a push button optionally releases the lock on the touchscreen 112, or optionally initiates a process to unlock the device using gestures on the touchscreen. A longer press of a push button (e.g., 206) optionally turns power on or off the device 100. The functionality of one or more of the buttons is optionally customizable by the user. The touchscreen 112 is used to implement virtual or soft buttons and one or more soft keyboards.
[0077] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or transmits electrical signals to the touchscreen 112. The touchscreen 112 displays a visual output to the user. This visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively, “graphics”). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.
[0078] The touchscreen 112 has a touch-sensing surface, sensor, or set of sensors that accept user input based on touch and / or tactile contact. The touchscreen 112 and the display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of contact) on the touchscreen 112 and translate the detected contact into interaction with user interface objects displayed on the touchscreen 112 (e.g., one or more soft keys, icons, web pages, or images). In an exemplary embodiment, the point of contact between the touchscreen 112 and the user corresponds to the user's finger.
[0079] The touchscreen 112 optionally uses LCD (liquid crystal display) technology, LPD (polymer light-emitting display) technology, or LED (light-emitting diode) technology, but other display technologies may also be used in other embodiments. The touchscreen 112 and the display controller 156 optionally, but not limited to, use any of a number of currently known or future-developed touch sensing technologies, including capacitive, resistive, infrared, and surface acoustic technologies, as well as other proximity sensor arrays or other elements that determine one or more points of contact with the touchscreen 112, to detect contact and any movement or interruption thereof. In exemplary embodiments, projected mutual capacitive sensing technology is used, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, California.
[0080] The touch-sensitive displays in some embodiments of the touchscreen 112 are optionally similar to the multi-touch-sensitive touchpads described in U.S. Patent No. 6,323,846 (Westerman et al.), No. 6,570,557 (Westerman et al.), and / or No. 6,677,932 (Westerman), and / or U.S. Patent Application Publication No. 2002 / 0015024(A1), which are each incorporated herein by reference in their entirety. However, the touchscreen 112 displays visual output from device 100, whereas the touch-sensitive touchpad does not provide visual output.
[0081] The touch-sensitive displays in some embodiments of the touchscreen 112 are described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, "Multipoint Touch Surface Controller"; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, "Multipoint Touchscreen"; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, "Gestures For Touch Sensitive Input Devices"; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, "Gestures For Touch Sensitive Input Devices"; (5) U.S. Patent Application No. 11 / 038,590, filed January 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive Input These are described in (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, "Virtual Input Device Placement On A Touch Screen User Interface", (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, "Operation Of A Computer With A Touch Screen Interface", (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard", and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, "Multi-Functional Hand-Held Device". All of these applications are incorporated herein by reference in their entirety.
[0082] The touchscreen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. The user optionally touches the touchscreen 112 using any suitable object or attachment such as a stylus or finger. In some embodiments, the user interface is designed to operate primarily using finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of the finger on the touchscreen. In some embodiments, the device translates coarse finger input into a precise pointer / cursor position or command to perform an action desired by the user.
[0083] In some embodiments, in addition to the touchscreen, the device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensing area of the device that, unlike the touchscreen, does not display a visual output. The touchpad is optionally a touch-sensing surface separate from the touchscreen 112 or an extension of the touch-sensing surface formed by the touchscreen.
[0084] Device 100 also includes a power system 162 that supplies power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with generating, managing, and distributing power within the portable device.
[0085] The device 100 also optionally includes one or more optical sensors 164. Figure 1A shows optical sensors coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensors 164 optionally include a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. The optical sensors 164 receive light from the environment projected through one or more lenses and convert that light into data representing an image. The optical sensors 164 work in conjunction with an imaging module 143 (also called a camera module) to optionally capture still images or video. In some embodiments, the optical sensors are located on the back of the device 100, opposite the touchscreen display 112 which is on the front of the device, so that the touchscreen display can be used as a viewfinder for acquiring still images and / or video. In some embodiments, the optical sensors are located on the front of the device so that the user's image is optionally acquired for video conferencing while the user is viewing other video conference participants on the touchscreen display. In some embodiments, the position of the light sensor 164 can be changed by the user (for example, by rotating the lens and sensor within the device housing), so that a single light sensor 164 can be used for both video conferencing and acquiring still images and / or videos, together with the touchscreen display.
[0086] Device 100 also optionally includes one or more depth camera sensors 175. Figure 1A shows a depth camera sensor coupled to a depth camera controller 169 in the I / O subsystem 106. The depth camera sensor 175 receives data from the environment to create a three-dimensional model of an object in the scene (e.g., a face) from a viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with an imaging module 143 (also called a camera module), the depth camera sensor 175 is optionally used to determine depth maps of different parts of an image captured by the imaging module 143. In some embodiments, the depth camera sensor is positioned on the front of Device 100 to optionally acquire an image of the user with depth information for video conferencing while the user views other video conference participants on a touchscreen display, and also to capture a selfie image with depth map data. In some embodiments, the depth camera sensor 175 is positioned on the back of the device, or on both the back and front of Device 100. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (for example, by rotating the lens and sensor within the device housing), so that the depth camera sensor 175, together with the touchscreen display, can be used for both video conferencing and the acquisition of still images and / or videos.
[0087] Device 100 also optionally includes one or more contact intensity sensors 165. Figure 1A shows a contact intensity sensor coupled to an intensity sensor controller 159 in the I / O subsystem 106. The contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, pressure-power sensors, optical force sensors, capacitive touch-sensing surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch-sensing surface). The contact intensity sensor 165 receives contact intensity information (e.g., pressure information, or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is positioned juxtaposed with or adjacent to a touch-sensing surface (e.g., a touch-sensing display system 112). In some embodiments, at least one contact intensity sensor is positioned on the back of Device 100, opposite the touchscreen display 112 located on the front of Device 100.
[0088] The device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows a proximity sensor 166 coupled to a peripheral interface 118. Alternatively, the proximity sensor 166 is optionally coupled to an input controller 160 in the I / O subsystem 106. The proximity sensor 166 optionally functions as described in U.S. Patent Applications 11 / 241,839, “Proximity Detector In Handheld Device,” 11 / 240,788, “Proximity Detector In Handheld Device,” 11 / 620,702, “Using Ambient Light Sensor To Augment Proximity Sensor Output,” 11 / 586,862, “Automated Response To And Sensing Of User Activity In Portable Devices,” and 11 / 638,251, “Methods And Systems For Automatic Configuration Of Peripherals,” which are all incorporated herein by reference. In some embodiments, if the multifunction device is placed near the user's ear (for example, when the user is making a phone call), the proximity sensor turns off and disables the touchscreen 112.
[0089] Device 100 also optionally includes one or more tactile output generators 167. Figure 1A shows a tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as a speaker or other audio component, and / or electromechanical devices that convert energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component that converts an electrical signal into a tactile output on the device). The contact intensity sensor 165 receives a tactile feedback generation command from the tactile feedback module 133 and generates a tactile output on device 100 that can be sensed by the user of device 100. In some embodiments, at least one tactile output generator is positioned alongside or adjacent to a touch-sensing surface (e.g., a touch-sensing display system 112) and optionally generates a tactile output by moving the touch-sensing surface vertically (e.g., inward / outward from the surface of device 100) or horizontally (e.g., forward / backward in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is positioned on the back of device 100, opposite the touchscreen display 112 which is positioned on the front of device 100.
[0090] The device 100 also optionally includes one or more accelerometers 168. Figure 1A shows an accelerometer 168 coupled to a peripheral interface 118. Alternatively, the accelerometer 168 is optionally coupled to an input controller 160 in the I / O subsystem 106. The accelerometer 168 optionally functions as described in U.S. Patent Application Publication 20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices," and U.S. Patent Application Publication 20060017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in portrait or landscape orientation based on an analysis of data received from one or more accelerometers. In addition to one or more accelerometers 168, device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for acquiring information regarding the position and orientation of device 100 (e.g., vertical or horizontal).
[0091] In some embodiments, the software components stored in memory 102 include an operating system 126, a communications module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, in some embodiments, memory 102 (Figure 1A) or 370 (Figure 3) stores device / global internal state 157, as shown in Figures 1A and 3. The device / global internal state 157 includes one or more of the following: active application state, indicating which application is active if there is an active application; display state, indicating which applications, views, or other information occupy different areas of the touchscreen display 112; sensor state, including information obtained from various sensors and input control devices 116 of the device; and location information relating to the device's position and / or orientation.
[0092] An operating system 126 (for example, an embedded operating system such as Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or VxWorks) includes various software components and / or drivers that control and manage general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitate communication between various hardware components and software components.
[0093] The communication module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to connect to other devices directly or indirectly via a network (e.g., the Internet, Wi-Fi, etc.). In some embodiments, the external ports are multi-pin (e.g., 30-pin) connectors that are the same as and / or compatible with the 30-pin connector used on iPod® (a trademark of Apple Inc.) devices.
[0094] The contact / motion module 130 optionally detects contact with the touchscreen 112 and other touch-sensitive devices (e.g., a touchpad or physical click wheel) (in cooperation with the display controller 156). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of contact and tracking movement across the touch-sensitive surface (e.g., detecting one or more events of a finger dragging), and determining whether contact has stopped (e.g., detecting a finger up event or interruption of contact). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point, represented by a series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions can be optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.
[0095] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (for example, to determine whether a user has "clicked" on an icon). In some embodiments, at least one subset of the intensity thresholds is determined according to a software parameter (for example, the intensity thresholds can be adjusted without modifying the physical hardware of device 100, rather than being determined by the activation threshold of a particular physical actuator). For example, the mouse "click" threshold for a trackpad or touchscreen display can be set to one of a range of default thresholds without modifying the trackpad or touchscreen display hardware. In addition, in some implementations, the user of the device is provided with software settings to adjust one or more of the set of intensity thresholds (for example, by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using a system-level click "intensity" parameter).
[0096] The contact / motion module 130 optionally detects gesture input from the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motion, timing, and / or intensity of the detected contact). Therefore, gestures are optionally detected by detecting a specific contact pattern. For example, detecting a finger tap gesture involves detecting a finger down event, followed by a finger up (lift-off) event at the same location (or substantially the same location) as the finger down event (e.g., the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface involves detecting a finger down event, followed by one or more finger drag events, and then a finger up (lift-off) event.
[0097] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other display, including components that change the visual effects of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). In this specification, the term “graphics” includes, but is not limited to, any object that can be displayed to the user, including characters, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0098] In some embodiments, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from an application or the like, as needed, along with coordinate data and other graphic characteristic data, specifying the graphics to be displayed, and then generates screen image data to output to the display controller 156.
[0099] The haptic feedback module 133 includes various software components for generating commands used by a tactile output generator(s) 167, and generates tactile outputs at one or more locations on the device 100 in response to interaction with the user's device 100.
[0100] The text input module 134 is optionally a component of the graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other applications that require text input).
[0101] The GPS module 135 determines the device's location and provides this information for use within various applications (for example, to the phone 138 for use in location-based dialing, to the camera 143 as picture / video metadata, and to applications that provide location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets).
[0102] Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof: ● Contact module 137 (sometimes called the address book or contact list), ●Telephone module 138, ●Video conferencing module 139, ● Email client module 140, ● Instant messaging (IM) module 141, ●Training support module 142, ● Camera module 143 for still images and / or video, ●Image management module 144, ●Video player module, ● Music player module, ● Browser module 147, ●Calendar module 148, ●Optionally, a widget module 149 may include one or more of the following: weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, other widgets obtained by the user, and user-created widgets 149-6. ●Widget creator module 150 for creating user-created widget 149-6, ● Search module 151, ●Video and music player module 152, which integrates a video player module and a music player module. ●Memo Module 153, ●Map module 154, and / or, ● Online video module 155.
[0103] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, Java-enabled applications, encryption, digital rights management, voice recognition, and voice duplication.
[0104] In conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the contact module 137 is used to manage an address book or contact list (stored, for example, in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including optionally adding names(s) to the address book, deleting names(s) from the address book, associating telephone numbers(s) or email addresses(s) or other information with names, associating images with names, categorizing and sorting names, and providing telephone numbers or email addresses to initiate and / or facilitate communication via telephone 138, video conferencing module 139, email 140, or IM 141.
[0105] The telephone module 138 works in conjunction with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134 to optionally input character sequences corresponding to telephone numbers, access one or more telephone numbers in the contact module 137, modify entered telephone numbers, dial individual telephone numbers, make calls, and disconnect and terminate calls at the end of a call. As previously mentioned, wireless communication may optionally use any of several communication standards, protocols, and technologies.
[0106] The video conferencing module 139 works in conjunction with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, light sensor 164, light sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138 to include executable commands for starting, running, and ending video conferences between the user and one or more other participants in accordance with the user's commands.
[0107] The email client module 140, in conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, includes executable commands for creating, sending, receiving, and managing emails in response to user commands. In conjunction with the image management module 144, the email client module 140 makes it extremely easy to create and send emails containing still or video images captured by the camera module 143.
[0108] The instant messaging module 141, in conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, includes executable commands for inputting character sequences corresponding to instant messages, modifying previously entered characters, sending individual instant messages (e.g., using Short Message Service (SMS) or Multimedia Message Service (MMS) protocols for telephone-based instant messaging, or XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments, such as those supported by MMS and / or Enhanced Messaging Service (EMS). In this specification, “instant messaging” refers to both telephone-based messaging (e.g., messages sent using SMS or MMS) and internet-based messaging (e.g., messages sent using XMPP, SIMPLE, or IMPS).
[0109] The training support module 142 works in conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module to create training (e.g., with time, distance, and / or calorie burn goals), communicate with training sensors (sports devices), receive training sensor data, calibrate sensors used to monitor training, select and play music for training, and includes executable commands for displaying, storing, and transmitting training data.
[0110] The camera module 143 works in conjunction with the touchscreen 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144 to include executable commands for capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.
[0111] The image management module 144 works in conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143 to include executable commands for arranging, modifying (e.g., editing), or performing other actions on still images and / or videos, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing them.
[0112] The browser module 147, in conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, includes executable commands for browsing the internet according to user commands, including searching, linking, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.
[0113] The calendar module 148 works in conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147 to include executable commands for creating, displaying, modifying, and storing a calendar and data associated with the calendar (e.g., calendar items, to-do lists, etc.) in accordance with user commands.
[0114] The widget module 149 works in conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147 to optionally download and use mini-applications (e.g., weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or mini-applications created by the user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! widget).
[0115] The widget creator module 150 works in conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147 to be used by the user to optionally create widgets (for example, to turn a user-specified portion of a web page into a widget).
[0116] The search module 151 works in conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134 to include executable commands for searching for characters, music, sounds, images, videos, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to user commands.
[0117] The video and music player module 152 works in conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147 to include executable commands that allow the user to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable commands for displaying, presenting, or otherwise playing videos (for example, on the touchscreen 112 or on an external display connected via the external port 124). In some embodiments, the device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).
[0118] The memo module 153 works in conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134 to include executable commands for creating and managing memos, to-do lists, etc., according to user commands.
[0119] The map module 154 works in conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147 to optionally receive, display, modify, and store maps and map-related data (e.g., driving directions, data on shops and other points of interest in or near a specific location, and other location-based data) in accordance with user commands.
[0120] The online video module 155, in conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, includes instructions that enable the user to access, browse, receive (e.g., by streaming and / or downloading), play (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and perform other management of online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. For further information regarding online video applications, please refer to U.S. Provisional Patent Application No. 60 / 936,562, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed June 20, 2007, and U.S. Patent Application No. 11 / 968,067, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed December 31, 2007, the entire contents of which are incorporated herein by reference.
[0121] Each of the modules and applications identified above corresponds to a set of executable instructions that perform one or more of the functions described above and the methods described in this application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not need to be implemented as separate software programs (e.g., computer programs (including instructions)), procedures, or modules; therefore, in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. For example, a video player module is optionally combined with a music player module to form a single module (e.g., the video and music player module 152 in Figure 1A). In some embodiments, memory 102 optionally stores a subset of the modules and data structures identified above. Furthermore, memory 102 optionally stores additional modules and data structures not described above.
[0122] In some embodiments, device 100 is a device in which the operation of a default set of functions in the device is performed solely via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for device 100 to operate, the number of physical input control devices (push buttons, dials, etc.) on device 100 is optionally reduced.
[0123] A default set of functions, which are performed only through the touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to the main menu, home menu, or root menu. In such embodiments, a “menu button” is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touchpad.
[0124] Figure 1B is a block diagram showing exemplary components for event processing according to several embodiments. In some embodiments, memory 102 (Figure 1A) or 370 (Figure 3) includes an event sorting unit 170 (e.g., within the operating system 126) and individual applications 136-1 (e.g., any of the aforementioned applications 137-151, 155, 380-390).
[0125] The event sorting unit 170 receives event information and determines the application 136-1 that distributes the event information, and the application view 191 of application 136-1. The event sorting unit 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates the current application view(s) displayed on the touch-sensitive display 112 when the application is active or running. In some embodiments, a device / global internal state 157 is used by the event sorting unit 170 to determine which application(s) are currently active, and the application internal state 192 is used by the event sorting unit 170 to determine the application view(s) to which the event information is distributed.
[0126] In some embodiments, the application internal state 192 includes additional information such as resume information to be used when the application 136-1 resumes execution, user interface state information that indicates or is ready to display information displayed by the application 136-1, a state queue that allows the user to return to a previous state or view of the application 136-1, and one or more redo / undo queues of previous actions performed by the user.
[0127] The event monitor 171 receives event information from the peripheral interface 118. The event information includes information about sub-events (for example, user touch as part of a multi-touch gesture on the touch-sensitive display 112). The peripheral interface 118 transmits information received from the I / O subsystem 106, or from sensors such as the proximity sensor 166, one or more accelerometers 168, and / or the microphone 113 (via the audio circuit 110). The information received by the peripheral interface 118 from the I / O subsystem 106 includes information from the touch-sensitive display 112 or the touch-sensitive surface.
[0128] In some embodiments, the event monitor 171 sends requests to the peripheral interface 118 at predetermined intervals. In response, the peripheral interface 118 transmits event information. In other embodiments, the peripheral interface 118 transmits event information only when there is a significant event (e.g., reception of input exceeding a predetermined noise threshold and / or exceeding a predetermined duration).
[0129] In some embodiments, the event sorting unit 170 also includes a hit view determination module 172 and / or an active event recognition determination module 173.
[0130] The hit view determination module 172 provides a software procedure for determining where in one or more views a sub-event occurred when the touch-sensitive display 112 is displaying two or more views. A view consists of control devices and other elements that the user can see on the display.
[0131] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of an individual application) in which a touch is detected optionally corresponds to a program level within the application's program hierarchy or view hierarchy. For example, the lowest-level view in which a touch is detected optionally refers to a hit view, and the set of events recognized as appropriate input is optionally determined at least in part based on the hit view of the initial touch that initiates a touch gesture.
[0132] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views arranged in a hierarchy, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchy from which the sub-events should be processed. In most situations, the hit view is the lowest-level view from which the initiating sub-event (e.g., the first sub-event in a sub-event sequence that forms an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source that was identified as the hit view.
[0133] The active event recognition determination module 173 determines which view(s) in the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognition determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognition determination module 173 determines that all views, including the physical location of the sub-event, are actively involved views, and therefore all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if the touch sub-event is entirely confined to an area associated with one particular view, higher-level views in the hierarchy still remain actively involved views.
[0134] The event dispatcher module 174 dispatches event information to an event recognition unit (e.g., an event recognition unit 180). In embodiments including an active event recognition unit determination module 173, the event dispatcher module 174 distributes the event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores event information acquired by individual event receiving units 182 in an event queue.
[0135] In some embodiments, the operating system 126 includes an event sorting unit 170. Alternatively, application 136-1 includes an event sorting unit 170. In yet another embodiment, the event sorting unit 170 is a standalone module or part of another module stored in memory 102, such as a contact / motion module 130.
[0136] In some embodiments, application 136-1 includes a plurality of event processing units 190 and one or more application views 191, each containing instructions for handling touch events occurring within a separate view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognition units 180. Typically, a separate application view 191 includes a plurality of event recognition units 180. In other embodiments, one or more of the event recognition units 180 are part of a separate module, such as a user interface kit or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a separate event processing unit 190 includes one or more event data 179 received from a data update unit 176, an object update unit 177, a GUI update unit 178, and / or an event sorting unit 170. The event processing unit 190 optionally uses or calls the data update unit 176, the object update unit 177, or the GUI update unit 178 to update the application's internal state 192. Alternatively, one or more of the application views 191 include one or more individual event processing units 190. In some embodiments, one or more of the data update unit 176, object update unit 177, and GUI update unit 178 are included in an individual application view 191.
[0137] Each individual event recognition unit 180 receives event information (e.g., event data 179) from the event sorting unit 170 and identifies an event from the event information. The event recognition unit 180 includes an event receiving unit 182 and an event comparison unit 184. In some embodiments, the event recognition unit 180 also includes at least a subset of metadata 183 and event distribution commands 188 (optionally including sub-event distribution commands).
[0138] The event receiving unit 182 receives event information from the event sorting unit 170. The event information includes information about sub-events, such as touches or the movement of touches. Depending on the sub-event, the event information also includes additional information, such as the position of the sub-event. When the sub-event involves the movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, an event includes the rotation of the device from one orientation to another (e.g., from portrait to landscape, or vice versa), and the event information includes corresponding information about the current orientation of the device (also called the device's orientation).
[0139] The event comparison unit 184 compares event information with a predefined definition of an event or sub-event, and based on the comparison, determines an event or sub-event, or determines or updates the state of an event or sub-event. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes definitions of events (e.g., a sequence of default sub-events), such as event 1 (187-1) and event 2 (187-2). In some embodiments, sub-events within an event (187-1 and / or 187-2) include, for example, a touch start, a touch end, a touch move, a touch cancel, and multiple touches. In one embodiment, the definition for event 1 (187-1) is a double tap on a displayed object. A double tap includes, for example, a first touch on the displayed object for a predetermined stage (touch start), a first lift-off for the predetermined stage (touch end), a second touch on the displayed object for the predetermined stage (touch start), and a second lift-off for the predetermined stage (touch end). In another embodiment, event 2(187-2) is defined as a drag on a displayed object. The drag includes, for example, a touch (or contact) on the displayed object to a predetermined stage, movement of the touch across the touch-sensitive display 112, and lift-off of the touch (end of touch). In some embodiments, the event also includes information about one or more associated event processing units 190.
[0140] In some embodiments, the event definition 186 includes event definitions for individual user interface objects. In some embodiments, the event comparison unit 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view where three user interface objects are displayed on the touch-sensitive display 112, when a touch is detected on the touch-sensitive display 112, the event comparison unit 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with an individual event processing unit 190, the event comparison unit uses the results of the hit test to determine which event processing unit 190 should be activated. For example, the event comparison unit 184 selects the sub-event and the event processing unit associated with the object that triggers the hit test.
[0141] In some embodiments, the definition of an individual event 187 also includes a delay action that delays the transmission of event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognition unit.
[0142] If an individual event recognition unit 180 determines that a series of sub-events does not match any of the events in the event definition 186, the individual event recognition unit 180 enters an event impossible, event failed, or event terminated state, and thereafter ignores subsequent sub-events of the touch-based gesture. In this situation, if there are other event recognition units that remain active for the hit view, those event recognition units continue to track and process the sub-events of the ongoing touch-based gesture.
[0143] In some embodiments, an individual event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or lists that indicate to the actively involved event recognition unit how the event distribution system should perform sub-event distribution. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognition units interact with each other, or how they can interact with each other. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists that indicate how sub-events are distributed to various levels in the view hierarchy or program hierarchy.
[0144] In some embodiments, an individual event recognition unit 180 activates an event processing unit 190 associated with an event when one or more specific sub-events of an event are recognized. In some embodiments, the individual event recognition unit 180 delivers event information associated with the event to the event processing unit 190. Activating the event processing unit 190 is separate from sending (and delaying the sending of) sub-events to individual hit views. In some embodiments, the event recognition unit 180 sets a flag associated with the recognized event, and the event processing unit 190 associated with that flag captures the flag and executes a default process.
[0145] In some embodiments, the event distribution command 188 includes a sub-event distribution command that distributes event information about a sub-event without activating an event processing unit. Instead, the sub-event distribution command distributes event information to an event processing unit associated with a set of sub-events, or to a view that is actively involved. The event processing unit associated with the set of sub-events or the view that is actively involved receives the event information and executes a predetermined process.
[0146] In some embodiments, the data update unit 176 creates and updates data used in application 136-1. For example, the data update unit 176 updates telephone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, the object update unit 177 creates and updates objects used in application 136-1. For example, the object update unit 177 creates new user interface objects or updates the position of user interface objects. The GUI update unit 178 updates the GUI. For example, the GUI update unit 178 prepares display information and sends it to graphics module 132 for display on touch-sensitive display.
[0147] In some embodiments, the event processing unit(s) 190 includes or has access to a data update unit 176, an object update unit 177, and a GUI update unit 178. In some embodiments, the data update unit 176, the object update unit 177, and the GUI update unit 178 are contained in a single module of an individual application 136-1 or application view 191. In other embodiments, they are contained in two or more software modules.
[0148] The foregoing description regarding the handling of user touch events on a touch-sensitive display also applies to other forms of user input for operating the multifunction device 100 using input devices, but it should be understood that not all of these begin on the touchscreen. For example, mouse movement and mouse button presses, touch movements such as taps, drags, and scrolls on a touchpad, pen stylus input, device movement, verbal commands, detected eye movements, biometric input, and / or any combination thereof may be optionally used as inputs corresponding to sub-events that define the events to be recognized.
[0149] Figure 2 shows a portable multifunction device 100 having a touchscreen 112 according to several embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment, and in other embodiments described below, the user can select one or more of the graphics by performing a gesture on the graphics using, for example, one or more fingers 202 (not shown in the figure to an exact scale) or one or more styluses 203 (not shown in the figure to an exact scale). In some embodiments, the selection of one or more graphics occurs when the user interrupts contact with that one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, right to left, upward and / or downward) and / or rolling (from right to left, left to right, upward and / or downward) with a finger in contact with the device 100. In some implementations or situations, accidental contact with a graphic does not constitute a selection of that graphic. For example, if the gesture corresponding to selection is a tap, a swipe gesture sweeping over an application icon does not arbitrarily select the corresponding application.
[0150] Device 100 also optionally includes one or more physical buttons, such as a "Home" button or a menu button 204. As previously mentioned, the menu button 204 is optionally used to navigate to any application 136 within a set of applications running on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touchscreen 112.
[0151] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push button 206 for turning the device on / off and locking the device, one or more volume buttons 208, a subscriber identification module (SIM) card slot 210, a headset jack 212, and an external port 124 for docking / charging. The push button 206 is optionally used to turn the device on / off by pressing down and holding the button down for a predetermined period of time, to lock the device by pressing down and releasing the button before a predetermined period of time has elapsed, and / or to unlock the device or initiate an unlocking process. In alternative embodiments, device 100 also accepts verbal input via a microphone 113 to activate or deactivate certain functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more tactile output generators 167 for generating tactile output to the user of device 100.
[0152] Figure 3 is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to several embodiments. The device 300 does not need to be portable. In some embodiments, the device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home or commercial controller). The device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 that interconnect these components. The communication buses 320 optionally include circuitry (sometimes called a chipset) that interconnects and controls communication between system components. The device 300 includes an input / output (I / O) interface 330 including a display 340, the display 340 is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 that generates tactile output on device 300 (for example, similar to the tactile output generator(s) 167 described above with reference to Figure 1A), and a sensor 359 (for example, light, acceleration, proximity, touch sensing, and / or a contact intensity sensor similar to the contact intensity sensor(s) 165 described above with reference to Figure 1A). The memory 370 includes high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 370 optionally includes one or more storage devices located remotely from the CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or subsets thereof, that are stored in memory 102 of the portable multifunction device 100 (Figure 1A). Furthermore, memory 370 optionally stores additional programs, modules, and data structures that are not present in memory 102 of the portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, whereas memory 102 of the portable multifunction device 100 (Figure 1A) optionally does not store these modules.
[0153] Each of the elements identified above in Figure 3 is optionally stored in one or more of the memory devices described above. Each of the modules identified above corresponds to an instruction set for performing the function described above. The modules or computer programs (e.g., instruction sets or instructions) identified above do not need to be implemented as separate software programs (e.g., computer programs (including instructions)), procedures, or modules; therefore, in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. In some embodiments, memory 370 optionally stores subsets of the modules and data structures identified above. Furthermore, memory 370 optionally stores additional modules and data structures not described above.
[0154] Next, we optionally turn our attention to an embodiment of a user interface implemented in, for example, a portable multi-functional device 100.
[0155] Figure 4A shows an exemplary user interface for an application menu on a portable multifunction device 100 according to several embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, the user interface 400 includes the following elements, or subsets or supersets thereof. ●Signal strength indicators (single or multiple) for wireless communication (single or multiple) such as cellular signals and Wi-Fi signals 402, ●Time 404, ●Bluetooth indicator 405, ●Battery status indicator 406, ●Tray 408 containing icons for frequently used applications, as shown below. ○Optionally including an indicator 414 for the number of missed calls or voicemail messages, an icon 416 of the telephone module 138 labeled "Telephone", ○Optionally including an indicator 410 for the number of unread emails, an icon 418 of the email client module 140 labeled "Mail", ○ Icon 420 of browser module 147, labeled "Browser", and ○ Icon 422 for the video and music player module 152, also known as the iPod (trademark of Apple Inc.) module 152, which is labeled "iPod", and ● Icons of other applications, such as the following: ○ Icon 424 of IM module 141, labeled "Message", ○ Icon 426 of calendar module 148, labeled "Calendar" ○ Icon 428 of image management module 144, labeled "Photo" ○ Icon 430 of camera module 143, labeled "Camera" ○ Icon 432 of online video module 155, labeled "online video", 〇 Icon 434 of stock price widget 149-2, labeled "Stock Price", ○ Icon 436 of map module 154, labeled "Map" 〇 Icon 438 of weather widget 149-1, labeled "Weather" 〇 Icon 440 of the alarm clock widget 149-4, labeled as "Clock", ○ Icon 442 of training support module 142, labeled "Training Support" ○ Icon 444 of memo module 153, labeled as "Memo", and ○ An icon 446 labeled "Settings," which provides access to the settings of device 100 and its various applications 136, for a settings application or module.
[0156] Please note that the icon labels shown in Figure 4A are for illustrative purposes only. For example, the icon 422 for the video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label for an individual application icon includes the name of the application to which that individual application icon corresponds. In some embodiments, the label for a particular application icon is different from the name of the application to which that particular application icon corresponds.
[0157] Figure 4B shows an exemplary user interface on a device (e.g., device 300 in Figure 3) having a touch-sensitive surface 451 (e.g., tablet or touchpad 355 in Figure 3) separate from the display 450 (e.g., touchscreen display 112). Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting the intensity of contact on the touch-sensitive surface 451, and / or one or more tactile output generators 357 for generating tactile output to the user of device 300.
[0158] Some of the following examples are given by referring to input on a touchscreen display 112 (a combination of a touch-sensing surface and a display), but in some embodiments, the device detects input on a touch-sensing surface separate from the display, as shown in Figure 4B. In some embodiments, the touch-sensing surface (e.g., 451 in Figure 4B) has a primary axis (e.g., 452 in Figure 4B) corresponding to a primary axis (e.g., 453 in Figure 4B) on the display (e.g., 450). According to these embodiments, the device detects contact with the touch-sensing surface 451 (e.g., 460 and 462 in Figure 4B) at positions corresponding to each of the positions on the display (e.g., 460 corresponds to 468 and 462 corresponds to 470 in Figure 4B). In this way, user input (e.g., touches 460 and 462, and their movement) detected by the device on a touch-sensitive surface (e.g., 451 in Figure 4B) is used by the device to operate the user interface on the display of the multifunction device (e.g., 450 in Figure 4B) when the touch-sensitive surface is separate from the display. It should be understood that a similar method may be optionally used for other user interfaces described herein.
[0159] In addition, while the following examples are given primarily with reference to finger input (e.g., finger touch, finger tap gesture, finger swipe gesture), it should be understood that in some embodiments, one or more of the finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of touch), followed by a mouse click with cursor movement along the swipe path (e.g., instead of touch movement). As another example, a tap gesture may optionally be replaced by a mouse click (e.g., instead of touch detection and subsequent cessation of touch detection) while the cursor is located over the tap gesture position. Similarly, it should be understood that when multiple user inputs are detected simultaneously, multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.
[0160] Figure 5A shows an exemplary personal electronic device 500. Device 500 includes a body 502. In some embodiments, device 500 may include some or all of the features described with respect to devices 100 and 300 (e.g., Figures 1A to 4B). In some embodiments, device 500 has a touch-sensitive display screen 504, hereafter referred to as touchscreen 504. Alternatively, in addition to touchscreen 504, device 500 may have a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, the touchscreen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors that detect the intensity of the applied contact (e.g., touch). One or more intensity sensors on the touchscreen 504 (or touch-sensitive surface) may provide output data representing the intensity of the touch. The user interface of device 500 may respond to touches based on their intensity, meaning that touches of different intensity may invoke different user interface behaviors on device 500.
[0161] For example, see, for instance, International Patent Application PCT / US2013 / 040061, “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” filed 8 May 2013, published as International Publication WO / 2013 / 169849, and International Patent Application PCT / US2013 / 069483, “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” filed 11 November 2013, published as International Publication WO / 2014 / 105276.
[0162] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. The input mechanisms 506 and 508 may be physical, if included. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can enable the device 500 to be attached to, for example, hats, eyeglasses, earrings, necklaces, shirts, jackets, bracelets, watch bands, chains, trousers, belts, shoes, wallets, backpacks, etc. These attachment mechanisms enable the user to wear the device 500.
[0163] Figure 5B shows an exemplary personal electronic device 500. In some embodiments, the device 500 may include some or all of the components described with respect to Figures 1A, 1B, and 3. The device 500 has a bus 512 that operably connects an I / O section 514 to one or more computer processors 516 and memory 518. The I / O section 514 may be connected to a display 504, which may have a touch-sensing component 522 and optionally an intensity sensor 524 (e.g., a contact intensity sensor). In addition, the I / O section 514 may be connected to a communication unit 530 that receives application and operating system data using Wi-Fi, Bluetooth, near-field communication (NFC), cellular, and / or other wireless communication technologies. The device 500 may include input mechanisms 506 and / or 508. The input mechanism 506 may optionally be, for example, a rotatable input device or a pressable and rotatable input device. In some embodiments, the input mechanism 508 is optionally a button.
[0164] In some embodiments, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors such as a GPS sensor 532, an accelerometer 534, a direction sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or a combination thereof, all of which can be operably connected to the I / O section 514.
[0165] The memory 518 of the personal electronic device 500 may include one or more non-temporary computer-readable storage media for storing computer-executable instructions, which, when executed by one or more computer processors 516, can cause the computer processors to perform, for example, the techniques described later, including processes 700, 900, 1000, 1200, and 1400 (Figures 7, 9, 10, 12, and 14). The computer-readable storage media may be any medium that can tangibly contain or store computer-executable instructions used by or in connection with an instruction execution system, apparatus, or device. In some embodiments, the storage medium is a temporary computer-readable storage medium. In some embodiments, the storage medium is a non-temporary computer-readable storage medium. The non-temporary computer-readable storage medium may include, but is not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, CDs, DVDs, or optical disks based on Blu-ray technology, as well as persistent solid-state memory such as flash and solid-state drives. The personal electronic device 500 is not limited to the components and configurations shown in Figure 5B, and may include other or additional components in multiple configurations.
[0166] As used herein, the term “affordance” refers to user-interactive graphical user interface objects that are optionally displayed on the display screens of devices 100, 300, and / or 500 (Figures 1A, 3, and 5A-5B). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each optionally constitute an affordance.
[0167] As used herein, the term “focus selector” refers to an input element that indicates the current part of the user interface that the user is interacting with. In some implementations, including a cursor or other position marker, the cursor acts as a “focus selector,” and therefore, when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 in Figure 3 or touch-sensitive surface 451 in Figure 4B) while the cursor is positioned over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations, including a touchscreen display that enables direct interaction with user interface elements on the touchscreen display (e.g., touch-sensitive display system 112 in Figure 1A or touchscreen 112 in Figure 4A), a detected contact on the touchscreen acts as a “focus selector,” and therefore, when an input (e.g., a press input by touch) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, the particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one area of the user interface to another without corresponding cursor movement or touch movement on the touchscreen display (for example, by using the tab key or arrow keys to move focus from one button to another), and in these implementations, the focus selector moves in accordance with the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or touch on the touchscreen display) controlled by the user to communicate about the user's intended interaction with the user interface (for example, by pointing to the device the user interface element through which the user intends to interact).For example, the position of a focus selector (e.g., cursor, touch, or selection box) over an individual button while pressure input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen) indicates that the user intends to activate that individual button (rather than other user interface elements displayed on the device's display).
[0168] As used herein and in the claims, the term “characteristic intensity” of a contact refers to the characteristics of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a set of intensity samples collected over a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predetermined event (e.g., after detection of contact, before detection of lift-off of contact, before or after detection of the start of movement of contact, before detection of the end of contact, before or after detection of an increase in contact intensity, and / or before or after detection of a decrease in contact intensity). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the top 10 percentile value of the contact intensity, the maximum half value of the contact intensity, the maximum 90 percent value of the contact intensity, and so on. In some embodiments, the duration of contact is used when determining characteristic intensity (for example, when characteristic intensity is the average intensity of contact over time). In some embodiments, characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action has been performed by the user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, contact with a characteristic intensity not exceeding the first threshold results in a first action, contact with a characteristic intensity above the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a characteristic intensity above the second threshold results in a third action. In some embodiments, the comparison between characteristic intensity and one or more thresholds is not used to determine whether a first action should be performed or a second action should be performed, but rather to determine whether one or more actions should be performed at all (for example, whether individual actions should be performed or whether the performance of individual actions should be canceled).
[0169] Next, we will focus on embodiments of user interfaces ("UI") and related processes implemented on electronic devices such as portable multifunction device 100, device 300, or device 500.
[0170] Figures 6A to 6O show exemplary user interfaces that provide guidance on starting the operation, according to several embodiments. The user interfaces in these figures are used to describe processes described later, including the process shown in Figure 7.
[0171] In some embodiments, any of the inputs described herein (e.g., inputs 650a, 650b, 650c, 650d, 650e, 650f, 650g, and / or 650h) is a touch input (e.g., a tap gesture and / or a swipe gesture) or includes a touch input. In some embodiments, any of the inputs described herein (e.g., inputs 650a, 650b, 650c, 650d, 650e, 650f, 650g, and / or 650h) is a voice input (e.g., a voice command for selecting a user interface element, or a voice command for activating a feature or function associated with a user interface element, or for performing a function) or includes a voice input. In some embodiments, any of the inputs described herein (e.g., inputs 650a, 650b, 650c, 650d, 650e, 650f, 650g, and / or 650h) is or includes an air gesture (e.g., an air gesture for selecting a user interface element, or an air gesture for activating a feature or function, such as a feature or function associated with a user interface element). In some embodiments, any of the inputs described herein (e.g., inputs 650a, 650b, 650c, 650d, 650e, 650f, 650g, and / or 650h) is or includes an activation thereof (e.g., pressing, rotating, and / or moving). In some embodiments, any of the user interface elements described herein as being selected (e.g., icons, affordances, buttons, and / or selectable options) is selected by activating a hardware device while the user interface element has focus (e.g., highlighted, bolded, outlined, visually distinguished from other user interface elements, and / or positioned at or near the cursor).
[0172] Figure 6A shows a computer system 600 that displays a clock face user interface 604 via a display device 602. In Figure 6A, the computer system 600 includes, in addition to the display device 602, a first hardware input device 606a, a second hardware input device 606b, and a third hardware input device 606c. The first hardware input device 606a includes a first button configured to cause the computer system 600 to perform one or more first actions when selected via user input. In some embodiments, the first hardware input device 606a is a physical button, a physically pressable button, and / or a solid button having a pressure sensor. In some embodiments, the first hardware input device 606a includes a tactile output generator that provides tactile feedback (e.g., haptic feedback) in response to detecting user input corresponding to the first hardware input device 606a. As described below, in some embodiments, a first hardware input device 606a is user-configurable such that user input corresponding to the first hardware input device 606a causes the computer system 600 to perform a user selection operation. A second hardware input device 606b includes a second button configured to cause the computer system 600 to perform one or more second operations when selected via user input. A third hardware input device 606c includes a rotatable input device configured to receive rotational and / or press user inputs that cause the computer system 600 to perform one or more third operations.
[0173] In Figure 6A, the clock face user interface 604 includes user interface objects 608a-608h and a time indicator 610 (e.g., an analog time indicator). Upon detecting user input corresponding to individual user interface objects 608a-608h, the computer system 600 is configured to display a user interface associated with the individual application corresponding to the selected user interface object. For example, in Figure 6A, the computer system 600 detects user input 650a (e.g., a tap gesture or other selection / navigation input) corresponding to user interface object 608d associated with the computer system 600's timer application. Upon detecting user input 650a, the computer system 600 displays the timer user interface 636, as shown in Figure 6J. In some embodiments, the clock face user interface 604 is the home and / or default user interface displayed by the computer system 600 when there is no user input requesting navigation to a specific application of the computer system 600.
[0174] In Figure 6A, the computer system 600 detects a user input 650b (e.g., a single-press gesture or other selection / navigation input) corresponding to a first hardware input device 606a. The first hardware input device 606a is user-configurable so that a user of the computer system 600 can select and / or otherwise configure the first hardware input device 606a to cause the computer system 600 to perform a predetermined action in response to the user input. In Figure 6A, the first hardware input device 606a is configured to cause the computer system 600 to start a workout routine, such as outdoor running. As described below with reference to Figures 6M to 6O, a user of the computer system 600 can select various actions and / or different types of workout routines that the computer system 600 will start in response to the detection of user input 650b. In some embodiments, a user of computer system 600 can configure the first hardware input device 606a via computer system 600 and / or via a separate and / or different companion computer system (e.g., computer system 646).
[0175] In response to detecting user input 650b, the computer system 600 initiates a process to start a workout routine, as shown in Figure 6B. In Figure 6B, the computer system 600 displays an indication 612 overlaid on the clock face user interface 604 via a display device 602. For example, the computer system 600 displays the indication 612 so that it is at the top of the clock face user interface 604 and appears as if at least a portion of the clock face user interface 604 is visible and / or otherwise visible (for example, the indication 612 includes a degree of transparency that allows the computer system 600 to see both the indication 612 and at least a portion of the clock face user interface 604). The computer system 600 also obscures, de-emphasizes, blurs, and / or reduces the size of the clock face user interface 604 in order to more firmly focus the user's attention on the indication 612 (for example, instead of the clock face user interface 604). In some embodiments, the computer system 600 replaces the display of the clock face user interface 604 with the display of the indication 612 such that the clock face user interface 604 is not displayed and / or invisible when the computer system 600 displays the indication 612.
[0176] In Figure 6B, the indication 612 includes an operation indicator 612a and an input indicator 612b. The operation indicator 612a provides a visual indication of a predetermined operation configured to be started and / or executed by the computer system 600 in response to the detection of user input 650b. In Figure 6B, the indication 612 includes symbols and / or icons associated with the predetermined operation (e.g., an outdoor running workout routine), as well as text indicating the predetermined operation (e.g., "outdoor running"). The input indicator 612b provides visual confirmation that user input 650b has been detected by the computer system 600 and that the indication 612 has been displayed in response to the detection of user input 650b. For example, the input indicator 612b is displayed at position 614 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the first hardware input device 606a (with respect to the display device 602). To further confirm that the indication 612 is displayed in response to the detection of user input 650b, the input indicator 612b also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the first hardware input device 606a.
[0177] In Figure 6B, the indication 612 includes a background 612c having a first color associated with a predetermined operation (for example, shown in the first shaded display in Figure 6B). For example, in some embodiments, the first color is based on an application associated with the predetermined operation and / or an application that enables the computer system 600 to perform this predetermined operation. In some embodiments, the first color is based on the color of a first hardware input device 606a (for example, including a first hue of the first hardware input device 606a). The input indicator 612b includes a second color associated with a predetermined operation and / or associated with the first hardware input device 606a (for example, the color of the first hardware input device 606a) (for example, shown in the second shaded display in Figure 6B). In some embodiments, the background 612c includes a first hue of the first hardware input device 606a, and the input indicator 612b includes a second hue of the first hardware input device 606a.
[0178] In Figure 6B, the computer system 600 displays an indication 612 in response to detecting user input 650b. In some embodiments, the computer system 600 is configured to display the indication 612 for a predetermined period (e.g., 2, 3, or 5 seconds) before transitioning to displaying a user interface associated with a predetermined action (e.g., an outdoor running workout routine). For example, after displaying the indication 612 for a predetermined period (and optionally after detecting the end of user input 650b (e.g., release), the computer system 600 displays the workout user interface 616, as shown in Figure 6C.
[0179] In Figure 6C, the workout user interface 616 includes user interface objects 616a to 616e that provide information and / or data about the workout routine in progress (e.g., an outdoor running workout routine started in response to the detection of user input 650b). Thus, the computer system 600 starts the workout routine, and after detecting user input 650b and / or after displaying the indication 612 for a predetermined period of time (e.g., accordingly), displays the workout user interface 616. In some embodiments, while the workout routine is in progress (e.g., while a predetermined action is being performed), the computer system 600 detects user interaction with the computer system 600, thereby causing the computer system 600 to display a first hint indication 618, as shown in Figure 6D. In some embodiments, user interaction that causes the computer system to display the first hint indication 618 includes user input on the display device 602, user input on one or more of the hardware input devices 606a to 606c, and / or a wrist-raising gesture indicating that the user is looking at the computer system's display device 602. In some embodiments, the computer system 600 displays the first hint indication 618 after performing a predetermined operation over a predetermined period of time without detecting user interaction.
[0180] In Figure 6D, the first hint indication 618 visually suggests, teaches, and / or otherwise informs the user of the computer system 600 that the computer system 600 is configured to perform a second predetermined action in response to user input corresponding to the first hardware input device 606a. For example, the first hardware input device 606a may be configured to cause the computer system 600 to perform a number of different actions based on various types of user input detected and / or based on the context of the computer system 600 (for example, based on whether the computer system is currently performing a particular action and / or displaying a particular user interface). As described above, in some embodiments, the computer system 600 displays the first hint indication 618 in response to detecting a user interaction with the computer system 600 (for example, one or more predetermined types of user interactions). For example, in some embodiments, the computer system 600 detects a user interaction that indicates the user is requesting the performance of a second predetermined action, such as a wrist-raising gesture. In some embodiments, the computer system 600 displays a first hint indication 618 in response to detecting a decrease in the computer system 600's movement indicating that the user has stopped a workout, exercise, and / or other physical activity being performed.
[0181] In Figure 6D, the first hint indication 618 is overlaid on the workout user interface 616. For example, computer system 600 displays the first hint indication 618 so that it is on top of the workout user interface 616 and appears to be visible and / or visible in any other way (for example, the first hint indication 618 includes an amount of transparency that allows computer system 600 to see both the first hint indication 618 and the portion of the workout user interface 616). In some embodiments, computer system 600 obscures, de-highlights, blurs, and / or reduces the size of the workout user interface 616 in order to more firmly focus the attention of the computer system 600 user on the first hint indication 618 (rather than the workout user interface 616). In some embodiments, the computer system 600 replaces the display of the workout user interface 616 with the display of the first hint indication 618 such that the workout user interface 616 is not displayed and / or invisible when the computer system 600 displays the first hint indication 618.
[0182] The first hint indication 618 includes an action indicator 618a and an input indicator 618b. The action indicator 618a provides a visual indication of a second predetermined action configured to be performed by the computer system 600 in response to detection of user input corresponding to the first hardware input device 606a. In Figure 6D, the action indicator 618a includes symbols and / or icons associated with the second predetermined action (e.g., pausing an outdoor running workout routine), as well as text indicating the second predetermined action (e.g., "Outdoor Running Press and Pause"). The input indicator 618b visually confirms and / or guides the computer system 600 to perform the second predetermined action based on user input corresponding to the first hardware input device 606a. For example, the input indicator 618b is displayed at position 614 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the first hardware input device 606a (e.g., with respect to the display device 602). The input indicator 618b also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the first hardware input device 606a.
[0183] In Figure 6D, the first hint indication 618 includes a background 618c having a third color associated with a second predetermined operation (e.g., shown in the third shaded display in Figure 6D). For example, in some embodiments, the third color is based on an application associated with the second predetermined operation (e.g., a workout application) and / or an application that enables the computer system 600 to perform the second predetermined operation (e.g., a workout application). In some embodiments, the third color is based on the color of the first hardware input device 606a (e.g., the background 618c includes a third shade of the first hardware input device 606a). The input indicator 618b includes a fourth color associated with the second predetermined operation and / or associated with the first hardware input device 606a (e.g., shown in the second shaded display in Figure 6D), corresponding to and / or based on the color of the first hardware input device 606a. In some embodiments, the background 618c includes a third color tone of the first hardware input device 606a, and the input indicator 618b includes a fourth color tone of the first hardware input device 606a.
[0184] In some embodiments, the first hint indication 618 is displayed as an introduction to the functionality of the computer system 600 to perform a second predetermined operation. For example, after the computer system 600 is initially configured to perform a second predetermined operation via user input corresponding to a first hardware input device 606a (e.g., in response to detecting user interaction), the first hint indication 618 is displayed a predetermined number of times (e.g., 2, 5, or 10 times). That is, after the first hardware input device 606a is initially configured to cause the computer system 600 to perform a second predetermined operation, the computer system 600 displays the first hint indication 618 a predetermined number of times. In some embodiments, after the computer system 600 has displayed the first hint indication 618 a predetermined number of times, the computer system displays a second hint indication 620, as shown in Figure 6E.
[0185] In some embodiments, the computer system 600 displays a second hint indication 620 in response to detecting a user interaction while displaying the workout user interface 616 (for example, after having already displayed the first hint indication 618 a predetermined number of times). User interaction that causes the computer system to display the second hint indication 620 includes user input on the display device 602, user input on one or more of the hardware input devices 606a to 606c, and / or a wrist-raising gesture indicating that the user is looking at the computer system's display device 602. In some embodiments, the computer system 600 displays the second hint indication 620 after performing a predetermined action (for example, performing a workout routine action) over a predetermined amount of time without detecting a user interaction. In some embodiments, the computer system 600 displays the second hint indication 620 in response to detecting a decrease in the computer system 600's movement indicating that the user has stopped a workout, exercise, and / or other physical activity being performed (for example, after displaying the first hint indication 618 a predetermined number of times).
[0186] In Figure 6E, the second hint indication 620 includes an input indicator 620a but does not include an operation indicator 618a and / or background 618c of the first hint indication 618. The second hint indication 620 does not include an operation indicator 618a and / or background 618c because the computer system 600 has displayed the first hint indication 618 a predetermined number of times, and therefore the user of the computer system 600 can perform a second predetermined operation via user input at the first hardware input device 606a. The input indicator 620a visually confirms and / or guides the user input corresponding to the first hardware input device 606a to cause the computer system 600 to perform the second predetermined operation. For example, the input indicator 620a is displayed at position 614 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the first hardware input device 606a (with respect to the display device 602). The input indicator 620a also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the first hardware input device 606a.
[0187] In Figure 6E, the computer system 600 detects a user input 650c (e.g., a press input or other selection / navigation input) corresponding to the first hardware input device 606a. Upon detection of the user input 650c, the computer system 600 initiates a second predetermined action, as shown in Figure 6F, and pauses the ongoing workout routine operation. Although the user input 650c is shown in Figure 6E, the computer system 600 is also configured to initiate the execution of the second predetermined action upon detection of user input corresponding to the first hardware input device 606a, while displaying the first hint indicator 618 in Figure 6D. In some embodiments, the computer system 600 is also configured to initiate the second predetermined action upon detection of user input corresponding to the first hardware input device 606a, even if the first hint indicator 618 and / or the second hint indicator 620 are not displayed. In some embodiments, in addition to and / or instead of detecting user input 650c of the computer system 600, the computer system 600 detects user input 650d (e.g., a right swipe gesture or other selection / navigation input) on the workout user interface 616. In response to detecting user input 650d (e.g., instead of user input 650c), the computer system displays the workout control user interface 622, as shown in Figure 6G.
[0188] In Figure 6F, the computer system 600 displays a workout user interface 616 that includes a status indicator 616f indicating that the workout routine operation is paused (for example, the status indicator 616f includes the text “Paused”). Thus, the computer system 600 is configured to display a first hint indicator 618 and / or a second hint indicator 620 so that the user of the computer system 600 is aware that a user input corresponding to a first hardware input device 606a is causing the computer system 600 to pause the ongoing workout routine operation. In some embodiments, the computer system 600 is configured to pause the ongoing workout routine operation in response to the detection of user input corresponding to the first hardware input device 606a, even if the first hint indicator 618 and / or the second hint indicator 620 are not displayed. In Figure 6F, the computer system 600 detects a user input 650e on the workout user interface 616 (for example, a left swipe gesture or other selection / navigation input). Upon detecting user input 640e, the computer system 600 displays the music user interface 624, as shown in Figure 6I.
[0189] In Figure 6G, the computer system 600 displays a workout control user interface 622, which, when selected, includes user interface objects 622a-622d that control the aspects and / or context associated with the ongoing workout routine (for example, controlling the aspects and / or context associated with the ongoing workout routine before the ongoing workout routine is paused in response to user input 650c). In some embodiments, the first hardware control device 606a is configured to perform the same predetermined actions when the computer system 600 displays various user interfaces (for example, various user interfaces for the same and / or different applications of the computer system 600). In some embodiments, the first hardware control device 606a is configured to perform various actions in response to various types of user input while the computer system 600 is displaying the workout control user interface 622 (and optionally the workout user interface 616). In some embodiments, the first hardware control device 606a is configured to perform actions associated with user interface objects 622a-622d.
[0190] For example, in Figure 6G, the computer system 600 displays a third hint indication 626 and boundary 628 at least partially around the user interface object 622d. In some embodiments, the computer system 600 displays the third hint indication 626 and boundary 628 after displaying the workout control user interface 622 for a predetermined period of time. In some embodiments, the computer system 600 displays the third hint indication 626 and boundary 628 in response to having displayed the workout control user interface 622. In some embodiments, the computer system 600 displays the third hint indication 626 and boundary 628 based on the detection of user interaction with the computer system 600 and / or based on information provided via one or more sensors of the computer system 600. In Figure 6G, the third hint indication 626 includes an input indicator 626a. The input indicator 626a visually confirms and / or guides the computer system 600 to perform a third predetermined action (e.g., a second predetermined action and / or a pause in an ongoing workout routine) based on user input corresponding to the first hardware input device 606a. For example, the input indicator 626a is displayed at position 614 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the first hardware input device 606a (with respect to the display device 602). The input indicator 626a also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the first hardware input device 606a.
[0191] Boundary 628 guides and / or informs the user of computer system 600 that user input corresponding to the first hardware input device 606a will perform an action related to user interface object 622d, such as pausing an ongoing workout routine operation. Therefore, if the first hardware input device 606a is configured to cause computer system 600 to perform the same action as the action associated with a displayed user interface object, the computer system will display boundary 628 at least partially around the displayed user interface object. In Figure 6G, the third hint indication 626 and / or boundary 628 allow the user to understand that computer system 600 can perform an action via user input on the first hardware input 606a (e.g., a press gesture or other selection / navigation input) and / or user input on a displayed user interface object (e.g., user interface object 622d) (e.g., a tap gesture or other selection / navigation input).
[0192] As described above, the computer system 600 is configured to perform various operations in response to various types of user input corresponding to the first hardware input device 606a. For example, in Figure 6H, the computer system 600 displays a workout control user interface 622 which includes at least partially a fourth hint indication 630 and a boundary 632 around a user interface object 622a. In some embodiments, (for example, when the computer system 600 does not detect user input) the computer system 600 alternates between displaying the third hint indication 626 and the fourth hint indication 630 while displaying the workout control user interface 622. For example, in some embodiments, the computer system 600 displays an animation in which the third hint indication 626, boundary 628, fourth hint indication 630, and / or boundary 632 move, change in size, change in thickness, change in brightness, and / or alternate between displaying and not displaying over time. Therefore, the computer system 600 provides the user with guidance and / or information regarding various types of user input that may be provided to cause the computer system 600 to perform various operations.
[0193] In Figure 6H, the fourth hint indication 630 includes a first input indicator 630a and a second input indicator 630b that are simultaneously displayed on the workout control user interface 622. The first input indicator 630a and the second input indicator 630b provide visual guidance to the user of the computer system 600 that user input (e.g., simultaneous and / or consecutive pressing gestures) directed to both the first hardware input device 606a and the second hardware input 606b causes the computer system 600 to perform a fourth predetermined action (e.g., enabling a waterlock action during a workout routine). For example, the first input indicator 630a is displayed at position 614 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the first hardware input device 606a (with respect to the display device 602). The first input indicator 630a also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the first hardware input device 606a. The second input indicator 630b is displayed at position 634 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the second hardware input device 606b (e.g., with respect to the display device 602). The second input indicator 630b also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the second hardware input device 606b. Furthermore, the boundary 632 provides visual indication of the fourth predetermined operation by highlighting the user interface object 622a associated with the fourth predetermined operation.
[0194] In Figures 6G and 6H, the computer system 600 is configured to perform a third predetermined operation and pause the ongoing workout routine operation in response to the detection of user input corresponding to the first hardware input device 606a (and not corresponding to the second hardware input device 606b). Furthermore, the computer system 600 is configured to perform a fourth predetermined operation and initiate a waterlock operation in response to the detection of user input corresponding to both the first hardware input device 606a and the second hardware input device 606b (for example, simultaneous input on both the first and second hardware input devices 606a and / or consecutive input on both the first and second hardware input devices 606b). In some embodiments, the computer system 600 is also configured to perform a third predetermined operation and a fourth predetermined operation in response to user input on the first hardware input device 606a and user input on the first hardware input device 606a and the second hardware input device 606b, respectively, while displaying the workout user interface 616 (for example, while displaying or not displaying the first hint indication 618 and / or the second hint indication 620).
[0195] As described above, in response to detecting user input 650e in Figure 6F, the computer system 600 displays the music user interface 624 as shown in Figure 6I. In Figure 6I, the computer system 600 is not configured to perform the actions associated with the music user interface 624 in response to user input corresponding to the first hardware input device 606a. Therefore, while the computer system 600 is displaying the music user interface 624, the computer system 600 does not display the hint indications (e.g., the first hint indication 618, the second hint indication 620, the third hint indication 626, and / or the fourth hint indication 630) because it is not displaying the user interface associated with the actions that the first hardware input device 606a is configured to perform (e.g., it stops displaying them). When the computer system 600 is displaying the music user interface 624 but not displaying hint indications, in some embodiments, the computer system 600 is also configured to perform a predetermined operation in response to detecting user input corresponding to the first hardware input device 606a.
[0196] As described above, upon detecting user input 650a corresponding to user interface object 608a in Figure 6A, the computer system displays the timer user interface 636 as shown in Figure 6J. In Figure 6J, the computer system 600 is configured to perform one or more operations associated with the timer application (for example, a second predetermined operation, a third predetermined operation, and / or a fourth predetermined operation associated with the workout application as described above with reference to Figures 6B-6H, in addition to or instead of a first predetermined operation) upon detecting user input corresponding to the first hardware input device 606a. For example, in Figure 6J, the computer system 600 displays the timer user interface 636, which includes a timer duration indicator 636a, a remaining time indicator 636b, a timer user interface object 636c, a cancel user interface object 636d, and a pause user interface object 636e. The pause user interface object 636e indicates that a timer operation (e.g., a 10-minute timer) is currently running by the computer system 600, because the computer system 600 is configured to pause an ongoing timer operation instead of resuming, starting, and / or restarting the timer operation. That is, the computer system 600 is configured to alert the user at the end of a predetermined duration (e.g., 10 minutes) from the time the timer operation was started (e.g., via user input).
[0197] In Figure 6J, the computer system 600 displays hint indications 638 and a boundary 640 at least partially around the pause user interface object 636e. The hint indications 638 include a first input indicator 638a and a second hint indicator 638b that are displayed simultaneously on the timer control user interface 636. The first input indicators 638a and 638b provide visual guidance to the user of the computer system 600 that user inputs directed to both the first hardware input device 606a and the second hardware input 606b (e.g., simultaneous and / or consecutive user inputs) cause the computer system 600 to perform a fifth predetermined operation (e.g., pause the timer). For example, the first input indicator 638a is displayed at position 614 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the first hardware input device 606a (e.g., with respect to the display device 602). The first input indicator 638a also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the first hardware input device 606a. The second input indicator 638b is displayed at position 634 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the second hardware input device 606b (e.g., with respect to the display device 602). The second input indicator 638b also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the second hardware input device 606b. Furthermore, the boundary 640 provides visual indication of the fifth predetermined operation by highlighting the pause user interface object 636e associated with the fifth predetermined operation.
[0198] The computer system 600 is configured to animate the hint indicator 638 and / or the boundary 640 in order to further provide the user with visual guidance that the selection of the first hardware input 606a and the second hardware input 606b is configured to perform a fifth predetermined operation. For example, in Figure 6J, the computer system 600 displays a first input indicator 638a and a second hint indicator 638b having a first thickness 642a (e.g., width), and a boundary 640 having a first thickness 644a. In some embodiments, the computer system 600 is configured to animate the first input indicator 638a, the second input indicator 638b, and the boundary 640 so that they appear to pulsate, change in size, change in thickness, change in brightness, and / or move in other ways over time. For example, after displaying the boundary 640 between the first input indicators 638a and 638b of the first thickness 642a and the first thickness 644a, the computer system 600 displays the boundary 640 between the first input indicators 638a and 638b of the second thickness 642b and the second thickness 644b, where, as shown in Figure 6K, the second thickness 642b is greater than the first thickness 642a and the second thickness 644b is greater than the first thickness 644a. In some embodiments, the computer system 600 alternates between displaying the boundary 640 between the first input indicators 638a and 638b of the first thickness 642a and the first thickness 644a, and displaying the boundary 640 between the first input indicators 638a and 638b of the second thickness 642b and the second thickness 644b. Therefore, the computer system 600 further draws the user's attention to the fact that it can perform a fifth predetermined operation by informing and / or showing the user that a fifth predetermined operation is performed by user input corresponding to the first hardware input device 606a and the second hardware input device 606b.
[0199] While pulse animations of the hint indicator 638 and boundary 640 are shown in Figures 6J and 6K with respect to a fifth predetermined operation, in some embodiments, the computer system 600 animates the display of the first hint indicator 618, the second hint indicator 620, the third indicator 626, and / or the fourth hint indicator 630 so that they appear to change in size, thickness, brightness, and / or otherwise move over time.
[0200] In Figure 6K, the computer system 600 detects a user input 650f (e.g., a simultaneous press gesture, a continuous press gesture, or other selection / navigation input) corresponding to the first hardware input device 606a and the second hardware input device 606b. Upon detecting the user input 650f, the computer system performs a fifth predetermined operation and pauses the timer, as shown in Figure 6L.
[0201] In Figure 6L, the computer system 600 displays a timer user interface 636 with a start (play) user interface object 636f instead of a pause user interface object 636e. Thus, the computer system 600 pauses the timer operation at a time related to the detection of user input 650f (e.g., "9:35"). In some embodiments, the computer system 600 is configured to resume the timer operation (e.g., continue counting down from "9:35") in response to the detection of user inputs corresponding to a first hardware input device 606a, a second hardware input device 606b, and / or user interface object 636f.
[0202] As described above, the first hardware input device 606a is user-configurable so that a user of the computer system 600 can select one or more predetermined operations to be performed by the computer system 600 in response to one or more types of user input corresponding to the first hardware input device 606a. In some embodiments, the computer system 600 is a wearable device such as a smartwatch, and the computer system 600 communicates with an external computer system 646 (e.g., a companion computer system). The external computer system 646 communicates with the computer system 600 (e.g., is paired with the computer system 600) and is configured to provide the computer system 600 with information such as setting information, notification information, and / or configuration information. Figures 6M to 6O show the external computer system 646 detecting user input corresponding to configuring and / or selecting an operation to be performed by the first hardware input device 606a on the computer system 600. For example, the external computer system 646 detects and / or receives user input to select one or more operations that the first hardware input device 606a is configured to perform on the computer system 600, and communicates information to the computer system 600 regarding the selected operations and the configuration of the first hardware input device 606a. Figures 6M to 6O show the external device 646 displaying a user interface for configuring the first hardware input device 606a of the computer system 600, but in some embodiments, the computer system 600 displays a similar user interface that allows the computer system 600 to configure the first hardware input device 606a via user input detected by the computer system 600 (for example, without the computer system 600 receiving information from the external computer system 646).
[0203] In Figure 6M, the external computer system 646 displays a configuration user interface 648 via a display device 646a, which allows the user to select one or more operations associated with the first hardware input device 606a. The configuration user interface 648 includes an information area 652 that informs and / or guides the user that the configuration user interface 648 is related to configuring the first hardware input device 606a. For example, the information area 652 includes text 652a (e.g., "Select a shortcut one-click action, and you can change this in the settings") and / or an image 652b (e.g., an image representing computer system 600) that provides information related to the first hardware input device 606a. The configuration user interface 648 also includes a category area 654 having user interface objects 654a to 654c corresponding to various categories of operations that the first hardware input device 606a may be configured to function. In Figure 6M, the first user interface object 654a is associated with the workout category, the second user interface object 654b is associated with the stopwatch category, and the third user interface object 654c is associated with the flashlight category. In some embodiments, the category area 654 contains fewer than three user interface objects. In some embodiments, the category area 654 contains three or more user interface objects, and the external computer system 646 is configured to display additional user interface objects in response to detecting a swipe gesture (or other selection / navigation input) on the category area 654.
[0204] In Figure 6M, the external computer system 646 detects user input 650g (e.g., a tap gesture or other selection / navigation input) corresponding to the selection of the first user interface object 654a in the category area 654. In response to detecting user input 650g, the external computer system 646 displays the application user interface 656, as shown in Figure 6N. In some embodiments, the external computer system 646 discontinues displaying the application user interface 656 if the user interface object of the selected category is not associated with multiple applications on the external computer system 646 and / or computer system 600. For example, if the external computer system 646 and / or computer system 600 contain only a single workout application corresponding to the workout category, the external computer system 646 discontinues displaying the application user interface 656 because there are no multiple applications for the user to select. In some embodiments, after the external computer system 646 discontinues displaying the application user interface 656, the external computer system 646 displays the settings user interface 658 in response to detecting user input 650g.
[0205] In Figure 6N, the external computer system 646 displays an application user interface 656 (for example, based on a determination that the external computer system 646 and / or computer system 600 include multiple applications related to a workout category). The application user interface 656 includes a first application user interface object 656a corresponding to a first workout application (e.g., "Workout App #1") and a second application user interface object 656b corresponding to a second workout application (e.g., "Workout App #2"). In some embodiments, upon detecting user input to select one of the user interface objects 654a to 654c, the external computer system 646 displays application user interface objects on computer system 646 corresponding to all applications on the external computer system 646 and / or related to the selected category. Thus, in some embodiments, the application user interface 656 includes more than two application user interface objects.
[0206] In Figure 6N, the external computer system 646 detects user input 650h (e.g., a tap gesture or other selection / navigation input) corresponding to the selection of the first application user interface object 656a. Upon detecting user input 650h, the external computer system 646 displays the configuration user interface 658, as shown in Figure 6O. In Figure 6O, the configuration user interface 658 allows the user to configure various actions that the computer system 600 should perform based on various types of user inputs corresponding to the first hardware input device 606a.
[0207] In Figure 6O, the configuration user interface 658 includes a category user interface object 658a that identifies the selected category (e.g., "Workouts"), an application user interface object 658b that identifies the selected application (e.g., "Workout App #1"), and operation user interface objects 658c-658e. In some embodiments, the external computer system 646 displays the configuration user interface 648 in response to detecting user input that selects the category user interface object 658a. In some embodiments, the external computer system 646 displays the application user interface 656 in response to detecting user input that selects the application user interface object 658b (for example, if computer system 600 and / or the external computer system 646 include multiple applications corresponding to the categories associated with the selected user interface objects 654a-654c of the category user interface 648).
[0208] In Figure 6O, the first operation user interface object 658c corresponds to a first operation configured to be performed by the first hardware input device 606a in response to a first type of user input (e.g., a first press). For example, the first operation user interface object 658c indicates that the first hardware input device 606a is configured to cause the computer system 600 to open up outdoor running activity goals in response to a first press on the first hardware input device 606a. That is, in response to detecting a first press on the first hardware input device 606a, the computer system 600 displays a user interface that allows the user to input and / or otherwise select outdoor running activity goals (e.g., time, distance, and / or calories). In some embodiments, in response to detecting user input that selects the first operation user interface object 658c, the external computer system 646 is configured to display a list of selectable operations that the computer system 600 can perform in response to a first press on the first hardware input device 606a. Therefore, the first operational user interface object 658c enables the user to configure the first hardware input device 606a to cause the computer system 600 to perform an action selected and / or set by the user in response to a first press of the first hardware input device 606a.
[0209] The second operation user interface object 658d corresponds to a second operation configured to be performed by the first hardware input device 606a in response to a second type of user input (e.g., a second press). For example, the second operation user interface object 658d indicates that the first hardware input device 606a is configured to cause the computer system 600 to pause the outdoor running operation in response to a second press (a press gesture or other selection / navigation input corresponding to the first hardware input device 606a detected by the computer system 600 after the first press). In some embodiments, upon detecting user input to select the second operation user interface object 658d, the external computer system 646 is configured to display a list of selectable operations that the computer system 600 can perform in response to a second press of the first hardware input device 606a. Therefore, the second operational user interface object 658d enables the user to configure the first hardware input device 606a to cause the computer system 600 to perform an action selected and / or set by the user in response to a second press of the first hardware input device 606a.
[0210] The third operation user interface object 658e corresponds to a third operation configured to be performed by the first hardware input device 606a in response to a third type of user input (e.g., pressing both the first hardware input device 606a and the second hardware input device 606b). For example, the third operation user interface object 658e indicates that the first hardware input device 606a is configured to cause the computer system 600 to perform a waterlock operation in response to both the first hardware input device 606a and the second hardware input device 606b being pressed (e.g., simultaneous and / or sequential pressing of the first hardware input device 606a and the second hardware input device 606b). In some embodiments, upon detecting user input that selects the third operation user interface object 658e, the external computer system 646 is configured to display a list of selectable operations that the computer system 600 can perform in response to pressing both the first hardware input device 606a and the second hardware input device 606b. Therefore, the third operational user interface object 658e enables the user to configure the first hardware input device 606a to cause the computer system 600 to perform user-selected and / or user-configured actions in response to pressing both the first hardware input device 606a and the second hardware input device 606b.
[0211] In Figure 6O, the configuration user interface 658 includes a gesture area 660 that provides visual indications of user input types corresponding to a first hardware input device 606a, which may be provided to perform various operations. The gesture area 660 enables the user to quickly learn and / or confirm that a particular type of user input corresponding to the first hardware input device 606a (and / or second hardware input device 606b) can perform a selected operation.
[0212] Figures 6M to 6O show a first hardware input device 606a configured to perform actions for a workout application, but in some embodiments, the first hardware input device 606a is configured to perform actions for various applications. Table 1 below shows examples of actions configured to be performed by the computer system 600 in response to detecting user input corresponding to the first hardware input device 606a and / or the second hardware input device 606b (for example, based on individual user-selected configurations of the first hardware input device 606a and / or the second hardware input device 606b). In some embodiments, the columns in Table 1 are alternative configurations of the first hardware input device 606a, and thus the first hardware input device 606a is configured to cause the computer system 600 to perform one or more actions corresponding to one application and / or category (for example, one row in Table 1). In some embodiments, the first hardware input 606a is not configured to cause the computer system 600 to perform operations corresponding to two or more applications and / or categories (for example, the first hardware input device 606a cannot be configured to cause the computer system 600 to perform operations in two or more rows of Table 1). [Table 1]
[0213] Figure 7 is a flowchart illustrating a method for initiating operation using a computer system according to several embodiments. Method 700 involves a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) communicating with a display generation component (e.g., 602, 646a, and / or 1300a) (e.g., a display controller, a touch-sensitive display system, a projector, a display screen, a display monitor, and / or a holographic display) and one or more hardware input devices (e.g., 606a, 606b, and / or 606c) (e.g., one or more physical buttons (e.g., buttons included in and / or on the housing of the computer system), a rotatable input device, a pressable input device, and / or a solid button with a pressure sensor) (e.g., 100, 300, 500, 600, 646, and / or 1300) ((e.g., an electronic device, a smartphone or smartwatch or similar smart device It is performed on a device (such as a computer, mobile device, or wearable device). In some embodiments, one of the hardware input devices (e.g., 606a) among one or more hardware input devices can be configured for a computer system (e.g., 100, 300, 500, 600, and / or 646) to perform a default function in response to user input (e.g., a default input of a particular type) (e.g., user-selected, user-defined, and / or user-customized). In some embodiments, one or more hardware input devices (e.g., 606a, 606b, and / or 606c) include a tactile output generator that provides tactile feedback (e.g., haptic feedback) in response to detecting user input corresponding to individual hardware input devices of one or more hardware input devices. Some operations of Method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0214] As will be described later, Method 700 provides an intuitive way to guide the user through the process of initiating operation. This method reduces the cognitive burden on the user when initiating operation, thereby creating a more efficient human-machine interface. In the case of battery-powered computing devices, enabling the user to start operation faster and more efficiently saves power and extends the time between battery charges.
[0215] A computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) detects the occurrence of conditions (e.g., 650a, 650b, and / or 650d) associated with displaying a first user interface (e.g., 616, 622, and / or 636) associated with a first operation (e.g., a request to navigate to the first user interface, or an event that causes the device to navigate from another user interface to the first user interface, transition the first user interface from a low-power state to an active state, or turn on the display device to display the first user interface) (702).
[0216] In response to detecting the occurrence of a condition, the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays a first user interface (e.g., 612, 622, and / or 636) (704).
[0217] While a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is displaying (704) a first user interface (e.g., 612, 622, and / or 636) (e.g., a clock face user interface, a user interface related to an application of the computer system, and / or a user interface including one or more application user interface objects corresponding to an application of the computer system), one or more hardware input devices (e.g., 606a, 606b, and / or 606c) of the first hardware input device (e.g., 606a) (e.g., a pressable button located on the side of the computer system's casing) are configured in a first configuration that enables the first hardware input device to perform a first operation (e.g., the first hardware input device performs a first operation (e.g., an application of the computer system (and optionally a first user interface) via a first type of user input (e.g., press, long press, double press, and / or multiple press user input)) In accordance with the determination that a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is configured to perform an action (e.g., an action selected by the user) (e.g., via user input and / or user selection) associated with an application associated with an interface, the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays graphical user interface objects (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (606a) can perform a first action via display generation components (e.g., 602, 646a, and / or 1300a) (e.g., overlaid on the first user interface) (706) (e.g., one or more user interface objects indicating text, user interface objects, user interface objects containing the same first color as the first color of the first hardware input device, and / or indicating an application that indicates a first action, and / or indicating user input that causes the computer system to perform a first action), (e.g.,A graphical user interface object provides the user of the computer system with visual guidance and / or indications that user input corresponding to a first hardware input device (606a) performs a first operation. In some embodiments, the first hardware input device includes a first color different from a second color of the computer system enclosure.
[0218] While a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is displaying (704) a first user interface (e.g., 612, 622, and / or 636) (e.g., a clock face user interface, a user interface related to an application of the computer system, and / or a user interface including one or more application user interface objects corresponding to an application of the computer system), one of the first hardware input devices (e.g., 606a, 606b, and / or 606c) is not configured in a first configuration (e.g., the first hardware input device (e.g., 606a) is not configured to perform a first operation via a first type of user input. In accordance with the determination that a first action that would enable execution (e.g., an action associated with an application of the computer system (e.g., an action selected by the user) (and optionally, an application associated with the first user interface) (e.g., via user input and / or user selection) is not configured, the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) ceases to display graphical user interface objects (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606) can perform the first action (708) (e.g., maintain the display of the first user interface without displaying graphical user interface objects).
[0219] By displaying a graphical user interface object according to the determination that the first hardware input device is configured in a first configuration, and ceasing to display a graphical user interface object according to the determination that the first hardware input device is not configured in a first configuration, the computer system provides the user with an indication of whether a first operation can be performed at a particular time via user input to select the first hardware input device, thereby providing the user with improved visual feedback.
[0220] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) detects the occurrence of conditions (e.g., 650a and / or 650d) associated with displaying a second user interface (e.g., 616, 622, and / or 636) associated with a second operation (e.g., a request to navigate to the second user interface, or an event that causes the device to navigate from another user interface to the second user interface, transition the second user interface from a low-power state to an active state, or turn on the display device to display the second user interface). In response to detecting the occurrence of a condition, the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays the second user interface (e.g., 612, 622, and / or 636). While a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is displaying a second user interface (e.g., 612, 622, and / or 636) (e.g., a clock face user interface, a user interface related to an application of the computer system, and / or a user interface including one or more application user interface objects corresponding to an application of the computer system), the first hardware input device (e.g., 606a, 606b, and / or 606c) of one or more hardware input devices (e.g., 606a, 606b, and / or 606c) For example, 606a) (e.g., a pressable button located on the side of the computer system enclosure) is configured in a second configuration (e.g., the first hardware input device is configured to perform a second operation via a second type of user input (e.g., press, long press, double press, and / or multiple press user input) which enables the first hardware input device (e.g., 606a) to perform a second operation (e.g., an operation related to an application of the computer system (and optionally, an application related to a second user interface) (e.g., an operation selected by the user)) (e.g.,In accordance with the determination that a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is configured (through user input and / or user selection), the computer system displays a second graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) through a display generation component (e.g., overlaid on the second user interface) that indicates the first hardware input device can perform a second operation (e.g., through one or more user interface objects that indicate text, user interface objects, a user interface object that includes the same first color as the first color of the first hardware input device, and / or indicates a second operation, an application, and / or user input that causes the computer system to perform a second operation) (e.g., the graphical user interface object provides visual guidance and / or indication to the user of the computer system that the user input corresponding to the first hardware input device (e.g., 606a) performs a second operation). While a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is displaying a second user interface (e.g., 612, 622, and / or 636) (e.g., a clock face user interface, a user interface associated with an application of the computer system, and / or a user interface including one or more application user interface objects corresponding to an application of the computer system), one of the first hardware input devices (e.g., 606a, 606b, and / or 606c) enables the first hardware input device (e.g., 606a) to perform a second operation (e.g., a second operation via a second type of user input (e.g., an application associated with the computer system (e.g., a user selection operation) (and optionally, an application associated with the second user interface))In accordance with the determination that a second configuration is not configured (not configured by user input and / or user selection), the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) ceases displaying a second graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that the first hardware input device (e.g., 606a) can perform a second operation (e.g., maintaining the display of the second user interface without displaying the second graphical user interface object). In some embodiments, the first hardware input device includes a first color different from the second color of the computer system's enclosure.
[0221] The system provides the user of a computer system with an indication of whether a second operation can be performed at a given time via user input selecting a first hardware input device, by displaying a second graphical user interface object according to the determination that a first hardware input device is configured in the second configuration, and ceasing to display the second graphical user interface object according to the determination that a first hardware input device is not configured in the second configuration, thereby providing the user with improved visual feedback.
[0222] In some embodiments, the first user interface (e.g., 616, 622, and / or 636) and the second user interface (e.g., 616, 622, and / or 636) are the same user interface (for example, the computer system is configured to perform various actions (e.g., both first and second actions) based on user input corresponding to the first hardware input device while the same user interface is displayed). By enabling the first hardware input device to cause the computer system to perform various actions while the same user interface is displayed, the user can quickly perform various actions without requiring further user input directed to the user interface, thereby reducing the number of inputs required to perform the actions.
[0223] In some embodiments, the first user interface (e.g., 616, 622, and / or 636) and the second user interface (e.g., 616, 622, and / or 636) are different user interfaces (for example, a computer system is configured to perform various operations (e.g., a first operation and a second operation) based on user input corresponding to a first hardware input device while displaying various user interfaces). By enabling the first hardware input device to perform various operations while various user interfaces are displayed, the user can quickly perform a specific operation without requiring further user input in the displayed user interface, thereby reducing the number of inputs required to perform the operation.
[0224] In some embodiments, a first user interface (e.g., 616, 622, and / or 636) is associated with a first application of the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) (e.g., a first application that enables the computer system to perform one or more first functions and / or operations of the computer system), and a second user interface (e.g., 616, 622, and / or 636) is associated with a second application different from the first application of the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300). Associated with an application (for example, a second application of a computer system that enables the computer system to perform one or more second functions and / or operations) (for example, a first hardware input device, when selected via user input, is configured to cause the computer system to perform a first operation when the first user interface of the first application is displayed, and a first hardware input device, when selected via user input, is configured to cause the computer system to perform a second operation different from the first operation when the second user interface of the second application is displayed).
[0225] By enabling a first hardware input device to perform various actions while various user interfaces of different applications are displayed, users can quickly perform specific actions without requiring further user input on the displayed user interface, thereby reducing the number of inputs required to perform the actions.
[0226] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that displays a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation includes a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that adjusts the appearance (e.g., 644a and / or 644b) (e.g., color, darkness, opacity, transparency, thickness, and / or size) of selectable user interface objects (e.g., 622a, 622d, and / or 636e) of a first user interface (e.g., 616, 622, and / or 636). (e.g., when selected via user input, the user interface object and / or affordance is configured to cause the computer system to perform a particular operation). By adjusting the appearance of the selectable user interface object, an indication of the first operation that can be performed via selection of the first hardware input device is provided to the user, thereby providing improved visual feedback to the user.
[0227] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that adjusts the appearance of selectable user interface objects (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) of a first user interface (e.g., 616, 622, and / or 636) includes a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that adjusts the appearance of selectable user interface objects (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) of a first user interface (e.g., 628, 632, and / or 640), and a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that displays a boundary and / or edge around the selectable user interface object (e.g., 622a, 622d, and / or 636e) which includes a different thickness and / or color from the thickness and / or color of the selectable user interface object before displaying the graphical user interface object. By displaying outlines around selectable user interface objects, the user is provided with an indication of a first action that can be performed via the selection of a first hardware input device, thereby providing the user with improved visual feedback.
[0228] In some embodiments, a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation includes a first color (e.g., yellow, orange, green, and / or a different color than the color of the computer system's housing), and the first hardware input device (e.g., 606a, 606b, and / or 606c) includes the first color (e.g., yellow, orange, green, and / or a different color than the color of the computer system's housing). In some embodiments, to visually couple the graphical user interface object to the hardware input device, the first hardware input device has a color that harmonizes with or is an accent color to the color of the graphical user interface object indicating the first operation. By displaying the graphical user interface object in the same color as the first hardware input device, the user can associate the selection of the first hardware input device with the performance of the first operation, thereby providing the user with improved visual feedback.
[0229] In some embodiments, a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation includes a first color (e.g., yellow, orange, green, and / or another color different from the color of the computer system enclosure) based on a second color of the first hardware input device (e.g., 606a, 606b, and / or 606c) (e.g., a first color selected based on a second color of the first hardware input device so that the user can associate the selection of the first hardware input device with the performance of the first operation). By displaying the graphical user interface object in a first color based on a second color of the first hardware input device, the user can associate the selection of the first hardware input device with the performance of the first operation, thereby providing the user with improved visual feedback.
[0230] In some embodiments, a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation is located (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) on a display generation component (e.g., 602, 646a, and / or 1300a) adjacent to the first hardware input device (e.g., 606a, 606b, and / or 606c) (e.g., a location visible to a user of a computer system) (e.g., a location adjacent, adjacent, and / or differently close to the physical location of the first hardware input device (e.g., the location of the first hardware input device relative to the display generation component) so that a user of a computer system associates the selection of the first hardware input device with the performance of a first operation). By displaying a graphical user interface object adjacent to the first hardware input device, the user can associate the selection of the first hardware input device with the execution of a first action, thereby providing the user with improved visual feedback.
[0231] In some embodiments, the display position (e.g., 614 and / or 634) of graphical user interface objects (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) on a display generation component (e.g., 602, 646a, and / or 1300a) is based on the orientation setting of the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) (for example, the computer system is a wearable device (e.g., a smartwatch) configured to be worn in various orientations (e.g., on the left wrist or the right wrist), and the position of the graphical user interface objects on the displayed display generation component (e.g., whether the first hardware input device is to the left or right of the display generation component relative to the user when the computer system is being worn) is determined based on the orientation setting). By displaying graphical user interface objects at specific positions based on the orientation settings of the computer system, the user can associate the selection of a first hardware input device with the execution of a first action, regardless of whether the computer system is oriented in a first or second orientation setting, thereby providing the user with improved visual feedback.
[0232] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays graphical user interface objects (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation, while the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) receives user input (e.g., 650c and / or 650f) (e.g., a press gesture to select the first hardware input device) requesting the first operation to be performed. Here, user input (e.g., 650c and / or 650f) includes multiple presses of a first hardware input device (e.g., 606a, 606b, and / or 606c) (e.g., a first press gesture selecting the first hardware input device includes one or more additional press gestures selecting the first hardware input device (e.g., one or more additional press gestures selecting the first hardware input device are detected and / or received within a predetermined time interval from the first press gesture)). In some embodiments, upon detecting user input including a single press (e.g., one press), the computer system performs a second action different from the first action. In some embodiments, upon detecting user input including a single press (e.g., one press), the computer system cancels the execution of the first action and / or another action. In some embodiments, upon detecting user input including a single press (e.g., one press), the computer system ignores the user input. By requesting the execution of a first action through multiple presses of a first hardware input device, the first hardware input device can perform multiple different actions through various user inputs without requiring the user to perform additional user inputs and / or navigate to different user interfaces, thereby reducing the number of inputs required to perform the actions.
[0233] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays graphical user interface objects (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation, while the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) receives user input (e.g., 650c and / or 650f) (e.g., a press gesture to select the first hardware input device) requesting the first operation to be performed. Here, user input (e.g., 650c and / or 650f) includes a first press input corresponding to a second hardware input device (e.g., 606a, 606b, and / or 606c) that occurs in conjunction with a second press input corresponding to a first hardware input device (e.g., 606a, 606b, and / or 606c), which in turn occurs with the first press input corresponding to the second hardware input device (e.g., the first press input and / or the first press and hold input) (e.g., within a time threshold before, after, and / or simultaneously with the second press input of the first hardware input device). By requesting the execution of an action via the press of the first hardware input device and the press of the second hardware input device, the first hardware input device (e.g., alone or together with other hardware input devices) can perform multiple different actions via various user inputs without requiring the user to make additional user inputs and / or move to different user interfaces, thereby reducing the number of inputs required to perform an action.
[0234] In some embodiments, a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation is provided when one or more of a set of usage criteria are met (e.g., the computer system has been running since it was first turned on and / or has been associated with a user of the computer system for less than a predetermined time, the first hardware input device has been activated less than a predetermined number of times, and / or the first hardware input device is activated a certain number of times) A beginner-friendly graphical user interface object (e.g., 618) (e.g., a graphical user interface object containing the first amount of content (e.g., images, icons, symbols, animations, and / or text)) is used to cover (e.g., cover, block, dehighlight, and / or overlay) a first amount (e.g., part of the display generating components) (e.g., images, icons, symbols, animations, and / or text) of the display area that displays the first user interface (e.g., 616), according to the determination that the time spent in configuration 1 is less than a predetermined time.In some embodiments, a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation according to the determination that a set of user criteria are not met (e.g., the computer system has been operating in association with a user of the computer system for a predetermined time or longer since it was first turned on, and / or for a predetermined time or longer), displays the first user interface (e.g., 616) in a display area. Intermediate to advanced graphical user interface objects (e.g., 620 and / or 620a) that cover (e.g., cover, block, dehighlight, and / or overlay) a second amount of a region that is smaller than a first amount (e.g., a portion of the display generation elements) (e.g., graphical user interface objects containing a second amount of content that is less than a first amount of content (e.g., images, icons, symbols, animations, and / or text)) (e.g., intermediate to advanced graphical user interface objects are smaller in size (and optionally contain less content compared to beginner graphical user interface objects, and / or otherwise occupy a smaller portion of the display generation elements)).
[0235] By displaying a graphical user interface object as a beginner-friendly graphical user interface object when one or more of a set of usage criteria are met, and displaying it as an intermediate to advanced graphical user interface object when one or more of a set of usage criteria are not met, users can quickly learn the capabilities of a first hardware input device to trigger a first action, thereby improving visual feedback to the user.
[0236] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displaying a novice-friendly graphical user interface object (e.g., 618) is equivalent to a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) de-emphasizing the appearance of a first user interface (e.g., 616) (e.g., dimming, fading, hiding, covering, and / or blocking at least a portion of the first user interface). Furthermore, computer systems that display intermediate-to-advanced graphical user interface objects (e.g., 620 and / or 620a) (e.g., 100, 300, 500, 600, 646, and / or 1300) do not include computer systems that de-highlight the appearance of the first user interface (e.g., 616) (e.g., 100, 300, 500, 600, 646, and / or 1300). (For example, displaying intermediate-to-advanced graphical user interface objects means dimming, fading, hiding, covering, and / or blocking at least a portion of the first user interface). By displaying beginner-friendly graphical user interface objects while de-highlighting the appearance of the first user interface, the user can better see the beginner-friendly graphical user interface objects and understand that the first hardware input device is causing the computer system to perform the first action, thereby providing the user with improved visual feedback.
[0237] In some embodiments, a graphical user interface object for beginners (e.g., 618) includes a first amount of content (e.g., 618a, 618b, and / or 618c) (e.g., visual elements, icons, symbols, animations, and / or text) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation (e.g., user input to select the first hardware input device by providing guidance and / or obstacles to the user of the computer system causes the computer system to perform the first operation). A graphical user interface object for intermediate and advanced users (e.g., 620) includes a second amount of content (e.g., 620a) (e.g., visual elements, icons, symbols, animations, and / or text) less than the first amount of content, indicating that a first hardware input device can perform a first operation. (For example, a graphical user interface object for intermediate to advanced users assumes that the user is familiar with the capabilities of a first hardware input device that triggers a first action, and therefore provides the user of the computer system with less guidance and / or obstacles to cause the computer system to perform the first action by user input selecting the first hardware input device.) A graphical user interface object for beginners with a first amount of content allows the user to better understand how the first hardware input device causes the computer system to perform the first action, thereby providing the user with improved visual feedback. A graphical user interface object for intermediate to advanced users with a second amount of content still allows the user to understand how the first hardware input device causes the computer system to perform the first action without requiring the display of additional information, thereby reducing the battery usage of the computer system.
[0238] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that displays a beginner-friendly graphical user interface object (e.g., 618) includes a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that displays a time-varying animation of the beginner-friendly graphical user interface object (e.g., 618). Computer systems that display intermediate and advanced graphical user interface objects (e.g., 620 and / or 620a) (e.g., 100, 300, 500, 600, 646, and / or 1300) do not display time-varying animations of intermediate and advanced graphical user interface objects (e.g., 620 and / or 620a). (e.g., intermediate and advanced graphical user interface objects are not displayed with motion, pulses, and / or changes in size, shape, opacity, brightness, and / or position over time). Beginner-friendly graphical user interface objects, including animations, allow users to better understand how a first hardware input device causes the computer system to perform a first action, thereby providing them with improved visual feedback. Intermediate to advanced-level graphical user interface objects, without animations, allow users to understand how a first hardware input device causes the computer system to perform a first action without requiring additional processing power from the computer system, thereby reducing the computer system's battery usage.
[0239] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that detects the occurrence of conditions related to displaying a first user interface (e.g., 616, 622, and / or 636) includes detecting a wrist-raising gesture (e.g., the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is a wearable device configured to be worn on the user's wrist and including one or more sensors (e.g., one or more accelerometers, gyroscopes, and / or inertial measuring devices) that enable the computer system to detect that the orientation of the computer system indicates that the user's wrist is in a raised position (e.g., the user is positioning the computer system so that the user can display display-generating components and / or otherwise interact with the computer system)). By displaying a first user interface when the computer system detects a wrist-raising gesture, the computer system can display information such as graphical user interface objects to the user of the computer system without requiring the user to make any additional user input, thereby reducing the number of inputs required to perform the action.
[0240] In some embodiments, the detection of the occurrence of conditions related to the display of a first user interface (e.g., 616, 622, and / or 636) by a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) indicates that the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is in an active state (e.g., the computer system has detected a wrist-raising gesture and / or other user input requesting the display-generating component to actively display information (e.g., a user interface)); the display-generating component is not disabled / off, or is a low-power and / or infrequently updated, always-on user interface (e.g., a user interface displayed when the computer is operating in low-power mode and not in high-power mode). When displaying user interfaces such as the above, the overall brightness of the display in low power mode is lower than the overall brightness of the display in high power mode; when the computer system is in low power mode, one or more processors of the computer system are awake for a lower proportion of time compared to high power mode; when the computer system is in low power mode, one or more processors wake up less frequently over a longer period of time compared to high power mode; when the computer system is operating in low power mode, a smaller portion of the processors are operating compared to high power mode; and / or the computer system employs lower power consumption processor power management techniques (e.g., slowing down or turning off the core clock, slowing down or turning off the bus clock, and / or lowering the main computer processing unit voltage) that are not employed in higher power consumption modes.
[0241] By displaying a first user interface when the computer system detects that a display generation component is active, the computer system can display information such as graphical user interface objects to the user of the computer system without requiring the user to make any additional user input, thereby reducing the number of inputs required to perform an action.
[0242] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) that detects the occurrence of conditions related to displaying a first user interface (e.g., 616, 622, and / or 636) requests a transition from displaying a second user interface (e.g., 604 and / or 616) to displaying the first user interface (e.g., 616, 622, and / or 636) (e.g., replacing the previously displayed user interface (e.g., the second user interface) with the first user interface) The computer system includes (e.g., 100, 300, 500, 600, 646, and / or 1300) which detects user input (e.g., 650a, 650b, and / or 650d) (one or more user inputs that move the computer system between user interfaces, such as a swipe gesture, one or more tap gestures, a long tap gesture, a voice command and / or gesture (e.g., a voice command and / or gesture that requests an action from a virtual assistant), and / or a press gesture on one or more hardware input devices). By displaying the first user interface when the computer system detects a request to transition from the second user interface to the first user interface, the computer system can display graphical user interface objects without requiring the user to provide additional user input, thereby reducing the number of inputs required to perform an action.
[0243] In some embodiments, displaying a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation includes animating the graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) to pulsate a predetermined number of times before stopping (e.g., repeatedly increasing or decreasing size, thickness, opacity, transparency, and / or brightness) (e.g., the graphical user interface object pulsates a predetermined number of times and is then displayed as a still image on the display generation component). By displaying the graphical user interface object with a pulsating animation, the user can associate the selection of a first hardware input device with the performance of a first operation, thereby providing the user with improved visual feedback.
[0244] In some embodiments, before the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) detects the occurrence of a condition (e.g., before displaying the first user interface), the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) configures the first configuration (e.g., the first hardware input device and / or other features and / or components of the computer system) (e.g., via the display generation component or the display generation component of a companion computer system used to set up and / or configure the computer system). A second user interface (e.g., 648, 656, and / or 658) is displayed for configuring a first hardware input device (e.g., 606a, 606b, and / or 606c) in a configuration user interface and / or setup user interface, where the second user interface (e.g., 648, 656, and / or 658) includes a plurality of selectable application types (e.g., 654a-654c) (e.g., user interface objects corresponding to categories and / or functions of applications configured to run by the computer system). In some embodiments, the companion computer system (e.g., 646) includes an external computer system that is separate from and / or distinct from the computer system (e.g., 600) and communicates with the computer system (e.g., 600), and / or can receive one or more user inputs associated with the configuration and / or configuration settings of the computer system and supply (e.g., transmit) information associated with the configuration and / or configuration settings of the computer system to the computer system (e.g., 600).
[0245] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays a second user interface (e.g., 648, 656, and / or 658) for configuring a first hardware input device (e.g., 606a, 606b, and / or 606c), and the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) receives first information corresponding to the selection of a first selectable application type (e.g., 654a-654c) out of a plurality of selectable application types (e.g., 654a-654c) (e.g., first information including that the computer system and / or companion computer system has detected a first user input (e.g., a tap gesture) that selects the first selectable application type). In some embodiments, first information corresponding to the selection of a first selectable application type from a plurality of selectable application types is received by a computer system (e.g., 600) via detected user input (e.g., the computer system displays a second user interface for configuring a first hardware input device in a first configuration, and the computer system detects user input for selecting a first selectable application type). In some embodiments, a companion computer system (e.g., 646) displays a second user interface for configuring a first hardware input device having a first configuration, and the companion computer system (e.g., 646) detects user input for selecting a first selectable application type and provides the computer system (e.g., 600) with information corresponding to the selection of the first selectable application type.
[0246] In some embodiments, in response to a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) receiving first information corresponding to a selection of a first selectable application type (e.g., 654a-654c), the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays one or more applications (e.g., 656a and / or 656b) corresponding to the first selectable application type (e.g., 654a-654c) (e.g., user interface objects corresponding to applications of the computer system belonging to the category of the first selectable application type and / or user interface objects otherwise configured to perform functions related to the first selectable application type) (e.g., via a display generation component or a display generation component of a companion computer system used to set up and / or configure the computer system).
[0247] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) receives second information corresponding to the selection of a first application (e.g., 656a and / or 656b) of one or more applications (e.g., 656a and / or 656b) corresponding to a first selectable application type (e.g., 654a to 654c) (e.g., user interface objects corresponding to computer system applications belonging to the category of the first selectable application type and / or user interface objects configured to perform functions related to the first selectable application type). (e.g., the second information includes the detection of a second user input (e.g., a tap gesture) by the computer system and / or companion computer system in selecting the first application. In some embodiments, second information corresponding to the selection of a first application from one or more applications corresponding to a first selectable application type is received by the computer system (e.g., 600) via detected user input (e.g., the computer system displays or an application corresponding to the first selectable application type and detects user input corresponding to the first application). In some embodiments, second information corresponding to the selection of a first application from one or more applications corresponding to a first selectable application type is received by the computer system (e.g., 600) from a companion computer system (e.g., 646) (e.g., the companion computer system displays one or more applications corresponding to the first selectable application type, detects user input to select a first application and provides the computer system with information corresponding to the selection of the first application).
[0248] In some embodiments, when a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) receives second information corresponding to the selection of a first application (e.g., 656a and / or 656b) from one or more applications (e.g., 656a and / or 656b) corresponding to a first selectable application type (e.g., 654a to 654c), the 00) displays one or more selectable options (e.g., 658c-658e) (e.g., functions and / or actions configured (through one or more user inputs) for a first hardware input device (e.g., 606a, 606b, and / or 606c) to associate operation with a first hardware input device (e.g., 606a, 606b, and / or 606c) (e.g., functions and / or actions configured (through one or more user inputs) for a first application to have the computer system perform).
[0249] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) receives third information corresponding to a selection of a first selectable option (e.g., 658c - 658e) of one or more selectable options corresponding to a first operation (e.g., the first selectable option corresponds to the first operation, and the computer system associates the first selectable option with a first hardware input device such that activation of the first hardware input device is configured to cause the computer system to perform the first operation). In some embodiments, the third information corresponding to the selection of the first selectable option of one or more selectable options corresponding to the first operation is received by the computer system (e.g., 600) via a detected user input (e.g., the computer system displays one or more selectable options and detects a user input selecting the first selectable option). In some embodiments, the third information corresponding to the selection of the first selectable option of one or more selectable options corresponding to the first operation is received by the computer system from a companion computer system (e.g., 646) (e.g., the companion computer system displays one or more selectable options, detects a user input selecting the first selectable option, and provides information corresponding to the selection of the first selectable option to the computer system).
[0250] By enabling a user selection of the first operation, the user can customize the operation that is performed when the first hardware input device is activated, thereby providing additional control options without cluttering the user interface with additional displayed controls.
[0251] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) receives first information corresponding to the selection of a first selectable application type (e.g., 654a-654c), and the first selectable application type (e.g., 654a-654c) does not include two or more applications (e.g., 656a and / or 656b) (e.g., the computer system includes only one application associated with the category of the first selectable application type, and / or the computer system includes a function associated with the first selectable application type). In accordance with the determination that the first selectable application type contains only one application configured to perform the first selectable application type, the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) ceases to display one or more applications (e.g., 656a and / or 656b) corresponding to a first selectable application type (e.g., 654a-654c) (e.g., the computer system and / or companion computer system does not display one or more applications corresponding to the first selectable application type, but instead displays one or more selectable options for associating an action with a first hardware input device). When the first selectable application type does not contain two or more applications, by ceasing to receive second information corresponding to the selection of a first application from one or more applications corresponding to the first selectable application type, the user can quickly associate an action with a first hardware input device without requiring additional user input, thereby reducing the number of user inputs required to perform the action.
[0252] In some embodiments, during a setup process for configuring a first hardware input device (e.g., 606a, 606b, and / or 606c) (e.g., an initial setup process initiated when the computer system is first turned on and / or a setup process initiated in response to one or more user inputs (e.g., user input to select a first hardware input device and / or user input requesting navigation to a configuration user interface associated with the first hardware input device), the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) may use various user inputs to configure the first hardware input devices (e.g., 606a, 606b, and / or 606c) to perform their respective operations (e.g., via display generation components used to configure the computer system or display generation components of a companion computer system) Display a third user interface (e.g., 658) (e.g., a configuration user interface associated with the first hardware input device) that includes multiple selectable options (e.g., 658a to 658e) (user interface objects corresponding to each application type, application, operation, user input type, and / or other configuration options for the first hardware input device) for configuring via force (e.g., multiple actions performed by the computer system when different user inputs corresponding to the first hardware input device (e.g., single press of the first hardware input device, multiple presses of the first hardware input device, long press of the first hardware input device, and / or press of the first hardware input device and another hardware input device) (e.g., simultaneous press and / or continuous press)) (e.g., a configuration user interface associated with the first hardware input device that allows user selection of one or more features, functions, and / or actions associated with the first hardware input device).In some embodiments, a third user interface (e.g., 658) is displayed via a first display generation component (e.g., 602) of the computer system (e.g., 600) so that the computer system (e.g., 600) is configured to receive and / or detect one or more user inputs constituting a first hardware input device (e.g., 606a, 606b, and / or 606c). In some embodiments, the third user interface (e.g., 658) is displayed via a display generation component (e.g., 646a) of a companion computer system (e.g., 646) (e.g., an external computer system separate from and / or different from the computer system, an external computer system communicating with the computer system, and / or an external computer system capable of receiving one or more user inputs associated with the configuration and / or configuration settings of the computer system), and the companion computer system is configured to receive and / or detect one or more user inputs and provide (e.g., transmit) information regarding the configuration of the first hardware input device to the computer system.
[0253] The first hardware input device enables the computer system to perform various actions based on various types of user input, thereby allowing the user to perform actions without having to navigate to various user interfaces and / or perform additional user input, thereby reducing the number of user inputs required to perform the actions.
[0254] In some embodiments, the setup process occurs when the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is first configured (e.g., when the device is first turned on or connected to a companion computer system) (e.g., the setup process is part of the initial setup process of the computer system, which allows the user to select and / or configure the settings, functions, and / or operations of the computer system (e.g., before the user can use the computer system in normal operating mode)). By displaying a third user interface when the computer system is first turned on, the user can quickly associate one or more operations with a first hardware input device without having to navigate to an additional configuration user interface, thereby reducing the number of user inputs required to perform the operations.
[0255] In some embodiments, the setup process occurs in response to a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) detecting user input (e.g., a press gesture) corresponding to a first hardware input device (e.g., 606a, 606b, and / or 606c) before the first hardware input device (e.g., 606a, 606b, and / or 606c) is configured in a first configuration (e.g., before the computer system's operation detects user input corresponding to the first hardware input device, and displays a third user interface that allows the user to select an operation to associate with the first hardware input device). By displaying a third user interface in response to the detection of user input corresponding to the first hardware input device before the first hardware input device is configured in a first configuration, the user can associate an operation with the first hardware input device without having to navigate to another user interface, thereby reducing the number of user inputs required to perform the operation.
[0256] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) provides a fourth user input (e.g., 650c and / or 650f) corresponding to a first hardware input device (e.g., 606a, 606b, and / or 606c) (e.g., single press of the first hardware input device, multiple presses of the first hardware input device, long press of the first hardware input device, and / or press of the first hardware input device and another hardware input device) The computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) detects a vice press (e.g., simultaneous press and / or continuous press) and, in response to the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) detecting a fourth user input (e.g., 650c and / or 650f), performs a first action (e.g., the computer system performs the action associated with the first hardware input device and / or the fourth user input). By performing the first action in response to the fourth user input, the user can have the computer system perform the first action without having to make additional user inputs to navigate to a specific application and / or user interface associated with the first action, thereby reducing the number of user inputs required to perform the action.
[0257] In some embodiments, a fourth user input (e.g., 650c and / or 650f) is received while the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) is not displaying the first user interface (e.g., 616, 622, and / or 636) (for example, the computer system is configured to perform a first action in response to detecting a fourth user input even when the computer system is not displaying the first user interface). By performing a first action in response to a fourth user input while the computer system is not displaying the first user interface, the user can have the computer system perform the first action without having to provide additional user input to navigate to specific applications and / or user interfaces related to the first action, thereby reducing the number of user inputs required to perform the action.
[0258] In some embodiments, when a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) detects a fourth user input (e.g., 650c and / or 650f) corresponding to a first hardware input device (e.g., 606a, 606b, and / or 606c), the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) uses a display generation component (e.g., 602, 646a, and / or 1300a) to display a fourth user input (e.g., 650c and / or 650f) corresponding to a first hardware input device (e.g., 606a, 606b, and / or 606c), the computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays a fourth user input (e.g., 650c and / or 650f) via a display generation component (e.g., 602, 646a, and / or 1300a). A visual indication (e.g., 612, 612b, 620a, 638a, and / or 638b) (e.g., a visual element and / or graphical user interface object displayed in close proximity to the first hardware input device (e.g., overlaid on the currently displayed user interface) to indicate that a fourth user input has been detected and / or that the fourth user input is causing the computer system to perform a first operation) is displayed to the user of the computer system, thereby providing the user with improved visual feedback by displaying a visual indication in response to the detection of a fourth user input, thereby confirming that the fourth user input is causing the computer system to perform a first operation.
[0259] In some embodiments, the visual indication (e.g., 612, 612b, 620a, 638a, and / or 638b) includes a first color (e.g., yellow, orange, green, and / or another color different from the color of the computer system's casing), and the first hardware input device (e.g., 606a, 606b, and / or 606c) includes a first color (e.g., yellow, orange, green, and / or another color different from the color of the computer system's casing). By displaying the visual indication in the same color as the first hardware input device, the user can confirm that a fourth user input corresponding to the first hardware input device has caused the computer system to perform a first action, thereby providing the user with improved visual feedback.
[0260] In some embodiments, the visual indication (e.g., 612, 612b, 620a, 638a, and / or 638b) includes a first color (e.g., yellow, orange, green, and / or another color different from the color of the computer system housing) based on a second color of a first hardware input device (e.g., 606a, 606b, and / or 606c) (e.g., a first color selected based on the second color of the first hardware input device so that the user can associate the selection of the first hardware input device with the performance of a first operation). By displaying the visual indication in a first color based on the second color of the first hardware input device, the user can confirm that a fourth user input corresponding to the first hardware input device has caused the computer system to perform a first operation, thereby providing the user with improved visual feedback.
[0261] In some embodiments, a visual indication (e.g., 612, 612b, 620a, 638a, and / or 638b) includes text (e.g., 612a) and / or a second graphical user interface object (e.g., 612a) indicating a first action. (For example, the visual indication includes information confirming that a fourth user input corresponding to a first hardware input device has caused and / or is causing the computer system to perform a first action.) By displaying a visual indication with text and / or a second graphical user interface object, the user can confirm that a fourth user input corresponding to a first hardware input device has caused the computer system to perform a first action, thereby providing the user with improved visual feedback.
[0262] In some embodiments, according to the determination that a fourth user input (e.g., 650c and / or 650f) corresponds to a first hardware input device (e.g., 606a, 606b, and / or 606c) (e.g., including a user input where the fourth user input is directed only to the first hardware input device), the visual indication (e.g., 612, 612b, 620a, 638a, and / or 638b) includes a first appearance (e.g., 620a) (e.g., the visual indication is displayed in its entirety at a first position on a display generating component adjacent to and / or associated with the first hardware input device). When it is determined that a fourth user input (e.g., 650c and / or 650f) corresponds to a first hardware input device (e.g., 606a, 606b, and / or 606c) and a second hardware input device (e.g., 606a, 606b, and / or 606c) (for example, the fourth user input includes a first part (e.g., a first press) corresponding to the first hardware input device and a second part (e.g., a second press) corresponding to the second hardware input device, wherein the first and second parts are simultaneously (e.g., simultaneously) and / or consecutively ( For example, a visual indication (e.g., 612, 612b, 620a, 638a and / or 638b) detected (with a predetermined time difference between them) includes a second appearance (e.g., 638a and / or 638b) that is different from the first appearance (e.g., the visual indication includes a first portion displayed at a first location on a display generating component associated with and / or adjacent to the first hardware input device, and a second portion displayed at a second location on a display generating component associated with and / or adjacent to the second hardware input device).
[0263] By displaying a visual indication having a first appearance or a second appearance based on whether the fourth user input corresponds to the first hardware input device or to both the first and second hardware input devices, the user can confirm that the fourth user input has caused the computer system to perform a first operation, thereby providing the user with improved visual feedback.
[0264] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) provides a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) indicating that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation (e.g., before detecting user input corresponding to a first hardware input device that causes the computer system to perform a first operation). After displaying, and in accordance with the determination that the first hardware input device (e.g., 606a, 606b, and / or 606c) is configured in a third configuration that enables the first hardware input device (e.g., 606a, 606b, and / or 606c) and the second hardware input device (e.g., 606a, 606b, and / or 606c) to perform a third operation (e.g., an operation related to an application of the computer system (and optionally, an application related to the first user interface) which is performed in response to user input corresponding to both the first and second hardware input devices (e.g., a user-selected operation)), the computer system (e.g., for example, the first hardware input device is configured to perform the third operation via a third type of user input (e.g., a press input in both the first and second hardware input devices (e.g., simultaneous press input and / or continuous press input)) (e.g., via user input and / or user selection)), the computer system (e.g., , 100, 300, 500, 600, 646, and / or 1300) via display generation components (e.g., 602, 646a, and / or 1300a) a third graphical user interface object (e.g., 630 and / or 638) (e.g., text, user interface object,Display a user interface object that includes the same first color as the first color of the first hardware input device, and / or one or more user interface objects that indicate a third action, indicate an application, and / or indicate user input that causes the computer system to perform the third action (for example, a third graphical user interface object provides the user of the computer system with visual guidance and / or indication that user input corresponding to both the first and second hardware input devices performs the third action).
[0265] In some embodiments, a computer system (e.g., 100, 300, 500, 600, 646, and / or 1300) displays a graphical user interface object (e.g., 618, 618b, 620a, 626, 626a, 630, and / or 638) and then indicates that a first hardware input device (e.g., 606a, 606b, and / or 606c) can perform a first operation. (For example, before detecting user input corresponding to a first hardware input device that causes a computer system to perform a first operation) Based on the determination that the first hardware input device (e.g., 606a, 606b, and / or 606c) is not configured in a third configuration (for example, the first hardware input device is not configured to perform a third operation via a third type of user input (e.g., via user input and / or user selection)), the first hardware input device (e.g., 606a, 606b, and / or 606c) and the second hardware input device (e.g., 606a, 606b, and / or 606c) enable the first hardware input device (e.g., 606a, 606b, and / or 606c) and the second hardware input device (e.g., 606a, 606b, and / or 606c) to perform a third operation, and (for example, the computer system Computer systems (e.g., 100, 300, 500, 600, 646, and / or 1300) associated with an application (e.g., user-selected actions) (and optionally, applications associated with the first user interface) will cease displaying a third graphical user interface object (e.g., 630 and / or 638) indicating that the first hardware input device (e.g., 606a, 606b, and / or 606c) and the second hardware input device (e.g., 606a, 606b, and / or 606c) can perform a third action (e.g., maintaining the display of the first user interface without displaying the third graphical user interface object).
[0266] The system provides the user of a computer system with an indication of whether a third operation can be performed at a given time via user input to select both the first and second hardware input devices, by displaying a third graphical user interface object according to the determination that the first hardware input device is configured in the third configuration, and by discontinuing the display of the third graphical user interface object according to the determination that the first hardware input device is not configured in the third configuration, thereby providing the user with improved visual feedback.
[0267] It should be noted that the details of the process described above in relation to Method 700 (e.g., Figure 7) are also applicable in a similar manner to the methods described later. For example, Methods 900, 1000, 1200, and 1400 optionally include one or more features of the various methods described above in relation to Method 700. For example, a computer system configured to perform Method 700 is also configured to perform a first operation, adjust the audio output for emergency operations, display notifications, and / or perform operations in low-power operation mode. For brevity, these details will not be repeated below.
[0268] Figures 8A to 8W show exemplary user interfaces for performing a first operation and / or emergency operation according to several embodiments. These user interfaces are used to illustrate the processes described later, including the processes shown in Figures 9 and 10.
[0269] In some embodiments, any of the inputs described herein (e.g., inputs 850a, 850b, 850c, 850d, 850e, 850f, and / or 850g) is a touch input (e.g., a tap gesture and / or a swipe gesture) or includes a touch input. In some embodiments, any of the inputs described herein (e.g., inputs 850a, 850b, 850c, 850d, 850e, 850f, and / or 850g) is a voice input (e.g., a voice command for selecting a user interface element, or a voice command for activating a function such as a feature or function associated with a user interface element) or includes a voice input. In some embodiments, any of the inputs described herein (e.g., inputs 850a, 850b, 850c, 850d, 850e, 850f, and / or 850g) is or includes an air gesture (e.g., an air gesture for selecting a user interface element, or an air gesture for activating or performing a function such as a feature or function associated with a user interface element). In some embodiments, any of the inputs described herein (e.g., inputs 850a, 850b, 850c, 850d, 850e, 850f, and / or 850g) is or includes a hardware device (e.g., a button, a rotatable input mechanism, a rotatable and pressable input mechanism, a mouse button, a remote control button, and / or a joystick) or includes its activation (e.g., pressing, turning, and / or moving). In some embodiments, any of the user interface elements described herein as being selected (e.g., icons, affordances, buttons, and / or selectable options) is selected by activating a hardware device while the user interface element has focus (e.g., highlighted, bolded, outlined, visually distinguished from other user interface elements, and / or positioned at or near the cursor).
[0270] Figure 8A shows a computer system 600 that displays a clock face user interface 604 via a display device 602. In Figure 8A, the computer system 600 includes, in addition to the display device 602, a first hardware input device 606a, a second hardware input device 606b, and a third hardware input device 606c. As described above with reference to Figures 6A to 6O, in some embodiments, the first hardware input device 606a is user-configurable such that a user input corresponding to the first hardware input device 606a causes the computer system 600 to perform a user selection operation. As will be described later, the first hardware input device 606a is also configured to cause the computer system 600 to perform a predetermined operation (e.g., a non-user selection and / or non-user configured operation) in response to a predetermined type of input (e.g., a press and hold gesture or other selection / navigation input).
[0271] In Figure 8A, the clock face user interface 604 includes user interface objects 608a to 608h and a time indicator 610 (e.g., an analog time indicator). Upon detecting user input corresponding to individual user interface objects 608a to 608h, the computer system 600 is configured to display a user interface associated with the individual application corresponding to the selected user interface object. In some embodiments, the clock face user interface 604 is the home and / or default user interface that the computer system 600 displays when there is no user input requesting navigation to a particular application of the computer system 600.
[0272] In Figure 8A, the computer system 600 detects a user input 850a (e.g., a single-press gesture or other selection / navigation input) corresponding to the first hardware input device 606a. As described above with reference to Figures 6A to 6O, the first hardware input device 606a is user-configurable so that a user of the computer system 600 can select and / or otherwise configure the first hardware input device 606a to cause the computer system 600 to perform a predetermined action in response to the user input. In Figure 8A, the predetermined action that the user input 850a corresponding to the first hardware input device 606a causes the computer system 600 to perform is the start of a workout routine, such as outdoor running.
[0273] In response to detecting user input 850a, the computer system 600 initiates a process to start a workout routine, as shown in Figure 8B. In Figure 8B, the computer system 600 displays an indication 612 overlaid on the clock face user interface 604 via a display device 602. For example, the computer system 600 displays the indication 612 so that it is at the top of the clock face user interface 604 and appears as if at least a portion of the clock face user interface 604 is visible and / or otherwise visible (for example, the indication 612 includes a degree of transparency that allows the computer system 600 to see both the indication 612 and at least a portion of the clock face user interface 604). The computer system 600 also obscures, de-emphasizes, blurs, and / or reduces the size of the clock face user interface 604 in order to further focus the user's attention on the indication 612 (rather than the clock face user interface 604). In some embodiments, the computer system 600 replaces the display of the clock face user interface 604 with the display of the indication 612 such that the clock face user interface 604 is not displayed and / or invisible when the computer system 600 displays the indication 612.
[0274] In Figure 8B, the indication 612 includes an operation indicator 612a and an input indicator 612b. The operation indicator 612a provides a visual indication of a predetermined operation configured to be started and / or executed by the computer system 600 in response to the detection of user input 850a. In Figure 8B, the indication includes symbols and / or icons associated with the predetermined operation (e.g., an outdoor running workout routine), as well as text indicating the predetermined operation (e.g., "outdoor running"). The input indicator 612b provides a visual confirmation that the computer system 600 has detected user input 850a and that the indication 612 corresponds to a predetermined operation configured for the computer system 600 to start in response to the detection of user input 850a. For example, the input indicator 612b is displayed at position 614 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the first hardware input device 606a (with respect to the display device 602). To further confirm the detection of user input 850a, the input indicator 612b also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the first hardware input device 606a.
[0275] In Figure 8B, the indication 612 includes a background 612c having a first color associated with a predetermined operation (for example, shown in the first shaded display in Figure 8B). For example, in some embodiments, the first color is based on an application associated with the predetermined operation and / or an application that enables the computer system 600 to perform this predetermined operation. In some embodiments, the first color is based on the color of the first hardware input device 606a (for example, including a first hue of the first hardware input device 606a). The input indicator 612b includes a second color associated with the predetermined operation and / or associated with the first hardware input device 606a (for example, shown in the second shaded display in Figure 8B), which is associated with and / or based on the color of the first hardware input device 606a. In some embodiments, the background 612c includes a first hue of the first hardware input device 606a, and the input indicator 612b includes a second hue of the first hardware input device 606a.
[0276] In Figure 8B, the computer system 600 displays an indication 612 in response to detecting user input 850a. In response to detecting user input 850a, and in response to detecting the end of user input 850a (e.g., release of pressure on the first hardware input device 606a) while the indication 612 is being displayed, the computer system 600 displays the workout user interface 616, as shown in Figure 8C. In some embodiments, the computer system 600 is configured to continue displaying the indication 612 for a predetermined time (e.g., 2 seconds, 3 seconds, or 5 seconds) after detecting the end of user input 850a, before transitioning to displaying the workout user interface 616.
[0277] The computer system 600 continues to detect user input 850a while displaying the indication 612, and if it does not detect the end of user input 850a for a predetermined period (e.g., 2 seconds, 3 seconds, or 5 seconds) after displaying the indication 612, the computer system 600 displays an emergency indication 800, as shown in Figure 8D. That is, if the computer system 600 continues to detect user input 850a for a predetermined period while displaying the indication 612, the computer system 600 displays an emergency indication 800 to show the user that the computer system 600 will perform an emergency action by maintaining the user input 850a. In some embodiments, the computer system 600 displays a transition animation between the display of the indication 612 and the display of the emergency indication 800. For example, in some embodiments, in response to continuously detecting user input 850a, the computer system 600 displays an indication 612 that moves and / or slides away from the computer system 600's display device 602, and displays an emergency indication that moves and / or slides onto the computer system 600's display device 602. In some such embodiments, the computer system 600 simultaneously displays a first portion of the indication 612 (e.g., so that the indication 612 slides away from the display device 602) and a second portion of the emergency indication 800 (e.g., so that the emergency indication 800 slides onto the display device 602).
[0278] In Figure 8D, the emergency indication 800 replaces the indicator display 612 (and optionally, the clock user interface 604). The emergency indication 800 includes an action indicator 802, a hold indicator 804, an input indicator 806, and emergency user interface objects 808a-808c. The action indicator 802 includes a symbol 802a and text 802b (e.g., "emergency siren") indicating an action (e.g., emergency siren) configured to be performed by the computer system 600 in response to continuous user input 850a corresponding to a first hardware input device 606a. The hold-continue indicator 804 (e.g., "hold-continue") provides visual guidance to the user of the computer system 600 that the computer system 600 will perform the action if user input 850a is maintained on the first hardware input device 606a. The input indicator 806 provides visual confirmation that the computer system 600 has detected (or continues to detect) user input 850a corresponding to the first hardware input device 606a. For example, the input indicator 806 is displayed at position 614 on the display device 602, adjacent, near, very close to, and / or in the vicinity of the location of the first hardware input device 606a (with respect to the display device 602). The input indicator 806 also includes a size (e.g., length and / or height) that approximates the size (e.g., length and / or height) of the first hardware input device 606a. The input indicator 806 includes a color (e.g., red) associated with an action configured to be performed by the computer system 600 in response to the detection of continuous user input 850a on the first hardware input device 606a. In some embodiments, the color of the input indicator 806 is not associated with and / or based on the first hardware input device 606a.
[0279] The emergency user interface objects 808a-808c are configured, when selected and / or otherwise interacted with, to cause the computer system 600 to perform their respective emergency actions, such as displaying the user's medical identification information, activating an emergency siren, and / or initiating an emergency call. In some embodiments, while the emergency indication 800 is displayed, the computer system 600 maintains the display of the emergency indication 800 (e.g., without continuing the hold indicator 804 and / or input indicator 806) in response to detecting the end (e.g., release) of user input 850a corresponding to the first hardware input device 606a, as shown in Figure 8H. In some embodiments, the computer system 600 is configured to detect user input (e.g., a tap gesture, a swipe gesture, or other selection / navigation input) corresponding to the emergency user interface objects 808a-808c while user input 850a is being maintained (and while the computer system 600 is displaying the emergency indication 800).
[0280] In Figure 8E, the computer system 600 displays an emergency indication 800 with a background 800a. In some embodiments, the computer system 600 displays the emergency indication 800 with a background 800a when it first displays the emergency indication 800 (for example, when the computer system 600 transitions from displaying indication 612 to the emergency indication 800). In some embodiments, the computer system 600 displays the emergency indication 800 with a background 800a after displaying the emergency indication 800 for a predetermined time (for example, one or two seconds). In some embodiments, the background 800a has a fourth color associated with the emergency action (for example, shown in the third shaded display in Figure 8E). For example, in some embodiments, the fourth color is based on an emergency application associated with the emergency action, and / or an application that enables the computer system 600 to perform the emergency action. In some embodiments, the fourth color is not based on the color of the first hardware input device 606a. In some embodiments, the background 800a includes a first shade associated with the emergency operation (e.g., a first shade of red), and the input indicator 806 includes a second shade of color associated with the emergency operation (e.g., a second shade of red).
[0281] In Figure 8F, the computer system 600 continues to detect user input 850a corresponding to the first hardware input device 606a. In response to the continued detection of user input 850a while displaying the emergency indication 800, the computer system displays a countdown user interface object 810 on the emergency indication 800. The countdown user interface object 810 provides a visual indication of the duration for which the user input 850a is maintained to prompt the computer system 600 to perform an emergency action. In some embodiments, in response to the continued detection of user input 850a while displaying the emergency indication 800, the computer system 600 is configured to start outputting audio (e.g., audio 820, audio 830, audio 834, and / or audio 838) while displaying the countdown user interface object 810. In some embodiments, when the computer system 600 outputs audio while displaying a countdown user interface object 810, the computer system 600 gradually increases the volume level of the audio as the countdown user interface object 810 expires, progresses, and / or elapses.
[0282] In Figure 8F, the computer system 600 displays a portion 812 of the second emergency user interface object 808b at position 814 within the second emergency user interface object 808b to further indicate the period for which user input 850a is maintained to cause the computer system 600 to perform an emergency action. In Figure 8F, portion 812 includes a countdown user interface object 810. Furthermore, by displaying (e.g., moving) portion 812 at position 814, an indication of an emergency action (e.g., an emergency siren action associated with the second emergency user interface object 808b) is provided, which is configured to be performed in response to the computer system 600 continuing to detect user input 850a. In some embodiments, the computer system 600 displays an animation of portion 812 of the second emergency user interface object 808b such that portion 812 moves (e.g., over time) from an inactive position 816a to an active position 816b within the second emergency user interface object 808b. When a portion 812 of the second emergency user interface object 808b is displayed at the active position 816b, the computer system 600 is configured to initiate emergency operation. In some embodiments, the computer system 600 displays an animation of portion 812 in response to continuous detection of user input 850a corresponding to the first hardware input device 606a (e.g., displaying portion 812 moving from the inactive position 816a to the active position 816b). In some embodiments, the computer system 600 displays an animation of portion 812 in response to detection of a swipe and / or slide gesture on portion 812 of the second emergency user interface object 808b (e.g., displaying portion 812 moving from the inactive position 816a to the active position 816b).
[0283] In Figure 8F, the emergency action includes the emergency siren action, and the computer system 600 is configured to output audio (e.g., via speaker 817) at or above a threshold volume level (e.g., 60 decibels or more, 70 decibels or more, 80 decibels or more, and / or 85 decibels or more) when the emergency siren action is activated. In some embodiments, the computer system 600 is configured to output audio and / or activate the emergency siren while the computer system 600 is not being worn by a user (e.g., the computer system 600 is a wearable device such as a smartwatch and the computer system 600 is not being worn on the user's wrist). In some embodiments, the computer system 600 is configured to output audio and / or activate the emergency siren while the computer system 600 is operating in a restricted operating mode and / or displaying a lock screen (e.g., an operating mode in which the computer system 600 requires one or more authenticated user inputs before performing one or more actions based on detected user inputs). Thus, the computer system 600 is configured to activate an emergency siren to help users of the computer system 600 obtain assistance in an emergency.
[0284] In Figure 8G, the computer system 600 starts an emergency siren operation in response to continuing to detect user input 850a for a predetermined time (e.g., a predetermined time after displaying the emergency indication 800 and / or a predetermined time after starting to detect user input 850a), and / or not detecting the end of user input 850a throughout the period corresponding to the countdown user interface object 810 (e.g., not detecting the end of user input 850a while the countdown user interface object 810 counts down from a predetermined time (e.g., 5 seconds)). In some embodiments, in response to detecting the end of user input 850a before the period corresponding to the countdown user interface object 810 has elapsed, the computer system 600 does not run the emergency siren (e.g., stops the output of audio 820) and displays the emergency indication 800 as shown in Figure 8H.
[0285] The initiation of emergency siren operation includes the computer system 600 displaying the emergency siren user interface 818 and outputting audio 820 corresponding to the emergency siren. As described above, the audio 820 includes a volume that is above a threshold volume level (e.g., 60 decibels or more, 70 decibels or more, 80 decibels or more, and / or 85 decibels or more) to enable the user to request assistance in an emergency. In some embodiments, the audio 820 is output with a waveform (e.g., volume, frequency, wavelength, tone, and / or pitch) that enables the audio 820 to be heard by other people located at a predetermined distance from the computer system (e.g., more than 100 feet, more than 200 feet, more than 300 feet, and / or more than 400 feet). In some embodiments, the computer system 600 outputs the audio 820 continuously. In some embodiments, the computer system 600 outputs audio 820 as audio bursts occurring at time intervals (e.g., uniform time intervals and / or dynamic time intervals that vary based on the context of the computer system 600 (e.g., battery charging of the computer system 600)). In some embodiments, the computer system 600 outputs audio 820 at a volume level, frequency, pitch, and / or tone selected to maximize the distance from the computer system 600 at which audio 820 is audible, while minimizing the battery usage of the computer system 600 (e.g., the computer system 600 selects the audio characteristics of audio 820 by determining the maximum distance from the computer system 600 that minimizes the battery usage of the computer system 600).
[0286] In Figure 8G, the emergency siren user interface 818 includes a time indicator 818a, an operation indicator 818b, a duration indicator 818c, a stop user interface object 818d, and an emergency telephone user interface object 818e. The time indicator 818a provides a visual indication (e.g., a digital indication) of the current time (e.g., "10:09"). The operation indicator 818b provides a visual indication of the current operation (emergency siren operation) being performed by the computer system 600. The duration indicator 818c provides a visual indication of the time (e.g., from the current time indicated by the time indicator 818a) that the computer system 600 is configured to continue performing the emergency siren operation (e.g., before the power and / or battery charge of the computer system 600 runs out). For example, in Figure 8G, the duration indicator 818c includes the remaining battery power and / or charge percentage (e.g., 75%) of the computer system 600. Therefore, a user of the computer system 600 can estimate and / or otherwise determine the amount of time the computer system 600 can continue to perform emergency siren operation based on the remaining battery power and / or charge of the computer system 600.
[0287] The Cancel User Interface Object 818d, when selected, is configured to cause the computer system 600 to cancel and / or pause the execution of the emergency siren operation. In some embodiments, upon detecting user input corresponding to the Cancel User Interface Object 818d, the computer system 600 stops outputting audio 820 and displays an emergency indication 800, as shown in Figure 8H. The Emergency Call User Interface Object 818e is also configured to cause the computer system 600 to initiate an emergency call when selected and / or otherwise interacted with. In some embodiments, the computer system 600 pauses outputting audio 820 in response to the initiation of an emergency call and resumes outputting audio 820 (e.g., automatically without additional user input) in response to the termination of the emergency call. In some embodiments, the emergency call is initiated by the computer system 600 as a dialing to a telephone number associated with an emergency service (e.g., 911, a local emergency service center, and / or a hospital). In some embodiments, the computer system 600 initiates an emergency call in response to detecting a swipe and / or slide gesture on a portion 818f of the emergency call user interface object 818e.
[0288] The emergency siren user interface 818 also includes a background 819 that indicates the emergency siren operation is being performed by the computer system 600 (for example, the computer system 600 is outputting audio 820). In some embodiments, the background 819 includes a color (for example, red) that indicates the emergency siren operation. In some embodiments, the computer system 600 displays the background 819 with an animation such that the background 819 appears to pulsate over time (for example, fade in and fade out). In Figure 8G, the background 819 includes a boundary portion 819a that is displayed near, adjacent to, and / or next to the edge of the display device 602. In some embodiments, the boundary portion 819a includes a darker shade than the interior portion 819b of the background 819.
[0289] In Figure 8G, the computer system 600 detects a user input 850b (e.g., a press gesture or other selection / navigation input) corresponding to the third hardware input device 606c. In response to the detection of user input 850b, the computer system 600 displays the clock face user interface 604, as shown in Figure 8L.
[0290] In response to the detection of one or more predetermined events, the computer system 600 is configured to adjust the output of the audio 820 (for example, to adjust the characteristics of an emergency siren operation). In some embodiments, the computer system 600 pauses (for example, temporarily stops) the output of the audio 820 in response to the detection of one or more predetermined events of a first type, and resumes (for example, automatically outputs) the output of the audio 820 in response to the detection of the end of one or more predetermined events of a first type. In some embodiments, the computer system 600 adjusts one or more characteristics of the audio 820, such as volume, pitch, tone, frequency, and / or wavelength, in response to the detection of one or more predetermined events of a second type. Thus, a user of the computer system 600 can perform various operations using the computer system 600 and / or receive alerts for time-sensitive events, even when the computer system 600 is performing an emergency siren operation (for example, outputting audio 820).
[0291] For example, in Figure 8I, the computer system 600 detects the occurrence of an incoming phone call. In some embodiments, the computer system 600 detects the occurrence of an incoming phone call based on information received from an external computer system (e.g., external computer system 646). In some embodiments, the computer system 600 detects the occurrence of an incoming phone call based on information received from a cellular antenna communicating with the computer system 600. In Figure 8I, the computer system 600 stops the output of audio 820 and displays the communication user interface 822 in response to detecting the occurrence of an incoming phone call. Thus, a user of the computer system 600 can confirm and / or answer the incoming phone call without the communication between the user and another user (e.g., John Appleseed) being interrupted by audio 820. In Figure 8I, the communication user interface 822 includes an emergency siren indicator 823 that provides a visual indication to the user of the computer system 600 that the emergency siren operation has been paused based on the incoming phone call (and is configured to resume upon completion of the incoming phone call). In some embodiments, upon detecting a user input corresponding to the emergency siren indicator 823 while the communication user interface 822 is being displayed, the computer system 600 cancels the telephone call, displays the emergency siren user interface 818, and / or resumes the output of the audio 820.
[0292] In some embodiments, in response to detecting user input corresponding to the accept user interface object 822a in Figure 8I, the computer system 600 initiates a phone call to allow the user to communicate with another user. In some embodiments, in response to detecting the end of the phone call, the computer system 600 displays the emergency siren user interface 818 (for example, replacing the display of the communication user interface 822 with the emergency siren user interface 818) and resumes outputting audio 820. In some embodiments, in response to detecting user input corresponding to the ignore user interface object 822b, the computer system 600 cancels the phone call and resumes outputting audio 820.
[0293] In Figure 8J, the computer system 600 detects the end and / or expiration of the timer operation. In Figure 8J, in response to detecting the end and / or expiration of the timer operation, the computer system 600 stops the output of audio 820 and displays the timer user interface 824. In some embodiments, the computer system 600 outputs audio different from audio 820 in response to the end and / or expiration of the timer operation. Thus, a user of the computer system 600 can receive an alert and / or notification that the timer operation has ended, which may be important to the user. For example, a user of the computer system 600 can set and / or start the timer operation to prompt the user to perform a specific action that may assist the user during an emergency. In Figure 8J, the timer user interface 824 includes an emergency siren indicator 823, which provides a visual indication to the user of the computer system 600 that the emergency siren operation has been paused based on the expiration of the timer operation (and is configured to resume in response to the cancellation, silencing, restart, and / or abortion of the timer operation). In some embodiments, upon detecting a user input corresponding to the emergency siren indicator 823 while the timer user interface 824 is being displayed, the computer system 600 silences the timer operation, displays the emergency siren user interface 818, and / or resumes the output of the audio 820.
[0294] In some embodiments, upon detection of user input corresponding to the Cancel user interface object 824a, the computer system 600 displays the Emergency Siren user interface 818 (for example, replacing the display of the Timer user interface 824 with the Emergency Siren user interface 818) and resumes the output of the audio 820. In some embodiments, upon detection of user input corresponding to the Repeat user interface object 824b, the computer system 600 starts and / or restarts the timer operation (for example, setting a 10-minute timer) (and optionally resumes the output of the audio 820 and displays the Emergency Siren user interface 818).
[0295] In Figure 8K, the computer system 600 detects the occurrence of a triggered alarm action. That is, the computer system 600 triggers the alarm (e.g., set and / or started via user input) when the current time reaches a predetermined time corresponding to the alarm. In Figure 8K, in response to detecting the occurrence of an alarm action trigger, the computer system 600 stops the output of audio 820 and displays the alarm user interface 826. In some embodiments, the computer system 600 outputs audio different from audio 820 in response to an alarm action trigger. Thus, a user of the computer system 600 can receive an alert and / or notification that an alarm action has been triggered, which may be important to the user. For example, a user of the computer system 600 can set and / or start an alarm action to prompt the user to perform a specific task (e.g., taking medication) that may assist the user during an emergency situation. In Figure 8K, the alarm user interface 826 includes an emergency siren indicator 823, which provides a visual indication to the user of the computer system 600 that the emergency siren operation has been paused based on an alarm operation trigger (and is configured to resume in response to the cancellation, silencing, restart, and / or abortion of the alarm). In some embodiments, upon detecting a user input corresponding to the emergency siren indicator 823 while the alarm user interface 826 is being displayed, the computer system 600 silences the alarm, displays the emergency siren user interface 818, and / or resumes the output of the audio 820.
[0296] In some embodiments, upon detecting user input corresponding to the snooze user interface object 826a, the computer system 600 initiates an alarm operation at a predetermined time from the current time (for example, 9 minutes from the current time and / or the time when user input corresponding to the snooze user interface object 826a was detected), and resumes the output of audio 820 (and optionally replaces the display of the alarm user interface 826 with the emergency siren user interface 818). In some embodiments, upon detecting user input corresponding to canceling the user interface object 826b, the computer system 600 displays the emergency siren user interface 818 (for example, replaces the display of the alarm user interface 826 with the emergency siren user interface 818), and / or resumes the output of audio 820.
[0297] As described above, the computer system 600 displays the clock face user interface 604 in response to detecting user input 850b while displaying the emergency siren user interface 818. In Figure 8L, the computer system 600 displays the clock face user interface 604 and adjusts the output of audio 820 to output audio 830. User input 850b indicates that a user of the computer system 600 is interacting with the computer system 600 and / or requesting to interact with the computer system 600. In some embodiments, user input 850b is performed while the user's wrist is raised and / or in other ways is closer to the user's ear. Therefore, to reduce interruptions to user interaction with the computer system 600 and reduce the amount of noise the user is exposed to, the computer system 600 adjusts the output of audio 820 to output audio 830 in response to detecting user input 850b. In some embodiments, audio 830 includes a reduced volume level compared to audio 820. In some embodiments, the computer system 600 adjusts one or more characteristics of the audio 820, such as volume level, frequency, pitch, tone, and / or wavelength, to output the audio 830.
[0298] In Figure 8L, the clock face user interface 604 includes an emergency siren indicator 823 to indicate that the computer system 600 is performing (or continuing to perform) an emergency siren operation. The computer system 600 displays the emergency siren indicator 823 at position 828 on the display device 602 and / or the clock user interface 604. In some embodiments, the computer system 600 displays the emergency siren indicator 823 at position 828 instead of displaying a notification indicator at position 828. That is, the computer system 600 replaces the display of the notification indicator with the emergency siren indicator 823. In some embodiments, in response to user input corresponding to the emergency siren indicator 823, the computer system 600 displays the emergency siren user interface 818 and adjusts the output of audio 830 to the output of audio 820. In other words, upon detecting a user input corresponding to the emergency siren indicator 823, the computer system 600 outputs audio 820 with previous and / or default characteristics (for example, resuming outputting audio 820 at a higher volume level and / or with its original and / or predetermined characteristics).
[0299] ...
Claims
1. It is a method, In a computer system that communicates with a display generation component and one or more hardware input devices, Detecting the occurrence of conditions associated with displaying a first user interface associated with a first operation, In response to detecting the occurrence of the aforementioned condition, while the first user interface is being displayed, In accordance with the determination that a first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform the first operation, a graphical user interface object indicating that the first hardware input device can perform the first operation is displayed via the display generation component. In accordance with the determination that the first hardware input device among the one or more hardware input devices is not configured in the first configuration that enables the first hardware input device to perform the first operation, the graphical user interface object indicating that the first hardware input device can perform the first operation is discontinued. A method comprising displaying the first user interface, including the following:
2. Detecting the occurrence of conditions associated with displaying a second user interface associated with a second action, In response to detecting the occurrence of the aforementioned condition, while the second user interface is being displayed, In accordance with the determination that the first hardware input device among the one or more hardware input devices is configured in a second configuration that enables the first hardware input device to perform the second operation, a second graphical user interface object indicating that the first hardware input device can perform the second operation is displayed via the display generation component, In accordance with the determination that the first hardware input device among the one or more hardware input devices is not configured in the second way that enables the first hardware input device to perform the second operation, the display of the second graphical user interface object indicating that the first hardware input device can perform the second operation is discontinued. Displaying the second user interface, including, The method according to claim 1, further comprising:
3. The method according to claim 2, wherein the first user interface and the second user interface are the same user interface.
4. The method according to claim 2, wherein the first user interface and the second user interface are different user interfaces.
5. The method according to claim 2, wherein the first user interface is associated with a first application of the computer system, and the second user interface is associated with a second application of the computer system that is different from the first application.
6. The method according to any one of claims 1 to 5, wherein displaying the graphical user interface object indicating that the first hardware input device can perform the first operation includes adjusting the appearance of selectable user interface objects of the first user interface.
7. The method according to claim 6, wherein adjusting the appearance of the selectable user interface objects of the first user interface includes displaying a contour around at least a portion of the selectable user interface objects.
8. The method according to any one of claims 1 to 7, wherein the graphical user interface object indicating that the first hardware input device can perform the first operation includes a first color, and the first hardware input device includes the first color.
9. The method according to any one of claims 1 to 7, wherein the graphical user interface object indicating that the first hardware input device can perform the first operation includes a first color based on a second color of the first hardware input device.
10. The method according to any one of claims 1 to 9, wherein the graphical user interface object indicating that the first hardware input device can perform the first operation is displayed on the display generation component at a position adjacent to the first hardware input device.
11. The method according to claim 10, wherein the displayed position of the graphical user interface object on the display generation component is based on the orientation setting of the computer system.
12. The method according to any one of claims 1 to 11, further comprising receiving a user input requesting the execution of the first operation, which includes a plurality of presses of the first hardware input device, while the graphical user interface object is displaying an object indicating that the first hardware input device is capable of performing the first operation.
13. The method according to any one of claims 1 to 11, further comprising receiving a user input requesting the execution of the first operation while the graphical user interface object is displayed indicating that the first hardware input device is capable of performing the first operation, the user input including a first press input corresponding to a second hardware input device that occurs in conjunction with a second press input corresponding to the first hardware input device.
14. The graphical user interface object indicating that the first hardware input device can perform the first operation is, A beginner-friendly graphical user interface object that covers a first amount of the display area for displaying the first user interface, in accordance with the determination that one or more usage criteria of a set are met, The method according to any one of claims 1 to 13, further comprising: an intermediate to advanced graphical user interface object that, in accordance with the determination that the set of user criteria described above are not met, covers a second amount of the display area for displaying the first user interface, wherein the second amount is less than the first amount.
15. Displaying the aforementioned beginner-friendly graphical user interface object includes de-emphasizing the appearance of the first user interface, The method according to claim 14, wherein displaying the intermediate to advanced graphical user interface object does not include de-emphasizing the appearance of the first user interface.
16. The aforementioned beginner-friendly graphical user interface object includes a first amount of content indicating that the first hardware input device can perform the first operation, The method according to claim 14, wherein the intermediate to advanced graphical user interface object includes a second amount of content, less than the first amount of content, indicating that the first hardware input device can perform the first operation.
17. Displaying the aforementioned beginner-friendly graphical user interface object includes a time-varying animation of the aforementioned beginner-friendly graphical user interface object. The method according to claim 14, wherein the display of the intermediate to advanced graphical user interface object does not include time-varying animation of the intermediate to advanced graphical user interface object.
18. The method according to any one of claims 1 to 17, wherein detecting the occurrence of the condition associated with displaying the first user interface includes detecting a wrist-raising gesture.
19. The method according to any one of claims 1 to 17, wherein detecting the occurrence of the condition associated with displaying the first user interface includes detecting that the display generation component is in an active state.
20. The method according to any one of claims 1 to 17, wherein detecting the occurrence of the condition associated with displaying the first user interface includes detecting a user input requesting a transition from displaying a second user interface to displaying the first user interface.
21. The method according to any one of claims 1 to 20, wherein displaying the graphical user interface object indicating that the first hardware input device can perform the first operation includes animating the graphical user interface object to pulsate a predetermined number of times before stopping the pulsation.
22. Before detecting the occurrence of the aforementioned condition, a second user interface for configuring the first hardware input device in the first configuration is displayed, the second user interface includes a plurality of selectable application types, While displaying the second user interface for configuring the first hardware input device in the first configuration, first information corresponding to the selection of a first selectable application type from the plurality of selectable application types is received, In response to receiving the first information corresponding to the selection of the first selectable application type, display one or more applications corresponding to the first selectable application type, Receiving second information corresponding to the selection of a first application of one or more applications corresponding to the first selectable application type, In response to receiving the second information corresponding to the selection of the first application from among the one or more applications corresponding to the first selectable application type, display one or more selectable options for associating the operation with the first hardware input device, Receiving third information corresponding to the selection of a first selectable option among the one or more selectable options corresponding to the first operation, The method according to any one of claims 1 to 21, further comprising:
23. Upon receiving the first information corresponding to the selection of the first selectable application type, The method according to claim 22, further comprising deselecting the display of one or more applications corresponding to the first selectable application type in accordance with the determination that the first selectable application type does not include two or more applications.
24. The method according to any one of claims 1 to 23, further comprising displaying a third user interface during a setup process for configuring the first hardware input device, which includes a plurality of selectable options for configuring the first hardware input device to perform various operations via different user inputs.
25. The method according to claim 24, wherein the setup process occurs when the computer system is configured for the first time.
26. The method according to claim 24, wherein the setup process occurs in response to detecting a user input corresponding to the first hardware input device before the first hardware input device is configured in the first configuration.
27. To detect a fourth user input corresponding to the first hardware input device, The method according to any one of claims 1 to 26, further comprising: detecting the fourth user input; performing the first operation;
28. The method according to claim 27, wherein the fourth user input is received while the computer system is not displaying the first user interface.
29. The method according to claim 27 or 28, further comprising, in response to detecting the fourth user input corresponding to the first hardware input device, displaying a visual indication via the display generation component that the computer system is performing the first operation.
30. The method according to claim 29, wherein the visual indication includes a first color and the first hardware input device includes the first color.
31. The method according to claim 29, wherein the visual indication includes a first color based on a second color of the first hardware input device.
32. The method according to claim 29, wherein the visual indication includes text and / or a second graphical user interface object indicating the first action.
33. In accordance with the determination that the fourth user input corresponds to the first hardware input device, the visual indication includes the first appearance. The method according to claim 29, wherein, in accordance with the determination that the fourth user input corresponds to the first hardware input device and the second hardware input device, the visual indication includes a second appearance different from the first appearance.
34. After displaying the graphical user interface object that indicates the first hardware input device can perform the first operation, In accordance with the determination that the first hardware input device is configured in a third configuration that enables the first hardware input device and the second hardware input device to perform a third operation, a third graphical user interface object is displayed via the display generation component indicating that the first hardware input device and the second hardware input device can perform the third operation. In accordance with the determination that the first hardware input device is not configured in the third configuration that enables the first hardware input device and the second hardware input device to perform the third operation, the display of the third graphical user interface object indicating that the first hardware input device and the second hardware input device can perform the third operation is discontinued. The method according to any one of claims 1 to 33, further comprising:
35. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, the programs including instructions for performing the method according to any one of claims 1 to 34.
36. A computer system configured to communicate with a display generation component and one or more hardware input devices, One or more processors, A memory for storing one or more programs configured to be executed by one or more processors, which include instructions for performing the method described in any one of claims 1 to 34, A computer system equipped with the following features.
37. A computer system configured to communicate with a display generation component and one or more hardware input devices, A computer system comprising means for performing the method described in any one of claims 1 to 34.
38. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, the programs comprising one or more programs that include instructions for performing the method according to any one of claims 1 to 34.
39. A non-temporary computer-readable storage medium that stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, wherein the one or more programs are Detect the occurrence of a condition associated with displaying a first user interface associated with a first operation, In response to detecting the occurrence of the aforementioned condition, while the first user interface is being displayed, In accordance with the determination that a first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform the first operation, a graphical user interface object indicating that the first hardware input device can perform the first operation is displayed via the display generation component. In accordance with the determination that the first hardware input device among the one or more hardware input devices is not configured in the first configuration that enables the first hardware input device to perform the first operation, the graphical user interface object indicating that the first hardware input device can perform the first operation is discontinued. A non-temporary computer-readable storage medium containing instructions for displaying the first user interface, including the above.
40. A computer system configured to communicate with a display generation component and one or more hardware input devices, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more programs, Detect the occurrence of a condition associated with displaying a first user interface associated with a first operation, In response to detecting the occurrence of the aforementioned condition, while the first user interface is being displayed, In accordance with the determination that a first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform the first operation, a graphical user interface object indicating that the first hardware input device can perform the first operation is displayed via the display generation component. In accordance with the determination that the first hardware input device among the one or more hardware input devices is not configured in the first configuration that enables the first hardware input device to perform the first operation, the graphical user interface object indicating that the first hardware input device can perform the first operation is discontinued. A computer system including instructions for displaying the first user interface, including the above.
41. A computer system configured to communicate with a display generation component and one or more hardware input devices, Means for detecting the occurrence of conditions associated with displaying a first user interface associated with a first operation, The means for displaying the first user interface, in response to detecting the occurrence of the condition, while the first user interface is being displayed, In accordance with the determination that a first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform the first operation, a graphical user interface object indicating that the first hardware input device can perform the first operation is displayed via the display generation component. Means for discontinuing the display of the graphical user interface object indicating that the first hardware input device can perform the first operation, based on the determination that the first hardware input device among the one or more hardware input devices is not configured in the first configuration that enables the first hardware input device to perform the first operation, A computer system equipped with the following features.
42. A computer program product, The system includes a display generation component and one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more hardware input devices, and the one or more programs are Detect the occurrence of a condition associated with displaying a first user interface associated with a first operation, In response to detecting the occurrence of the aforementioned condition, while the first user interface is being displayed, In accordance with the determination that a first hardware input device among the one or more hardware input devices is configured in a first configuration that enables the first hardware input device to perform the first operation, a graphical user interface object indicating that the first hardware input device can perform the first operation is displayed via the display generation component. In accordance with the determination that the first hardware input device among the one or more hardware input devices is not configured in the first configuration that enables the first hardware input device to perform the first operation, the graphical user interface object indicating that the first hardware input device can perform the first operation is discontinued. A computer program product including instructions for displaying the first user interface, including the above.
43. It is a method, In a computer system that communicates with a display generation component and one or more hardware input devices, Detecting user input corresponding to a first hardware input device among the one or more hardware input devices, In response to detecting the user input, the first indication of a first operation configured to be performed by the first hardware input device is displayed via the display generation component. After displaying the first indication of the first operation, the end of the user input is detected, In response to detecting the end of the user input, The first operation is performed in accordance with the determination that the end of user input is detected while the first indication is being displayed. A method comprising displaying the first indication, then stopping the display of the first indication, and then ceasing to perform the first operation in accordance with the determination that the end of user input has been detected.
44. The method according to claim 43, wherein the first operation is an operation selected by the user from a plurality of available operations.
45. The method according to claim 44, wherein the first operation includes adding a new waypoint.
46. The method according to claim 44, wherein the first operation includes initiating a shortcut operation of the computer system.
47. The method according to claim 44, wherein the first operation includes a route selection operation selected from the group consisting of initiating a route selection operation for a waypoint and pausing an ongoing route selection operation for a waypoint.
48. The method according to claim 44, wherein the first operation includes initiating the flashlight operation of the computer system.
49. The method according to claim 44, wherein the first action includes an action selected from the group consisting of starting a workout, starting a new lap and / or segment of an ongoing workout, and pausing the ongoing workout.
50. The method according to claim 44, wherein the first action includes an action selected from the group consisting of starting a stopwatch, starting a new lap and / or interval of the stopwatch in progress, and pausing the stopwatch in progress.
51. The method according to claim 44, wherein the first action includes an action selected from the group consisting of initiating a dive and performing dynamic actions for a dive in progress.
52. The method according to any one of claims 43 to 51, wherein displaying the first indication of the first operation configured to be performed by the first hardware input device includes overlaying the first indication on the currently displayed user interface.
53. After the first hardware input device displays the first indication of the first operation configured to be performed over a predetermined period of time, and while continuing to detect the user input, To stop the display of the first indication, To display a second indication of a second operation configured to be performed by the first hardware input device via the display generation component, The method according to any one of claims 43 to 52, further comprising:
54. The method according to claim 53, wherein the first operation is selected by the user and the second operation is a predetermined operation.
55. The method according to claim 53, wherein the second operation is a first emergency operation of the computer system.
56. The method according to claim 55, wherein the first emergency operation of the computer system includes outputting an emergency siren configured to continue after detecting the termination of the user input.
57. The method according to claim 56, wherein outputting the emergency siren includes outputting an audio burst that occurs less frequently as the battery life of the computer system shortens.
58. The method according to claim 55, wherein the first emergency action includes displaying an option to initiate an emergency call.
59. The method according to claim 55, wherein the first emergency action includes displaying an indication of the duration for which the first emergency action continues.
60. The method according to claim 55, further comprising initiating a second emergency operation different from the first emergency operation in response to the detection of a second user input corresponding to the first hardware input device and the second hardware input device.
61. The method according to claim 53, further comprising performing the second operation after the first hardware input device has displayed a second indication of the second operation configured to be performed over a predetermined period of time, and while continuing to detect the user input.
62. The method according to claim 53, wherein the first indication includes a first color, and the second indication includes a second color different from the first color.
63. The method according to claim 53, wherein the computer system is configured to perform the second operation regardless of whether the first hardware input device is configured to perform the first operation.
64. Displaying the second indication of the second operation configured to be performed by the first hardware input device is done via the display generation component. Medical identification options, Emergency siren selectable option, Emergency call selection option, The method according to claim 53, comprising displaying at least two of the same at the same time.
65. The method according to claim 64, wherein displaying the second indication of the second operation configured to be performed by the first hardware input device includes displaying an animation of the first indication sliding out of the display area of the display generating component and an animation of the second indication sliding into the display area of the display generating component, the second indication including a countdown indicating the time the computer system has to perform the second operation.
66. In response to detecting the end of the user input, The method of claim 65, further comprising maintaining the display of the second indicator in accordance with the determination that the end of the user input has been detected before the countdown is completed.
67. After detecting the end of the user input, In accordance with the determination that the end of user input has been detected after the countdown has been completed, To activate the emergency siren of the aforementioned computer system, The method according to claim 65, further comprising displaying an emergency siren user interface including the emergency phone selectable option via the display generation component.
68. While performing the second operation, detect user input requesting to navigate away from the second indication, The method of claim 53, further comprising detecting the user input requesting to navigate away from the second indication, and via the display generating component, displaying a user interface including a selectable indicator, wherein the selection of the selectable indicator causes the selectable indicator to display the second indication.
69. The method according to claim 68, wherein the user interface is a clock face user interface including time indication, and the selectable indicator replaces the display of a notification indicator on the clock face user interface.
70. The method according to claim 68, wherein the user interface is associated with an application of the computer system, and the selectable indicator is displayed in the status area of the user interface.
71. The method according to claim 68, wherein the user interface includes a plurality of application user interface objects, and the selectable indicator is displayed in the corner of the display area of the display generation component.
72. The method according to any one of claims 43 to 71, further comprising maintaining the display of the first indicator in accordance with the determination that the end of user input has been detected while the first indicator is being displayed.
73. The method according to claim 72, further comprising maintaining the display of the first indication for a predetermined period of time, and then displaying a fading animation of the first indication.
74. To detect a third user input corresponding to the first hardware input device and the third hardware input device among the one or more hardware input devices, A third indication of a third operation configured to be performed by the first hardware input device and the second hardware input device in response to the detection of the third user input, An emergency call selectable option, configured to move from an inactive position to an active position while the second user input is maintained, A countdown indicating the time when emergency call operations will begin, Displaying a third indication including, The method according to any one of claims 43 to 73, further comprising:
75. The method according to claim 74, further comprising displaying one or more graphical user interface objects indicating that the first hardware input device and the second hardware input device have been activated in response to the detection of the third user input.
76. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, the programs including instructions for performing the method according to any one of claims 43 to 75.
77. A computer system configured to communicate with a display generation component and one or more hardware input devices, One or more processors, A memory for storing one or more programs configured to be executed by one or more processors, which include instructions for performing the method described in any one of claims 43 to 75, A computer system equipped with the following features.
78. A computer system configured to communicate with a display generation component and one or more hardware input devices, A computer system comprising means for performing the method described in any one of claims 43 to 75.
79. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more hardware input devices, the programs comprising one or more programs that include instructions for performing the method according to any one of claims 43 to 75.
80. A non-temporary computer-readable storage medium, The system includes a display generation component and one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more hardware input devices, and the one or more programs are The system detects a user input corresponding to a first hardware input device among the one or more hardware input devices, In response to detecting the user input, the first indication of the first operation configured to be performed by the first hardware input device is displayed via the display generation component. After displaying the first indication for the first operation, the end of the user input is detected, In response to detecting the end of the user input, In accordance with the determination that the end of user input has been detected while the first indication is being displayed, the first operation is executed. A non-temporary computer-readable storage medium including an instruction that displays the first indication, then stops displaying the first indication, and then, in accordance with the determination that the end of user input has been detected, cancels the execution of the first operation.
81. A computer system configured to communicate with a display generation component and one or more hardware input devices, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more programs, The system detects user input corresponding to the first hardware input device among the one or more hardware input devices. In response to detecting the user input, the first indication of the first operation configured to be performed by the first hardware input device is displayed via the display generation component. After displaying the first indication for the first operation, the end of the user input is detected, In response to detecting the end of the user input, In accordance with the determination that the end of user input has been detected while the first indication is being displayed, the first operation is executed. A computer system including an instruction to display the first indication, then stop displaying the first indication, and then, in accordance with the determination that the end of user input has been detected, to cancel the execution of the first operation.
82. A computer system configured to communicate with a display generation component and one or more hardware input devices, Means for detecting user input corresponding to a first hardware input device among the one or more hardware input devices, In response to detecting the user input, means for displaying a first indication of a first operation configured to be performed by the first hardware input device via the display generation component, After displaying the first indication of the first operation, means for detecting the end of user input, In response to detecting the end of the user input, In accordance with the determination that the end of user input has been detected while the first indication is being displayed, the first operation is executed. Means for displaying the first indication, then stopping the display of the first indication, and then ceasing to perform the first operation in accordance with the determination that the end of the user input has been detected, A computer system equipped with the following features.
83. A computer program product, The system includes a display generation component and one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more hardware input devices, and the one or more programs are The system detects a user input corresponding to a first hardware input device among the one or more hardware input devices, In response to detecting the user input, the first indication of the first operation configured to be performed by the first hardware input device is displayed via the display generation component. After displaying the first indication for the first operation, the end of the user input is detected, In response to detecting the end of the user input, In accordance with the determination that the end of user input has been detected while the first indication is being displayed, the first operation is executed. A computer program product including an instruction to display the first indication, then stop displaying the first indication, and then, in accordance with the determination that the end of user input has been detected, to cancel the execution of the first operation.
84. It is a method, In a computer system that communicates with display generation components, Detecting the occurrence of an event, In response to detecting the occurrence of the aforementioned event, a notification corresponding to the event is displayed, The computer system, in accordance with a determination that the computer system satisfies one or more separate sets of criteria indicating that user input is occurring or is likely to occur, displays a first notification corresponding to the event via the display generation component, the first notification covering a first amount of the display area used to display the user interface before the display of the first notification. A method comprising: displaying, via the display generation component, a second notification corresponding to the event, which covers a second amount greater than the first amount of the display area used to display the user interface before the display of the second notification, in accordance with the determination that the computer system does not satisfy one or more of the separate set of criteria indicating that user input is occurring or is likely to occur;
85. The state in which user input is occurring or is likely to occur includes the computer system displaying an edit user interface, a selection user interface, or a draft user interface via the display generation component, The method according to claim 84, wherein the state in which user input is occurring or is likely to occur does not include the computer system displaying an information display user interface.
86. The conditions in which user input is occurring or is likely to occur include the computer system being oriented to indicate that the user's wrist is raised, and the computer system displaying a user interface other than a watch face user interface. The method according to claim 84 or 85, wherein the state in which user input is occurring or is likely to occur includes the computer system being oriented to indicate that the user's wrist is lowered, and / or the computer system displaying a clock face user interface.
87. The method according to any one of claims 84 to 86, wherein the first notice includes a first amount of content, and the second notice includes a second amount of content greater than the first amount of content.
88. The method according to any one of claims 84 to 87, wherein the first notice includes a first size, and the second notice includes a second size that is larger than the first size.
89. Displaying the second notification corresponding to the event includes extending the second notification from covering a third amount of the display area that is smaller than the second amount to covering the second amount of the display area, The method according to any one of claims 84 to 88, wherein displaying the first notification corresponding to the event does not involve extending the first notification.
90. While the first notification corresponding to the event is displayed, user input corresponding to the selection of the first notification is detected, In response to detecting the user input, the first notification is expanded from covering a first amount of the display area to covering a fourth amount of the display area that is larger than the first amount. The method according to claim 89, further comprising:
91. The method according to any one of claims 84 to 90, wherein displaying the first notification corresponding to the event includes de-highlighting the user interface that was displayed before the first notification was displayed.
92. The method according to claim 91, wherein de-highlighting the user interface displayed before the display of the first notification includes darkening and / or blurring the user interface displayed before the display of the first notification.
93. The method according to claim 91 or 92, wherein de-highlighting the user interface displayed before the first notification is displayed includes reducing the size of the user interface displayed before the first notification is displayed.
94. While the first notification corresponding to the event is displayed, a swipe gesture corresponding to the first notification is detected. The method according to any one of claims 84 to 93, further comprising stopping the display of the first notification in response to the detection of the swipe gesture corresponding to the first notification.
95. While the first notification corresponding to the event is displayed, it is detected that a predetermined amount of time has elapsed since the first notification was first displayed without detecting any user input. The method according to any one of claims 84 to 94, further comprising stopping the display of the first notification in response to the detection that a predetermined amount of time has elapsed since the first notification was first displayed.
96. While the first notification corresponding to the aforementioned event is displayed, the occurrence of the second event is detected, The method according to any one of claims 84 to 95, further comprising: receiving the occurrence of the second event; replacing the display of the first notification with a display of a third notification corresponding to the second event.
97. While displaying the third notification corresponding to the second event, detect user input requesting to dismiss the third notification, In response to detecting the user input requesting the rejection of the third notification, Displaying the extended animations of the third notification and the first notification, The method according to claim 96, further comprising displaying the extended animations of the third notification and the first notification, and then stopping the display of the first notification and the third notification.
98. Displaying the second notification mentioned above is At the first time, display the first part of the second notification that covers the fifth amount of the display area, the first part of the second notification that includes an icon indicating the event, After displaying the first portion of the second notification, at a second time, display the second portion of the second notification which covers the second amount of the display area and includes the icon indicating the event and text related to the event, The method according to any one of claims 84 to 97, including the method described in any one of claims 84 to 97.
99. The method according to any one of claims 84 to 98, further comprising displaying the second notification corresponding to the event, regardless of whether the computer system satisfies one or more of the set of criteria indicating that user input has occurred or is likely to occur, in response to the detection of the occurrence of the event and in accordance with the determination that the event is of a first type.
100. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component, the programs comprising instructions for performing the method according to any one of claims 84 to 99.
101. A computer system configured to communicate with display generation components, One or more processors, A memory for storing one or more programs configured to be executed by one or more processors, which include instructions for performing the method described in any one of claims 84 to 99, A computer system equipped with the following features.
102. A computer system configured to communicate with display generation components, A computer system comprising means for performing the method described in any one of claims 84 to 99.
103. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component, the one or more programs comprising instructions for performing the method according to any one of claims 84 to 99.
104. A non-temporary computer-readable storage medium that stores one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component, wherein the one or more programs are Detect the occurrence of an event, Upon detecting the occurrence of the aforementioned event, The computer system, in accordance with a determination that it satisfies one or more separate sets of criteria indicating that user input is occurring or is likely to occur, displays a first notification corresponding to the event via the display generation component, the first notification covering a first amount of the display area used to display the user interface before the display of the first notification. A non-temporary computer-readable storage medium including instructions for displaying a notification corresponding to an event, which includes, via the display generation component, a second notification corresponding to the event, which covers a second amount greater than the first amount of the display area used to display the user interface before the display of the second notification, in accordance with the determination that the computer system does not meet one or more of the individual set of criteria indicating that user input is occurring or is likely to occur.
105. A computer system configured to communicate with display generation components, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more programs, Detect the occurrence of an event, Upon detecting the occurrence of the aforementioned event, The computer system, in accordance with a determination that it satisfies one or more separate sets of criteria indicating that user input is occurring or is likely to occur, displays a first notification corresponding to the event via the display generation component, the first notification covering a first amount of the display area used to display the user interface before the display of the first notification. A computer system including an instruction to display a notification corresponding to an event, which includes, via the display generation component, a second notification corresponding to the event, which covers a second amount greater than the first amount of the display area used to display the user interface before the display of the second notification, in accordance with a determination that the computer system does not meet one or more separate sets of criteria indicating that user input is being made or is likely to be made.
106. A computer system configured to communicate with display generation components, Means for detecting the occurrence of an event, A means for displaying a notification corresponding to the event in response to the detection of the occurrence of the event, The computer system, in accordance with a determination that it satisfies one or more separate sets of criteria indicating that user input is occurring or is likely to occur, displays a first notification corresponding to the event via the display generation component, the first notification covering a first amount of the display area used to display the user interface before the display of the first notification. Means including, in accordance with a determination that the computer system does not meet one or more of the separate sets of criteria indicating that user input is occurring or is likely to occur, displaying a second notification corresponding to the event via the display generation component, the second notification covering a second amount greater than the first amount of the display area used to display the user interface before the display of the second notification, A computer system equipped with the following features.
107. A computer program product It includes one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component, and the one or more programs are Detect the occurrence of an event, Upon detecting the occurrence of the aforementioned event, The computer system, in accordance with a determination that it satisfies one or more separate sets of criteria indicating that user input is occurring or is likely to occur, displays a first notification corresponding to the event via the display generation component, the first notification covering a first amount of the display area used to display the user interface before the display of the first notification. The computer system, in accordance with a determination that it does not meet one or more separate sets of criteria indicating that user input is occurring or is likely to occur, displays a second notification corresponding to the event via the display generation component, the second notification covering a second amount greater than the first amount of the display area used to display the user interface before the display of the second notification. A computer program product that includes instructions for displaying notifications corresponding to the aforementioned events.
108. It is a method, In a computer system communicating with an audio output device, While outputting audio corresponding to an emergency siren via the aforementioned audio output device, an event is detected, In response to detecting the aforementioned event, In accordance with the determination that the event is of a first type, the output of the audio corresponding to the emergency siren is adjusted while the computer system is performing a first action associated with the event. In accordance with the determination that the event is of a second type different from the first type, the output of the audio corresponding to the emergency siren is maintained while the computer system performs a second action associated with the event. Methods that include...
109. Before outputting the audio corresponding to the emergency siren, the system detects user input corresponding to a hardware input device communicating with the computer system, The method according to claim 108, further comprising: detecting the user input corresponding to the hardware input device, and outputting the audio corresponding to the emergency siren.
110. Before outputting the audio corresponding to the emergency siren, the system detects user input corresponding to an alert user interface object displayed via a display generation component communicating with the computer system, The method according to claim 108, further comprising: detecting the user input corresponding to the alert user interface object, and outputting the audio corresponding to the emergency siren.
111. The method according to claim 110, wherein the alert user interface object is displayed on the user interface of the alert application of the computer system.
112. The method according to claim 110, wherein the alert user interface object is displayed on the emergency contact user interface.
113. The method according to claim 110, wherein the alert user interface object is displayed on a user interface that includes selectable options for activating a low-power mode for the computer system.
114. Before outputting the audio corresponding to the emergency siren, the occurrence of a detected fall event is detected, Upon detecting the occurrence of the aforementioned fall event, and in accordance with the determination that the fall event meets individual criteria, the audio corresponding to the emergency siren is output. The method according to any one of claims 108 to 113, further comprising:
115. In response to detecting the occurrence of the fall event that satisfies the aforementioned individual criteria, To initiate the emergency telephone service of the aforementioned computer system, In response to detecting the termination of the emergency telephone operation of the computer system, the system outputs the audio corresponding to the emergency siren. The method according to claim 114, further comprising:
116. Before outputting the audio corresponding to the emergency siren, the occurrence of a trigger event for the emergency siren is detected, In response to the detection of the occurrence of the trigger event for the emergency siren, The display generation component communicating with the aforementioned computer system displays a countdown, The method according to any one of claims 108 to 115, further comprising outputting the audio corresponding to the emergency siren, wherein the volume of the audio gradually increases as the countdown progresses.
117. While the countdown is being displayed, the system detects user input requesting the cancellation of outputting the audio corresponding to the emergency siren, The method according to claim 116, further comprising detecting the user input requesting the cancellation of outputting the audio corresponding to the emergency siren, and ceasing to output the audio corresponding to the emergency siren.
118. The method according to any one of claims 108 to 117, wherein the computer system is configured to output the audio corresponding to the emergency siren while the computer system is in a restricted operating mode.
119. The aforementioned computer system is a wearable device, The method according to claim 118, wherein the computer system is configured to output the audio corresponding to the emergency siren when the computer system is not being worn by a user.
120. The method according to any one of claims 108 to 119, wherein while the computer system is performing the first operation associated with the event, adjusting the output of the audio corresponding to the emergency siren includes stopping the output of the audio corresponding to the emergency siren.
121. The method according to claim 120, wherein the event includes a telephone call.
122. The method according to claim 120, wherein the event includes the expiration of the timer operation of the computer system.
123. The method according to claim 120, wherein the event includes an alarm trigger.
124. The method according to claim 120, further comprising restarting the audio output corresponding to the emergency siren in response to detection that the first operation associated with the event has ended.
125. The method according to any one of claims 108 to 124, wherein adjusting the output of the audio corresponding to the emergency siren while the computer system is performing the first operation associated with the event includes adjusting the characteristics of the audio corresponding to the emergency siren based on user interaction with the computer system.
126. The method according to claim 125, wherein the user interaction includes user input corresponding to a user interface displayed via a display generation component communicating with the computer system, and the user input is detected within a predetermined time from the current time.
127. The method according to claim 125, wherein the user interaction is a wrist-raising gesture.
128. The method according to any one of claims 108 to 127, wherein the audio corresponding to the emergency siren has a waveform selected such that the audio can be transmitted to a predetermined distance from the computer system while suppressing the battery usage of the computer system.
129. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with an audio output device, the programs comprising instructions for performing the method according to any one of claims 108 to 128.
130. A computer system configured to communicate with an audio output device, One or more processors, A memory for storing one or more programs configured to be executed by one or more processors, which include instructions for performing the method described in any one of claims 108 to 128, A computer system equipped with the following features.
131. A computer system configured to communicate with an audio output device, A computer system comprising means for performing the method described in any one of claims 108 to 128.
132. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with an audio output device, the one or more programs comprising instructions for performing the method according to any one of claims 108 to 128.
133. A non-temporary computer-readable storage medium, It stores one or more programs configured to be executed by one or more processors of a computer system that communicates with an audio output device, and the one or more programs are While outputting audio corresponding to an emergency siren via the aforementioned audio output device, an event is detected, In response to detecting the aforementioned event, In accordance with the determination that the event is of a first type, while the computer system is performing a first action associated with the event, the output of the audio corresponding to the emergency siren is adjusted. An instruction to maintain the output of the audio corresponding to the emergency siren while the computer system is performing a second action associated with the event, in accordance with the determination that the event is of a second type different from the first type; Non-temporary computer-readable storage media, including [specific type of storage medium].
134. A computer system configured to communicate with an audio output device, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more programs, While outputting audio corresponding to an emergency siren via the aforementioned audio output device, an event is detected, In response to detecting the aforementioned event, In accordance with the determination that the event is of a first type, while the computer system is performing a first action associated with the event, the output of the audio corresponding to the emergency siren is adjusted. A computer system including an instruction to maintain the output of the audio corresponding to the emergency siren while the computer system is performing a second action associated with the event, based on a determination that the event is of a second type different from the first type.
135. A computer system configured to communicate with an audio output device, The means for detecting an event while outputting audio corresponding to an emergency siren via the aforementioned audio output device, In response to detecting the aforementioned event, In accordance with the determination that the event is of a first type, while the computer system is performing a first action associated with the event, the output of the audio corresponding to the emergency siren is adjusted. Means for maintaining the audio output corresponding to the emergency siren while the computer system is performing a second action associated with the event, based on the determination that the event is of a second type different from the first type; A computer system equipped with the following features.
136. A computer program product, Includes one or more programs configured to run by one or more processors of a computer system communicating with an audio output device, and said one or more programs While outputting audio corresponding to an emergency siren via the aforementioned audio output device, an event is detected, In response to detecting the aforementioned event, In accordance with the determination that the event is of a first type, while the computer system is performing a first action associated with the event, the output of the audio corresponding to the emergency siren is adjusted. A computer program product including an instruction to maintain the output of the audio corresponding to the emergency siren while the computer system is performing a second action associated with the event, based on the determination that the event is of a second type different from the first type.
137. It is a method, In a computer system that communicates with a display generation component and one or more sensors, Detecting user input corresponding to a request to perform a first operation associated with one or more of the sensors, In response to detecting the user input, the computer system performs the first operation based on one or more sensor measurements from a first set of sensors, regardless of whether it is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode. While the computer system is operating in the first operating mode, it monitors one or more sensor measurements from a second set of one or more sensors from the one or more sensors, and, in accordance with the determination that a specific condition has occurred, it performs a second operation based on one or more sensor measurements from the second set of one or more sensors. To detect the occurrence of an event corresponding to the transition of the computer system from the first operating mode to the second operating mode, A method comprising: stopping monitoring sensor measurements from one or more sensors in response to detecting the occurrence of the event; and disabling the computer system's ability to perform a second action based on the sensor measurements from one or more sensors when the individual conditions occur.
138. The computer system detects a second user input requesting the execution of a third operation while it is operating in the second operating mode, In response to detecting the second user input requesting the execution of the third operation, the third operation is performed based on one or more sensor measurements from the second set of one or more sensors, The method according to claim 137, further comprising:
139. The method according to claim 137 or 138, wherein the individual conditions include detecting the orientation of the computer system indicating that the user's wrist is in a lowered position.
140. The method according to claim 137 or 138, wherein the individual conditions include the detection of a hand gesture covering the display generation component.
141. The method according to any one of claims 137 to 140, wherein the second operation includes displaying a wake screen user interface.
142. The method according to claim 141, wherein the wake screen user interface includes a time indicator and one or more complications.
143. The method according to claim 141 or 142, wherein the wake screen user interface is the lock user interface of the computer system.
144. The method according to any one of claims 137 to 143, wherein the second operation includes monitoring the biometric characteristics of a user of the computer system.
145. The method according to claim 144, wherein the biometric authentication feature includes heart rate.
146. The method according to claim 144, wherein the biometric authentication feature includes blood oxygen concentration.
147. The method according to any one of claims 137 to 146, wherein the second operation includes detecting the activity of a user of the computer system.
148. The method according to claim 147, wherein the computer system's detection of the user's activity includes detecting the user's exercise, and the computer system is configured to initiate an exercise tracking operation after detecting the user's exercise.
149. The method according to claim 147, wherein the detection of the user's activity in the computer system includes the detection of audio in the physical environment in which the computer system is located.
150. The method according to claim 147, wherein the detection of the user's activity in the computer system includes the detection of the user's own handwashing.
151. The method according to claim 147, wherein the detection of the user's activity in the computer system includes the detection of the computer system moving to a location within a predetermined distance of a contactless payment terminal.
152. The method according to any one of claims 137 to 151, wherein the second operation includes initiating a voice assistant in response to detecting audio indicating a keyword spoken by a user of the computer system.
153. The method according to any one of claims 137 to 152, further comprising reducing the operating frequency of one or more wireless antennas communicating with the computer system while the computer system is operating in the second operating mode.
154. The method according to any one of claims 137 to 153, further comprising monitoring one or more sensor measurements of a third set from the sensors while the computer system is operating in the second operating mode, and performing a third operation based on one or more sensor measurements of the third set from the one or more sensors.
155. The method according to claim 154, wherein one or more of the third set of sensor readings from the sensors include information about the user's movement in the computer system indicating that the user has fallen.
156. The method according to claim 154, wherein one or more of the third set of sensor measurements from the sensors include information relating to the user's movements in the computer system indicating that the user is performing physical activity.
157. The method according to claim 154, wherein one or more of the third set of sensor measurements from the sensors include information relating to the movement of the computer system to a location within a predetermined distance from a payment terminal broadcasting a predetermined signal.
158. The computer system, while operating in the second operating mode, detects the occurrence of an event associated with the generation of a notification, In response to detecting the occurrence of the event associated with the generation of the notification, To provide an alert corresponding to the event in accordance with the determination that one or more criteria of a set have been met, In accordance with the determination that one or more of the aforementioned set of criteria are not met, the provision of alerts associated with the event will be suspended until one or more of the aforementioned set of criteria are met. The method according to any one of claims 137 to 157, further comprising:
159. The method according to claim 158, wherein one or more of the set of criteria include detection of the current time, detection of a predetermined time and / or detection of user input.
160. To detect a third user input requesting the shutdown of the computer system, In response to detecting the user input requesting the shutdown of the computer system, the computer system is shut down, The computer system is shut down while a fourth user input is detected, In response to detecting the fourth user input, the time indication is displayed via the display generation component without displaying the clock face user interface, The method according to any one of claims 137 to 159, further comprising:
161. The method according to any one of claims 137 to 160, further comprising displaying a system user interface of the computer system, which includes a status indicator indicating that the computer system is operating in the second operating mode, while the computer system is operating in the second operating mode.
162. The status indicator includes a predetermined color indicating that the computer system is operating in the second operating mode, The method according to claim 161, wherein the system user interface includes a second state indicator having the predetermined color.
163. The occurrence of the aforementioned event includes the start of a workout tracking operation. The method according to any one of claims 137 to 162, further comprising transitioning the computer system from the second operating mode to the first operating mode in response to detection that the workout tracking operation has ended.
164. The method according to claim 163, further comprising, in accordance with the determination that a third operating mode of the computer system has been enabled and in response to the detection of the occurrence of the event, transitioning the operation of the computer system from the first or second operating mode to the third operating mode, which reduces the frequency of a fourth operation of the computer system compared to the second operating mode.
165. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more sensors, the programs including instructions for performing the method according to any one of claims 137 to 164.
166. A computer system configured to communicate with a display generation component and one or more sensors, One or more processors, A memory for storing one or more programs configured to be executed by one or more processors, which include instructions for performing the method described in any one of claims 137 to 164, A computer system equipped with the following features.
167. A computer system configured to communicate with a display generation component and one or more sensors, A computer system comprising means for performing the method described in any one of claims 137 to 164.
168. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more sensors, the programs comprising one or more programs that include instructions for performing the method according to any one of claims 137 to 164.
169. A non-temporary computer-readable storage medium that stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component and one or more sensors, wherein the one or more programs are The system detects user input corresponding to a request to perform a first operation associated with one or more of the sensors, In response to detecting the user input, the computer system performs the first operation based on one or more sensor measurements from a first set of sensors, regardless of whether it is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode. While the computer system is operating in the first operating mode, it monitors one or more sensor measurements from a second set of one or more sensors from the one or more sensors, and, in accordance with the determination that a specific condition has occurred, it performs a second operation based on one or more sensor measurements from the second set of one or more sensors. The occurrence of an event corresponding to the transition of the computer system from the first operating mode to the second operating mode is detected. A non-temporary computer-readable storage medium containing instructions for stopping monitoring sensor measurements from one or more sensors in response to detecting the occurrence of the aforementioned event, and for disabling the computer system's ability to perform the second operation based on the sensor measurements from one or more sensors when the individual conditions occur.
170. A computer system configured to communicate with a display generation component and one or more sensors, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more programs, The system detects user input corresponding to a request to perform a first operation associated with one or more of the sensors, In response to detecting the user input, the computer system performs the first operation based on one or more sensor measurements from a first set of sensors, regardless of whether it is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode. While the computer system is operating in the first operating mode, it monitors one or more sensor measurements from a second set of one or more sensors from the one or more sensors, and, in accordance with the determination that a specific condition has occurred, it performs a second operation based on one or more sensor measurements from the second set of one or more sensors. The occurrence of an event corresponding to the transition of the computer system from the first operating mode to the second operating mode is detected. A computer system including an instruction to stop monitoring sensor measurements from one or more sensors in response to detecting the occurrence of the event, and to disable the computer system's ability to perform a second action based on the sensor measurements from one or more sensors when the individual conditions occur.
171. A computer system configured to communicate with a display generation component and one or more sensors, means for detecting user input corresponding to a request to perform a first operation associated with one or more of the sensors, In response to detecting the user input, means for performing the first operation based on one or more sensor measurements from a first set of sensors, regardless of whether the computer system is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode, The computer system, while operating in the first operating mode, monitors one or more sensor measurements from a second set of one or more sensors, and, in accordance with the determination that a specific condition has occurred, means for performing a second operation based on one or more sensor measurements from the second set of one or more sensors, means for detecting the occurrence of an event corresponding to the transition of the computer system from the first operating mode to the second operating mode, A computer system comprising: means for stopping monitoring sensor measurements from one or more sensors in response to detecting the occurrence of the aforementioned event, and ceasing to disable the computer system's ability to perform a second operation based on the sensor measurements from one or more sensors when the individual conditions occur.
172. A computer program product, The display generation component includes one or more programs configured to be executed by one or more processors of a computer system communicating with one or more sensors, and the one or more programs are The system detects user input corresponding to a request to perform a first operation associated with one or more of the sensors, In response to detecting the user input, the computer system performs the first operation based on one or more sensor measurements from a first set of sensors, regardless of whether it is in a first operating mode or a second operating mode which is a lower-power operating mode than the first operating mode. While the computer system is operating in the first operating mode, it monitors one or more sensor measurements from a second set of one or more sensors from the one or more sensors, and, in accordance with the determination that a specific condition has occurred, it performs a second operation based on one or more sensor measurements from the second set of one or more sensors. The occurrence of an event corresponding to the transition of the computer system from the first operating mode to the second operating mode is detected. A computer program product that includes instructions to stop monitoring sensor measurements from one or more sensors in response to detecting the occurrence of the event, and to disable the computer system's ability to perform a second action based on the sensor measurements from one or more sensors when the individual conditions occur.