Mobile user interface

Abstract

The present disclosure generally relates to a mobile user interface.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 409,775, filed on September 24, 2022, entitled “MOVEMENT USER INTERFACE,” the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates generally to computer user interfaces and, more particularly, to techniques for indicating movement. Background Art

[0004] Some devices capture the movement of objects in the physical environment. Such movement can be used to allow people to understand the physical environment and interact with other people. Summary of the invention

[0005] However, some techniques for indicating movement using electronic devices are often cumbersome and inefficient. For example, some prior art techniques use complex and time-consuming user interfaces that may include multiple keystrokes or keystrokes. Prior art techniques require more time than necessary, which results in wasted user time and device energy. This latter consideration is particularly important in battery-powered devices.

[0006] Therefore, the present technology provides electronic devices with faster, more efficient methods and interfaces for indicating movement. Such methods and interfaces optionally supplement or replace other methods for indicating movement. Such methods and interfaces reduce the cognitive burden imposed on users and produce more efficient human-computer interfaces. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charges.

[0007] In some embodiments, a method is performed at a computer system that communicates with a display generation component and one or more sensors. In some embodiments, the method includes: while the computer system is moving in an environment, displaying a user interface element in a first appearance via the display generation component; while displaying the user interface element: based on determining that a first set of criteria are met, continuing to display the user interface element in the first appearance; and based on determining that the first set of criteria are not met, displaying the user interface element in a second appearance different from the first appearance via the display generation component, and stopping displaying the user interface element in the first appearance. The system also includes: detecting data about the environment via the one or more sensors; and in response to detecting data about the environment: based on determining that a second set of criteria are met, displaying a representation of a subject via the display generation component, wherein the second set of criteria includes a first standard that is met when the subject is detected in the data, and wherein the second set of criteria includes a second standard that is met when the first set of movement criteria are not met. The system also includes: based on determining that the second set of criteria are not met, abandoning displaying the representation of the subject.

[0008] In some embodiments, a non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component and one or more sensors. In some embodiments, the one or more programs include: when the computer system is moving in an environment, displaying a user interface element in a first appearance via the display generation component; when displaying the user interface element: based on determining that a first set of criteria are met, continue to display the user interface element in the first appearance; and based on determining that the first set of criteria are not met, display the user interface element in a second appearance different from the first appearance via the display generation component, and stop displaying the user interface element in the first appearance. The program also includes: detecting data about the environment via the one or more sensors; and in response to detecting data about the environment: based on determining that a second set of criteria are met, displaying a representation of a subject via the display generation component, wherein the second set of criteria includes a first criterion that is met when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is met when the first set of movement criteria are not met; and based on determining that the second set of criteria are not met, abandoning displaying the representation of the subject.

[0009] In some embodiments, a transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component and one or more sensors. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a user interface element in a first appearance via the display generation component while the computer system is moving in an environment; while displaying the user interface element: continuing to display the user interface element in the first appearance based on determining that a first set of criteria are met; and displaying the user interface element in a second appearance different from the first appearance via the display generation component based on determining that the first set of criteria are not met, and stopping displaying the user interface element in the first appearance. The program also includes: detecting data about the environment via the one or more sensors; and in response to detecting data about the environment: displaying a representation of a subject via the display generation component based on determining that a second set of criteria are met, wherein the second set of criteria includes a first criterion that is met when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is met when the first set of movement criteria are not met; and abandoning displaying the representation of the subject based on determining that the second set of criteria are not met.

[0010] In some embodiments, a computer system is described that is configured to communicate with a display generation component and one or more sensors. In some embodiments, the computer system includes: one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: when the computer system is moving in an environment, displaying a user interface element in a first appearance via the display generation component; when displaying the user interface element: based on determining that a first set of criteria are met, continue to display the user interface element in the first appearance; and based on determining that the first set of criteria are not met, display the user interface element in a second appearance different from the first appearance via the display generation component, and stop displaying the user interface element in the first appearance. The system also includes: detecting data about the environment via the one or more sensors; and in response to detecting data about the environment: based on determining that a second set of criteria are met, displaying a representation of a subject via the display generation component, wherein the second set of criteria includes a first standard that is met when the subject is detected in the data, and wherein the second set of criteria includes a second standard that is met when the first set of movement criteria are not met; and based on determining that the second set of criteria are not met, abandoning displaying the representation of the subject.

[0011] In some embodiments, a computer system is described that is configured to communicate with a display generation component and one or more sensors. In some embodiments, the computer system includes: a component for displaying a user interface element in a first appearance via the display generation component when the computer system is moving in an environment; a component for performing the following operations when displaying the user interface element: based on determining that a first set of criteria are met, continue to display the user interface element in the first appearance; and based on determining that the first set of criteria are not met, display the user interface element in a second appearance different from the first appearance via the display generation component, and stop displaying the user interface element in the first appearance. The system also includes: a component for detecting data about the environment via the one or more sensors; and a component for performing the following operations in response to detecting data about the environment: based on determining that a second set of criteria are met, display a representation of a subject via the display generation component, wherein the second set of criteria includes a first standard that is met when the subject is detected in the data, and wherein the second set of criteria includes a second standard that is met when the first set of movement criteria are not met. The system also includes: based on determining that the second set of criteria are not met, abandoning displaying the representation of the subject.

[0012] In some embodiments, a computer program product is configured to communicate with a display generation component and one or more sensors. In some embodiments, the computer program product includes: when the computer system is moving in the environment, displaying a user interface element in a first appearance via the display generation component; when displaying the user interface element: based on determining that a first set of criteria are met, continue to display the user interface element in the first appearance; and based on determining that the first set of criteria are not met, display the user interface element in a second appearance different from the first appearance via the display generation component, and stop displaying the user interface element in the first appearance. The product also includes: detecting data about the environment via the one or more sensors; and in response to detecting data about the environment: based on determining that a second set of criteria are met, displaying a representation of a subject via the display generation component, wherein the second set of criteria includes a first criterion that is met when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is met when the first set of movement criteria are not met; and based on determining that the second set of criteria are not met, abandoning displaying the representation of the subject.

[0013] In some embodiments, a method is performed at a computer system in communication with a display generation component and one or more sensors. In some embodiments, the method includes: detecting data corresponding to a subject in an environment via the one or more sensors; and in response to detecting the data corresponding to the subject: displaying a user interface indicating a perception of the subject via the display generation component based on determining that the subject meets a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are met when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; and abandoning displaying the first user interface object based on determining that the subject does not meet the corresponding set of criteria.

[0014] In some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component and one or more sensors. In some embodiments, the one or more programs include instructions for performing the following operations: detecting data corresponding to a subject in an environment via the one or more sensors; and in response to detecting the data corresponding to the subject: displaying a user interface indicating a perception of the subject via the display generation component based on determining that the subject meets a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are met when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; and abandoning displaying the first user interface object based on determining that the subject does not meet the corresponding set of criteria.

[0015] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs that are configured to be executed by one or more processors of a computer system that communicates with a display generation component and one or more sensors. In some embodiments, the one or more programs include instructions for performing the following operations: detecting data corresponding to a subject in an environment via the one or more sensors; and in response to detecting the data corresponding to the subject: displaying a user interface indicating a perception of the subject via the display generation component based on determining that the subject meets a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are met when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; and abandoning displaying the first user interface object based on determining that the subject does not meet the corresponding set of criteria.

[0016] In some embodiments, a computer system is described, which is configured to communicate with a display generation component and one or more sensors. In some embodiments, the computer system also includes: one or more processors; and a memory, the memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: detecting data corresponding to a subject in an environment via the one or more sensors; and in response to detecting the data corresponding to the subject: displaying a user interface indicating a perception of the subject via the display generation component based on determining that the subject meets a corresponding set of criteria, wherein the corresponding set of criteria includes a standard that is met when determining that the subject is within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; and abandoning displaying the first user interface object based on determining that the subject does not meet the corresponding set of criteria.

[0017] In some embodiments, a computer system is described that is configured to communicate with a display generation component and one or more sensors. The computer system includes: a component for detecting data corresponding to a subject in an environment via the one or more sensors; and a component for performing the following operations in response to detecting the data corresponding to the subject: displaying a user interface indicating the perception of the subject via the display generation component based on determining that the subject meets a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are met when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; and abandoning displaying the first user interface object based on determining that the subject does not meet the corresponding set of criteria.

[0018] In some embodiments, a computer program product is described that is configured to communicate with a display generation component and one or more sensors. In some embodiments, the computer program product includes: detecting data corresponding to a subject in an environment via the one or more sensors; and in response to detecting the data corresponding to the subject: displaying a user interface indicating a perception of the subject via the display generation component based on determining that the subject meets a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are met when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; and abandoning displaying the first user interface object based on determining that the subject does not meet the corresponding set of criteria.

[0019] In some embodiments, a method is performed at a computer system in communication with a display generation component. In some embodiments, the method includes: while displaying a corresponding user interface having a certain amount of a visual characteristic via a display generation component, detecting an occurrence of a corresponding set of movement conditions; and in response to detecting the occurrence of the corresponding set of movement conditions: based on determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristic relative to a movement rate of the computer system; and based on determining that the corresponding set of movement conditions is a second set of movement conditions different from the first set of movement conditions, changing the amount of the visual characteristic relative to a corresponding rate different from the movement rate of the computer system.

[0020] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component and one or more sensors. In some embodiments, the one or more programs include instructions for performing the following operations: when displaying a corresponding user interface having a certain amount of visual characteristics via a display generation, detecting the occurrence of a corresponding set of movement conditions; and in response to detecting the occurrence of the corresponding set of movement conditions: based on determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristics relative to a movement rate of the computer system; and based on determining that the corresponding set of movement conditions is a second set of movement conditions different from the first set of movement conditions, changing the amount of the visual characteristics relative to a corresponding rate different from the movement rate of the computer system.

[0021] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component and one or more sensors. In some embodiments, the one or more programs include instructions for performing the following operations: when displaying a corresponding user interface having a certain amount of visual characteristics via a display generation, detecting the occurrence of a corresponding set of movement conditions; and in response to detecting the occurrence of the corresponding set of movement conditions: based on determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristics relative to a movement rate of the computer system; and based on determining that the corresponding set of movement conditions is a second set of movement conditions different from the first set of movement conditions, changing the amount of the visual characteristics relative to a corresponding rate different from the movement rate of the computer system.

[0022] In some embodiments, a computer system is described that is configured to communicate with a display generation component and one or more sensors. In some embodiments, the computer system includes: one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: when displaying a corresponding user interface having a certain amount of visual characteristics via a display generation, detecting the occurrence of a corresponding set of movement conditions; and in response to detecting the occurrence of the corresponding set of movement conditions: based on determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristics relative to a movement rate of the computer system; and based on determining that the corresponding set of movement conditions is a second set of movement conditions different from the first set of movement conditions, changing the amount of the visual characteristics relative to a corresponding rate different from the movement rate of the computer system.

[0023] In some embodiments, a computer system is configured to communicate with a display generation component and one or more sensors. In some embodiments, the computer system includes: a component for detecting the occurrence of a corresponding set of movement conditions when displaying a corresponding user interface having a certain amount of visual characteristics via a display generation; and a component for performing the following operations in response to detecting the occurrence of the corresponding set of movement conditions: based on determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristics relative to a movement rate of the computer system; and based on determining that the corresponding set of movement conditions is a second set of movement conditions different from the first set of movement conditions, changing the amount of the visual characteristics relative to a corresponding rate different from the movement rate of the computer system.

[0024] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes: detecting an occurrence of a corresponding set of movement conditions when generating a display of a corresponding user interface having a certain amount of a visual characteristic; and in response to detecting the occurrence of the corresponding set of movement conditions: based on determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristic relative to a movement rate of the computer system; and based on determining that the corresponding set of movement conditions is a second set of movement conditions different from the first set of movement conditions, changing the amount of the visual characteristic relative to a corresponding rate different from the movement rate of the computer system.

[0025] In some embodiments, a method is performed at a computer system in communication with a display generation component. In some embodiments, the method includes: displaying a user interface via the display generation component, the user interface including an indication displayed in a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; while displaying the user interface including the indication covering the first portion and the second portion via the display generation component and while the computer system is in a non-stationary state, detecting a change in a movement condition; and in response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to a stationary state, changing the indication via the display generation component so that the indication is displayed in the first portion and not in the second portion.

[0026] In some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a user interface via the display generation component, the user interface including an indication displayed in a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; when the user interface including the indication covering the first portion and the second portion is displayed via the display generation component and when the computer system is in a non-stationary state, detecting a change in a movement condition; and in response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to a stationary state, changing the indication via the display generation component so that the indication is displayed in the first portion and not in the second portion.

[0027] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs that are configured to be executed by one or more processors of a computer system that communicates with a display generation component. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a user interface via the display generation component, the user interface including an indication displayed in a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; when the user interface including the indication covering the first portion and the second portion is displayed via the display generation component and when the computer system is in a non-stationary state, detecting a change in a movement condition; and in response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to a stationary state, changing the indication via the display generation component so that the indication is displayed in the first portion and not in the second portion.

[0028] In some embodiments, a computer system is described that is configured to communicate with a display generation component. In some embodiments, the computer system includes: one or more processors; a memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: displaying a user interface via the display generation component, the user interface including an indication displayed in a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; when the user interface including the indication covering the first portion and the second portion is displayed via the display generation component and when the computer system is in a non-stationary state, detecting a change in a movement condition; and in response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to the stationary state, changing the indication via the display generation component so that the indication is displayed in the first portion and not in the second portion.

[0029] In some embodiments, a computer system is described that is configured to communicate with a display generation component. In some embodiments, the computer system includes: a component for displaying a user interface via the display generation component, the user interface including an indication displayed in a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; a component for detecting a change in a movement condition when the user interface including the indication covering the first portion and the second portion is displayed via the display generation component and when the computer system is in a non-stationary state; and a component for changing the indication via the display generation component in response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to the stationary state, so that the indication is displayed in the first portion but not in the second portion.

[0030] In some embodiments, a computer program product is described that is configured to communicate with a display generation component. The computer program product includes: displaying a user interface via the display generation component, the user interface including an indication displayed in a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; while displaying the user interface including the indication covering the first portion and the second portion via the display generation component and while the computer system is in a non-stationary state, detecting a change in a movement condition; and in response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to a stationary state, changing the indication via the display generation component so that the indication is displayed in the first portion and not in the second portion.

[0031] In some embodiments, a method is performed at a computer system in communication with a display generation component and a physical mechanism. In some embodiments, the method includes: displaying a first user interface via the display generation component; while displaying the first user interface, detecting an occurrence of a condition; and in response to detecting the occurrence of the condition: displaying a second user interface different from the first user interface via the display generation component; and causing the physical mechanism to lower the computer system.

[0032] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and a physical mechanism. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a first user interface via the first display generation component; while displaying the first user interface, detecting an occurrence of a condition; and in response to detecting the occurrence of the condition: displaying a second user interface different from the first user interface via the display generation component; and causing the physical mechanism to lower the computer system.

[0033] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and a physical mechanism. In some embodiments, the one or more programs include instructions for: displaying a first user interface via the first display generation component; while displaying the first user interface, detecting an occurrence of a condition; and in response to detecting the occurrence of the condition: displaying a second user interface different from the first user interface via the display generation component; and causing the physical mechanism to lower the computer system.

[0034] In some embodiments, a computer system is described that is configured to communicate with a display generation component and a physical mechanism. In some embodiments, the computer system includes: one or more processors; and a memory that stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: displaying a first user interface via the display generation component; while displaying the first user interface, detecting an occurrence of a condition; and in response to detecting the occurrence of the condition: displaying a second user interface different from the first user interface via the display generation component; and causing the physical mechanism to lower the computer system.

[0035] In some embodiments, a computer system is described that is configured to communicate with a display generation component and one or more sensors. The computer system includes: a component for displaying a first user interface via the display generation component; a component for detecting the occurrence of a condition while displaying the first user interface; and a component for performing the following operations in response to detecting the occurrence of the condition: displaying a second user interface different from the first user interface via the display generation component; and causing the physical mechanism to lower the computer system.

[0036] In some embodiments, a computer system product is described, the computer system product being configured to communicate with a display generation component and one or more sensors. The computer program product includes: displaying a first user interface via the display generation component; while displaying the first user interface, detecting an occurrence of a condition; and in response to detecting the occurrence of the condition: displaying a second user interface different from the first user interface via the display generation component; and causing the physical mechanism to lower the computer system.

[0037] In some embodiments, a method is performed at a computer system that communicates with a first display generation component and a second display generation component. The method includes: displaying a first user interface element in a first appearance via the first display generation component when the computer system is moving; detecting the occurrence of one or more events when the first user interface element is displayed in the first appearance; and in response to detecting the occurrence of the one or more events:. The method also includes: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving. The method also includes: displaying the first user interface element in a second appearance different from the first appearance via the first display generation component based on determining that the one or more events do not include the first event. The method also includes: displaying a second user interface element at least partially surrounding the first user interface element via the second display generation component based on determining that the one or more events include a second event, the second event being an event of a different type from the first event. The method also includes: abandoning displaying the second user interface element via the second display generation component based on determining that the one or more events do not include the second event.

[0038] In some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of a computer system communicating with a first display generating component and a second display generating component. In some embodiments, the one or more programs include instructions for performing the following operations: when the computer system is moving, displaying a first user interface element in a first appearance via the first display generating component; while displaying the first user interface element in the first appearance, detecting the occurrence of one or more events; and in response to detecting the occurrence of the one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; based on determining that the one or more events do not include the first event, displaying the first user interface element in a second appearance different from the first appearance via the first display generating component; based on determining that the one or more events include a second event, displaying a second user interface element at least partially surrounding the first user interface element via the second display generating component, the second event being an event of a different type from the first event; and based on determining that the one or more events do not include the second event, abandoning displaying the second user interface element via the second display generating component.

[0039] In some embodiments, a transient computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of a computer system communicating with a first display generating component and a second display generating component. In some embodiments, the one or more programs include instructions for performing the following operations: when the computer system is moving, displaying a first user interface element in a first appearance via the first display generating component; while displaying the first user interface element in the first appearance, detecting the occurrence of one or more events; and in response to detecting the occurrence of the one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; based on determining that the one or more events do not include the first event, displaying the first user interface element in a second appearance different from the first appearance via the first display generating component; based on determining that the one or more events include a second event, displaying a second user interface element at least partially surrounding the first user interface element via the second display generating component, the second event being an event of a different type from the first event; and based on determining that the one or more events do not include the second event, abandoning displaying the second user interface element via the second display generating component.

[0040] In some embodiments, a computer system is configured to communicate with a first display generation component and a second display generation component. In some embodiments, the computer system also includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: when the computer system is moving, displaying a first user interface element in a first appearance via the first display generation component; when displaying the first user interface element in the first appearance, detecting the occurrence of one or more events; and in response to detecting the occurrence of the one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; based on determining that the one or more events do not include the first event, displaying the first user interface element in a second appearance different from the first appearance via the first display generation component; based on determining that the one or more events include a second event, displaying a second user interface element at least partially surrounding the first user interface element via the second display generation component, the second event being an event of a different type from the first event; and based on determining that the one or more events do not include the second event, abandoning displaying the second user interface element via the second display generation component.

[0041] In some embodiments, a computer system is described that is configured to communicate with a first display generation component and a second display generation component. In some embodiments, the computer system includes: a component for displaying a first user interface element in a first appearance via the first display generation component when the computer system is moving; a component for detecting the occurrence of one or more events when the first user interface element is displayed in the first appearance; and a component for performing the following operations in response to detecting the occurrence of the one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; displaying the first user interface element in a second appearance different from the first appearance via the first display generation component based on determining that the one or more events do not include the first event; displaying a second user interface element at least partially surrounding the first user interface element via the second display generation component based on determining that the one or more events include a second event, the second event being an event of a different type from the first event; and abandoning displaying the second user interface element via the second display generation component based on determining that the one or more events do not include the second event.

[0042] In some embodiments, a computer program product is described, which is configured to communicate with a first display generation component and a second display generation component. In some embodiments, the computer program product includes: when the computer system is moving, displaying a first user interface element in a first appearance via the first display generation component; when displaying the first user interface element in the first appearance, detecting the occurrence of one or more events; and in response to detecting the occurrence of the one or more events: based on determining that the one or more events include a first event, continue to display the first user interface element in the first appearance, wherein when it is determined that the computer system is moving, the first event is detected; based on determining that the one or more events do not include the first event, displaying the first user interface element in a second appearance different from the first appearance via the first display generation component; based on determining that the one or more events include a second event, displaying a second user interface element at least partially surrounding the first user interface element via the second display generation component, the second event being an event of a different type from the first event; and based on determining that the one or more events do not include the second event, abandoning displaying the second user interface element via the second display generation component. Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are optionally included in a transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0043] Thus, devices are provided with faster, more efficient methods and interfaces for indicating movement, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices. Such methods and interfaces may supplement or replace other methods for indicating movement. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, in which like reference numerals designate corresponding parts throughout the several views.

[0045] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.

[0046] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments.

[0047] Figure 2 A portable multifunction device with a touch screen according to some embodiments is illustrated.

[0048] Figure 3is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0049] Figure 4A An exemplary user interface for a menu of applications on a portable multifunction device according to some embodiments is illustrated.

[0050] Figure 4B An exemplary user interface for a multifunction device having a touch-sensitive surface separate from the display is illustrated according to some embodiments.

[0051] Figure 5A Personal electronic devices according to some embodiments are illustrated.

[0052] Figure 5B is a block diagram illustrating a personal electronic device according to some embodiments.

[0053] FIG. 5C to FIG. 5D Exemplary components of a personal electronic device with a touch-sensitive display and an intensity sensor according to some embodiments are illustrated.

[0054] FIG. 5E to FIG. 5H Illustrated are exemplary components and user interfaces of a personal electronic device according to some embodiments.

[0055] 6A to 6F An exemplary user interface for indicating movement using computer system 600 according to some embodiments is illustrated.

[0056] Figure 7 is a flow chart illustrating a method for instructing movement of a computer system and a subject according to some embodiments.

[0057] Figure 8 is a flow chart illustrating a method for indicating perception of a subject using a computer system according to some embodiments.

[0058] Fig. 9 is a flowchart illustrating a method for indicating acceleration using a computer system according to some embodiments.

[0059] Fig.10 is a flow chart illustrating a method for instructing movement of a computer system according to some embodiments.

[0060] Fig.11 is a flow chart illustrating a method for indicating the absence of movement using a computer system according to some embodiments.

[0061] Fig.12 is a flow chart illustrating a method for indicating movement information using a computer system according to some embodiments. DETAILED DESCRIPTION

[0062] The following description sets forth exemplary methods and parameters, etc. However, it should be appreciated that such description is not intended to limit the scope of the present disclosure, but is provided as a description of exemplary embodiments.

[0063] There is a need for electronic devices that provide efficient methods and interfaces for indicating movement. Such techniques can reduce the cognitive burden imposed on users, thereby increasing productivity. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0064] under Figure 1A to Figure 1B , Figure 2 , Figure 3 , FIG. 4A to FIG. 4B and FIG. 5A to FIG. 5H A description of an exemplary device for performing techniques for management event notifications is provided. 6A to 6F An exemplary user interface for indicating movement is illustrated. Figure 7 is a flow chart illustrating a method for instructing movement of a computer system and a subject according to some embodiments. Figure 8 is a flow chart illustrating a method for indicating perception of a subject using a computer system according to some embodiments. Fig. 9 is a flowchart illustrating a method for indicating acceleration using a computer system according to some embodiments. Fig.10 is a flow chart illustrating a method for instructing movement of a computer system according to some embodiments. Fig.11 is a flow chart illustrating a method for indicating the absence of movement using a computer system according to some embodiments. Fig.12 is a flow chart illustrating a method for indicating movement information using a computer system according to some embodiments. 6A to 6F The user interface in is used to illustrate the processes described below, which include Figures 7 to 12 process.

[0065] The processes described below enhance the operability of the device and make the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device) through various techniques, including by providing improved visual feedback to the user, reducing the number of inputs required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, performing an operation without further user input when a set of conditions have been met, and / or additional techniques. These techniques also reduce power usage and extend the battery life of the device by enabling the user to use the device more quickly and more efficiently.

[0066] In addition, in the method described herein where one or more steps depend on one or more conditions having been met, it should be understood that the method can be repeated in multiple repetitions so that in the process of repetition, all conditions for determining the steps in the method have been met in different repetitions of the method. For example, if the method needs to perform a first step (if the condition is met) and a second step (if the condition is not met), then the skilled person will know that the steps stated are repeated until both the condition is met and the condition is not met (in no particular order). Therefore, the method described as having one or more steps depending on one or more conditions having been met can be rewritten as a method of repeating until each of the conditions described in the method has been met. However, this does not require a system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing a contingent operation based on the satisfaction of the corresponding one or more conditions, and is therefore able to determine whether a possible situation has been met without explicitly repeating the steps of the method until all conditions in the conditions for determining the steps in the method have been met. It will also be understood by those of ordinary skill in the art that, similar to the method with a contingent step, the system or computer-readable storage medium can repeat the steps of the method as many times as needed to ensure that all contingent steps have been performed.

[0067] Although the following description uses the terms "first", "second", etc. to describe various elements, these elements should not be limited by the terms. In some embodiments, these terms are used to distinguish one element from another element. For example, a first touch can be named a second touch and similarly a second touch can be named a first touch without departing from the scope of the various described embodiments. In some embodiments, the first touch and the second touch are two separate references to the same touch. In some embodiments, both the first touch and the second touch are touches, but they are not the same touch.

[0068] The terms used in the description of various described embodiments herein are only for the purpose of describing specific embodiments, and are not intended to be limiting. As used in the description of various described embodiments and in the appended claims, the singular forms "one", "a kind of" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the terms "and / or" used herein refer to and encompass any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "including" and / or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or their grouping.

[0069] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that ..." or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that ..." or "in response to determining that ..." or "upon detecting [a stated condition or event]," or "in response to detecting [a stated condition or event]," depending on the context.

[0070] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or a music player function. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc. of Cupertino, California. Devices, iPod Equipment and Device. Optionally use other portable electronic devices, such as laptop computers or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads). In some embodiments, the electronic device is a computer system that communicates with the display generation component (e.g., via wireless communication, via wired communication). The display generation component is configured to provide visual output, such as display via a CRT display, display via an LED display, or display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separated from the computer system. As used herein, "display" content includes sending data (e.g., image data or video data) to an integrated or external display generation component via a wired or wireless connection to visually generate content to display content (e.g., video data rendered or decoded by display controller 156).

[0071] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.

[0072] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0073] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as a touch-sensitive surface) optionally supports various applications with a user interface that is intuitive and clear to the user.

[0074] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A 1 is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a "touch-sensitive display system". The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0075] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) of the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface adjacent to the contact and / or its change, and / or the resistance of the touch-sensitive surface adjacent to the contact and / or its change are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functionality that would otherwise be inaccessible to the user on a smaller device with limited real estate, which is used to display an enable indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0076] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of a device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device that will be detected by a user using the user's sense of touch. For example, in the case where the device or a component of the device is in contact with a user's touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical property of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" to a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, movement of a touch-sensitive surface may optionally be interpreted or sensed by a user as "roughness" of the touch-sensitive surface even when the smoothness of the touch-sensitive surface does not change. While such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.

[0077] It should be understood that device 100 is merely one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0078] The memory 102 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state memory devices. The memory controller 122 optionally controls the access rights of other components of the device 100 to the memory 102.

[0079] The peripheral device interface 118 can be used to couple the input peripheral devices and output peripheral devices of the device to the CPU 120 and the memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data. In some embodiments, the peripheral device interface 118, the CPU 120, and the memory controller 122 are optionally implemented on a single chip (such as the chip 104). In some other embodiments, they are optionally implemented on separate chips.

[0080] RF (radio frequency) circuit 108 receives and sends RF signals, also referred to as electromagnetic signals. RF circuit 108 converts electrical signals into / converts electromagnetic signals into electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, subscriber identity modules (SIM) cards, memories, and the like. RF circuit 108 optionally communicates with networks (such as the Internet (also referred to as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs))) and other devices via wireless communications. RF circuit 108 optionally includes well-known circuits for detecting near field communications (NFC) fields, such as by short-range communication radio components. Wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Utilizing Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)) and / or Short Message Service (SMS), or any other suitable communications protocol including communications protocols that have not yet been developed as of the filing date of this document.

[0081] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and sends the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and sends the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or sent to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset having both output (eg, single-ear headset or dual-ear headset) and input (eg, microphone).

[0082] The I / O subsystem 106 couples input / output peripherals on the device 100, such as the touch screen 112 and other input control devices 116, to a peripherals interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive / transmit electrical signals from / to other input control devices 116. Other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, and the like. In some embodiments, the input controller 160 is optionally coupled to any of the following (or none of the following): a keyboard, an infrared port, a USB port, and a pointing device (such as a mouse). One or more buttons (e.g., Figure 2 208) optionally includes an increase / decrease button for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2206 in). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking a user's gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system. In some embodiments, an air gesture is a gesture that is detected without the user touching an input element that is part of the device (or independent of an input element that is part of the device) and is based on detected movement of a part of the user's body through the air, including movement of the user's body relative to an absolute reference (for example, the angle of the user's arm relative to the ground or the distance of the user's hand relative to the ground), movement relative to another part of the user's body (for example, movement of the user's hand relative to the user's shoulder, movement of one of the user's hands relative to the user's other hand, and / or movement of the user's fingers relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (for example, a tap gesture involving a hand moving a predetermined amount and / or speed in a predetermined posture, or a shake gesture involving a predetermined speed or amount of rotation of a part of the user's body).

[0083] A quick press of the push button optionally disengages the lock of the touch screen 112 or optionally begins the process of unlocking the device using gestures on the touch screen, as described in U.S. Patent Application 11 / 322,549, filed on December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," (i.e., U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functionality of one or more of these buttons is optionally user-customizable. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0084] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or transmits electrical signals to the touch screen. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0085] The touch screen 112 has a touch-sensitive surface, sensor, or sensor group that accepts input from a user based on tactile and / or haptic contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of the contact) on the touch screen 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0086] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the Apple iPod Touch from Apple Inc. of Cupertino, California. and iPod The technology used in

[0087] The touch-sensitive display in some embodiments of touch screen 112 is optionally similar to the multi-touch-sensitive touchpad described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, touch screen 112 displays visual output from device 100, while a touch-sensitive touchpad does not provide visual output.

[0088] The touch-sensitive display in some embodiments of the touch screen 112 is described in the following applications: (1) U.S. patent application No. 11 / 381,313, filed on May 2, 2006, "Multipoint Touch Surface Controller"; (2) U.S. patent application No. 10 / 840,862, filed on May 6, 2004, "Multipoint Touchscreen"; (3) U.S. patent application No. 10 / 903,964, filed on July 30, 2004, "Gestures For Touch Sensitive Input Devices"; (4) U.S. patent application No. 11 / 048,264, filed on January 31, 2005, "Gestures For Touch Sensitive Input Devices"; (5) U.S. patent application No. 11 / 038,590, filed on January 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive No. 11 / 228,700, filed on September 16, 2005, "Operation Of A Computer With A Touch Screen Interface"; (8) No. 11 / 228,737, filed on September 16, 2005, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard"; and (9) No. 11 / 367,749, filed on March 3, 2006, "Multi-Functional Hand-Held Device". All of these applications are incorporated herein by reference in their entirety.

[0089] The touch screen 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or attachment such as a stylus, finger, etc. to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​the finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positioning or commands for performing the actions desired by the user.

[0090] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from the touch screen 112, or an extension of the touch-sensitive surface formed by the touch screen.

[0091] Device 100 also includes a power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power fault detection circuits, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0092] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with the imaging module 143 (also referred to as a camera module), the optical sensor 164 optionally captures a static image or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to the touch screen display 112 on the front of the device, so that the touch screen display can be used as a viewfinder for static image and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device so that the user's image is optionally obtained for video conferencing when the user views other video conference participants on the touch screen display. In some embodiments, the positioning of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that a single optical sensor 164 is used with the touch screen display for both video conferencing and static image and / or video image acquisition.

[0093] Device 100 optionally also includes one or more depth camera sensors 175 . Figure 1A A depth camera sensor coupled to a depth camera controller 169 in the I / O subsystem 106 is shown. The depth camera sensor 175 receives data from the environment to create a three-dimensional model of an object (e.g., a face) within the scene from a viewpoint (e.g., a depth camera sensor). In some embodiments, in conjunction with the imaging module 143 (also referred to as a camera module), the depth camera sensor 175 is optionally used to determine a depth map of different portions of the image captured by the imaging module 143. In some embodiments, the depth camera sensor is located on the front of the device 100, so that an image of the user with depth information is optionally obtained for video conferencing while the user is viewing other video conference participants on the touch screen display, and a selfie with depth map data is captured. In some embodiments, the depth camera sensor 175 is located on the rear of the device, or on both the rear and front of the device 100. In some embodiments, the positioning of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that the depth camera sensor 175 is used with the touch screen display for both video conferencing and static image and / or video image acquisition.

[0094] In some embodiments, a depth map (e.g., a depth map image) contains information (e.g., values) related to the distance of an object in a scene from a viewpoint (e.g., a camera, an optical sensor, a depth camera sensor). In one embodiment of a depth map, each depth pixel defines the position of its corresponding two-dimensional pixel in the Z axis of the viewpoint. In some embodiments, a depth map consists of pixels, each of which is defined by a value (e.g., 0 to 255). For example, a "0" value represents a pixel located farthest from a viewpoint (e.g., a camera, an optical sensor, a depth camera sensor) in a "three-dimensional" scene, and a "255" value represents a pixel located closest to the viewpoint in a "three-dimensional" scene. In other embodiments, a depth map represents the distance between an object in a scene and a plane of the viewpoint. In some embodiments, a depth map includes information about the relative depths of various features of an object of interest in the field of view of a depth camera (e.g., the relative depths of the eyes, nose, mouth, and ears of a user's face). In some embodiments, a depth map includes information that enables the device to determine the contour of an object of interest along the z direction.

[0095] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor is shown coupled to a force sensor controller 159 in the I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100, opposite to touch screen display 112 located on the front of device 100.

[0096] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1AA proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 is optionally implemented as described in U.S. patent application Ser. No. 11 / 241,839, entitled “Proximity Detector In Handheld Device”; U.S. patent application Ser. No. 11 / 240,788, entitled “Proximity Detector In Handheld Device”; U.S. patent application Ser. No. 11 / 620,702, entitled “Using Ambient Light Sensor To Augment Proximity Sensor Output”; U.S. patent application Ser. No. 11 / 586,862, entitled “Automated Response To And Sensing Of User Activity In Portable Devices”; and U.S. patent application Ser. No. 11 / 638,251, entitled “Methods And Systems For Automatic Configuration Of Peripherals”, the entirety of which is hereby incorporated by reference herein. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch screen 112.

[0097] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1AA tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as a speaker or other audio component; and / or an electromechanical device for converting energy into linear motion such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component for converting an electrical signal into a tactile output on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates a tactile output on the device 100 that can be felt by a user of the device 100. In some embodiments, at least one tactile output generator is arranged in parallel or adjacent to a touch-sensitive surface (e.g., a touch-sensitive display system 112) and optionally generates a tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward of the surface of the device 100) or laterally (e.g., backward and forward in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.

[0098] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripherals interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 optionally performs as described in U.S. Patent Publication No. 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication No. 20060017692, entitled "Methods And Apparatuses For Operating A Portable Device Based On AnAccelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed in a portrait view or a landscape view on a touch screen display based on analysis of data received from one or more accelerometers. Device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver in addition to accelerometer 168 for obtaining information about the position and orientation (eg, portrait or landscape) of device 100 .

[0099] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) storage device / global internal state 157, such as Figure 1A and Figure 3 The device / global internal state 157 includes one or more of the following: an active application state indicating which applications, if any, are currently active; a display state indicating what applications, views, or other information occupy various areas of the touch screen display 112; a sensor state including information obtained from various sensors and input control devices 116 of the device; and position information relating to the position and / or posture of the device.

[0100] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitating communication between various hardware components and software components.

[0101] The communication module 128 facilitates communication with other devices through one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is connected to (trademark of Apple Inc.) devices.

[0102] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger press event), determining the contact strength (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes: determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on the touch pad.

[0103] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of a touchpad or touchscreen can be set to any one of a large range of predefined thresholds. Additionally, in some specific implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0104] The contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.

[0105] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0106] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application or the like, along with coordinate data and other graphic attribute data if necessary, and then generates screen image data to be output to the display controller 156.

[0107] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0108] Text input module 134, optionally as a component of graphics module 132, provides a soft keyboard for entering text in various applications (eg, contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0109] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services, such as a weather widget, a local yellow pages widget, and a map / navigation widget).

[0110] Application 136 optionally includes the following modules (or instruction sets) or a subset or superset thereof:

[0111] Contacts module 137 (sometimes referred to as address book or contact list);

[0112] Telephone module 138;

[0113] Video conferencing module 139;

[0114] Email client module 140;

[0115] Instant messaging (IM) module 141;

[0116] Fitness support module 142;

[0117] A camera module 143 for still images and / or video images;

[0118] Image management module 144;

[0119] Video player module;

[0120] Music player module;

[0121] Browser module 147;

[0122] Calendar module 148;

[0123] A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock market widget 149-2, a calculator widget 149-3, an alarm widget 149-4, a dictionary widget 149-5, and other widgets acquired by the user and a widget 149-6 created by the user;

[0124] A widget creator module 150 for forming a user-created widget 149 - 6 ;

[0125] Search module 151;

[0126] Video and music player module 152, which combines the video player module and the music player module;

[0127] Notepad module 153;

[0128] Map module 154; and / or

[0129] Online video module 155.

[0130] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0131] In combination with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132 and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (for example, stored in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140 or IM 141; and the like.

[0132] In conjunction with RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a character sequence corresponding to a phone number, access one or more phone numbers in contact module 137, modify an already entered phone number, dial a corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is completed. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0133] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0134] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, transmitting, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and transmit emails with still images or video images captured by camera module 143.

[0135] In conjunction with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for performing the following operations: entering a character sequence corresponding to an instant message, modifying previously entered characters, sending a corresponding instant message (e.g., using a short message service (SMS) or multimedia message service (MMS) protocol for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the instant messages sent and / or received optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or enhanced messaging services (EMS). As used herein, "instant messaging" refers to both telephone-based messages (e.g., messages transmitted using SMS or MMS) and Internet-based messages (e.g., messages transmitted using XMPP, SIMPLE, or IMPS).

[0136] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154 and the music player module, the fitness support module 142 includes executable instructions for performing the following operations: creating a fitness (e.g., with time, distance and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for fitness; and displaying, storing and sending fitness data.

[0137] In conjunction with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for performing the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.

[0138] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, marking, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0139] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for performing the following operations: browsing the Internet in accordance with user instructions, which user instructions include searching, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0140] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for performing the following operations: creating, displaying, modifying and storing calendars and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0141] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is a mini-application that is optionally downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm widget 149-4, and dictionary widget 149-5) or a mini-application created by a user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! widget).

[0142] In combination with the RF circuit 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134 and browser module 147, the widget creator module 150 is optionally used by a user to create widgets (e.g., turning a user-specified portion of a web page into a widget).

[0143] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for performing the following operations: searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search conditions (for example, one or more user-specified search terms) in accordance with user instructions.

[0144] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0145] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the notepad module 153 includes executable instructions for performing the following operations: creating and managing notepads and to-do lists according to user instructions, etc.

[0146] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the GPS module 135 and the browser module 147, the map module 154 is optionally used to receive, display, modify and store maps and data associated with the maps (e.g., driving directions, data relating to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0147] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for performing the following operations: allowing a user to access, browse, receive (e.g., by streaming and / or downloading), playback (e.g., on the touch screen or on an external display connected via external port 124), send an email with a link to a specific online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a specific online video. Additional description of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.

[0148] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as independent software programs (such as computer programs (e.g., including instructions)), processes or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1A In some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.

[0149] In some embodiments, the device 100 is a device where the operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touch pad. By using a touch screen and / or a touch pad as the primary input control device for operating the device 100, the number of physical input control devices (e.g., push buttons and dials, etc.) on the device 100 is optionally reduced.

[0150] A predefined set of functions performed exclusively through the touch screen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, a main desktop menu, or a root menu. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touchpad.

[0151] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0152] The event classifier 170 receives event information and determines the application 136-1 and the application view 191 of the application 136-1 to which the event information is to be delivered. The event classifier 170 includes an event monitor 171 and an event distributor module 174. In some embodiments, the application 136-1 includes an application internal state 192 that indicates one or more current application views displayed on the touch-sensitive display 112 when the application is active or executing. In some embodiments, the device / global internal state 157 is used by the event classifier 170 to determine which application(s) is currently active, and the application internal state 192 is used by the event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0153] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by application 136-1, a state queue for enabling a user to return to a previous state or view of application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0154] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 sends information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (through audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0155] In some embodiments, event monitor 171 sends requests at predetermined intervals to peripheral device interface 118. In response, peripheral device interface 118 sends event information. In other embodiments, peripheral device interface 118 sends event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0156] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0157] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0158] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as correct input is optionally determined at least in part based on the hit view of the initial touch that started the touch-based gesture.

[0159] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-events. In most cases, the hit view is the lowest level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it is identified as the hit view.

[0160] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, higher views in the hierarchy will still remain as actively participating views.

[0161] Event distributor module 174 distributes event information to event recognizers (e.g., event recognizers 180). In embodiments including active event recognizer determination module 173, event distributor module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event distributor module 174 stores the event information in an event queue, which is retrieved by corresponding event receivers 182.

[0162] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet other embodiments, event classifier 170 is a standalone module or is part of another module stored in memory 102, such as contact / motion module 130.

[0163] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, the corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more event recognizers in event recognizers 180 are part of an independent module, which is a higher-level object such as a user interface toolkit or application 136-1 from which methods and other properties are inherited. In some embodiments, the corresponding event handler 190 includes one or more of the following: data updater 176, object updater 177, GUI updater 178 and / or event data 179 received from event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177 or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 include one or more corresponding event handlers 190. In addition, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in the corresponding application view 191.

[0164] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally includes sub-event delivery instructions).

[0165] Event receiver 182 receives event information from event classifier 170. Event information includes information about sub-events such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of the touch, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another orientation (e.g., from a longitudinal orientation to a transverse orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0166] Event comparator 184 compares event information with predefined event or sub-event definitions, and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in events (e.g., 187-1 and / or 187-2) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (end of touch). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0167] In some embodiments, event definition 186 includes a definition of an event for a corresponding user interface object. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with a sub-event and the object that triggered the hit test.

[0168] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.

[0169] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0170] In some embodiments, the corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0171] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from transmitting (and deferred transmission) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and performs a predefined process.

[0172] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or with an actively participating view receives the event information and performs a predetermined process.

[0173] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and transmits the display information to graphics module 132 for display on a touch-sensitive display.

[0174] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0175] It should be understood that the above discussion of event processing of user touches on a touch-sensitive display also applies to other forms of user input that utilize input devices to operate multifunction device 100, and not all user input is initiated on a touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or holddowns; contact movement on a touch pad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as input corresponding to sub-events defining an event to be recognized.

[0176] Figure 2A portable multifunction device 100 with a touch screen 112 according to some embodiments is illustrated. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of these graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, when the user interrupts contact with one or more graphics, selection of one or more graphics will occur. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down) and / or rolling of fingers that have been in contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with a graphic will not select the graphic. For example, when the gesture corresponding to selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0177] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

[0178] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and for locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to: turn the device on / off by pressing the button and keeping the button in a pressed state for a predefined time interval; lock the device by pressing the button and releasing the button before the predefined time interval passes; and / or unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions through the microphone 113. The device 100 also optionally includes one or more contact strength sensors 165 for detecting the strength of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for a user of the device 100.

[0179] Figure 3300 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. Device 300 does not have to be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home controller or an industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or a mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above reference Figure 1A The tactile output generator 167 described above), sensor 359 (e.g., optical sensor, acceleration sensor, proximity sensor, touch sensor and / or contact intensity sensor (similar to the above reference Figure 1A The memory 370 may include a high-speed random access memory (such as DRAM, SRAM, DDR RAM) or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 370 may optionally include one or more storage devices located away from the CPU 310. In some embodiments, the memory 370 stores data related to the portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.

[0180] Figure 3Each element in the above-mentioned elements in is optionally stored in one or more memory devices of the previously mentioned memory device. Each module in the above-mentioned module corresponds to the instruction set for performing the function described above. The above-mentioned modules or computer programs (for example, instruction sets or including instructions) need not be implemented as independent software programs (such as computer programs (for example, including instructions)), processes or modules, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subset of the above-mentioned modules and data structures. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0181] Attention is now turned to an embodiment of a user interface that is optionally implemented on, for example, portable multifunction device 100.

[0182] Figure 4A An exemplary user interface of an application menu on portable multifunction device 100 according to some embodiments is illustrated. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0183] Signal strength indicators 402 for wireless communications such as cellular signals and Wi-Fi signals;

[0184] Time 404;

[0185] Bluetooth indicator 405;

[0186] Battery status indicator 406;

[0187] A tray 408 with icons for commonly used applications, such as:

[0188] o An icon 416 of the phone module 138 labeled "Phone," which optionally includes an indicator 414 of the number of missed calls or voicemails;

[0189] o an icon 418 of the email client module 140 labeled “Mail”, which optionally includes an indicator 410 of the number of unread emails;

[0190] o An icon 420 labeled "Browser" of the browser module 147; and

[0191] o an icon 422 labeled “iPod” of the video and music player module 152 (also referred to as the iPod (trademark of Apple Inc.) module 152); and

[0192] Icons for other apps, such as:

[0193] o Icon 424 labeled "Message" of IM module 141;

[0194] o An icon 426 labeled “Calendar” of the calendar module 148;

[0195] o Icon 428 labeled “Photos” of the image management module 144;

[0196] o An icon 430 labeled “Camera” of the camera module 143;

[0197] ○ Icon 432 labeled “Online Video” of the online video module 155;

[0198] ○ Icon 434 labeled “Stock Market” of the Stock Market Widget 149 - 2 ;

[0199] o An icon 436 labeled “Map” of the map module 154;

[0200] ○ Icon 438 labeled “Weather” of the weather widget 149-1;

[0201] ○ Icon 440 labeled as “Clock” of the alarm clock widget 149 - 4 ;

[0202] o An icon 442 labeled “Fitness Support” of the fitness support module 142;

[0203] o an icon 444 labeled "Notepad" of the Notepad module 153; and

[0204] o An icon 446 of a settings application or module labeled “Settings” that provides access to settings for the device 100 and its various applications 136 .

[0205] It should be pointed out that Figure 4A The illustrated icon labels are exemplary only. For example, the icon 422 of the video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label of the corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0206] Figure 4B The example embodiment has a touch-sensitive surface 451 (eg, touch screen display 112) that is separate from a display 450 (eg, touch screen display 112). Figure 3 A device (e.g., a tablet computer or touch pad 355) Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.

[0207] Although some of the examples below will be given with reference to input on a touch screen display 112 (where a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) of the main axis (for example, Figure 4B According to these embodiments, the device detects a position corresponding to a corresponding position on the display (e.g., Figure 4B 460 corresponds to 468 and 462 corresponds to 470) in contact with touch-sensitive surface 451 (e.g., Figure 4B Thus, when the touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4B When the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is separated, the device is used to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0208] Additionally, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting contact, followed by ceasing to detect contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or mice and finger contacts are optionally used simultaneously.

[0209] Figure 5AAn exemplary personal electronic device 500 is illustrated. Device 500 includes a body 502. In some embodiments, device 500 may include a body 502 relative to devices 100 and 300 (e.g., Figures 1A to 4B ) some or all of the features described in the foregoing. In some embodiments, device 500 has a touch-sensitive display screen 504, referred to hereinafter as touch screen 504. Alternatively, or in addition to touch screen 504, device 500 also has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of contact (e.g., touch) applied. One or more intensity sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of touch. The user interface of device 500 can respond to touch based on the intensity of the touch, which means that touches of different intensities can invoke different user interface operations on device 500.

[0210] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related applications: International Patent Application Serial No. PCT / US2013 / 040061, filed on May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” published as WIPO Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed on November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” published as WIPO Publication No. WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.

[0211] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. The input mechanisms 506 and 508 (if included) can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) can allow the device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear the device 500.

[0212] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, the device 500 may include a Figure 1A , Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples an I / O portion 514 to one or more computer processors 516 and a memory 518. I / O portion 514 may be connected to a display 504, which may have a touch-sensitive component 522 and optionally an intensity sensor 524 (e.g., a contact intensity sensor). In addition, I / O portion 514 may be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 is optionally a rotatable input device. In some examples, input mechanism 508 is optionally a button.

[0213] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as GPS sensor 532, accelerometer 534, orientation sensor 540 (e.g., compass), gyroscope 536, motion sensor 538, and / or combinations thereof, all of which are operably connected to I / O portion 514.

[0214] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including processes 700 through 1200 ( Figures 7 to 12). Computer-readable storage media can be any medium that can tangibly contain or store computer-executable instructions for use by or in conjunction with instruction execution systems, devices, and apparatuses. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory and solid-state drives. Personal electronic device 500 is not limited to Figure 5B components and configurations, but may include other components or additional components in a variety of configurations.

[0215] As used herein, the term "indicative representation" refers to an optional feature of the apparatus 100, 300, and / or 500 ( Figure 1A , Figure 3 and FIG. 5A to FIG. 5B ) is a user-interactive graphical user interface object displayed on a display screen of a computer. For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) optionally each constitute an affordance.

[0216] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface that a user is interacting with. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in the display, the particular user interface element is adjusted according to the detected input. In the case that a touch-screen display (e.g., Figure 1A A touch-sensitive display system 112 or Figure 4AIn some implementations of the touch screen 112 in FIG. 1 , a contact detected on the touch screen acts as a “focus selector” such that when an input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted in accordance with the detected input. In some implementations, the focus moves from one area of ​​the user interface to another area of ​​the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves in accordance with the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user interface element (or contact on the touch screen display) that is controlled by the user to deliver the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0217] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of a contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact starts to move, before contact ends, before or after contact intensity is detected to increase, and / or before or after contact intensity is detected to decrease). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, or the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the characteristic strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose characteristic strength does not exceed the first threshold results in a first operation, a contact whose characteristic strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose characteristic strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the characteristic strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to abandon the corresponding operation) rather than to determine whether to perform the first operation or the second operation.

[0218] Figure 5C Detecting multiple contacts 552A through 552E on touch-sensitive display screen 504 using multiple intensity sensors 524A through 524D is illustrated. Figure 5C Also included is an intensity graph that shows the current intensity measurements of intensity sensors 524A through 524D relative to intensity units. In this example, the intensity measurements of intensity sensors 524A and 524D are each 9 intensity units, and the intensity measurements of intensity sensors 524B and 524C are each 7 intensity units. In some implementations, the cumulative intensity is the sum of the intensity measurements of multiple intensity sensors 524A through 524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned a corresponding intensity, which is a portion of the cumulative intensity. Figure 5DThe assignment of cumulative strengths to contacts 552A to 552E based on their distances from the center of force 554 is illustrated. In this example, each of contacts 552A, 552B, and 552E is assigned a contact strength of 8 strength units of the cumulative strength, and each of contacts 552C and 552D is assigned a contact strength of 4 strength units of the cumulative strength. More generally, in some implementations, each contact j is assigned a corresponding strength Ij that is a portion of the cumulative strength A according to a predefined mathematical function Ij=A·(Dj / ΣDi), where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i=1 to the last) from the center of force. The reference may be performed using an electronic device similar to or equivalent to device 100, 300, or 500. FIG. 5C to FIG. 5D In some embodiments, the characteristic intensity of the contact is based on one or more intensities of the contact. In some embodiments, the intensity sensor is used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). It should be noted that the intensity map is not part of the displayed user interface, but is included in the FIG. 5C to FIG. 5D To assist the readers.

[0219] In some embodiments, a portion of a gesture is identified for determining a characteristic intensity. For example, the touch-sensitive surface optionally receives a continuous swipe contact that transitions from a starting position and reaches an end position, where the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end position is optionally based only on a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the end position). In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of the following: an unweighted sliding average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow peaks or depressions in the intensity of the swipe contact to achieve the purpose of determining the characteristic intensity.

[0220] The intensity of contact on the touch-sensitive surface is optionally characterized relative to one or more intensity thresholds such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from an operation typically associated with clicking a button of a physical mouse or trackpad. In some embodiments, when a contact having a characteristic intensity lower than a light press intensity threshold (e.g., and higher than a nominal contact detection intensity threshold, contacts lower than the nominal contact detection intensity threshold are no longer detected) is detected, the device will move the focus selector according to the movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different groups of user interface illustrations.

[0221] An increase in the characteristic intensity of a contact from an intensity below a light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in the characteristic intensity of a contact from an intensity below a deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in the characteristic intensity of a contact from an intensity below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting a contact on the touch surface. A decrease in the characteristic intensity of a contact from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting a contact lifted from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0222] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the strength of the contact (or multiple contacts) increases to above a press input strength threshold. In some embodiments, the corresponding operation is performed in response to detecting that the strength of the corresponding contact increases to above the press input strength threshold (e.g., a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the strength of the corresponding contact to above the press input strength threshold and the strength of the contact subsequently decreases to below the press input strength threshold, and the corresponding operation is performed in response to detecting that the strength of the corresponding contact subsequently decreases to below the press input threshold (e.g., an "up stroke" of the corresponding press input).

[0223] FIG. 5E to FIG. 5H Detection of a gesture is illustrated, the gesture comprising contact 562 with an intensity ranging from less than Figure 5E The light press intensity threshold in L ”) increases to a strength higher than Figure 5H The deep compression intensity threshold in D ”). On the displayed user interface 570 including application icons 572A to 572D displayed in the predefined area 574, when the cursor 576 is displayed above the application icon 572B corresponding to application 2, a gesture performed using contact 562 is detected on the touch-sensitive surface 560. In some embodiments, the gesture is detected on the touch-sensitive display 504. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines whether the intensity of the contact 562 is within the deep press intensity threshold (for example, “IT D ”) reaches a peak above. Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, and according to the intensity increasing to a deep press intensity threshold (e.g., “IT D ”) above contact 562, displays scaled representations 578A to 578C (e.g., thumbnails) of documents recently opened for application 2, such as FIG. 5F to FIG. 5H In some embodiments, the intensity is a characteristic intensity of the contact compared to one or more intensity thresholds. It should be noted that the intensity map for contact 562 is not part of the displayed user interface, but is included in the FIG. 5E to FIG. 5H To assist the readers.

[0224] In some embodiments, the display of representations 578A to 578C includes animation. For example, representation 578A is initially displayed near application icon 572B, such as Fig. 5F As the animation progresses, representation 578A moves upward and representation 578B is displayed near application icon 572B, as shown. Figure 5G Then, representation 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed near application icon 572B, as shown. Figure 5H In some embodiments, the animation progresses according to the intensity of contact 562, such as Figure 5F to Figure 5G 578A to 578C appear and increase as the strength of contact 562 approaches a deep press strength threshold (eg, “IT D ”) increases and moves upward. In some embodiments, the intensity according to which the animation progresses is the characteristic intensity of the contact. The reference may be performed using an electronic device similar to or equivalent to device 100, 300, or 500. FIG. 5E to FIG. 5H The operation described.

[0225] In some embodiments, the device employs intensity hysteresis to avoid unexpected input, sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below a hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the hysteresis intensity threshold (e.g., an "up stroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the strength of the contact increases from an strength equal to or lower than a hysteresis strength threshold to an strength equal to or higher than a press input strength threshold and, optionally, the strength of the contact subsequently decreases to an strength equal to or lower than the hysteresis strength, and a corresponding operation is performed in response to detecting the press input (for example, depending on the circumstances, the strength of the contact increases or the strength of the contact decreases).

[0226] For ease of explanation, optionally, a description of an operation performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input is triggered in response to detecting any of the following: the intensity of the contact increases above the press input intensity threshold, the intensity of the contact increases from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, the intensity of the contact decreases below the press input intensity threshold, and / or the intensity of the contact decreases below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting that the intensity of the contact decreases below the press input intensity threshold, optionally, the operation is performed in response to detecting that the intensity of the contact decreases below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold.

[0227] As used herein, an "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., become open) on the device. In some embodiments, a downloaded application becomes an installed application using an installer that extracts program portions from a downloaded software package and integrates the extracted portions with the operating system of a computer system.

[0228] As used herein, the term "open application" or "executing application" refers to a software application that has retained state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or executing application is optionally any of the following types of applications:

[0229] The active application that is currently displayed on the display of the device on which the application is being used;

[0230] Background applications (or background processes) that are not currently displayed but whose one or more processes are being processed by one or more processors; and

[0231] • A suspended or dormant application that is not running but has state information stored in memory (volatile and non-volatile, respectively) that can be used to resume execution of the application.

[0232] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., the state information of a closed application is not stored in the memory of the device). Therefore, closing an application includes: stopping and / or removing the application process of the application and removing the state information of the application from the memory of the device. Generally speaking, while in a first application, opening a second application does not close the first application. When the second application is displayed and the first application stops being displayed, the first application becomes a background application.

[0233] Attention is now turned to embodiments of a user interface ("UI") and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.

[0234] 6A to 6F Illustrated are exemplary user interfaces for indicating movement using a computer system according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including Figures 7 to 12 process.

[0235] In some embodiments, the techniques and processes described below relate to accessibility features in which a user can communicate information (e.g., whether the user is moving) via a computer system by means other than verbal communication. In some embodiments, the techniques and processes described below allow other people in a physical environment to obtain information about the user's movements, the user's expected movements, and / or other information being transmitted by the user. In some embodiments, a user holds a computer system with the computer system's display facing away from the user so that other users in the physical environment can see information displayed by the user's computer system. In some embodiments, a computer system automatically displays and / or updates portions of a user interface based in part on the user's movements.

[0236] Fig. 6A The computer system 600 is illustrated to display a user interface including a display area 610, a right display area 620, and a left display area 622. Fig. 6AAs illustrated, the display area 610, the right display area 620, and the left display area 622 are displayed via a single display physically coupled to the computer system 600. The right display area 620 partially surrounds and / or surrounds the display area 610, and the left display area 622 partially surrounds the display area 610. In some embodiments, one or more of the right display area 620 and the left display area 622 completely surround the display area 610. In some embodiments, the computer system 600 includes one or more features and / or components of the computer systems 100, 300, and / or 500 described above. In some embodiments, the display area 610, the right display area 620, and the left display area 622 are each displayed via a separate display physically and / or wirelessly coupled to the computer system 600. In some embodiments, the right display area 620 and / or the left display area 622 are displayed on another computer system (such as a smart watch, a tablet computer, another smart phone, and / or a fitness tracking device), while the computer system 600 displays the display area 610. In one or more of such embodiments, display area 610 occupies the entire display of computer system 600. In some embodiments, when right display area 620 and / or left display area 622 are displayed on another computer system, right display area 620 may be displayed on a computer system positioned to the right of the user, while left display area 622 may be displayed on a computer system positioned to the left of the user.

[0237] like Fig. 6A As illustrated, display area 610 includes visual characteristics 612. Visual characteristics 612 is a color that fills a portion of display area 610, while another portion of display area 610 is filled with another color. In some embodiments, display area 610 includes more colors (e.g., more than two colors) than the two colors of display area 610. In some embodiments, computer system 600 displays right display area 620 and / or left display area 612 having the same visual characteristics as visual characteristics 612. In some embodiments, the visual characteristics are black, and other portions of display area 610 that do not include visual characteristics include colors different from black. In some embodiments, the different colors are similar to the colors of light and / or are the colors of light (e.g., soft white and / or yellow). In some embodiments, visual characteristics 612 are brightness levels, colors, hues, and / or chromaticity. In some embodiments, visual characteristics 612 are images (e.g., images that include or do not include text) and / or videos.

[0238] Fig. 6AThe map information 630a is provided to indicate the user's location and the user's movement in the physical environment. The map information 630a includes a location indicator 632a that is traveling along a path 632a. For the purpose of discussion, Fig. 6A At , the user who is holding the computer system 600 is standing on the path 632a in the direction of the arrow indicated by the position indicator 632a. Fig. 6A In some embodiments, the computer system 600 (or user) is determined to be starting to move (and / or will not be stationary within (or after) a predetermined time period) in response to detecting movement of the computer system 600 (or user), and determining that the computer system 600 will not be stationary within a predetermined time period (e.g., 0 minutes to 2 minutes). In some embodiments, the computer system 600 (or user) is determined to be starting to move (and / or will not be stationary within (or after) a predetermined time period). In some embodiments, the computer system 600 is determined to be starting to move based on detecting one or more actions of the user (such as the user interacting with the computer system, the user or the computer system starting to move, and / or the user transmitting one or more requests to the computer system). In some embodiments, the computer system 600 is determined to be starting to move based on one or more micro-movements (e.g., small vibrations) made by the user (such as movements detectable by a gyroscope and / or a heart rate sensor).

[0239] like Figure 6B As illustrated, based on determining that computer system 600 will begin to move, computer system 600 increases the size of visual feature 612, wherein visual feature 612 is Figure 6B China Figure 6B As part of increasing the size of visual feature 612, computer system 600 displays an animation of visual feature 612 that fills up the display area over time (e.g., a sliding up animation and / or a filling animation in which visual feature 612 slowly rises upward to cover more of display area 610). Figure 6BAt , the rate of the animation including the visual characteristic 612 filling the display area 610 is not based on the movement rate of the computer system 600. In some embodiments, based on determining that the computer system 600 will begin to move, the visual characteristic 612 fills the display area 610 based on a predetermined rate that is not based on the movement of the computer system 600 (and / or the user). In some embodiments, before the computer system 600 is moved in a lateral direction (e.g., the direction in which the user walks, runs, and / or jogs along the group), the animation of the visual characteristic 612 filling the display area 610 is completed. In some embodiments, the computer system 600 displays a portion of the animation of the visual characteristic 612 filling the display area 610 before the computer system 600 is moved, and displays another portion of the animation after the computer system 600 is moved. In some embodiments, before filling the display area 610 with the visual characteristic 612, the computer system 600 initially outputs a corresponding sound. In some embodiments, the corresponding sound has a single tone and / or is output within a short period of time (e.g., less than 1 second). In some embodiments, after outputting the corresponding sound, the computer system 600 begins outputting a different sound as the animation of the visual characteristic 612 filling the display area 610 is displayed. In some embodiments, the different sound is longer than the corresponding sound (or not shorter than the corresponding sound). In some embodiments, the difference in the sound increases in pitch and / or volume in proportion to the rate at which the animation of the visual characteristic 612 is displayed.

[0240] exist Figure 6B At this point, the computer system 600 will continue to display the following Figure 6B The presented area 610 and visual characteristics 612 are not displayed until it is determined that the computer system 600 has stopped or will stop (e.g., as described below with respect to FIG. 6C to FIG. 6D discussed further in Figure 6B At , it is determined that the user of computer system 600 will need to turn right (and / or computer system 600 will move in such a way that it will turn right with the user). Figure 6C As illustrated, in response to determining that the user of computer system 600 will need to turn right, computer system 600 displays visual characteristics similar to visual characteristics 612 in right display area 620. Notably, in Figure 6BAt , the computer system 600 does not display the visual characteristics in the right display area 620 because it is determined that the user of the computer system 600 will need to turn right (rather than left). In some embodiments, the visual characteristics in the right display area 620 are different colors, brightness levels, and / or chromaticities from the visual characteristics 612; in some embodiments, they are the same. In some embodiments, the visual characteristics in the right display area 620 will pulse (e.g., light up the turn signal), while the visual characteristics 612 will not pulse. In some embodiments, the computer system 600 uses the right display area 620 and the left display area 622 to display hazard information that pulses simultaneously (e.g., the same visual characteristics in the right display area 620 and the left display area 622) (e.g., such as a hazard signal). In some embodiments, the computer system 600 displays hazard information in the right display area 620 and the left display area 622 based on determining that the computer system 600 is malfunctioning and / or determining that the user of the computer system 600 wants to convey hazard information (e.g., the user is in pain, the user is tired, the user is sleepy, and / or the user is lost, etc.). Therefore, see Figure 6B , computer system 600 may use right display area 620 and left display area 622 to indicate information about future actions and / or potential actions (e.g., left turns, right turns, and / or hazard information), while using display area 610 to display information about whether computer system 600 is being moved (and / or whether the user is moving). Figure 6B In some embodiments, determining that the computer system 600 (or the user) is about to stop and / or will stop moving within a predetermined period of time is performed because the user (and / or the computer system 600) is approaching a street sign, a crosswalk (e.g., a pedestrian crossing) or a pedestrian crossing (e.g., a pedestrian crossing) by a user (and / or the computer system 600). Fig.6D The vehicle is about to stop as indicated by 632d and 634d in the map information 630d), bicycle lanes, people and / or dangers.

[0241] like Figure 6CAs illustrated, based on determining that the computer system 600 is about to stop, the computer system 600 reduces the amount of visual characteristics 612 displayed in the display area 610. Here, the computer system 600 reduces the amount of visual characteristics 612 displayed in the display area 610 by displaying an animation (e.g., a sliding down animation) of the visual characteristics being removed from the display area 610. In some embodiments, the rate of the animation (e.g., the speed at which the visual characteristics 612 are removed) is based on the movement of the computer system 600. In some embodiments, when the computer system 600 (and / or the user) stops at a faster rate, the computer system 600 removes the visual characteristics 612 at a faster rate. In some embodiments, the computer system 600 outputs a sound while reducing the amount of visual characteristics 612. In some embodiments, the volume or pitch of the sound decreases in proportion to the decrease in the amount of visual characteristics 612.

[0242] Fig.6D An embodiment is illustrated in which the computer system 600 has completed removing the visual feature 612 from the display area 610 based on a determination that the computer system 600 (and / or the user) is about to stop. Fig.6D At , the user of computer system 600 has completely stopped, and most of visual features 612 have been removed. Fig.6D At , a portion of the visual feature 612 remains in the display area 610 (e.g., when the computer system 600 is in Fig. 6A the same part where it originally stopped).

[0243] exist Fig. 6E At , computer system 600 detects four persons (e.g., 636e1 to 336e3) surrounding computer system 600 and the user. As indicated by map information 630e, person 636e1 is directly in front of the user (e.g., as indicated by indication 632e), person 636e2 is to the left of the user, and person 636e3 is in front of the user but further behind than person 636e1. Fig. 6EAt , each person is detected by one or more sensors (e.g., one or more of the same and / or different sensors) (such as one or more cameras) of the computer system 600. However, the computer system 600 only displays a representation of the person 632e1 (e.g., representation 614) in the display area 614. The computer system 600 displays the representation 614 because it is determined that the person 632e1 is within a predetermined area (e.g., direction and distance) from the computer system 600. Specifically, the computer system 600 displays the representation 614 because the person 632e1 is within a predetermined distance in front of the computer system 600. The computer system 600 does not display a representation corresponding to the person 636e2 because it is determined that the person 636e2 is outside the predetermined area (e.g., direction) of the computer system 600. In addition, the computer system 600 does not display a representation corresponding to the person 636e3 because it is determined that the person 636e3 is outside the predetermined area (e.g., distance) of the computer system 600.

[0244] It is worth noting that in Fig. 6E At , the computer system 600 displays a representation 614 (e.g., for a person in a predetermined area) in the display area 610, while a portion of the visual characteristics 612 continues to be displayed in the display area 614. In some embodiments, the representation 614 is not a live feed and / or does not actually resemble (e.g., does not look like) the person 636e1. In some embodiments, the representation 614 is a fuzzy shape, in which the same size and / or shape of the person 636e1 is represented by the representation 614. However, in some embodiments, the representation 614 does not include one or more facial features of the person 636e1. In some embodiments, the representation 614 is displayed as having the visual characteristics 612. In such embodiments, the representation 614 has the same color (or brightness) as the visual characteristics 612. In some embodiments, the computer system 600 moves the representation 614 so that the representation 614 mimics the movement of the person 636e1 in the physical environment. In some embodiments, when it is determined that the person 636e1 has moved outside of a predetermined area or zone within a predetermined distance in front of the computer system 600, the computer system 600 stops displaying the person 636e1.

[0245] Fig. 6F Computer system 600 is illustrated as displaying representation 614 and representation 616 in display area 610 while displaying a portion of visual feature 612. Fig. 6F At , computer system 600 displays representation 614 and representation 616 because the persons corresponding to representations 614 and 616 (eg, persons 636f1 and 636f2) are in (eg, using the above description of Fig. 6E within a predetermined area determined by one or more of the above techniques. Fig. 6F, person 636f is behind computer system 600, and despite one or more sensors of computer system 600, computer system 600 does not display a representation corresponding to person 636f because person 636f is not within the predetermined area discussed above. In some embodiments, the predetermined area is a continuous area. In some embodiments, the predetermined area is not a continuous area, such as an area within a blind spot of computer system 600. In some embodiments, computer system 600 does not display a visual representation of a subject that is not a person (and / or an animal), even if the subject or object is within the predetermined area. Thus, in some embodiments, when computer system 600 is stopped, computer system 600 displays representations of some subjects but not other subjects. In some embodiments, while computer system 600 is moving, computer system 600 does not display representations of subjects via display area 610. Although the accessibility features have been described above, 6A to 6F , but it should be understood that the above techniques can be used in one or more other applications. For example, display areas 610 to 614 can be headlights on a vehicle, where the vehicle (e.g., a boat, a bicycle, a truck, and / or a lorry) will display information based on the movement of the vehicle via display areas 610 to 614 using one or more techniques described herein. 6A to 6F User interface.

[0246] Figure 7 It is a flowchart illustrating a method for indicating the movement of a computer system and a subject according to some embodiments. Method 700 is performed at a computer system (e.g., 100, 300, 500, and / or 600) communicating with a display generation component (e.g., a display screen and / or a touch-sensitive display) and one or more sensors (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras) and / or one or more sensors (e.g., temperature, lidar, radar, and / or motion). In some embodiments, the computer system is a watch, a fitness tracking device, a phone, a tablet computer, a processor, a head-mounted display (HMD) device, and / or a personal computing device. Some operations in method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0247] As described below, method 700 provides an intuitive way to indicate movement. The method reduces the cognitive burden on the user of indicating movement, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to indicate movement faster and more efficiently saves power and increases the time interval between battery charges.

[0248] At 710 of method 700, the computer system displays a user interface element in a first appearance via the display generating component (e.g., a display (e.g., the entire display or a portion of the display that is not the entire display)) while the computer system is moving (e.g., not stationary and / or moving laterally, vertically, and / or horizontally) in an environment (e.g., a physical environment and / or a virtual environment) (and / or when a set of movement conditions are met).

[0249] At 720 of method 700, while displaying the user interface element and based on determining that a first set of criteria is satisfied (e.g., determining that the computer system is moving and / or determining that the computer system will begin moving within a predetermined time period), the computer system continues to display the user interface element in the first appearance.

[0250] At 730 of method 700, while displaying the user interface element and based on determining that the first set of criteria is not met, the computer system displays the user interface element via the display generation component in a second appearance different from the first appearance, and stops displaying the user interface element in the first appearance.

[0251] At 740 of method 700 , the computer system detects data about the environment via the one or more sensors.

[0252] At 750 of method 700, in response to detecting data about the environment and based on determining that a second set of criteria is satisfied, the computer system displays a representation of a subject (e.g., a person and / or an animal) via the display generation component, wherein the second set of criteria includes a first criterion that is satisfied when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is satisfied when the first set of movement criteria is not satisfied.

[0253] At 760 of method 700, in response to detecting data about the environment and based on determining that the second set of criteria is not met, the computer system forgoes displaying the representation of the subject. Displaying the user interface element in a second appearance via the display generation component based on the specification allows the computer system to display information about the state of the computer system when deemed appropriate, to perform operations without further user input when a set of conditions have been met, and to provide improved feedback to the user.

[0254] In some embodiments, displaying the user interface element (e.g., 610) with the first appearance (e.g., countdown clock and / or countup clock and / or display area is filled and / or unfilled) indicates that the computer system will not be stationary within a first predetermined time period (e.g., within 0 minutes to 5 minutes) (e.g., the computer system is moving for the first predetermined time period and / or will move within the first predetermined time period or after the predetermined time period has passed). In some embodiments, displaying the user interface element (e.g., 610) with the second visual appearance (e.g., countdown clock and / or countup clock and / or display area is filled and / or unfilled) indicates that the computer system will be stationary within the first predetermined time period. Displaying the user interface element with the first appearance indicates that the computer system will not be stationary within the first predetermined time period and displaying the user interface element (e.g., 610) with the second visual appearance indicates that the computer system will be stationary within the first predetermined time period provides feedback to the user about the state of the computer system, which provides improved visual feedback.

[0255] In some embodiments, the representation of the subject includes a first amount of physical characteristics of the subject, and wherein the data includes a second amount of physical characteristics of the subject, the second amount being greater than the first amount. In some embodiments, the representation of the subject indicates the size of the subject and the speed of movement of the subject. However, in some embodiments, the representation of the subject does not include one or more facial features and / or physical features of the subject. In some embodiments, the representation of the subject is a fuzzy shape. In some embodiments, one or more immutable characteristics of the subject cannot be determined by viewing the representation of the subject. Displaying the representation of the subject when specified conditions are met allows the computer system to display information about the state of the computer system when it is deemed appropriate, which performs operations without further user input when a set of conditions have been met, and provides improved feedback to the user and provides improved feedback to the user.

[0256] In some embodiments, based on determining that the first set of criteria are not met and before displaying the user interface element (e.g., 610) in the second appearance, the computer system transitions the appearance of the user interface element (e.g., 610) from the first appearance to the second appearance, wherein the transition includes reducing (e.g., gradually reducing and / or reducing based on the rate of change of the movement of the computer system) an amount of a characteristic (e.g., visual characteristic, color, light, brightness, and / or size of an indicator) of the user interface element displayed in the first appearance (e.g., over a first time period). Reducing the amount of the characteristic of the user interface element displayed based on determining that the first set of criteria are not met allows the computer system to automatically provide a dynamic indication that informs a person how the computer system is moving, which provides improved visual feedback and performs operations without further user input when a set of conditions have been met, and provides improved feedback to the user.

[0257] In some embodiments, while displaying the user interface element in the second appearance (e.g., 610) and based on determining that the first set of criteria are met, the computer system transitions the appearance of the user interface element from the second appearance to the first appearance, wherein the transition includes increasing the amount of the characteristic of the user interface element displayed in the second appearance over a second time period. In some embodiments, while displaying the user interface element in the second appearance and based on determining that the first set of criteria are met, the computer system generates, via the display, displaying the user interface element in the first appearance, and stops displaying the user interface element in the second appearance, wherein the user interface element is displayed in the first appearance. Increasing the amount of the characteristic of the user interface element displayed in the second appearance over a second time period based on determining that the first set of criteria are met allows the computer system to automatically provide a dynamic indication of how the computer system is moving, which provides improved visual feedback and performs operations without further user input when a set of conditions have been met, and provides improved feedback to the user and provides improved feedback to the user.

[0258] In some embodiments, displaying the representation of the subject via the display generation component includes: based on determining that the subject is moving in a first direction, moving the representation of the subject in the first direction; and based on determining that the subject is moving in a second direction different from the first direction, moving the representation of the subject in the second direction. In some embodiments, when displaying the representation of the subject, a second representation of a second subject is displayed, wherein the second representation is moved based on the movement of the second subject (e.g., the second representation is not displayed based on the movement of the subject; the representation is not displayed based on the movement of the second subject). Moving the representation of the subject based on the movement of the subject provides visual feedback to the subject that they are within a certain proximity of the computer system, which provides improved visual feedback and performs operations without further user input when a set of conditions have been met.

[0259] In some embodiments, based on determining that the subject has a first size, the representation of the subject has a second size (e.g., a size based on the first size and not based on a second size different from the first size); and based on determining that the subject has a third size different from the first size, the representation of the subject has a fourth size different from the second size (e.g., a size based on the third size and not based on the first size). Displaying the representation of the subject at a size based on the size of the subject provides dynamic visual feedback to the subject that they are within a certain proximity of the computer system, which provides improved visual feedback and performs operations without further user input when a set of conditions have been met.

[0260] In some embodiments, based on determining that the subject is a first distance (and / or proximity) from the computer system, the representation of the subject has a fifth size; and based on determining that the subject is a second distance from the computer system, the representation of the subject has a sixth size that is different from the fifth size, wherein the second distance is different from the first distance. Displaying the representation of the subject at a size based on the distance of the subject from the computer system provides dynamic visual feedback to the subject that they are within a certain proximity of the computer system, which provides improved visual feedback and performs operations without further user input when a set of conditions have been met.

[0261] In some embodiments, the representation of the subject is not displayed until the user interface element is displayed in the second appearance (e.g., 610). In some embodiments, while the representation of the subject is displayed simultaneously with the user interface element having the second appearance, the computer system: detects a change in movement of the computer; and in response, stops displaying the representation of the subject and stops displaying the user interface element in the second appearance.

[0262] In some embodiments, the representation of the subject is displayed simultaneously with the user interface element having the second appearance, and wherein the representation of the subject is not displayed simultaneously with the user interface element having the first appearance.

[0263] In some embodiments, the first set of criteria includes a determination that the computer system will not be stationary within a second predetermined time period (e.g., within 0 minutes to 5 minutes) (e.g., the computer system is moving and / or will move within the first predetermined time period or after the predetermined time period has elapsed). Displaying the representation of the subject when it is determined that the computer system will not be stationary within the second predetermined time period allows the computer system to display information about the state of the computer system when deemed appropriate, which performs operations without further user input when a set of conditions have been met and provides improved feedback to the user.

[0264] In some embodiments, the representation of the body is displayed simultaneously with the user interface element having the second appearance; displaying the user interface element (e.g., 610) with the first appearance includes: displaying a first portion of the user interface having a first visual characteristic (e.g., 612) and a second portion of the user interface element having the first visual characteristic via the display generating component; and displaying the user interface element (e.g., 610) with the second appearance includes: displaying the first portion of the user interface element having the first visual characteristic (e.g., 612) and the second portion of the user interface element having a second visual characteristic, which is different from the first visual characteristic.

[0265] In some embodiments, the computer system communicates with a speaker. In some embodiments, in conjunction with displaying the user interface element in the second appearance (e.g., 610) (e.g., when displaying the user interface element in the second appearance, within a predetermined time period (e.g., 1 second to 30 seconds) after displaying the user interface element in the second appearance, within a predetermined time period before displaying the user interface element in the second appearance) and based on determining that the first set of criteria is not met, the computer system outputs a first sound via one or more speakers, and the first sound changes based on the movement rate (e.g., movement speed) of the computer system (e.g., a non-zero rate). In some embodiments, based on determining that the movement of the computer system is changing at a first rate, the pitch, tone, and / or volume of the sound rises (or falls) at a second rate. In some embodiments, based on determining that the movement of the computer system is changing at a third rate different from the first rate, the pitch, tone, and / or volume of the sound rises (or falls) at a fourth rate different from the second rate. Outputting a first sound that changes based on the rate of movement (e.g., movement speed) (e.g., a non-zero rate) of the computer system provides feedback to the user about how the computer system is moving in the physical environment and / or will move in the physical environment in the future, which provides feedback to the user.

[0266] In some embodiments, the computer system: based on determining that the first set of criteria is met when displaying the user interface element in the second appearance, the appearance of the user interface element is transformed from the second appearance to the first appearance; and in conjunction with transforming the user interface element to the first appearance, a second sound is outputted via the one or more speakers, the second sound not changing based on the movement rate of the computer system, wherein the second sound is different from the first sound. In some embodiments, when the first sound rises in pitch, tone, and / or volume, the second sound decreases in pitch, tone, and / or volume over a period of time. In some embodiments, when the first sound decreases in pitch, tone, and / or volume, the second sound rises in pitch, tone, and / or volume over a period of time. Outputting the second sound that does not change based on the rate of the computer system notifies the subject that the computer system is beginning and / or will begin to be caused to move, which provides feedback to the user.

[0267] In some embodiments, in conjunction with transitioning the user interface element (e.g., 610) to the first appearance and before outputting the second sound, the computer system outputs a third sound via the display generating component, the third sound does not change based on the movement rate of the computer system, wherein the third sound is different from the first sound and the second sound.

[0268] In some embodiments, before displaying the user interface element in the second appearance (e.g., 610), the computer system transitions the appearance of the user interface element from the first appearance to the second appearance, wherein the transition includes displaying a first animation that transitions from displaying the user interface element in the first appearance to displaying the user interface element in the second appearance, and wherein the rate of movement of the transition to the second appearance (e.g., how quickly the animation occurs and / or the speed of the animation from start to end) is based on the movement of the computer system (e.g., while displaying the first animation). In some embodiments, based on determining that the movement of the computer system is being reduced at a first rate, the first animation has a second speed and / or a first display rate; and based on determining that the movement of the computer system is being reduced at a third rate that is different from the first rate, the first animation has a fourth rate and / or a second display rate.

[0269] In some embodiments, based on determining that the first set of criteria is met when displaying the user interface element in the second appearance, the computer system transitions the appearance of the user interface element from the second appearance to the first appearance, wherein a rate of movement of the transition to the first appearance is not based on the movement of the computer system. In some embodiments, the rate of movement of the second animation is the same regardless of the movement of the computer system. In some embodiments, in conjunction with displaying the second animation, the computer system is raised (e.g., as described below with respect to method 1100).

[0270] Note that the process described above with respect to method 700 (eg, Figure 7 ) also applies in a similar manner to the methods described below. For example, method 800 optionally includes one or more of the characteristics of the various methods described above with reference to method 700. For example, when the operations of method 800 are performed, the first set of criteria of method 700 is not met. For the sake of brevity, these details are not repeated below.

[0271] Figure 8It is a flowchart illustrating a method for indicating the perception of a subject using a computer system according to some embodiments. Method 800 is performed at a computer system (e.g., 100, 300, 500, and / or 600) communicating with a display generation component (e.g., a display screen and / or a touch-sensitive display) and one or more sensors (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras) and / or one or more sensors (e.g., temperature, lidar, radar, and / or motion). In some embodiments, the computer system is a watch, a fitness tracking device, a phone, a tablet computer, a processor, a head-mounted display (HMD) device, and / or a personal computing device. Some operations in method 800 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0272] As described below, method 800 provides an intuitive way to indicate movement. The method reduces the cognitive burden on the user of indicating movement, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to indicate movement faster and more efficiently saves power and increases the time interval between battery charges.

[0273] At 810 of method 800, the computer system detects data corresponding to a subject (e.g., a person and / or an animal) (and in some embodiments, not an object) in the environment via the one or more sensors (e.g., as described above with respect to method 700).

[0274] At 820 of method 800, in response to detecting the data corresponding to the subject and based on determining that the subject satisfies a corresponding set of criteria, the computer system displays, via the display generation component, a user interface indicating perception of the subject (e.g., the user interface was not previously displayed before the subject was detected in the field of view of the one or more cameras), wherein the corresponding set of criteria includes criteria that are satisfied when it is determined that the subject is within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance (e.g., at least one visual characteristic) (e.g., a size and / or shape) (e.g., the first user interface object moves based on movement of the subject), the visual appearance of the first user interface object being based on the visual appearance of the subject (e.g., a representation of the subject, as described above with respect to method 700); and

[0275] At 830 of method 800, in response to detecting the data corresponding to the subject and based on determining that the subject does not meet the corresponding set of criteria, the computer system abandons displaying the first user interface object. In some embodiments, the first user interface object is not part of the field of view and / or detection of the sensor and / or an actual representation of the field of view and / or detection of the sensor. In some embodiments, the first user interface object is not displayed with a representation of the physical environment and / or parts of the physical environment that are not the subject. Dynamically displaying the first user interface object based on specified conditions provides feedback to the user about the state of the computer system, which provides improved visual feedback and performs operations without further user input when a set of conditions have been met.

[0276] In some embodiments, in response to detecting the data corresponding to the subject, the computer system: displays the first user interface object (e.g., 614 and / or 616) based on determining that the subject is within a third area (e.g., an area in front of the computer system and / or an area in front of the display generating component) and within a predetermined distance from the computer system; and abandons displaying the first user interface object based on determining that the subject is within the third area but not within the predetermined distance from the computer system. Displaying the first user interface object based on the distance between the subject and the computer system provides improved visual feedback and performs operations without further user input when a set of conditions have been met.

[0277] In some embodiments, the first user interface object (e.g., 614 and / or 616) is displayed with an indication (e.g., a user interface element having the second appearance, as described above with respect to method 700) that the computer system is not moving (e.g., and / or will not move within a predetermined period of time). Displaying the first user interface object to indicate that the computer system is not moving provides improved visual feedback, and performs an operation without further user input when a set of conditions have been met.

[0278] In some embodiments, displaying the first user interface object (e.g., 614 and / or 616) includes: based on determining that the subject is moving in the environment in a first direction, moving the first user interface object in a second direction (e.g., as described above with respect to method 700); and based on determining that the subject is moving in the environment in a third direction, moving the first user interface object in a fourth direction different from the second direction, wherein the third direction is different from the first direction (e.g., as described above with respect to method 700). Moving the first user interface object based on the direction of the subject in the environment provides improved visual feedback, and performs operations without further user input when a set of conditions have been met.

[0279] In some embodiments, the set of criteria includes criteria that are satisfied when the subject is a first type of subject (e.g., a human or an animal), and wherein the set of criteria includes criteria that are not satisfied when the subject is a second type of subject different from the first type of subject (e.g., not a human or an animal). In some embodiments, the set of criteria includes criteria that are not satisfied when the subject is an object (e.g., a building, an electronic device, and / or another computer system).

[0280] In some embodiments, while displaying the first user interface object (e.g., 614 and / or 616), the computer system: detects, via the one or more sensors, data corresponding to a second subject, the second subject being different from the subject; and in response to the data corresponding to the second subject: based on determining that the subject and the second subject satisfy the set of criteria, displays, via the display generation component, a second user interface object having a visual appearance, the visual appearance of the second user interface object being based on a visual appearance of the second subject (rather than the subject), wherein the second user interface is displayed simultaneously with the first user interface object (e.g., as described above with respect to method 700). In some embodiments, based on determining that the subject satisfies the set of criteria and the second subject does not satisfy the set of criteria, the first user interface object is displayed without displaying the second user interface object. In some embodiments, based on determining that the subject does not satisfy the set of criteria and the second subject satisfies the set of criteria, the second user interface object is displayed without displaying the first user interface object. In some embodiments, based on determining that the subject does not satisfy the set of criteria and the second subject satisfies the set of criteria, the computer system forgoes displaying the first user interface object and the second user interface object.

[0281] In some embodiments, when displaying the first user interface object and the second user interface object: based on determining that the subject and the second subject meet the set of criteria and based on determining that the subject is closer to the computer system than the second subject, the first user interface element is at least partially displayed above the second user interface object (for example, the size of the first user interface object is larger than the size of the second user interface object); and based on determining that the subject and the second subject meet the set of criteria and based on determining that the second object is closer to the computer system than the subject, the second user interface element is at least partially displayed above the user interface object (for example, the size of the second user interface object is larger than the size of the first user interface object). Displaying the second user interface element at least partially above the user interface object dynamically provides feedback about the status of the device and the physical environment simultaneously via a user interface, which provides improved visual feedback and performs operations without further user input when a set of conditions have been met.

[0282] In some embodiments, the first user interface object is displayed with corresponding visual characteristics (e.g., 612) (e.g., color, brightness, chroma and / or tint), and the second user interface object (e.g., the representation of the subject, as described above with respect to method 700) is displayed with corresponding visual characteristics (e.g., color, brightness, chroma and / or tint).

[0283] In some embodiments, while displaying the first user interface object and the second user interface object, the computer system detects movement of one or more of the subject and the second subject; and in response to detecting movement of one or more of the subject and the second subject: based on determining that the subject is in a third area relative to (e.g., relative to and / or relative to) the computer system (e.g., in a region in front of the computer system) and the second subject is in a fourth area relative to the computer system (e.g., behind the computer system), continue to display the first user interface object without displaying the second user interface object, wherein the fourth area is different from the third area, and wherein the fourth area and the third area are within the predetermined distance from the computer system (e.g., away from the middle, midpoint, centroid, center of the computer system); and based on determining that the second subject is in the third area relative to the computer system and the subject is in the fourth area relative to the computer system, continue to display the second user interface object without displaying the first user interface object. In some embodiments, based on determining that the subject and the second subject are in the third area relative to the computer system, the computer system continues to display the first user interface object and the second user interface object. In some embodiments, based on determining that the subject and the second subject are in the fourth area relative to the computer system, the computer system stops displaying the first user interface object and the second user interface object.

[0284] Note that the above description is relative to method 800 (eg, Figure 8 ) also apply in a similar manner to the methods described above and below. For example, method 900 optionally includes one or more of the features of the various methods described above with reference to method 800. For example, the second user interface of method 1100 may include the first user interface object of method 800. For the sake of brevity, these details are not repeated.

[0285] Fig. 9It is a flowchart illustrating a method for indicating acceleration using a computer system according to some embodiments. Method 900 is performed at a computer system (e.g., 100, 300, 500, and / or 600) communicating with a display generation component (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the computer system is a watch, a fitness tracking device, a phone, a tablet computer, a processor, a head-mounted display (HMD) device, and / or a personal computing device. In some embodiments, the computer system communicates with one or more cameras (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras). Some operations in method 900 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0286] As described below, method 900 provides an intuitive way to indicate movement. The method reduces the cognitive burden on the user of indicating movement, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to indicate movement faster and more efficiently saves power and increases the time interval between battery charges.

[0287] At 910 of method 900 , the computer system detects occurrence of a corresponding set of movement conditions while generating, via display, a corresponding user interface having a certain amount of visual characteristics (e.g., brightness, color, and / or visual characteristics, as described above with respect to method 700 ).

[0288] At 920 of method 900, in response to detecting the occurrence of the corresponding set of movement conditions and determining (e.g., based on a predetermined route and / or decision to stop moving) that the corresponding set of movement conditions is a first set of movement conditions (e.g., deceleration conditions (e.g., deceleration, where the current speed is below a certain threshold and / or where the rate of deceleration is above a certain threshold) and / or conditions that the computer system will be stationary for a predetermined period of time) (e.g., determining that the computer system will stop moving for a predetermined period of time) (e.g., the computer system will transition from a non-stationary state to a stationary state for a predetermined period of time), the computer system The computer system may also be configured to change the amount of the visual characteristic (e.g., adjust and / or increase the amount of color (e.g., black and / or dark colors) that is filling the display and / or decrease the amount of color) (e.g., decrease the amount of brightness) relative to the computer system's rate of movement (e.g., lateral, backward, and / or forward speed, the computer system's traversal of the physical environment (e.g., the ground and / or surfaces in the physical environment)) (e.g., at a rate of change based on the computer system's rate of movement and / or at the same rate of change as the computer system's rate of movement) (e.g., as described above with respect to method 700).

[0289] At 930 of method 900, in response to detecting the occurrence of the corresponding set of movement conditions and based on determining (e.g., based on a predetermined route and / or decision to begin movement) that the corresponding set of movement conditions is a second set of movement conditions that is different from the first set of movement conditions (e.g., acceleration conditions and / or conditions that determine that the computer system will not be stationary within a predetermined time period) (e.g., determining that the computer system will begin moving within a predetermined time period) (e.g., the computer system will transition from a stationary state to a non-stationary state within a predetermined time period), the computer system (e.g., while the computer system is moving and / or before the computer system has begun moving) changes the amount of the visual characteristic (e.g., adjusts and / or reduces the amount of color (e.g., black and / or dark colors) that is filling the display and / or reduces the amount of color) (e.g., increases the amount of brightness) (e.g., does not change the indication relative to the movement rate of the computer system) relative to a corresponding rate (e.g., a predetermined rate and / or predefined rate) that is different from the movement rate of the computer system (e.g., as described above with respect to method 700). Changing the amount of the visual characteristic in different ways based on specified conditions allows the computer system to inform a subject about the state of the computer system at a point in time, providing improved visual feedback and performing operations without requiring further user input when a set of conditions have been met.

[0290] In some embodiments, before detecting the occurrence of the corresponding set of movement conditions, the amount of the visual characteristic (e.g., 612) is a first amount; and after changing the amount of the visual characteristic (e.g., 612) relative to the corresponding rate, the amount of the visual characteristic is a second amount different from the first amount. In some embodiments, while the amount of the visual characteristic is the second amount, detecting an occurrence of a third set of movement conditions (e.g., different from the corresponding set of movement conditions); and in response to detecting the occurrence of the third set of movement conditions: based on determining that the third set of movement conditions is the first set of movement conditions, the computer system changes the amount of the visual characteristic (e.g., 612) relative to the movement rate of the computer system (e.g., 600), wherein after changing the amount of the visual characteristic relative to the movement rate of the computer system, the amount of the visual characteristic is the first amount (e.g., as described above with respect to method 700). In some embodiments, based on determining that the third set of movement conditions is not the first set of movement conditions, the computer system does not change the amount of the visual characteristic relative to the movement rate of the computer system and / or the amount of the visual characteristic continues to be the second amount.

[0291] In some embodiments, before detecting the occurrence of the corresponding set of movement conditions, the amount of the visual characteristic (e.g., 612) is a third amount; and after changing the amount of the visual characteristic (e.g., 612) relative to the movement rate of the computer system, the amount of the visual characteristic is a fourth amount different from the third amount. In some embodiments, while the amount of the visual characteristic is the fourth amount, the computer system detects an occurrence of a fourth set of movement conditions (e.g., different from the corresponding set of movement conditions); and in response to detecting the occurrence of the fourth set of movement conditions: based on determining that the fourth set of movement conditions is the second set of movement conditions, changing the amount of the visual characteristic relative to the corresponding rate, wherein after changing the amount of the visual characteristic relative to the movement rate of the computer system, the amount of the visual characteristic is the third amount (e.g., as described above with respect to methods 700 and 800). In some embodiments, based on determining that the fourth set of movement conditions is not the second set of movement conditions, the computer system does not change the amount of the visual characteristic relative to the corresponding rate and / or the amount of the visual characteristic continues to be the fourth amount.

[0292] In some embodiments, the amount by which the computer system changes the visual characteristic (e.g., 612) relative to the corresponding rate indicates that it has been determined that the computer system will not be stationary for a first predetermined period of time (e.g., as described above with respect to method 700), and wherein the amount by which the visual characteristic changes relative to the corresponding rate indicates that the computer system will be stationary for the first predetermined period of time (e.g., as described above with respect to method 700). In some embodiments, the corresponding rate is faster than the movement rate of the computer system.

[0293] In some embodiments, before causing the computer system to move, the amount of the visual characteristic is changed relative to the corresponding rate (rather than relative to the rate of the movement of the computer system). In some embodiments, before causing the computer system to stop moving, the amount of the visual characteristic (e.g., 612) is changed relative to the rate at which the movement of the computer system occurs (rather than relative to the corresponding rate).

[0294] In some embodiments, the first set of movement conditions includes conditions that are satisfied when it is determined that the computer system will be stationary within a second predetermined time period (e.g., as described above with respect to method 700). In some embodiments, the second set of movement conditions includes conditions that are satisfied when it is determined that the computer system will not be stationary within a third predetermined time period (e.g., as described above with respect to method 700).

[0295] In some embodiments, changing the amount of the visual characteristic includes adjusting (e.g., increasing and / or decreasing) the brightness of the corresponding user interface (and / or the amount of light output by the display generation component). In some embodiments, changing the amount of the visual characteristic (e.g., 612) includes increasing or decreasing (e.g., via the display generation component) the amount of the color of the corresponding user interface. In some embodiments, changing the amount of the visual characteristic relative to the movement rate of the computer system includes decreasing the amount of the color and / or brightness of the corresponding user interface relative to the movement rate of the computer system.

[0296] In some embodiments, changing the amount of the visual characteristic relative to the corresponding rate that is different from the movement rate of the computer system includes increasing the amount of color and / or brightness of the corresponding user interface relative to the corresponding rate.

[0297] In some embodiments, before the amount of the visual characteristic (e.g., 612) is changed relative to the rate of movement of the computer system, the amount of the visual characteristic is a fifth amount; and after the amount of the visual characteristic is changed relative to the rate of movement of the computer system, the amount of the visual characteristic is a sixth amount different from the fifth amount, wherein the sixth amount and the fifth amount are not zero.

[0298] In some embodiments, the first set of movement conditions includes conditions whereby the computer system will decelerate within a fourth predetermined time period (e.g., as described above with respect to method 700), and wherein the second set of movement conditions includes conditions whereby the computer system will accelerate within a fifth predetermined time period (e.g., as described above with respect to method 700).

[0299] Note that the above description is relative to method 900 (eg, Fig. 9 ) also apply in a similar manner to the methods described above and below. For example, method 1100 optionally includes one or more of the characteristics of the various methods described above with reference to method 900. For example, the corresponding set of movement conditions of method 900 may include the occurrence of the conditions of method 1100. For the sake of brevity, these details are not repeated.

[0300] Fig.10It is a flowchart illustrating a method for indicating the movement of a computer system according to some embodiments. Method 1000 is performed at a computer system (e.g., 100, 300, 500, and / or 600) communicating with a display generation component (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the computer system communicates with one or more cameras (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras). In some embodiments, the computer system is a watch, a fitness tracking device, a phone, a tablet computer, a processor, a head-mounted display (HMD) device, and / or a personal computing device. Some operations in method 1000 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0301] As described below, method 1000 provides an intuitive way to indicate movement. The method reduces the cognitive burden on the user of indicating movement, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to indicate movement faster and more efficiently saves power and increases the time interval between battery charges.

[0302] At 1010 of method 1000, the computer system displays a user interface via the display generating component, the user interface including an indication displayed within a first portion of a display area (e.g., a display area of ​​the display generating component and / or an area of ​​a display onto which the display generating component is projecting) and a second portion of the display area (e.g., covering and / or superimposing the first portion and the second portion), wherein the first portion is different from (e.g., is separate from, does not surround, is not surrounded by, and / or includes) the second portion (e.g., multiple instances of the indication are not displayed).

[0303] At 1020 of method 1000, when the user interface including the indication overlaying the first portion and the second portion is displayed via the display generation component (e.g., a portion of the indication is included in the first portion and another portion of the indication is included in the second portion) and when the computer system is in a non-stationary state (e.g., when the computer system is moving), the computer system detects a change in a movement condition (e.g., a speed and / or acceleration of the computer system).

[0304] At 1030 of method 1000, in response to detecting the change in the movement condition (e.g., a stop movement condition, as described above with respect to method 900) and in accordance with determining that the computer system is transitioning from the non-stationary state to the stationary state, the computer system, via the display generation component, changes the indication (e.g., adjusts, shrinks, reduces the size of, and / or removes a portion thereof) such that the indication is displayed within the first portion and not within the second portion. In some embodiments, in response to detecting the change in the movement condition and in accordance with determining that the computer system is not transitioning from the non-stationary state to the stationary state, the computer system does not change the indication and continues to include the indication in the first portion and the second portion.

[0305] In some embodiments, the first portion does not overlap with the second portion (e.g., and / or does not cover on and / or over, does not surround the second portion, and / or is not surrounded by the second portion). In some embodiments, the first portion is adjacent to the second portion. In some embodiments, the first portion and the second portion are connected and / or continuous.

[0306] In some embodiments, changing the indication so that the indication is displayed within the first portion and not within the second portion includes: removing a first visual characteristic (e.g., 612) (e.g., color, light, brightness and / or hue) from the second portion via the display generating component (e.g., over a period of time and / or over a period of time based on the movement of the computer system) (e.g., as described above with respect to methods 700 to 900).

[0307] In some embodiments, removing the first visual characteristic includes: based on determining that the movement of the computer system is changing in a corresponding manner (e.g., increasing or decreasing) at a first rate, stopping displaying the first visual characteristic (e.g., corresponding to the indication and / or the indication) from the second portion at a second rate (e.g., as described above with respect to methods 700 to 900); and based on determining that the movement of the computer system is changing in a corresponding manner (e.g., increasing or decreasing) at a third rate that is different from the first rate, stopping displaying the first visual characteristic (e.g., corresponding to the indication and / or the indication) from the second portion at a fourth rate different from the second rate (e.g., like pouring water from a glass) (e.g., as described above with respect to methods 700 to 900).

[0308] In some embodiments, the computer system communicates with one or more sensors. In some embodiments, when the indication (e.g., 612) is changed so that the indication is displayed in the first portion but not in the second portion, the computer system detects data including a subject in an environment (e.g., a physical environment or a virtual environment) via one or more sensors; and in response to detecting the data including the subject, the computer system displays a representation of the subject in the second portion via the display generation component (e.g., 614 and / or 616), while the indication continues to be displayed in the first portion (e.g., as described above with respect to methods 700 to 900).

[0309] In some embodiments, displaying the representation of the subject via the display generating component includes: based on determining that the subject has moved in a first direction in the environment, moving the representation of the subject along a third direction (e.g., as described above with respect to methods 700 to 900); and based on determining that the subject has moved in a second direction different from the first direction in the environment, moving the representation of the subject along a fourth direction different from the third direction (e.g., as described above with respect to methods 700 to 900).

[0310] In some embodiments, the representation of the body does not cover the entirety of the second portion. In some embodiments, the indication does not cover the second body.

[0311] In some embodiments, the representation of the subject has a second visual characteristic, and wherein the indication displayed within the first portion has the second visual characteristic (e.g., as described above with respect to methods 700 to 900). In some embodiments, the first portion does not have the second visual characteristic in addition to the subject and without the indication within the corresponding portion. In some embodiments, the second portion has the second visual characteristic.

[0312] In some embodiments, when the indication is displayed in the first portion and not in the second portion: the first portion has a third visual characteristic; and the second portion has a fourth visual characteristic different from the third visual characteristic.

[0313] Note that the above description is relative to method 1000 (eg, Fig.10 ) also apply in a similar manner to the methods described above and below. For example, method 700 optionally includes one or more of the features of the various methods described above with reference to method 1000. For example, the user interface of method 1000 can be a corresponding user interface of method 700. For the sake of brevity, these details are not repeated.

[0314] Fig.11It is a flowchart illustrating a method for indicating no movement using a computer system according to some embodiments. Method 1100 is performed at a computer system (e.g., 100, 300, 500, and / or 600) that communicates with a display generation component (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the computer system communicates with one or more cameras (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras) and a physical mechanism (e.g., an actuator, a level, an arm, a suspension system, a hydraulic lift, and / or a lift): In some embodiments, the computer system is a watch, a fitness tracking device, a phone, a tablet computer, a processor, a head-mounted display (HMD) device, and / or a personal computing device. Some operations in method 1100 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0315] As described below, method 1100 provides an intuitive way to indicate movement. The method reduces the cognitive burden on the user of indicating movement, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to indicate movement faster and more efficiently saves power and increases the time interval between battery charges.

[0316] At 1110 of method 1100 , the computer system displays a first user interface via the display generation component.

[0317] At 1120 of method 1100, while displaying the first user interface, the computer system detects the occurrence of a condition (e.g., a physical entity within a certain proximity of the computer system, a movement condition, such as the computer system being determined to be beginning to move and / or moving and / or the computer system has started moving and / or has moved within a predetermined time period) (e.g., a stop moving condition, as described above with respect to method 900).

[0318] At 1130 of method 1100, in response to detecting the occurrence of the condition, the computer system displays a second user interface different from the first user interface via the display generation component (e.g., and the second user interface was not displayed before detecting the occurrence of the condition). In some embodiments, the second user interface is darker and / or darker than the first user interface. In some embodiments, the second user interface includes a portion of the first user interface, and the first user interface does not include a portion of the second user interface. In some embodiments, displaying the second user interface includes: displaying an animation of the first user interface filled with a color (e.g., black, yellow, and / or white) and / or gradually reducing the amount of brightness of the first user interface to display the second user interface with a smaller brightness (e.g., as described above with respect to methods 700 to 900).

[0319] At 1140 of method 1100, in response to detecting the occurrence of the condition, the computer system causes the physical mechanism to lower the computer system (e.g., lowers the computer system via the physical mechanism). In some embodiments, in response to detecting the occurrence of a second condition different from the occurrence of the condition, abandoning the physical mechanism from lowering the computer system. Updating different user interfaces based on the occurrence of a specific condition allows a user to be up to date on what is happening with the computer system, thereby reducing the number of inputs required to perform an operation. Displaying a first user interface element based on movement of the computer system provides information that traditionally requires several user inputs, which reduces the number of inputs required to perform an operation, wherein the first user interface element is at least partially surrounded by a second user interface element displayed based on the occurrence of an event.

[0320] In some embodiments, causing the physical mechanism to lower the computer system includes: transmitting instructions to cause the physical mechanism to lower one or more portions of the computer system. In some embodiments, one or more portions of the computer system are not lowered. Transmitting instructions to cause the physical mechanism to lower allows the computer system to not have to spend processing time when lowering, but rather to leave those operations to the mechanism to which the instructions are transmitted, thereby ensuring efficiency.

[0321] In some embodiments, displaying the second user interface via the display generation component includes: removing the visual feature from a first portion of the first user interface while continuing to display the visual feature on a second portion of the user interface, wherein the first portion is different from the second portion (e.g., separate from, different from, not surrounded by, and / or does not surround the second portion). Removing the visual feature while continuing to display the visual feature ensures that others can identify that the computer system is still running and has not been shut down, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0322] In some embodiments, displaying the second user interface via the display generation component includes: displaying a first animation (e.g., a user interface element, as described above with respect to method 700) of transitioning from displaying the first user interface to displaying the second user interface, and wherein the first animation is displayed while the physical mechanism is caused to lower the computer system. Outputting the animation while lowering allows others to perceive movement in the environment, thereby providing improved visual feedback to the user and performing an operation without further user input when a set of conditions have been met.

[0323] In some embodiments, displaying the second user interface via the display generation component includes: displaying a second animation (e.g., a user interface element, as described above with respect to method 700) that transitions from displaying the first user interface to displaying the second user interface. In some embodiments, the first animation is displayed before the physical mechanism is caused to lower the computer system. Outputting the animation before lowering allows others to perceive movement in the environment, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0324] In some embodiments, detecting the occurrence of the condition includes detecting that the computer system will not move within a predetermined time period. Basing the occurrence of a condition on whether the computer system will not move within a predetermined time period ensures that the computer system is communicating its movement, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0325] In some embodiments, while causing the physical mechanism to lower the computer system and while displaying the second user interface, detecting the occurrence of a second condition different from the condition. In some embodiments, in response to detecting the occurrence of the second condition, the computer system displays the first user interface (e.g., without displaying the second user interface) (e.g., user interface elements, as described above with respect to method 700) via the display generation component; and causing the physical mechanism to raise the computer system. Raising the computer system when an event occurs allows the computer system to be reactive, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0326] In some embodiments, displaying the first user interface in response to detecting the occurrence of the second condition includes: adding the second visual characteristic to a third portion of the first user interface while continuing to display the second visual characteristic (e.g., the same amount of color before the device changed from the non-stationary state to the stationary state) on a fourth portion of the user interface (e.g., a user interface element, as described above with respect to method 700), and wherein the third portion is different from the fourth portion. Displaying additional visual characteristics when a condition occurs ensures that the condition is known, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0327] In some embodiments, displaying the first user interface in response to detecting the occurrence of the second condition includes: displaying a third animation (e.g., a user interface element, as described above with respect to method 700) that transitions from displaying the second user interface to displaying the first user interface, and wherein the third animation is displayed while the physical mechanism is caused to raise the computer system (and, in some embodiments, causing the device to stop raising before the user interface has stopped changing to be displayed in more colors). Displaying the animation while the physical mechanism is caused to raise the computer system provides a visual cue to others that something is happening with the computer system, thereby providing improved visual feedback to the user and performing an operation without further user input when a set of conditions have been met.

[0328] In some embodiments, the computer system is in communication with one or more speakers. In some embodiments, in conjunction with lowering the computer system (e.g., after the computer system is lowered, within a predetermined time period before the computer system is lowered, and / or within a predetermined time period after the computer system is lowered), a first sound is output via the one or more speakers; and in conjunction with raising the device, a second sound different from the first sound is output via the one or more speakers. Outputting the sound while lowering allows others to perceive movement in the environment, thereby providing improved visual feedback to the user and performing an operation without further user input when a set of conditions have been met.

[0329] In some embodiments, the first user interface includes a third visual characteristic and a fourth visual characteristic, and wherein the second user interface includes the third visual characteristic but does not include the fourth visual characteristic (and, in some embodiments, the first user interface and / or the second user interface has only two colors). Ensuring that the first user interface includes multiple colors allows outputs to be differentiated using different colors, thereby reducing the number of inputs required to perform an operation.

[0330] Note that the above description is relative to method 1100 (eg, Fig.11 ) also apply in a similar manner to the methods described above and below. For example, method 1200 optionally includes one or more of the features of the various methods described above with reference to method 1100. For example, the second user interface element of method 1200 can be displayed simultaneously with the first user interface element of method 1100. For the sake of brevity, these details are not repeated.

[0331] Fig.121200 is a flowchart illustrating a method for indicating movement information using a computer system according to some embodiments. Method 1200 is performed at a computer system (e.g., 100, 300, 500, and / or 600) that communicates with a first display generation component and a second display generation component (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the computer system communicates with one or more sensors (e.g., one or more cameras (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras), one or more radar sensors, and / or one or more lidar sensors). In some embodiments, the computer system is a watch, a fitness tracking device, a phone, a tablet computer, a processor, a head-mounted display (HMD) device, and / or a personal computing device. Some operations in method 1200 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0332] As described below, method 1200 provides an intuitive way to indicate movement. The method reduces the cognitive burden on the user of indicating movement, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to indicate movement faster and more efficiently saves power and increases the time interval between battery charges.

[0333] At 1210 of method 1200 , the computer system displays a first user interface element in a first appearance via the first display generating component (eg, displays or does not display a user interface element via the second display generating component) while the computer system is moving.

[0334] At 1220 of method 1200, the computer system detects the occurrence of one or more events while displaying the first user interface element in the first appearance (e.g., as described above with respect to the representation of the user interface element and / or the subject and method 700); and

[0335] At 1230 of method 1200, in response to detecting the occurrence of the one or more events and based on determining that the one or more events include a first event, the computer system continues to display the first user interface element in the first appearance (e.g., a representation and / or indication of information (e.g., whether the computer system is moving, not moving, beginning to move, and / or stopping moving), the information indicating a decision determined based on the current directional movement of the computer system), wherein the first event is detected when it is determined that the computer system is moving.

[0336] At 1240 of method 1200, in response to detecting the occurrence of the one or more events and based on determining that the one or more events do not include the first event, the computer system displays the first user interface element via the first display generation component in a second appearance different from the first appearance.

[0337] At 1250 of method 1200, in response to detecting the occurrence of the one or more events and based on determining that the one or more events include a second event, the computer system displays, via a second display generating component, a second user interface element at least partially surrounding the first user interface element (e.g., a representation of the second user interface element (e.g., turn right, turn left, and / or danger), the second user interface element indicating a decision not determined based on the current directional movement of the computer system (e.g., some movement and / or no movement and / or lateral movement and / or movement along a route)), the second event being an event of a different type than the first event.

[0338] At 1260 of method 1200, in response to detecting the occurrence of the one or more events and based on determining that the one or more events do not include the second event, the computer system abandons displaying the second user interface element via the second display generating component (e.g., while continuing to display the first user interface element). Displaying a first user interface element based on movement of the computer system provides information that traditionally requires several user inputs, which reduces the number of inputs required to perform an operation, wherein the first user interface element is at least partially surrounded by a second user interface element displayed based on the occurrence of an event.

[0339] In some embodiments, the first event is detected based on a current directional movement of the computer system (e.g., movement of the computer system in a direction (e.g., in some embodiments, relative to the direction the computer system is facing)), and the second event is not detected based on the current directional movement of the computer system. Assigning different events to different display generation components allows a user to know where to look for specific information about the state of the computer system, thereby reducing the number of inputs required to perform operations.

[0340] In some embodiments, the computer system: detects the occurrence of a first group of one or more events while displaying the first user interface element in the second appearance and displaying the second user interface element; and in response to detecting the occurrence of the first group of one or more events: based on determining that the first group of one or more events includes the first event and the second event, modifies the display of the first user interface element via the first display generation component, and modifies the display of the second user interface element via the second display generation component; based on determining that the first group of one or more events includes the first event but does not include the second event, modifies the display of the first user interface element via the first display generation component without Modifying the display of the second user interface element via the second display generating component; and based on determining that the first group of one or more events includes the first event but does not include the second event, modifying the display of the first user interface element via the first display generating component without modifying the display of the second user interface element via the second display generating component; and based on determining that the first group of one or more events does not include the first event and the second event, abandoning modifying the display of the second user interface element via the first display generating component, and abandoning modifying the display of the second user interface element via the second display generating component without modifying the display of the first user interface element via the first display generating component. In some embodiments, while displaying the first user interface element in the first appearance and displaying the second user interface element, the computer system detects the occurrence of a third one or more events. In some embodiments, in response to detecting the occurrence of the third one or more events, the computer system: based on determining that the third one or more events do not include the first event but include the second event, modify the display of the first user interface element via the first display generation component without modifying the display of the second user interface element via the second display generation component; based on determining that the third one or more events include the first event but do not include the second event, the computer system abandons modifying the display of the first user interface element via the first display generation component and abandons modifying the display of the second user interface element via the second display generation component; based on determining that the third one or more events do not include the first event and the second event, the computer system modifies the first user interface element via the first display generation component without modifying the display of the second user interface element via the second display generation component; and based on the third one or more events including the first event and the second event, the computer system modifies the display of the second user interface element via the second display generation component and modifies the display of the first user interface element via the first display generation component. Updating different user interface elements based on the occurrence of specific events allows the user to understand what is happening on the computer system without navigating to different user interfaces, thereby reducing the number of inputs required to perform operations.

[0341] In some embodiments, displaying the second user interface element includes: pulsating a visual characteristic of the second user interface element, and wherein displaying the first user interface element does not include: pulsating one or more visual characteristics of the first user interface element. Pulsating some information without pulsating other information allows a user to focus on important events without getting lost in too much information, thereby reducing the number of inputs required to perform an operation.

[0342] In some embodiments, the second user interface element includes an indication (e.g., signal information) of a change (e.g., a future change and / or a current change) in the orientation of the computer system (e.g., a signal for a direction associated with turning, rotating, and / or moving). Indicating a change in the orientation of the computer system allows the user and other users to understand how the computer system is interacting with the environment, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0343] In some embodiments, based on determining that the second event corresponds to an event corresponding to a first direction (e.g., swiping left, swiping right, rotating clockwise, turning right, rotating counterclockwise, and / or turning left), the second display generating component is a third display generating component; and based on determining that the second event corresponds to an event corresponding to a second direction different from the first direction, the second display generating component is a fourth display generating component different from the third display generating component. Providing different display generating components for displaying information about different direction-based events allows a user to identify where to find specific information, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0344] In some embodiments, the second user interface element includes danger information. In some embodiments, when the second user interface element is displayed via the display generation (the second display generation component), the same user interface element is displayed via a display generation component different from the second display generation component (e.g., when displaying danger information). However, when displaying signal information, the display generation component does not display the same information and / or display user interface elements on two display generation components. Including danger information in the second user interface element provides information that is not usually easily accessible, thereby reducing the number of inputs required to perform an operation.

[0345] In some embodiments, the first user interface element displayed in the second appearance includes information about one or more subjects detected in the environment, and wherein the first user interface element displayed in the first appearance does not include information about one or more subjects detected in the environment (e.g., as described above with respect to the representation of the user interface element and / or the subjects and / or method 700). Displaying information about subjects detected in the environment provides the user with a better understanding of what is happening around the computer system and what the computer system is detecting, thereby providing improved visual feedback to the user and performing actions without further user input when a set of conditions have been met.

[0346] In some embodiments, the first user interface element displayed in the second appearance indicates that the computer system will not move within a predetermined time period (e.g., as described above with respect to method 700), and wherein the first user interface element indicates that the computer system will move within the predetermined time period (e.g., as described above with respect to method 700). Providing an indication in advance when the computer system will move allows others to understand the future movement of the computer system, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0347] In some embodiments, the first user interface element displayed in the first appearance has a first amount of visual characteristic (e.g., as described above with respect to method 700), and wherein the first user interface element displayed in the second appearance has a second amount of the visual characteristic that is different from the first amount of the visual characteristic (e.g., as described above with respect to method 700). The variable amount of visual characteristic allows a user to quickly understand the state of the computer system without having to scroll through different user interfaces, thereby reducing the number of inputs required to perform operations.

[0348] In some embodiments, the second display generating component is a display generating component of a different type than the first display generating component. In some embodiments, the second display generating component is a display generating component of the same type as the first display generating component. In some embodiments, the second display generating component is the first display generating component. Providing different types of display generating components allows the system to take advantage of a particular type of display generating component, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0349] In some embodiments, the output of the second display generating component at least partially surrounds (e.g., encloses and / or surrounds) the output of the first display generating component. In some embodiments, the light output from the second display generating component is directed in a direction that results in the appearance of at least partially surrounding the light output from the first display generating component. In some embodiments, the light output from the second display generating component is in a different direction than the light output from the first display generating component. In some embodiments, the second display component at least partially surrounds the first display generating component. Ensuring that the output of the second display generating component at least partially surrounds the output of the first display generating component allows a more concise expression of the state of the computer system, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0350] In some embodiments, a display area corresponding to the first display generating component (e.g., a display surface to which light from the first display generating component is directed) protrudes further from the computer system (e.g., in a particular direction) than a display area corresponding to the second display generating component (e.g., a display surface to which light from the second display generating component is directed). In some embodiments, the display area of ​​the first display generating component is parallel to the display area of ​​the second display generating component. The protruding portions of the display areas allow different display generating components to utilize different topologies, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0351] In some embodiments, the second user interface element is displayed using primarily indirect light (e.g., displayed using light reflected from a surface), and the first user interface element is not displayed using primarily indirect light (e.g., displayed using light not reflected from a surface). In some embodiments, the resolution output by the second display generating component is different (e.g., more or less) from the resolution output by the first display generating component. In some embodiments, there is a gap between the second user interface element and the first user interface element. In some embodiments, there is a gap between the display area of ​​the second display generating component and the display area of ​​the first display generating component. The use of indirect light allows certain optical advantages to be generated for particular representations, thereby providing improved visual feedback to the user and performing operations without further user input when a set of conditions have been met.

[0352] Note that the above description is relative to method 1200 (eg, Fig.12) also apply in a similar manner to the methods described above / below. For example, method 700 optionally includes one or more of the features of the various methods described above with reference to method 1200. For example, the first user interface element of method 1200 can be displayed via the corresponding user interface of method 700. For the sake of brevity, these details are not repeated.

[0353] For the purpose of explanation, the preceding description is described by reference to specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the invention to the disclosed precise form. According to the above teachings, many modifications and variations are possible. These embodiments are selected and described in order to best explain the principles of these technologies and their practical applications. Others skilled in the art can thus best utilize these technologies and various embodiments with various modifications suitable for the intended specific use.

[0354] Although the disclosure and examples have been fully described with reference to the accompanying drawings, it should be noted that various changes and modifications will become apparent to those skilled in the art. It should be understood that such changes and modifications are considered to be included within the scope of the disclosure and examples defined by the claims.

[0355] As described above, one aspect of the present technology is to collect and use data from various sources to indicate movement. The present disclosure contemplates that in some instances, these collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, Twitter IDs, home addresses, data or records related to the user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identification or personal information.

[0356] The present disclosure recognizes that the use of such personal information data in the present technology can be used to benefit users. For example, personal information data can be used to determine the content to be displayed. Accordingly, the use of such personal information data enables users to have planned control over the displayed content. In addition, the present disclosure also anticipates other uses of personal information data that benefit users. For example, health and fitness data can be used to provide insights into the user's overall health status, or can be used as positive feedback to individuals who use technology to pursue health goals.

[0357] The disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage or other purposes of such personal information data will comply with perfect privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to the use of privacy policies and measures that are recognized as meeting or exceeding the industry or government requirements for maintaining the privacy and security of personal information data. Users can easily access such policies and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legal and reasonable entity purposes and should not be shared or sold outside these legal purposes. In addition, such collection / sharing should be carried out after receiving the informed consent of the user. Additionally, such entities should consider taking any necessary steps to protect and safeguard access to such personal information data, and ensure that other entities with access to personal information data comply with the privacy policies and procedures of other entities. In addition, such entities can subject themselves to third-party assessments to prove that they comply with widely accepted privacy policies and practices. In addition, policies and practices should be adapted to specific types of personal information data collected and / or accessed, and to applicable laws and standards including considerations of special jurisdictions. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0358] Regardless of the foregoing, the present disclosure also contemplates implementation schemes in which users selectively block the use or access of personal information data. That is, the present disclosure contemplates that hardware elements and / or software elements may be provided to prevent or block access to such personal information data. For example, with respect to display services, the technology of the present invention may be configured to allow users to choose to "opt in" or "opt out" at any time during or after registration for the service to participate in the collection of personal information data. In another example, a user may choose not to provide data to a targeted service. In yet another example, a user may choose to limit the length of time that data is retained or to completely prohibit the development of a baseline profile. In addition to providing "opt-in" and "opt-out" options, the present disclosure also contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then the user may be reminded again just before the personal information data is accessed by the application.

[0359] In addition, the intention of the present disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once the data is no longer needed, the risk can be minimized by limiting the collection of data and deleting the data. In addition, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be facilitated by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than at the address level), controlling how the data is stored (e.g., aggregating data between users), and / or other methods when appropriate.

[0360] Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure also contemplates that various embodiments may also be implemented without access to such personal information data. That is, various embodiments of the present technology will not fail to function properly due to the lack of all or a portion of such personal information data. For example, content may be displayed by inferring preferences based on non-personal information data or an absolute minimum amount of personal information (such as content requested by a device associated with a user, other non-personal information available to a service, or publicly available information).

Claims

1. A method, comprising: At a computer system in communication with a display generating component and one or more sensors: displaying, via the display generation component, a user interface element in a first appearance while the computer system is moving in an environment; When displaying the user interface element: Based on determining that the first set of criteria is satisfied, continuing to display the user interface element in the first appearance; as well as displaying, via the display generation component, the user interface element in a second appearance different from the first appearance, and ceasing to display the user interface element in the first appearance, based on determining that the first set of criteria is not satisfied; detecting data about the environment via the one or more sensors; as well as In response to detecting data about the environment: displaying, via the display generation component, a representation of a subject based on determining that a second set of criteria is satisfied, wherein the second set of criteria includes a first criterion that is satisfied when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is satisfied when the first set of movement criteria is not satisfied; and Based on determining that the second set of criteria is not met, displaying the representation of the subject is foregone.

2. The method of claim 1 , wherein displaying the user interface element in the first visual appearance indicates that the computer system will not be stationary within a first predetermined time period, and wherein displaying the user interface element in the second visual appearance indicates that the computer system will be stationary within the first predetermined time period.

3. A method according to any one of claims 1 to 2, wherein the representation of the subject includes a first quantity of physical characteristics of the subject, and wherein the data includes a second quantity of physical characteristics of the subject, the second quantity being greater than the first quantity.

4. The method according to any one of claims 1 to 3, further comprising: Based on determining that the first set of criteria is not met and before displaying the user interface element in the second appearance, transitioning the appearance of the user interface element from the first appearance to the second appearance, wherein the transitioning includes reducing an amount of a feature of the user interface element displayed in the first appearance.

5. The method according to claim 4, further comprising: While displaying the user interface element in the second appearance and based on determining that the first set of criteria is satisfied, transitioning the appearance of the user interface element from the second appearance to the first appearance, wherein the transition comprises increasing an amount of the characteristic of the user interface element displayed in the second appearance over a second time period.

6. The method of any one of claims 1 to 5, wherein displaying the representation of the subject via the display generation component comprises: based on determining that the subject is moving in a first direction, moving the representation of the subject in the first direction; as well as Based on determining that the subject is moving in a second direction different from the first direction, the representation of the subject is moved in the second direction.

7. The method according to any one of claims 1 to 6, wherein: Based on determining that the subject has a first size, the representation of the subject has a second size; and Based on determining that the subject has a third size different from the first size, the representation of the subject has a fourth size different from the second size.

8. The method according to any one of claims 1 to 7, wherein: Based on determining that the subject is a first distance from the computer system, the representation of the subject has a fifth size; and The representation of the subject has a sixth size that is different from the fifth size based on determining that the subject is a second distance from the computer system, wherein the second distance is different from the first distance.

9. The method of any one of claims 1 to 8, wherein the representation of the subject is not displayed until the user interface element is displayed in the second appearance.

10. The method of any one of claims 1 to 9, wherein the representation of the subject is displayed simultaneously with the user interface element having the second appearance, and wherein the representation of the subject is not displayed simultaneously with the user interface element having the first appearance.

11. The method of any one of claims 1 to 10, wherein the first set of criteria includes determining that the computer system will not be quiescent within a second predetermined time period.

12. The method according to any one of claims 1 to 11, wherein: the representation of the subject being displayed simultaneously with the user interface element having the second appearance; Displaying the user interface element in the first appearance includes: displaying, via the display generation component, a first portion of a user interface having a first visual characteristic and a second portion of the user interface element having the first visual characteristic; and Displaying the user interface element in the second appearance includes: displaying, via the display generation component, the first portion of the user interface element having the first visual characteristic and the second portion of the user interface element having a second visual characteristic, the second visual characteristic being different from the first visual characteristic.

13. The method of any one of claims 1 to 12, wherein the computer system is in communication with a speaker, the method further comprising: In conjunction with displaying the user interface element in the second appearance and in accordance with determining that the first set of criteria is not met, outputting a first sound via one or more speakers, the first sound varying based on a rate of movement of the computer system.

14. The method according to any one of claims 13, further comprising: based on determining that the first set of criteria is satisfied when the user interface element is displayed in the second appearance, changing the appearance of the user interface element from the second appearance to the first appearance; as well as In conjunction with transitioning the user interface element to the first appearance, outputting a second sound via the one or more speakers, the second sound not changing based on the rate of movement of the computer system, wherein the second sound is different from the first sound.

15. The method according to claim 14, further comprising: In combination with transitioning the user interface element to the first appearance and before outputting the second sound, outputting a third sound via the display generation component, the third sound not changing based on the movement rate of the computer system, wherein the third sound is different from the first sound and the second sound.

16. The method according to any one of claims 1 to 15, further comprising: Before displaying the user interface element in the second appearance, transitioning the appearance of the user interface element from the first appearance to the second appearance, wherein the transitioning includes displaying a first animation that transitions from displaying the user interface element in the first appearance to displaying the user interface element in the second appearance, and wherein a rate of movement of the transition to the second appearance is based on the movement of the computer system.

17. The method according to claim 16, further comprising: Based on determining that the first set of criteria is satisfied when displaying the user interface element in the second appearance, transitioning the appearance of the user interface element from the second appearance to the first appearance, wherein a rate of movement of the transition to the first appearance is not based on the movement of the computer system.

18. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 17.

19. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 17.

20. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: Components for carrying out the method according to any one of claims 1 to 17.

21. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and one or more sensors, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 17.

22. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors, the one or more programs comprising instructions for: displaying, via the display generation component, a user interface element in a first appearance while the computer system is moving in an environment; When displaying the user interface element: Based on determining that the first set of criteria is satisfied, continuing to display the user interface element in the first appearance; as well as displaying, via the display generation component, the user interface element in a second appearance different from the first appearance, and ceasing to display the user interface element in the first appearance, based on determining that the first set of criteria is not satisfied; detecting data about the environment via the one or more sensors; as well as In response to detecting data about the environment: displaying, via the display generation component, a representation of a subject based on determining that a second set of criteria is satisfied, wherein the second set of criteria includes a first criterion that is satisfied when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is satisfied when the first set of movement criteria is not satisfied; and Based on determining that the second set of criteria is not met, displaying the representation of the subject is foregone.

23. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: displaying, via the display generation component, a user interface element in a first appearance while the computer system is moving in an environment; When displaying the user interface element: Based on determining that the first set of criteria is satisfied, continuing to display the user interface element in the first appearance; as well as displaying, via the display generation component, the user interface element in a second appearance different from the first appearance, and ceasing to display the user interface element in the first appearance, based on determining that the first set of criteria is not satisfied; detecting data about the environment via the one or more sensors; as well as In response to detecting data about the environment: displaying, via the display generation component, a representation of a subject based on determining that a second set of criteria is satisfied, wherein the second set of criteria includes a first criterion that is satisfied when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is satisfied when the first set of movement criteria is not satisfied; and Based on determining that the second set of criteria is not met, displaying the representation of the subject is foregone.

24. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: means for displaying, via the display generation component, a user interface element in a first appearance while the computer system is moving in an environment; A widget that performs the following actions when the user interface element is displayed: Based on determining that the first set of criteria is satisfied, continuing to display the user interface element in the first appearance; as well as displaying, via the display generation component, the user interface element in a second appearance different from the first appearance, and ceasing to display the user interface element in the first appearance, based on determining that the first set of criteria is not satisfied; means for detecting data about said environment via said one or more sensors; and Means for, in response to detecting data about the environment: displaying, via the display generation component, a representation of a subject based on determining that a second set of criteria is satisfied, wherein the second set of criteria includes a first criterion that is satisfied when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is satisfied when the first set of movement criteria is not satisfied; and Based on determining that the second set of criteria is not met, displaying the representation of the subject is foregone.

25. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors, the one or more programs comprising instructions for: displaying, via the display generation component, a user interface element in a first appearance while the computer system is moving in an environment; When displaying the user interface element: Based on determining that the first set of criteria is satisfied, continuing to display the user interface element in the first appearance; as well as displaying, via the display generation component, the user interface element in a second appearance different from the first appearance, and ceasing to display the user interface element in the first appearance, based on determining that the first set of criteria is not satisfied; detecting data about the environment via the one or more sensors; as well as In response to detecting data about the environment: displaying, via the display generation component, a representation of a subject based on determining that a second set of criteria is satisfied, wherein the second set of criteria includes a first criterion that is satisfied when the subject is detected in the data, and wherein the second set of criteria includes a second criterion that is satisfied when the first set of movement criteria is not satisfied; and Based on determining that the second set of criteria is not met, displaying the representation of the subject is foregone.

26. A method comprising: At a computer system in communication with a display generating component and one or more sensors: detecting, via the one or more sensors, data corresponding to a subject in the environment; as well as In response to detecting the data corresponding to the subject: displaying, via the display generation component, a user interface indicating perception of the subject based on a determination that the subject satisfies a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are satisfied when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; as well as Based on determining that the subject does not satisfy the corresponding set of criteria, displaying the first user interface object is abandoned.

27. The method of claim 26, wherein the corresponding set of criteria includes criteria that are satisfied when it is determined that the subject is within a first zone relative to the computer system but not within a second zone relative to the computer system.

28. The method according to any one of claims 26 to 27, further comprising: In response to detecting the data corresponding to the subject: Based on determining that the subject is within a third area and within a predetermined distance from the computer system, displaying the first user interface object; and Based on determining that the subject is within the third area but not within a predetermined distance from the computer system, displaying the first user interface object is abandoned.

29. A method according to any one of claims 26 to 28, wherein the first user interface object is displayed with an indication that the computer system is not moving.

30. The method of any one of claims 26 to 29, wherein displaying the first user interface object comprises: moving the first user interface object along a second direction based on determining that the subject is moving along a first direction in the environment; as well as Based on determining that the subject is moving in a third direction in the environment, the first user interface object is moved in a fourth direction different from the second direction, wherein the third direction is different from the first direction.

31. A method according to any one of claims 26 to 30, wherein the set of criteria includes criteria that are satisfied when the subject is a first type of subject, and wherein the set of criteria includes criteria that are not satisfied when the subject is a second type of subject different from the first type of subject.

32. The method according to any one of claims 26 to 31, further comprising: while displaying the first user interface object, detecting, via the one or more sensors, data corresponding to a second subject, the second subject being different from the subject; as well as In response to the data corresponding to the second body: Based on determining that the subject and the second subject satisfy the set of criteria, a second user interface object having a visual appearance is displayed via the display generation component, wherein the visual appearance of the second user interface object is based on the visual appearance of the second subject, wherein the second user interface is displayed simultaneously with the first user interface object.

33. A method according to any one of claims 26 to 32, wherein: While displaying the first user interface object and the second user interface object: Based on determining that the subject and the second subject satisfy the set of criteria and based on determining that the subject is closer to the computer system than the second subject, displaying the first user interface element at least partially over the second user interface object; as well as Based on determining that the subject and the second subject satisfy the set of criteria and based on determining that the second subject is closer to the computer system than the subject, the second user interface element is at least partially displayed over the user interface object.

34. A method according to any one of claims 26 to 33, wherein the first user interface object is displayed with corresponding visual characteristics, and the second user interface object is displayed with the corresponding visual characteristics.

35. The method according to any one of claims 26 to 34, further comprising: detecting movement of one or more of the subject and the second subject while displaying the first user interface object and the second user interface object; as well as In response to detecting movement of one or more of the subject and the second subject: continuing to display the first user interface object without displaying the second user interface object based on determining that the subject is within a third area relative to the computer system and the second subject is within a fourth area relative to the computer system, wherein the fourth area is different from the third area, and wherein the fourth area and the third area are within the predetermined distance from the computer system; as well as Based on determining that the second subject is within the third region relative to the computer system and the subject is within the fourth region relative to the computer system, continuing to display the second user interface object without displaying the first user interface object.

36. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors, the one or more programs comprising instructions for executing a method according to any one of claims 26 to 35.

37. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 26 to 35.

38. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: Means for carrying out the method according to any one of claims 26 to 35.

39. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and one or more sensors, the one or more programs comprising instructions for performing the method according to any one of claims 26 to 35.

40. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors, the one or more programs comprising instructions for: detecting, via the one or more sensors, data corresponding to subjects in the environment; and In response to detecting the data corresponding to the subject: displaying, via the display generation component, a user interface indicating a perception of the subject based on a determination that the subject satisfies a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are satisfied when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; and Based on determining that the subject does not satisfy the corresponding set of criteria, displaying the first user interface object is abandoned.

41. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: detecting, via the one or more sensors, data corresponding to subjects in the environment; and In response to detecting the data corresponding to the subject: displaying, via the display generation component, a user interface indicating perception of the subject based on a determination that the subject satisfies a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are satisfied when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; as well as Based on determining that the subject does not satisfy the corresponding set of criteria, displaying the first user interface object is abandoned.

42. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: means for detecting, via the one or more sensors, data corresponding to a subject in the environment; and means for, in response to detecting the data corresponding to the subject, performing the following operations: displaying, via the display generation component, a user interface indicating perception of the subject based on a determination that the subject satisfies a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are satisfied when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; as well as Based on determining that the subject does not satisfy the corresponding set of criteria, displaying the first user interface object is abandoned.

43. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors, the one or more programs comprising instructions for: detecting, via the one or more sensors, data corresponding to subjects in the environment; and In response to detecting the data corresponding to the subject: displaying, via the display generation component, a user interface indicating a perception of the subject based on a determination that the subject satisfies a corresponding set of criteria, wherein the corresponding set of criteria includes criteria that are satisfied when the subject is determined to be within a predetermined distance from the computer system, the user interface including a first user interface object having a visual appearance, the visual appearance of the first user interface object being based on the visual appearance of the subject; and Based on determining that the subject does not satisfy the corresponding set of criteria, displaying the first user interface object is abandoned.

44. A method comprising: At a computer system in communication with a display generating component: detecting occurrence of a corresponding set of movement conditions while generating, via the display, displaying a corresponding user interface having a certain amount of visual characteristics; as well as In response to detecting said occurrence of said corresponding set of movement conditions: in response to determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristic relative to a rate of movement of the computer system; and Based on determining that the corresponding set of movement conditions is a second set of movement conditions that is different from the first set of movement conditions, the amount of the visual characteristic is changed relative to a corresponding rate that is different from the movement rate of the computer system.

45. The method of claim 44, wherein: prior to detecting said occurrence of said corresponding set of movement conditions, said amount of said visual characteristic is a first amount; After changing the amount of the visual characteristic relative to the corresponding rate, the amount of the visual characteristic is a second amount different from the first amount; and The method further comprises: detecting occurrence of a third set of movement conditions when the amount of the visual characteristic is the second amount; and In response to detecting said occurrence of said third set of movement conditions: According to determining that the third set of movement conditions is the first set of movement conditions, The amount of the visual characteristic is changed relative to the rate of movement of the computer system, wherein the amount of the visual characteristic is the first amount after changing the amount of the visual characteristic relative to the rate of movement of the computer system.

46. ​​A method according to any one of claims 44 to 45, wherein: prior to detecting said occurrence of said corresponding set of movement conditions, said amount of said visual characteristic is a third amount; after changing the amount of the visual characteristic relative to the rate of movement of the computer system, the amount of the visual characteristic is a fourth amount different from the third amount; and The method further comprises: detecting said occurrence of a fourth set of movement conditions when said amount of said visual characteristic is said fourth amount; and In response to detecting said occurrence of said fourth set of movement conditions: Based on determining that the fourth set of movement conditions is the second set of movement conditions, the amount of the visual characteristic is changed relative to the corresponding rate, wherein after changing the amount of the visual characteristic relative to the movement rate of the computer system, the amount of the visual characteristic is the third amount.

47. A method according to any one of claims 44 to 46, wherein the amount of changing the visual characteristic relative to the corresponding rate indicates that it has been determined that the computer system will not be stationary within a first predetermined time period, and wherein the amount of changing the visual characteristic relative to the corresponding rate indicates that the computer system will be stationary within the first predetermined time period.

48. A method according to any one of claims 44 to 47, wherein the corresponding rate is faster than the movement rate of the computer system.

49. The method according to any one of claims 44 to 48, wherein: Prior to causing the computer system to move, the amount of the visual characteristic is changed relative to the corresponding rate.

50. The method according to any one of claims 44 to 49, wherein: Prior to stopping the movement of the computer system, the amount of the visual characteristic is changed relative to the rate of movement of the computer system.

51. A method according to any one of claims 44 to 50, wherein the first set of movement conditions comprises a condition which is satisfied when it is determined that the computer system will be stationary within a second predetermined time period.

52. A method according to any one of claims 44 to 51, wherein the second set of movement conditions comprises a condition which is satisfied when it is determined that the computer system will not be stationary within a third predetermined time period.

53. The method of any one of claims 44 to 52, wherein changing the amount of the visual characteristic comprises: The brightness of the corresponding user interface is adjusted.

54. The method of any one of claims 44 to 53, wherein changing the amount of the visual characteristic comprises: Increases or decreases the amount of color of the corresponding user interface.

55. The method of any one of claims 44 to 54, wherein changing the amount of the visual characteristic relative to the rate of movement of the computer system comprises: The amount by which the color and / or brightness of the corresponding user interface is reduced relative to the rate of movement of the computer system.

56. The method of any one of claims 44 to 55, wherein changing the amount of the visual characteristic relative to the corresponding rate different than the rate of movement of the computer system comprises: The amount by which the color and / or brightness of the respective user interface is increased relative to the respective rate.

57. A method according to any one of claims 44 to 56, wherein: prior to changing the amount of the visual characteristic relative to the rate of movement of the computer system, the amount of the visual characteristic is a fifth amount; and After changing the amount of the visual characteristic relative to the rate of movement of the computer system, the amount of the visual characteristic is a sixth amount different from the fifth amount, wherein the sixth amount and the fifth amount are non-zero.

58. A method according to any one of claims 44 to 57, wherein the first set of movement conditions includes a condition that the computer system will decelerate within a fourth predetermined time period, and wherein the second set of movement conditions includes a condition that the computer system will accelerate within a fifth predetermined time period.

59. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generating component and one or more sensors, the one or more programs comprising instructions for executing a method according to any one of claims 44 to 58.

60. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 44 to 58.

61. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: Means for carrying out the method according to any one of claims 44 to 58.

62. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and one or more sensors, the one or more programs comprising instructions for performing a method according to any one of claims 44 to 58.

63. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors, the one or more programs comprising instructions for: detecting the occurrence of a corresponding set of movement conditions while generating, via the display, a display of a corresponding user interface having a certain amount of visual characteristics; and In response to detecting said occurrence of said corresponding set of movement conditions: in response to determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristic relative to a rate of movement of the computer system; and Based on determining that the corresponding set of movement conditions is a second set of movement conditions that is different from the first set of movement conditions, the amount of the visual characteristic is changed relative to a corresponding rate that is different from the movement rate of the computer system.

64. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: detecting occurrence of a corresponding set of movement conditions while generating, via the display, displaying a corresponding user interface having a certain amount of visual characteristics; as well as In response to detecting said occurrence of said corresponding set of movement conditions: in response to determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristic relative to a rate of movement of the computer system; and Based on determining that the corresponding set of movement conditions is a second set of movement conditions that is different from the first set of movement conditions, the amount of the visual characteristic is changed relative to a corresponding rate that is different from the movement rate of the computer system.

65. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: means for detecting the occurrence of a corresponding set of movement conditions when displaying, via the display generation, a corresponding user interface having a certain amount of visual characteristics; and means for, in response to detecting said occurrence of said corresponding set of movement conditions: in response to determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristic relative to a rate of movement of the computer system; and Based on determining that the corresponding set of movement conditions is a second set of movement conditions that is different from the first set of movement conditions, the amount of the visual characteristic is changed relative to a corresponding rate that is different from the movement rate of the computer system.

66. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more sensors, the one or more programs comprising instructions for: detecting the occurrence of a corresponding set of movement conditions while generating, via the display, a display of a corresponding user interface having a certain amount of visual characteristics; and In response to detecting said occurrence of said corresponding set of movement conditions: in response to determining that the corresponding set of movement conditions is a first set of movement conditions, changing the amount of the visual characteristic relative to a rate of movement of the computer system; and Based on determining that the corresponding set of movement conditions is a second set of movement conditions that is different from the first set of movement conditions, the amount of the visual characteristic is changed relative to a corresponding rate that is different from the movement rate of the computer system.

67. A method comprising: At a computer system in communication with a display generating component: displaying, via the display generation component, a user interface comprising an indication displayed within a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; detecting a change in movement conditions while displaying, via the display generation component, the user interface including the indication overlaying the first portion and the second portion and while the computer system is in a non-stationary state; as well as In response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to the stationary state, changing the indication via the display generation component so that the indication is displayed within the first portion and not within the second portion.

68. The method of claim 67, wherein the first portion does not overlap with the second portion.

69. The method of any one of claims 67 to 68, wherein the first portion is adjacent to the second portion.

70. The method of any one of claims 68 to 69, wherein changing the indication so that the indication is displayed in the first portion and not in the second portion comprises: A first visual characteristic is removed from the second portion via the display generation component.

71. The method of claim 70, wherein removing the first visual characteristic comprises: ceasing to display the first visual characteristic from the second portion at a second rate in response to determining that movement of the computer system is changing in a corresponding manner at a first rate; as well as Based on determining that the movement of the computer system is changing in a corresponding manner at a third rate different from the first rate, displaying the first visual characteristic from the second portion is stopped at a fourth rate different from the second rate.

72. The method of any one of claims 67 to 71, wherein the computer system is in communication with one or more sensors, the method further comprising: detecting, via the one or more sensors, data including a subject in an environment when the indication is changed such that the indication is displayed within the first portion and not within the second portion; as well as In response to detecting data including the subject, a representation of the subject is displayed within the second portion via the display generation component while the indication continues to be displayed within the first portion.

73. The method of claim 72, wherein displaying the representation of the subject via the display generation component comprises: moving the representation of the subject in a third direction based on determining that the subject has moved in the first direction in the environment; as well as Based on determining that the subject has moved in the environment in a second direction different from the first direction, the representation of the subject is moved in a fourth direction different from the third direction.

74. A method according to any one of claims 72 to 73, wherein the representation of the body does not cover the entirety of the second part.

75. A method according to any one of claims 72 to 74, wherein the representation of the subject has a second visual characteristic, and wherein the indication displayed within the first portion has the second visual characteristic.

76. The method of any one of claims 67 to 75, wherein: When the indication is displayed in the first part and not in the second part: The first portion has a third visual characteristic; and The second portion has a fourth visual property different from the third visual property.

77. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component, the one or more programs comprising instructions for executing a method according to any one of claims 67 to 76.

78. A computer system configured to communicate with a display generation component, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 67 to 76.

79. A computer system configured to communicate with a display generation component, the computer system comprising: Means for carrying out the method according to any one of claims 67 to 76.

80. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs comprising instructions for performing the method of any one of claims 67 to 76.

81. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs comprising instructions for: displaying, via the display generation component, a user interface comprising an indication displayed within a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; detecting a change in movement conditions while displaying, via the display generation component, the user interface including the indication overlaying the first portion and the second portion and while the computer system is in a non-stationary state; and In response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to the stationary state, changing the indication via the display generation component so that the indication is displayed within the first portion and not within the second portion.

82. A computer system configured to communicate with a display generation component, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: displaying, via the display generation component, a user interface comprising an indication displayed within a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; detecting a change in movement conditions while displaying, via the display generation component, the user interface including the indication overlaying the first portion and the second portion and while the computer system is in a non-stationary state; as well as In response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to the stationary state, changing the indication via the display generation component so that the indication is displayed within the first portion and not within the second portion.

83. A computer system configured to communicate with a display generation component, the computer system comprising: means for displaying, via the display generation component, a user interface comprising an indication displayed within a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; means for detecting a change in movement condition while displaying, via the display generation component, the user interface including the indication overlaying the first portion and the second portion and while the computer system is in a non-stationary state; and Means for, in response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to the stationary state, changing, via the display generation component, the indication so that the indication is displayed in the first portion and not in the second portion.

84. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs comprising instructions for: displaying, via the display generation component, a user interface comprising an indication displayed within a first portion of a display area and a second portion of the display area, wherein the first portion is different from the second portion; detecting a change in movement conditions while displaying, via the display generation component, the user interface including the indication overlaying the first portion and the second portion and while the computer system is in a non-stationary state; and In response to detecting the change in the movement condition and based on determining that the computer system is transitioning from the non-stationary state to the stationary state, changing the indication via the display generation component so that the indication is displayed within the first portion and not within the second portion.

85. A method comprising: At a computer system in communication with a display generating component and a physical mechanism: displaying a first user interface via the display generation component; When displaying the first user interface, detecting the occurrence of a condition; as well as In response to detecting said occurrence of said condition: displaying, via the display generation component, a second user interface different from the first user interface; and The physical mechanism is caused to lower the computer system.

86. The method of claim 85, wherein causing the physical mechanism to lower the computer system comprises: Instructions are transmitted to cause the physical mechanism to lower one or more portions of the computer system.

87. The method of any one of claims 85 to 86, wherein displaying the second user interface via the display generation component comprises: While continuing to display the visual characteristic on a second portion of the user interface, the visual characteristic is removed from a first portion of the first user interface, wherein the first portion is different from the second portion.

88. The method of any one of claims 85 to 87, wherein displaying the second user interface via the display generation component comprises: A first animation is displayed that transitions from displaying the first user interface to displaying the second user interface, and wherein the first animation is displayed while the physical mechanism is lowering the computer system.

89. The method of any one of claims 85 to 87, wherein displaying the second user interface via the display generation component comprises: A second animation is displayed that transitions from displaying the first user interface to displaying the second user interface, and wherein the first animation is displayed prior to causing the physical mechanism to lower the computer system.

90. The method of any one of claims 85 to 89, wherein detecting the occurrence of the condition comprises: It is detected that the computer system will not move within a predetermined period of time.

91. The method of any one of claims 85 to 90, further comprising: while causing the physical mechanism to lower the computer system and while displaying the second user interface, detecting an occurrence of a second condition different from the condition; as well as In response to detecting said occurrence of said second condition: displaying the first user interface via the display generation component; and The physical mechanism is caused to elevate the computer system.

92. The method of claim 91, wherein displaying the first user interface in response to detecting the occurrence of the second condition comprises: While continuing to display the second visual characteristic on a fourth portion of the user interface, adding the second visual characteristic to a third portion of the first user interface, and wherein the third portion is different from the fourth portion.

93. The method of any one of claims 91 to 92, wherein displaying the first user interface in response to detecting the occurrence of the second condition comprises: A third animation is displayed that transitions from displaying the second user interface to displaying the first user interface, and wherein the third animation is displayed when the physical mechanism is caused to raise the computer system.

94. The method of any one of claims 91 to 92, wherein the computer system is in communication with one or more speakers, the method further comprising: in conjunction with lowering the device, outputting a first sound via the one or more speakers; as well as In conjunction with raising the device, a second sound different from the first sound is output via the one or more speakers.

95. A method according to any one of claims 85 to 94, wherein the first user interface includes a third visual characteristic and a fourth visual characteristic, and wherein the second user interface includes the third visual characteristic but does not include the fourth visual characteristic.

96. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generation component and a physical input mechanism, the one or more programs comprising instructions for executing a method according to any one of claims 85 to 95.

97. A computer system configured to communicate with a display generation component and a physical input mechanism, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 85 to 95.

98. A computer system configured to communicate with a display generation component and a physical input mechanism, the computer system comprising: Components for performing the method according to any one of claims 85 to 95.

99. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and a physical input mechanism, the one or more programs comprising instructions for performing a method according to any one of claims 85 to 95.

100. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and a physical mechanism, the one or more programs comprising instructions for: displaying a first user interface via the display generation component; While displaying the first user interface, detecting the occurrence of a condition; and In response to detecting said occurrence of said condition: displaying, via the display generation component, a second user interface different from the first user interface; and The physical mechanism is caused to lower the computer system.

101. A computer system configured to communicate with a display generation component and a physical mechanism, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: displaying a first user interface via the display generation component; When displaying the first user interface, detecting the occurrence of a condition; as well as In response to detecting said occurrence of said condition: displaying, via the display generation component, a second user interface different from the first user interface; and The physical mechanism is caused to lower the computer system.

102. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: means for displaying a first user interface via the display generation component; A component for detecting the occurrence of a condition when displaying the first user interface; and means for, in response to detecting said occurrence of said condition, performing: displaying, via the display generation component, a second user interface different from the first user interface; and The physical mechanism is caused to lower the computer system.

103. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and a physical mechanism, the one or more programs comprising instructions for: means for displaying a first user interface via the display generation component; means for detecting the occurrence of a condition when displaying the first user interface; and means for, in response to detecting said occurrence of said condition, performing: displaying, via the display generation component, a second user interface different from the first user interface; and The physical mechanism is caused to lower the computer system.

104. A method comprising: At a computer system in communication with a first display generating component and a second display generating component: while the computer system is moving, displaying, via the first display generation component, a first user interface element in a first appearance; While displaying the first user interface element in the first appearance, detecting occurrence of one or more events; as well as In response to detecting said occurrence of said one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; Based on determining that the one or more events do not include the first event, displaying, via the first display generating component, the first user interface element in a second appearance different from the first appearance; displaying, via a second display generation component, a second user interface element at least partially surrounding the first user interface element based on determining that the one or more events include a second event, the second event being an event of a different type than the first event; as well as Based on determining that the one or more events do not include the second event, Displaying the second user interface element via the second display generating component is abandoned.

105. The method of claim 104, wherein the first event is detected based on a current directional movement of the computer system, and wherein the second event is not detected based on a current directional movement of the computer system.

106. The method according to any one of claims 104 to 105, further comprising: detecting occurrence of a first set of one or more events while displaying the first user interface element in the second appearance and while displaying the second user interface element; as well as In response to detecting said occurrence of said first set of one or more events: modifying, via the first display generation component, a display of the first user interface element, and modifying, via the second display generation component, a display of the second user interface element based on determining that the first set of one or more events includes the first event and the second event; based on determining that the first set of one or more events includes the first event but does not include the second event, modifying display of the first user interface element via the first display generation component without modifying display of the second user interface element via the second display generation component; as well as modifying, via the second display generation component, display of the second user interface element without modifying, via the first display generation component, display of the first user interface element based on determining that the first set of one or more events includes the second event but does not include the first event; as well as Based on determining that the first group of one or more events does not include the first event and the second event, abandoning modifying the display of the first user interface element via the first display generating component, and abandoning modifying the display of the second user interface element via the second display generating component, without modifying the display of the first user interface element via the first display generating component.

107. The method of any one of claims 104 to 106, wherein displaying the second user interface element comprises: A visual characteristic of the second user interface element is pulsed, and wherein displaying the first user interface element does not include: pulsating one or more visual characteristics of the first user interface element.

108. A method according to any one of claims 104 to 107, wherein the second user interface element comprises an indication of a change in the orientation of the computer system.

109. The method of claim 108, wherein: Based on determining that the second event corresponds to an event corresponding to the first direction, the second display generating component is a third display generating component; and Based on determining that the second event corresponds to an event corresponding to a second direction different from the first direction, the second display generating component is a fourth display generating component different from the third display generating component.

110. The method of any one of claims 104 to 109, wherein the second user interface element comprises hazard information.

111. A method according to any one of claims 104 to 110, wherein the first user interface element displayed in the second appearance includes information about one or more subjects detected in the environment, and wherein the first user interface element displayed in the first appearance does not include information about one or more subjects detected in the environment.

112. A method according to any one of claims 104 to 111, wherein the first user interface element displayed in the second appearance indicates that the computer system will not move within a predetermined time period, and wherein the first user interface element indicates that the computer system will move within the predetermined time period.

113. A method according to any one of claims 104 to 112, wherein the first user interface element displayed in the first appearance has a first amount of visual characteristics, and wherein the first user interface element displayed in the second appearance has a second amount of the visual characteristics, and the second amount is different from the first amount of the visual characteristics.

114. The method of any one of claims 104 to 113, wherein the second display generating component is a different type of display generating component than the first display generating component.

115. The method of any one of claims 104 to 114, wherein the output of the second display generating component at least partially surrounds the output of the first display generating component.

116. The method of any one of claims 104 to 115, wherein a display area corresponding to the first display generating component protrudes further from the computer system than a display area corresponding to the second display generating component.

117. A method according to any one of claims 104 to 116, wherein the second user interface element is displayed primarily using indirect light, and the first user interface element is not displayed primarily using indirect light.

118. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that communicates with a display generating component and one or more sensors, the one or more programs comprising instructions for executing a method according to any one of claims 104 to 117.

119. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 104 to 117.

120. A computer system configured to communicate with a display generation component and one or more sensors, the computer system comprising: Components for performing the method according to any one of claims 104 to 117.

121. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and one or more sensors, the one or more programs comprising instructions for performing a method according to any one of claims 104 to 117.

122. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a first display generating component and a second display generating component, the one or more programs comprising instructions for: while the computer system is moving, displaying, via the first display generation component, a first user interface element in a first appearance; While displaying the first user interface element in the first appearance, detecting occurrence of one or more events; as well as In response to detecting said occurrence of said one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; displaying, via the first display generation component, the first user interface element in a second appearance different from the first appearance based on determining that the one or more events do not include the first event; displaying, via a second display generation component, a second user interface element at least partially surrounding the first user interface element based on determining that the one or more events include a second event, the second event being an event of a different type than the first event; as well as Based on determining that the one or more events do not include the second event, displaying the second user interface element via the second display generating component is foregone.

123. A computer system configured to communicate with a first display generating component and a second display generating component and comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: while the computer system is moving, displaying, via the first display generation component, a first user interface element in a first appearance; While displaying the first user interface element in the first appearance, detecting occurrence of one or more events; as well as In response to detecting said occurrence of said one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; displaying, via the first display generation component, the first user interface element in a second appearance different from the first appearance based on determining that the one or more events do not include the first event; displaying, via a second display generation component, a second user interface element at least partially surrounding the first user interface element based on determining that the one or more events include a second event, the second event being an event of a different type than the first event; as well as Based on determining that the one or more events do not include the second event, displaying the second user interface element via the second display generating component is foregone.

124. A computer system configured to communicate with a first display generating component and a second display generating component and comprising: means for displaying, via the first display generation component, a first user interface element in a first appearance while the computer system is moving; means for detecting the occurrence of one or more events when displaying the first user interface element in the first appearance; and Means for, in response to detecting said occurrence of said one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; displaying, via the first display generation component, the first user interface element in a second appearance different from the first appearance based on determining that the one or more events do not include the first event; displaying, via a second display generation component, a second user interface element at least partially surrounding the first user interface element based on determining that the one or more events include a second event, the second event being an event of a different type than the first event; as well as Based on determining that the one or more events do not include the second event, displaying the second user interface element via the second display generating component is foregone.

125. A computer program product, the computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a first display generating component and a second display generating component, the one or more programs comprising instructions for: while the computer system is moving, displaying, via the first display generation component, a first user interface element in a first appearance; While displaying the first user interface element in the first appearance, detecting occurrence of one or more events; as well as In response to detecting said occurrence of said one or more events: continuing to display the first user interface element in the first appearance based on determining that the one or more events include a first event, wherein the first event is detected when it is determined that the computer system is moving; displaying, via the first display generation component, the first user interface element in a second appearance different from the first appearance based on determining that the one or more events do not include the first event; displaying, via a second display generation component, a second user interface element at least partially surrounding the first user interface element based on determining that the one or more events include a second event, the second event being an event of a different type than the first event; as well as Based on determining that the one or more events do not include the second event, displaying the second user interface element via the second display generating component is foregone.

Images