Techniques and user interfaces for controlling one or more electronic devices
Patent Information
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- APPLE INC
- Filing Date
- 2024-09-27
- Publication Date
- 2026-07-01
AI Technical Summary
Existing techniques for controlling electronic devices using computer systems are cumbersome and inefficient, often requiring complex and time-consuming user interfaces that waste user time and device energy, especially in battery-operated devices.
The development of faster and more efficient methods and interfaces for controlling electronic devices, which include detecting the direction of external devices and displaying control indications accordingly, reducing cognitive burden and conserving power.
These methods and interfaces reduce the time and effort required to control electronic devices, enhance user experience, and conserve battery life in portable devices.
Smart Images

Figure US2024049119_03042025_PF_FP_ABST
Abstract
Description
Attorney Docket No.: 041501 (P64631WO1) TECHNIQUES AND USER INTERFACES FOR CONTROLLING ONE OR MORE ELECTRONIC DEVICES CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to U.S. Non-Provisional Patent Application Serial No.18 / 896,500 entitled “TECHNIQUES AND USER INTERFACES FOR CONTROLLING ONE OR MORE ELECTRONIC DEVICES,” filed September 25, 2024, to U.S. Non-Provisional Patent Application Serial No.18 / 896,505 entitled “TECHNIQUES AND USER INTERFACES FOR DISPLAYING CONTROLS,” filed September 25, 2024, to U.S. Non-Provisional Patent Application Serial No.18 / 895,559 entitled “USER INTERFACES AND TECHNIQUES FOR DISPLAYING INFORMATION,” filed September 25, 2024, to U.S. Provisional Patent Application serial No.63 / 587,112 entitled “TECHNIQUES AND USER INTERFACES FOR CONTROLLING ONE OR MORE ELECTRONIC DEVICES,” filed September 30, 2023, to U.S. Provisional Patent Application serial No.63 / 587,110 entitled “TECHNIQUES AND USER INTERFACES FOR DISPLAYING CONTROLS,” filed September 30, 2023, and to U.S. Provisional Patent Application serial No.63 / 587,111 entitled “USER INTERFACES AND TECHNIQUES FOR DISPLAYING INFORMATION,” filed September 30, 2023, which are hereby incorporated by reference in their entireties for all purposes. BACKGROUND
[0002] Computer systems are often in communication with external devices. Computer systems often leverage the communication to control one or more operations of the external devices. Computer systems often display controls that correspond to the external devices. The controls can used to adjust a state of the external devices. Computer systems often display information via external displays. Such information can optionally be displayed on both the computer system and the external displays. SUMMARY
[0003] Some techniques for controlling electronic devices using computer systems, however, are generally cumbersome and inefficient. For example, some existing techniques use a complex and time-consuming user interface, which may include multiple key presses or keystrokes. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) Existing techniques require more time than necessary, wasting user time and device energy. This latter consideration is particularly important in battery-operated devices.
[0004] Accordingly, the present technique provides electronic devices with faster, more efficient methods and interfaces for controlling electronic devices. Such methods and interfaces optionally complement or replace other methods for controlling electronic devices. Such methods and interfaces reduce the cognitive burden on a user and produce a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.
[0005] In some embodiments, a method that is performed at a computer system that is in communication with a display component is described. In some embodiments, the method comprises: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0006] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component is described. In some embodiments, the one or more programs includes instructions for: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
[0007] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component is described. In some embodiments, the one or more programs includes instructions for: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
[0008] In some embodiments, a computer system that is in communication with a display component is described. In some embodiments, the computer system that is in communication with a display component comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
[0009] In some embodiments, a computer system that is in communication with a display component is described. In some embodiments, the computer system that is in communication with a display component comprises means for performing each of the following steps: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
[0010] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) display component. In some embodiments, the one or more programs include instructions for: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
[0011] In some embodiments, a method that is performed at a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the method comprises: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
[0012] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
[0013] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
[0014] In some embodiments, a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the computer system that is in communication with a display component and one or more input devices comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
[0015] In some embodiments, a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the computer system that is in communication with a display component and one or more input devices comprises means for performing each of the following steps: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
[0016] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices. In some embodiments, the one or more programs include instructions for: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
[0017] In some examples, a method that is performed at a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the method comprises: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
[0018] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0019] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
[0020] In some embodiments, a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the computer system that is in communication with a display component and one or more input devices comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
[0021] In some embodiments, a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the computer system that is in communication with a display component and one or more input devices comprises means for performing each of the following steps: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
[0022] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices. In some embodiments, the one or more programs include instructions for: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
[0023] In some examples, a method that is performed at a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism is described. In some embodiments, the method comprises: while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
[0024] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism is described. In some embodiments, the one or more programs includes instructions for: while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
[0025] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism is described. In some embodiments, the one or more programs includes instructions for: while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
[0026] In some embodiments, a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism is described. In some embodiments, the computer system that is in communication with a display component, one or more input devices, and a physical input mechanism comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
[0027] In some embodiments, a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism is described. In some embodiments, the computer system that is in communication with a display component, one or more input devices, and a physical input mechanism comprises means for performing each of the following steps: while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
[0028] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism. In some embodiments, the one or more programs include instructions for: while displaying a respective 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
[0029] In some examples, a method that is performed at a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the method comprises: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
[0030] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0031] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
[0032] In some embodiments, a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the computer system that is in communication with a display component and one or more input devices comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
[0033] In some embodiments, a computer system that is in communication with a display component and one or more input devices is described. In some embodiments, the computer system that is in communication with a display component and one or more input devices comprises means for performing each of the following steps: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
[0034] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices. In some embodiments, the one or more programs include instructions for: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
[0035] In some embodiments, a method that is performed at a computer system that is in communication with a display component and a physical input mechanism is described. In some embodiments, the method comprises: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
[0036] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a physical input mechanism is described. In some embodiments, the one or more programs includes instructions for: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
[0037] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a physical input mechanism is described. In some embodiments, the one or more programs includes instructions for: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0038] In some embodiments, a computer system that is in communication with a display component and a physical input mechanism is described. In some embodiments, the computer system that is in communication with a display component and a physical input mechanism comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
[0039] In some embodiments, a computer system that is in communication with a display component and a physical input mechanism is described. In some embodiments, the computer system that is in communication with a display component and a physical input mechanism comprises means for performing each of the following steps: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
[0040] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a physical input mechanism. In some embodiments, the one or more programs include instructions for: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0041] In some embodiments, a method that is performed at a computer system that is in communication with a display component and a respective device is described. In some embodiments, the method comprises: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0042] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device is described. In some embodiments, the one or more programs includes instructions for: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0043] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device is described. In some embodiments, the one or more programs includes instructions for: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0044] In some embodiments, a computer system that is in communication with a display component and a respective device is described. In some embodiments, the computer system that is in communication with a display component and a respective device comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0045] In some embodiments, a computer system that is in communication with a display component and a respective device is described. In some embodiments, the computer system that is in communication with a display component and a respective device comprises means for performing each of the following steps: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0046] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device. In some embodiments, the one or more programs include instructions for: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and in accordance with a determination that the set of one or more criteria is not met, displaying, via the display 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) component, the one or more controls without causing the respective device to display the one or more controls.
[0047] In some embodiments, a method that is performed at a computer system that is in communication with a display component and a respective device is described. In some embodiments, the method comprises: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0048] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device is described. In some embodiments, the one or more programs includes instructions for: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0049] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device is described. In some embodiments, the one or more programs includes instructions for: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0050] In some embodiments, a computer system that is in communication with a display component and a respective device is described. In some embodiments, the computer system that is in communication with a display component and a respective device comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0051] In some embodiments, a computer system that is in communication with a display component and a respective device is described. In some embodiments, the computer system that is in communication with a display component and a respective device comprises means for performing each of the following steps: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0052] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device. In some embodiments, the one or more programs include instructions for: while the respective device is displaying a respective user interface, 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
[0053] Executable instructions for performing these functions are, optionally, included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are, optionally, included in a transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.
[0054] Thus, devices are provided with faster, more efficient methods and interfaces for controlling electronic devices, thereby increasing the effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may complement or replace other methods for controlling electronic devices. DESCRIPTION OF THE FIGURES
[0055] For a better understanding of the various described embodiments, reference should be made to the Detailed Description below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures.
[0056] FIG.1 is a block diagram illustrating a system with various components in accordance with some embodiments.
[0057] FIGS.2A-2G illustrate exemplary user interfaces for controlling one or more electronic devices in accordance with some examples.
[0058] FIGS.3A-3B is a flow diagram illustrating a method for controlling one or more electronic devices in accordance with some examples.
[0059] FIG.4 is a flow diagram illustrating a method for displaying controls in accordance with some examples. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0060] FIGS.5A-5E illustrate exemplary user interfaces for displaying controls in accordance with some embodiments.
[0061] FIGS.6A-6B is a flow diagram illustrating a method for displaying controls in accordance with some embodiments.
[0062] FIGS.7A-7F illustrate exemplary user interfaces for controlling the display of controls in accordance with some embodiments.
[0063] FIGS.8A-8B is a flow diagram illustrating a method for controlling the display of controls in accordance with some embodiments.
[0064] FIGS.9A-9G illustrate exemplary user interfaces for changing the appearance of a user interface object in accordance with some embodiments.
[0065] FIGS.10A-10B is a flow diagram illustrating a method for changing the appearance of a user interface object in accordance with some embodiments.
[0066] FIGS.11A-11E illustrate exemplary user interfaces for displaying controls via an external display in accordance with some examples.
[0067] FIGS.12A-12B are a flow diagram illustrating a method for displaying controls via an external display in accordance with some examples.
[0068] FIGS.13A-13F illustrate exemplary user interfaces for selectively displaying controls in accordance with some examples.
[0069] FIG.14 is a flow diagram illustrating a method for displaying information via an external display based on the location of a computer system in accordance with some examples.
[0070] FIG.15 is a flow diagram illustrating a method for selectively displaying a user interface via an external display in accordance with some examples. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) DETAILED DESCRIPTION
[0071] The following description sets forth exemplary techniques for controlling electronic devices. This description is not intended to limit the scope of this disclosure but is instead provided as a description of example implementations.
[0072] Users need electronic devices that provide effective techniques for controlling electronic devices. Efficient techniques can reduce a user’s mental load when controlling electronic devices. This reduction in mental load can enhance user productivity and make the device easier to use. In some embodiments, the techniques described herein can reduce battery usage and processing time (e.g., by providing user interfaces that require fewer user inputs to operate).
[0073] FIG.1 provides illustrations of exemplary devices for performing techniques for controlling electronic devices and / or displaying controls. FIGS.2A-2G illustrate exemplary user interfaces for controlling one or more electronic devices in accordance with some examples. FIGS.3A-3B is a flow diagram illustrating methods of controlling one or more electronic devices in accordance with some examples. FIG.4 is a flow diagram illustrating a method for displaying controls in accordance with some examples. The user interfaces in FIGS.2A-4G are used to illustrate the processes described below, including the processes in FIGS.3A-3B and 4. FIGS.5A-5E illustrate exemplary user interfaces for displaying in accordance with some embodiments. FIGS.6A-6B is a flow diagram illustrating methods of displaying controls in accordance with some embodiments. The user interfaces in FIGS.5A-5E are used to illustrate the processes described below, including the processes in FIGS.6A-6B. FIGS.7A-7F illustrate exemplary user interfaces for controlling the display of controls in accordance with some embodiments. FIGS.8A-8B is a flow diagram illustrating methods of controlling the display of controls in accordance with some embodiments. The user interfaces in FIGS.7A-7F are used to illustrate the processes described below, including the processes in FIGS.8A-8B. FIGS.9A-9G illustrate exemplary user interfaces for changing the appearance of a user interface object in accordance with some embodiments. FIGS.10A-10B is a flow diagram illustrating a method for changing the appearance of a user interface object in accordance with some embodiments. The 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) user interfaces in FIGS.9A-9G are used to illustrate the processes described below, including the processes in FIGS.10A-10B.
[0074] The processes below describe various techniques for making user interfaces and / or human-computer interactions more efficient (e.g., by helping the user to quickly and easily provide inputs and preventing user mistakes when operating a device). These techniques sometimes reduce the number of inputs needed for a user (e.g., a person and / or a user) to perform an operation, provide clear and / or meaningful feedback (e.g., visual, acoustic, and / or haptic feedback) to the user so that the user knows what has happened or what to expect, provide additional information and controls without cluttering the user interface, and / or perform certain operations without requiring further input from the user. Since the user can use a device more quickly and easily, these techniques sometimes improve battery life and / or reduce power usage of the device.
[0075] In methods described where one or more steps are contingent on one or more conditions having been satisfied, it should be understood that the described method can be repeated in multiple repetitions so that over the course of the repetitions all of the conditions upon which steps in the method are contingent have been satisfied in different repetitions of the method. For example, if a method requires performing a first step if a condition is satisfied, and a second step if the condition is not satisfied, it should be appreciated that the steps are repeated until the condition has been both satisfied and not satisfied, in no particular order. Thus, a method described with one or more steps that are contingent upon one or more conditions having been satisfied could be rewritten as a method that is repeated until each of the conditions described in the method has been satisfied. This multiple repetition, however, is not required of system or computer readable medium claims where the system or computer readable medium contains instructions for performing conditional operations that require that one or more conditions be satisfied before the operations occur. A person having ordinary skill in the art would also understand that, similar to a method with conditional steps, a system or computer readable storage medium can repeat the steps of a method as many times as are needed to ensure that all of the conditional steps have been performed. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0076] The terminology used in the description of the various embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting.
[0077] User interfaces for electronic devices, and associated processes for using these devices, are described below. In some embodiments, the device is a desktop computer with a touch-sensitive surface (e.g., a touch screen display and / or a touchpad). In other embodiments, the device is a portable, movable, and / or mobile electronic device (e.g., a processor, a smart phone, a smart watch, a tablet, a fitness tracking device, a laptop, a head-mounted display (HMD) device, a communal device, a vehicle, a media device, a smart speaker, a smart display, a robot, a television and / or a personal computing device).
[0078] In some embodiments, the electronic device is a computer system that is in communication with a display component (e.g., by wireless or wired communication). The display component may be integrated into the computer system or may be separate from the computer system. Additionally, the display component may be configured to provide visual output to a display (e.g., a liquid crystal display, an OLED display, or CRT display). As used herein, “displaying” content includes causing to display the content (e.g., video data rendered or decoded by a display controller) by transmitting, via a wired or wireless connection, data (e.g., image data or video data) to an integrated or external display component to visually produce the content. In some embodiments, visual output is any output that is capable of being perceived by the human eye, including, and not limited to images, videos, graphs, charts, and other graphical representations of data.
[0079] In some embodiments, the electronic device is a computer system that is in communication with an audio generation component (e.g., by wireless or wired communication). The audio generation component may be integrated into the computer system or may be separate from the computer system. Additionally, the audio generation component may be configured to provide audio output. Examples of an audio generation component include a speaker, a home theater system, a soundbar, a headphone, an earphone, an earbud, a television speaker, an augmented reality headset speaker, an audio jack, an optical audio output, a Bluetooth audio output, and / or an HDMI audio output). In some embodiments, audio output is any output that is 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) capable of being perceived by the human ear, including, and not limited to sound waves, music, speech, and / or other audible representations of data.
[0080] In the discussion that follows, an electronic device that includes particular input and output devices is described. It should be understood, however, that the electronic device optionally includes one or more other input and / or output devices, such as physical user-interface devices (e.g., a physical keyboard, a mouse, and / or a joystick).
[0081] FIG.1 illustrates an example system 100 for implementing techniques described herein. System 100 can perform any of the methods described in processes 300, 400, 600, 800, 1000, 1200, 1400, and / or 1500 (FIGS.3A-3B, 4, 6A-6B, 8A-8B, 10A-10B, 12A-12B, 14, and / or 15) and / or portions of these methods.
[0082] In FIG.1, system 100 includes various components, such as processor(s) 103, RF circuitry(ies) 105, memory(ies) 107, sensors 156 (e.g., image sensor(s), orientation sensor(s), location sensor(s), heart rate monitor(s), temperature sensor(s)), input device(s) 158 (e.g., camera(s) (e.g., a periscope camera, a telephoto camera, a wide-angle camera, and / or an ultra- wide-angle camera), depth sensor(s), microphone(s), touch sensitive surface(s), hardware input mechanism(s), and / or rotatable input mechanism(s)), mobility components (e.g., actuator(s) (e.g., pneumatic actuator(s), hydraulic actuator(s), and / or electric actuator(s)), motor(s), wheel(s), movable base(s), rotatable component(s), translation component(s), and / or rotatable base(s)) and output device(s) 160 (e.g., speaker(s), display component(s), audio generation component(s), haptic output device(s), display screen(s), projector(s), and / or touch-sensitive display(s)). These components optionally communicate over communication bus(es) 123 of the system. Although shown as separate components, in some implementations, various components can be combined and function as a single component, such as a sensor can be an input device.
[0083] In some embodiments, system 100 is a mobile and / or movable device (e.g., a tablet, a smart phone, a laptop, head-mounted display (HMD) device, and or a smartwatch). In other embodiments, system 100 is a desktop computer, an embedded computer, and / or a server.
[0084] In some embodiments, processor(s) 103 includes one or more general processors, one or more graphics processors, and / or one or more digital signal processors. In some embodiments, 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) memory(ies) 107 is one or more non-transitory computer-readable storage mediums (e.g., flash memory and / or random-access memory) that store computer-readable instructions configured to be executed by processor(s) 103 to perform techniques described herein.
[0085] In some embodiments, RF circuitry(ies) 105 includes circuitry for communicating with electronic devices and / or networks (e.g., the Internet, intranets, and / or a wireless network, such as cellular networks and wireless local area networks (LANs)). In some embodiments, RF circuitry(ies) 105 includes circuitry for communicating using near-field communication and / or short-range communication, such as Bluetooth® or Ultra-wideband.
[0086] In some embodiments, display(s) 121 includes one or more monitors, projectors, and / or screens. In some embodiments, display(s) 121 includes a first display for displaying images to a first eye of a user and a second display for displaying images to a second eye of the user. In such embodiments, corresponding images can be simultaneously displayed on the first display and the second display. Optionally, the corresponding images include the same virtual objects and / or representations of the same physical objects from different viewpoints, resulting in a parallax effect that provides the user with the illusion of depth of the objects on the displays. In some embodiments, display(s) 121 is a single display. In such embodiments, corresponding images are simultaneously displayed in a first area and a second area of the single display for each eye of the user. Optionally, the corresponding images include the same virtual objects and / or representations of the same physical objects from different viewpoints, resulting in a parallax effect that provides a user with the illusion of depth of the objects on the single display.
[0087] In some embodiments, system 100 includes touch-sensitive surface(s) 115 for receiving user inputs, such as tap inputs and swipe inputs. In some embodiments, display(s) 121 and touch-sensitive surface(s) 115 form touch-sensitive display(s).
[0088] In some embodiments, sensor(s) 156 includes sensors for detecting various conditions. In some embodiments, sensor(s) 156 includes orientation sensors (e.g., orientation sensor(s) 111) for detecting orientation and / or movement of platform 150. For example, system 100 uses orientation sensors to track changes in the location and / or orientation (sometimes collectively referred to as position) of system 100, such as with respect to physical objects in the physical environment. In some embodiments, sensor(s) 156 includes one or more gyroscopes, 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) one or more inertial measurement units, and / or one or more accelerometers. In some embodiments, sensor(s) 156 includes a global positioning sensor (GPS) for detecting a GPS location of platform 150. In some embodiments, sensor(s) 156 includes a radar system, LIDAR system, sonar system, image sensors (e.g., image sensor(s) 109, visible light image sensor(s), and / or infrared sensor(s)), depth sensor(s), rangefinder(s), and / or motion detector(s). In some embodiments, sensor(s) 156 includes sensors that are in an interior portion of system 100 and / or sensors that are on an exterior of system 100. In some embodiments, system 100 uses sensor(s) 156 (e.g., interior sensors) to detect a presence and / or state (e.g., location and / or orientation) of a passenger in the interior portion of system 100. In some embodiments, system 100 uses sensor(s) 156 (e.g., external sensors) to detect a presence and / or state of an object external to system 100. In some embodiments, system 100 uses sensor(s) 156 to receive user inputs, such as hand gestures and / or other air gesture. In some embodiments, system 100 uses sensor(s) 156 to detect the location and / or orientation of system 100 in the physical environment. In some embodiments, system 100 uses sensor(s) 156 to navigate system 100 along a planned route, around obstacles, and / or to a destination location. In some embodiments, sensor(s) 156 include one or more sensors for identifying and / or authenticating a user of system 100, such as a fingerprint sensor and / or facial recognition sensor.
[0089] In some embodiments, image sensor(s) includes one or more visible light image sensor, such as charged coupled device (CCD) sensors, and / or complementary metal–oxide– semiconductor (CMOS) sensors operable to obtain images of physical objects. In some embodiments, image sensor(s) includes one or more infrared (IR) sensor(s), such as a passive IR sensor or an active IR sensor, for detecting infrared light. For example, an active IR sensor can include an IR emitter, such as an IR dot emitter, for emitting infrared light. In some embodiments, image sensor(s) includes one or more camera(s) configured to capture movement of physical objects. In some embodiments, image sensor(s) includes one or more depth sensor(s) configured to detect the distance of physical objects from system 100. In some embodiments, system 100 uses CCD sensors, cameras, and depth sensors in combination to detect the physical environment around system 100. In some embodiments, image sensor(s) includes a first image sensor and a second image sensor different form the first image sensor. In some embodiments, system 100 uses image sensor(s) to receive user inputs, such as hand gestures and / or other air 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) gestures. In some embodiments, system 100 uses image sensor(s) to detect the location and / or orientation of system 100 in the physical environment.
[0090] In some embodiments, system 100 uses orientation sensor(s) for detecting orientation and / or movement of system 100. For example, system 100 can use orientation sensor(s) to track changes in the location and / or orientation of system 100, such as with respect to physical objects in the physical environment. In some embodiments, orientation sensor(s) includes one or more gyroscopes, one or more inertial measurement units, and / or one or more accelerometers.
[0091] In some embodiments, system 100 uses microphone(s) to detect sound from one or more users and / or the physical environment of the one or more users. In some embodiments, microphone(s) includes an array of microphones (including a plurality of microphones) that optionally operate in tandem, such as to identify ambient noise or to locate the source of sound in space (e.g., inside system 100 and / or outside of system 100) of the physical environment.
[0092] In some embodiments, input device(s) 158 includes one or more mechanical and / or electrical devices for detecting input, such as button(s), slider(s), knob(s), switch(es), remote control(s), joystick(s), touch-sensitive surface(s), keypad(s), microphone(s), and / or camera(s). In some embodiments, input device(s) 158 include one or more input devices inside system 100. In some embodiments, input device(s) 158 include one or more input devices (e.g., a touch- sensitive surface and / or keypad) on an exterior of system 100.
[0093] In some embodiments, output device(s) 160 include one or more devices, such as display(s), monitor(s), projector(s), speaker(s), light(s), and / or haptic output device(s). In some embodiments, output device(s) 160 includes one or more external output devices, such as external display screen(s), external light(s), and / or external speaker(s). In some embodiments, output device(s) 160 includes one or more internal output devices, such as internal display screen(s), internal light(s), and / or internal speaker(s).
[0094] In some embodiments, environment controls 162 includes mechanical and / or electrical systems for monitoring and / or controlling conditions of an internal portion (e.g., cabin) of system 100. In some embodiments, environmental controls 162 includes fan(s), heater(s), air 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) conditioner(s), and / or thermostat(s) for controlling the temperature and / or airflow within the interior portion of system 100.
[0095] In some embodiments, mobility component(s) includes mechanical and / or electrical components that enable a platform to move and / or assist in the movement of the platform. In some embodiments, mobility system 164 includes powertrain(s), drivetrain(s), motor(s) (e.g., an electrical motor), engine(s), power source(s) (e.g., battery(ies)), transmission(s), suspension system(s), speed control system(s), and / or steering system(s). In some embodiments, one or more elements of mobility component(s) are configured to be controlled autonomously or manually (e.g., via system 100 and / or input device(s) 158).
[0096] In some embodiments, system 100 performs monetary transactions with or without another computer system. For example, system 100, or another computer system associated with and / or in communication with system 100 (e.g., via a user account described below), is associated with a payment account of a user, such as a credit card account or a checking account. To complete a transaction, system 100 can transmit a key to an entity from which goods and / or services are being purchased that enables the entity to charge the payment account for the transaction. As another example, system 100 stores encrypted payment account information and transmits this information to entities from which goods and / or services are being purchased to complete transactions.
[0097] System 100 optionally conducts other transactions with other systems, computers, and / or devices. For example, system 100 conducts transactions to unlock another system, computer, and / or device and / or to be unlocked by another system, computer, and / or device. Unlocking transactions optionally include sending and / or receiving one or more secure cryptographic keys using, for example, RF circuitry(ies) 105.
[0098] In some embodiments, system 100 is capable of communicating with other computer systems and / or electronic devices. For example, system 100 can use RF circuitry(ies) 105 to access a network connection that enables transmission of data between systems for the purpose of communication. Example communication sessions include phone calls, e-mails, SMS messages, and / or videoconferencing communication sessions. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0099] In some embodiments, videoconferencing communication sessions include transmission and / or receipt of video and / or audio data between systems participating in the videoconferencing communication sessions, including system 100. In some embodiments, system 100 captures video and / or audio content using sensor(s) 156 to be transmitted to the other system(s) in the videoconferencing communication sessions using RF circuitry(ies) 105. In some embodiments, system 100 receives, using the RF circuitry(ies) 105, video and / or audio from the other system(s) in the videoconferencing communication sessions, and presents the video and / or audio using output device(s) 160, such as display(s) 121 and / or speaker(s). In some embodiments, the transmission of audio and / or video between systems is near real-time, such as being presented to the other system(s) with a delay of less than 0.1, 0.5, 1, or 3 seconds from the time of capturing a respective portion of the audio and / or video.
[0100] In some embodiments, the system 100 generates tactile (e.g., haptic) outputs using output device(s) 160. In some embodiments, output device(s) 160 generates the tactile outputs by displacing a moveable mass relative to a neutral position. In some embodiments, tactile outputs are periodic in nature, optionally including frequency(ies) and / or amplitude(s) of movement in two or three dimensions. In some embodiments, system 100 generates a variety of different tactile outputs differing in frequency(ies), amplitude(s), and / or duration / number of cycle(s) of movement included. In some embodiments, tactile output pattern(s) includes a start buffer and / or an end buffer during which the movable mass gradually speeds up and / or slows down at the start and / or at the end of the tactile output, respectively.
[0101] In some embodiments, tactile outputs have a corresponding characteristic frequency that affects a “pitch” of a haptic sensation that a user feels. For example, higher frequency(ies) corresponds to faster movement(s) by the moveable mass whereas lower frequency(ies) corresponds to slower movement(s) by the moveable mass. In some embodiments, tactile outputs have a corresponding characteristic amplitude that affects a “strength” of the haptic sensation that the user feels. For example, higher amplitude(s) corresponds to movement over a greater distance by the moveable mass, whereas lower amplitude(s) corresponds to movement over a smaller distance by the moveable mass. In some embodiments, the “pitch” and / or “strength” of a tactile output varies over time. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0102] In some embodiments, tactile outputs are distinct from movement of system 100. For example, system 100 can includes tactile output device(s) that move a moveable mass to generate tactile output and can include other moving part(s), such as motor(s), wheel(s), axel(s), control arm(s), and / or brakes that control movement of system 100. Although movement and / or cessation of movement of system 100 generates vibrations and / or other physical sensations in some situations, these vibrations and / or other physical sensations are distinct from tactile outputs. In some embodiments, system 100 generates tactile output independent from movement of system 100 For example, system 100 can generate a tactile output without accelerating, decelerating, and / or moving system 100 to a new position.
[0103] In some embodiments, system 100 detects gesture input(s) made by a user. In some embodiments, gesture input(s) includes touch gesture(s) and / or air gesture(s), as described herein. In some embodiments, touch-sensitive surface(s) 115 identify touch gestures based on contact patterns (e.g., different intensities, timings, and / or motions of objects touching or nearly touching touch-sensitive surface(s) 115). Thus, touch-sensitive surface(s) 115 detect a gesture by detecting a respective contact pattern. For example, detecting a finger-down event followed by detecting a finger-up (e.g., liftoff) event at (e.g., substantially) the same position as the finger- down event (e.g., at the position of a user interface element) can correspond to detecting a tap gesture on the user interface element. As another example, detecting a finger-down event followed by detecting movement of a contact, and subsequently followed by detecting a finger- up (e.g., liftoff) event can correspond to detecting a swipe gesture. Additional and / or alternative touch gestures are possible.
[0104] In some embodiments, an air gesture is a gesture that a user performs without touching input device(s) 158. In some embodiments, air gestures are based on detected motion of a portion (e.g., a hand, a finger, and / or a body) of a user through the air. In some embodiments, air gestures include motion of the portion of the user relative to a reference. Example references include a distance of a hand of a user relative to a physical object, such as the ground, an angle of an arm of the user relative to the physical object, and / or movement of a first portion (e.g., hand or finger) of the user relative to a second portion (e.g., shoulder, another hand, or another finger) of the user. In some embodiments, detecting an air gesture includes detecting absolute motion of the portion of the user, such as a tap gesture that includes movement of a hand in a 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) predetermined pose by a predetermined amount and / or speed, or a shake gesture that includes a predetermined speed or amount of rotation of a portion of the user.
[0105] In some embodiments, detecting one or more inputs includes detecting speech of a user. In some embodiments, system 100 uses one or more microphones of input device(s) 158 to detect the user speaking one or more words. In some embodiments, system 100 parses and / or communicates information to one or more other systems to determine contents of the speech of the user, including identifying words and / or obtaining a semantic understanding of the words. For example, system processor(s) 103 can be configured to perform natural language processing to detect one or more words and / or determine a likely meaning of the one or more words in the sequence spoken by the user. Additionally or alternatively, in some embodiments, the system 100 determines the meaning of the one or more words in the sequence spoken based upon a context of the user determined by the system 100.
[0106] In some embodiments, system 100 outputs spatial audio via output device(s) 160. In some embodiments, spatial audio is output in a particular position. For example, system 100 can play a notification chime having one or more characteristics that cause the notification chime to be generated as if emanating from a first position relative to a current viewpoint of a user (e.g., “spatializing” and / or “spatialization” including audio being modified in amplitude, filtered, and / or delayed to provide a perceived spatial quality to the user).
[0107] In some embodiments, system 100 presents visual and / or audio feedback indicating a position of a user relative to a current viewpoint of another user, thereby informing the other user about an updated position of the user. In some embodiments, playing audio corresponding to a user includes changing one or more characteristics of audio obtained from another computer system to mimic an effect of placing an audio source that generates the play back of audio within a position corresponding to the user, such as a position within a three-dimensional environment that the user moves to, spawns at, and / or is assigned to. In some embodiments, a relative magnitude of audio at one or more frequencies and / or groups of frequencies is changed, one or more filters are applied to audio (e.g., directional audio filters), and / or the magnitude of audio provided via one or more channels are changed (e.g., increased or decreased) to create the perceived effect of the physical audio source. In some embodiments, the simulated position of 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) the simulated audio source relative to a floor of the three-dimensional environment matches an elevation of a head of a participant providing audio that is generated by the simulated audio source, or is a predetermined one or more elevations relative to the floor of the three-dimensional environment. In some embodiments, in accordance with a determination that the position of the user will correspond to a second position, different from the first position, and that one or more first criteria are satisfied, system 100 presents feedback including generating audio as if emanating from the second position.
[0108] In some embodiments, system 100 communicates with one or more accessory devices. In some embodiments, one or more accessory devices is integrated with system 100. In some embodiments, one or more accessory devices is external to system 100. In some embodiments, system 100 communicates with accessory device(s) using RF circuitry(ies) 105 and / or using a wired connection. In some embodiments, system 100 controls operation of accessory device(s), such as door(s), window(s), lock(s), speaker(s), light(s), and / or camera(s). For example, system 100 can control operation of a motorized door of system 100. As another example, system 100 can control operation of a motorized window included in system 100. In some embodiments, accessory device(s), such as remote control(s) and / or other computer systems (e.g., smartphones, media players, tablets, computers, and / or wearable devices) functioning as input devices control operations of system 100. For example, a wearable device (e.g., a smart watch) functions as a key to initiate operation of an actuation system of system 100. In some embodiments, system 100 acts as an input device to control operations of another system, device, and / or computer, such as the system 100 functioning as a key to initiate operation of an actuation system of a platform associated with another system, device, and / or computer.
[0109] In some embodiments, digital assistant(s) help a user perform various functions using system 100. For example, a digital assistant can provide weather updates, set alarms, and perform searches locally and / or using a network connection (e.g., the Internet) via a natural- language interface. In some embodiments, a digital assistant accepts requests at least partially in the form of natural language commands, narratives, requests, statements, and / or inquiries. In some embodiments, a user requests an informational answer and / or performance of a task using the digital assistant. For example, in response to receiving the question “What is the current 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) temperature?,” the digital assistant answers “It is 30 degrees.” As another example, in response to receiving a request to perform a task, such as “Please invite my family to dinner tomorrow,” the digital assistant can acknowledge the request by playing spoken words, such as “Yes, right away,” and then send the requested calendar invitation on behalf of the user to each family member of the user listed in a contacts list for the user. In some embodiments, during performance of a task requested by the user, the digital assistant engages with the user in a sustained conversation involving multiple exchanges of information over a period of time. Other ways of interacting with a digital assistant are possible to request performance of a task and / or request information. For example, the digital assistant can respond to the user in other forms, e.g., displayed alerts, text, videos, animations, music, etc. In some embodiments, the digital assistant includes a client-side portion executed on system 100 and a server-side portion executed on a server in communication with system 100. The client-side portion can communicate with the server through a network connection using RF circuitry(ies)105. The client-side portion can provide client-side functionalities, input and / or output processing and / or communication with the server, for example. In some embodiments, the server-side portion provides server-side functionalities for any number client-side portions of multiple systems.
[0110] In some embodiments, system 100 is associated with one or more user accounts. In some embodiments, system 100 saves and / or encrypts user data, including files, settings, and / or preferences in association with particular user accounts. In some embodiments, user accounts are password-protected and system 100 requires user authentication before accessing user data associated with an account. In some embodiments, user accounts are associated with other system(s), device(s), and / or server(s). In some embodiments, associating one user account with multiple systems enables those systems to access, update, and / or synchronize user data associated with the user account. For example, the systems associated with a user account can have access to purchased media content, a contacts list, communication sessions, payment information, saved passwords, and other user data. Thus, in some embodiments, user accounts provide a secure mechanism for a customized user experience.
[0111] Attention is now directed towards embodiments of user interfaces (“UI”) and associated processes that are implemented on a computer system, such as system 100. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0112] FIGS.2A-2G illustrate exemplary user interfaces for controlling one or more electronic devices in accordance with some examples. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS.3A-3B and / or 4.
[0113] FIG.2A illustrates computer system 200, which is a smartphone and includes display 208 (e.g., a display component). However, it should be understood that the types of computer systems and components described herein are merely exemplary and are provided to give context to the examples described herein. In some embodiments, computer system 200 includes a knob, a dial, a joystick, touch-sensitive surface, button, a slider. In some embodiments, computer system 200 is a television, projector, monitor, a remote control, a head-mounted display (HMD) device, a smart display, laptop, and / or personal computer. In some embodiments, computer system 200 includes one or more components of system 100.
[0114] As illustrated in FIG.2A, computer system 200 displays controls user interface 204. Controls user interface 204 includes light control user interface object 212 and speaker control user interface object 214. Light control user interface object 212 corresponds to one or more light devices (e.g., external to computer system 200) (e.g., the one or more light devices are not integrated into computer system 200) that is in communication (e.g., wired and / or wireless (e.g., Wi-Fi, Bluetooth, and / or Ultra-Wideband) communication) with computer system 200. Further, speaker control user interface object 214 corresponds to one or more speaker devices (e.g., external to computer system 200) (e.g., the one or more speaker devices are not integrated into computer system 200) that are in communication (e.g., wired and / or wireless (e.g., Wi-Fi, Bluetooth, and / or Ultra-Wideband) communication) with computer system 200. In some embodiments, computer system 200, the one or more light devices that correspond to light control user interface object 212, and the one or more speaker devices that correspond to speaker control user interface object 214 are all coupled to a common external structure (e.g., a house, an apartment, an airplane, a boat, and / or a car). In some embodiments, the one or more light devices and the one or more speaker devices are integrated into computer system 200. In some embodiments, the one or more lights devices and / or speaker devices are other types of devices, such as smart windows, smart blinds, smart phones, smart watches, fitness tracking devices, smart thermostats, smart heaters, and / or smart air conditioners. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0115] At FIG.2A, light control user interface object 212 indicates the status of the one or more light devices, and speaker control user interface object 214 indicates the status of the one or more speaker devices. As illustrated in FIG.2A, light control user interface object 212 indicates that the one or more light devices are operating at 50% power. Further, as illustrated in FIG.2A, speaker control user interface object 214 indicates that the one or more speaker devices are not outputting audio corresponding to a media item. The display of light control user interface object 212 and speaker control user interface object 214 is dynamic. That is, the display of light control user interface object 212 and speaker control user interface object 214 update as the operation of the one or more speaker devices and / or the operation of the one or more light devices update (e.g., the brightness of the one or more light devices are changed and / or the volume of the playback of a media item on the one or more speaker devices is changed).
[0116] FIG.2A includes schematic 210, which is a visual aid that illustrates the orientation and location of computer system 200 relative to the orientation and location of the one or more light devices that correspond to light control user interface object 212 and the one or more speaker devices that correspond to speaker control user interface object 214. As illustrated in FIG.2A, schematic 210 includes representation of computer system 220, representation of one or more light devices 222, and representation of one or more speaker devices 224. The positioning and orientation of representation of computer system 220 corresponds to the positioning and orientation of computer system 200, the positioning and orientation of representation of light devices 222 corresponds to the positioning and orientation of the one or more light devices (e.g., that correspond to light control user interface object 212), and the positioning and orientation of representation of speaker device 224 corresponds to the positioning and orientation of the one or more speaker devices (e.g., that correspond to speaker control user interface object 214).
[0117] As illustrated in FIG.2A, schematic 210 also includes location indicator 228 and field-of-detection indicator 230. Field-of-detection indicator 230 corresponds to the field-of- detection of computer system 200 (e.g., field-of-view of one or more sensors, such as a camera; field-of-detection of one or more sensors, such as a microphone; and / or field-of-signal-transfer, such as a speaker and / or a wire signal generator), and location indicator 228 indicates the direction at which computer system 200 is directed. As illustrated in FIG.2A, schematic 210 depicts that neither representation of light devices 222 nor representation of one or more speaker 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) devices 224 is within field-of-detection indicator 230 and location indicator 228 is positioned between representation of light devices 222 and representation of one or more speaker devices 224. Accordingly, at FIG.2A, the one or more light devices and the one or more speaker devices are not within, the field-of-detection of computer system 200, and computer system 200 is directed to (e.g., directed at, pointed in the direction of, and / or center of the field-of-detection is directed to) a position that is in between the one or more light devices and the one or more speaker devices. In some embodiments, both representation of light device 222 and representation of representation of speaker device 224 are within field-of-detection indicator 230. In some examples location indicator 228 represents a gaze location of a user (e.g., where a user is looking at a point in time and / or where the user will be looking at a point in time and / or within a period of time). In some embodiments, field-of-detection indicator 230 represents the user’s field of view and / or a viewpoint of a head-mounted display device. In some embodiments, computer system 200 displays light control user interface object 212 and / or speaker control user interface object 214 in response to computer system 200 detecting that computer system 200 is directed to the one or more light devices and / or the one or more speaker devices. In some embodiments, computer system 200 displays light control user interface object 212 and speaker control user interface object 214 prior to a determination being made (e.g., by computer system 200) that computer system 200 is directed to the one or more light devices and / or the one or more speaker devices. In some embodiments, field-of-detection indicator 230 corresponds to the field-of-view of one or more cameras that are integrated into computer system 200. In some embodiments, field-of-detection indicator 230 corresponds to the field-of-detection of a user of computer system 200. At FIG.2A, computer system 200 is moved to the left within the physical environment.
[0118] At FIG.2B, after computer system 200 is moved (or moves) to the left within the physical environment, computer system 200 is directed to the one or more light devices that correspond to representation of light devices 222 (e.g., as illustrated by location indicator 228 in schematic 210). At FIG.2B, a determination is made that computer system 200 is directed to the one or more light devices for less than a predetermined period of time (e.g., 0.5, 1, 3, 5, 7, 10, 15, 20, 25, or 30 seconds). At FIG.2B, because a determination is made that computer system 200 is directed to the one or more light devices for less than the predetermined period of time, computer system 200 does not expand the display of light control user interface object 212. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0119] At FIGS.2C, as illustrated by schematic 210, computer system 200 remains directed to the one or more light devices that correspond to light control user interface object 212. At FIGS.2C, a determination is made that computer system 200 has been directed to the one or more light devices that correspond to light control user interface object 212 for the predetermined period of time (and / or, In some embodiments, for more than a predetermined period of time). At FIGS.2C, because a determination is made that computer system 200 has been directed to the one or more light devices for the predetermined period of time, computer system 200 expands the display of light control user interface object 212. Accordingly, as illustrated in FIGS.2C, computer system 200 displays light control user interface object 212 as expanded (e.g., in contrast to the non-expanded display of light control user interface object 212 at FIG.2B).
[0120] As illustrated in FIGS.2C, as a part of displaying light control user interface object 212 as expanded, computer system 200 displays power control user interface object 226 within light control user interface object 212. The display of power control user interface object 226 indicates that computer system 200 is configured to control the one or more light devices that correspond to light control user interface object 212. That is, as described in greater detail below, while computer system 200 displays power control user interface object 226, computer system 200 is configured to transmit one or more instructions to the one or more light devices. Computer system 200 transmits these instructions in response to detecting input on the power control user interface object 226. In some embodiments, in response to detecting that a user is gazing (e.g., via one or more external cameras) at the one or more light devices (and / or that computer system 200 is directed to one or more light devices), computer system 200 displays power control user interface object 226. In some embodiments, in response to detecting that a user is gazing at the one or more light devices (e.g., via one or more external cameras) (e.g., and computer system 200 does not detect that computer system is directed to the one or more light devices), computer system 200 displays power control user interface object 226.
[0121] At FIGS.2C, the display of power control user interface object 226 corresponds to the power level of the one or more light devices. As illustrated in FIGS.2C, computer system 200 displays power control user interface object 226 as halfway filled. Accordingly, at FIGS.2C, the one or more light devices are operating at 50% power. The display of power control user 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) interface object 226 is dynamic. That is, the display of power control user interface object 226 updates as the operation of the one or more light devices change (e.g., the brightness of the one or more light devices are changed).
[0122] At FIGS.2C, computer system 200 is moved to the right such that computer system 200 is no longer directed to the one or more light devices. In some embodiments, when computer system 200 is directed to both the one or more light devices and the one or more speaker devices for the predetermined amount of time, computer system 200 concurrently displays light control user interface object 212 and speaker control user interface object 214 as expanded. In some embodiments, computer system 200 does not expand the display of light control user interface object 212 in response to a determination that computer system 200 is directed to the one or more light devices for the predetermined period of time. In examples where computer system 200 does not expand the display of light control user interface object 212, computer system 200 displays power control user interface object 226 on a portion of display 208 that does not overlap with the display of light control user interface object 212 (e.g., computer system 200 displays power control user interface object 226 below or above light control user interface object 212). In some embodiments, computer system 200 ceases to display speaker control user interface object 214 as a part of expanding the display of light control user interface object 212. In some embodiments, computer system 200 expands speaker control user interface object 214 in response to detecting an input directed to speaker control user interface object 214 while computer system 200 remains directed to light devices 222. In some embodiments, computer system 200 continues to display light control user interface object 212 as unexpanded in response to computer system 200 detecting an input directed to speaker control user interface object 214 while computer system 200 remains directed to light devices 222.
[0123] At FIGS.2C, while computer system 200 is directed to the one or more light devices that correspond to light control user interface object 212, computer system 200 detects input 205c that corresponds to a swipe input on the display of power control user interface object 226. In some embodiments, input 205c can correspond to a tap input, swipe input, voice command, long press (e.g., tap and hold), a rotational input, a swipe input, an air gesture, a gaze input and / or hand gesture, mouse clicks, and / or head movement inputs. In some embodiments, other inputs described 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) below in relation to FIGS.2C-2F can alternatively be one or more other types of inputs, such as a rotational input, a swipe input, a tap input, an air gesture, a voice input, and / or a gaze input.
[0124] At FIG.2D, in response to detecting input 205c, computer system 200 transmits one or more instructions to the one or more light devices. The instructions correspond to the input 205c. Input 205c is a swipe from right to left that signifies that the user would like to decrease the power level of the one or more light devices by the amount indicated by the (length of the) swipe. The sent instructions then cause the power level of the one or more light devices to decrease by the amount indicated (e.g., from a 50% power level to a 25% power level). Accordingly, as illustrated in FIG.2D, computer system 200 displays power control user interface object 226 as a quarter filled (e.g., hatching fills a quarter of power control user interface object 226). As explained above, computer system 200 is configured to control the operation of the one or more light devices while computer system 200 displays power control user interface object 226. Put a different way, the display of power control user interface object 226 indicates that computer system 200 is configured to control the one or more light devices.
[0125] At FIG.2D, as illustrated by schematic 210, location indicator 228 is positioned between representation of one or more light devices 222 and representation of one or more speaker devices 224. Further, neither representation of one or more light devices 222 nor representation of one or more speaker devices 224 are within field-of-detection indicator 230. Accordingly, at FIG.2D, the one or more speaker devices and the one or more light devices are not in the field-of-detection of computer system 200 and computer system 200 is not directed to the one or more speaker devices nor the one or more light devices.
[0126] As illustrated in FIG.2D, computer system 200 displays power control user interface object 226 within light control user interface object 212. Accordingly, at FIG.2C, as explained above, computer system 200 is configured to control the one or more light devices that correspond to light control user interface object 212. Computer system 200 remains configured to control the one or more light devices though computer system 200 is not directed to the one or more light devices because computer system 200 detects input 205c (e.g., at FIG.2B) while the computer system 200 is directed to the one or more light devices. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0127] Computer system 200 remains configured to control the one or more light devices until computer system 200 makes a determination that computer system 200 and / or user attention is directed to a different external device (e.g., the one or more speaker devices) for the predetermined amount of time. In some embodiments, in response to detecting an input directed to computer system 200 at FIG.2D, computer system 200 causes the one or more light devices to be adjusted.
[0128] In some embodiments, computer system 200 ceases to be configured to control the one or more light devices when a determination is made that computer system 200 or the user’s attention (e.g., gaze) is not directed to the one or more light devices for a predetermined amount of time. In some embodiments, computer system 200 ceases to be configured to control the one or more light devices in response to computer system 200 detecting an input (e.g., a tap input, swipe input, voice command, long press (e.g., tap and hold), a rotational input, a swipe input, an air gesture, a gaze input and / or hand gesture, mouse clicks, and / or head movement inputs) while computer system 200 is not directed at the one or more light devices. In some embodiments, computer system 200 ceases to be configured to control the one or more light devices when a determination is made that a user has not gazed at the one or more light devices for a predetermined amount of time. In some embodiments, in response to detecting a different input than input 205c, computer system 200 displays one or more different options for controlling the one or more light devices. These options may be different from the slider presented via power control user interface object 226 at FIG.2D, such as one or more options that control one or more colors of one or more light devices 222 and / or one or more options that control whether the one or more light devices 222 turn on and / or turn off automatically based on one more conditions (e.g., time conditions, conditions of the environment (e.g., ambient light in the environment and / or temperature of the environment)). At FIG.2D, computer system 200 is moved to the right within the physical environment.
[0129] At FIG.2E, after computer system 200 is moved (or moves) to the right within the physical environment, computer system 200 is directed to the one or more speaker devices that correspond to representation of speaker devices 224 (e.g., as illustrated by location indicator 228 in schematic 210). At FIG.2E, a determination is made that computer system 200 is directed to the one or more speaker devices for less than the predetermined time period. At FIG.2E, because 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) a determination is made that computer system 200 is directed to the one or more speaker devices for less than the predetermined time, computer system 200 remains configured to control the operation of the one or more light devices that correspond to light control user interface object 212. Accordingly, as illustrated in FIG.2E, computer system 200 displays power control user interface object 226 within light control user interface object 212. In some embodiments, when computer system 200 does not detect an input while computer system 200 is directed to the one or more light devices, computer system 200 ceases to display power control user interface object 226 when a determination is made that computer system 200 is no longer directed to the one or more light devices. In some embodiments, computer system 200 is configured to control the one or more speaker devices when a determination is made that computer system 200 is directed to the one or more speaker devices (e.g., and not when a determination is made that computer system 200 is directed to the one or more speaker devices for greater than the predetermined period of time).
[0130] At FIG.2F, computer system 200 remains directed to the one or more speaker devices (e.g., as illustrated by location indicator 228 in schematic 210). At FIG.2F, a determination is made (e.g., by computer system 200) that computer system 200 has been directed to the one or more speaker devices for the predetermined time period (and / or for more than the predetermined period of time). Because a determination is made that computer system 200 has been directed to the one or more speaker devices for the predetermined time period, computer system 200 expands display of speaker control user interface object 214. As illustrated in FIG.2F, as part of expanding the display of speaker control user interface object 214, computer system 200 displays playback controls user interface object 234 within speaker control user interface object 214.
[0131] Like power control user interface object 226, the display of playback controls user interface object 234 indicates that computer system 200 is configured to control the one or more speaker devices. That is, while computer system 200 displays playback controls user interface object 234, computer system 200 can control the playback of the one or more speaker devices. Computer system 200 transmits one or more instructions to the one or more speaker devices that cause the playback status of the one or more speaker devices (e.g., adjusts the volume of the playback of a media item, pause the playback of a media item, proceed to a different media item in a queue, and / or initiate the playback of a media item) to be modified in response to computer 52 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) system 200 detecting an input that corresponds to selection of playback controls user interface object 234. In some embodiments, as a part of displaying speaker control user interface object 214 as expanded, computer system 200 ceases to display light control user interface object 212. In some embodiments, computer system 200 does not detect an input while computer system 200 is directed to the one or more speaker devices. In examples where computer system 200 does not detect an input while computer system 200 is directed to the one or more speaker devices, computer system 200 ceases to display playback controls user interface object 234 when a determination is made that computer system 200 (and / or user attention) is no longer directed to the one or more speaker devices. In examples where computer system 200 does not detect an input while computer system 200 is directed to the one or more speaker devices, computer system 200 does not display an indication that computer system 200 is configured to control the one or more speaker devices when a determination is made that computer system 200 is directed to a direction that does not correspond to the location of the one or more speaker devices.
[0132] At FIG.2G, computer system 200 remains directed to the one or more speaker devices (e.g., as illustrated by location indicator 228 in schematic 210). At FIG.6G, a determination is made (e.g., by computer system 200) that computer system 200 has remained inactive (e.g., computer system 200 has not detected a particular type of input and / or any inputs and / or computer system 200 is in a sleep mode) for more than a threshold period of inactivity (e.g., .5-60 minutes) while computer system 200 is directed to the one or more speaker devices. Because a determination is made that computer system 200 has remained inactive for more than the threshold period of inactivity while computer system 200 is directed to the one or more speaker devices, computer system 200 ceases displaying speaker control user interface object 214 as expanded.
[0133] In some embodiments, computer system 200 displays a set of controls on a particular side of display 208 of computer system 200 based on detecting input (and / or an intent to control). In some embodiments, the input corresponds to the particular side of display 208 (as illustrated in FIG.2A) on which the set of controls are displayed. In some embodiments, the computer system 200 detects an input directed to the right side of computer system 200 and displays a set of controls along the right side of display 208 of computer system 200 without displaying one or more controls along the left side of display 208 of computer system 200. In 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) some embodiments, computer system 200 detects an input directed to the left of computer system 200 and displays the set of controls along the left side of display 208 of computer system 200 without displaying one or more controls along the right side of display 208 of computer system 200. Thus, in some embodiments, the set of controls are only displayed on the particular side of display 208 based on which side the input is directed. More information will be provided below corresponding the type of input and / or the set of controls.
[0134] In some embodiments, computer system 200 displays the set of one or more controls on a particular side of display 208 in response to detecting an intent to control computer system 200 and / or in response to detecting that computer system 200 is being used to change one or more operations at an external device. In some embodiments, the intent to control is detected in response to detecting an air gesture that is directed to a particular side of computer system 200 and / or within a predetermined distance (e.g., 0.1-5 meters) from a display (e.g., display 208 and / or a display that is external to computer system 200). In some embodiments, the intent to control is detected in response to detecting an input, e.g., a touch input, that is directed to the particular side of display 208. In some embodiments, the intent to control is detected in response to detecting that the gaze of a user is directed to a particular side and / or area of computer system 200 and / or within a predetermined distance (e.g., 0.1-5 meters) from a particular side and / or area of computer system 200. In some embodiments, the intent to control is detected in response to detecting that a hand and / or another body part of the user is directed to an area and / or side of computer system 200. In some embodiments, the intent to control is detected in response to detecting that the user is in a certain position (e.g., sitting, standing, and / or kneeling) relative to computer system 200 and / or an external structure (e.g., passenger side, driver side, back side, and / or front side).
[0135] In some embodiments, the set of controls are controls for controlling a particular region of a display of an external structure. In some of these examples, the state of one or more external devices that are located and / or directed to the left side of the external structure (e.g., a set of blinds on a left side of a house, driver’s side light, a driver’s side vent, and / or a driver’s side window) is modified in response to the detection of the selection a set of controls displayed on the left side of display 208, while the state of one or more external devices that are located and / or directed to the right side of the external structure is modified in response to the detection 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) of the selection of a set of controls displayed on the right side of display 208 In some embodiments, controls on the right side of display 208 and controls on the left side of display 208 include a common control that is used to control the same device, such as a sound system and / or an air conditioning device. In some of these examples, this same device is a device can be a local device or a global device. In some embodiments, a global device is directed to multiple areas of a physical environment and / or sides of computer system 200. In some embodiments, a local device is directed to one side of computer system 200 and / or a single area of a physical environment. In some embodiments, the set of controls are displayed on a particular side of computer system 200 until the input is no longer detected and / or directed to the side of computer system 200 for a predetermined period of time. In some embodiments, selection of one or more of the controls causes computer system 200 to change the state of an external device (e.g., local and / or global device) that corresponds to the selected control.
[0136] FIGS.3A-3B is a flow diagram illustrating a method (e.g., process 300) for controlling one or more electronic devices in accordance with some examples. Some operations in process 300 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.
[0137] As described below, process 300 provides an intuitive way for controlling one or more electronic devices. Process 300 reduces the cognitive burden on a user for controlling one or more electronic devices, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to control one or more electronic devices faster and more efficiently conserves power and increases the time between battery charges.
[0138] In some embodiments, process 300 is performed at a computer system (e.g., 200) that is in communication with a display component (e.g., 208) (e.g., a display screen and / or a touch- sensitive display). In some embodiments, the computer system is a watch, a phone, a tablet, a processor, a head-mounted display (HMD) device, and / or a personal computing device. In some embodiments, the computer system is in communication with one or more cameras (e.g., one or more telephoto, wide angle, and / or ultra-wide-angle cameras). In some embodiments, the computer system is in communication with one or more input devices (e.g., a physical input mechanism (e.g., a hardware input mechanism, a rotatable input mechanism, a crown, a knob, a 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) dial, a physical slider, and / or a hardware button), a camera, a touch-sensitive display, a microphone, and / or a button). In some embodiments, the display component is included in the computer system. In some embodiments, the display component is not included in the computer system and is not included the respective device. In some embodiments, the computer system is a remote that includes a display.
[0139] The computer system detects (302) that the computer system (e.g., 200) is being pointed in a direction of a first device (e.g., 222 and / or 224) (e.g., a watch, a phone, a tablet, a display, a fan, a thermostat, a window, a door, and / or speaker) for at least a predetermined period of time (e.g., as described above in relation to FIGS.2C).
[0140] In response to detecting that the computer system (e.g., 200) is being pointed in the direction of the first device (e.g., 222 and / or 224) for at least the predetermined period of time (e.g., as described above in relation to FIGS.2C) (e.g., 1-10 seconds), the computer system displays (304), via the display component (e.g., 208), an indication that the computer system is configured to control the first device (e.g., as described in relation to FIGS.2C and 2F). In some embodiments, the indication includes a representation (e.g., textual representation, a graphical representation, and / or a symbol) of the first device. In some embodiments, the first region and the second region are regions of the same surface.
[0141] While displaying the indication that the computer system (e.g., 200) is configured to control the first device (e.g., 222 and / or 224), the computer system detects (306) that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction (e.g., as described above in relation to FIGS.2D and 2E).
[0142] In response to (308) detecting that the computer system is being pointed in the second direction for at least the predetermined period of time and in accordance with (310) a determination that the second direction is a direction of a second device (e.g., 222 and / or 224) (e.g., a watch, a phone, a tablet, a display, a fan, a thermostat, a window, a door, and / or speaker) that can be controlled by the computer system (e.g., 200) and an input (e.g., 205c) (e.g., a selection input and / or a tap input) (and, in some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) flicking air gesture)) was detected by the computer system while the computer system was pointed in the first direction, the computer system displays (312), via the display component (e.g., 208), an indication (e.g., as described above in relation to FIG.2F) (e.g., a graphical indication, a textual indication, and / or a symbolic indication) that the computer system (e.g., 200) is configured to control the second device (e.g., 222 and / or 224), wherein the second device is different from (e.g., different graphical representation / indication, different textual representation / indication., and / or different symbolic representation / indication) the first device (e.g., 222 and / or 224).
[0143] In response to (308) detecting that the computer system is being pointed in the second direction for at least the predetermined period of time and in accordance with (310) the determination that the second direction is the direction of the second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction, the computer system ceases (314) display of the indication that the computer system (e.g., 200) is configured to control the first device (e.g., 222 and / or 224).
[0144] In response to (308) detecting that the computer system is being pointed in the second direction for at least the predetermined period of time and in accordance with (316) a determination that the second direction is not a direction of a respective device (e.g., the second device and / or another device) that can be controlled by the computer system (e.g., 200) (e.g., as described above in relation to FIG.2D) and the input (e.g., 205c) was detected by the computer system while the computer system was pointed in the first direction, the computer system continues to display the indication that the computer system is configured to control the first device (e.g., 222 and / or 224) (e.g., as described above in relation to FIG.2D) (e.g., without displaying the indication that the computer system is configured to control the second device). In some embodiments, the indication that the computer system is configured to control the first device continues to be displayed while the computer system is determined to be pointed at another device that can be controlled by the computer system for less than the predetermined period of time (e.g., 1-120 seconds) when the input was detected by the computer system while the computer system was pointed in the first direction. In response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) while displaying the indication that the computer system is configured to control the first device, selectively continuing to display the indication that the computer system is configured to control the first device allows the computer system to selectively continue to be able to control the first device and to display such, thereby providing improved visual feedback to the user, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0145] In some embodiments, while displaying, via the display component (e.g., 208), the indication that the computer system (e.g., 200) is configured to control the first device (e.g., 222 and / or 224) (e.g., as described above in relation to FIGS.2C) (and, in some embodiments, while detecting that the computer system is being pointed in the direction of the first device), the computer system detects a first input (e.g., 205c) directed to the computer system. In some embodiments, in response to detecting the first input directed to the computer system, the computer system causes a characteristic of the first device to be adjusted (e.g., as described above in relation to FIG.2D) (e.g., without causing a characteristic of the second device to be adjusted). Causing the characteristic of the first device to be adjusted in response to detecting the first input directed to the computer system allows the computer system to control a state of the characteristic of the first device, thereby providing additional control options without cluttering the user interface with additional displayed controls and / or performing an operation when a set of conditions has been met without requiring further user input.
[0146] In some embodiments, while displaying, via the display component (e.g., 208), the indication that the computer system (e.g., 200) is configured to control the second device (e.g., 222 and / or 224) (e.g., as described above in relation to FIGS.2C and 2F) (and, in some embodiments, while detecting that the computer system is being pointed in the direction of the second device), the computer system detects a second input (e.g., 205c) directed to the computer system. In some embodiments, in response to detecting the second input directed to the computer system, the computer system causes a characteristic of the second device to be adjusted (e.g., as described in relation to FIGS.2D and 2F) (e.g., without causing a characteristic of the first device to be adjusted). Causing the characteristic of the second device to be adjusted in response to detecting the second input directed to the computer system allows the computer system to 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) control a state of the characteristic of the second device, thereby providing additional control options without cluttering the user interface with additional displayed controls and / or performing an operation when a set of conditions has been met without requiring further user input.
[0147] In some embodiments, the first device (e.g., 222 and / or 224) is a first type (e.g., a watch, a phone, a tablet, a display, a fan, a thermostat, a window, a door, and / or speaker) of device. In some embodiments, the second device (e.g., 222 and / or 224) is a second type of device that is different from the first type of device (e.g., as described above in relation to FIG. 2A). Having the computer system control different types of devices by pointing at different devices allows the computer system to intuitively, quickly, and / or easily control the different types of devices, thereby providing additional control options without cluttering the user interface with additional displayed controls and / or performing an operation when a set of conditions has been met without requiring further user input.
[0148] In some embodiments, while displaying the indication that the computer system (e.g., 200) is configured to control the first device (e.g., 222 and / or 224) (e.g., as described above in relation to FIGS.2C and 2F), the computer system is configured to control a first type of characteristic of the first device. In some embodiments, while displaying the indication that the computer system is configured to control the second device (e.g., 222 and / or 224), the computer system is configured to control a second type of characteristic of the second device. In some embodiments, the first type of characteristic is different from the second type of characteristic (e.g., position of a window and / or door, tint of a window and / or door, output of a fan, output of a heating element, output of a speaker, and / or configuration of a thermostat) (e.g., as described above in relation to FIGS.2C and 2F). Configuring the computer system to control different types of characteristics of the first device and the second device allows the computer system to intuitively, quickly, and / or easily control the different types of characteristics, thereby providing additional control options without cluttering the user interface with additional displayed controls and / or performing an operation when a set of conditions has been met without requiring further user input.
[0149] In some embodiments, the computer system displays, via the display component (e.g., 208), a plurality of controls (e.g., 212 and / or 214), wherein the indication that the computer 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) system (e.g., 200) is configured to control the first device (e.g., 222 and / or 224) is not displayed in an area (e.g., an area on a user interface of an application and / or a user interface on the application) that includes the plurality of controls, and wherein the indication that the computer system is configured to control the second device (e.g., 222 and / or 224) is not displayed in the area that includes the plurality of controls. In some embodiments, display of the indication that the computer system is configured to control the second device replaces display of the indication that the computer system is configured to control the first device, in accordance with a determination that the second direction is the direction of the second device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction. In some embodiments, the plurality of controls is displayed on / near a first side and on / near a first edge of a display while the indication that the computer system is configured to control the first device and / or the indication that the computer system is configured to control the first device is displayed on / near a second side and / or edge of the display that is different from the first side and / or edge. Displaying the indications that the computer system is configured to control the first device and the second device in an area that is different from where the plurality of controls are displayed allows for the computer system to maintain the area where the plurality of controls are displayed while still displaying the indications in different locations, thereby providing improved visual feedback to the user, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0150] In some embodiments, in accordance with a determination that the second direction is not in a direction of a respective device that can be controlled by the computer system (e.g., 200) (e.g., as described above in relation to FIG.2D) and the input was not detected by the computer system while the computer system was pointed in the first direction, the computer system ceases to display the indication that the computer system is configured to control the first device (e.g., 222 and / or 224) (e.g., as described above in relation to FIG.2D) (and, In some embodiments, the computer system does not display the indication that the computer system is configured to control the second device, wherein the second device is different from the first device). Ceasing to display the indication that the computer system is configured to control the first device in accordance with the determination that the second direction is not in a direction of a respective 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) device that can be controlled by the computer system and the input was not detected by the computer system while the computer system was pointed in the first direction allows the computer system to change what is displayed to be related to what the computer system determines to be what a user wants, thereby providing improved visual feedback to the user, reducing the number of inputs needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0151] In some embodiments, in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system (e.g., 200) (e.g., as described above in relation to FIG.2D) and the input (e.g., 205c) was not detected by the computer system while the computer system was pointed in the first direction, the computer system forgoes displaying an indication that the computer system is configured to control a respective device (e.g., any device and any indication) (e.g., as described above in relation to FIG.2D). Not displaying the indication that the computer system is configured to control a respective device in accordance with the determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was not detected by the computer system while the computer system was pointed in the first direction allows the computer system to display what the computer system determines to be what a user wants to control (and if the computer system determines that the user does not want to control anything then it does not display any indications for controlling devices), thereby providing improved visual feedback to the user, reducing the number of inputs needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0152] Note that details of the processes described above with respect to process 300 (e.g., FIGS.3A-3B) are also applicable in an analogous manner to other methods described herein. For example, process 400 optionally includes one or more of the characteristics of the various methods described above with reference to process 300. For example, a computer system can display an indication that the computer system is configured to control a respective device using 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) one or more techniques described above in relation to process 300 while the computer system displays the first set of one or more controls or the second set of one or more controls using the one or more techniques described above in relation to 400.
[0153] FIG.4 is a flow diagram illustrating a method (e.g., process 400) for displaying controls in accordance with some examples. Some operations in process 400 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.
[0154] As described below, process 400 provides an intuitive way for displaying controls. Process 400 reduces the cognitive burden on a user for displaying controls, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to display controls faster and more efficiently conserves power and increases the time between battery charges.
[0155] In some embodiments, process 400 is performed at a computer system (e.g., 200) that is in communication with a display component (e.g., 208) (e.g., a display screen and / or a touch- sensitive display) and one or more input devices (e.g., a physical input mechanism (e.g., a hardware input mechanism, a rotatable input mechanism, a crown, a knob, a dial, a physical slider, and / or a hardware button), a camera, a touch-sensitive display, a microphone, and / or a button). In some embodiments, the computer system is a watch, a phone, a tablet, a processor, a head-mounted display (HMD) device, and / or a personal computing device. In some embodiments, the computer system is in communication with one or more cameras (e.g., one or more telephoto, wide angle, and / or ultra-wide-angle cameras).
[0156] The computer system detects (402) an intent to control (e.g., a body part (e.g., a hand), a pointer, and / or gaze that is within a predetermined distance away from the display and / or an air gesture and / or gaze that is directed to the display and / or a position that is within a predetermined distance from the display) a display (e.g., of the display component and / or the display) (e.g., as described above in relation to description following FIG.2G).
[0157] In response to (404) detecting the intent to control the display and in accordance with (406) a determination that the intent to control is directed to a first portion of the display, the 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) computer system displays (, via the display component (e.g., 208), a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, (e.g., via a tap input) (and, in some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)) causes (e.g., via the computer system) a first device that is associated with a first region (e.g., of a display, the computer system, an area, a region, a container, and / or a room) and not a second region (e.g., of a display, the computer system, an area, a region, a container, and / or a room) to perform a first operation (e.g., as described above in relation to description following FIG.2G).
[0158] In response to (404) detecting the intent to control the display and in accordance with (408) a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, the computer system displays , via the display component (e.g., 208), the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected (e.g., via a tap input) (and, in some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)), causes (e.g., via the computer system) a second device that is associated with the second region (e.g., of the computer system and / or of an area) and not the first region to perform a second operation (e.g., as described above in relation to description following FIG.2G). In some embodiments, the first set of one or more controls does not include the second control and / or a control that, when selected, causes a device that is associated with the second region to perform an operation (e.g., the first operation, the second operation, and / or another operation). In some embodiments, the second set of one or more controls does not include the first control and / or a control that, when selected, causes a device that is associated with the first region to perform an operation (e.g., the first operation, the second operation, and / or another operation). In some embodiments, the first operation is different from the second operation. In some embodiments, the first operation is the same as the first operation. In some embodiments, the second control is different from the first control. In some embodiments, the first control is displayed with a value corresponding to the first device and the second control is displayed with a value corresponding to the second device. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) In some embodiments, the value corresponding to the first device is different from the value corresponding to the second device. Selectively displaying different sets of one or more controls in different portions of the display allows for the computer system to intelligently and / or contextually display controls to a user in portions in which the computer system determines to be better for the user, thereby providing improved visual feedback to the user, reducing the number of inputs needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0159] In some embodiments, the first operation and the second operation are a same (e.g., a same type of operation) operation (e.g., as described above in relation to description following FIG.2G). In some embodiments, the first operation is the second operation. In some embodiments, the first operation includes the second operation. In some embodiments, the second operation includes the first operation.
[0160] In some embodiments, the first portion of the display is closer to (e.g., closer in distance and / or proximity) the first region than the second portion of the display. In some embodiments, the second portion of the display is closer to the second region than the first portion of the display (e.g., as described above in relation to description following FIG.2G). Displaying a set of one or more controls closer to a region in which it is determined that the user intends to control allows for the user to more easily and / or quickly interact with the set of one nor more controls, thereby reducing the time needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0161] In some embodiments, the first set of one or more controls includes a respective control (e.g., a volume control, a speaker controls, and / or a global control that, when selected, causes output that impacts the first region and the second region) (e.g., as described above in relation to description following FIG.2G). In some embodiments, the second set of one or more controls includes the respective control (e.g., as described above in relation to description following FIG.2G). In some embodiments, the respective control is initially displayed as being 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) selected when the first set of one or more controls is displayed and when the second set of one or more controls is displayed (e.g., as described above in relation to description following FIG.2G). Including the same control in the first region and the second region as selected allows for the computer system to surface what it believes is what the user wishes to interact with regardless of a region in which it is determined that the user intends to control, thereby reducing the number of inputs needed to perform an operation, reducing the time needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0162] In some embodiments, while displaying the respective control, the computer system detects an input (e.g., a tap input) (and, in some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)) directed to the respective control (e.g., as described above in relation to description following FIG.2G). In some embodiments, in response to detecting the input directed to the respective control, the computer system causes output of a respective device to change, wherein the respective device is associated with the first and the second region (e.g., as described above in relation to description following FIG.2G). In response to detecting the input directed to the respective control, causing output of the respective device to change allows for a user to control devices associated with multiple regions (e.g., the first region and the second region), thereby reducing the number of inputs needed to perform an operation, reducing the time needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0163] In some embodiments, displaying the respective control as being selected includes displaying, via the display component (e.g., 208), the respective control with a first brightness level concurrently with displaying a non-selected control (e.g., of the first set of one or more controls and / or of the second set of one or more control) with a second brightness level that is lower than the first brightness level (e.g., as described above in relation to description following FIG.2G). Displaying selected controls at a higher brightness level than unselected controls allows for a user to quickly and / or certainly distinguish between which control is selected, 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) thereby providing improved visual feedback to the user, reducing the number of inputs needed to perform an operation, reducing the time needed to perform an operation, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0164] In some embodiments, in response to detecting the intent to control the display and in accordance with a determination that the intent to control is directed to a third portion of the display that is different from the first portion and the second portion of the display, the computer system displays, via the display component (e.g., 208), a third set of one or more controls in the third portion of the display without displaying the first set of one or more controls and the second set of controls (e.g., as described above in relation to description following FIG.2G). In some embodiments, the third set of one or more controls includes a third control that, when selected, causes (e.g., via the computer system) a third device that is associated with the third region (e.g., of the computer system and / or of an area) and not the first region and second region to perform a third operation (e.g., as described above in relation to description following FIG.2G). Displaying the third set of one or more controls in the third portion of the display without displaying the first set of one or more controls and the second set of controls allows for the computer system to intelligently and / or contextually display controls to a user in portions in which the computer system determines to be better for the user, thereby providing improved visual feedback to the user, reducing the number of inputs needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0165] In some embodiments, after detecting the intent to control the display and in accordance with a determination that the intent to control the display has not been detected for a predetermined period of time (e.g., 1-60 seconds), the computer system forgoes displaying the first set of one or more controls and the second set of one or more controls (e.g., and / or ceasing to the display the first set of one or more controls if the first set of one or more controls were displayed in response to detecting the intent to control or ceasing to the display the second set of one or more controls if the second set of one or more controls were displayed in response to detecting the intent to control) (e.g., as described above in relation to description following FIG. 2G). In some embodiments, in accordance with a determination that the intent to control the 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) display has been detected for the predetermined period of time, the computer system continues displaying the first set of one or more controls and / or the second set of one or more controls. In some embodiments, while displaying the first set of one or more controls, the computer system detects a second intent to control the display that is different from the intent to control the display (and, in some embodiments, while detecting the intent to control the display), and in response to detecting the second intent to control the display and in accordance with a determination that the intent to control is directed to the first portion of the display that is different from the second portion of the display, the computer system concurrently displays the second set of one or more controls and the second set of one or more controls (e.g., as described above in relation to description following FIG.2G). In accordance with the determination that the intent to control the display has not been detected for the predetermined period of time, forgoing displaying the first set of one or more controls and the second set of one or more controls allows the computer system to selectively display different sets of one or more controls based on whether it is determined that the user has an intent to control, thereby providing improved visual feedback to the user, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0166] In some embodiments, detecting the intent to control the display includes detecting a gaze of the user that is directed to a second respective region (e.g., first region, second region, and / or a different region). Detecting the gaze of the user to detect the intent to control allows for such detection to be performed with minimal and / or less user action (e.g., than actual pressing of a button), thereby reducing the number of inputs needed to perform an operation, reducing the time needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0167] In some embodiments, detecting the intent to control the display includes detecting a body part (e.g., hand, arm, foot, and / or finger) of a user that is directed to a second respective region (e.g., first region, second region, and / or a different region). Detecting the body part of the user to detect the intent to control allows for such detection to be performed when a user is about to and / or in a position to want to perform the operations, thereby providing improved visual 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) feedback to the user, reducing the number of inputs needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0168] In some embodiments, detecting the intent to control the display includes detecting an air gesture (e.g., that is, in some embodiments, directed to a second respective region (e.g., first region, second region, and / or a different region)).
[0169] In some embodiments, detecting the intent to control the display includes detecting that a user is in a position (e.g., a sitting position, a standing position, and / or a kneeling position). In some embodiments, the position is location in a physical environment. In some embodiments, the position is a type of position. Detecting that the user is in the position to detect the intent to control allows for such detection to be catered and / or specific to particular contexts (e.g., based on the position), thereby providing improved visual feedback to the user, reducing the number of inputs needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation when a set of conditions has been met without requiring further user input.
[0170] Note that details of the processes described above with respect to method 400 (e.g., FIG.4) are also applicable in an analogous manner to the methods described herein. For example, method 300 optionally includes one or more of the characteristics of the various methods described above with reference to method 400. For example, a computer system can display an indication that the computer system is configured to control a respective device using one or more techniques described above in relation to method 300 while the computer system displays the first set of one or more controls or the second set of one or more controls using the one or more techniques described above in relation to 400.
[0171] FIGS.5A-5E illustrate exemplary user interfaces for displaying controls in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS.6A-6B. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0172] FIG.5A illustrates computer system 500. As illustrated in FIG.5A, computer system 500 is a smartwatch and includes display 504 (e.g., a display component) and rotatable input mechanism 516. However, it should be understood that the types of computer systems and components described herein are merely exemplary and are provided to give context to the embodiments described herein. In some embodiments, computer system 500 includes a knob, a dial, a joystick, a touch-sensitive surface, a button, a slider, a television, a projector, a monitor, a smart display, a laptop, and / or a personal computer. In some embodiments, display 504 is positioned within rotatable input mechanism 516. In some embodiments, display 504 is positioned above or below rotatable input mechanism 516. In some embodiments, display 504 is positioned around rotatable input mechanism 516. In some embodiments, rotatable input mechanism 516 is positioned on the surface of display 504.
[0173] As illustrated in FIG.5A, computer system 500 displays controls user interface 502. At FIG.5A, controls user interface 502 includes fan value user interface object 510, temperature value user interface object 512, and volume value user interface object 514. Fan value user interface object 510 corresponds to a fan device, temperature value user interface object 512 corresponds to an air conditioning device (e.g., a device that is capable of heating and cooling a space), and volume value user interface object 514 corresponds to one or more speaker devices. In some embodiments, computer system 500, the fan device, the air conditioning device, and the one or more speaker devices are coupled to a common external structure (e.g., an airplane, car, bus, boat, and / or home). In some embodiments, the fan device, the air conditioning device, and the one or more speaker devices are integrated into computer system 500. In some embodiments, the fan device, the air conditioning device, and the one or more speaker devices are external to computer system 500. In some embodiments, computer system 500 displays fan value user interface object 510, temperature value user interface object 512, and volume value user interface object 514 around rotatable input mechanism 516.
[0174] Fan value user interface object 510 includes a numerical representation that indicates the current setting of the fan device (e.g., the output of the fan), temperature value user interface object 512 includes a numerical representation that indicates the current temperature setting of the air conditioning device, and volume value user interface object 514 includes a numerical representation of the volume level of the one or more speaker devices. As illustrated in FIG.5A, 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) fan value user interface object 510 indicates that the setting of the fan device is set to three, temperature value user interface object 512 indicates that the temperature setting of the air conditioning device is set to 70 degrees, and volume value user interface object 514 indicates that the one or more speaker devices are set to a volume level of forty.
[0175] Further, as illustrated in FIG.5A, computer system 500 displays fan scale user interface object 518. Computer system 500 displays fan scale user interface object 518 as a series of dots that form a circle. Each dot in the series of dots corresponds to a respective fan level of the fan device. The number of dots that are connected indicates the current fan level of the fan device. As illustrated in FIG.5A, computer system 500 displays fan scale user interface object 518 with three circles connected. Accordingly, at FIG.5A, the fan device is operating at level 3.
[0176] As illustrated in FIG.5A, computer system 500 displays fan value user interface object 510 as a smooth curve (e.g., an arc). The degree of the curve of fan value user interface object 510 corresponds to the fan setting of the fan device. The higher the value of the fan setting of the fan device, the larger the degree of the curve of fan value user interface object 510. This description of fan value user interface object is also applicable to temperature value user interface object 512 and volume value user interface object 514. In some embodiments, in response to computer system 500 detecting a rotation of rotatable input mechanism 516 while computer system 500 displays fan scale user interface object 518, computer system 500 transmits instructions to the fan device that cause the operation of the fan device to adjust. In embodiments where computer system 500 transmits instructions to the fan device that adjust the operation of the fan device, the power of the fan increases when computer system 500 detects that rotatable input mechanism 516 is rotated in a first direction (e.g., a clockwise direction) and the power of the fan decreases if computer system 500 detects that rotatable input mechanism 516 is rotated in a second direction (e.g., counterclockwise).
[0177] As illustrated in FIG.5A, computer system 500 displays enlarged fan control user interface object 520 and fan value indicator 520a. Like fan value user interface object 510, enlarged fan control user interface object 520 corresponds to the fan device. Computer system 500 displays enlarged fan control user interface object 520 as a horizontal line graph with several tick marks. Each tick mark corresponds to a respective fan setting of the fan device. Fan value 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) indicator 520a indicates the current fan setting of the fan device. At FIG.5A, because the fan device is operating at the third fan level, computer system 500 displays fan value indicator 520a as overlaid on top of the tick mark that corresponds to the third fan setting.
[0178] At FIG.5A, computer system 500 detects input 505a1 that corresponds to selection of temperature value user interface object 512 or computer system 500 detects input 505a2 that corresponds to selection of volume value user interface object 514. In some embodiments, computer system 500 displays enlarged fan control user interface object 520 in response to computer system 500 detecting an input that corresponds to selection of fan value user interface object 510. In some embodiments, inputs 505a2 and 505a1 correspond to a depression and / or rotation of rotatable input mechanism 516, voice command, swipe gesture, tap gesture, hand gesture and / or a gaze. In some embodiments, while computer system 500 displays enlarged fan control user interface object 520, computer system 500 outputs a continuous haptic output while computer system 500 detects an input that corresponds to a rotation of rotatable input mechanism 516. In some embodiments, computer system 500 outputs a single discrete haptic output in response to computer system 500 detecting input 505a1 and / or 505a2. In some embodiments, input 505a1 and / or input 505a2 is a rotation of rotatable input mechanism 516, depression of rotatable input mechanism 516, slide gesture, tap gesture, voice command, and / or gaze.
[0179] FIGS.5B and 5C illustrate the behavior of computer system 500 in response to computer system 500 detecting input 505a1 or 505a2. More specifically, FIG.5B illustrates the behavior of computer system 500 in response to computer system 500 detecting input 505a2 and FIG.5C illustrates the behavior of computer system 500 in response to computer system 500 detecting input 505a1. Either FIG.5B or FIG.5C can follow FIG.5A.
[0180] As illustrated in FIG.5B, in response to computer system 500 detecting input 505a2, computer system 500 displays enlarged volume control user interface object 528 and ceases to display enlarged fan control user interface object 520 and fan scale user interface object 518. Enlarged volume control user interface object 528 corresponds to the one or more speaker devices (e.g., that correspond to volume value user interface object 514).
[0181] As illustrated in FIG.5B, enlarged volume control user interface object 528 includes volume indicator 528a and numerical representation 528b. Volume indicator 528a and numerical 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) representation 528b indicate the current volume level of the one or more speaker devices. Computer system 500 displays volume indicator 528a with a different appearance than fan value indicator 520a (e.g., as shown in FIG.5A). That is, computer system 500 displays volume indicator 528a as an arrow and computer system 500 displays fan value indicator 520a as a dot.
[0182] Further, as illustrated in FIG.5B, in response to computer system 500 detecting input 505a2, computer system 500 displays volume scale user interface object 530 around volume value user interface object 514. Volume scale user interface object 530 corresponds to the range of volume levels of the one or more speaker devices. Computer system 500 does not display a respective scale around fan value user interface object 510 and temperature value user interface object 512 while computer system 500 displays volume scale user interface object 530 around the display of volume value user interface object 514.
[0183] Computer system 500 displays volume scale user interface object 530 with a different visual appearance than fan scale user interface object 518 (e.g., computer system 500 displays fan scale user interface object 518 as a series of dots in a circle and computer system 500 displays volume scale user interface object 530 as a series of connected / adjacent quadrilaterals). In some embodiments, computer system 500 does not display enlarged volume control user interface object 528 in response to detecting input 505a1. In some embodiments, computer system 500 transmits instructions to the one or more speaker devices that modify the volume level of the one or more speaker devices in response to computer system 500 detecting an input (e.g., a slide gesture) that corresponds to selection of volume indicator 528a and / or numerical representation 528b. In some embodiments, while computer system 500 displays enlarged volume control user interface object 528, computer system 500 outputs a continuous haptic output while computer system 500 detects an input that corresponds to a rotation of rotatable input mechanism 516 (e.g., computer system 500 outputs a different type of haptic output in response to computer system 500 detecting a rotation of rotatable input mechanism 516 while computer system 500 displays enlarged fan control user interface object 520 than when computer system 500 detects an input that corresponds to a rotation of rotatable input mechanism 516 while computer system 500 displays enlarged volume control user interface object 528). In some embodiments, computer system 500 displays enlarged volume control user interface object 528 in response to computer system 500 detecting an input that corresponds to a selection of volume 72 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) value user interface object 514 while computer system 500 displays volume scale user interface object 530.
[0184] FIG.5C illustrates the behavior of computer system 500 in response to computer system 500 detecting input 505a1 at FIG.5A. As explained above, either FIGS.5B or 5C can follow FIG.5A.
[0185] As illustrated in FIG.5C, in response to computer system 500 detecting input 505a1, computer system 500 displays temperature scale user interface object 522 around temperature value user interface object 512 and computer system 500 ceases to display enlarged fan control user interface object 520 and fan scale user interface object 518. Temperature scale user interface object 522 corresponds to the range of temperature settings of the air conditioning device. Computer system 500 does not display a respective scale around fan value user interface object 510 and volume value user interface object 514 while computer system 500 displays temperature scale user interface object 522 around temperature value user interface object 512. In some embodiments, computer system 500 displays temperature scale user interface object 522 with a number of colors that correspond to the various temperature settings (e.g., blue corresponds to cool temperature settings and red corresponds to warm temperature settings) of the air conditioning device.
[0186] Further, as illustrated in FIG.5C, in response to computer system 500 detecting input 505a1, computer system 500 displays enlarged temperature control user interface object 536. Enlarged temperature control user interface object 536 corresponds to a range of temperature settings of the air conditioning device. As illustrated in FIG.5C, as part of displaying enlarged temperature control user interface object 536, computer system 500 displays temperature indicator user interface object 536a and temperature numerical representation user interface object 536b. Temperature indicator user interface object 536a and temperature numerical representation user interface object 536b indicate the current temperature setting of the air conditioning device. Accordingly, at FIG.5C, the air conditioning device is set to 70 degrees. In some embodiments, while computer system 500 displays enlarged temperature control user interface 536, in response to detecting a rotation of rotatable input mechanism 516, computer 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) system 500 transmits instructions to the air conditioning device that adjusts the temperature setting of the air conditioning device.
[0187] At FIG.5C, while computer system 500 displays temperature scale user interface object 522, computer system 500 detects input 505c that corresponds to selection of temperature value user interface object 512. In some embodiments, input 505c corresponds to tap gesture, swipe gesture, a rotation of rotatable input mechanism 516, depression of rotatable input mechanism 516, a voice command, a gaze, and / or hand gesture. In some embodiments, computer system 500 does not display enlarged temperature control user interface object 536 in response to detecting input 505a1. In some embodiments, enlarged temperature control user interface object 536 is not selectable (e.g., computer system 500 does not perform an action in response to detecting an input on the display of enlarged temperature control user interface object 536). In some embodiments, computer system 500 displays enlarged temperature control user interface object 536, enlarged sound control user interface object 528, and / or enlarged fan control user interface object 520 around rotatable input mechanism 516 such that a respective enlarged control surrounds a different amount of rotatable input mechanism (e.g., enlarged temperature control user interface object 536 surrounds half of rotatable input mechanism 516 and enlarged sound control user interface object 528 surrounds three-quarters of rotatable input mechanism 516).
[0188] At FIG.5D, in response to detecting input 505c, computer system 500 ceases to display fan value user interface object 510, temperature value user interface object 512, temperature scale user interface object 522, and volume value user interface object 514. Further, as illustrated in FIG.5D, in response to detecting input 505c, computer system 500 displays weather information 538. Weather information 538 indicates the current weather conditions (e.g., temperature, humidity, rain conditions, and / or cloud conditions) at the physical location of computer system 500.
[0189] As illustrated in FIG.5D, in response to detecting input 505c, computer system 500 maintains the display of enlarged temperature control user interface object 536, temperature indicator user interface object 536a, and temperature numerical representation user interface object 536b. In some embodiments, computer system 500 displays enlarged temperature control 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) user interface object 536, temperature indicator user interface object 536a, and temperature numerical representation user interface object 536b, in response to computer system 500 detecting input 505c. At FIG.5D, computer system 500 detects input 505d that corresponds to a leftward swipe on the display of enlarged temperature control user interface object 536. In some embodiments, input 505d corresponds to tap gesture, swipe gesture, a rotation of rotatable input mechanism 516, depression of rotatable input mechanism 516, a voice command, a gaze, and / or hand gesture. In some embodiments, computer system 500 redisplays displays fan value user interface object 510, temperature value user interface object 512, temperature scale user interface object 522, and volume value user interface object 514 in response to detecting that rotatable input mechanism 516 is depressed.
[0190] At FIG.5E, in response to detecting input 505d, computer system 500 transmits instructions to the air conditioning device that cause the air conditioning device to decrease its temperature setting to 43 degrees. That is, computer system 500 is configured to control the operation of the air conditioning device while computer system 500 displays enlarged temperature control user interface object 536 without displaying fan value user interface object 510, temperature value user interface object 512, temperature scale user interface object 522, and volume value user interface object 514. At FIG.5E, in response to detecting input 505d, computer system 500 updates the display of temperature numerical representation user interface object 536b and temperature indicator user interface object 536a. Accordingly, as illustrated in FIG.5E, both temperature numerical representation user interface object 536b and temperature indicator user interface object 536a indicate that the current temperature setting of the air conditioning device is 43 degrees. In some embodiments, computer system 500 is configured to control the operation of the air condition device while computer system 500 concurrently displays enlarged temperature control user interface object and one or more of fan value user interface object 510, temperature value user interface object 512, temperature scale user interface object 522, and / or volume value user interface object 514. In some embodiments, computer system 500 outputs a continuous haptic while computer system 500 detects input 505d.
[0191] At FIG.5E, a determination is made that a predetermined amount of time (e.g., 3, 5, 7, 10, 15, 20, 25, or 30 seconds) has elapsed since computer system 500 detected input 505d. Because a determination is made that the predetermined amount of time has elapsed since 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) computer system 500 has detected input 505d, as illustrated in FIG.5E, computer system 500 displays fan value user interface object 510, temperature value user interface object 512, temperature scale user interface object 522, and volume value user interface object 514.
[0192] As illustrated in FIG.5E, computer system 500 displays temperature value user interface object 512 with an indication of the new temperature setting of the air conditioning device. In some embodiments, computer system 500 displays fan value user interface object 510, temperature value user interface object 512, temperature scale user interface object 522, and volume value user interface object 514 in response to computer system 500 detecting input 505d. In some embodiments, rotatable input mechanism 516 includes a display. In embodiments where rotatable input mechanism 516 includes a display, computer system 500 changes the color of the display of rotatable input mechanism 516 in accordance with the change in the temperature setting of the air conditioning device (e.g., the display of rotatable input mechanism 516 changes from an orange color to a blue color to indicate that the temperature setting of the air conditioning device is getting cooler). In some embodiments, computer system 500 transmits instructions to the air conditioning device that cause the air conditioning device to increase its temperature setting in response to computer system 500 detecting an input that corresponds to a rightward swipe input on the display of enlarged temperature control user interface object 536. In some embodiments, computer system 500 transmits instructions to the air conditioning device that modify the temperature setting of the air conditioning device in response to detecting that rotatable input mechanism 516 is rotated (e.g., the temperature setting of the air conditioning device is increased if computer system 500 detects that rotatable input mechanism 516 is rotated in the clockwise direction and the temperature setting of the air conditioning device is decreased if computer system 500 detects that rotatable input mechanism 516 is rotated in the counter- clockwise direction). FIGS.6A-6B is a flow diagram illustrating a method (e.g., process 600) for displaying controls in accordance with some embodiments. Some operations in process 600 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.
[0194] As described below, process 600 provides an intuitive way for displaying controls. Process 600 reduces the cognitive burden on a user for displaying controls, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) user to display controls faster and more efficiently conserves power and increases the time between battery charges.
[0195] In some embodiments, process 600 is performed at a computer system (e.g., 500) that is in communication with a display component (e.g., 504) (e.g., a display screen and / or a touch- sensitive display) and one or more input devices (e.g., a physical input mechanism (e.g., a hardware input mechanism, a rotatable input mechanism, a crown, a knob, a dial, a physical slider, and / or a hardware button), a camera, a touch-sensitive display, a microphone, and / or a button). In some embodiments, the computer system is a watch, a phone, a tablet, a processor, a head-mounted display (HMD) device, and / or a personal computing device. In some embodiments, the computer system is in communication with one or more cameras (e.g., one or more telephoto, wide angle, and / or ultra-wide-angle cameras).
[0196] The computer system displays (602), via the display component (e.g., 504): (604) a plurality of user interface objects (e.g., 510, 512, and / or 514) (e.g., selectable user interface objects and / or user interface objects that, when selected, cause the computer system to perform an operation) (e.g., home and / or vehicle controls (e.g., temperature, volume, fan speed, and / or light intensity) and / or media controls (e.g., volume, playback speed, next track, previous track, fast forward, and / or rewind)) including a first user interface object (e.g., 510, 512, and / or 514) corresponding to a first setting (e.g., a media playback setting, a temperature setting, a volume setting, a fan speed setting, and / or a light intensity setting) and a second user interface object (e.g., 510, 512, and / or 514) corresponding to a second setting that is different from the first setting; a (606) first representation of a current value (e.g., a non-numerical representation (e.g., a scale and / or filling in a bar and / or line graph), a textual representation, and / or a numerical representation) for the first setting (e.g., as described above at FIG.5A); and a (608) second representation of a current value (e.g., a non-numerical representation (e.g., a scale and / or filling in a bar and / or line graph), a textual representation, and / or a numerical representation) for the second setting (e.g., as described above at FIG.5A). In some embodiments, the first representation of the current value for the first setting is visually different from the second representation of the current value for the second setting. In some embodiments, the first representation is located at a different location than the second representation. In some embodiments, the first user interface object includes the first representation of the current value. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) In some embodiments, the second user interface object includes the second representation of the current value.
[0197] While displaying the first user interface object (e.g., 510, 512, and / or 514), the second user interface object (e.g., 510, 512, and / or 514), the first representation, and the second representation (and, In some embodiments, the plurality of user interface objects), the computer system detects (610), via the one or more input devices, a first input (e.g., 505a1 and / or 505a2) (e.g., an input (e.g., a tap input and / or a rotational input) on a rotatable input mechanism and / or a tap on a control and / or user interface object) (and, In some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)).
[0198] In response to (612) detecting the first input (e.g., 505a1 and / or 505a2) and in accordance with a determination that the first input (e.g., 505a1 and / or 505a2) corresponds to selection of the first user interface object (e.g., 510, 512, and / or 514), the computer system updates (614) display of the first user interface object to include a first scale (e.g., 518, 522 and / or 530) (e.g., update the user interface object to have color which indicates a scale and / or a range of values) corresponding to the first setting (e.g., displaying an animation that gradually transitions display of the scale and / or fades in the scale) without updating display of the second user interface object (e.g., 510, 512, and / or 514) to include a second scale (e.g., 518, 522 and / or 530) corresponding to the second setting (e.g., and without updating the second user interface object to include the first scale).. In some embodiments, the first scale is different from the first representation of the current value. In some embodiments, while the first scale is displayed, the first representation of the current value is overlaid on, on top of, and / or over the first scale.
[0199] In response to (612) detecting the first input and in accordance with a determination that the first input (e.g., 505a1 and / or 505a2) corresponds to selection of the second user interface object (e.g., 510, 512, and / or 514), the computer system updates (616) display of the second user interface object to include a second scale (e.g., 518, 522 and / or 530) corresponding to the second setting without updating display of the first user interface object (e.g., 510, 512, and / or 514) to include the first scale (e.g., 518, 522 and / or 530). In some embodiments, display of the second scale is visually different from (e.g., has a different color, size, and / or shape) 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) display of the first scale. In some embodiments, the second scale is different from the first scale. In some embodiments, the second scale is different from the second representation of the current value. In some embodiments, while the second scale is displayed, the second representation of the current value is overlaid on, on top of, and / or over the second scale. In some embodiments, the first scale is a different color than the first representation of the current value, and the second scale is a different color than the second representation of the current value. In some embodiments, the first representation of the current value is a line, tick mark, and / or a point corresponding to a value, and the first scale indicates the range of values to which the first setting can be set. In some embodiments, the second representation of the current value is a line, tick mark, and / or a point corresponding to a value, and the second scale indicates the range of values to which the second setting can be set. Updating the display of one scale (e.g., first scale or second scale) without updating display of the second user interface object to include a second scale (e.g., second scale or first scale) corresponding to the second setting based on the first input corresponding to selection of the first user interface object or second user interface object provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user, thereby providing additional control options without cluttering the user interface with additional user interface objects.
[0200] In some embodiments, the one or more inputs devices includes a first rotatable input mechanism (e.g., 516) (e.g., a crown, a knob, a dial, and / or a physical slider). In some embodiments, the first input (e.g., 505a1 and / or 505a2) is an input (e.g., a pressing input, a touching input, a tapping input, a long-press input, and / or a rotational input) that is directed to (e.g., on and / or that touches) the first rotatable input mechanism (e.g., as described above at FIGS.5A-5C). Updating the display of one scale (e.g., first scale or second scale) without updating display of the second user interface object to include a second scale (e.g., second scale or first scale) corresponding to the second setting based on the first input that is directed to the first rotatable input mechanism provides the user with additional control over the user interface by allowing the computer system to display a particular scale at the direction of the user using the first rotatable input mechanism, thereby providing additional control options without cluttering the user interface with additional user interface objects. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0201] In some embodiments, the one or more input devices includes a first touch-sensitive display (e.g., 504) (e.g., separate from the display component or the same as the display component). In some embodiments, the first input (e.g., 505a1 and / or 505a2) is an input (e.g., a pressing input, a touching input, a tapping input, a long-press input, and / or a rotational input) that is directed to (e.g., on and / or that touches) the first touch-sensitive display. Updating the display of one scale (e.g., first scale or second scale) without updating display of the second user interface object to include a second scale (e.g., second scale or first scale) corresponding to the second setting based on the first input that is directed to the first touch-sensitive display provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user using the first touch-sensitive display, thereby providing additional control options without cluttering the user interface with additional user interface objects.
[0202] In some embodiments, the one or more inputs devices includes a second rotatable input mechanism (e.g., 516) (e.g., a crown, a knob, a dial, and / or a physical slider). In some embodiments, display of the plurality of user interface objects (e.g., 510, 512, and / or 514) at least partially (or, In some embodiments, completely) circumscribes the second rotatable input mechanism (e.g., as described above at FIG.5A). In some embodiments, the display of the plurality of user interface objects forms (and / or is in) a circle or semi-circle. Updating the display of one scale (e.g., first scale or second scale) without updating display of the second user interface object to include a second scale (e.g., second scale or first scale) corresponding to the second setting based on the first input, where the scale is displayed around the second rotatable input mechanism, provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved visual feedback to the user.
[0203] In some embodiments, while displaying, via the display component (e.g., 504), the first user interface object (e.g., 510, 512, and / or 514) that includes the first scale (e.g., 518, 522 and / or 530), the computer system detects, via the one or more input devices, a second input (e.g., 505a1 and / or 505a2). In some embodiments, in response to detecting the second input (e.g., while displaying, via the display component, the first user interface object that includes the first 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) scale) (e.g., an input (e.g., a tap input and / or a rotational input) on a rotatable input mechanism and / or a tap on a control and / or user interface object) (and, In some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)) and in accordance with a determination that the second input corresponds to selection of the first user interface object, the computer system displays, via the display component (e.g., 505), a third scale (e.g., 520, 528, and / or 536) corresponding to the first setting (e.g., without updating the second user interface object to include the second scale), wherein the third scale includes (and / or is) an enlarged representation of the first scale. In some embodiments, in response to detecting the second input (e.g., while displaying, via the display component, the first user interface object that includes the first scale) and in accordance with a determination that the second input corresponds to selection of the first user interface object, the computer system ceases to display the plurality of user interface objects, the first representation, and / or the second representation. In some embodiments, in response to detecting the second input (e.g., while displaying, via the display component, the first user interface object that includes the first scale) and in accordance with a determination that the second input corresponds to selection of the first user interface object, the computer system ceases to display the first user interface object. In some embodiments, in response to detecting the second input (e.g., while displaying, via the display component, the first user interface object that includes the first scale) and in accordance with a determination that the second input corresponds to selection of the first user interface object, the computer system ceases to display the second user interface object. Displaying, via the display component, a third scale corresponding to the first setting in response to detecting the second input provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user using the first touch-sensitive display, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved visual feedback to the user.
[0204] In some embodiments, the one or more input devices includes a second touch- sensitive display (e.g., 504) (e.g., separate from the display component or the same as the display component). In some embodiments, the second input (e.g., 505a1 and / or 505a2) is an input (e.g., a pressing input, a touching input, a tapping input, a long-press input, and / or a rotational input) that is directed to (e.g., on and / or that touches) second touch-sensitive display. Displaying, via 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) the display component, a third scale corresponding to the first setting in response to detecting the second input directed to the second touch-sensitive display provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user using the second touch-sensitive display, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved visual feedback to the user.
[0205] In some embodiments, the one or more inputs devices includes a third rotatable input mechanism (e.g., a crown, a knob, a dial, and / or a physical slider). In some embodiments, the second input (e.g., 505a1 and / or 505a2) is an input (e.g., a pressing input, a touching input, a tapping input, a long-press input, and / or a rotational input) that is directed to (e.g., on and / or that touches) the third rotatable input mechanism (e.g., 516). Displaying, via the display component, a third scale corresponding to the first setting in response to detecting the second input directed to the third rotatable input mechanism provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user using the third rotatable input mechanism, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved visual feedback to the user.
[0206] In some embodiments, in response to detecting the second input (e.g., 505a1 and / or 505a2) (e.g., while displaying, via the display component, the first user interface object that includes the first scale) and in accordance with a determination that the second input corresponds to selection of the second user interface object (e.g., 510, 512, and / or 514), the computer system updates display of the second user interface object to include the second scale (e.g., 518, 522 and / or 530) corresponding to the second setting. In some embodiments, in response to detecting the second input (e.g., while displaying, via the display component, the first user interface object that includes the first scale) and in accordance with a determination that the second input corresponds to selection of the second user interface object, the computer system ceases to display the first user interface object that includes the first scale. In some embodiments, in response to detecting the second input, the computer system continues to display the plurality of user interface objects, the first representation, and / or the second representation. Updating display of the second user interface object to include the second scale corresponding to the second 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) setting in response to detecting the second input and in accordance with a determination that the second input corresponds to selection of the second user interface object provides the user with additional control over the user interface by allowing the computer system to display a particular scale at the direction of the user, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved visual feedback to the user.
[0207] In some embodiments, the one or more inputs devices includes a fourth rotatable input mechanism (e.g., 516) (e.g., a crown, a knob, a dial, and / or a physical slider) (e.g., same as and / or different from the third rotatable input mechanism). In some embodiments, while displaying, via the display component (e.g., 504), the second user interface object (e.g., 510, 512, and / or 514) that includes the second scale (e.g., 518, 522 and / or 530), the computer system detects, via the one or more input devices, a third input (e.g., 505a1 and / or 505a2). In some embodiments, in response to detecting the third input (e.g., while displaying, via the display component, the second user interface object that includes the second scale) (e.g., an input (e.g., a tap input and / or a rotational input) on a rotatable input mechanism and / or a tap on a control and / or user interface object) (and, In some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)) and in accordance with a determination that the third input corresponds to selection of the second user interface object, the computer system displays, via the display component, a fourth scale (e.g., 520, 528, and / or 536) corresponding to the second setting, wherein: the fourth scale includes (and / or is) an enlarged representation of the second scale(e.g., without display the third scale; while (and / or after) the fourth scale is displayed, display of the fourth scale surrounds the fourth rotatable input mechanism by a first amount (e.g., as described above at FIG.5C); and while (and / or after) the third scale (e.g., 520, 528, and / or 536) is displayed, display of the third scale surrounds the fourth rotatable input mechanism by a second amount that is different from the first amount (e.g., as described above at FIG.5C). Displaying scales that go around the rotatable input mechanism by different amounts in response to detecting inputs provides the user with additional control over the user interface by allowing the computer system to display a particular scale at the direction of the user and provides feedback to the user concerning the values in which the scale can be set, thereby providing additional control options without 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) cluttering the user interface with additional user interface objects and providing improved visual feedback to the user.
[0208] In some embodiments, in response to detecting the second input (e.g., 505a1 and / or 505a2) and in accordance with a determination that the second input corresponds to selection of the first user interface object (510, 512, and / or 514), the computer system displays, via the display component (e.g., 504), an indication on the third scale (e.g., 520, 528, and / or 536) at a location corresponding to a current value of the first setting (and / or, In some embodiments, an enlarged representation of the first representation on the third scale) (and, In some embodiments, cease to display the first representation and / or the second representation). Displaying, via the display component, an indication on the third scale at a location corresponding to a current value of the first setting in response to detecting the second input and in accordance with a determination that the second input corresponds to selection of the first user interface object provides the user with additional control over the user interface by allowing the computer system to display a particular scale at the direction of the user with a current value of the scale and provides feedback to the user concerning the values in which the scale can be set, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved visual feedback to the user.
[0209] In some embodiments, in response to detecting the third input (e.g., 505a1 and / or 505a2) and in accordance with a determination that the third input corresponds to selection of the second user interface object (e.g., 510, 512, and / or 514), the computer system displays, via the display component (e.g., 504), an indication on the fourth scale (e.g., 520, 528, and / or 536) at a location corresponding to a current value of the second setting (and / or, In some embodiments, an enlarged representation of the second representation on the fourth scale) (and, In some embodiments, cease to display the first representation and / or the second representation), wherein display of the indication on the fourth scale is visually different from (e.g., has a different position on the display and / or different in color, shape, and / or size) display of the indication on the third scale (e.g., 520, 528, and / or 536). Displaying, via the display component, an indication on the fourth scale at a location in response to detecting the third input and in accordance with a determination that the third input corresponds to selection of the second user interface object provides the user with additional control over the user interface by allowing the computer system 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) to display a particular scale at the direction of the user with a different indication and provides feedback to the user concerning the difference between scales, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved visual feedback to the user.
[0210] In some embodiments, while displaying, via the display component (e.g., 504), the third scale (e.g., 520, 528, and / or 536) or the fourth scale (e.g., 520, 528, and / or 536), the computer system detects a rotation of a fifth rotatable input mechanism (e.g., 516) (e.g., a rotatable input mechanism) (e.g., a crown, a knob, a dial, and / or a physical slider) (e.g., same as and / or different from the third rotatable input mechanism). In some embodiments, in response to detecting the rotation of the fifth rotatable input mechanism and in accordance with a determination that the third scale was displayed while the rotation of the physical input mechanism was detected, the computer system generates a first set of one or more haptics. In some embodiments, in response to detecting the rotation of the fifth rotatable input mechanism and in accordance with a determination that the fourth scale was displayed while the rotation of the physical input mechanism was detected, the computer system generates a second set of one or more haptics that is different from (e.g., different in number, different in spacing between the haptics, different in length of haptics and / or individual haptics that are generated) the first set of one or more haptics (e.g., as described above at FIG.5B). Generating different sets of haptics based on which scale was displayed while the rotation of the physical input mechanism in response to detecting rotation of the fifth rotatable input mechanism allows the computer system to automatically output feedback concerning the received input, thereby providing additional control options without cluttering the user interface with additional user interface objects, performing an operation when a set of conditions has been met without requiring further user input, and providing improved visual feedback to the user.
[0211] In some embodiments, in response to detecting the first input (e.g., 505a1 and / or 505a2), the computer system generates a third set of one or haptics that is different from the first set of one or more haptics and the second set of one or more haptics (e.g., as described above at FIG.5A). Generating a third set of one or haptics that is different from the first set of one or more haptics and the second set of one or more haptics in response to detecting the first input allows the computer system to automatically output feedback concerning the received input, 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) thereby providing additional control options without cluttering the user interface with additional user interface objects, performing an operation when a set of conditions has been met without requiring further user input, and providing improved visual feedback to the user.
[0212] In some embodiments, in response to detecting the second input (e.g., 505a1 and / or 505a2) and in accordance with a determination that the second input corresponds to selection of the first user interface object (610, 512, and / or 514), the computer system displays, via the display component (e.g., 504), a numerical representation (e.g., 520, 528, and / or 536) (e.g., a numerical character and / or one or more numbers) of the current value for the first setting concurrently with the third scale (e.g., 520, 528, and / or 536), wherein the numerical representation of the current value for the first setting was not previously displayed before the second input was detected. Displaying a numerical representation of the current value for the first setting concurrently with the third scale in response to detecting the second input and in accordance with a determination that the second input corresponds to selection of the first user interface object in response to detecting the second input allows the computer system to automatically display numerical representations of the current value for the first setting, thereby providing additional control options without cluttering the user interface with additional user interface objects, performing an operation when a set of conditions has been met without requiring further user input, and providing improved visual feedback to the user.
[0213] In some embodiments, while displaying, via the display component (e.g., 504), the third scale (e.g., 520, 528, and / or 536), the computer system detects an input (e.g., 505d) corresponding to a movement input (e.g., a swipe input, an air gesture, a gaze input, a click-and- drag input, and / or a dragging input). In some embodiments, in response to detecting the input corresponding to the movement input, the computer system updates the current value for the first setting to a new value based on movement of the input corresponding to the movement input (e.g., as described above at FIG.5E). In some embodiments, in response to detecting the input corresponding to the movement input, the computer system causes output of a device (e.g., a fan, a thermostat, a window, a door, an actuator, a speaker, and / or a chair) corresponding to the first setting to change (e.g., as described above at FIG.5E) (e.g., without causing output of a device corresponding to the second setting to change) (e.g., a device that is in communication with the computer system) (e.g., based on the new value and / or a different value). Updating the current 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) value for the first setting to a new value based on movement of the input corresponding to the movement input and causing output of a device corresponding to the first setting to change in response to detecting the input corresponding to the movement input provides a user with more control over the computer system to cause the output of a device to change, thereby providing additional control options without cluttering the user interface with additional user interface objects.
[0214] In some embodiments, the computer system (e.g., 500) is in communication with a sixth rotatable input mechanism (e.g., 516) (e.g., a crown, a knob, a dial, and / or a physical slider) (e.g., same as and / or different from the fourth rotatable input mechanism). In some embodiments, the input corresponding to the movement input (e.g., 505d) is a rotation of the sixth rotatable input mechanism (e.g., 516). Updating the display of one scale (e.g., first scale or second scale) without updating display of the second user interface object to include a second scale (e.g., second scale or first scale) corresponding to the second setting based on the first input that includes a rotation of a rotatable input mechanism provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user using the rotatable input mechanism, thereby providing additional control options without cluttering the user interface with additional user interface objects.
[0215] In some embodiments, the sixth rotatable input mechanism (e.g., 516) includes a respective display (e.g., 504). In some embodiments, the respective display includes a user interface that is updated as the current value for the first setting is updated (e.g., as described above at FIG.5E). In some embodiments, the display is the display component. In some embodiments, the user interface includes a scale corresponding to the first setting (and / or a scale corresponding to another setting) and / or the first scale, second scale, third scale, and / or fourth scale. Updating the display of one scale (e.g., first scale or second scale) without updating display of the second user interface object to include a second scale (e.g., second scale or first scale) corresponding to the second setting based on the first input that includes a rotation of a rotatable input mechanism that includes display provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user using the rotatable input mechanism that includes the display, thereby 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) providing additional control options without cluttering the user interface with additional user interface objects and providing the user with improved feedback.
[0216] In some embodiments, after displaying, via the display component (e.g., 504), the third scale (e.g., 520, 528, and / or 536) corresponding to the first setting and in accordance with a determination that an input (e.g., 505a1, 505c, and / or 505d) has not been detected for a predetermined period of time (e.g., after the second input was detected and / or after another input was detected), the computer system displays (e.g., re-displays and / or displays again) the plurality of controls (e.g., 510, 512, and / or 514) (e.g., as described above at FIG.5E) (e.g., and / or re- displaying the first scale and / or a scale corresponding to the enlarged scale that was displayed before the determination occurred). In some embodiments, in accordance with a determination that an input has been detected for the predetermined period of time, the computer system continues to display the third scale. In some embodiments, in accordance with a determination that the input has been detected for the predetermined period of time, the computer system forgoes re-displaying the plurality of controls and continuing to display the third scale. Displaying the plurality of controls in accordance with a determination that an input has not been detected for a predetermined period of time allows the computer system to automatically provide the plurality of controls when a set of conditions are met, thereby performing an operation when a set of conditions has been met without requiring further user input.
[0217] In some embodiments, the computer system (e.g., 500) is in communication with a seventh rotatable input mechanism (e.g., 516) (e.g., a crown, a knob, a dial, and / or a physical slider) (e.g., same as and / or different from the input rotatable input mechanism). In some embodiments, in response to detecting an input (e.g., 505a1, 505c, and / or 505d) directed to the seventh rotatable input mechanism, the computer system displays (e.g., re-displays and / or displays again) the plurality of controls (e.g., 510, 512, and / or 514) (e.g., and / or re-displaying the first scale and / or a scale corresponding to the enlarged scale that was displayed before the determination occurred). Displaying the plurality of controls in response to detecting an input directed to the seventh rotatable input mechanism allows the computer system to automatically provide the plurality of controls when a set of conditions are met, thereby performing an operation when a set of conditions has been met without requiring further user input. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0218] In some embodiments, displaying the plurality of controls (e.g., 510, 512, and / or 514) in response to detecting an input (e.g., 505a1, 505c, and / or 505d) directed to the seventh rotatable input mechanism (e.g., 516) includes displaying (e.g., re-displaying and / or displaying again) the first user interface object (510, 512, and / or 514) that includes the first scale (e.g., 518, 522 and / or 530) and the second user interface object (e.g., 510, 512, and / or 514) without displaying the second scale (e.g., 518, 522 and / or 530). In some embodiments, displaying the plurality of controls in response to detecting an input directed to the seventh rotatable input mechanism includes re-displaying the first representation of the current value for the first setting. In some embodiments, the position of the first representation of the current value for the first setting is changed if the current value of the first setting was reset in response to detecting a rotation of the rotatable input mechanism while the third scale (e.g., the enlarged scale for the first setting) was displayed.
[0219] In some embodiments, display of the second scale (e.g., 518, 522 and / or 530) is visually different from display of the first scale (e.g., 518, 522 and / or 530). In some embodiments, one scale is a multi-colored (e.g., red, blue, yellow, and orange) gradient while other scale is single color gradient. In some embodiments, one scale is multi-colored while the other scale is a solid color. Updating the display of one scale (e.g., first scale or second scale) without updating display of the second user interface object to include a second scale (e.g., second scale or first scale) corresponding to the second setting based on the first input corresponding to selection of the first user interface object or second user interface object, where the scales are visually different, provides the user with additional control over the user interface by allowing the computer system to automatically display a particular scale at the direction of the user, thereby providing additional control options without cluttering the user interface with additional user interface objects.
[0220] Note that details of the processes described above with respect to process 600 (e.g., FIGS.6A-6B) are also applicable in an analogous manner to other methods described herein. For example, process 1000 optionally includes one or more characteristics of the various methods described above with reference to process 600. For example, a scale can be displayed using the techniques described above in relation to process 600, where the appearance of the scale is adjusted using one or more techniques described below in relation to process 1000. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0221] FIGS.7A-7F illustrate exemplary user interfaces for controlling the display of controls in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS.8A-8B.
[0222] At FIG.7A, computer system 500 is operating in a sleep mode. Computer system 500 does not display a respective user interface and / or respective user interface objects on display 504 while computer system 500 is in the sleep mode. FIG.7A illustrates portion of body 710. Portion of body 710 is one or more body parts (e.g., one or more digits (e.g., finger and / or toes), limb (e.g., arm and / or leg), torso, and / or head) of a user of computer system 500. As illustrated in FIG.7A, portion of body 710 is near computer system 500. That is, at FIG.7A, portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516.
[0223] At FIG.7A, computer system 500 detects that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516 for an amount of time that is greater than a predetermined time threshold (e.g., .5, 1, 3, 5, 7, or 10 seconds). In some embodiments, computer system 500 detects that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516 via a wireless signal (e.g., NFC, Bluetooth, and / or Wi-Fi). In some embodiments, computer system 500 is in communication (e.g., wireless and / or wired communication) with one or more cameras. In embodiments where computer system 500 is in communication with the one or more cameras, computer system 500 detects that portion of body 710 is within predetermined distance threshold 718 for the predetermined amount of time via the one or more cameras. In some embodiments, computer system 500 does not detect that portion of body 710 contacts computer system 500 as a part of computer system 500 determining that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516. In some embodiments, computer system 500 displays a respective user interface and / or user interface objects while computer system 500 detects that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516.
[0224] In each of FIGS.7B-7D, computer system 500 continues to detect that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516 (e.g., portion of body 710 remains in near rotatable input mechanism 516 in FIGS.7B-7D). 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0225] As illustrated in FIG.7B, in response to computer system 500 detecting that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516 for the predetermined time threshold, computer system 500 displays fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712. As illustrated in FIG.7B, computer system 500 displays each of fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 near rotatable input mechanism 516 (e.g., computer system 500 displays each of fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 on a portion of display 504 closer to rotatable input mechanism 516 than a different portion of display 504). In some embodiments, computer system 500 displays each of fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 above, to the side, or below rotatable input mechanism 516. In some embodiments, computer system 500 displays a respective control user interface object on each side of rotatable input mechanism 516.
[0226] In some embodiments, computer system 500 maintains the display of each of fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 while two conditions are satisfied. In some embodiments, the first condition is that computer system 500 does not detect that portion of body 710 is outside predetermined distance threshold 718 of rotatable input mechanism 516 for a threshold amount of time (e.g., 1, 3,5,7, 10, 15, 25 seconds). In some embodiments, the second condition is that a first time threshold (e.g., 1, 3, 5, 10, 13, 15 or 20 seconds) has not elapsed since computer system 500 last detected an input (e.g., a tap input, a swipe input, or an input that corresponds to a rotation of rotatable input mechanism 516 was rotated). In some embodiments, computer system 500 will cease to display each of fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 while computer system 500 detects that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516 if the first time threshold has elapsed since computer system 500 last detected an input. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0227] Fan control user interface object 706 corresponds to a fan device, temperature control user interface object 708 corresponds to an air conditioning device (e.g., a device capable of heating and / or cooling a space), volume control user interface object 714 corresponds to one or more speaker devices, and light control user interface object 716 corresponds to one or more light devices. As explained in greater detail below, each of fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 can be selected to configure computer system 500 to control the operation of the device that corresponds to the selected control user interface object. In some embodiments, one or more of the fan device, air conditioning device, one or more speaker devices, and / or one or more light devices are integrated into computer system 500. In some examples one or more of the fan device, air conditioning device, one or more speaker devices, and / or one or more light devices are not integrated into computer system 500. In some examples one or more of the fan device, air conditioning device, one or more speaker devices, one or more light devices and / or computer system 500 are coupled to a common external structure (e.g., a home, an airplane, a bus, a car, and / or boat). In some embodiments, computer system 500 displays fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 in a configuration that corresponds to the rotation of rotatable input mechanism 516 (e.g., computer system 500 displays fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 in a half circle configuration if rotatable input mechanism 516 rotates about an z-axis or computer system 500 displays fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 in a circle that extends into / out of display 504 if rotatable input mechanism 516 rotates about a x-axis). In some embodiments, computer system 500 resizes / moves the display of a respective user interface and / or user interface objects as a part of displaying fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 such that computer system 500 does not display fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 as overlaid on the respective user interface and / or user interface objects. In some embodiments, computer 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) system 500 does not display fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 as overlaid on top of user interface elements that computer system 500 displays prior to computer system 500 detecting that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516. In some embodiments, computer system 500 displays fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 in response to computer system 500 detecting that portion of body 710 is within the predetermined distance of a hardware component (e.g., display 504, a hardware button, and / or backside of computer system 500) of computer system 500 that is not rotatable input mechanism 516.
[0228] As illustrated in FIG.7B, computer system 500 displays fan control user interface object 706 as visually emphasized (e.g., computer system 500 displays fan control user interface object 706 with hatching and / or color to indicate that fan control user interface object 706 is visually emphasized). At FIG.7B, computer system 500 detects input 705b that corresponds to a rotation of rotatable input mechanism 516. In some embodiments, in order to visually emphasize fan control user interface object 706, computer system 500 displays fan control user interface object 706 as a different color than temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716. In some embodiments, input 705b corresponds to a tap input, swipe input, voice command, a gaze, and / or a hand gesture.
[0229] At FIG.7C, in response to detecting input 705b, computer system 500 scrolls from fan control user interface object 706 to volume control user interface object 714. At FIG.7C, as a part of scrolling from fan control user interface object 706 to volume control user interface object 714, computer system 500 ceases to display fan control user interface object 706 as visually emphasized and computer system 500 displays volume control user interface object 714 as visually emphasized. In some embodiments, computer system 500 displays fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 as rotating about and x-axis in and out of display 504 in a circle as a part of computer system 500 scrolling fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712. In some embodiments, the direction at which 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) computer system 500 scrolls fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 is based on the detected rotation direction of rotatable input mechanism 516 (e.g., computer system 500 scrolls fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 in a first direction in response to computer system 500 detecting that rotatable input mechanism 516 is rotated in a clockwise direction and computer system 500 scrolls fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 in a second direction (e.g., opposite the first direction) in response to computer system 500 detecting that rotatable input mechanism 516 is rotated in a counterclockwise direction). In some embodiments, the speed at which computer system 500 scrolls fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 corresponds the detected rotation speed of rotatable input mechanism 516 (e.g., the rate at which computer system 500 scrolls fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 is directly to the speed at which computer system 500 detects rotatable input mechanism 516 as being rotated). In some embodiments, in response to detecting input 705b and while computer system displays fan control user interface object as visually emphasized (e.g., the fan device is the targeted device), computer system 500 transmits instructions to the fan device that modify the operation of the fan device without changing the operation of the air conditioning device, the one or more speaker devices, or the one or more light devices. In some embodiments, in response to detecting input 705b and while computer system displays fan control user interface object as visually emphasized (e.g., the fan device is the targeted device), computer system 500 does not transmit instructions to the fan device that modify the operation of the fan device.
[0230] At FIG.7C, while computer system 500 displays volume control user interface object 714 as visually emphasized, computer system 500 detects input 705c that corresponds to a depression of rotatable input mechanism 516. In some embodiments, input 705c corresponds to a tap input, swipe input, a gaze, a hand gesture, voice command, and / or a rotation of rotatable input mechanism 516. In some embodiments, computer system 500 continues to display fan 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 while computer system 500 detects that rotatable input mechanism 516 is being rotated. In some embodiments, while computer system 500 displays fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714 and light control user interface object 716, computer system 500 does not transmit instructions to the fan device, the air conditioning device, the one or more speaker devices, or the one or more light devices in response to detecting an input. In some embodiments, computer system 500 updates the display of a respective user interface object and does not update the display of fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712 in response to detecting an input.
[0231] As illustrated in FIG.7D, in response to detecting input 705c while computer system 500 displays volume control user interface object 714 as visually emphasized, computer system 500 displays volume scale user interface object 722 and ceases to display fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 712. Volume scale user interface object 722 includes volume representation user interface object 730. The length of volume scale user interface object 722 corresponds to the range of the volume settings of the one or more speaker devices (e.g., that correspond to volume control user interface object 714). The leftmost portion of volume scale user interface object 722 corresponds to the minimum volume setting of the one or more speaker devices and the rightmost portion of volume scale user interface object 722 represents the maximum volume setting of the one or more speaker devices. Volume representation user interface object 730 represents the current volume level of the one or more speaker devices. In some embodiments, computer system 500 displays volume scale user interface object at the same position on display 504 that computer system 500 displays volume control user interface object 714.
[0232] Computer system 500 ceases to display fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 as a part of displaying volume scale user interface object 722. In some embodiments, volume scale user interface object 722 includes a numerical representation 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) of the current volume setting of the one or more speaker devices. In some embodiments, computer system 500 continues to display volume control user interface object 714 and ceases to display each of fan control user interface object 706, temperature control user interface object 708, and light control user interface object 716 as a part of displaying volume scale user interface object 722. In some embodiments, computer system 500 displays fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 while computer system 500 displays volume scale user interface object 722.
[0233] As explained in greater detail below, computer system 500 is configured to control the volume setting of the one or more speaker devices while computer system 500 displays volume scale user interface object. At FIG.7D, computer system 500 detects input 705d that corresponds to a rotation of rotatable input mechanism 516. In some embodiments, input 705d corresponds to a tap input, swipe input, a gaze, voice command, depression of rotatable input mechanism 516 and / or a hand gesture. In some embodiments, input 705d corresponds to a swipe input on the display of volume representation user interface object 730.
[0234] At FIG.7E, in response to computer system 500 detecting input 705d, computer system 500 transmits instructions to the one or more speaker devices that cause the volume setting of the one or more speaker devices to increase (e.g., in comparison to the volume setting of the one or more speaker devices at FIG.7D). Computer system 500 moves the display of volume indicator 720 to the right on volume scale user interface object 722 to represent the new volume setting of the one or more speaker devices. In some embodiments, the volume setting is adjusted based on the detected direction of the rotation of rotatable input mechanism 516 (e.g., the volume setting is increased if computer system 500 detects that rotatable input mechanism 516 is rotated in a clockwise direction and the volume setting is decreased if computer system 500 detects that rotatable input mechanism 516 is rotated in the counterclockwise direction). In some embodiments, the magnitude of the change of the volume setting is based on the on the detected speed of the rotation of rotatable input mechanism 516. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0235] At FIG.7E, computer system 500 detects that portion of body 710 is positioned at a distance from rotatable input mechanism 516 that is outside of predetermined distance threshold 718 for a second time threshold.
[0236] At FIG.7F, in response to computer system 500 detecting that portion of body 710 is positioned at a distance from rotatable input mechanism 516 that is greater than predetermined distance threshold 718 for a second time threshold, computer system 500 ceases to display volume scale user interface object 722. The second time threshold is less than the first time threshold (e.g., as discussed above in reference to FIG.7B). That is, the amount of time computer system 500 is required to detect that portion of body 710 is positioned at a distance that is greater than predetermined distance threshold 718 in order for computer system 500 to cease the display of volume scale user interface object 722 is less that the amount of time computer system 500 is required to go without detecting an input while portion of body 710 is positioned within predetermined distance threshold 718 in order for computer system 500 to cease the display of volume scale user interface object 722. For example, computer system 500 ceases to display volume scale user interface object 722 after 3 seconds have elapsed since computer system 500 detects that portion of body 710 is positioned at a distance that is greater than predetermined distance threshold 718. In contrast, while portion of body 710 is positioned at a distance from rotatable input mechanism 516 that is within the predetermined distance threshold 718, computer system 500 ceases to display volume scale user interface object 722 after computer system 500 has not detected an input for 10 seconds. In some embodiments, computer system 500 displays one or more of fan control user interface object 706, temperature control user interface object 708, volume control user interface object 714, and light control user interface object 716 as a part of ceasing to display volume scale user interface object 722. In some embodiments, computer system 500 redisplays volume scale user interface object 722 in response to detecting that portion of body 710 is within predetermined distance threshold 718 for the first time threshold. In some embodiments, computer system 500 displays fan value user interface object 510, temperature value user interface object 512, and / or volume value user interface object 514 in response to detecting that portion of body 710 is within predetermined distance threshold 718 of rotatable input mechanism 516 for an amount of time that is greater than a predetermined time threshold. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0237] FIGS.8A-8B is a flow diagram illustrating a method (e.g., process 800) for displaying controls in accordance with some embodiments. Some operations in process 800 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.
[0238] As described below, process 800 provides an intuitive way for displaying. Process 800 reduces the cognitive burden on a user for displaying controls, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to display controls faster and more efficiently conserves power and increases the time between battery charges.
[0239] In some embodiments, process 800 is performed at a computer system (e.g., 500) that is in communication with a display component (e.g., 504) (e.g., a display screen and / or a touch- sensitive display), one or more input devices (e.g., a camera, a touch-sensitive display, a microphone, and / or a button), and a physical input mechanism (e.g., 516) (e.g., a hardware input mechanism, a rotatable input mechanism, a crown, a knob, a dial, a physical slider, and / or a hardware button). In some embodiments, the computer system is a watch, a phone, a tablet, a processor, a head-mounted display (HMD) device, and / or a personal computing device. In some embodiments, the computer system is in communication with one or more cameras (e.g., one or more telephoto, wide angle, and / or ultra-wide-angle cameras).
[0240] While displaying a respective user interface, the computer system detects (802), via the one or more inputs devices, an intent to control the physical input mechanism (e.g., 516) (e.g., as described above at FIG.5A) (e.g., a body part (e.g., a hand), a pointer, and / or gaze that is within a predetermined distance away from and / or moving toward (e.g., within a predetermined amount of time) the physical input mechanism and / or an air gesture and / or gaze that is directed to the physical input mechanism).
[0241] In response to detecting the intent to control the physical input mechanism (e.g., 516), the computer system displays (804), via the display component (e.g., 504), one or more user interface objects (e.g., 706, 708, 714, and / or 716) on the respective user interface, wherein movement of the physical input mechanism causes the computer system (e.g., 500) to update display at least one of the one or more user interface objects. In some embodiments, in response 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) to detecting movement of the physical input mechanism, the computer system causes a setting (e.g., as described above in relation to process 600) for a device (e.g., a speaker, a thermostat, a door (e.g., front door and / or back door), a fan, a light, and / or a window component (e.g., blinds, a window opening, and / or a window tint)) to be adjusted and / or causes the device to adjust output.
[0242] While displaying the one or more respective user interface objects on the respective user interface and in accordance with a determination that the physical input mechanism (e.g., 516) is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed (e.g., since the rotatable input mechanism was moved or since the hand was near the rotatable input mechanism) (e.g., as described above at FIG.7B), the computer system continues (808) to display the one or more respective user interface objects (e.g., 706, 708, 714, and / or 716) on the respective user interface.
[0243] While displaying the one or more respective user interface objects on the respective user interface and in accordance with a determination that the physical input mechanism (e.g., 516) is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed (e.g., since the rotatable input mechanism was moved or since the hand was near the rotatable input mechanism), the computer system ceases (810) to display the one or more respective user interface objects on the respective user interface (e.g., as described above at FIG.5B).
[0244] While displaying the one or more respective user interface objects on the respective user interface and ion accordance with a determination that the physical input mechanism (e.g., 516) is not moving and the intent to control the physical input mechanism does not continue to be detected (and, In some embodiments, irrespective of whether or not the predetermined period of time has passed (e.g., since the rotatable input mechanism was moved or since the hand was near the rotatable input mechanism)), the computer system ceases (812) to display the one or more respective user interface objects on the respective user interface (e.g., as described above at FIG.9B). Continuing to display the one or more respective user interface objects on the respective user interface or ceasing to display the one or more respective user interface objects on the respective user interface when prescribed conditions are met allows the computer system 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) to automatically cease to display or continue to display the one or more respective user interface objects based on certain conditions being met, thereby providing additional control options without cluttering the user interface with additional user interface objects and performing an operation when a set of conditions has been met without requiring further user input.
[0245] In some embodiments, detecting the intent to control the physical input mechanism includes detecting that a body part (e.g., hand, head, arm, finger, toe, and / or foot) of a user (e.g., 710) is within a predetermined distance (e.g., 0.1-50 centimeters) from an area that includes the physical input mechanism (e.g., as described above at FIG.7A). Continuing to display the one or more respective user interface objects on the respective user interface or ceasing to display the one or more respective user interface objects on the respective user interface based on detecting that a body part of a user is within a predetermined distance from an area that includes the physical input mechanism provides the user with control over the computer system to choose whether the one or more respective user interface objects should be displayed, thereby providing additional control options without cluttering the user interface with additional user interface objects and performing an operation when a set of conditions has been met without requiring further user input.
[0246] In some embodiments, the area surrounds (e.g., and / or circumscribes) at least a portion of the physical input mechanism. In some embodiments, the shape of the area is a circle and / or semi-circle.
[0247] In some embodiments, in response to detecting the intent to control the physical input mechanism (e.g., as described above at FIG.7A) and in accordance with a determination that the physical input mechanism (e.g., 516) is moving, the computer system continues to display the one or more respective user interface objects (e.g., 706, 708, 714, and / or 716) on the respective user interface. Continuing to display the one or more respective user interface objects on the respective user interface in response to detecting the intent to control the physical input mechanism and in accordance with a determination that the physical input mechanism is moving provides the user with control over the computer system to choose whether the one or more respective user interface objects is displayed, thereby providing additional control options without cluttering the user interface with additional user interface objects, performing an 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) operation when a set of conditions has been met without requiring further user input, and provides improved feedback (e.g., sensory, visual, auditory, and touching).
[0248] In some embodiments, the one or more user interface objects (e.g., 706, 708, 714, and / or 716) includes: a first user interface object (e.g., 706, 708, 714, and / or 716) that has a first visual appearance (e.g., a size, shape, color, and / or including one or more graphical representations (e.g., different types of graphical representations)); and a second user interface object (e.g., 706, 708, 714, and / or 716) that has a second visual appearance (e.g., a size, shape, color, and / or including one or more graphical representations (e.g., different types of graphical representations)) that is different form the first visual appearance.
[0249] In some embodiments, while displaying the one or more user interface objects (e.g., 706, 708, 714, and / or 716) including the first user interface object (e.g., 706, 708, 714, and / or 716) and the second user interface object (e.g., 706, 708, 714, and / or 716), the computer system detects an input (e.g., 705b) (e.g., an input (e.g., a tap input and / or a rotational input) on a rotatable input mechanism and / or a tap on a control and / or user interface object) (and, In some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)), via the one or more input devices, directed to the one or more user interface objects. In some embodiments, in response to detecting the input directed to the one or more user interface objects and in accordance with a determination that the input directed to the one or more user interface objects is directed to the first user interface object, the computer system causes output of a first device to change (e.g., where the first device corresponds to the first user interface object) without causing output of a second device to change (e.g., where the second device corresponds to the first user interface object) (e.g., to increase and / or decrease), wherein the second device is different from the first device (e.g., as described above at FIG.7C). In some embodiments, in response to detecting the input directed to the one or more user interface objects and in accordance with a determination that the input directed to the one or more user interface objects is directed to the second user interface object, the computer system causes output of the second device to change without causing output of the first device to change (e.g., as described above at FIG.7C). Causing output of a first device to change without causing output of a second device to change or causing output of the second device to change without causing output of the first device to change in response to 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) detecting the input directed to the one or more user interface objects provides the user with more control over the computer system to cause a device’s output to change based on the user interface object in which the input was directed, thereby providing additional control options without cluttering the user interface with additional user interface objects, performing an operation when a set of conditions has been met without requiring further user input, and provides improved feedback (e.g., sensory, visual, auditory, and touching).
[0250] In some embodiments, the one or more user interface objects (e.g., 706, 708, 714, and / or 716) are displayed in a portion of the respective user interface that is closer to a location of the physical input mechanism (e.g., 516) (e.g., in the portion of the user interface that is the closet to the physical input mechanism than the other portions of the respective user interface) (e.g., within an average adult’s thumb distance away from) than another portion of the respective user interface (e.g., as described above at FIG.7B). Displaying the one or more user interface objects a portion of the respective user interface that is closer to a location of the physical input mechanism than another portion of the respective user interface provides a user with feedback that the one or more user interface objects can be controlled and / or manipulated via input that is directed to the physical input mechanism, thereby providing improved feedback and providing additional control options without cluttering the user interface with additional user interface objects.
[0251] In some embodiments, the one or more user interface objects (e.g., 706, 708, 714, and / or 716) are displayed in an arrangement (e.g., a shape and / or a layout) that indicates a direction that the rotatable input mechanism (e.g., 516) can be moved (e.g., as described above at FIG.7A) (e.g., a semi-color that starts at one position and that ends at another position on the user interface). In some embodiments, the rotatable input mechanism rotates in a first direction and the one or more user interface objects (when the one or more user interface objects includes a plurality of user interface objects) are aligned in the first direction. Displaying the one or more user interface objects are displayed in an arrangement that indicates a direction that the rotatable input mechanism can be moved provides a user with feedback that the one or more user interface objects can be controlled and / or manipulated via input that is directed to the physical input mechanism, thereby providing improved feedback and providing additional control options without cluttering the user interface with additional user interface objects. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0252] In some embodiments, before detecting, via the one or more inputs devices, the intent to control the physical input mechanism (e.g., as described above at FIG.7A), the respective user interface includes visual information and does not include the one or more user interface objects (e.g., 706, 708, 714, and / or 716). In some embodiments, in response to detecting the intent to control the physical input mechanism, the one or more user interface objects are displayed concurrently with the visual information and are not overlaid on (e.g., not displayed on top of, not displayed over, does not obstruct display of) the visual information (e.g., as described above at FIG.7B). Displaying the one or more user interface objects concurrently with the visual information, where the one or more user interface objects and are not overlaid on the visual information provides the user with controls options for performing one or more operations while also allow the user to view visual information, thereby providing additional control options without cluttering the user interface with additional user interface objects.
[0253] In some embodiments, while displaying the one or more user interface objects (e.g., 706, 708, 714, and / or 716), the computer system displays an indication that a third user interface object of the one or more user interface objects is selected (e.g., 706 at FIG.7B and / or 714 at FIG.7C). In some embodiments, while displaying the indication that the third user interface object is selected, the computer system detects a rotation (e.g., 705b and / or 705d) (e.g., counterclockwise and / or clockwise) of the physical input mechanism (e.g., 516). In some embodiments, in response to detecting the rotation of the physical input mechanism, the computer system displays an indication (e.g., a focus indicator, highlighting of a respective user interface object, bolding of a respective user interface object, a shape around a respective user interface object) that a fourth user interface object of the one or more user interface objects is selected (e.g., 706 at FIG.7B and / or 714 at FIG.7C). In some embodiments, in response to detecting the rotation of the physical input mechanism, the computer system ceases to display the indication that the third user interface is selected (e.g., as described above at FIG.7C). Displaying an indication that a fourth user interface object of the one or more user interface objects is selected and ceasing to display the indication that the third user interface is selected in response to detecting the rotation of the physical input mechanism allows the user with more control over the computer system to allow the user to switch a selection of a user interface object while providing visual feedback of which user interface object is selected, thereby providing 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) additional control options without cluttering the user interface with additional user interface objects and providing improved feedback.
[0254] In some embodiments, in response to detecting the rotation (e.g., 705b and / or 705d) of the physical input mechanism (e.g., 516), the computer system moves (e.g., in a circular direction, in a lateral direction, and / or in a vertical direction) display of the one or more user interface objects (e.g., 706, 708, 714, and / or 716) (e.g., as described above at FIG.7B). Moving display of the one or more user interface objects in response to detecting the rotation of the physical input mechanism provides the user with more control over the computer system to allow the user to switch a selection of a user interface object, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved feedback.
[0255] In some embodiments, in response to detecting the rotation (e.g., 705b and / or 705d) of the physical input mechanism (e.g., 516) while displaying the one or more user interface objects (e.g., 706, 708, 714, and / or 716), the computer system forgoes causing a current value for a setting to be adjusted (e.g., forgoing causing a device that corresponds to the current value for the setting to be adjusted) (e.g., as described above at FIG.7C). Having the current value for the setting not to be adjusted in response to detecting the rotation of the physical input mechanism while displaying the one or more user interface objects provides the user with more control to only adjust settings when desired, thereby providing additional control options without cluttering the user interface with additional user interface objects.
[0256] In some embodiments, while displaying the one or more user interface objects (e.g., 706, 708, 714, and / or 716), the computer system detects an input (e.g., 705b, 705c, and / or 705d) (e.g., an input (e.g., a tap input and / or a rotational input) on a rotatable input mechanism and / or a tap on a control and / or user interface object) (and, In some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)) that is directed to a fourth user interface object (e.g., 706, 708, 714, and / or 716) of the one or more user interface objects (e.g., 706, 708, 714, and / or 716). In some embodiments, in response to detecting the input that is directed to the fourth user interface object, the computer system displays a scale (e.g., 722) (e.g., a color and / or graphical 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) representation which indicates a scale and / or a range of values) that includes an indication (e.g., 730) of a current value of a setting corresponding to the fourth user interface object. Displaying a scale that includes an indication of a current value of a setting corresponding to the fourth user interface object in response to detecting the input that is directed to the fourth user interface object provides the user with more control over the user interface to cause display of the scale, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved feedback.
[0257] In some embodiments, while displaying the scale (e.g., 722) that includes the indication (e.g., 730) of the current value of the setting corresponding to the fourth user interface object (e.g., 706, 708, 714, and / or 716), the computer system detects, via the one or more inputs, an input (e.g.,705b, 705c, and / or 705d) (e.g., an input (e.g., a tap input and / or a rotational input) on a rotatable input mechanism and / or a tap on a control and / or user interface object) (and, In some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)) that is directed to the physical input mechanism (e.g., 516). In some embodiments, in response to detecting the input that is directed to the physical input mechanism, the computer system adjusts the current value of the setting corresponding to the fourth user interface object (e.g., as discussed above at FIG.7E). In some embodiments, in response to detecting the input that is directed to the physical input mechanism, the computer system causes output of a device (e.g., a fan, thermostat, speaker, window, door, and / or actuator) that corresponds to the setting corresponding to the fourth user interface object (e.g., as described above at FIG.7E). Causing output of a device that corresponds to the setting corresponding to the fourth user interface object and adjusting the current value of the setting corresponding to the fourth user interface object in response to detecting the input that is directed to the physical input mechanism provides the user with more control of the user interface to adjust the current value of the setting and change the output of a device, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved feedback.
[0258] In some embodiments, the fourth user interface object (e.g., 706, 708, 714, and / or 716) is displayed at a respective location. In some embodiments, in response to detecting the input (e.g.,705b, 705c, and / or 705d) that is directed to the fourth user interface object, the 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) computer system ceases to display the fourth user interface object at the respective location, wherein the scale (e.g., 722) is displayed at the respective location (e.g., as described above at FIG.7D). In some embodiments, the scale replaces the fourth user interface object. Ceasing to display the fourth user interface object at the respective location, wherein the scale is displayed at the respective location allows the computer system to cease displaying user interface object(s) when needed and / or when another user interface object should be displayed at the location which gives the user the indication that the user interface object that has ceased to be displayed is not actionable, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved feedback.
[0259] In some embodiments, while displaying the one or more user interface objects (e.g., 706, 708, 714, and / or 716), the computer system detects an input (e.g.,705b, 705c, and / or 705d) (e.g., an input (e.g., a tap input and / or a rotational input) on a rotatable input mechanism and / or a tap on a control and / or user interface object) (and, In some embodiments, a non-tap input, such as a mouse click, gaze input, voice command, air gesture (e.g., a tap air gesture, a pinch gesture, and / or a flicking air gesture)) that is not directed to the physical input mechanism (e.g., 516). In some embodiments, in response to detecting the input that is not directed to the physical input mechanism, the computer system updates the respective user interface without displaying a scale (e.g., 722) that updates based on movement of the physical input mechanism and without updating display of the one or more user interface objects. Updating the respective user interface without displaying a scale that updates based on movement of the physical input mechanism and without updating display of the one or more user interface objects in response to detecting the input that is not directed to the physical input mechanism provides the user with more control to update the respective user interface in a manner that is based on the input, thereby providing additional control options without cluttering the user interface with additional user interface objects and providing improved feedback.
[0260] In some embodiments, detecting the intent to control (e.g., as discussed above at FIG. 7A) the physical input mechanism (e.g., 516) does not include detecting an input (e.g.,705b, 705c, and / or 705d) on (and / or that is touching and / or that is at a location corresponding to the surface of) the physical input mechanism. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0261] Note that details of the processes described above with respect to process 800 (e.g., FIGS.8A-8B) are also applicable in an analogous manner to other methods described herein. For example, process 600 optionally includes one or more of the characteristics of the various methods described above with reference to process 800.
[0262] FIGS.9A-9G illustrate exemplary user interfaces for changing the appearance of a user interface object in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS.10A-10B.
[0263] At FIG.9A, computer system 500 displays temperature control user interface 904. Temperature control user interface 904 corresponds to an air conditioning device (e.g., a device capable of heating and / or cooling an area). The air conditioning device has a neutral temperature value of 72 degrees. Computer system 500 is configured to control the air conditioning device while computer system 500 displays temperature control user interface 904. In some embodiments, the neutral temperature value is a range of temperature settings of the air conditioning device. In some embodiments, the neutral temperature value is based on one or more user preferences. In some embodiments, the neutral temperature value is a median temperature setting of the air conditioning device. In some embodiments, the neutral temperature value is a preset setting (e.g., the neutral temperature value is set by the manufacturer of the air conditioning device or computer system 500).
[0264] As illustrated in FIG.9A, temperature control user interface 904 includes temperature scale user interface object 912, temperature value user interface object 902, and temperature representation user interface object 906. Temperature scale user interface object 912 corresponds to a range of temperature settings of the air conditioning device. The leftmost portion of temperature scale user interface object 912 corresponds to a minimum temperature setting of the air conditioning device and the rightmost portion of temperature scale user interface object 912 corresponds to a maximum temperature setting of the air conditioning device. Temperature value user interface object 902 indicates the current temperature setting of the air conditioning device. At FIG.9A, temperature value user interface object 902 indicates that the current temperature setting of the air conditioning device is 55 degrees. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1)
[0265] Temperature representation user interface object 906 is also a representation of the current temperature setting of the air conditioning device. As explained in greater detail below, the size of temperature representation user interface object 906 corresponds to the temperature setting of the air conditioning device. Computer system 500 adjusts the size of the display of temperature representation user interface object 906 based on the relationship between the current temperature setting of the air conditioning device and the neutral temperature value of the air conditioning device. The closer the temperature setting of the air conditioning device is to the neutral temperature value, the smaller the size of temperature representation user interface object 906.
[0266] Further, the color of temperature representation user interface object 906 corresponds to the temperature setting of the air conditioning device. When the temperature setting of the air conditioning device is set to a cooler setting, computer system 500 displays temperature representation user interface object 906 with a cool color (e.g., blue, light blue, and / or teal). When the temperature setting of the air conditioning device is set to a warmer setting, computer system 500 displays temperature representation user interface object 906 with a warm color (e.g., orange, red, yellow).
[0267] At FIG.9A, computer system 500 displays temperature representation user interface object 906 as a dark blue color (e.g., as indicated by the density of the hatching within temperature representation user interface object 906). Computer system 500 adjusts the shade of the color of temperature representation user interface object 906 based on the relationship between the temperature setting of the air conditioning device and the neutral temperature value of the air conditioning device. Computer system 500 does not adjust the hue of temperature representation user interface object 906 as the relationship between the temperature setting of the air conditioning device and the neutral temperature value changes.
[0268] While the temperature setting of the air conditioning device is less than the neutral temperature value, computer system 500 displays temperature representation user interface object 906 as a cool color (e.g., blue, light blue, and / or teal). While the temperature setting of the air conditioning device value is less than the neutral temperature value, computer system 500 decreases the intensity (e.g., adds white, increases the tint) of the color of temperature 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) representation user interface object 906 as the difference between the temperature setting of the air conditioning device and the neutral temperature value decreases. Conversely, while the temperature setting of the air conditioning device is less than the neutral temperature value, computer system 500 increases the intensity (e.g., adds black, adds more shading, decreases the tint) of the color of temperature representation user interface object 906 as the difference between the temperature setting of the air conditioning device and the neutral temperature value of the air conditioning device increases. In some embodiments, the color of temperature representation user interface object 906 indicates a temperature category of the current temperature setting of the air conditioning device (e.g., temperature representation user interface object 906 has a blue color to indicate that the temperature setting of the air conditioning device is set to a cooler temperature and temperature representation user interface object 906 has a red color to indicate that the temperature setting of the air conditioning device is set to a warmer temperature.
[0269] While the temperature setting of the air conditioning device is greater than the neutral temperature value of the air conditioning device, computer system 500 displays temperature representation user interface objection 906 as a warm color (e.g., orange, red, yellow). While the temperature setting of the air conditioning device is greater than the neutral temperature value, computer system 500 increases the intensity (e.g., adds more shading, decreases the tint, adds black) of the color of temperature representation user interface object 906 as the difference between the temperature setting of the air conditioning device and the neutral temperature value of the air conditioning device increases. Conversely, while the temperature setting is greater than the neutral temperature value, computer system 500 decreases the intensity (e.g., adds white, increases the tint) of the color of temperature representation user interface object 906 as the difference between the temperature setting of the air conditioning device and the neutral temperature value of the air conditioning device decreases.
[0270] At FIG.9A, computer system 500 detects input 905a that corresponds to a rotation of the rotatable input mechanism 516. In some embodiments, input 905a corresponds to a tap gesture, swipe gesture, voice command, hand gesture, and / or gaze. In some embodiments, rotatable input mechanism 516 includes a display (e.g., a touch-sensitive display). In embodiments when rotatable input mechanism 516 includes a display, computer system 500 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) displays temperature control user interface 904 on the display of rotatable input mechanism 516. In some embodiments, computer system 500 displays temperature scale user interface object 912 around rotatable input mechanism 516.
[0271] At FIG.9B, in response to detecting input 905a, computer system 500 transmits instructions to the air conditioning device. In response to receiving the instructions from computer system 500, the air conditioning device increases its temperature setting from 55 degrees to 67 degrees. Accordingly, at FIG.9B, temperature value user interface object 902 indicates that the current temperature setting of the air conditioning device is 67 degrees. Further, at FIG.9B, computer system 500 moves the display of temperature value user interface object 902 rightward on temperature scale user interface object 912 (e.g., in comparison to the location of the display of temperature value user interface object 902 at FIG.9A) to represent the increase of the temperature setting of the air conditioning device. In some embodiments, the temperature setting of the air conditioning device is adjusted based on the direction of the detected rotation of rotatable input mechanism 516 (e.g., the temperature setting of the air conditioning device is increased if computer system 500 detects that rotatable input mechanism 516 is rotated in the clockwise direction or the temperature setting of the air conditioning device is decreased if computer system 500 detects that rotatable input mechanism 516 is rotated in the counterclockwise direction).
[0272] As explained above, computer system 500 decreases the size of temperature representation user interface object 906 as the difference between the temperature setting of the air conditioning device and the neutral temperature value of the air conditioning device decreases. Accordingly, at FIG.9B, because the difference between the temperature of the air conditioning device and the neutral temperature value of the air conditioning d...
Claims
Attorney Docket No.: 041501 (P64631WO1) CLAIMS What is claimed is:
1. A method, comprising: at a computer system that is in communication with a display component: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
2. The method of claim 1, further comprising: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) while displaying, via the display component, the indication that the computer system is configured to control the first device, detecting a first input directed to the computer system; and in response to detecting the first input directed to the computer system, causing a characteristic of the first device to be adjusted.
3. The method of any one of claims 1-2, further comprising: while displaying, via the display component, the indication that the computer system is configured to control the second device, detecting a second input directed to the computer system; and in response to detecting the second input directed to the computer system, causing a characteristic of the second device to be adjusted.
4. The method of any one of claims 1-3, wherein the first device is a first type of device, and wherein the second device is a second type of device that is different from the first type of device.
5. The method of any one of claims 1-4, wherein: while displaying the indication that the computer system is configured to control the first device, the computer system is configured to control a first type of characteristic of the first device; while displaying the indication that the computer system is configured to control the second device, the computer system is configured to control a second type of characteristic of the second device; and the first type of characteristic is different from the second type of characteristic.
6. The method of any one of claims 1-5, further comprising: displaying, via the display component, a plurality of controls, wherein the indication that the computer system is configured to control the first device is not displayed in an area that includes the plurality of controls, and wherein the indication that the computer system is configured to control the second device is not displayed in the area that includes the plurality of controls. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 7. The method of any one of claims 1-6, further comprising: in accordance with a determination that the second direction is not in a direction of a respective device that can be controlled by the computer system and the input was not detected by the computer system while the computer system was pointed in the first direction, ceasing to display the indication that the computer system is configured to control the first device.
8. The method of any one of claims 1-7, further comprising: in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was not detected by the computer system while the computer system was pointed in the first direction, forgoing displaying an indication that the computer system is configured to control a respective device.
9. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, the one or more programs including instructions for performing the method of any one of claims 1-8.
10. A computer system that is in communication with a display component, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 1-8.
11. A computer system that is in communication with a display component, comprising: means for performing the method of any one of claims 1-8.
12. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, the one or more programs including instructions for performing the method of any one of claims 1-8. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 13. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, the one or more programs including instructions for: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
14. A computer system that is in communication with a display component, comprising: one or more processors; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
15. A computer system that is in communication with a display component, comprising: means for detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) means, responsive to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, for displaying, via the display component, an indication that the computer system is configured to control the first device; means, while displaying the indication that the computer system is configured to control the first device, for detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and means, responsive to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time, for: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
16. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, the one or more programs including instructions for: detecting that the computer system is being pointed in a direction of a first device for at least a predetermined period of time; in response to detecting that the computer system is being pointed in the direction of the first device for at least the predetermined period of time, displaying, via the display component, an indication that the computer system is configured to control the first device; 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) while displaying the indication that the computer system is configured to control the first device, detecting that the computer system is being pointed in a second direction for at least the predetermined period of time, wherein the second direction is different from the first direction; and in response to detecting that the computer system is being pointed in the second direction for at least the predetermined period of time: in accordance with a determination that the second direction is a direction of a second device that can be controlled by the computer system and an input was detected by the computer system while the computer system was pointed in the first direction: displaying, via the display component, an indication that the computer system is configured to control the second device, wherein the second device is different from the first device; and ceasing display of the indication that the computer system is configured to control the first device; and in accordance with a determination that the second direction is not a direction of a respective device that can be controlled by the computer system and the input was detected by the computer system while the computer system was pointed in the first direction, continuing to display the indication that the computer system is configured to control the first device.
17. A method, comprising: at a computer system that is in communication with a display component and one or more input devices: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
18. The method of claim 17, wherein the first operation and the second operation are a same operation.
19. The method of any one of claims 17-18, wherein the first portion of the display is closer to the first region than the second portion of the display, and wherein the second portion of the display is closer to the second region than the first portion of the display.
20. The method of any one of claims 17-19, wherein the first set of one or more controls includes a respective control, wherein the second set of one or more controls includes the respective control, and wherein the respective control is initially displayed as being selected when the first set of one or more controls is displayed and when the second set of one or more controls is displayed.
21. The method of claim 20, further comprising: while displaying the respective control, detecting an input directed to the respective control; and in response to detecting the input directed to the respective control, causing output of a respective device to change, wherein the respective device is associated with the first and the second region.
22. The method of claim 20-21, wherein displaying the respective control as being selected includes displaying, via the display component, the respective control with a first brightness level concurrently with displaying a non-selected control with a second brightness level that is lower than the first brightness level. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 23. The method of any one of claims 17-22, further comprising: in response to detecting the intent to control the display and in accordance with a determination that the intent to control is directed to a third portion of the display that is different from the first portion and the second portion of the display, displaying, via the display component, a third set of one or more controls in the third portion of the display without displaying the first set of one or more controls and the second set of controls, wherein the third set of one or more controls includes a third control that, when selected, causes a third device that is associated with the third region and not the first region and second region to perform a third operation.
24. The method of any one of claims 17-23, further comprising: after detecting the intent to control the display: in accordance with a determination that the intent to control the display has not been detected for a predetermined period of time, forgoing displaying the first set of one or more controls and the second set of one or more controls.
25. The method of any one of claims 17-24, wherein detecting the intent to control the display includes detecting a gaze of the user that is directed to a second respective region.
26. The method of any one of claims 17-25, wherein detecting the intent to control the display includes detecting a body part of a user that is directed to a second respective region.
27. The method of any one of claims 17-26, wherein detecting the intent to control the display includes detecting an air gesture.
28. The method of any one of claims 17-27, wherein detecting the intent to control the display includes detecting that a user is in a position.
29. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) display component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 17-28.
30. A computer system that is in communication with a display component and one or more input devices, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 17-28.
31. A computer system that is in communication with a display component and one or more input devices, comprising: means for performing the method of any one of claims 17-28.
32. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 17-28.
33. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
34. A computer system that is in communication with a display component and one or more input devices, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
35. A computer system that is in communication with a display component and one or more input devices, comprising: means for detecting an intent to control a display; and means, responsive to detecting the intent to control the display, for: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation.
36. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for: detecting an intent to control a display; and in response to detecting the intent to control the display: in accordance with a determination that the intent to control is directed to a first portion of the display, displaying, via the display component, a first set of one or more controls in the first portion of the display without displaying a second set of one or more controls, wherein the first set of one or more controls includes a first control that, when selected, causes a first device that is associated with a first region and not a second region to perform a first operation; and in accordance with a determination that the intent to control is directed to a second portion of the display that is different from the first portion of the display, displaying, via the display component, the second set of one or more controls in the second portion of the display without displaying the first set of one or more controls, wherein the second set of one or more controls includes a second control that, when selected, causes a second device that is associated with the second region and not the first region to perform a second operation. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 37. A method, comprising: at a computer system that is in communication with a display component and one or more input devices: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
38. The method of claim 37, wherein the one or more inputs devices includes a first rotatable input mechanism, and wherein the first input is an input that is directed to the first rotatable input mechanism.
39. The method of any one of claims 37-38, wherein the one or more input devices includes a first touch-sensitive display, and wherein the first input is an input that is directed to the first touch-sensitive display. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 40. The method of any one of claims 37-39, wherein the one or more inputs devices includes a second rotatable input mechanism, and wherein display of the plurality of user interface objects at least partially circumscribes the second rotatable input mechanism.
41. The method of any one of claims 37-40, further comprising: while displaying, via the display component, the first user interface object that includes the first scale, detecting, via the one or more input devices, a second input; and in response to detecting the second input and in accordance with a determination that the second input corresponds to selection of the first user interface object, displaying, via the display component, a third scale corresponding to the first setting, wherein the third scale includes an enlarged representation of the first scale.
42. The method of claim 41, wherein the one or more input devices includes a second touch- sensitive display, and wherein the second input is an input that is directed to second touch- sensitive display.
43. The method of claim 41, wherein the one or more inputs devices includes a third rotatable input mechanism, and wherein the second input is an input that is directed to the third rotatable input mechanism.
44. The method of any one of claims 41-43, further comprising: in response to detecting the second input and in accordance with a determination that the second input corresponds to selection of the second user interface object, updating display of the second user interface object to include the second scale corresponding to the second setting.
45. The method of any one of claims 41-44, wherein the one or more inputs devices includes a fourth rotatable input mechanism, the method further comprising: while displaying, via the display component, the second user interface object that includes the second scale, detecting, via the one or more input devices, a third input; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in response to detecting the third input and in accordance with a determination that the third input corresponds to selection of the second user interface object, displaying, via the display component, a fourth scale corresponding to the second setting, wherein: the fourth scale includes an enlarged representation of the second scale; while the fourth scale is displayed, display of the fourth scale surrounds the fourth rotatable input mechanism by a first amount; and while the third scale is displayed, display of the third scale surrounds the fourth rotatable input mechanism by a second amount that is different from the first amount.
46. The method of claim 45, further comprising: in response to detecting the second input and in accordance with a determination that the second input corresponds to selection of the first user interface object, displaying, via the display component, an indication on the third scale at a location corresponding to a current value of the first setting.
47. The method of claim 46, further comprising: in response to detecting the third input and in accordance with a determination that the third input corresponds to selection of the second user interface object, displaying, via the display component, an indication on the fourth scale at a location corresponding to a current value of the second setting, wherein display of the indication on the fourth scale is visually different from display of the indication on the third scale.
48. The method of any one of claims 45-47, further comprising: while displaying, via the display component, the third scale or the fourth scale, detecting a rotation of a fifth rotatable input mechanism; and in response to detecting the rotation of the fifth rotatable input mechanism: in accordance with a determination that the third scale was displayed while the rotation of the physical input mechanism was detected, generating a first set of one or more haptics; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in accordance with a determination that the fourth scale was displayed while the rotation of the physical input mechanism was detected, generating a second set of one or more haptics that is different from the first set of one or more haptics.
49. The method of claim 48, further comprising: in response to detecting the first input, generating a third set of one or haptics that is different from the first set of one or more haptics and the second set of one or more haptics.
50. The method of any one of claims 41-49, further comprising: in response to detecting the second input and in accordance with a determination that the second input corresponds to selection of the first user interface object, displaying, via the display component, a numerical representation of the current value for the first setting concurrently with the third scale, wherein the numerical representation of the current value for the first setting was not previously displayed before the second input was detected.
51. The method of any one of claims 41-50, further comprising: while displaying, via the display component, the third scale, detecting an input corresponding to a movement input; and in response to detecting the input corresponding to the movement input: updating the current value for the first setting to a new value based on movement of the input corresponding to the movement input; and causing output of a device corresponding to the first setting to change.
52. The method of claim 51, wherein the computer system is in communication with a sixth rotatable input mechanism, and wherein the input corresponding to the movement input is a rotation of the sixth rotatable input mechanism.
53. The method of claim 52, wherein the sixth rotatable input mechanism includes a respective display, and wherein the respective display includes a user interface that is updated as the current value for the first setting is updated. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 54. The method of any one of claims 41-53, further comprising: after displaying, via the display component, the third scale corresponding to the first setting and in accordance with a determination that an input has not been detected for a predetermined period of time, displaying the plurality of controls.
55. The method of any one of claims 41-54, wherein the computer system is in communication with a seventh rotatable input mechanism, the method further comprising: in response to detecting an input directed to the seventh rotatable input mechanism, displaying the plurality of controls.
56. The method of claim 55, wherein displaying the plurality of controls in response to detecting an input directed to the seventh rotatable input mechanism includes displaying the first user interface object that includes the first scale and the second user interface object without displaying the second scale.
57. The method of any one of claims 37-56, wherein display of the second scale is visually different from display of the first scale.
58. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 37-57.
59. A computer system that is in communication with a display component and one or more input devices, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 37-57. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 60. A computer system that is in communication with a display component and one or more input devices, comprising: means for performing the method of any one of claims 37-57.
61. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 37-57.
62. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 63. A computer system that is in communication with a display component and one or more input devices, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
64. A computer system that is in communication with a display component and one or more input devices, comprising: displaying, via the display component: means for, a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) means for, a first representation of a current value for the first setting; and means for, a second representation of a current value for the second setting; means for, while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: means for, in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. means for, in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
65. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for: displaying, via the display component: a plurality of user interface objects including a first user interface object corresponding to a first setting and a second user interface object corresponding to a second setting that is different from the first setting; a first representation of a current value for the first setting; and a second representation of a current value for the second setting; while displaying the first user interface object, the second user interface object, the first representation, and the second representation, detecting, via the one or more input devices, a first input; and in response to detecting the first input: in accordance with a determination that the first input corresponds to selection of the first user interface object, updating display of the first user interface object to include a first 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) scale corresponding to the first setting without updating display of the second user interface object to include a second scale corresponding to the second setting; and. in accordance with a determination that the first input corresponds to selection of the second user interface object, updating display of the second user interface object to include a second scale corresponding to the second setting without updating display of the first user interface object to include the first scale.
66. A method, comprising: at a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism: while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 67. The method of claim 66, wherein detecting the intent to control the physical input mechanism includes detecting that a body part of a user is within a predetermined distance from an area that includes the physical input mechanism.
68. The method of claim 67, wherein the area surrounds at least a portion of the physical input mechanism.
69. The method of any one of claims 66-68, further comprising: in response to detecting the intent to control the physical input mechanism and in accordance with a determination that the physical input mechanism is moving, continuing to display the one or more respective user interface objects on the respective user interface.
70. The method of any one of claims 66-69, wherein the one or more user interface objects includes: a first user interface object that has a first visual appearance; and a second user interface object that has a second visual appearance that is different form the first visual appearance.
71. The method of claim 70, further comprising: while displaying the one or more user interface objects including the first user interface object and the second user interface object, detecting an input, via the one or more input devices, directed to the one or more user interface objects; in response to detecting the input directed to the one or more user interface objects: in accordance with a determination that the input directed to the one or more user interface objects is directed to the first user interface object, causing output of a first device to change without causing output of a second device to change, wherein the second device is different from the first device; and in accordance with a determination that the input directed to the one or more user interface objects is directed to the second user interface object, causing output of the second device to change without causing output of the first device to change. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 72. The method of any one of claims 66-71, wherein the one or more user interface objects are displayed in a portion of the respective user interface that is closer to a location of the physical input mechanism than another portion of the respective user interface.
73. The method of any one of claims 66-72, wherein the one or more user interface objects are displayed in an arrangement that indicates a direction that the rotatable input mechanism can be moved.
74. The method of any one of claims 66-73, wherein before detecting, via the one or more inputs devices, the intent to control the physical input mechanism, the respective user interface includes visual information and does not include the one or more user interface objects, and wherein, in response to detecting the intent to control the physical input mechanism, the one or more user interface objects are displayed concurrently with the visual information and are not overlaid on the visual information.
75. The method of any one of claims 66-74, further comprising: while displaying the one or more user interface objects, displaying an indication that a third user interface object of the one or more user interface objects is selected; while displaying the indication that the third user interface object is selected, detecting a rotation of the physical input mechanism; and in response to detecting the rotation of the physical input mechanism: displaying an indication that a fourth user interface object of the one or more user interface objects is selected; and ceasing to display the indication that the third user interface is selected.
76. The method of claim 75, further comprising: in response to detecting the rotation of the physical input mechanism, moving display of the one or more user interface objects.
77. The method of any one of claims 66-76, further comprising: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in response to detecting the rotation of the physical input mechanism while displaying the one or more user interface objects, forgoing causing a current value for a setting to be adjusted.
78. The method of any one of claims 66-77, further comprising: while displaying the one or more user interface objects, detecting an input that is directed to a fourth user interface object of the one or more user interface objects; and in response to detecting the input that is directed to the fourth user interface object, displaying a scale that includes an indication of a current value of a setting corresponding to the fourth user interface object.
79. The method of claim 78, further comprising: while displaying the scale that includes the indication of the current value of the setting corresponding to the fourth user interface object, detecting, via the one or more inputs, an input that is directed to the physical input mechanism; and in response to detecting the input that is directed to the physical input mechanism: adjusting the current value of the setting corresponding to the fourth user interface object; and causing output of a device that corresponds to the setting corresponding to the fourth user interface object.
80. The method of any one of claims 78-79, wherein the fourth user interface object is displayed at a respective location, the method further comprising: in response to detecting the input that is directed to the fourth user interface object, ceasing to display the fourth user interface object at the respective location, wherein the scale is displayed at the respective location.
81. The method of any one of claims 66-80, further comprising: while displaying the one or more user interface objects, detecting an input that is not directed to the physical input mechanism; in response to detecting the input that is not directed to the physical input mechanism, updating the respective user interface without displaying a scale that updates based on movement 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) of the physical input mechanism and without updating display of the one or more user interface objects.
82. The method of any one of claims 66-81, wherein detecting the intent to control the physical input mechanism does not include detecting an input on the physical input mechanism.
83. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism, the one or more programs including instructions for performing the method of any one of claims 66-82.
84. A computer system that is in communication with a display component, one or more input devices, and a physical input mechanism, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 66-82.
85. A computer system that is in communication with a display component, one or more input devices, and a physical input mechanism, comprising: means for performing the method of any one of claims 66-82.
86. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism, the one or more programs including instructions for performing the method of any one of claims 66-82.
87. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism, the one or more programs including instructions for: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
88. A computer system that is in communication with a display component, one or more input devices, and a physical input mechanism, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
89. A computer system that is in communication with a display component, one or more input devices, and a physical input mechanism, comprising: means for, while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; means for, in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: means for, in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) means for, in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and means for, in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, ceasing to display the one or more respective user interface objects on the respective user interface.
90. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component, one or more input devices, and a physical input mechanism, the one or more programs including instructions for: while displaying a respective user interface, detecting, via the one or more inputs devices, an intent to control the physical input mechanism; in response to detecting the intent to control the physical input mechanism, displaying, via the display component, one or more user interface objects on the respective user interface, wherein movement of the physical input mechanism causes the computer system to update display at least one of the one or more user interface objects; and while displaying the one or more respective user interface objects on the respective user interface: in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has not passed, continuing to display the one or more respective user interface objects on the respective user interface; in accordance with a determination that the physical input mechanism is not moving, the intent to control the physical input mechanism continues to be detected, and a predetermined period of time has passed, ceasing to display the one or more respective user interface objects on the respective user interface; and in accordance with a determination that the physical input mechanism is not moving and the intent to control the physical input mechanism does not continue to be detected, 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) ceasing to display the one or more respective user interface objects on the respective user interface.
91. A method, comprising: at a computer system that is in communication with a display component and one or more input devices: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 92. The method of claim 91, wherein the one or more inputs devices includes a physical input mechanism, and wherein the physical input mechanism includes the display component.
93. The method of claim 92, wherein the physical input mechanism is a rotatable input mechanism, and wherein the respective input includes a rotation of the rotatable input mechanism.
94. The method of any one of claims 91-93, wherein the first visual property is a size of the visual representation.
95. The method of any one of claims 91-94, wherein the first visual property indicates a value of the setting.
96. The method of any one of claims 91-95, wherein: in response to detecting the respective input and in accordance with the setting being the second type of setting and the respective input being in the second direction: the first visual property of the visual representation is changed in the second manner at a first rate; and the second visual property of the visual representation is changed in the third manner at a second rate that is slower than the first rate.
97. The method of any one of claims 91-96, wherein changing the first visual property of the visual representation in the first manner includes expanding a size of the visual representation, and wherein changing the first visual property of the visual representation in the second manner includes compressing the size of the visual representation.
98. The method of claim 97, wherein the size of the visual representation is expanded from a centroid of the visual representation, and wherein the size of the visual representation is compressed towards the centroid of the visual representation. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 99. The method of any one of claims 91-98, wherein the second visual property is a color of the visual representation.
100. The method of any one of claims 91-99, wherein the second visual property indicates a category that corresponds to the setting.
101. The method of any one of claims 91-100, further comprising: after detecting the respective input, detecting, via the one or more input devices, a second input that is different from the respective input, wherein the second input is in the same direction as the respective input; and in response to detecting the second input: in accordance with the setting being the first type of setting, forgoing changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting, changing the second visual property of the visual representation in a fourth manner.
102. The method of claim 101, wherein, after the second visual property of the visual representation is changed in the fourth manner, the first visual property of the visual representation is the same as the first visual property was before the respective input was detected.
103. The method of any one of claims 91-102, wherein, after the second visual property of the visual representation is changed in the third manner, the first visual property is at a terminal value for the first visual property.
104. The method of any one of claims 91-103, wherein the computer system is in communication with a first device, the method further comprising: in response to detecting the respective input, causing output of the first device to be adjusted. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 105. The method of any one of claims 91-104, wherein the second type of setting is a type of setting that impacts temperature of the environment, and wherein the first type of setting is not a type of setting that impacts temperature of the environment.
106. The method of any one of claims 91-105, wherein the setting is a first setting, the method further comprising: while displaying the user interface that includes the visual representation of the setting, detecting a request to select a second setting that is different from the first setting; and in response to detecting the request to select the second setting, ceasing to display the visual representation of the value of the setting.
107. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 91-106.
108. A computer system that is in communication with a display component and one or more input devices, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 91-106.
109. A computer system that is in communication with a display component and one or more input devices, comprising: means for performing the method of any one of claims 91-106.
110. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 91-106. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 111. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
112. A computer system that is in communication with a display component and one or more input devices, comprising: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
113. A computer system that is in communication with a display component and one or more input devices, comprising: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) means for, displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; means for, while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: means for, in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; means for, in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; means for, in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and means for, in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
114. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and one or more input devices, the one or more programs including instructions for: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) displaying, via the display component, a visual representation of a value of a setting, wherein the visual representation includes a first visual property and a second visual property that are displayed based on the value of the setting, and wherein the first visual property is different from the second visual property; while displaying the visual representation including the first visual property and the second visual property, detecting, via the one or more input devices, a respective input; and in response to detecting the respective input: in accordance with the setting being a first type of setting and the respective input being in a first direction, changing the first visual property of the visual representation in a first manner without changing the second visual property of the visual representation; in accordance with the setting being the first type of setting and the respective input being in a second direction that is different from the first direction, changing the first visual property of the visual representation in a second manner without changing the second visual property of the visual representation, wherein the first manner is different from the second manner; in accordance with the setting being a second type of setting that is different from the first type of setting and the respective input being in the first direction, changing the first visual property of the visual representation in the first manner without changing the second visual property of the visual representation; and in accordance with the setting being the second type of setting and the respective input being in the second direction, changing the first visual property of the visual representation in the second manner and changing the second visual property of the visual representation in a third manner that is different from the first manner and the second manner.
115. A method, comprising: at a computer system that is in communication with a display component and a physical input mechanism: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination that the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
116. The method of claim 115, wherein the physical input mechanism is a rotatable input mechanism, and wherein the input directed to the physical input mechanism is a rotating input.
117. The method of any one of claims 115-116, wherein the first side is a side that is on an opposite side of a display than the second side.
118. The method of any one of claims 115-117, wherein: the first portion is adjacent to the second portion; the third portion is adjacent to the second portion; the first portion is closer to the first side than the second side; and the third portion is closer to the second side than the first side.
119. The method of any one of claims 115-118, wherein: the physical input mechanism is a first physical input mechanism; 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) the computer system is in communication with a second physical input mechanism that is different from the first physical input mechanism; and the method further comprises: while displaying the one or more user interface objects in the first portion of the respective user interface and while the information is displayed in the second portion and the third portion of the respective user interface, detecting an input that is directed to the second physical input mechanism; and in response to detecting the input that is directed to the second physical input mechanism, concurrently displaying, via the display component, one or more respective user interface objects in the third portion of the respective user interface with the one or more user interface objects in the first portion of the respective user interface, wherein the one or more respective user objects in the third portion are updated based on one or more inputs to the second physical input mechanism.
120. The method of claim 119, further comprising: in response to detecting the input that is directed to the second physical input mechanism, moving display of the information such that the information is displayed in the second portion of the respective user interface without being displayed in the first portion and the third portion of the respective user interface.
121. The method of any one of claims 115-120, wherein display of the one or more user interface objects does not overlap with display of the information.
122. The method of any one of claims 115-121, wherein the information includes navigation information.
123. The method of claim 122, wherein the navigation information includes a map and a route to a destination, and wherein the route is updated based on movement of the computer system.
124. The method of any one of claims 115-123, further comprising: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) while displaying the one or more user interface objects that are updated based on one or more inputs directed to the physical input mechanism, detecting an input directed to the one or more user interface objects; and in response to detecting the input directed to the one or more user interface objects, causing output of a first device to be adjusted, wherein the first device is in communication with the computer system.
125. The method of claim 124, further comprising: in response to detecting the input directed to the one or more user interface objects, forgoing causing the information to be adjusted.
126. The method of claim 124, wherein the first device is associated with a particular user that is associated with the first side or a particular user that is associated with the second side.
127. The method of any one of claims 124-126, wherein: in accordance with a determination the physical input mechanism is associated with the first side, the first device is associated with the first side and is not associated with the second side; and in accordance with a determination the physical input mechanism is associated with the second side, the first device is associated with the second side is not associated with the second side.
128. The method of any one of claims 124-127, wherein: in accordance with a determination that the physical input mechanism is associated with the first side, output of the first device is directed to the first side; and in accordance with a determination that the physical input mechanism is associated with the second side, output of the first device is directed to the second side.
129. The method of any one of claims 115-128, further comprising: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) while displaying, via the display component, the one or more user interface objects that are updated based on one or more inputs directed to the physical input mechanism, detecting whether a first set of one or more criteria is met; and in response to detecting whether the first set of one or more conditions is met and in accordance with a determination that the first set of one or more conditions is met, ceasing display of the one or more user interface objects that are updated based on one or more inputs directed to the physical input mechanism, wherein the first set of one or more conditions includes a condition that is met when a first input has not been directed to the physical input mechanism for a first period of time while the one or more user interface objects are displayed.
130. The method of claim 129, further comprising: while displaying, via the display component, the one or more user interface objects that are updated based on one or more inputs directed to the physical input mechanism and while the information is not displayed in the first portion or the third portion, detecting whether a second set of one or more conditions is met; and in response to detecting whether the second set of one or more conditions is met and in accordance with a determination that the second set of one or more conditions is met: ceasing display of the one or more user interface objects that are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the first portion, the second portion, and the third portion, wherein the second set of one or more conditions includes a condition that is met when a second input has not been directed to the physical input mechanism for a second period of time while the one or more user interface objects are displayed.
131. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a physical input mechanism, the one or more programs including instructions for performing the method of any one of claims 115-130. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 132. A computer system that is in communication with a display component and a physical input mechanism, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 115-130.
133. A computer system that is in communication with a display component and a physical input mechanism, comprising: means for performing the method of any one of claims 115-130.
134. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a physical input mechanism, the one or more programs including instructions for performing the method of any one of claims 115-130.
135. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a physical input mechanism, the one or more programs including instructions for: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
136. A computer system that is in communication with a display component and a physical input mechanism, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
137. A computer system that is in communication with a display component and a physical input mechanism, comprising: means for, displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; means for, while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: means for, displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and means for moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: means for, displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and means for moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
138. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a physical input mechanism, the one or more programs including instructions for: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) displaying, via the display component, a respective user interface that includes information that is displayed in a first portion of the respective user interface, a second portion of the respective user interface, and a third portion of the respective user interface; while displaying the information in the first, second, and third portions of the respective user interface, detecting an input directed to the physical input mechanism; and in response to detecting the input directed to the physical input mechanism: in accordance with a determination the physical input mechanism is associated with a first side: displaying, via the display component, one or more user interface objects in the first portion of the respective user interface, wherein the one or more user interface objects are updated based on one or more inputs directed to the physical input mechanism; and moving display of the information such that the information is displayed in the second portion and the third portion of the respective user interface; and in accordance with a determination the physical input mechanism is associated with a second side that is different from the first side: displaying, via the display component, the one or more user interface objects in the third portion of the respective user interface; and moving display of the information such that the information is displayed in the first portion and the second portion of the respective user interface.
139. A method, comprising: at a computer system that is in communication with a display component and a respective device: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
140. The method of claim 139, wherein the input is an input on a first physical input mechanism, and wherein the computer system is in communication with the first physical input mechanism.
141. The method of any one of claims 139-140, wherein detecting the input includes detecting that the respective device is at a predetermined location in the physical environment.
142. The method of any one of claims 139-141, further comprising: before detecting the input, detecting a presence of a user; and in response to detecting the presence of the user, displaying, via the display component, an indication of a greeting for the user.
143. The method of claim 142, further comprising: in response to detecting the presence of the user, modifying one or more settings based on a set of one or more preferences of the user.
144. The method of claim 142-143, wherein the one or more controls include: a first control that is displayed with a representation of a first value, wherein the first value is selected at least based on one or more first preferences in the set of one or more preferences of the user; and a second control that is displayed with a representation of a second value, wherein the first value is selected at least based on one or more second preferences in the set of one or more preferences of the user, and wherein the one or more second preferences are different from the one or more first preferences.
145. The method of any one of claims 139-144, wherein the respective device is displaying a first user interface while the input was detected, and wherein causing the respective device to 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) display one or more controls includes causing the respective device to replace display of the first user interface with display of the one or more controls.
146. The method of any one of claims 139-145, wherein the display component is displaying information over a first portion of a second user interface, a second portion of the second user interface, and a third portion of the second user interface, the method further comprising: in response to detecting the input and in accordance with a determination that the set of one or more criteria is not met, moving the information, such that the information is displayed on the first portion and the second portion of the second user interface and is not displayed on the third portion of the second user interface, wherein the one or more controls are displayed in the third portion of the second user interface.
147. The method of any one of claims 139-146, wherein the computer system is in communication with a second physical input mechanism and a first device, the method further comprising: detecting an input directed to the second physical input mechanism; and in response to detecting the input directed to the second physical input mechanism: updating display of at least one of the one or more controls based on the input that is directed to the second physical input mechanism; and causing the first device to provide output based on the input directed to the second physical input mechanism.
148. The method of claim 147, wherein the input directed to the second physical input mechanism is detected while causing the respective device to display the one or more controls, the method further comprising: in response to detecting the input directed to the second physical input mechanism, updating, via the display component, display of at least one of the one or more controls based on the input that is directed to the second physical input mechanism.
149. The method of claim 148, wherein the input directed to the second physical input mechanism is detected while displaying, via the display component, the one or more controls and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) while not causing the respective device to display the one or more controls, the method further comprising: in response to detecting the input directed to the second physical input mechanism, forgoing causing a user interface of the respective device to be updated.
150. The method of any one of claims 139-149, further comprising: while the respective device is displaying the one or more controls, detecting a first set of one or more inputs including an input directed to a first control not included in the one or more controls; and in response to detecting the set of one or more inputs including the input directed to the first control not included in the one or more controls, causing a second device to provide output based on the input directed to the first control.
151. The method of any one of claims 139-150, wherein the respective device is caused to display the one or more controls in a first arrangement, and wherein the computer system displays, via the display component, the one or more controls in a second arrangement that is different from the first arrangement.
152. The method of any one of claims 139-151, wherein the one or more controls are displayed with a first visual appearance while the respective device is caused to display the one or more controls, and wherein the one or more controls are displayed with a second visual appearance that is different from the first visual appearance while the computer system is displaying the one or more controls via the display component.
153. The method of any one of claims 139-152, wherein: the one or more controls occupy a first percentage of a display of the respective device while the respective device is caused to display the one or more controls; the one or more controls occupy a second percentage of a display that is communication with the computer system while the computer system is displaying the one or more controls via the display component; and the second percentage is smaller than the first percentage. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 154. The method of any one of claims 139-153, wherein the computer system is in communication with a third physical input mechanism, and wherein the predetermined location is a location that is near the third physical input mechanism.
155. The method of any one of claims 139-154, wherein the computer system is in communication with a fourth physical input mechanism, and wherein the predetermined location is above the fourth physical input mechanism.
156. The method of claim 155, wherein the fourth physical input mechanism has a physically pressed state and a physically unpressed state.
157. The method of any one of claims 139-156, wherein the set of one or more criteria includes a criterion that is met when the respective device is magnetically connected.
158. The method of any one of claims 139-157, wherein, while the respective device is at the predetermined location, the respective device is in a charging state.
159. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device, the one or more programs including instructions for performing the method of any one of claims 139-158.
160. A computer system that is in communication with a display component and a respective device, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 139-158. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 161. A computer system that is in communication with a display component and a respective device, comprising: means for performing the method of any one of claims 139-158.
162. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device, the one or more programs including instructions for performing the method of any one of claims 139-158.
163. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device, the one or more programs including instructions for: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
164. A computer system that is in communication with a display component and a respective device, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting an input; and in response to detecting the input: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
165. A computer system that is in communication with a display component and a respective device, comprising: means for detecting an input; and in response to detecting the input: means for, in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and means for, in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
166. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device, the one or more programs including instructions for: detecting an input; and in response to detecting the input: in accordance with a determination that a set of one or more criteria is met, causing the respective device to display one or more controls, wherein the set of one or more criteria includes a criterion that is met when the respective device is at a predetermined location; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in accordance with a determination that the set of one or more criteria is not met, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
167. A method, comprising: at a computer system that is in communication with a display component and a respective device: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
168. The method of claim 167, wherein detecting the input includes detecting an input directed to a first physical input mechanism, and wherein the computer system is in communication with the first physical input mechanism.
169. The method of any one of claims 167-168, wherein detecting the input includes detecting that the respective device is at a predetermined location in the physical environment.
170. The method of any one of claims 167-169, further comprising: In response to detecting the input and in accordance with a determination that the respective user interface is the first type of user interface, displaying, via the display component, the one or more controls.
171. The method of claim 170, further comprising: 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in response to detecting the input and in accordance with a determination that the respective user interface is the first type of user interface, causing the respective device to cease displaying at least a portion of the respective user interface.
172. The method of any one of claims 167-171, wherein the second type of user interface is a communication user interface.
173. The method of any one of claims 167-171, wherein the second type of user interface is a user interface that includes sensitive data.
174. The method of any one of claims 167-173, wherein the one or more controls are displayed with a first visual appearance while the respective device is displaying the one or more controls, wherein the one or more controls are displayed with a second visual appearance while the one or more controls are being displayed via the display component, and wherein the second visual appearance is different from the first visual appearance.
175. The method of any one of claims 167-174, further comprising: in response to detecting the input and in accordance with a determination that the respective device is not at a predetermined location, displaying, via the display component, the one or more controls.
176. The method of claim 175, wherein the computer system is in communication with a first physical input mechanism, and wherein the predetermined location is a location that is near the first physical input mechanism.
177. The method of claims 175-176, wherein the computer system is in communication with a second physical input mechanism, and wherein the predetermined location is a location that is above the second physical input mechanism. 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) 178. The method of any one of claims 175-177, wherein detecting that the respective device is at the predetermined location includes detecting that the respective device is magnetically connected to the predetermined location.
179. The method of any one of claims 175-178, wherein the respective device is in a charging state while at the predetermined location.
180. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device, the one or more programs including instructions for performing the method of any one of claims 167-179.
181. A computer system that is in communication with a display component and a respective device, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 167-179.
182. A computer system that is in communication with a display component and a respective device, comprising: means for performing the method of any one of claims 167-179.
183. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device, the one or more programs including instructions for performing the method of any one of claims 167-179.
184. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) communication with a display component and a respective device, the one or more programs including instructions for: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
185. A computer system that is in communication with a display component and a respective device, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
186. A computer system that is in communication with a display component and a respective device, comprising: means for, while the respective device is displaying a respective user interface, detecting an input; and 4861-8850-6339.2Attorney Docket No.: 041501 (P64631WO1) in response to detecting the input: means for, in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and means for, in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls.
187. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display component and a respective device, the one or more programs including instructions for: while the respective device is displaying a respective user interface, detecting an input; and in response to detecting the input: in accordance with a determination that the respective user interface is a first type of user interface, causing the respective device to display one or more controls; and in accordance with a determination that the respective user interface is a second type of user interface that is different from the first type of user interface, displaying, via the display component, the one or more controls without causing the respective device to display the one or more controls. 4861-8850-6339.2