Techniques for providing controls

Abstract

The present disclosure generally relates to user interfaces.

Description

Cross-references to related applications

[0001] This application claims priority to U.S. Nonprovisional Patent Application Serial No. 18 / 896,574, entitled "Techniques for Providing Controls," filed September 25, 2024; U.S. Provisional Patent Application Serial No. 63 / 541,818, entitled "Techniques for Providing Controls," filed September 30, 2023; and U.S. Provisional Patent Application Serial No. 63 / 541,808, entitled "User Interfaces for Displaying Controls," filed September 30, 2023, the entire contents of which are incorporated herein by reference for all purposes. Background Technology

[0002] Electronic devices typically provide controls. These controls are used to perform operations. Electronic devices usually display controls that enable such devices to respond to user input. Such responses can depend on the characteristics of the detected input and the context in which the user input was detected. Summary of the Invention

[0003] Some technologies used to provide controls for electronic devices are often cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may include multiple buttons or keystrokes. These existing technologies require more time than necessary, resulting in wasted user time and device power. This latter consideration is particularly important in battery-powered devices.

[0004] Therefore, the present invention provides electronic devices with faster and more efficient methods and interfaces for providing controls. Such methods and interfaces optionally supplement or replace other methods for providing controls. These methods and interfaces reduce the cognitive burden on the user and result in more efficient human-computer interfaces. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charging cycles.

[0005] In some embodiments, a method is described that is performed at a computer system communicating with a display component. In some embodiments, the method includes: detecting a change in the coupling state of the computer system; and in response to detecting the change in the coupling state of the computer system: displaying a first user interface including one or more controls of the first set of criteria via the display component based on determining that one or more criteria of a first set of criteria are met, wherein the first set of criteria includes criteria met when it is determined that the computer system is currently magnetically coupled to a corresponding region; and displaying a second user interface including one or more controls of the second set of criteria via the display component based on determining that one or more criteria of a second set of criteria are met, wherein the second set of criteria is different from the first set of criteria.

[0006] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display component. In some embodiments, the one or more programs include instructions for: detecting a change in the coupling state of the computer system; and in response to detecting the change in the coupling state of the computer system: displaying a first user interface including one or more controls of the first set of one set of one set of criteria, wherein the first set of one or more criteria includes criteria satisfied when it is determined that the computer system is currently magnetically coupled to a corresponding region; and displaying a second user interface including one or more controls of the second set of one set of one set of one set of criteria, wherein the second set of one or more criteria includes criteria satisfied when it is determined that the computer system is currently not magnetically coupled, wherein the second set of one or more controls is different from the first set of one or more controls.

[0007] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display component. In some embodiments, the one or more programs include instructions for: detecting a change in the coupling state of the computer system; and in response to detecting the change in the coupling state of the computer system: displaying a first user interface including one or more controls of the first set of criteria via the display component, based on determining that one or more criteria are met, wherein the first set of criteria includes criteria met when it is determined that the computer system is currently magnetically coupled to a corresponding region; and displaying a second user interface including one or more controls of the second set of criteria, wherein the second set of criteria is different from the first set of criteria, based on determining that one or more criteria are met, wherein the second set of criteria includes criteria met when it is determined that the computer system is currently not magnetically coupled.

[0008] In some embodiments, a computer system communicating with a display component is described. In some embodiments, the computer system communicating with the display component includes one or more processors and memory configured to execute one or more programs by the one or more processors. In some embodiments, the one or more programs include instructions for: detecting a change in the coupling state of the computer system; and in response to detecting the change in the coupling state of the computer system: displaying a first user interface including one or more controls of the first set via the display component based on determining that a first set of one or more criteria is met, wherein the first set of one or more criteria includes criteria met when it is determined that the computer system is currently magnetically coupled to a corresponding region; and displaying a second user interface including one or more controls of the second set via the display component based on determining that a second set of one or more criteria is met, wherein the second set of one or more controls is different from the first set of one or more controls.

[0009] In some embodiments, a computer system communicating with a display component is described. In some embodiments, the computer system communicating with the display component includes components for performing each of the following steps: detecting a change in the coupling state of the computer system; and in response to detecting the change in the coupling state of the computer system: displaying a first user interface including one or more controls of the first set of one ...

[0010] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to execute by one or more processors of a computer system communicating with a display component. In some embodiments, the one or more programs include instructions for: detecting a change in the coupling state of the computer system; and in response to detecting the change in the coupling state of the computer system: displaying a first user interface including one or more controls of the first set of criteria via the display component, based on determining that one or more criteria are met, wherein the first set of criteria includes criteria met when it is determined that the computer system is currently magnetically coupled to a corresponding region; and displaying a second user interface including one or more controls of the second set of criteria, wherein the second set of criteria is different from the first set of criteria, based on determining that one or more criteria are met.

[0011] In some embodiments, a method is described that is performed at a computer system communicating with a display component. In some embodiments, the method includes: displaying via the display component a first user interface including first content and a first plurality of selection indicators, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; detecting a change in the coupling state of the computer system while the first user interface including the first content, the first plurality of selection indicators, and the selection indicator indicating that the first content is selected is displayed via the display component; and in response to detecting the change in the coupling state of the computer system: stopping the display of the selection indicator indicating that the first content is selected; and displaying via the display component a second user interface including second content and a second plurality of selection indicators, the second plurality of selection indicators including a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

[0012] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display component. In some embodiments, the one or more programs include instructions for: displaying via the display component a first user interface including first content and a first plurality of selection indicators, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; detecting a change in the coupling state of the computer system while the first user interface including the first content, the first plurality of selection indicators, and the selection indicator indicating that the first content is selected is displayed via the display component; and in response to detecting the change in the coupling state of the computer system: stopping the display of the selection indicator indicating that the first content is selected; and displaying via the display component a second user interface including second content and a second plurality of selection indicators, the second plurality of selection indicators including a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

[0013] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display component. In some embodiments, the one or more programs include instructions for: displaying, via the display component, a first user interface including first content and a first plurality of selection indicators, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; detecting a change in the coupling state of the computer system while the first user interface including the first content, the first plurality of selection indicators, and the selection indicator indicating that the first content is selected is displayed via the display component; and, in response to detecting the change in the coupling state of the computer system: stopping the display of the selection indicator indicating that the first content is selected; and displaying, via the display component, a second user interface including second content and a second plurality of selection indicators, the second plurality of selection indicators including a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

[0014] In some embodiments, a computer system communicating with a display component is described. In some embodiments, the computer system communicating with the display component includes one or more processors and memory configured to execute one or more programs by the one or more processors. In some embodiments, the one or more programs include instructions for: displaying a first user interface via the display component including first content and a first plurality of selection indicators, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; detecting a change in the coupling state of the computer system while displaying the first user interface including the first content, the first plurality of selection indicators, and the selection indicator indicating that the first content is selected; and in response to detecting the change in the coupling state of the computer system: stopping the display of the selection indicator indicating that the first content is selected; and displaying a second user interface via the display component including second content and a second plurality of selection indicators, the second plurality of selection indicators including a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

[0015] In some embodiments, a computer system communicating with a display component is described. In some embodiments, the computer system communicating with the display component includes components for performing each of the following steps: displaying a first user interface via the display component, including first content and a first plurality of selection indicators, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; detecting a change in the coupling state of the computer system while displaying the first user interface via the display component, including the first content, the first plurality of selection indicators, and the selection indicator indicating that the first content is selected; and in response to detecting the change in the coupling state of the computer system: stopping the display of the selection indicator indicating that the first content is selected; and displaying a second user interface via the display component, including second content and a second plurality of selection indicators, the second plurality of selection indicators including a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

[0016] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to execute by one or more processors of a computer system communicating with a display component. In some embodiments, the one or more programs include instructions for: displaying via the display component a first user interface including first content and a first plurality of selection indicators, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; detecting a change in the coupling state of the computer system while the first user interface including the first content, the first plurality of selection indicators, and the selection indicator indicating that the first content is selected is displayed via the display component; and in response to detecting the change in the coupling state of the computer system: stopping the display of the selection indicator indicating that the first content is selected; and displaying via the display component a second user interface including second content and a second plurality of selection indicators, the second plurality of selection indicators including a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

[0017] In some embodiments, a method is described that is executed at a computer system communicating with a display component, a first group of one or more devices excluding an object, a second group of one or more devices excluding an object, and one or more input devices. In some embodiments, the method includes: detecting a request to identify the location of an object via one or more input devices; and in response to detecting the request to identify the location of an object: based on determining that the first group of one or more devices meets one or more criteria of the corresponding group and that the second group of one or more devices does not meet one or more criteria of the corresponding group, causing the first group of one or more devices to provide output indicating the location of the object in the environment, while not causing the second group of one or more devices to provide output indicating the location of the object in the environment; and based on determining that the first group of one or more devices does not meet one or more criteria of the corresponding group and that the second group of one or more devices meets one or more criteria of the corresponding group, causing the second group of one or more devices to provide output indicating the location of the object in the environment, while not causing the first group of one or more devices to provide output indicating the location of the object in the environment.

[0018] In some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display component, one or more devices of a first group excluding an object, one or more devices of a second group excluding an object, and one or more input devices. In some embodiments, the one or more programs include instructions for: detecting a request to identify the location of an object via one or more input devices; and, in response to detecting the location of the object, causing the first group of one or more devices to provide output indicating the location of the object in the environment, while not causing the second group of one or more devices to provide output indicating the location of the object in the environment, based on the determination that the first group of one or more devices meets one or more criteria of the corresponding group and the second group of one or more devices does not meet one or more criteria of the corresponding group; and causing the second group of one or more devices to provide output indicating the location of the object in the environment, while not causing the first group of one or more devices to provide output indicating the location of the object in the environment, based on the determination that the first group of one or more devices does not meet one or more criteria of the corresponding group and the second group of one or more devices meets one or more criteria of the corresponding group.

[0019] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display component, one or more devices of a first group excluding an object, one or more devices of a second group excluding an object, and one or more input devices. In some embodiments, the one or more programs include instructions for: detecting a request to identify the location of an object via one or more input devices; and, in response to detecting the location of the object, causing the first group of one or more devices to provide output indicating the location of the object in the environment, while not causing the second group of one or more devices to provide output indicating the location of the object in the environment, based on the determination that the first group of one or more devices meets one or more criteria of the corresponding group and the second group of one or more devices meets one or more criteria of the corresponding group; and causing the second group of one or more devices to provide output indicating the location of the object in the environment, while not causing the first group of one or more devices to provide output indicating the location of the object in the environment, based on the determination that the first group of one or more devices does not meet one or more criteria of the corresponding group and the second group of one or more devices meets one or more criteria of the corresponding group.

[0020] In some embodiments, a computer system is described that communicates with a display component, a first group of one or more devices excluding an object, a second group of one or more devices excluding an object, and one or more input devices. In some embodiments, the computer system communicating with the display component, the first group of one or more devices excluding an object, the second group of one or more devices excluding an object, and one or more input devices includes one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: detecting a request to identify the location of an object via one or more input devices; and, in response to detecting the location of the object, causing the first group of one or more devices to provide output indicating the location of the object in the environment, while not causing the second group of one or more devices to provide output indicating the location of the object in the environment, based on the determination that the first group of one or more devices does not meet the corresponding group of one or more criteria and the second group of one or more devices does not meet the corresponding group of one or more criteria; and causing the second group of one or more devices to provide output indicating the location of the object in the environment, while not causing the first group of one or more devices to provide output indicating the location of the object in the environment, based on the determination that the first group of one or more devices does not meet the corresponding group of one or more criteria and the second group of one or more devices meets the corresponding group of one or more criteria.

[0021] In some embodiments, a computer system is described that communicates with a display component, a first group of one or more devices excluding an object, a second group of one or more devices excluding an object, and one or more input devices. In some embodiments, the computer system communicating with the display component, the first group of one or more devices excluding an object, the second group of one or more devices excluding an object, and one or more input devices includes components for performing each of the following steps: detecting a request to identify the location of an object via one or more input devices; and in response to detecting the location of an object: based on determining that the first group of one or more devices meets one or more criteria of the corresponding group and that the second group of one or more devices does not meet one or more criteria of the corresponding group, causing the first group of one or more devices to provide output indicating the location of the object in the environment, while not causing the second group of one or more devices to provide output indicating the location of the object in the environment; and based on determining that the first group of one or more devices does not meet one or more criteria of the corresponding group and that the second group of one or more devices meets one or more criteria of the corresponding group, causing the second group of one or more devices to provide output indicating the location of the object in the environment, while not causing the first group of one or more devices to provide output indicating the location of the object in the environment.

[0022] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to execute by one or more processors of a computer system communicating with a display component, one or more devices of a first group excluding an object, one or more devices of a second group excluding an object, and one or more input devices. In some embodiments, the one or more programs include instructions for: detecting a request to identify the location of an identified object via one or more input devices; and, in response to detecting the location of the identified object, causing the first group of one or more devices to provide output indicating the location of the object in the environment, while not causing the second group of one or more devices to provide output indicating the location of the object in the environment, based on the determination that the first group of one or more devices does not meet the corresponding group of one or more criteria and the second group of one or more devices does not meet the corresponding group of one or more criteria; and causing the second group of one or more devices to provide output indicating the location of the object in the environment, while not causing the first group of one or more devices to provide output indicating the location of the object in the environment, based on the determination that the first group of one or more devices does not meet the corresponding group of one or more criteria and the second group of one or more devices meets the corresponding group of one or more criteria.

[0023] In some embodiments, a method is described that is performed at a computer system communicating with a first group of one or more devices that do not include an object. In some embodiments, the method includes: detecting a change in the location relationship between a first user and an object while the first group of one or more devices provides a first output indicating where the object is located; and in response to detecting the change in the location relationship between the first user and the object, causing the first group of one or more devices to provide a second output indicating where the object is located, wherein the second output is different from the first output.

[0024] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs executed by one or more processors of a computer system configured to communicate with one or more devices, excluding an object. In some embodiments, the one or more programs include instructions for: detecting a change in the location relationship between a first user and an object when the first group of one or more devices provides a first output indicating where the object is located; and, in response to detecting the change in the location relationship between the first user and the object, causing the first group of one or more devices to provide a second output indicating where the object is located, wherein the second output is different from the first output.

[0025] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs executed by one or more processors of a computer system configured to communicate with one or more devices, excluding an object. In some embodiments, the one or more programs include instructions for: detecting a change in the location relationship between a first user and the object when the first group of one or more devices provides a first output indicating where the object is located; and, in response to detecting the change in the location relationship between the first user and the object, causing the first group of one or more devices to provide a second output indicating where the object is located, wherein the second output is different from the first output.

[0026] In some embodiments, a computer system is described that communicates with one or more devices in a first group that do not include an object. In some embodiments, the computer system communicating with one or more devices in a first group that do not include an object includes one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: detecting a change in the location relationship between a first user and an object when the one or more devices in the first group provide a first output indicating where the object is located; and, in response to detecting the change in the location relationship between the first user and the object, causing the one or more devices in the first group to provide a second output indicating where the object is located, wherein the second output is different from the first output.

[0027] In some embodiments, a computer system is described that communicates with a first group of one or more devices that do not include an object. In some embodiments, the computer system communicating with the first group of one or more devices that does not include an object includes components for performing each of the following steps: detecting a change in the location relationship between a first user and the object when the first group of one or more devices provides a first output indicating where the object is located; and in response to detecting the change in the location relationship between the first user and the object, causing the first group of one or more devices to provide a second output indicating where the object is located, wherein the second output is different from the first output.

[0028] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to execute by one or more processors of a computer system communicating with one or more devices, excluding an object. In some embodiments, the one or more programs include instructions for: detecting a change in the location relationship between a first user and the object when the first group of one or more devices provides a first output indicating where the object is located; and, in response to detecting the change in the location relationship between the first user and the object, causing the first group of one or more devices to provide a second output indicating where the object is located, wherein the second output is different from the first output.

[0029] In some embodiments, a method is described that is performed at a computer system communicating with a first group of one or more devices. In some embodiments, the method includes: detecting a first movement of a user while the first group of one or more devices are operated in a first manner; and in response to detecting the first movement of the user: operating the first group of one or more devices in a second manner different from the first manner based on determining the existence of a first context; and operating the first group of one or more devices in a third manner different from the second and first manner based on determining the existence of a second context.

[0030] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more devices in a first group. In some embodiments, the one or more programs include instructions for: detecting a first movement of a user when the first group of one or more devices is operated in a first manner; and in response to detecting the first movement of the user: operating the first group of one or more devices in a second manner different from the first manner based on determining the existence of a first context; and operating the first group of one or more devices in a third manner different from the second and first modes based on determining the existence of a second context.

[0031] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more devices in a first group. In some embodiments, the one or more programs include instructions for: detecting a first movement of a user when the first group of one or more devices is operated in a first manner; and in response to detecting the first movement of the user: operating the first group of one or more devices in a second manner different from the first manner based on determining the existence of a first context; and operating the first group of one or more devices in a third manner different from the second and first modes based on determining the existence of a second context.

[0032] In some embodiments, a computer system communicating with a first group of one or more devices is described. In some embodiments, the computer system communicating with the first group of one or more devices includes one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: detecting a first movement of a user when the first group of one or more devices is operated in a first manner; and in response to detecting the first movement of the user: operating the first group of one or more devices in a second manner different from the first manner based on determining the existence of a first context; and operating the first group of one or more devices in a third manner different from both the second and first modes based on determining the existence of a second context.

[0033] In some embodiments, a computer system communicating with a first group of one or more devices is described. In some embodiments, the computer system communicating with the first group of one or more devices includes components for performing each of the following steps: detecting a first movement of a user when the first group of one or more devices is operated in a first manner; and in response to detecting the first movement of the user: operating the first group of one or more devices in a second manner different from the first manner based on determining the existence of a first context; and operating the first group of one or more devices in a third manner different from both the second and first modes based on determining the existence of a second context.

[0034] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to execute by one or more processors of a computer system communicating with one or more devices in a first group. In some embodiments, the one or more programs include instructions for: detecting a first movement of a user when the first group of one or more devices is operated in a first manner; and in response to detecting the first movement of the user: operating the first group of one or more devices in a second manner different from the first manner based on determining the existence of a first context; and operating the first group of one or more devices in a third manner different from both the second and first modes based on determining the existence of a second context.

[0035] In some embodiments, a method is described that is performed at a computer system communicating with a display component and one or more input components. In some embodiments, the method includes: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and wherein the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components while the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: based on determining that the first input was initially detected at a location corresponding to the first location: displaying a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; and causing the output of a first device to change based on movement of the first input; and based on determining that the first input was initially detected at a location corresponding to the second location: displaying a first portion of the second scale at the second location; and causing the output of a second device to change based on movement of the first input, wherein the second device is different from the first device.

[0036] In some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display component and one or more input components. In some embodiments, the one or more programs include instructions for: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: based on determining that the first input was initially detected at a location corresponding to the first location: displaying a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; and causing the output of a first device to change based on movement of the first input; and based on determining that the first input was initially detected at a location corresponding to the second location: displaying a first portion of the second scale at the second location; and causing the output of a second device to change based on movement of the first input, wherein the second device is different from the first device.

[0037] In some embodiments, a transient computer-readable storage medium is described, storing one or more programs configured to be executed by one or more processors of a computer system communicating with a display component and one or more input components. In some embodiments, the one or more programs include instructions for: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: based on determining that the first input was initially detected at a location corresponding to the first location: displaying a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; and causing the output of a first device to change based on movement of the first input; and based on determining that the first input was initially detected at a location corresponding to the second location: displaying a first portion of the second scale at the second location; and causing the output of a second device to change based on movement of the first input, wherein the second device is different from the first device.

[0038] In some embodiments, a computer system communicating with a display component and one or more input components is described. In some embodiments, the computer system communicating with the display component includes one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: based on determining that the first input was initially detected at a location corresponding to the first location: displaying a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; and causing the output of a first device to change based on movement of the first input; and based on determining that the first input was initially detected at a location corresponding to the second location: displaying a first portion of the second scale at the second location; and causing the output of a second device to change based on movement of the first input, wherein the second device is different from the first device.

[0039] In some embodiments, a computer system communicating with a display component and one or more input components is described. In some embodiments, the computer system communicating with the display component includes components for performing each of the following steps: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and wherein the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: based on determining that the first input was initially detected at a location corresponding to the first location: displaying a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; and causing the output of a first device to change based on movement of the first input; and based on determining that the first input was initially detected at a location corresponding to the second location: displaying a first portion of the second scale at the second location; and causing the output of a second device to change based on movement of the first input, wherein the second device is different from the first device.

[0040] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to execute by one or more processors of a computer system communicating with a display component and one or more input components. In some embodiments, the one or more programs include instructions for: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: based on determining that the first input was initially detected at a location corresponding to the first location: displaying a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; and causing the output of a first device to change based on movement of the first input; and based on determining that the first input was initially detected at a location corresponding to the second location: displaying a first portion of the second scale at the second location; and causing the output of a second device to change based on movement of the first input, wherein the second device is different from the first device.

[0041] In some embodiments, a method is described that is performed at a computer system communicating with a display component and one or more input components. In some embodiments, the method includes: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components while the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: displaying via the display component a first scale including one or more values ​​corresponding to the first setting, based on determining that the first input was initially detected at a location corresponding to the first indication; and displaying via the display component a second scale including one or more values ​​corresponding to the second setting, based on determining that the first input was initially detected at a location corresponding to the second indication, wherein the display of the first scale and the display of the second scale are visually different.

[0042] In some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display component and one or more input components. In some embodiments, the one or more programs include instructions for: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: displaying via the display component a first scale including one or more values ​​corresponding to the first setting, based on determining that the first input was initially detected at a location corresponding to the first indication; and displaying via the display component a second scale including one or more values ​​corresponding to the second setting, based on determining that the first input was initially detected at a location corresponding to the second indication, wherein the display of the first scale and the display of the second scale are visually different.

[0043] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display component and one or more input components. In some embodiments, the one or more programs include instructions for: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: displaying via the display component a first scale including one or more values ​​corresponding to the first setting, based on determining that the first input was initially detected at a location corresponding to the first indication; and displaying via the display component a second scale including one or more values ​​corresponding to the second setting, based on determining that the first input was initially detected at a location corresponding to the second indication, wherein the display of the first scale and the display of the second scale are visually different.

[0044] In some embodiments, a computer system communicating with a display component and one or more input components is described. In some embodiments, the computer system communicating with the display component includes one or more processors and memory configured to execute one or more programs by the one or more processors. In some embodiments, the one or more programs include instructions for: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via the one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: displaying via the display component a first scale including one or more values ​​corresponding to the first setting, based on determining that the first input was initially detected at a location corresponding to the first indication; and displaying via the display component a second scale including one or more values ​​corresponding to the second setting, based on determining that the first input was initially detected at a location corresponding to the second indication, wherein the display of the first scale and the display of the second scale are visually different.

[0045] In some embodiments, a computer system communicating with a display component and one or more input components is described. In some embodiments, the computer system communicating with the display component includes components for performing each of the following steps: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and wherein the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: based on determining that the first input was initially detected at a location corresponding to the first indication, displaying via the display component a first scale including one or more values ​​corresponding to the first setting; and based on determining that the first input was initially detected at a location corresponding to the second indication, displaying via the display component a second scale including one or more values ​​corresponding to the second setting, wherein the display of the first scale and the display of the second scale are visually different.

[0046] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to execute by one or more processors of a computer system communicating with a display component and one or more input components. In some embodiments, the one or more programs include instructions for: displaying via the display component a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; detecting a first input via one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; and in response to detecting the first input: displaying via the display component a first scale including one or more values ​​corresponding to the first setting, based on determining that the first input was initially detected at a location corresponding to the first indication; and displaying via the display component a second scale including one or more values ​​corresponding to the second setting, based on determining that the first input was initially detected at a location corresponding to the second indication, wherein the display of the first scale and the display of the second scale are visually different.

[0047] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0048] Therefore, faster and more efficient methods and interfaces are provided for displaying controls on devices, thereby improving the effectiveness, efficiency, and user satisfaction of such devices. These methods and interfaces can complement or replace other methods used for displaying controls. Attached Figure Description

[0049] To better understand the various described embodiments, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which similar reference numerals indicate corresponding parts throughout the drawings.

[0050] Figure 1 This is a block diagram illustrating a system with various components according to some implementation schemes.

[0051] Figures 2A to 2C Exemplary user interfaces for providing controls in different contexts are illustrated according to some implementation schemes.

[0052] Figure 3 This is a flowchart illustrating a method for selectively providing controls according to some implementation schemes.

[0053] Figure 4 This is a flowchart illustrating a method for providing an indication of the status of a computer system according to some implementation schemes.

[0054] Figures 5A to 5C An exemplary user interface for locating objects is illustrated according to some implementation schemes.

[0055] Figure 6 This is a flowchart illustrating a method for locating objects according to some implementation schemes.

[0056] Figures 7A to 7C Examples of techniques for selectively providing feedback are illustrated according to some implementation schemes.

[0057] Figure 8 This is a flowchart illustrating a method for adjusting the output of a device according to some implementation schemes.

[0058] Figure 9 This is a flowchart illustrating a method for providing context-based feedback according to some implementation schemes.

[0059] Figures 10A to 10M An exemplary user interface for displaying controls is illustrated according to some implementation schemes.

[0060] Figures 11A to 11B This is a flowchart illustrating a method for adjusting the output of a device according to some implementation schemes.

[0061] Figure 12This is a flowchart illustrating a method for selectively displaying controls according to some implementation schemes. Detailed Implementation

[0062] The following description illustrates exemplary techniques for providing controls. This description is not intended to limit the scope of this disclosure, but is provided as a description of specific example implementations.

[0063] Users require electronic devices that offer efficient technologies for providing controls. Efficient technologies reduce the psychological burden on users when accessing the provided controls. This reduction in mental load can improve user productivity and make devices easier to use. In some implementations, the technologies described herein can reduce battery usage and processing time (e.g., by providing a user interface that requires less user input to operate).

[0064] Figure 1 An illustration is provided of an exemplary device for implementing techniques for providing controls. Figures 2A to 2C Exemplary user interfaces for providing controls in different contexts are illustrated according to some implementation schemes. Figure 3 This is a flowchart illustrating a method for selectively providing controls according to some implementation schemes. Figure 4 This is a flowchart illustrating a method for providing an indication of the status of a computer system according to some implementation schemes. Figures 2A to 2C The user interface in the document is used to illustrate the processes described below, including Figure 3 and / or Figure 4 The process in. Figures 5A to 5C An exemplary user interface for locating objects is illustrated according to some implementation schemes. Figure 6 This is a flowchart illustrating a method for locating objects according to some implementation schemes. Figures 5A to 5C The user interface in the document is used to illustrate the processes described below, including Figure 6 The process in. Figures 7A to 7C Examples of techniques for selectively providing feedback are illustrated according to some implementation schemes. Figure 8 This is a flowchart illustrating a method for adjusting the output of a device according to some implementation schemes. Figure 9 This is a flowchart illustrating a method for providing context-based feedback according to some implementation schemes. Figures 7A to 7C The user interface in the document is used to illustrate the processes described below, including Figure 8 and / or Figure 9 The process in. Figures 10A to 10M Exemplary user interfaces for displaying controls are illustrated according to some implementation schemes. The user interfaces in these figures are used to illustrate the processes described below, including... Figures 11A to 11B and Figure 12 The process in.

[0065] The process described below describes various techniques for making user interfaces and / or human-computer interaction more efficient (e.g., by helping users provide input quickly and easily and preventing user errors when operating the device). These techniques sometimes reduce the number of inputs required for users (e.g., people and / or users) to perform actions, provide users with clear and / or meaningful feedback (e.g., visual, auditory, and / or tactile feedback), inform users of the current state and subsequent expectations, provide additional information and controls without cluttering the user interface, and / or perform certain actions without requiring further input from the user. Because users can use the device more quickly and easily, these techniques sometimes improve battery life and / or reduce the device's power consumption.

[0066] In a method where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the described method can be repeated in multiple repetitions such that, during the repetitions, all conditions depending on the steps in the method have been satisfied in different repetitions of the method. For example, if the method requires performing a first step if a condition is satisfied, and a second step if a condition is not satisfied, it should be understood that the steps are repeated until both conditions are satisfied and not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method has been satisfied. However, system or computer-readable medium claims do not require such multiple repetitions, wherein the system or computer-readable medium contains instructions for performing conditional operations that require one or more conditions to be satisfied before the operation occurs. Those skilled in the art will also understand that, similar to a method having conditional steps, a system or computer-readable storage medium can repeat the steps of the method multiple times as needed to ensure that all conditional steps have been performed.

[0067] The terminology used in the description of the various implementation schemes is for the purpose of describing a particular implementation scheme only and is not intended to be limiting.

[0068] The following describes user interfaces for electronic devices and associated processes for using these devices. In some embodiments, the device is a desktop computer with a touch-sensitive surface (e.g., a touchscreen display and / or touchpad). In other embodiments, the device is a portable, mobile, and / or mobile electronic device (e.g., a processor, smartphone, smartwatch, tablet, fitness tracker, laptop, head-mounted display (HMD) device, public facilities, vehicles, media devices, smart speakers, smart displays, robots, televisions, and / or personal computing devices).

[0069] In some embodiments, the electronic device is a computer system that communicates with the display component (e.g., via wireless or wired communication). The display component may be integrated into the computer system or may be separate from the computer system. Additionally, the display component may be configured to provide visual output to a display (e.g., a liquid crystal display, an OLED display, or a CRT display). As used herein, "display" content includes content that is visually generated by sending data (e.g., image data or video data) to an integrated or external display component via a wired or wireless connection (e.g., video data rendered or decoded by a display controller). In some embodiments, visual output is any output that can be perceived by the human eye, including but not limited to images, videos, graphics, charts, and other graphical representations of data.

[0070] In some embodiments, the electronic device is a computer system that communicates with the audio generation component (e.g., via wireless or wired communication). The audio generation component may be integrated into the computer system or may be separate from the computer system. Additionally, the audio generation component may be configured to provide audio output. Examples of audio generation components include speakers, home theater systems, soundbars, headphones, in-ear headphones, earbuds, television speakers, augmented reality headset speakers, audio jacks, optical audio outputs, Bluetooth audio outputs, and / or HDMI audio outputs. In some embodiments, the audio output is any output that can be perceived by the human ear, including but not limited to sound waves, music, speech, and / or other audible representations of data.

[0071] In the following discussion, an electronic device including specific input and output devices is described. However, it should be understood that the electronic device may optionally include one or more other input and / or output devices, such as physical user interface devices (e.g., physical keyboard, mouse, and / or joystick).

[0072] Figure 1 A system 100 for implementing the techniques described herein is illustrated. System 100 is executable. Figure 3 , Figure 4 Figure 5 Figure 6 And / or any of the methods described in Figure 7 (e.g., processes 700, 800, 1000, 1200 and / or 1300) and / or portions of these methods.

[0073] exist Figure 1In this system 100, various components are included, such as processor 103, RF circuitry 105, memory 107, sensors 156 (e.g., image sensors, orientation sensors, position sensors, heart rate monitors, temperature sensors), input devices 158 (e.g., cameras (e.g., periscope cameras, telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras), depth sensors, microphones, touch-sensitive surfaces, hardware input mechanisms, and / or rotatable input mechanisms), mobility components (e.g., actuators (e.g., pneumatic actuators, hydraulic actuators, and / or electric actuators), motors, wheels, movable bases, rotatable components, translational components, and / or rotatable bases), and output devices 160 (e.g., speakers, display components, audio generation components, haptic output devices, displays, projectors, and / or touch-sensitive displays). These components optionally communicate via the system's communication bus 123. Although shown as separate components, in some specific implementations, various components may be combined and used as a single component; for example, a sensor may be an input device.

[0074] In some implementations, system 100 is a mobile and / or mobile device (e.g., a tablet, smartphone, laptop, head-mounted display (HMD) device, and / or smartwatch). In other implementations, system 100 is a desktop computer, embedded computer, and / or server.

[0075] In some embodiments, processor 103 includes one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some embodiments, memory 107 is one or more non-transitory computer-readable storage media (e.g., flash memory and / or random access memory) storing computer-readable instructions configured to be executed by processor 103 to perform the techniques described herein.

[0076] In some embodiments, RF circuit 105 includes circuitry for communicating with electronic devices and / or networks (e.g., the Internet, intranets, and / or wireless networks such as cellular networks and wireless local area networks (LANs)). In some embodiments, RF circuit 105 includes circuitry for using near-field communication and / or short-range communication such as Bluetooth. ® Circuits for communication, or ultra-wideband communication.

[0077] In some embodiments, display 121 includes one or more monitors, projectors, and / or screens. In some embodiments, display 121 includes a first display for displaying an image to a user's first eye and a second display for displaying an image to a user's second eye. In such embodiments, corresponding images may be displayed simultaneously on the first and second displays. Optionally, the corresponding images include representations of the same virtual objects and / or the same physical objects from different viewpoints, thereby creating a parallax effect that provides the user with a stereoscopic effect of objects on the display. In some embodiments, display 121 is a single display. In such embodiments, for each of the user's eyes, the corresponding image is simultaneously displayed in a first and a second area of ​​a single display. Optionally, the corresponding images include representations of the same virtual objects and / or the same physical objects from different viewpoints, thereby creating a parallax effect that provides the user with a stereoscopic effect of objects on a single display.

[0078] In some embodiments, system 100 includes one or more touch-sensitive surfaces 115 for receiving user input such as tap and swipe inputs. In some embodiments, display 121 and touch-sensitive surfaces 115 form a touch-sensitive display.

[0079] In some embodiments, sensor 156 includes sensors for detecting various conditions. In some embodiments, sensor 156 includes orientation sensors (e.g., orientation sensor 111) for detecting the orientation and / or movement of platform 150. For example, system 100 uses orientation sensors to track changes in the position and / or orientation (sometimes collectively referred to as positioning) of system 100, such as relative to physical objects in the physical environment. In some embodiments, sensor 156 includes one or more gyroscopes, one or more inertial measurement units, and / or one or more accelerometers. In some embodiments, sensor 156 includes a Global Positioning Sensor (GPS) for detecting the GPS position of platform 150. In some embodiments, sensor 156 includes a radar system, a LiDAR system, a sonar system, an image sensor (e.g., image sensor 109, a visible light image sensor, and / or an infrared sensor), a depth sensor, a rangefinder, and / or a motion detector. In some embodiments, sensor 156 includes sensors located within internal portions of system 100 and / or sensors located externally to system 100. In some embodiments, system 100 uses sensors 156 (e.g., internal sensors) to detect the presence and / or state (e.g., location and / or orientation) of passengers within the interior of system 100. In some embodiments, system 100 uses sensors 156 (e.g., external sensors) to detect the presence and / or state of objects outside system 100. In some embodiments, system 100 uses sensors 156 to receive user input, such as gestures and / or other air gestures. In some embodiments, system 100 uses sensors 156 to detect the location and / or orientation of system 100 in the physical environment. In some embodiments, system 100 uses sensors 156 to navigate system 100 along a planned route, around obstacles, and / or to a destination location. In some embodiments, sensors 156 include one or more sensors for identifying and / or authenticating users of system 100, such as fingerprint sensors and / or facial recognition sensors.

[0080] In some embodiments, the image sensor includes one or more visible light image sensors, such as charge-coupled device (CCD) sensors and / or complementary metal-oxide-semiconductor (CMOS) sensors, capable of operating to acquire images of physical objects. In some embodiments, the image sensor includes one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light. For example, an active IR sensor may include an IR emitter, such as an IR point emitter, for emitting infrared light. In some embodiments, the image sensor includes one or more cameras configured to capture movement of the physical object. In some embodiments, the image sensor includes one or more depth sensors configured to detect the distance of the physical object from system 100. In some embodiments, system 100 uses the CCD sensor, camera, and depth sensor in combination to detect the physical environment surrounding system 100. In some embodiments, the image sensor includes a first image sensor and a second image sensor different from the first image sensor. In some embodiments, system 100 uses the image sensor to receive user input, such as gestures and / or other air gestures. In some embodiments, system 100 uses the image sensor to detect the position and / or orientation of system 100 in the physical environment.

[0081] In some implementations, system 100 uses an orientation sensor to detect the orientation and / or movement of system 100. For example, system 100 may use an orientation sensor to track changes in the position and / or orientation of system 100, such as relative to a physical object in the physical environment. In some implementations, the orientation sensor includes one or more gyroscopes, one or more inertial measurement units, and / or one or more accelerometers.

[0082] In some embodiments, system 100 uses a microphone to detect sound from one or more users and / or the physical environment of those users. In some embodiments, the microphone includes a microphone array (comprising multiple microphones) that optionally cooperates to identify ambient noise or to locate sound sources in a space of the physical environment (e.g., inside and / or outside system 100).

[0083] In some embodiments, input device 158 includes one or more mechanical and / or electrical devices for detecting input, such as buttons, sliders, knobs, switches, remote controls, joysticks, touch-sensitive surfaces, keypads, microphones, and / or cameras. In some embodiments, input component 158 ​​includes one or more input devices internal to system 100. In some embodiments, input component 158 ​​includes one or more input devices (e.g., touch-sensitive surfaces and / or keypads) external to system 100.

[0084] In some embodiments, output device 160 includes one or more devices such as a display, monitor, projector, speaker, lamp, and / or haptic output device. In some embodiments, output device 160 includes one or more external output devices such as an external display screen, external lamp, and / or external speaker. In some embodiments, output device 160 includes one or more internal output devices such as an internal display screen, internal lamp, and / or internal speaker.

[0085] In some embodiments, environmental controls 162 include mechanical and / or electrical systems for monitoring and / or controlling the condition of internal portions (e.g., compartments) of system 100. In some embodiments, environmental controls 162 include fans, heaters, air conditioners, and / or thermostats for controlling temperature and / or airflow within the internal portions of system 100.

[0086] In some embodiments, the mobility component includes mechanical and / or electrical components that enable and / or assist the platform in moving. In some embodiments, the mobility system 164 includes a power system, drivetrain, motor (e.g., an electric motor), engine, power source (e.g., a battery), transmission, suspension system, speed control system, and / or steering system. In some embodiments, one or more elements of the mobility component are configured for autonomous or manual control (e.g., via system 100 and / or input device 158).

[0087] In some implementations, system 100 performs monetary transactions with or without another computer system. For example, system 100, or another computer system associated with and / or communicating with system 100 (e.g., via a user account described below), is associated with a user's payment account, such as a credit card account or checking account. To complete the transaction, system 100 may send a key to the entity purchasing goods and / or services from it, enabling the entity to charge the payment account for the transaction. As another example, system 100 stores encrypted payment account information and sends that information to the entity purchasing goods and / or services from it to complete the transaction.

[0088] System 100 may optionally engage in other transactions with other systems, computers, and / or devices. For example, system 100 may transact to unlock another system, computer, and / or device, and / or be unlocked by another system, computer, and / or device. Unlocking transactions may optionally include using, for example, RF circuitry 105 to transmit and / or receive one or more secure cryptographic keys.

[0089] In some implementations, system 100 is capable of communicating with other computer systems and / or electronic devices. For example, system 100 may use RF circuitry 105 to access a network connection that enables the transmission of data between systems for communication purposes. Example communication sessions include telephone calls, emails, SMS messages, and / or video conferencing communication sessions.

[0090] In some implementations, a video conferencing communication session includes the transmission and / or reception of video and / or audio data between systems participating in the video conferencing communication session (including system 100). In some implementations, system 100 uses sensor 156 to capture video and / or audio content, which is then transmitted to other systems in the video conferencing communication session using RF circuitry 105. In some implementations, system 100 uses RF circuitry 105 to receive video and / or audio from other systems in the video conferencing communication session and uses output devices 160 (such as display 121 and / or speakers) to present the video and / or audio. In some implementations, the transmission of audio and / or video between systems is near real-time, such as presenting it to other systems with a delay of less than 0.1 seconds, 0.5 seconds, 1 second, or 3 seconds from the time the corresponding portion of the audio and / or video was captured.

[0091] In some embodiments, system 100 uses output component 160 to generate haptic (e.g., touch) output. In some embodiments, output component 160 generates haptic output by shifting a movable mass block relative to a neutral position. In some embodiments, the haptic output is inherently periodic, optionally including the frequency and / or amplitude of movement in two or three dimensions. In some embodiments, system 100 generates a variety of different haptic outputs that differ in the frequency, amplitude, and / or duration / number of cycles of the included movement. In some embodiments, the haptic output pattern includes a start buffer and / or an end buffer during which the movable mass block gradually accelerates and / or decelerates at the beginning and / or end of the haptic output, respectively.

[0092] In some embodiments, the haptic output has a corresponding characteristic frequency that affects the "pitch" of the haptic perception felt by the user. For example, a higher frequency corresponds to faster movement of the movable mass, while a lower frequency corresponds to slower movement of the movable mass. In some embodiments, the haptic output has a corresponding characteristic amplitude that affects the "intensity" of the haptic perception felt by the user. For example, a higher amplitude corresponds to movement of the movable mass over a greater distance, while a lower amplitude corresponds to movement of the movable mass over a smaller distance. In some embodiments, the "pitch" and / or "intensity" of the haptic output varies over time.

[0093] In some embodiments, the tactile output is distinct from the movement of system 100. For example, system 100 may include a tactile output device that moves a movable mass to generate the tactile output, and may include other moving parts that control the movement of system 100, such as motors, wheels, axles, control arms, and / or brakes. Although in some cases the movement and / or cessation of movement of system 100 generates vibrations and / or other physical sensations, these vibrations and / or other physical sensations are distinct from the tactile output. In some embodiments, system 100 generates a tactile output independent of the movement of system 100. For example, system 100 may generate a tactile output without causing system 100 to accelerate, decelerate, and / or move to a new position.

[0094] In some implementations, system 100 detects gesture input made by a user. In some implementations, gesture input includes touch gestures and / or air gestures, as described herein. In some implementations, touch-sensitive surface 115 identifies touch gestures based on contact patterns (e.g., different intensities, timings, and / or movements of an object touching or nearly touching touch-sensitive surface 115). Thus, touch-sensitive surface 115 detects gestures by detecting the corresponding contact patterns. For example, detecting a finger press event and then detecting a finger lift-off (e.g., lift-off) event at the same location as the finger press event (e.g., at the location of a user interface element) may correspond to detecting a tap gesture on a user interface element. As another example, detecting a finger press event, then detecting movement of the contact, and subsequently detecting a finger lift-off (e.g., lift-off) event may correspond to detecting a swipe gesture. Additional and / or alternative touch gestures are possible.

[0095] In some embodiments, an air gesture is a gesture performed by a user without touching the input component 158. In some embodiments, an air gesture is based on the detected movement of a portion of the user (e.g., hand, fingers, and / or body) in the air. In some embodiments, an air gesture includes the movement of that portion of the user relative to a reference. Example references include the distance of the user's hand relative to a physical object (such as the ground), the angle of the user's arm relative to a physical object, and / or the movement of a first portion of the user (e.g., hand or fingers) relative to a second portion of the user (e.g., shoulder, another hand, or another finger). In some embodiments, detecting an air gesture includes detecting the absolute movement of that portion of the user, such as a tapping gesture including moving the hand in a predetermined posture by a predetermined amount and / or speed, or a shaking gesture including rotating a portion of the user at a predetermined speed or amount.

[0096] In some implementations, detecting one or more inputs includes detecting the user's speech. In some implementations, system 100 uses one or more microphones of input device 158 to detect if the user utters one or more words. In some implementations, system 100 parses information and / or communicates information to one or more other systems to determine the content of the user's speech, including identifying words and / or obtaining a semantic understanding of those words. For example, processor 103 may be configured to perform natural language processing to detect one or more words and / or determine the possible meaning of one or more words in a sequence spoken by the user. Additionally or alternatively, in some implementations, system 100 determines the meaning of one or more words in a spoken sequence based on the context determined by system 100.

[0097] In some implementations, system 100 outputs spatial audio via output device 160. In some implementations, the spatial audio is output at a specific location. For example, system 100 may play a notification ringtone with one or more characteristics that cause the notification ringtone to be generated as if it were emitted from a first location relative to the user's current viewpoint (e.g., "spatializing" and / or "spatializing" includes modifying the audio in amplitude, filtering, and / or delaying it to provide the user with perceived spatial quality).

[0098] In some embodiments, system 100 presents visual and / or audio feedback indicating the user's current position relative to another user's current viewpoint, thereby informing the other user of the user's updated position. In some embodiments, playing audio corresponding to the user includes altering one or more characteristics of audio obtained from another computer system to simulate the effect of placing an audio source generating the audio playback within the user's position, such as a position where the user moves, appears, and / or is assigned within a three-dimensional environment. In some embodiments, the relative magnitude of audio at one or more frequencies and / or frequency groups is altered, one or more filters are applied to the audio (e.g., directional audio filters), and / or the magnitude of audio provided via one or more channels is altered (e.g., increased or decreased) to produce the perceived effect of a physical audio source. In some embodiments, the simulated position of the audio source relative to the ground of the three-dimensional environment is matched to the height of the participant's head, or one or more predetermined heights relative to the ground of the three-dimensional environment, of the simulated audio source. In some embodiments, system 100 presents feedback based on determining that the user's position corresponds to a second position different from a first position and meeting one or more first criteria, the feedback including generating audio as if it were emanating from the second position.

[0099] In some embodiments, system 100 communicates with one or more accessory devices. In some embodiments, one or more accessory devices are integrated with system 100. In some embodiments, one or more accessory devices are external to system 100. In some embodiments, system 100 communicates with accessory devices using RF circuitry 105 and / or using wired connections. In some embodiments, system 100 controls the operation of accessory devices such as doors, windows, locks, speakers, lights, and / or cameras. For example, system 100 may control the operation of a motorized door of system 100. As another example, system 100 may control the operation of a motorized window included in system 100. In some embodiments, accessory devices used as input devices, such as remote controls and / or other computer systems (e.g., smartphones, media players, tablets, computers, and / or wearable devices), control the operation of system 100. For example, a wearable device (e.g., a smartwatch) serves as a key to initiate the operation of the actuation system of system 100. In some implementations, system 100 acts as an input device to control the operation of another system, device, and / or computer, such as system 100 acting as a key to initiate the operation of an actuation system of a platform associated with another system, device, and / or computer.

[0100] In some implementations, the digital assistant assists the user in performing various functions using System 100. For example, the digital assistant may provide weather updates, set alarms, and perform searches locally and / or using a network connection (e.g., the Internet) via a natural language interface. In some implementations, the digital assistant accepts requests, at least in part, in the form of natural language commands, narrations, requests, statements, and / or inquiries. In some implementations, the user uses the digital assistant to request informational answers and / or the execution of tasks. For example, in response to receiving the question “What is the current temperature?”, the digital assistant answers “The current temperature is 30 degrees.” As another example, in response to receiving a request to perform a task, such as “Please invite my family to dinner tomorrow,” the digital assistant may acknowledge the request by playing spoken words such as “Okay, soon,” and then, on behalf of the user, send the requested calendar invitations to each family member listed in the user’s contact list. In some implementations, the digital assistant engages in a continuous dialogue with the user during the execution of a user-requested task, which involves multiple exchanges of information over a period of time. Other ways of interacting with the digital assistant may involve requesting the execution of tasks and / or requesting information. For example, a digital assistant may respond to a user in other forms, such as displayed alerts, text, video, animation, music, etc. In some embodiments, the digital assistant includes a client portion executing on system 100 and a server portion executing on a server communicating with system 100. The client portion may communicate with the server via a network connection using RF circuitry 105. For example, the client portion may provide client functionality, input and / or output processing, and / or communication with the server. In some embodiments, the server end is divided into any number of client portions across multiple systems providing server functionality.

[0101] In some implementations, system 100 is associated with one or more user accounts. In some implementations, system 100 stores and / or encrypts user data, including files, settings, and / or preferences associated with a specific user account. In some implementations, user accounts are password protected, and system 100 requires user authentication before accessing user data associated with an account. In some implementations, user accounts are associated with other systems, devices, and / or servers. In some implementations, associating a user account with multiple systems enables those systems to access, update, and / or synchronize user data associated with the user account. For example, a system associated with a user account may have access to purchased media content, contact lists, communication sessions, payment information, stored passwords, and other user data. Therefore, in some implementations, user accounts provide security mechanisms for a customized user experience.

[0102] Figures 2A to 2CExemplary user interfaces for providing controls in different contexts are illustrated according to some implementation schemes. The user interfaces in these figures are used to illustrate the processes described below, including... Figures 3 to 4 The process in.

[0103] Figure 2A A computer system 200 is illustrated, including a front side 200a and a rear side 200b. In some embodiments, the computer system 200 is a smartphone and includes a display 204 (e.g., a display component). In some embodiments, the display 204 is a touch-sensitive display. In some embodiments, the computer system 200 includes one or more input devices, such as knobs, dials, joysticks, touch-sensitive surfaces, buttons, and / or sliders. It should be understood that the types of computer systems and / or components described herein are merely exemplary and are provided to give context to the embodiments described herein. In some embodiments, the computer system 200 includes one or more features and / or components as described above with respect to system 100.

[0104] like Figure 2A As illustrated, computer system 200 is not coupled to an external charger (e.g., as indicated by the absence of an external charger on the rear side 200b of computer system 200). Figure 2A The computer system 200 is located in a first area within a physical structure (e.g., a building, residence, aircraft, and / or vehicle). In some embodiments, the physical structure includes one or more output devices, such as lights, playback devices, and / or windows. The computer system 200 can communicate with one or more output devices within the physical structure (e.g., wireless communication (e.g., Wi-Fi, Bluetooth, and / or ultra-wideband) and / or wired communication).

[0105] like Figure 2A As illustrated, computer system 200 displays a media playback user interface 206. The media playback user interface 206 includes media playback controls 228. The media playback controls 228 correspond to one or more playback devices (e.g., speaker devices) located throughout the physical structure (e.g., one or more playback devices are located in a first area of ​​the physical structure and / or other areas of the physical structure). The media playback controls 228 can be selected to modify the playback state of one or more playback devices.

[0106] The media playback control 228 includes a previous media item user interface object 228a, a playback control user interface object 228b, and a next media item user interface object 228c. It should be understood that such controls are merely examples and other objects may be used in conjunction with the techniques described herein. In some embodiments, each of the previous media item user interface object 228a, the playback control user interface object 228b, and the next media item user interface object 228c is a global control. In some embodiments, the global control corresponds to (e.g., is configured to control) one or more devices located in various areas of a physical structure (e.g., the global control corresponds to devices in different areas of the physical structure). In some embodiments, the computer system 200 sends an instruction to one or more playback devices to adjust the playback state of one or more playback devices in response to detecting input corresponding to a selection of the previous media item user interface object 228a, the playback control user interface object 228b, or the next media item user interface object 228c.

[0107] In some implementations, the media playback user interface 206 corresponds to a first user interface in a series of user interfaces. For example... Figure 2A As illustrated, the media playback user interface 206 includes a pagination indicator user interface object 210. The pagination indicator user interface object 210 includes a first pagination indicator 210a, a second pagination indicator 210b, and a third pagination indicator 210c. Each pagination indicator in the pagination indicator user interface object 210 corresponds to a specific user interface in this series of user interfaces. For example... Figure 2A As illustrated, computer system 200 displays the first page break indicator 210a as visually emphasized (e.g., the first page break indicator 210a is filled, and the second page break indicator 210b and the third page break indicator 210c are not filled). Computer system 200 does not display the second page break indicator 210b and / or the third page break indicator 210c as visually emphasized, while computer system 200 displays the first page break indicator 210a as visually emphasized. In some embodiments, computer system 200 displays one of the first page break indicator 210a, the second page break indicator 210b, and the third page break indicator 210c as visually emphasized based on which user interface in the series of user interfaces currently displaying computer system 200 is being used.

[0108] exist Figure 2BAt this point, the computer system 200 is decoupled from the external charger 232 and then coupled to the external charger 232, and the computer system 200 is moved to a second region within the physical structure (e.g., different from or the same as the first region). In some embodiments, the first and second regions are located on opposite sides of the physical structure (e.g., the first region is located on the left side of a residence and the second region is located on the right side of a residence, or the first region is located at the front of an aircraft and the second region is located at the rear of an aircraft).

[0109] exist Figure 2B At this point, it is determined that computer system 200 transitions from decoupling from external charger 232 to coupling with external charger 232. Because it is determined that computer system 200 transitions from decoupling from external charger 232 to coupling with external charger 232, computer system 200 stops displaying media playback user interface 206 and displays first control user interface 218 (e.g., computer system 200 scrolls from media playback user interface 206 to the first control user interface 218 in this series of user interfaces). Figure 2B In this embodiment, computer system 200 is magnetically coupled to external charger 232. A first control user interface 218 corresponds to a second user interface in this series of user interfaces. In some embodiments, computer system 200 redisplays media playback user interface 206 in response to detecting a swipe input (e.g., a right swipe input) while computer system 200 displays the first control user interface 218. In some embodiments, computer system 200 redisplays media playback user interface 206 in response to detecting decoupling of computer system 200 from external charger 232 while computer system 200 displays the first control user interface 218. In some embodiments, the background color, pattern, and / or image of the displayed user interface changes depending on whether computer system 200 is coupled to external charger 232. For example, the background color of the user interface displayed when computer system 200 is coupled to external charger 232 may be a first color, while the background color of the user interface displayed when computer system 200 is not coupled to external charger 232 may be a second color different from the first color.

[0110] In addition, Figure 2B At this point, since the computer system 200 has transitioned from decoupling from the external charger 232 to coupling with the external charger 232, the computer system 200 displays the second paging indicator 210b as visually emphasized. Figure 2BAt this point, computer system 200 stops displaying the first page indicator 201a as visually emphasized, as part of displaying the second page indicator 210b as visually emphasized. In some embodiments, upon determining that computer system 200 is transitioning from decoupling from external charger 232 to coupling with external charger 232, computer system 200 transitions from a first operating mode to a second operating mode (e.g., computer system 200 transitions from a sleep state or a shutdown state to an active / display state). In some embodiments, computer system 200 displays the second page indicator 210b as visually emphasized based on determining that computer system 200 displays the second user interface in a series of user interfaces.

[0111] exist Figure 2B The computer system 200 is located in a second region of the physical structure. Because the computer system 200 is located in the second region of the physical structure, the computer system 200 displays a first control user interface 218 having a first set of controls 212. The first set of controls 212 includes a first light control user interface object 220, a second light control user interface object 222, a first window control user interface object 224, a second window control user interface object 226, and a playback control user interface object 228b. The first light control user interface object 220 corresponds to (e.g., is configured to control) a first light device, the second light control user interface object 222 corresponds to (e.g., is configured to control) a second light device, the first window control user interface object 224 corresponds to (e.g., is configured to control) a first window, and the second window control user interface object 226 corresponds to (e.g., is configured to control) a second window. In some embodiments, each of the first light device, the second light device, the first window, and the second window is located within the second region of the physical structure. That is, when the computer system 200 is positioned in the second area of ​​the physical structure and coupled to the external charger 232, the computer system 200 displays a control user interface object corresponding to the device located in the second area of ​​the physical structure. In some embodiments, the computer system 200 sends an instruction to the first lamp device to adjust the operation of the lamp device in response to detecting input corresponding to the selection of the first lamp control user interface object 220 (e.g., tap input, swipe input, rotation of a rotatable input device, gaze, voice command, and / or hand gesture). In some embodiments, when it is determined that the second area of ​​the physical structure does not include any controllable accessories, the computer system 200 does not display the first control user interface 218 having the first set of controls 212. In some embodiments, the computer system 200 displays the media playback user interface 206 in response to detecting input corresponding to the selection of the playback control user interface object 228b when the computer system 200 displays the first control user interface 218.

[0112] In some embodiments, each of the first light control user interface object 220, the second light control user interface object 222, the first window control user interface object 224, and the second window control user interface object 226 is a local control. In some embodiments, local controls correspond to (e.g., are configured to control) one or more devices located in a specific area (e.g., a second area) of a physical structure, compared to global controls (e.g., as explained above). In some embodiments, the first control user interface 218 includes local controls instead of global controls (e.g., the first control user interface 218 includes the first light control user interface object 220, the second light control user interface object 222, the first window control user interface object 224, and the second window control user interface object 226, and does not include the playback control user interface object 228b). In some embodiments, the first control user interface 218 includes global controls instead of local controls. In some embodiments, the first control user interface 218 includes a combination of one or more global controls and one or more local controls.

[0113] like Figure 2B As illustrated, each of the first light control user interface object 220, the second light control user interface object 222, the first window control user interface object 224, and the second window control user interface object 226 includes an indication of the status of the device corresponding to the respective control user interface object. Specifically, the first light control user interface object 220 indicates that the first light device is powered off, the second light control user interface object 222 indicates that the second light device operates at 50% brightness, the first window control user interface object 224 indicates that the first window is half-open, and the second window control user interface object 226 indicates that the second window is closed. In some embodiments, the computer system 200 updates the status indicators included in the first light control user interface object 220, the second light control user interface object 222, the first window control user interface object 224, and / or the second window control user interface object 226 based on determining a change in the operation of the corresponding device. In some embodiments, the first set of controls 212 includes control user interface objects positioned within a second area of ​​the physical structure based on which attachments are located. In some implementations, the second area of ​​the physical structure includes multiple sub-areas (e.g., if the physical structure is a residence, the second area includes multiple rooms on corresponding floors of the residence), and the computer system 200 displays the first set of controls 212 regardless of which sub-area the computer system 200 is located within. In some implementations, when the second area of ​​the physical structure encompasses multiple sub-areas, the computer system 200 displays the corresponding set of controls based on which sub-area the computer system 200 is located within and which attachments are located within that sub-area. Figure 2BAt this point, computer system 200 changes from being coupled to external charger 232 to being coupled to external charger 230, and moves from a second region in the physical structure to a third region in the physical structure. In some embodiments, the second and third regions are located on opposite sides of the physical structure (e.g., the second region is located on the left side of the room, and the third region is located on the right side of the room).

[0114] exist Figure 2C At this point, it is determined that computer system 200 transitions from coupling to external charger 232 to coupling to external charger 230. Because it is determined that computer system 200 transitions from coupling to external charger 232 to coupling to external charger 230, computer system 200 stops displaying the first control user interface 218 and displays the second control user interface 238 (e.g., computer system 200 scrolls from the first control user interface 218 to the second control user interface 238). In some embodiments, when computer system 200 is coupled to external charger 230, computer system 200 does not display the first control user interface 218 and / or the first set of controls 212. Figure 2C At this location, computer system 200 is magnetically coupled to external charger 230. In some embodiments, when displaying the second control user interface 238, computer system 200 re-displays media playback user interface 206 in response to detecting a change in coupling from computer system 200 to external charger 230 and decoupling from the corresponding external charger. In some embodiments, when computer system 200 displays the first control user interface 218, computer system 200 displays the second control user interface 238 in response to detecting a swipe input (e.g., a left swipe input). In some embodiments, computer system 200 is wired to external charger 230 (e.g., external charger 230 is plugged into computer system 200). In some embodiments, determining the change in coupling from computer system 200 to external charger 230 includes determining a specific location where computer system 200 is coupled to a physical structure (e.g., the location of external charger 230).

[0115] In addition, Figure 2C At this point, since the computer system 200 is determined to switch from coupling to external charger 232 to coupling to external charger 230, the computer system 200 stops displaying the second page indicator 210b as visually emphasized, and the computer system 200 displays the third page indicator 210c as visually emphasized. The second control user interface 238 corresponds to the third user interface in this series of user interfaces.

[0116] The external charger 230 is positioned within a third region of the physical structure, which is different from the first and / or second regions of the physical structure. Figure 2CThe computer system 200 is located within a third region of the physical structure. Because the computer system 200 is located within this third region, the second control user interface 238 includes a second set of controls 236. The second set of controls 236 corresponds to the attachments located within the third region of the physical structure. The second set of controls 236 includes control user interface objects that are different from the control user interface objects included in the first set of controls 212.

[0117] The second set of controls 236 includes a third light control user interface object 240, a fourth light control user interface object 242, a third window control user interface object 244, a fourth window control user interface object 246, and a playback control user interface object 228b. Each of the third light control user interface objects 240, 242, 244, and 246 is a local control, while the playback control user interface object 228b is a global control, as explained above. Therefore, the second set of controls 236 includes both local and global controls. The third light control user interface object 240 corresponds to the third light device, the fourth light control user interface object 242 corresponds to the fourth light device, the third window control user interface object 244 corresponds to the third window, and the fourth window control user interface object 246 corresponds to the fourth window. Each of the third light device, fourth light device, third window, and fourth window is located in a second region of the physical structure. In some embodiments, the second set of controls 236 includes one or more control user interface objects not included in the first set of controls 212, or vice versa. In some embodiments, the second set of controls 236 and the first set of controls 212 have a common control user interface object. In some embodiments, the second set of controls 236 and the first set of controls 212 do not have a common control user interface object. In some embodiments, the computer system 200 sends an instruction to the corresponding device to adjust the operation of the corresponding device in response to detecting that one of the third light control user interface object 240, the fourth light control user interface object 242, the third window control user interface object 244, or the fourth window control user interface object 246 has been selected. In some embodiments, in response to detecting input corresponding to the selection of one of the third light control user interface object 240, the fourth light control user interface object 242, the third window control user interface object 244, or the fourth window control user interface object 246, the computer system 200 does not update the display of the selected control user interface object (e.g., the computer system 200 does not update the display of the selected control user interface object to indicate a change in the operation of the corresponding accessory). In some embodiments, the second set of controls 236 includes one or more media control user interface objects not included in the first set of controls 212 (e.g., which, when selected, cause the computer system 200 to send instructions to one or more playback devices to modify the playback state of one or more playback devices). In some embodiments, the first set of controls 212 includes one or more temperature control user interface objects not included in the second set of controls 236 (e.g., which, when selected, cause the computer system 200 to send instructions to an air conditioning unit (e.g., a unit capable of heating and cooling) to modify the temperature setting of the air conditioning unit).In some embodiments, when a first region of the physical structure is within a second region of the physical structure (e.g., the second region of the physical structure encompasses the first region of the physical structure), the second set of controls 236 includes one or more of a first light control user interface object 220, a second light control user interface object 222, a first window control user interface object 224, and / or a second window control user interface object 226. In some embodiments, the computer system 200 displays the second set of controls 236 and the first set of controls 212 in the same location on the display 204. In some embodiments, as part of displaying the second control user interface 238, the computer system 200 displays an animation of the second set of controls 236 replacing the first set of controls 212. In some embodiments, when the computer system 200 displays the animation of the second set of controls 236 replacing the first set of controls 212, the computer system 200 displays the first set of controls 212 as scrolling (e.g., scrolling up, down, left, and / or right) as part of displaying that animation.

[0118] Figure 3 This is a flowchart illustrating a method (e.g., process 300) for selectively providing controls according to some implementation schemes. Some operations in process 300 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0119] As described below, process 300 provides an intuitive way to selectively provide controls. Process 300 reduces the cognitive burden on users when interacting with computer systems, thereby creating a more efficient human-computer interface. For battery-powered computing devices, it enables users to interact with the computer system faster and more efficiently, saving power and increasing the time between battery charging.

[0120] In some embodiments, process 300 is performed at a computer system (e.g., 100 and / or 200) that communicates with display components (e.g., 204) (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the computer system communicates with physical (e.g., hardware and / or non-display) input mechanisms (e.g., hardware input mechanisms, rotatable input mechanisms, crowns, knobs, dials, physical sliders, and / or hardware buttons). In some embodiments, the computer system is a watch, telephone, tablet, processor, head-mounted display (HMD) device, and / or personal computing device. In some embodiments, the computer system communicates with one or more cameras (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras).

[0121] The computer system detects (302) changes in the coupling state of the computer system (e.g., magnetic coupling state, wireless coupling state and / or wired coupling state) (and / or detects a request to display a user interface (e.g., a request to wake up the computer system)) (e.g., as described above with respect to 230 and / or 232).

[0122] In response to (304) detecting a change in the coupling state of the computer system (and in some embodiments, when displaying a first user interface via a display component, and / or in response to detecting the presence of a user (e.g., detecting that the user and / or a device associated with the user are within a predetermined distance (e.g., 1 to 5 meters) from the computer system) (and / or in response to detecting a request to display the user interface (e.g., a request to wake up the computer system))), according to determining that a first set of one or more criteria are met, wherein the first set of one or more criteria includes criteria that are met when determining that the computer system is currently magnetically coupled to (e.g., connected to, linked to, and / or attached to) a corresponding area (e.g., direct magnetic coupling and / or coupling due to its contact with a magnet at the corresponding area) (e.g., as described above relative to) Figure 2B or Figure 2C As described, the computer system displays (306) a first user interface (e.g., 218 or 238) including one or more controls (e.g., 212 or 236) via a display component. In some embodiments, the first user interface and / or the first set of one or more controls are displayed around a rotatable input mechanism. In some embodiments, the background of at least a portion of the second user interface has a first appearance based on determining that one or more criteria of the first set are met.

[0123] In response to (304) detecting a change in the coupling state of the computer system, based on determining that one or more criteria of a second set are met, wherein the one or more criteria of the second set include those met when it is determined that the computer system is currently not magnetically coupled (e.g., as described above relative to...). Figure 2A or Figure 2CAs described, the computer system displays (308) a second user interface (e.g., 206) comprising one or more controls in a second group (e.g., 228), wherein the second group of one or more controls differs from the first group of one or more controls. In some embodiments, the first user interface differs from the user interface displayed by the computer system before a change in the coupling state of the computer system is detected. In some embodiments, the first user interface is the same as the user interface displayed by the computer system before a change in the coupling state of the computer system is detected. In some embodiments, the second user interface differs from the user interface displayed by the computer system before a change in the coupling state of the computer system is detected. In some embodiments, the second user interface is the same as the user interface displayed by the computer system before a change in the coupling state of the computer system is detected. In some embodiments, the first user interface does not include one or more controls in the second group of one or more controls. In some embodiments, the second user interface does not include one or more controls in the first group of one or more controls. In some embodiments, the second user interface differs from the first user interface. Displaying different groups of one or more controls based on whether the computer system is currently magnetically coupled allows the displayed group of one or more controls to be related to the current state and / or location of the computer system being magnetically coupled, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions is already met. In some embodiments, the second user interface and / or the second group of one or more controls is displayed around a rotatable input mechanism. In some embodiments, at least a portion of the background of the second user interface has a second appearance based on determining that the second group of one or more criteria is met. In some embodiments, the background of that portion of the first user interface has a third appearance based on determining that the second group of one or more criteria is met. In some embodiments, the third appearance differs from the first appearance.

[0124] In some embodiments, the first set of one or more criteria includes criteria that are met when a corresponding area is determined to be associated with a first type of device (e.g., a specific telephone, screen, display, fitness tracker, wearable device, and / or a device associated only with a portion and / or a local device and / or a portion of the computing system). In some embodiments, in response to detecting a change in the coupling state of the computer system and based on determining that the computer system is currently magnetically coupled to a second corresponding area, wherein the second corresponding area is associated with a second type of device different from the first type of device (e.g., a specific telephone, screen, display, fitness tracker, wearable device, and / or a device associated only with a portion and / or a global device and / or a portion of the computing system) (and in some embodiments, the second corresponding area is not associated with a first type of device), the computer system abandons displaying the first set of one or more controls. In some embodiments, in response to detecting a change in the coupling state of the computer system and based on determining that the computer system is currently magnetically coupled to a second corresponding area, the computer system displays a second set of one or more controls. In some embodiments, in response to detecting a change in the coupling state of the computer system and based on determining that the computer system is currently magnetically coupled to a second corresponding area, the computer system does not display the second set of one or more controls. Selectively displaying one or more controls in a first group based on determining that the corresponding area is associated with a first type of device rather than a second type of device, allowing the first group of controls to be displayed when associated with a device in an area magnetically coupled to the computer system, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0125] In some embodiments, when displaying a first user interface including a first set of one or more controls (and in some embodiments, in response to detecting a change in the coupling state of the computer system and based on determining that the first set of one or more criteria are met), the computer system displays via a display component a first set of indications (e.g., text, symbols, visual and / or graphical indications, representations and / or user interface objects) corresponding to one or more settings associated with a corresponding area (and in some embodiments, independent of different corresponding areas). Figure 2B and / or Figure 2C(As described). In some embodiments, when displaying a second user interface including a second set of one or more controls, the computer system does not display a set of indicators corresponding to one or more settings associated with a corresponding area (and in some embodiments, any corresponding and / or specific area). Displaying a first set of indicators corresponding to one or more settings associated with a corresponding area when displaying a first set of one or more controls allows the user to identify information about settings related to the current state and / or location of the computer system being magnetically coupled, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0126] In some embodiments, in response to detecting a change in the coupling state of the computer system and based on determining that the computer system is currently magnetically connected to a third corresponding region different from the corresponding region (e.g., the left side of the computer system instead of the right side), the computer system displays one or more controls in a third group (e.g., 212 or 236) different from the first group of one or more controls via a display component (e.g., not displaying the first group of one or more controls). In some embodiments, the third group of one or more controls is not displayed based on determining that one or more criteria of the first group are met and / or when the first group of one or more controls are displayed. In some embodiments, the third group of one or more controls is associated with the third corresponding region and is independent of the corresponding region. In some embodiments, the first group of one or more controls is independent of the third corresponding region but associated with the first corresponding region. In some embodiments, in response to detecting a selection of one or more controls, a user interface including settings corresponding to the selected control is displayed. In some embodiments, in response to detecting input to the settings of the selected control (e.g., tap input and / or non-tap input (e.g., gaze input, air gesture, pointing gesture, swipe input and / or mouse click)), the computer system causes a change in the output of a device (e.g., fan, thermostat, window, door and / or light). Displaying one or more controls in a third group based on determining that the computer system is currently magnetically coupled to a third corresponding area allows the display of the third group of controls when they are associated with the area of ​​the computer system that is magnetically coupled, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0127] In some implementations, in response to detecting a change in the coupling state of the computer system, the computer system transitions the display component from a first state (e.g., off, sleep, inactive, hibernating, and / or low-power state) to a second state different from the first state (e.g., on, awake, and / or high-power state). In some implementations, in response to detecting a change in the coupling state of the computer system, the computer system does not transition to a different state and / or remains in the on, awake, and / or high-power state. Transitioning the display component from a first state to a second state in response to detecting a change in the coupling state of the computer system allows the display component to be in a state consistent with the coupling state without requiring manual change by the user, thereby reducing the amount of input required to perform an operation and / or performing an operation when a set of conditions has already been met without further user input.

[0128] In some implementations, the first group of one or more controls is (and / or includes at least one) a local control that points to (e.g., directly affects, is configured to affect, is configured to be controlled by an associated user, and / or is configured to adjust its output) one or more devices (e.g., thermostats, fans, seats, windows, doors, and / or lights) associated with the corresponding area and not a fourth corresponding area different from the corresponding area. In some implementations, the second group of one or more controls is (and / or includes at least one) a global control that points to (e.g., directly affects, is configured to affect, is configured to be controlled by an associated user, and / or is configured to adjust its output) one or more devices (e.g., one or more thermostats, fans, seats, windows, doors, and / or lights) associated with both the corresponding area and the fourth corresponding area. The fact that the first group of one or more controls is a local control and the second group of controls is a global control allows the displayed group of one or more controls to be relevant to the current state and / or location of the computer system, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0129] In some implementations, the first group of one or more controls does not include, and the second group of one or more controls includes, controls that, when selected, adjust the output of media (e.g., audio and / or video media) (e.g., pause, play, stop, reverse, fast forward, rewind, jump forward to new media and / or jump backward to previous media) (e.g., via speakers, a monitor, and / or a television) (e.g., 228b). The second group of one or more controls includes media-related controls, while the first group of one or more controls does not, allowing the displayed group of one or more controls to be relevant to the current state and / or location of the computer system, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0130] In some implementations, a first group of one or more controls includes, and a second group of one or more controls does not include, controls that, when selected, adjust the output of a device (e.g., a fan, thermostat, door, light, and / or window) that affects (e.g., influences and / or causes a change) the ambient temperature. The inclusion of temperature-affecting controls in the first group of one or more controls, while excluding such controls in the second group of one or more controls, allows the displayed group of one or more controls to be relevant to the current state and / or location of the computer system, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions is already met.

[0131] In some implementations, when displaying a second set of one or more controls, the computer system detects input pointing to one of the controls in the second set (e.g., tap input and / or non-tap input, such as gaze input, air gesture, pointing gesture, swipe input, and / or mouse click). In some implementations, in response to detecting input pointing to one of the controls in the second set, the computer system displays an indication of the adjusted value (e.g., text, symbol, visual and / or graphical indication, representation, and / or user interface object) via a display component. Displaying an indication of the adjusted value in response to detecting input pointing to one of the controls in the second set allows the user to identify the state of the value as the user changes the value, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0132] In some implementations, when displaying one or more controls in the first group, the computer system detects input pointing at one of the controls in the first group (e.g., tap input and / or non-tap input (e.g., gaze input, air gesture, pointing gesture, swipe input, and / or mouse click)). In some implementations, in response to detecting input pointing at one of the controls in the first group, the computer system abandons displaying indications about adjusted values ​​(e.g., text, symbols, visual and / or graphical indicators, representations, and / or user interface objects) via display components.

[0133] In some implementations, when displaying a first set of one or more controls, the computer system detects a set of one or more inputs, including inputs pointing to a corresponding control within the first set of one or more controls (e.g., tap inputs and / or non-tap inputs (e.g., gaze inputs, air gestures, pointing gestures, swipe inputs, and / or mouse clicks)). In some implementations, in response to detecting the set of one or more inputs (and in some implementations, in response to detecting a corresponding control within the first set of one or more controls), the computer system causes a change in the output of a device associated with the corresponding area (and not with another corresponding area). This change in the output of a device associated with a corresponding area in response to detecting the set of one or more inputs, including inputs pointing to the corresponding control, allows the user to control the output of a device in an area magnetically coupled to the computer system, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0134] In some implementations, the second group of one or more controls comprises a first number of controls. In some implementations, the first group of one or more controls comprises a second number of controls, different from the first number. In some implementations, the first number is greater than the second number or the first number is less than the second number. The fact that the first group of one or more controls comprises a different number of controls than the second group of one or more controls allows the displayed group of one or more controls to be magnetically coupled and / or adapted to the current state of the computer system, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0135] In some embodiments, the second group of one or more controls includes controls included in the first group of one or more controls (e.g., 228b). In some embodiments, the first group of controls and the second group of controls include at least one identical control. The second group of one or more controls including controls included in the first group of one or more controls allows the display of controls relevant to both contexts, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0136] In some embodiments, the first group of one or more controls includes at least one control not included in the second group of one or more controls. In some embodiments, the second group of one or more controls includes at least one control not included in the first group of one or more controls. In some embodiments, the first group of one or more controls and the second group of one or more controls do not include at least one identical control. The inclusion of controls not included in the second group of one or more controls in the first group allows related controls to be displayed when the computer system is currently magnetically coupled, and not displayed when the computer system is not currently magnetically coupled, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0137] In some implementations, each control in the first group of one or more controls is different from each control in the second group of one or more controls. In some implementations, each control in the second group of one or more controls is different from each control in the first group of one or more controls. In some implementations, the first group of one or more controls and the second group of one or more controls do not include any identical controls. Making each control in the first group of one or more controls different from each control in the second group of one or more controls allows controls that are associated when the computer system is currently magnetically coupled to be displayed when the computer system is currently magnetically coupled, and not displayed when the computer system is not currently magnetically coupled, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0138] It should be noted that the process described above is relative to method 300 (e.g., Figure 3The details of this also apply in a similar manner to the other methods described herein. For example, process 400 optionally includes one or more features of the various methods described above with reference to process 300. For example, the first set of controls of process 300 may be included in the first content of process 400. For the sake of brevity, these details will not be repeated below.

[0139] Figure 4 This is a flowchart illustrating a method (e.g., process 400) for providing an indication of the state of a computer system according to some implementation schemes. Some operations in process 400 may be optionally combined, the order of some operations may be optionally changed, and some operations may be optionally omitted.

[0140] As described below, process 400 provides an intuitive way to indicate the state of a computer system. Process 400 reduces the cognitive burden on users when identifying the state of a computer system, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to identify the state of the computer system faster and more efficiently saves power and increases the time between battery charging sessions.

[0141] In some embodiments, process 400 is performed at a computer system (e.g., 100 and / or 200) that communicates with display components (e.g., 204) (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the computer system communicates with physical (e.g., hardware and / or non-display) input mechanisms (e.g., hardware input mechanisms, rotatable input mechanisms, crowns, knobs, dials, physical sliders, and / or hardware buttons). In some embodiments, the computer system is a watch, telephone, tablet, processor, head-mounted display (HMD) device, and / or personal computing device. In some embodiments, the computer system communicates with one or more cameras (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras).

[0142] The computer system displays (402) a first user interface (e.g., 206) via a display component, the first user interface including first content (e.g., 206 and / or 228) and a first plurality of selection indicators (e.g., such as...). Figure 2A The illustrated 210 (e.g., including pagination points and / or text indicators that include values ​​associated with specific content (e.g., 1, 2, 3, 4; I, II, III, IV, and / or V)) includes selection indicators that indicate the selection of first content (e.g., text, one or more user interface objects, and / or one or more videos, images, and / or symbols). Figure 2AThe illustrated 210a) (e.g., bold, focus indicator, highlight, emphasis (e.g., an indicator that is enlarged compared to other indicators) and / or text indicator) (and in some embodiments, a selection indicator that indicates that the second content is not selected).

[0143] When a first user interface, including first content and a first plurality of selection indicators and a selection indicator indicating that the first content is selected (e.g., at a corresponding location / area, main location / area, and / or center location / area of ​​the display), is displayed via a display component, the computer system detects (404) a change in the coupling state (e.g., magnetic coupling state, wireless coupling state, and / or wired coupling state) of the computer system (e.g., as described above relative to...). Figure 2B and / or Figure 2C (As described).

[0144] In response to (406) detecting a change in the coupling state of the computer system (and in some embodiments, when the first user interface is displayed via a display component and / or in response to detecting the presence of a user (e.g., detecting that the user and / or a device associated with the user are within a predetermined distance (e.g., 1 to 5 meters) from the computer system), the computer system stops (408) displaying a selection indicator indicating that the first content has been selected (e.g., such as...). Figure 2B or Figure 2C 210a) as exemplified.

[0145] In response to (406) detecting a change in the coupling state of the computer system, the computer system displays (410) via a display component a second set of content (e.g., 212 and / or 236) (and in some embodiments, excluding the first set of content) (e.g., at corresponding locations / areas, main locations / areas, and / or center locations / areas of the display) and a second plurality of selection indicators (e.g., such as...). Figures 2B to 2C The second user interface (e.g., 218 and / or 238) of the illustrated 210) includes a selection indicator indicating that a second content is selected (e.g., such as...). Figures 2B to 2C(Examples 210b or 210c) (and in some embodiments, a selection indicator indicating that the first content is not selected), wherein the second content differs from the first content. In some embodiments, the selection indicator indicating that the first content is selected is located at a first position relative to the first user interface, and the selection indicator indicating that the second content is selected is located at a second position relative to the second user interface, wherein the second position differs from the first position. Displaying the second content and the selection indicator indicating that the second content is selected in response to detecting a change in the coupling state of the computer system allows the user to be presented with content related to the current coupling state of the computer system, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0146] In some embodiments, the first content includes a first group of one or more controls (e.g., as described above with respect to process 300) (e.g., 228). In some embodiments, the second content includes a second group of one or more controls that differ from the first group of one or more controls (e.g., as described above with respect to process 300) (e.g., 212 or 236). Different content including different groups of one or more controls allows the displayed group of one or more controls to be associated with the current state and / or location of the computer system, thereby reducing the amount of input required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, and / or performing an operation without further user input when a set of conditions has already been met.

[0147] In some implementations, the second plurality of selection indicators includes indicators that indicate the first content is not selected (e.g., not bolded, not emphasized, not enlarged, and / or not focused compared to another indicator). Figure 2B or Figure 2C(210a) of [reference to previous implementation]. In some embodiments, the first plurality of selection indicators includes an indicator indicating that the second content is not selected. In some embodiments, when the indicator indicating that the first content is not selected is displayed, the indicator indicating that the first content is not selected is displayed at the same location as when the indicator indicating that the first content is selected is displayed. In some embodiments, when the indicator indicating that the second content is not selected is displayed, the indicator indicating that the second content is not selected is displayed at the same location as when the indicator indicating that the second content is selected is displayed. The second plurality of selection indicators, including the indicator indicating that the first content is not selected, allow the user to identify at a glance which part of the content is being displayed and what type of input will be displayed in which other part of the content, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0148] In some implementations, in response to detecting a change in the coupling state of the computer system, the computer system stops displaying the first content (e.g., as...). Figure 2B or Figure 2C (As illustrated). In some embodiments, the second user interface does not include the first content. In some embodiments, the first user interface does not include the second content. The first content is stopped being displayed in response to a detected change in the coupling state of the computer system, allowing the displayed content to be relevant to the current coupling state, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0149] In some implementations, first content is displayed at a corresponding location (e.g., location on the display and / or position and / or user interface displayed on the display) (e.g., the location of 206) before a change in the coupling state of the computer system is detected. In some implementations, second content is displayed at a corresponding location in response to the detection of a change in the coupling state of the computer system. Displaying first and second content at corresponding locations allows the content to be in consistent positioning, enabling the user to quickly know where to look, thereby providing the user with improved visual feedback and / or performing an action when a set of conditions has been met without requiring further user input.

[0150] In some implementations, displaying a second user interface including the second content includes replacing a first user interface including the first content (e.g., via transition animations, such as dissolve, fade, and / or slide animations) with a second user interface including the second content (e.g., as described above relative to...). Figures 2B to 2C(As described). Replacing the first user interface with a second user interface (e.g., via transition animation) allows the computer system to switch between displayed content as it identifies what is being displayed, thereby providing the user with improved visual feedback and / or performing an action when a set of conditions has been met without requiring further user input.

[0151] In some embodiments, displaying the second user interface including the second content includes scrolling (e.g., in a direction corresponding to the direction defined by movement from the positioning of the first selection indicator to the second selection indicator) of the first user interface including the first content to display the second user interface including the second content. Scrolling the first user interface to display the second user interface allows the user to intuitively switch between user interfaces in a manner accustomed to when using other user interfaces, while in some embodiments, switching can be done without additional user interface elements, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0152] In some implementations, detecting a change in the coupling state of the computer system includes detecting that the computer system is in an installed state (e.g., magnetically coupled to a device and / or area). In some implementations, the computer system is being modified while it is in an installed state. Detecting that the computer system is in an installed state to allow different content to be displayed allows the computer system to adapt the content being displayed based on the installed state and / or reduce the amount of content displayed in irrelevant states, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0153] In some implementations, the second content includes one or more global controls. In some implementations, in response to detecting a selection of a global control, a user interface for setting devices associated with all parts and / or the entire computer system is displayed. In some implementations, the global controls in the one or more global controls are configured to modify settings that affect and / or influence a first and a second corresponding region. In some implementations, local controls are configured to modify settings that affect and / or influence either a first or a second corresponding region. The second content includes one or more global controls that allow the user to switch contexts (e.g., interact with different content that may not be applicable to the area where the computer system is magnetically coupled) when a change in the coupling state of the computer system is detected, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0154] In some implementations, detecting a change in the coupling state of the computer system includes detecting that the computer system is in an uninstalled state (e.g., not magnetically coupled to a device and / or area). Detecting that the computer system is in an uninstalled state allows for different content to be displayed, enabling the computer system to adapt the content being displayed to the uninstalled state and / or reduce the amount of content displayed in irrelevant states, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0155] In some implementations, the second content includes one or more local controls. In some implementations, in response to detecting a selection of a global control, a user interface for setting devices associated with fewer than all parts and / or fewer than the entire computer system is displayed. In some implementations, local controls among the one or more local controls are configured to modify settings affecting a first or second corresponding region. In some implementations, global controls are configured to modify settings affecting both the first and second corresponding regions. The second content includes one or more local controls that allow the user to switch contexts (e.g., interact with different content that may not be applicable to the area where the computer system is magnetically coupled, and / or continue interacting with content applicable to that area) when a change in the coupling state of the computer system is detected, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0156] In some implementations, detecting a change in the coupling state of the computer system includes detecting the computer system magnetically coupled to a region (e.g., 200b) (an object and / or a specific magnetic coupling device) (e.g., as described with respect to process 300). Detecting the computer system magnetically coupled to this region to allow different content to be displayed allows the computer system to adapt the content being displayed to that region and / or reduce the amount of content displayed in irrelevant states, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0157] In some implementations, detecting a change in the coupling state of the computer system includes detecting that the computer system is coupled to a corresponding device (e.g., 230 and / or 232) via a wired (e.g., via a dongle and / or cable) or wireless connection (e.g., via Bluetooth, the Internet, and / or NFC connection). Detecting that the computer system is coupled to the corresponding device via a wired or wireless connection to allow different content to be displayed allows the computer system to adapt the content being displayed and / or reduce the amount of content displayed in irrelevant states based on communication being enabled, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0158] In some embodiments, when displaying a second user interface including second content and a second plurality of selection indicators, the computer system detects input with a first directional component (e.g., swipe input and / or non-swipe input (e.g., gaze input, air gesture, swipe gesture, tap input, and / or mouse click and drag input)). In some embodiments, in response to detecting input with a first directional component (e.g., a first direction in the x, y, and / or z plane), the computer system stops displaying the second user interface including the second content and the second plurality of selection indicators. In some embodiments, in response to detecting input with a first directional component, the computer system displays (e.g., redisplays and / or re-displays) the first user interface including the first content and the first plurality of selection indicators via a display component. Displaying the first user interface in response to detecting input with a first directional component after a previous display of the first user interface allows the user to easily and quickly switch between what to view, especially when the computer system intelligently changes the content based on changes in the coupling state of the computer system, thereby reducing the amount of input required to perform an operation and / or performing an operation without further user input when a set of conditions has already been met.

[0159] In some embodiments, when displaying a second user interface including second content and a second plurality of selection indicators, the computer system detects input having a second directional component that is different from the first directional component (e.g., opposite to the first directional component and in the opposite direction). This includes swipe input and / or non-swipe input (e.g., gaze input, air gesture, swipe gesture, tap input, and / or mouse click and drag input). In some embodiments, in response to detecting input having a second directional component (e.g., a first direction in the x, y, and / or z planes), the computer system stops displaying the second user interface including the second content and the second plurality of selection indicators. In some embodiments, in response to detecting input having a second directional component, the computer system displays a third user interface via a display component, including third content and a third plurality of selection indicators, the third plurality of selection indicators including a selection indicator indicating that the third content is selected, wherein the third content is different from the first content and the second content. In some embodiments, the third plurality of selection indicators includes a selection indicator indicating that the first content is not selected and / or a selection indicator indicating that the second content is not selected. A third user interface is displayed in response to the detection of input with a second directional component, allowing the user to switch between what is displayed by providing input with different directional components (e.g., without additional user interface elements), thereby reducing the amount of input required to perform an operation and / or performing an operation without further user input when a set of conditions has already been met.

[0160] It should be noted that the process described above is relative to method 400 (e.g., Figure 4 The details of this also apply in a similar manner to the other methods described herein. For example, process 300 optionally includes one or more features of the various methods described above with reference to process 400. For example, the second content of process 400 may include a second set of one or more controls of process 300. For the sake of brevity, these details will not be repeated.

[0161] Figures 5A to 5C Exemplary user interfaces for locating objects are illustrated according to some implementation schemes. The user interfaces in these figures are used to illustrate the processes described below, including... Figure 6 The process in.

[0162] Figure 5A Computer system 200 is shown. (For example...) Figure 5AAs illustrated, computer system 200 displays an external device user interface 502. The external device user interface 502 includes a first light control user interface object 512, a second light control user interface object 514, a first window control user interface object 516, a second window control user interface object 518, and a remote locator user interface object 520. Each of the first light control user interface object 512, the second light control user interface object 514, the first window control user interface object 516, and the second window control user interface object 518 corresponds to a corresponding external device (e.g., a device external to computer system 200). The remote locator user interface object 520 corresponds to an electronic remote control device for controlling one or more external devices and / or computer system 200.

[0163] exist Figure 5A At this point, computer system 200 detects input 505a corresponding to the selection of remote locator user interface object 520. In some embodiments, input 505a corresponds to tap input, swipe input, gaze, voice command, long press (e.g., press and hold), and / or hand gesture. In some embodiments, the remote control device is a smartphone, smartwatch, smart speaker, fitness tracker, playback device remote control, and / or television remote control. In some embodiments, computer system 200 and remote control device communicate wirelessly (e.g., Wi-Fi, Bluetooth, and / or ultra-wideband). In some embodiments, the remote control device is used to control external devices corresponding to one or more of the first light control user interface object 512, the second light control user interface object 514, the first window control user interface object 516, and / or the second window control user interface object 518. In some embodiments, in response to detecting input corresponding to a selection of one of the first light control user interface object 512, the second light control user interface object 514, the first window control user interface object 516, and / or the second window control user interface object 518, the computer system 200 sends an instruction to the corresponding external device to change the state of the corresponding external device (e.g., these instructions increase or decrease the brightness of the light, or these instructions open or close the window). In some embodiments, depending on whether a remote control device is installed (e.g., the remote control device is magnetically coupled to an external charger (e.g., as referenced above)). Figures 2B to 2C(As described above) and / or when the remote control device is coupled to the charger via a wired connection, the computer system 200 does not display the remote control locator user interface object 520. In some embodiments, when the remote control device is installed, the computer system 200 displays the remote control locator user interface object 520 as unselectable (e.g., the computer system 200 displays the remote control user interface object 520 as grayed out). In some embodiments, the computer system 200 displays the external device user interface 502 in response to detecting that the computer system 200 is coupled to an external charger (e.g., as referenced above). Figure 2B and Figure 2C (As described).

[0164] Figure 5B and Figure 5C Examples illustrate different scenarios of the behavior of both the computer system 200 and the external device in response to the computer system 200 detecting input 505a. More specifically, Figure 5B An example is given where computer system 200 detects the first scene input 505a when the remote control device is positioned between the first lighting device and the television, and Figure 5C An example is shown in which the computer system 200 detects the second scene of input 505a when the remote control device is positioned between the second light device and the television. Figure 5B or Figure 5C Either of them can Figure 5A after.

[0165] exist Figure 5B In response to the detection of input 505a, computer system 200 stops displaying the external device user interface 502 and displays a physical environment schematic user interface 530. The physical environment schematic user interface 530 is a representation of the physical environment (e.g., a room in a house, office building, car, and / or airplane) corresponding to the location of the remotely controlled device. Figure 5BAs illustrated, the physical environment schematic user interface 530 includes a first lighting device user interface object 522, a second lighting device user interface object 524, a first playback device user interface object 526, a second playback device user interface object 528, a television user interface object 536, and a remote control user interface object 532. The first lighting device user interface object 522 represents a first lighting device located in the physical environment (e.g., a lamp, ceiling light, and / or a light integrated into a fan), the second lighting device user interface object 524 represents a second lighting device located in the physical environment (e.g., a lamp, ceiling light, and / or a light integrated into a fan), the first playback device user interface object 526 represents a first playback device located in the physical environment (e.g., a smart speaker, subwoofer, and / or radio), the second playback device user interface object 528 represents a second playback device located in the physical environment, the television user interface object 536 represents a television device located in the physical environment, and the remote control user interface object 532 represents a remote control device.

[0166] exist Figure 5B The computer system 200 determines that the remote control device (e.g., the remote control device represented by remote control user interface object 532) is positioned between the first lamp device and the television in the physical environment. Since the remote control device is determined to be positioned between the first lamp device and the television, the computer system 200 displays the remote control user interface object 532 between the first lamp device user interface object 522 and the television user interface object 536. That is, the computer system 200 displays the remote control user interface object 532 within the physical environment schematic user interface 530 based on the real-world position of the remote control device relative to other devices in the physical environment. In some embodiments, the display of the remote control user interface object 532 within the physical environment schematic user interface 530 is dynamic (e.g., the computer system 200 changes the position of the remote control user interface object 532 within the physical environment schematic user interface 530 in real time based on changes in the real-world position of the remote control device). In some embodiments, the computer system 200 stops displaying the remote control user interface object 532 upon determining that a user is holding the remote control device. In some embodiments, the computer system 200 stops displaying the remote control user interface object 532 upon determining that the remote control device has changed from being never installed to being installed on an external charger (e.g., as described above regarding...). Figures 2B to 2C (As described).

[0167] In addition, Figure 5B The remote control device is positioned within a predetermined distance (e.g., 0.5 feet, 1 foot, 3 feet, 5 feet, 7 feet, 10 feet, 15 feet, or 20 feet) from the first light source and the television. Figure 5BSince the remote control device is determined to be within a predetermined distance from the first light device and the television, the first light device outputs an alarm (e.g., flashes the light and / or switches from power off to power on), and the television outputs an alarm (e.g., flashes the television display and / or outputs an audio alarm). That is, in response to the computer system 200 detecting input corresponding to the selection of the remote control locator user interface object 520, one or more external devices within a predetermined distance from the remote control device output alarms (e.g., outputs sound, displays video, and / or turns on the light) to indicate the location of the remote control device to the user. Figure 5B In some embodiments, the second light device, the first playback device, and the second playback device do not output alarms because they are not within a predetermined distance from the remote control device. In some implementations, the first light device and / or the television device output directional alarms based on the position of the remote control device relative to the first light device and / or the television (e.g., the first light device and / or the television output alarms in the direction of the remote control device (e.g., if the remote control device is positioned to the left of the television, the television will output an audio alarm using a set of speakers positioned to the left of the television, and / or if the remote control device is positioned to the right of the first light device, the first light device will output a visual alarm using a set of bulbs positioned to the right of the first light device)). In some implementations, the first light device and the television will stop outputting alarms in response to the computer system 200 stopping the display of the physical environment schematic user interface 530. In some implementations, based on the determination that a remote control device is installed, the first light device and the television do not output corresponding alarms in response to the computer system 200 detecting input corresponding to the selection of the remote control locator user interface object 520. In some implementations, based on the determination that no remote control device is installed and based on the determination that the remote control device is within a predetermined threshold distance of both the television and the first light device, in response to the computer system 200 detecting an input corresponding to the selection of the remote control locator user interface object 520, the television and the first light device output an alarm.

[0168] Computer system 200 instructs which external devices output alarms within the physical environment schematic user interface 530. For example... Figure 5B As illustrated, because the first light device outputs an alarm, the computer system 200 displays a first light device user interface object 522 with a filled appearance (e.g., compared to an unfilled second light device user interface object 524) to indicate that the first light device outputs an alarm. Furthermore, as... Figure 5BAs illustrated, because the television outputs an alarm, the computer system 200 displays sound waves emitted from the television user interface object 536 to indicate that the television outputs an alarm. In some embodiments, since the first light device and the television are different types of devices, the first light device outputs a first type of alarm (e.g., a visual alarm), and the television outputs a second type of alarm (e.g., a visual and / or audio alarm) that is different from the first type of alarm. In some embodiments, the external device outputs an alarm for a predetermined period of time (e.g., 5 seconds, 10 seconds, 15 seconds, 25 seconds, 50 seconds, 120 seconds, or 180 seconds). In some embodiments, the external device outputs a visual alarm (e.g., a flashing light). In some embodiments, the external device outputs an audio alarm (e.g., a continuously repeating sound). In some embodiments, the external device outputs a combination of visual and audio alarms. In some embodiments, the external device stops outputting alarms based on determining that the user holds the remote control device. In some embodiments, in response to the computer system 200 detecting input corresponding to the selection of the remote control locator user interface object 520, the remote control device outputs an alarm (e.g., an audio alarm, a tactile alarm, and / or a visual alarm). In some implementations, the alarm consists of a single continuous sound. In other implementations, the alarm consists of multiple discrete sounds.

[0169] As explained above, Figure 5C An example is given in which the computer system 200 detects input 505a when the remote control device is positioned between the second light device and the television. Figure 5B or Figure 5C Either of them can Figure 5A after.

[0170] exist Figure 5C At this point, in response to the detection of input 505a, computer system 200 stops displaying the external device user interface 502 and displays the physical environment schematic user interface 530. Figure 5C At this location, the remote control device (e.g., the remote control device represented by the remote locator user interface object 520) is positioned between the second light device and the television within the physical environment. As explained above, the computer system 200 displays the remote control user interface object 532 within the physical environment schematic user interface 530 based on the real-world position of the remote control device relative to other devices in the physical environment. Therefore, as Figure 5C As illustrated, since the remote control device is determined to be positioned between the second lamp device and the television, the computer system 200 displays the remote control user interface object 532 between the second lamp device user interface object 524 and the television user interface object 536.

[0171] In addition, Figure 5CThe remote control device is located within a predetermined distance of the second lighting device, the first playback device, and the television. As explained above, in response to the computer system 200 detecting an input corresponding to the selection of the remote control locator user interface object 520, one or more external devices within the predetermined distance of the remote control device output an alarm (e.g., output sound, display video, turn on lights) to indicate the location of the remote control device to the user. Therefore, in Figure 5C Since the remote control device is determined to be within a predetermined distance of the second light device, the first playback device, and the television, the second light device outputs an alarm (e.g., causes the light to flash), the first playback device outputs an alarm (e.g., an audio alarm), and the television outputs an alarm (e.g., causes the television display to flash and / or outputs an audio alarm). Figure 5C At this location, the first light device and the second playback device do not output the corresponding alarm because the first light device and the second playback device are not within the predetermined distance from the remote control device. For example... Figure 5C As illustrated, because the second light device outputs an alarm, the computer system 200 displays a second light device user interface object 524 with a filled appearance (e.g., compared to an unfilled first light device user interface object 522) to indicate that the second light device outputs an alarm. Furthermore, as... Figure 5C As illustrated, since the television and the first playback device output alarms, the computer system 200 displays sound waves as emitted from the television user interface object 536 and the first playback device user interface object 526 to indicate that both the first playback device and the television output alarms.

[0172] Figure 6 This is a flowchart illustrating a method for locating an object (e.g., process 600) according to some implementation schemes. Some operations in process 600 may be optionally combined, the order of some operations may be optionally changed, and some operations may be optionally omitted.

[0173] As described below, process 600 provides an intuitive way to locate objects. Process 600 reduces the cognitive burden on users when locating objects, thus creating a more efficient human-computer interface. For battery-powered computing devices, it enables users to locate objects faster and more efficiently, saving power and increasing the time between battery charging.

[0174] In some implementations, process 600 is performed at a computer system (e.g., 100 and / or 200) that communicates with a first group of one or more devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices and / or personal computing devices) (e.g., 522, 524, 526, 528 and / or 536) excluding objects (e.g., devices and / or remote controls) (e.g., 532), a second group of one or more devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices and / or personal computing devices) (e.g., 522, 524, 526, 528 and / or 536) excluding objects, and one or more input devices (e.g., physical input mechanisms, cameras, touch-sensitive displays, microphones and / or buttons). In some embodiments, the computer system communicates with physical (e.g., hardware and / or non-display) input mechanisms (e.g., hardware input mechanisms, rotatable input mechanisms, crowns, knobs, dials, physical sliders, and / or hardware buttons). In some embodiments, the computer system is a watch, telephone, tablet, processor, head-mounted display (HMD) device, and / or personal computing device. In some embodiments, the computer system communicates with one or more cameras (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras).

[0175] The computer system detects (602) a request (e.g., 505a) via one or more input devices to identify (e.g., find, search and / or highlight) the location of an object.

[0176] In response to (604) a request to detect the location of an identified object, based on determining that a first group of one or more devices meets one or more criteria for that group (e.g., including criteria met when the first group of one or more devices is within a predetermined distance (e.g., 0.1 m to 40 m) from the object, and / or including criteria met when the first group of one or more devices is designed for a specific area (e.g., for a specific area (e.g., a specific area including the object)) and a second group of one or more devices does not meet one or more criteria for that group (e.g., including criteria met when the second group of one or more devices is within a predetermined distance (e.g., 0.1 m to 40 m) from the object, and / or including criteria met when the second group of one or more devices is designed for a specific area (e.g., for a specific area (e.g., a specific area including the object))), the computer system causes (606) the first group of one or more devices (e.g., 522, as relative to) Figure 5B The device described provides an output indicating the location of an object in the environment, without causing a second group of one or more devices (e.g., 524 and 526) to provide an output indicating the location of an object in the environment.

[0177] In response to (604) a request to detect the location of an identified object, and based on the determination that one or more devices in the first group do not meet one or more criteria for the corresponding group and one or more devices in the second group meet one or more criteria for the corresponding group, the computer system causes (608) the second group of one or more devices (e.g., 524 and 526, as relative to) Figure 5C The system provides output indicating the location of an object in the environment, without causing a first group of one or more devices (e.g., 522) to provide such output. In some embodiments, the computer system causes the first group of one or more devices and the second group of one or more devices to provide output indicating the location of an object in the environment, based on the determination that the first group of one or more devices and the second group of one or more devices meet one or more corresponding group criteria. In some embodiments, the computer system does not cause the first group of one or more devices and the second group of one or more devices to provide output indicating the location of an object in the environment, based on the determination that the first group of one or more devices and the second group of one or more devices do not meet one or more corresponding group criteria. Enabling different groups of one or more devices to provide output indicating the location of an object in the environment allows the user to better and / or more easily locate objects using devices in the environment, thereby providing the user with improved visual feedback and / or enabling the user to perform actions without further user input when a set of conditions has already been met.

[0178] In some implementations, the object is an electronic device (e.g., a controller for one or more external devices such as a remote control, telephone, computer system, wearable device, tablet, fitness tracker, and / or control controller). The object is an electronic device that allows the computer system and / or user to better and / or more easily locate the object due to the communication and / or output of the electronic device, thereby providing the user with improved visual feedback and / or performing actions when a set of conditions has already been met without requiring further user input.

[0179] In some implementations, in response to a request to detect the location of an identified object (e.g., looking up an object, searching for an object, and / or locating an object), the computer system causes the electronic device to provide output (e.g., tactile output, light output (e.g., light beams and / or rays) and / or sound output). Making the electronic device provide output in response to a request to detect the location of an identified object allows the user to locate the object better and / or more easily due to the output of the electronic device, thereby providing the user with improved visual feedback and / or performing an action without further user input once a set of conditions has been met.

[0180] In some implementations, the output indicating the location of an object includes light (e.g., a beam of light, a ray of light, and / or pulsating light) directed at the object. Directing the light at the object allows the user to visually see the object's location in the environment without the object outputting any signal, thus providing the user with improved visual feedback and / or enabling actions to be performed when a set of conditions have been met without further user input.

[0181] In some implementations, the output indicating the location of an object includes audible output pointing to the object (and in some implementations, tactile output) (e.g., directional sound, beamed sound, and / or focused sound pointing to a specific location). Pointing the audible output to the object allows a user (e.g., audibly) to identify the object's location in the environment without the object outputting any signal, thereby providing the user with improved visual feedback and / or enabling actions to be performed when a set of conditions have been met without further user input.

[0182] In some embodiments, causing a first group of one or more devices to provide output indicating the location of an object in the environment includes: causing a first device (e.g., 522) in the first group of one or more devices to provide a first output based on the orientation of the first device relative to the object; and causing a second device (e.g., 536) in the first group of one or more devices to provide a second output based on the orientation of the second device relative to the object. In some embodiments, the first output differs from the second output (e.g., in a different direction and / or having a different amount of intensity (e.g., light intensity, brightness, sound intensity, and / or color)). In some embodiments, the orientation of the first device relative to the object (e.g., north, south, east, west, and / or any combination thereof relative to the x, y, and / or z planes) differs from the orientation of the second device relative to the object. In some implementations, as part of enabling a second group of one or more devices to provide output indicating the location of an object in the environment, the computer system enables a first device in the second group of one or more devices to provide a third output based on the orientation of the first device relative to the object; and enables a second device in the second group of one or more devices to provide a fourth output based on the orientation of the second device relative to the object, wherein the third output differs from the fourth output (e.g., in a different direction and / or with a different amount of intensity (e.g., light intensity, brightness, sound intensity, and / or color)). Enabling different devices to provide output based on the orientation of those devices relative to the object allows the output to be more precisely tailored to the object's position, thereby providing the user with improved visual feedback and / or performing an action when a set of conditions has been met without requiring further user input.

[0183] In some implementations, the first group of one or more devices includes a first type of device (e.g., a light, display, audio equipment, telephone, computer, tablet, wearable device, and / or fitness tracker) and a second type of device (e.g., a light, display, audio equipment, telephone, computer, tablet, wearable device, and / or fitness tracker) that is different from the first type of device. In some implementations, the first type of device is configured to output a first type of output, and the second type of device is configured to output a second type of output that is different from the first type of output. In some implementations, the first type of device outputs visual, audio, or haptic output, and the second type of device outputs another of visual, audio, or haptic output. Different groups of one or more devices include different types of devices, allowing different groups of one or more devices to better indicate the location of objects, thereby providing improved visual feedback to the user, reducing the amount of input required to perform an operation, and / or performing an operation without further user input when a set of conditions has already been met.

[0184] In some implementations, output indicating the location of an object in the environment is provided for a predetermined time period (e.g., 1 to 10 seconds), regardless of whether input is detected and / or the object is found. Providing output indicating the location of an object in the environment for a predetermined time period allows such output to be extended long enough for the user to locate the object, but not for an indefinite period so that the user would need to stop the output, thereby providing the user with improved visual feedback, reducing the amount of input required to perform an action, and / or performing an action when a set of conditions has been met without further user input.

[0185] In some implementations, in response to a request to detect the location of an identified object, the computer system displays an indication of the object's location (e.g., text, symbols, visual and / or graphical indicators, representations, and / or user interface objects) via a display component (e.g., 530). In some implementations, the indication of the object's location is located on a map of the physical environment. In some implementations, the indication of the object's location is a point displayed on the map. Displaying an indication of the object's location in response to a request to detect the location of an identified object allows the user to have multiple sources of identification of the object's location, thereby providing the user with improved visual feedback and / or enabling the user to perform actions without further user input when a set of conditions has been met.

[0186] In some implementations, in response to a request to detect the location of an identified object, an indication of the object's location is displayed relative to one or more representations of one or more locations of a first group of one or more devices in the environment and one or more representations of one or more locations of a second group of one or more devices in the environment. In some implementations, the map includes an indication of the object and indications of the locations of one or more external devices (e.g., one or more external devices providing the indication of the object's location). Displaying an indication of the object's location relative to one or more representations of one or more locations of different groups of one or more devices in the environment allows the user to have multiple sources of identification of the object's location, as well as indications within the context of output provided by other devices, thereby providing the user with improved visual feedback and / or enabling actions to be performed when a set of conditions has been met without further user input.

[0187] In some embodiments, in response to a request to detect the location of an identified object and based on the determination that one or more devices in a first group meet one or more criteria of the corresponding group and one or more devices in a second group do not meet one or more criteria of the corresponding group, one or more representations of the location of one or more devices in the environment of the first group of one or more devices include at least one indication of the first group of one or more devices providing output (e.g., text, symbols, visual and / or graphical indications, representations and / or user interface objects) (e.g., 522 and / or 532) (and in some embodiments, one or more representations of the location of one or more devices in the environment of the second group of one or more devices do not include at least one indication of the second group of one or more devices providing output). In some embodiments, in response to a request to detect the location of an identified object and based on the determination that one or more devices in a first group do not meet one or more criteria of the corresponding group and one or more devices in a second group meet one or more criteria of the corresponding group, one or more representations of the location of one or more devices in the environment of the second group of one or more devices include at least one indication of the second group of one or more devices providing output (e.g., 536, 524 and / or 526) (and in some embodiments, one or more representations of the location of one or more devices in the environment of the first group of one or more devices do not include at least one indication of the first group of one or more devices providing output). This provides an indication of an object's location relative to one or more representations of one or more locations of one or more devices providing output in the environment. It allows the user to have multiple sources of identification of the object's location, as well as indications in the context of output provided by other devices, thereby providing the user with improved visual feedback and / or enabling actions to be performed when a set of conditions have been met without further user input.

[0188] In some embodiments, after a first group of one or more devices provides output indicating the location of an object in the environment, the computer system detects that the object has been retrieved. In some embodiments, in response to detecting that the object has been retrieved, the computer system causes the first group of one or more devices to stop providing output indicating the location of the object in the environment. In some embodiments, after a second group of one or more devices provides output indicating the location of the object in the environment, the computer system detects that the object has been retrieved. In some embodiments, in response to detecting that the object has been retrieved, the computer system causes the second group of one or more devices to stop providing output indicating the location of the object in the environment. Responding to the detection that the object has been retrieved and causing the first group of one or more devices to stop providing output allows such devices to reduce visual and / or noise pollution and / or power consumption when such output is no longer needed, thereby providing the user with improved visual feedback and / or performing operations without further user input when a set of conditions has been met.

[0189] In some implementations, one or more criteria in the corresponding group include criteria that are met when determining an object that is not installed (e.g., magnetically mounted and / or connected (e.g., as described above with respect to process 300)). The inclusion of criteria that are met when determining an object that is not installed allows for conditional output when the object is not in the expected and / or installation location, thereby providing the user with improved visual feedback and / or performing an operation without further user input once a set of conditions has been met.

[0190] In some implementations, the request to detect the location of an identified object includes input (e.g., 505a) on a detection control (e.g., 520) (e.g., tap input and / or non-tap input (e.g., gaze input, air gesture, pointing gesture, swipe input, and / or mouse click)). Detecting input on a control allows the user to indicate when the object is located, providing the user with more control, thus offering improved visual feedback and / or enabling actions to be performed when a set of conditions are met without further user input.

[0191] In some implementations, the control is unselectable based on whether an object is installed (e.g., the computer system does not perform any operation, such as identifying the object's location, in response to detecting input on the control). In some implementations, the control is selectable based on whether an object is not installed (e.g., the computer system performs any operation, such as identifying the object's location, in response to detecting input on the control). Selectively making the control selectable based on whether an object is installed allows for the absence of a set of outputs from one or more devices under specific conditions and / or allows the user to identify when an object is not installed, thereby providing the user with improved visual feedback and / or performing an operation when a set of conditions has been met without further user input.

[0192] In some implementations, the control is invisible (e.g., not displayed, not made to be displayed, and / or not visible without moving the object) depending on whether an object is installed. In some implementations, the control is visible (e.g., not displayed, not made to be displayed, and / or not visible without moving the object) depending on whether an object is installed (and / or depending on whether a user is present and / or depending on whether a user is looking in the direction of the control). Selectively making the control visible based on whether an object is installed allows for the absence of a group of outputs from one or more devices under certain conditions and / or allows the user to identify when an object is not installed, thereby providing the user with improved visual feedback and / or performing an action without further user input when a set of conditions has been met.

[0193] It should be noted that the process described above is relative to that described in method 600 (e.g., Figure 6 The details of the above also apply to the other methods described herein. For example, process 800 optionally includes one or more characteristics of the various methods described above with reference to process 600. For example, an object of process 600 may be an object of process 800. For the sake of brevity, these details will not be repeated.

[0194] Figures 7A to 7C Techniques for selectively providing feedback according to some implementation schemes are illustrated. The schematic diagrams in these figures are used to illustrate the processes described below, including... Figures 8 to 9 The process in.

[0195] Although the following description refers to operations performed by a controller device, it should be understood that one or more computer systems may perform operations. For example, a controller device may receive an image from a separate camera and, based on that image, cause a separate smart speaker to output audio. As another example, a camera on a portable computer system may capture an image and, based on that image, cause a light on the portable computer system to turn on.

[0196] Figures 7A to 7C An example is illustrated where user 706 (e.g., a person) uses several computer systems (e.g., speaker 704, lamp 712, and sofa 708a) to locate an object (e.g., object 710) within a physical environment (e.g., environment 700). Examples of object 710 may include a smartphone, television remote control, smartwatch, car key, pen, a piece of paper, and smart speaker remote control. Therefore, object 710 can be an electrical or non-electrical device, can communicate with or not communicate with one or more computer systems, and / or can be located by or not through visual inspection (e.g., via environment 700). Figures 7A to 7C As illustrated, environment 700 is a room in a residence. It should be recognized that other objects, environments, and / or computer systems may be used in conjunction with the techniques described herein.

[0197] In some embodiments, speaker 704 is an audio output device configured to output audio to environment 700. In some embodiments, the audio output by speaker 704 is a media item (e.g., song, music, and / or podcast) and / or a series of audible tones. In some embodiments, the audio output by speaker 704 may be spatial audio (e.g., audio output at a certain volume in one direction and at another volume in another direction). In other embodiments, the audio output by speaker 704 is not spatial audio. In some embodiments, lamp 712 is a group of one or more lamps mounted to the ceiling of environment 700, the group of one or more lamps being configured to output light to environment 700. In some embodiments, lamp 712 may direct light in certain directions. In some embodiments, sofa 708a is a seat that includes sofa legs (e.g., sofa leg 708b) capable of changing position using actuators in response to a request.

[0198] In some implementations, the controller device assisting user 706 is capable of identifying the location of object 710 (e.g., through visual inspection, memory, or non-visual triangulation). In such implementations, the controller device may guide user 706 to object 710. For example, the controller device may cause the output of one or more computer systems to cause user 706 to look in a particular direction and / or move in that direction. As the user moves in the particular direction, the controller device may change the output of one or more computer systems to further cause user 706 to look in the particular direction and / or move in the particular direction until user 706 finds object 710, as described below relative to... Figures 7A to 7C Further discussion is needed.

[0199] In some implementations, the controller device assisting user 706 is unaware of the location of object 710. In such implementations, as user 706 looks around in environment 700, the controller device may cause the computer systems in environment 700 to change state to assist user 706. As user 706 continues to look around, the controller device may cause the same computer systems and / or different computer systems to change state to attempt to continue assisting user 706. For example, if user 706 looks to the right, the light in environment 700 may be directed to user 706's right side. If user 706 leans over to look at the bottom of sofa 708a, sofa leg 708b may be lowered while the light is directed to the original location of sofa leg 708b.

[0200] Go to Figure 7AThe controller device can operate in a normal mode, in which one or more computer systems in environment 700 operate as previously configured (e.g., by user 706 and / or another user). For example, speaker 704 can output audio 702 at a first volume (e.g., set by user 706), lamp 712 can output light at a first brightness level across substantially the entire environment 700, and sofa leg 701b can be raised. Note that the magnitude of audio 702 is related to its volume (e.g., a small indicator indicates low volume, while a large indicator indicates high volume). Figure 7A As illustrated, object 710 is positioned below sofa leg 708b and is obscured from the view of user 706.

[0201] exist Figure 7A At this point, the controller device switches to object locator mode, which allows the controller device to assist user 706 in finding objects. In some implementations, object locator mode is activated in response to detecting input from user 706 (such as tapping on a touch-sensitive surface, verbal requests, air gestures, and / or user 706 being determined to be searching for an object in environment 700).

[0202] In some implementations, the object locator mode corresponds to a specific user (e.g., the owner, primary user, and / or designated user of the controller device, such as the user who causes the controller device to change to object locator mode). In such implementations, the assistance provided by the controller device may correspond to a specific user rather than other users. For example, when a specific user moves around environment 700, the controller device may cause different computer systems to change state to assist that specific user. However, when another user moves around environment 700, the controller device may not cause different computer systems to change state to assist that other user.

[0203] exist Figure 7A At a location (e.g., when in object locator mode and / or when object locator mode is activated), the controller device (e.g., via a camera, a wearable device using a gyroscope, and / or another sensor) detects that the user 706 has turned toward the sofa 708a and / or the object 710.

[0204] like Figure 7B As illustrated, in response to detecting that user 706 turns around, the controller device causes speaker 704 to reduce the volume of its audio output (e.g., as in...). Figure 7AThe volume of the audio output of the illustrated speaker 704 is reduced (compared to the volume of the speaker 704). That is, the volume of the speaker 704 is reduced based on the user 706 turning around. Such a change can reduce distraction when the user 706 is looking for the object 710. In some embodiments, as an alternative and / or supplement to reducing the volume, the controller device causes the speaker 704 to direct the audio output (e.g., spatial audio) toward the object 710 in order to guide the user 706 closer to the object 710. For example, the controller device may cause the speaker 704 to output audio at an increased volume in the direction toward the object 710 and at a decreased volume in the direction away from the object 710. In some embodiments, as a supplement and / or alternative to reducing the volume of the speaker 704, the controller device causes the lamp 712 to illuminate a general area of ​​the sofa 708a. In such embodiments, the lamp can be used to indicate that the object 710 is approximately near the sofa 708a and / or to illuminate the area that the user 706 is looking at. It is worth noting that one or more other computer systems in the environment 700 may not be affected by the user 706 turning around to the sofa 708a. For example, sofa 708a does not respond to user 706 turning around and moving.

[0205] exist Figure 7B At that point, user 706 moved from a standing position to a squatting position. Figure 7C In response to detecting a user 706 in a crouching position, the controller device causes the speaker 704 to stop outputting audio (e.g., as shown in the image). Figure 7C (The audio 702 does not exist). This change in audio can further reduce distraction as the user 706 continues searching for object 710.

[0206] like Figure 7C As illustrated, in response to detecting a user 706 in a crouching position, the controller device causes the sofa leg 708b to retract into the sofa 708a (e.g., via an actuator of the sofa 708a). In some embodiments, in response to detecting a user 706 in a crouching position, the controller device causes the lamp 712 to direct light towards the location previously covered by the sofa leg 708b (e.g., as shown in the image). Figures 7A to 7B (As illustrated). In some embodiments, the light output rate of lamp 712 is based on the movement rate of user 706. That is, as user 706 moves in environment 700, lamp 712 may gradually illuminate the path to object 710 as user 706 approaches object 710 (e.g., lamp 712 does not output the entire light path from user 706 to object 710).

[0207] It is worth noting that various types of computer systems have been modified in response to the detection of a user 706 in a crouching position. Such examples illustrate how a controller device can utilize different types of output (e.g., sound, light, and / or movement) to assist in locating object 710. It should be recognized that in some implementations, some movement will not cause the controller device to change the content of its output. Instead, even when user 706 moves and / or changes position within environment 700, the controller device maintains its current output to assist user 706.

[0208] exist Figure 7C Since the sofa leg 708b has retracted into the sofa 708a, the object 710 is visible to the user 706. In some embodiments, the speaker 704 emits a sound before and / or after the sofa leg 708b retracts into the sofa 708a to indicate that the object 710 has been revealed.

[0209] In some implementations, the controller device adapts the use of computer systems and / or outputs when assisting user 706 in locating object 710. In such implementations, the controller device may select the computer system and / or output based on the current location and / or movement of user 706 relative to object 710. For example, the controller device may use light when user 706 is farther from object 710, and use motion when user 706 is closer to object 710.

[0210] Figure 8 This is a flowchart illustrating a method (e.g., process 800) for adjusting the output of a device according to some implementation schemes. Some operations in process 800 may be optionally combined, the order of some operations may be optionally changed, and some operations may be optionally omitted.

[0211] As described below, process 800 provides an intuitive way to adjust the output of a device. Process 800 reduces the cognitive burden on users when adjusting the device's output, thus creating a more efficient human-machine interface. For battery-powered computing devices, enabling users to adjust the device's output faster and more efficiently saves power and increases the time between battery charging cycles.

[0212] In some embodiments, process 800 is performed at a computer system communicating with one or more devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices, vehicles, smart seats, smart furniture, smart gates, smart doors, houses, boats, and / or intelligent parts of vehicles and / or personal computing devices) that do not include objects (e.g., devices and / or remote controls) (e.g., 710) (e.g., 704, 712, and / or 708). In some embodiments, the computer system communicates with one or more devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices, and / or personal computing devices) and one or more input devices (e.g., physical input mechanisms, cameras, touch-sensitive displays, microphones, and / or buttons) that do not include objects. In some embodiments, the computer system communicates with physical (e.g., hardware and / or non-display) input mechanisms (e.g., hardware input mechanisms, rotatable input mechanisms, crowns, knobs, dials, physical sliders, and / or hardware buttons). In some embodiments, the computer system is a watch, phone, tablet, processor, head-mounted display (HMD) device, and / or personal computing device. In some embodiments, the computer system communicates with one or more cameras (e.g., one or more telephoto, wide-angle, and / or ultra-wide-angle cameras). In some embodiments, the computer system communicates with display components (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the first group of one or more devices is not part of the computer system.

[0213] The first output (e.g., 702, as described above relative to one or more devices in the first group) indicates where the object is located. Figure 7B When the computer system detects (802) a change in the positioning relationship between the first user (e.g., 706) and the object (e.g., a change in orientation, positioning, and / or distance) (as described above) (e.g., sound output, light output, vibration output (e.g., in one direction (e.g., north, east, west, south, or any combination thereof) and / or to a specific degree (e.g., volume, intensity, and / or color)) (e.g., in one or more directions and / or perceived as in one or more directions (e.g., from a position corresponding to the object and a position corresponding to the user, from a position corresponding to the user to a position corresponding to the object, from the device to the object, and / or from the device to the user)) in one or more directions), the computer system detects (802) a change in the positioning relationship between the first user (e.g., 706) and the object (e.g., a change in orientation, positioning, and / or distance) (e.g., as described above relative to the object) Figure 7C (as described) (e.g., detecting changes in the user's position relative to an object and / or the object's position relative to the user) (e.g., movement of the user and / or the object (e.g., from a first position to a second position different from the first position)) (e.g., via one or more cameras and / or motion sensors in communication with a computer system)).

[0214] In response to detecting a change in the positioning relationship between the first user and the object, the computer system causes (804) one or more devices in the first group to provide a second output (e.g., 708b and / or 712) indicating where the object is located, wherein the second output differs from the first output (e.g., in a different direction, having a different intensity, and / or belonging to a different output type). This second output, caused by the first group of one or more devices in response to detecting a change in the positioning relationship between the first user and the object, allows the computer system to perform operations that guide the user to the location of the object, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0215] In some embodiments, the first output corresponds to light output in a first direction (e.g., the first direction is towards or away from the object). In some embodiments, the second output corresponds to light output in a second direction different from the first direction (e.g., the second direction is towards or away from the object) (e.g., the first and second directions overlap or do not overlap). In some embodiments, the first and second directions correspond to the positioning relationship between a first user and the object. In some embodiments, the brightness of the first light output is greater than or less than the brightness of the second light output. In some embodiments, the brightness of the first and / or second light outputs corresponds to the distance between the object and the user. Changing the direction of light pointing in response to detecting a change in the positioning relationship between the user and the object allows the computer system to guide the user to the object's location, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0216] In some embodiments, the first output includes audio having a first spatial output attribute (e.g., spatial audio) (e.g., audio output in a particular spatial direction and / or audible from different locations in space and / or one or more dimensions). In some embodiments, the second output includes audio having a second spatial output attribute different from the first spatial output (e.g., spatial audio). In some embodiments, the audio having the second spatial attribute can be heard and / or directed (e.g., output to be heard) at different locations in space compared to the audio having the first spatial attribute, and / or has different volume levels at different locations in space. In some embodiments, the first output has a first volume level pointing in a third direction rather than a fourth direction, and a second volume level pointing in a fourth direction rather than a third direction. In some embodiments, the first volume level is different from the second volume level (e.g., the second volume level is greater than, less than, or equal to the first volume level) (e.g., the third direction is different from and / or dissimilar to the fourth direction) (e.g., the third direction is a direction toward the object relative to the first user's position, or the third direction is a direction away from the object relative to the first user's position). In some implementations, the second output has a third volume level pointing in a fourth direction instead of a third direction, and a fourth volume level pointing in a third direction instead of the fourth direction. In some implementations, the third volume level and the fourth volume level are different (e.g., the third direction is different from and / or dissimilar to the fourth direction). In some implementations, the third direction and the fourth direction correspond to the positioning relationship between the first user and the object. In some implementations, the combined volume of the first volume level and the second volume level is greater than or less than the combined volume of the third volume level and the fourth volume level. Changing the spatial properties of the audio output in response to detecting a change in the positioning relationship between the user and the object allows the computer system to guide the user to the object's location, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0217] In some embodiments, the positioning relationship between the first user and the object changes at a certain speed rate (e.g., measured in feet per second, meters per second, miles per hour, and / or inches per second) (e.g., detected via one or more sensors integrated into or outside the computer system). In some embodiments, the second output has a first output rate (e.g., measured in beats per minute, light pulses per minute, light pulses per second, vibrations per minute, and / or vibrations per second) corresponding to a determined speed rate. In some embodiments, the second output has a second output rate different from the first output rate (e.g., measured in beats per minute, light pulses per minute, light pulses per second, vibrations per minute, and / or vibrations per second) corresponding to a determined speed rate different from the first speed rate. In some embodiments, the rate at which the second output is output by one or more devices in a first group is based on the speed rate of movement of the user and / or the object. In some embodiments, the output rate corresponding to the second output is different from the output rate corresponding to the first output. In some embodiments, the computer system and / or the first user and / or the object are moving when the first output is output. The first group of one or more devices outputs a second output at one or more rates based on the rate of change of the positioning relationship between the first user and the object, indicating to the user how fast the distance between the user and the object is changing, thereby providing improved feedback and providing the user with one or more additional control options without cluttering the user interface.

[0218] In some implementations, in response to detecting a change in the positioning relationship between the first user and the object and based on determining that the first user and the object have a first positioning relationship after the change in the positioning relationship between the first user and the object is detected (e.g., the first user is positioned to the left, above, below, right, in front of, or behind the object) (e.g., the distance between the first user and the object is greater than or less than a distance threshold (e.g., 1 foot to 25 feet)), the second output has a first set of characteristics (e.g., direction, brightness, volume, beats per minute, flashes per minute, and / or color). In some implementations, in response to detecting a change in the location relationship between the first user and the object, and based on determining that the first user and the object have a second location relationship different from the first location relationship after the change in location relationship is detected (e.g., the second location relationship is different from and / or dissimilar to the first location relationship), the second output has a second set of characteristics different from the first set of characteristics (e.g., direction, brightness, volume, beats per minute, flashes per minute, and / or color) (e.g., the output with the second set of characteristics is louder than the output with the first set of characteristics, the output with the second set of characteristics is quieter than the output with the first set of characteristics, the output with the second set of characteristics is brighter than the output with the first set of characteristics, the second set of characteristics corresponds to a faster output rate than the first set of characteristics, and the second set of characteristics corresponds to a slower rate or output than the first set of characteristics). In some implementations, the intensity of the second output is positively correlated with the distance between the first user and the object. In some implementations, the intensity of the second output is negatively correlated with the distance between the first user and the object. The first group of one or more devices outputs a second output with different group characteristics based on the positioning relationship between the user and the object. This allows the computer system to guide the user to the object's location, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0219] In some implementations, a first group of one or more devices is in a first location (e.g., 708b, as shown) before a change in the location relationship between the first user and the object is detected. Figure 7B (e.g., closed positioning, folded positioning, unfolded positioning, lateral positioning, forward positioning, and / or downward positioning). In some embodiments, causing the first group of one or more devices to provide a second output includes moving the first group of one or more devices from a first positioning to a second positioning different from the first positioning (e.g., 708b, as illustrated). Figure 7C(As illustrated). In some embodiments, the first positioning is relative to the second positioning (e.g., the first positioning is offset by 180 degrees from the second positioning, the first group of devices is extended when in the first positioning, and one or more devices in the first group are retracted when in the second positioning, and / or one or more devices in the first group are upright when in the first positioning, and one or more devices in the first group are not upright when in the second positioning). In some embodiments, the first group of one or more devices occludes the object when in the first positioning, and does not occlude the object when in the second positioning. In some embodiments, the first group of one or more devices occludes the object when in both the first and second positioning. As part of enabling the first group of one or more devices to provide a second output, moving the first group of one or more devices from the first positioning to the second positioning indicates the positioning of the object to the user, thereby providing improved feedback and providing the user with one or more additional control options without cluttering the user interface.

[0220] In some embodiments, the first output and the second output are the same type of output (e.g., the first output and the second output are audio output, light output, and / or haptic output). In some embodiments, the second output and the first output are different types of output. In some embodiments, the intensity of the first output is greater than or less than the intensity of the second output. In some embodiments, the intensity of the first output is the same as the intensity of the second output.

[0221] In some embodiments, the computer system communicates with a second group of one or more devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices, vehicles, smart seats, smart furniture, smart gates, smart doors, smart parts of houses, boats, and / or vehicles, and / or personal computing devices) that are different from the first group of one or more devices and do not include the object, and wherein a change in the location relationship between the first user and the object is detected when the second group of one or more devices provides a third output indicating where the object is located. In some embodiments, in response to detecting a change in the location relationship between the first user and the object, the computer system causes the second group of one or more devices to output a fourth output indicating where the object is located, wherein the fourth output is different from the second and third outputs (e.g., different intensity, different type (e.g., the third output is an audio output and the fourth output is a haptic output, or the third output is a visual output and the fourth output is an audio output) and / or different duration). In some embodiments, the fourth output is the same type of output as the first, second, and / or third outputs. In some implementations, the fourth output is a different type of output from the first, second, and / or third outputs. In some implementations, the second group of devices outputs the fourth output when, before, and / or after the first group of devices outputs the second output. Responding to the detection of a change in the positioning relationship between the first user and the object, causing one or more devices in the second group to output a fourth output different from the second and third outputs allows two or more devices to simultaneously indicate the object's positioning relative to the user, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0222] In some embodiments, the computer system communicates with one or more third groups of devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices, vehicles, smart seats, smart furniture, smart gates, smart doors, houses, boats, and / or intelligent parts of vehicles and / or personal computing devices) that are different from the first group of one or more devices and do not include the object, and wherein a change in the location relationship between the first user and the object is detected when the third group of one or more devices provides a fifth output indicating where the object is located. In some embodiments, in response to detecting a change in the location relationship between the first user and the object, the computer system continues to cause (e.g., maintain and / or preserve) the third group of one or more devices to provide the fifth output. In some embodiments, in response to detecting a change in the location relationship between the first user and the object, the computer system does not cause the third group of one or more devices to provide an output different from the fifth output.

[0223] In some embodiments, when causing one or more devices in the first group to provide a first output, the computer system detects a change in the location relationship between a second user (e.g., the second user is different from and / or different from the first user) and an object (e.g., the change in the location relationship between the second user and the object is detected before, after, or at the time the change in the location relationship between the first user and the object is detected). In some embodiments, in response to detecting a change in the location relationship between the second user and the object, the computer system abandons causing one or more devices in the first group to provide an output different from the first output (e.g., indicating where the object is located). In some embodiments, in response to detecting a change in the location relationship between the second user and the object, the computer system continues to cause one or more devices in the first group to provide the first output. In some embodiments, in response to detecting a change in the location relationship between the second user and the object, the computer system does not cause one or more devices in the first group to provide a second output. In some embodiments, the computer system causes one or more devices in the first group to provide a different output in response to detecting a change in the location relationship between the second user and the object.

[0224] In some implementations, the first user is a target user (e.g., the first user is targeted by the computer system and / or targeted by a user) (e.g., the first user is an owner, master user, and / or designated user). In some implementations, the second user is a non-target user (e.g., the computer system does not track the movement of the second user, the second user does not correspond to a user account corresponding to the computer system, and / or the second user is not registered with the computer system (e.g., via a user account and / or telephone number)). In some implementations, the computer system tracks the movement of the first user, and the computer system does not track the movement of other corresponding users. In some implementations, the computer system tracks the movement of the first user, and the computer system tracks the movement of other corresponding users. In some implementations, the first user is registered with the computer system (e.g., via a user account and / or telephone number). In response to detecting a change in the location relationship between non-target users without causing one or more devices in the first group to provide an output different from the first output, the computer system is allowed to provide targeted feedback and reduce the amount of distracting feedback in the computer system output, thereby providing improved feedback.

[0225] In some embodiments, the computer system communicates with a fourth group of one or more devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices, vehicles, smart seats, smart furniture, smart gates, smart doors, houses, boats, and / or intelligent parts of vehicles and / or personal computing devices) that are different from the first group of one or more devices and do not include the object (e.g., wired and / or wireless communication (e.g., Bluetooth, Wi-Fi, and / or ultra-wideband)). In some embodiments, in response to detecting a change in the positioning relationship between the first user and the object, the computer system moves the fourth group of one or more devices from the first position (e.g., lowers, raises, translates, and / or rotates) to a second position (e.g., the first and second positions are within an area (e.g., a room, a building, the side of a vehicle (e.g., front, rear, left, and / or right) (e.g., passenger side, driver side, and / or operator side), the side of a courtyard, the side of a boat, and / or the side of a house), or the first and second positions are located in different areas) (e.g., the second position is different from and / or dissimilar to the first position). In some implementations, the computer system moves a fourth group of one or more devices from a first position to a second position before, after, and / or while the computer system causes the first group of one or more devices to output a second output. In some implementations, the computer system moves the fourth group of one or more devices from the second position to the first position after the computer system has moved the fourth group of one or more devices from the first position to the second position. Moving the first group of one or more devices from the first position to the second position in response to detecting a change in the positioning relationship between the first user and the object allows the computer system to make the object visible to the user, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0226] In some implementations, when the fourth group of one or more devices is in the first position, the fourth group of one or more devices is located between the user and the object (e.g., the fourth group of one or more devices is in the path between the user and the object, and / or when the fourth group of one or more devices is positioned in the first position, the fourth group of one or more devices obstructs the user's line of sight to the object). In some implementations, when the fourth group of one or more devices is in the second position, the fourth group of one or more devices is not located between the user and the object. Moving the fourth group of one or more devices from the first position between the user and the object to the second position allows the computer system to make the object visible to the user, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0227] In some implementations, before moving one or more devices from the fourth group from the first position to the second position, the fourth group of one or more devices occludes (e.g., partially or completely occludes the object to the corresponding user). (For example, the fourth group of one or more devices occludes the object such that it is not visible to the user, partially invisible to the user, and / or partially occludes the object to the user.) In some implementations, the fourth group of one or more devices does not occlude the object when it is positioned at the second position. In some implementations, the fourth group of one or more devices occludes the object when it is in the first position. In some implementations, the fourth group of one or more devices does not occlude the object when it is in the second position. Moving one or more devices from the fourth group of one or more devices from the occluded object's first position to the second position allows the computer system to make the object visible to the user, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0228] It should be noted that the above description is relative to the process described in method 800 (e.g., Figure 8 The details of the above also apply in a similar manner to the other methods described herein. For example, process 300 optionally includes one or more characteristics of the various methods described above with reference to process 800. For example, the first set of devices in process 800 may be controlled via a first set of one or more controls or a second set of one or more controls in process 300. For the sake of brevity, these details will not be repeated.

[0229] Figure 9 This is a flowchart illustrating a method (e.g., process 900) for providing context-based feedback according to some implementation schemes. Some operations in process 900 may be optionally combined, the order of some operations may be optionally changed, and some operations may be optionally omitted.

[0230] As described below, Process 900 provides an intuitive way to deliver context-based feedback. Process 900 reduces the cognitive burden on users when receiving feedback, thus creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to receive feedback faster and more efficiently saves power and increases the time between battery charging sessions.

[0231] In some embodiments, process 900 is performed at a computer system communicating with a first group of one or more devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices, vehicles, smart seats, smart furniture, smart gates, smart doors, houses, boats, and / or intelligent parts of vehicles and / or personal computing devices) (and in some embodiments, the first group of one or more devices does not include objects (e.g., devices and / or remote controls)) (e.g., 704, 708, and / or 712). In some embodiments, the first group of one or more devices is not part of the computer system. In some embodiments, the computer system communicates with a second group of one or more devices that do not include objects (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices, and / or personal computing devices) and one or more input devices (e.g., physical input mechanisms, cameras, touch-sensitive displays, microphones, and / or buttons). In some embodiments, the computer system communicates with physical (e.g., hardware and / or non-display) input mechanisms (e.g., hardware input mechanisms, rotatable input mechanisms, crowns, knobs, dials, physical sliders, and / or hardware buttons). In some implementations, the computer system is a watch, phone, tablet, processor, head-mounted display (HMD) device, and / or personal computing device. In some implementations, the computer system communicates with display components (e.g., a display screen and / or a touch-sensitive display).

[0232] When the first group of one or more devices are in a first manner (e.g., as described above relative to...), Figure 7A As described above, when the computer system detects (902) the first movement (e.g., relative to the user) of the user (e.g., illuminating an area corresponding to the user, outputting audio at a specific location, or being in a specific location, dimming the interior in a first manner) (e.g., providing sound output, light output, and / or vibration output (e.g., in a direction (e.g., north, east, west, south, or any combination thereof) and / or at a specific degree (e.g., volume, intensity, and / or color)) (e.g., output in one or more directions and / or perceived as being in one or more directions (e.g., from a location corresponding to the object to a location corresponding to the user, from a location corresponding to the user to a location corresponding to the object, from the device to the object, and / or from the device to the user)), the computer system detects (902) the first movement (e.g., relative to the user) of the user (e.g., 706). Figure 7B (as described) (e.g., from a first position to a second position different from the first position and / or from a first body posture (e.g., sitting, standing, bending over and / or kneeling) to a second body posture (e.g., sitting, standing, bending over and / or kneeling) (e.g., via one or more cameras and / or motion sensors in communication with a computer system)).

[0233] In response to (904) detecting a first movement of the user (e.g., from a first location to a second location different from the first location), based on determining the existence of a first context (e.g., the computer system operates in the first context and / or the user's movement is the first context (e.g., the user's location is a specific location (e.g., bending over, standing, and / or kneeling))) (and / or when the first context exists) (e.g., after detecting the user's movement), the computer system causes (906) one or more devices in the first group to operate in a second manner different from the first manner (e.g., illuminating the area under the seat, outputting audio at a different location, or moving the seat) (e.g., as described above relative to the first manner). Figure 7B (As described). In some embodiments, the first context includes determining that the user has a first intent (e.g., a predicted intent and / or a determined intent). In some embodiments, the first context includes determining that the user is looking in a first direction. In some embodiments, the first context includes determining that an object is located in the direction the user is looking in. In some embodiments, the first context includes that the computer system is moving. In some embodiments, the first context includes determining that the user is outside the computer system. In some embodiments, the first context does not include the user's verbal and / or physical input.

[0234] In response to (904) detecting a first movement of the user, based on determining the existence of a second context (e.g., the computer system operates in a second context and / or the user's movement is a second context (e.g., the user's positioning is a specific positioning (e.g., bending over, standing, and / or kneeling))) (and / or when a second context exists) (e.g., after detecting the user's movement), the computer system causes (908) one or more devices in the first group to operate in a third mode different from the second and first modes (e.g., as described above relative to the first mode). Figure 7CThe described operation (e.g., in some embodiments, not causing the first group of one or more devices to operate in a second manner and / or a first manner). In some embodiments, the second context includes determining that the user has a second intention different from the first intention (e.g., a predicted intention and / or a determined intention). In some embodiments, the second context includes determining that the user is looking in a second direction different from the first direction. In some embodiments, the second context includes determining that the computer system has stopped. In some embodiments, the second context includes determining that the user is inside the computer system. In some embodiments, the second context does not include the user's verbal and / or physical input. In some embodiments, the first context and / or the second context are about the computer system. In some embodiments, the first context and / or the second context are about the user. In some embodiments, the first context and / or the second context are about objects separate from and / or not communicating with the computer system. Causing the first group of one or more devices to operate in a particular manner based on which context exists allows the computer system to automatically control the operation of the first group of one or more devices to indicate the context of the computer system and / or the user to the user, thereby providing improved feedback and providing the user with one or more additional control options without cluttering the user interface.

[0235] In some embodiments, the first group of one or more devices includes (and / or one or more groups of one or more) one or more output devices (e.g., lamps, televisions, radios, tablets, displays, head-mounted displays, and / or speakers) (e.g., devices that provide outputs detectable by one or more of an individual's senses). In some embodiments, the first group of one or more devices includes a first type of output device (e.g., a lamp or a speaker) and includes a second type of output device (e.g., a lamp or a speaker) that is an output device of a different type from the first type of output device.

[0236] In some embodiments, operating a first group of one or more devices in a first manner (and / or a second manner) includes having the first group of one or more devices provide a first output in a first direction (e.g., in a direction toward the user and / or in a direction away from the user) (e.g., above, below, and / or to the side of the first group of one or more devices), without having the first group of one or more devices provide a first output in a second direction. In some embodiments, operating a first group of one or more devices in a second manner includes having the first group of one or more devices provide a first output in a second direction, without having the first group of one or more devices provide a first output in the first direction (e.g., above, below, and / or to the side of the first group of one or more devices). In some embodiments, the first direction overlaps with the second direction. In some embodiments, the first direction does not overlap with the second direction. In some embodiments, the first direction is opposite to the second direction, the second direction is perpendicular to the first direction, and / or the second direction is at an angle to the first direction. In some embodiments, operating a first group of one or more devices in a first manner includes causing the first group of one or more devices to point a corresponding output (e.g., audio output, visual output, and / or tactile output) to a first location, without causing the first group of one or more devices to point the corresponding output to a second location (e.g., closer to the first group of one or more devices than the first location, farther away from the first group of one or more devices than the first location, and / or on a side of the first group of one or more devices different from the first location) (and / or detecting the output, such as light or sound, at the first location instead of the second location), and wherein operating the first group of one or more devices in a second manner includes causing the first group of one or more devices to point a corresponding output (e.g., a third output) to the second location, without causing the first group of one or more devices to point the corresponding output to the first location (and / or detecting the output, such as light or sound, at the second location instead of the first location). In some embodiments, the second location overlaps with the first location. In some embodiments, the second location does not overlap with the first location. In some embodiments, the first location and the second location (e.g., a room in a residence or an area inside a car) are sub-locations within a main location. This allows one or more devices in the first group to provide output in a specific direction based on the presence or absence of context, enabling the computer system to indicate the context of both the computer system and the user, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0237] In some implementations, the first output propagates (e.g., diffuses, spreads, and / or emits) throughout the physical environment (e.g., the physical environment surrounding the computer system, the physical environment within the computer system, and / or the physical environment not surrounding the computer system (e.g., the physical environment outside the computer system and / or the computer system not within the physical environment)).

[0238] In some embodiments, operating the first group of one or more devices in a first manner includes causing the first group of one or more devices to provide a second output having a first spatial attribute (e.g., outputting audio in a specific spatial direction and / or from different locations in space and / or one or more dimensions). In some embodiments, operating the first group of one or more devices in a second manner includes causing the first group of one or more devices to provide a second output having a second spatial attribute different from the first spatial attribute (e.g., different direction, different volume, and / or different audio characteristics) (e.g., outputting audio in a specific spatial direction and / or from different locations in space and / or one or more dimensions). In some embodiments, the volume of the output device decreases when the computer system detects that the user is searching for something and / or moving toward something (e.g., an object). Causing the first group of one or more devices to provide output with a specific type of spatial attribute based on the presence of context allows the computer system to indicate the context of both the computer system and the user, thereby providing improved feedback and offering the user one or more additional control options without cluttering the user interface.

[0239] In some embodiments, the first group of one or more devices includes an actuator (e.g., a pneumatic actuator, a hydraulic actuator, or an electric actuator). In some embodiments, operating the first group of one or more devices in a second manner includes moving the actuator from a first position (e.g., as described above relative to...). Figure 7B The described 708b) moves to a second location that is different from the first location (e.g., the second location moves away from the first location and / or the second location is different from the first location) (e.g., as described above relative to the first location). Figure 7C (As described in 708b). In some embodiments, the first positioning is closer to the user than the second positioning, or vice versa. In some embodiments, moving the actuator from the first positioning to the second positioning causes the device, such as a smart furniture, smart chair, smart door, smart accessory, and / or smart gate, to move.

[0240] In some embodiments, the computer system communicates (e.g., wireless and / or wired communication) with a second group of one or more devices (e.g., lights, speakers, telephones, tablets, processors, head-mounted display (HMD) devices, vehicles, smart seats, smart furniture, smart gates, smart doors, smart parts of houses, boats, and / or personal computing devices) (and in some embodiments, the first group of one or more devices does not include objects (e.g., devices and / or remote controls)), and wherein, prior to detecting a first movement of the user, the computer system causes the second group of one or more devices to operate in a fourth manner (e.g., different from or the same as the first and / or second manner). In some embodiments, in response to detecting a first movement of the user, the computer system causes the second group of one or more devices to operate in a fifth manner different from the fourth manner (e.g., when the second group of one or more devices operates in the fifth manner, the second group of devices is louder, brighter, spins faster, is quieter, spins slower, and / or is less bright than when the second group of one or more devices operates in the fourth manner). In some embodiments, the fifth manner is different from the first, second, and / or third manners. In some implementations, the fourth mode differs from the first, second, and / or third modes. In response to detecting a first movement by the user, one or more devices in the second group operate in a fifth mode, allowing the user to control the operation of the second group of one or more devices without requiring the computer system to display corresponding user interface elements, thereby providing the user with one or more additional control options without cluttering the user interface.

[0241] In some embodiments, the computer system communicates with an external wearable device (e.g., a smartwatch, head-mounted display, fitness tracker, head-mounted display, and / or smart glasses) via wireless and / or wired communication. In some embodiments, the user's initial movement is detected via the external wearable device (e.g., the computer system measures the signal strength of a wireless signal transmitted from the external wearable device to the computer system, and / or the computer system determines the distance between the external wearable device and the computer system). In some embodiments, the user's movement is detected via one or more cameras on the external wearable device. In some embodiments, the user's movement is detected via one or more sensors on the external wearable device.

[0242] In some embodiments, the computer system communicates with a group of one or more cameras (e.g., one or more cameras are external to the computer system, or one or more cameras are integrated into the computer system). In some embodiments, the user's first movement is detected via image data captured by the group of one or more cameras. In some embodiments, the group of one or more cameras is integrated into the computer system. In some embodiments, the group of one or more cameras is external to the computer system.

[0243] In some embodiments, when the first group of one or more devices is operated in a first manner and the user is within a focus area (e.g., the corresponding seat and / or area of ​​a mobile system (e.g., an airplane, ship, and / or car), an area within the wireless communication range of a computer system, an area within the field of view of one or more cameras, and / or a corresponding area of ​​the mobile system) (e.g., the side of a room, building, vehicle (e.g., front, rear, left, and / or right) (e.g., passenger side, driver side, and / or operator side), side of a courtyard, side of a ship, and / or side of a house), the computer system detects a second movement of the user (e.g., the same as or different from the first movement) (e.g., the second movement of the user is detected before or after the first movement of the user is detected). In some embodiments, in response to the detection of the second movement of the user, based on determining that the user is located within the focus area (part of the user is located within the focus area or the entire user is located within the focus area), the computer system causes the first group of one or more devices to continue operating in the first manner. In some embodiments, in response to the detection of the second movement of the user, based on determining that the user is not located within the focus area (part of the user is located within the focus area or the entire user is located within the focus area), the computer system causes the first group of one or more devices to operate in a fifth manner different from the first manner. In some implementations, in response to a user changing their location from within the focus area to outside the focus area, the first group of one or more devices changes from operating in a first mode to operating in a fifth mode. In some implementations, the computer system causes the first group of one or more devices to continue operating in either the first or fifth mode in response to detecting the end of a second movement of the user. In some implementations, the user is not located within the computer system when they are not located within the focus area. In some implementations, the user cannot access various functionalities of the computer system whether they are in the focus area or not. Automatically enabling the first group of one or more devices to operate in a specific manner based on the user's location allows the computer system to control the operation of the first group of one or more devices to indicate the user's location, thereby performing operations when a set of conditions has been met without further user input and providing improved feedback.

[0244] In some implementations, the user's initial movement is not detected by the motion sensor. In other implementations, the user's movement is detected by the motion sensor.

[0245] In some implementations, the first context corresponds to a first movement state of the computer system (e.g., the computer system is not moving, the computer system is moving, the computer system is decelerating, the computer system is accelerating, the computer system's speed is above a speed threshold, and / or the computer system's speed is below a speed threshold). In some implementations, the second context corresponds to a second movement state of the computer system that differs from the second movement state (e.g., the computer system is not moving, the computer system is moving, the computer system is decelerating, the computer system is accelerating, the computer system's speed is above a speed threshold, and / or the computer system's speed is below a speed threshold). Enabling a first group of one or more devices to operate accordingly based on the computer system's movement state allows the computer system to control the operation of the first group of one or more devices to indicate the current movement state of the computer system, thereby providing improved feedback and performing operations without further user input when a set of conditions has been met, and providing improved feedback.

[0246] In some implementations, the first context corresponds to a first operating state of the computer system (e.g., the computer system is powered off, the computer system is powered on, the computer system is in sleep mode, the computer system is playing media, the computer system is in an unlocked state, and / or the computer system is in a locked state). In some implementations, the second context corresponds to a second operating state of the computer system (e.g., the computer system is powered off, the computer system is powered on, the computer system is in sleep mode, the computer system is playing media, the computer system is in an unlocked state, and / or the computer system is in a locked state) (e.g., the second operating state is the same as the first operating state or the second operating state is different from the first operating state). This allows the first group of one or more devices to operate accordingly based on the operating state of the computer system, enabling the computer system to control the operation of the first group of one or more devices to indicate the current operating state of the computer system, thereby providing improved feedback and performing operations when a set of conditions has been met without requiring further user input, and providing improved feedback.

[0247] In some implementations, the first context corresponds to a user's first body posture (e.g., the user is standing, the user is kneeling, the user is sitting, the user is bending over, the user is moving, the user is not moving). In some implementations, the second context corresponds to a user's second body posture, different from the first body posture (e.g., the user is standing, the user is kneeling, the user is sitting, the user is bending over, the user is moving, the user is not moving). Enabling a first group of one or more devices to operate accordingly based on the user's body posture allows the user to control the operation of the first group of one or more devices without requiring the computer system to display corresponding user interface objects, thereby performing actions when a set of conditions is met without further user input and providing improved feedback.

[0248] Figures 10A to 10M Exemplary user interfaces for displaying controls are illustrated according to some implementation schemes. The user interfaces in these figures are used to illustrate the processes described below, including... Figures 11A to 11B and Figure 12 The process in.

[0249] Figure 10A An exemplary computing device 1000, as a laptop computer, is illustrated, including a display 1002 (e.g., a display component) and a touch-sensitive display 1004 (e.g., an input and / or output device). In the embodiments described below, the computing device 1000 uses the display 1002 and the touch-sensitive display 1004 to detect input and / or provide output for adjusting one or more settings. In some embodiments, the touch-sensitive display 1004 includes one or more touch sensors for detecting input (e.g., tapping, swiping, and / or pressing and holding input). In some embodiments, the touch-sensitive display 1004 includes a display component for displaying content (e.g., user interface elements, setting sliders, icons, and / or text). It should be appreciated that other types of devices, display components, input devices, output components, and / or operations can be used with the techniques described herein.

[0250] In some embodiments, the touch-sensitive display 1004 has a convex (e.g., protrusion) or concave (e.g., groove) shape along its length. For example, the touch-sensitive display 1004 may have a concave shape forming a groove channel (sometimes referred to herein as a "groove input mechanism"). The groove channel may be associated with (and / or include) one or more display components that display user interface elements and / or indications for adjusting one or more settings. In some embodiments, the touch-sensitive display 1004 is and / or forms part of the groove input mechanism. In other embodiments, the touch-sensitive display 1004 is positioned within the groove channel (e.g., the surface forming the groove channel or otherwise positioned such that the touch-sensitive display 1004 detects input via the groove channel and / or displays output within the groove channel). For example, to detect input, the touch-sensitive display 1004 may be positioned below the groove channel such that a capacitive touch sensor can detect touch input through the substrate of the groove channel. Furthermore, to output within the groove channel, the touch-sensitive display 1004 may display output through a partially or fully translucent substrate of the groove channel. In some implementations, grooved channels provide haptic feedback (e.g., in the form of channels that the user can feel to guide their fingers when the user taps and / or swipes), making input easier and / or more intuitive (e.g., reducing reliance on the user needing to use their vision).

[0251] In some embodiments, the touch-sensitive display 1004 is arranged in a ring-shaped and / or circular shape (e.g., a complete ring, a partial ring, a complete circle, a semicircle, and / or one or more arc segments), rather than as... Figures 10B to 10M The illustrated strip shape (e.g., a straight line without arcs and / or curves). In some embodiments, the touch display 1004 is arranged in another shape, such as a triangle or other geometry. In some embodiments, the touch display 1004 is arranged in a continuous shape (e.g., the input mechanism is configured without a minimum edge and / or a maximum edge). For example, the touch display 1004 may be arranged in a ring, tiled on the surface of the computing device 1000. In some embodiments, the touch display 1004 is not continuous (e.g., the input mechanism is configured with a minimum (e.g., the leftmost or bottommost) edge and / or a maximum (e.g., the rightmost or topmost) edge).

[0252] In some embodiments, the touch-sensitive display 1004 physically surrounds the second input mechanism. For example, the touch-sensitive display 1004 may be arranged as a ring around the second input mechanism (e.g., a pressable button and / or a touch-sensitive surface). In some embodiments, the computing device 1000 detects input associated with the second input mechanism (e.g., a press input) and performs an operation in response to detecting the input associated with the second input mechanism. For example, the operation may be related to adjusting settings (e.g., accepting adjusted settings) or may not be related (e.g., play / pause switching for media playback, locking / unlocking the device, actuating mechanical and / or electromechanical devices, or other operations).

[0253] like Figure 10B As illustrated, the touch-sensitive display 1004 displays a brightness setting icon 1006, a lamp setting icon 1008, and a volume setting icon 1010. In some embodiments, the icons associated with the adjustment settings are equidistant from each other within the touch-sensitive display 1004. For example, in a scenario where the touch-sensitive display 1004 is arranged as a continuous ring, each of the icons 1006, 1008, and 1010 may be positioned at equidistant locations around the continuous ring (e.g., the spacing between each icon is one-third of the circumference of the touch-sensitive display 1004).

[0254] In some embodiments, one or more inputs associated with brightness setting icon 1006 cause computing device 1000 to adjust the brightness of one or more display devices (e.g., monitor 1002 and / or touch-sensitive monitor 1004), one or more inputs associated with lamp setting icon 1008 cause computing device 1000 to adjust the brightness of one or more lamp devices (e.g., smart bulbs communicating with computer device 1000), and / or one or more inputs associated with volume setting icon 1010 cause computing device 1000 to adjust one or more sound output devices (e.g., speakers of computing device 1000 and / or speakers communicating with the computing device). Each of these icons corresponds to an adjustment of a different type of device output (e.g., monitor backlight brightness, sound volume, and bulb brightness). In some embodiments, the device being adjusted is part of computing device 1000 (and / or directly connected to the computing device), such as monitor 1002 adjusted using brightness setting icon 1006. In some embodiments, the device being adjusted is separate from the computing device 1000 (e.g., external to and / or remote from the computing device), such as one or more smart light bulbs adjusted using the light setting icon 1008. In some embodiments, detecting input that changes the setting from 0% to 100% involves detecting input that makes a circular motion (e.g., from 0 degrees to 360 degrees) around the touch-sensitive display 1004. In some embodiments, the full range of the setting corresponds to a range smaller than the full range of the touch-sensitive display 1004. For example, in the example where the touch-sensitive display 1004 is a ring, input to adjust the setting from 0% to 100% might require a swipe input that covers less than the full range around the ring (e.g., adjusting from 0% to 100% might require input covering half the distance around the ring, thus requiring a shorter finger movement than the full distance around the ring). It should be recognized that such settings, icons, and / or devices are merely examples, and other settings, icons, and / or devices may be used in conjunction with the techniques described herein.

[0255] exist Figure 10B At a location corresponding to the volume setting icon 1010 (e.g., at the volume setting icon itself), the computing device 1000 detects input 1005b (e.g., the start of a leftward swipe input). In some embodiments, in response to the detection of input 1005b, the computing device 1000 displays an indication of the current volume setting corresponding to the volume setting icon 1010. In such embodiments, this indication may be transmitted via a display 1002 (e.g., as shown in the image). Figure 10C (as illustrated by volume indicator 1012) and / or touch-sensitive display 1004 (e.g., volume indicator (as illustrated by volume indicator 1012) and / or touch-sensitive display 1004) Figure 10C(Similar or the same as the volume indicator 1014 illustrated in the image), such as starting at the position corresponding to the volume setting icon 1010 and (e.g., in the direction opposite to the direction in which the current volume setting is increased, as discussed further below) continuing for a length corresponding to the amount of the current volume setting.

[0256] In some implementations, a swipe input (e.g., including input 1005b) moving to the left changes the current volume setting. Such a change may depend on characteristics of the input (e.g., the length of the movement, the speed of the movement, the duration of the input, and / or another characteristic). For example, computing device 1000 may detect input initially positioned at the location of an icon (e.g., volume setting icon 1010), followed by movement of that input (e.g., touch input, followed by a swipe input without release). In some implementations, in response to detecting the input and its movement, computing device 1000 adjusts the corresponding setting based on the direction of the movement. For example, if computing device 1000 detects movement in one direction (e.g., left or clockwise), computing device 1000 increases the device output setting; and if computing device 1000 detects movement in another direction (e.g., right or counterclockwise), computing device 1000 decreases the device output setting.

[0257] In some implementations, different settings use different directions to increase and decrease. For example, a first setting (e.g., on the left side of the ring) can be increased using a clockwise direction and decreased using a counter-clockwise direction, while a second setting (e.g., on the right side of the ring) can be increased using a counter-clockwise direction and decreased using a clockwise direction. In some implementations, more than one setting can be adjusted using a first set of directions (e.g., increasing clockwise and decreasing counter-clockwise), and one or more settings can be adjusted using a second set of directions different from the first set of directions (e.g., increasing counter-clockwise and decreasing clockwise).

[0258] like Figure 10C As illustrated, in response to detecting that input 1005b has moved left to the position of input 1005c and / or after detecting that input 1005b has moved left to the position of input 1005c, computing device 1000 displays volume indicator 1014 via touch-sensitive display 1004. In some embodiments, volume indicator 1014 indicates the current adjustment amount of the setting corresponding to volume setting icon 1010. For example, as volume indicator 1014 increases, the amount of change in setting increases accordingly.

[0259] like Figure 10CAs illustrated, the volume indicator 1014 begins near the right edge of the touch-sensitive display 1004 (e.g., at the location of the volume setting icon 1010 and / or input 1005b) and extends to 30% of the distance of the touch-sensitive display 1004, corresponding to a 30% change in volume level (e.g., a 30% increase or decrease in maximum sound power output; or 30% of maximum volume). In some embodiments, the negative space of the volume indicator 1014 (e.g., areas of the touch-sensitive display 1004 not included in the volume indicator 1014) corresponds to an amount by which the setting can be further increased, such as indicating... Figure 10C The remaining 70% of the 100% scale shown.

[0260] like Figure 10C As illustrated, in response to the detection of input 1005c, computing device 1000 displays a volume indicator 1012 via display 1002, which indicates the current volume level as "Volume: 30%". In some embodiments, volume indicator 1012 includes the display of volume indicator 1014 (e.g., such that volume indicator 1014 is displayed concurrently on both display 1002 and touch-sensitive display 1004, or only on display 1002).

[0261] exist Figure 10C In response to detecting input 1005b and / or input 1005c, computing device 1000 outputs haptic output 1016, which provides haptic feedback to the user that the input has been received and / or is being received. In some embodiments, computing device 1000 outputs haptic output in response to detecting that a setting has reached a specific value. For example, when adjusting the setting in 10% increments, computing device 1000 may trigger haptic output (e.g., indicating to the user that the adjustment has reached a specific value). As another example, when adjusting the setting to a minimum and / or maximum value, computing device 1000 may trigger haptic output (e.g., indicating to the user that further adjustment in that direction is not possible).

[0262] In some implementations, the touch-sensitive display 1004 displays an indication of the current volume level (e.g., the text "30%") separate from the volume indicator 1014. For example, the indication may be inside the volume indicator 1014 or inside the negative space of the volume indicator 1014.

[0263] like Figure 10CAs illustrated, in response to the detection of input 1005b (and / or at least some movement in one direction, such as exemplified by input 1005c), computing device 1000 stops displaying brightness setting icon 1006 and lamp setting icon 1008, while maintaining the display of volume indicator 1014. In some embodiments, in response to the detection of input 1005b and / or after the detection of such input, computer device 1000 maintains the display of brightness setting icon 1006, lamp setting icon 1008, and volume indicator 1014 (e.g., volume indicator 1014 overlays brightness setting icon 1006 and / or lamp setting icon 1008 when increased to a value corresponding to the position of one of icons 1006 or 1008, as discussed further below). Figure 10C At that point, the computing device 1000 continues to detect the input 1005c that moves to the left on the touch-sensitive display 1004.

[0264] exist Figure 10D At this location, the computing device 1000 detects the position of the swipe input represented by inputs 1005b and 1005c at a position associated with an 80% volume output level (e.g., by...). Figure 10D The volume indicator 1014 in the middle is raised off the leftmost edge. For example... Figure 10D As illustrated, in response to the detection of a lift-off of a swipe input, the computing device 1000 uses a touch-sensitive display 1004 to... Figure 10B The illustrated larger-sized display volume indicator 1014 extends to approximately 80% of the touch-sensitive display 1004 (corresponding to 80% of the volume level). It is noteworthy that a portion of the volume indicator 1014 is displayed where the light setting icon 1008 was previously included (e.g., as shown in the image). Figure 10B (As illustrated) and at portions that previously included (and / or still include) the volume setting icon 1010. It should be recognized that these indicators may overlap with locations where different types of icons were previously and / or still are displayed. Similar to what has been described above, in response to the detection of input 1005c, computing device 1000 displays a volume indicator 1012 with a current volume level of "80%" via display 1002.

[0265] In some embodiments, in response to the detection of a lift-off of a swipe input, the computing device 1000 continues to display volume indicators 1012 and / or 1014. In some embodiments, in response to the detection of a lift-off of a swipe input and / or when no additional input is detected after the detection of a lift-off of a swipe input (also referred to herein as a "timeout period" (e.g., measured from the lift-off time of the swipe input that caused volume indicator 1014 to be displayed), the computing device 1000 stops displaying volume indicators 1012 and / or 1014.

[0266] Figure 10E An example is illustrated where the volume indicator 1012 continues to be displayed after the computing device 1000 detects a lift-off of a swipe input represented by inputs 1005b and 1005c. In some embodiments, in response to (1) detecting a lift-off of a swipe input represented by inputs 1005b and 1005c, (2) stopping the display of volume indicators 1012 and / or 1014, and / or (3) the expiration of a timeout period, the computing device 1000 displays icons that were displayed before the swipe input was detected. For example, the brightness setting icon 1006 and the lamp setting icon 1008 may again be displayed together with the volume setting icon 1010. In other embodiments, the brightness setting icon 1006 and the lamp setting icon 1008 remain displayed throughout the swipe input represented by inputs 1005b and 1005c.

[0267] exist Figure 10E At this location, computing device 1000 detects input 1005e, which is a rightward swipe input starting from the position of brightness setting icon 1006. For example... Figure 10E As illustrated, computing device 1000 detects input 1005e while volume indicator 1012 continues to be displayed via display 1002. In some embodiments, computing device 1000 detects input 1005e but no longer displays volume indicator 1012.

[0268] like Figure 10F As illustrated, after detecting input 1005e, computing device 1000 displays a brightness indicator 1018 via touch-sensitive display 1004. Figure 10F At this point, input 1005e has moved to the right edge of the brightness indicator 1018, as shown below. Figure 10F exemplified. exist Figure 10F At this location, the brightness indicator 1018 begins at the position of the brightness setting icon 1006 and / or input 1005e and extends to 40% of the touch-sensitive display 1004, corresponding to a 40% brightness level (e.g., increasing or decreasing the current brightness by 40%; or decreasing the maximum brightness by 40%). Figure 10F As illustrated, the computing device 1000 displays a brightness indicator 1015 via a display 1002, which indicates the current brightness level as "Brightness: 40%".

[0269] like Figure 10G As illustrated, in response to detecting that a timeout period has expired after a lift-off of a swipe input including input 1005e, the computing device 1000 displays the lamp setting icon 1008 and the volume setting icon 1010 together with the brightness setting icon 1006 via the touch-sensitive display 1004. Furthermore, the computing device 1000 maintains the display of the brightness indicator 1015 via the display 1002. Figure 10GAt this point, the computing device 1000 detects input 1005g (e.g., a tap input) on the light setting icon 1008 (e.g., at or near the location associated with the light setting icon).

[0270] like Figure 10H As illustrated, in response to the detection of input 1005g on the light setting icon 1008, the computing device 1000 displays a light setting menu 1008a including a light setting icon 1008b (corresponding to the left light) and a light setting icon 1008c (corresponding to the right light). For example, light setting icons 1008b and 1008c may correspond to two different sets (e.g., one or more) of controllable smart home bulbs (e.g., one corresponding to the left side of the room and one corresponding to the right side of the room). Figure 10H At this point, computing device 1000 detects input 1005h, which is a rightward swipe input starting on the light setting icon 1008c.

[0271] like Figure 10I As illustrated, in response to the detection of input 1005h, computing device 1000 displays a light indicator including segments 1020a and 1020b. In some embodiments, the light indicator is a three-segment indicator, wherein no segment of illumination corresponds to an off state, one illumination segment (indicated as segment 1020a filled with a first shadow line) corresponds to a low state (e.g., output by the lighting device), two illumination segments (indicated as segment 1020a filled with a first shadow line and segment 1020b filled with a second shadow line) correspond to a medium state, and three illumination segments (including the segment to the right of segment 1020b, which is not filled, such as...) Figure 10I (As illustrated) corresponds to the high state. In some implementations, each segment of the light indicator is referred to as a "part" and / or "discrete portion" of the light indicator. For example... Figure 10I As shown in the example, the light indicator is currently set to the medium state (two of the three segments are filled). It is worth noting that... Figure 10I A portion of the light indicator is displayed in the location previously included in icon 1008b.

[0272] like Figure 10IAs illustrated, computing device 1000 displays a light indicator 1022 via display 1002. This light indicator includes an indication that the light setting of the light identified as "right light" is set to medium (e.g., "Right light: Medium"). Note that computing device 1000 detects input 1005h corresponding to "right light" on light setting icon 1008c, and therefore, in response to input 1005h, light indicators 1020 and 1022 correspond to indicating the adjustment level of "right light". In some embodiments, the light setting of the right light is set to low before input 1005h is detected, and in response to a rightward movement of input 1005h, computing device 1000 adjusts the light setting to medium. In some embodiments, a swipe input starting on light setting icon 1008b is interpreted by computing device 1000 as selecting the corresponding device ("left light") for adjustment.

[0273] Figure 10I The illustration shows discrete portions of a light indicator 1020 on a straight line, but other arrangements are possible. For example, in the case where the input mechanism (e.g., touch-sensitive display 1004) is circular, the discrete portions can form a pattern with a circular shape (e.g., such that each of a set of three portions occupies 33% of the circle). In some embodiments, the pattern is less than 100% of the circular pattern.

[0274] Figure 10J Examples of being in and Figure 10B A similar output state is observed in the computing device 1000, in which the display 1002 and the touch-sensitive display 1004 do not display adjustment levels or indicators. Figure 10J and Figure 10K Alternative techniques for adjusting the output level of a lamp (e.g., the "right lamp") are illustrated (relative to...) Figures 10G to 10I ).exist Figure 10J At this point, computing device 1000 detects input 1005j (e.g., swipe right input) on light setting icon 1008.

[0275] like Figure 10K As illustrated, in response to the detection of input 1005j, computing device 1000 displays an indicator light including segment 1022a (e.g., the same as segment 1020a), segment 1022b (e.g., the same as segment 1020b), and segment 1022c. In some embodiments, Figure 10KThe light indicator is set to a high state because all three segments are illuminated (e.g., visually represented as being activated, such as by being filled, appearing brighter, by color, or any other suitable means). In some embodiments, in response to the detection of input 1005j and / or after the detection of such input, the computer device 1000 displays the light indicator 1022 via the display 1002 and stops displaying the brightness setting icon 1006 and the volume setting icon 1010 via the touch-sensitive display 1004. Notably, segment 1022a is displayed at the location where the brightness setting icon 1006 was previously displayed, and segment 1022c is displayed at the location where the volume setting icon 1010 was previously displayed. Notably, the computing device 1000 does not display icon 1008b via the touch-sensitive display 1004 when the right light is changed via the light setting icon 1008, but displays icon 1008b via the touch-sensitive display 1004 when the right light is changed via the light setting menu 1008a.

[0276] exist Figure 10K At this location, the light indicator shows the "right light" level as high, stating: "Right light: High." Note that this is different from... Figures 10G to 10I Unlike in the text, the swipe input that starts on the light setting icon 1008 (for example, Figure 10J Input 1005j at the location allows the computing device 1000 to adjust the light level without requiring a lamp setting menu (e.g., such as...). Figure 10H The second input is at the menu shown. In some implementations, in response to a swipe input on an icon representing a group of devices (e.g., a light setting icon 1008 representing two lights (including the right and left lights)), the computing device 1000 adjusts the default device (or group of devices) in that group of devices. For example, in this example, the right light is set to respond to a swipe input (such as...) Figure 10J The default light to be adjusted is (1005j). The default device may be set based on one or more of the following factors: based on whether it is the device closest to the computing device 1000, a pre-determined or pre-configured device (e.g., the user specifies that a swipe input on the light setting icon 1008 always adjusts only the "right light"), the device most recently adjusted and / or selected, the direction of the swipe input, the device associated with the location of the computing device 1000 or one of its components (e.g., display 1002 and / or touch-sensitive display 1004), or any other appropriate way of specifying or selecting the default device.

[0277] In some implementations, indicators associated with different settings (e.g., those mentioned above relative to...) Figure 10I and / or Figure 10K The light indicator discussed above is related to... Figure 10F The brightness indicator 1018 discussed and / or the above relative to Figures 10C to 10DThe volume indicator 1014 discussed is visually distinct based on one or more visual characteristics. For example, an indicator associated with different settings may be visually distinct in one or more ways, such as color, size, shape, brightness, and / or type of graphic representation (e.g., a continuous shape contrasting with multiple discrete points). In some embodiments, the indicator associated with a setting does not visually overlap with an icon associated with another setting. In some embodiments, the visual characteristics of the scale change based on the input attribute and / or the value of the setting. Input attributes may be input type, direction of movement, input position, etc. For example, the volume indicator 1014 may change color from green to red as the value approaches 100% (e.g., the maximum volume setting makes it red).

[0278] In some implementations, detecting input associated with an icon as a first type of input causes the computing device 1000 to perform a first operation, and detecting input associated with an icon as a second type of input (different from the first type of input) causes the computing device 1000 to perform a second operation (and / or abandon the execution of the first operation). For example, a swipe input starting on the volume setting icon 1010 (e.g., Figure 10B Input 1005b) can cause the computing device 1000 to display volume indicator 1012 and the touch-sensitive display 1004 to display volume indicator 1014 (e.g., as shown in Figure 1005b). Figure 10C As shown, both are displayed concurrently. Furthermore, as part of this example, a tap (instead of a swipe) on the volume setting icon 1010 causes the computing device 1000 (on display 1002) to display volume indicator 1012 and deselect (on touch-sensitive display 1004) volume indicator 1014. In some implementations, a tap can be used to quickly view current settings, previous settings, recommended settings, etc., but a swipe can be used (and interpreted by the computing device 1000) to display indicators and perform operations for adjusting settings.

[0279] In some embodiments, the computing device 1000 performs a display operation in response to detecting an input associated with a first input type, and the computing device 1000 may continue performing the display operation (e.g., continue displaying an indicator) in response to ceasing to detect the input (e.g., a tap causes the computing device 1000 to display the current value of the setting). In some embodiments, the computing device 1000 performs a display operation in response to detecting an input associated with a second input type (different from the first input type), and the computing device 1000 may stop performing the display operation (e.g., continue displaying an indicator) in response to ceasing to detect the input (e.g., a swipe causes the computing device 1000 to display an indicator to adjust the setting based on the length and direction of the swipe, and the indicator disappears when lifted away).

[0280] Figure 10L and Figure 10M An alternative method for displaying adjustment levels on computing device 1000 is illustrated according to some implementation schemes. Figure 10L Examples of being in and Figure 10B A similar output state is observed in the computing device 1000, in which the display 1002 and the touch-sensitive display 1004 do not display adjustment levels or indicators. Figure 10L At this point, computing device 1000 detects input 1005l, which is a leftward swipe input starting on the volume setting icon 1010.

[0281] like Figure 10M As illustrated, in response to the detection of input 1005l, computing device 1000 displays a volume indicator 1024, which includes a textual representation of the current volume level (statement "volume 15%)" and a graphical indication of the volume level (represented as a bar filled with approximately 15% from left to right, as illustrated in the shaded area). It is noteworthy that no indication of the current value corresponding to volume setting icon 1010 is displayed via touch-sensitive display 1004. Instead, computing device 1000 only stops displaying brightness setting icon 1006 and lamp setting icon 1008. In some embodiments, computer device 1000 does not stop displaying brightness setting icon 1006 and lamp setting icon 1008, but instead continues to display brightness setting icon 1006 and lamp setting icon 1008.

[0282] Figures 11A to 11B This is a flowchart illustrating a method for adjusting the output of a device using a computer system, according to some embodiments. Method 1100 is performed at a computer system (e.g., system 100). The computer system communicates with a display component and one or more input components. Some operations in method 1100 may optionally be combined, some operations may optionally be changed in order, and some operations may optionally be omitted.

[0283] As described below, Method 1100 provides an intuitive way to adjust the output of a device. This method reduces the cognitive burden on users when adjusting the device's output, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to adjust the device's output faster and more efficiently saves power and increases the time between battery charging cycles.

[0284] In some embodiments, method 1100 is performed at a computer system (e.g., 1000) that communicates with display components (e.g., 1002 and / or 1004) (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the computer system communicates with physical (e.g., hardware and / or non-display) input mechanisms (e.g., hardware input mechanisms, rotatable input mechanisms, crowns, knobs, dials, physical sliders, and / or hardware buttons). In some embodiments, the computer system is a watch, telephone, tablet, processor, head-mounted display (HMD) device, and / or personal computing device. In some embodiments, the computer system communicates with one or more cameras (e.g., one or more telephoto cameras, wide-angle cameras, and / or ultra-wide-angle cameras).

[0285] The computer system displays (1102) with a first setting (e.g., as relative to) via a display component (e.g., 1002 and / or 1004). Figures 10A to 10M The first indication (e.g., 1006, 1008, and / or 1010) corresponding to the described brightness, light, and / or volume (e.g., an indication corresponding to the value of a representation (e.g., graphical and / or numerical representation) and / or setting (e.g., temperature setting, fan setting, volume setting, display setting (e.g., brightness, contrast, and / or brightness adjustment), window setting, and / or control actuator setting)) and a second setting different from the first setting (e.g., as relative to the first setting) Figures 10A to 10M A second indicator (e.g., 1006, 1008, and / or 1010) corresponding to the described brightness, light, and / or volume, wherein the first indicator is displayed at a first location (e.g., the location of 1006, 1008, and / or 1010), and wherein the second indicator is displayed at a second location (e.g., the location of 1006, 1008, and / or 1010) different from the first location. In some embodiments, the first indicator does not correspond to the second setting, and the second indicator does not correspond to the first setting.

[0286] When a first instruction (e.g., 1006, 1008, and / or 1010) is displayed at a first location (e.g., locations 1006, 1008, and / or 1010) and a second instruction (e.g., 1006, 1008, and / or 1010) is displayed at a second location (e.g., locations 1006, 1008, and / or 1010), the computer system detects (1104) a first input (e.g., 1005b, 1005e, 1005g, 1005h, 1005j, 1005l, and / or 605m) via one or more input components (e.g., swipe input, drag input, and / or swipe input, and in some embodiments, different inputs such as mouse clicks, air gestures (e.g., tap air gestures, swipe air gestures, and / or flick air gestures), gaze gestures (e.g., gaze moving from one location to another), voice commands, and / or rotation of physical input mechanisms).

[0287] In response to (1106) the detection of a first input (e.g., 1005b, 1005e, 1005g, 1005h, 1005j, 1005l and / or 1005m), according to (1108) it is determined that the first input was initially detected at a location (e.g., the location of 1006, 1008 and / or 1010) corresponding to a first location (e.g., as the first location, near the first location and / or programmatically associated with the first location) (and in some embodiments, not at a location corresponding to a second location) (e.g., when the first input is first detected and / or immediately after the first input is first detected), the computer system, via a display component, detects the first input at the first location (e.g., 1005b, 1005e, 1005g, 1005h, 1005j, 1005l and / or 1005m). The first portion (e.g., shaded portions of 1014, 1018, and / or 1020) of the first scale (e.g., the leftmost portion, the end portion, the rightmost portion, another portion (e.g., portions representing certain percentages of a value range, such as 0% to 10%, 10% to 20%, 19% to 50%, etc.)) is displayed at the second location (e.g., the location of 1006, 1008, and / or 1010), wherein the second portion is different from the first portion.

[0288] In response to (1106) detecting the first input, and according to (1108) determining that the first input was initially detected at a location corresponding to the first location, the computer system causes (1112) the first device (e.g., as relative to) Figures 10A to 10MThe output of the described display device, lighting device, and / or sound output device (e.g., relative to...) Figures 10A to 10M The described brightness, light output, and / or volume are based on (e.g., in response to detection and / or by a quantity relative to its characteristics) a movement of a first input (e.g., as relative to its characteristics). Figures 10B to 10D The described 1005b and 1005c are changed (by moving to the left) (and / or upon detecting the first input). In some embodiments, the magnitude, velocity, and / or acceleration of the first input corresponds to the amount of change in the output of the first device.

[0289] In response to (1106) detecting the first input, and according to (1114) determining that the first input was initially detected at a location (e.g., the location of 1006, 1008, and / or 1010) corresponding to the second location (e.g., the location of 1006, 1008, and / or 1010) (and in some embodiments, not at a location corresponding to the first location), the computer system displays (1116) a first portion (e.g., a shaded portion of 1014, 1018, and / or 1020) of the second scale (e.g., 1014, 1018, and / or 1020) at the second location (e.g., the location of 1006, 1008, and / or 1010) (e.g., covering the second location, overlaying the second location, and / or on top of the second location) via a display component. In some embodiments, a third portion of the second scale (e.g., the second portion or another portion) is displayed at the first location.

[0290] In response to (1106) detecting the first input, and based on (1114) determining that the first input was initially detected at a location corresponding to the second location, the computer system causes (1118) the second device (e.g., as relative to) Figures 10A to 10M The output of the described display device, lighting device, and / or sound output device (e.g., relative to...) Figures 10A to 10M The described brightness, light output, and / or volume are based on (e.g., in response to detection and / or in a quantity relative to its characteristics) the movement (e.g., as relative to) a first input (e.g., 1005b, 1005e, 1005g, 1005h, 1005j, 1005l, and / or 1005m). Figures 10E to 10FThe described 1005e moves to the right (and / or changes upon detecting the first input) and alters (e.g., without changing the output of the first device), wherein the second device is different from the first device. In some embodiments, the magnitude, velocity, and / or acceleration of the first input corresponds to the amount of change in the output of the second device. In some embodiments, the computer system (e.g., 1000) does not change the output of the second device upon determining that the first input was initially detected at a location corresponding to the first location (e.g., when the first input is first detected and / or immediately after the first input is first detected). In some embodiments, upon determining that the first input was initially detected at a location corresponding to the first location, the computer system changes the visual appearance of the user interface object in a first manner (e.g., matching one or more characteristics of a first indication, such as color, text, and / or value); and upon determining that the first input was initially detected at a location corresponding to the second location, the computer system changes the visual appearance of the user interface object in a second manner different from the first manner (e.g., changing to a different color, including different text, having different values, displaying a different number of connections, values, and / or connection colors). This allows the user to have more control over the computer system, enabling the output of a specific device to change based on the movement of the first input from its initial detection location. It also allows the computer system to provide an input method that controls different devices without displaying additional control options, thus providing additional control options without cluttering the user interface with additional displayed controls. This allows operations to be performed when a set of conditions are met without further user input, and / or reduces the amount of input required to perform an operation. Displaying two different scales of the first portion differently based on the initial detection location of the first input allows the computer system to intelligently provide feedback on the location where the first input was detected and the scale of the specific device controlled by the user at a specific time instance, thus performing operations when a set of conditions are met without further user input, and / or providing improved visual feedback. Displaying a first portion of the first scale at a first location (e.g., the location of the first indication) and a second portion of the first scale at a second location (e.g., the location of the second indication) allows the computer system to maximize the area used to display the different indications and scales (allowing the locations of the indication and scales to overlap), thereby providing improved visual feedback.

[0291] In some implementations, the first device (e.g., as relative to) Figures 10A to 10M The described display device, lighting device, and / or sound output device are first-type devices (e.g., speakers, monitors, fans, thermostats, windows, and / or tactile mechanisms). In some embodiments, a second device (e.g., as relative to...) Figures 10A to 10MThe described display device, lighting device, and / or sound output device are second-type devices (e.g., speakers, monitors, fans, thermostats, windows, and / or haptic mechanisms) that are different from the first-type devices. In some embodiments, the first-type devices have (e.g., configured and / or set based on) a setting type corresponding to the first setting (e.g., as relative to) Figures 10A to 10M The described brightness, light output, and / or volume (e.g., outputting sound, visual content, and / or tactile sensation) (e.g., changing brightness, opacity, and / or color) (e.g., changing fan speed, temperature, and / or the amount of time a window is open). In some embodiments, the first type of device does not have a setting type corresponding to the second setting. In some embodiments, the second type of device has a setting type corresponding to the second setting (e.g., as relative to...). Figures 10A to 10M (Described brightness, light output, and / or volume). In some embodiments, the second type of device does not have a setting type corresponding to the first setting. Allowing the output of different types of devices to change based on the movement of the first input from the position where the first input was initially detected allows the user to have more control over the computer system to induce the output of different types of devices corresponding to different types of settings based on the position where the first input was initially detected, and allows the computer system to provide an input method that controls different types of devices and / or different types of settings without having to display additional control options, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing operations when a set of conditions is already met without requiring further user input, and / or reducing the amount of input required to perform operations.

[0292] In some embodiments, in response to detecting a first input (e.g., 1005b, 1005e, 1005g, 1005h, 1005j, 1005l and / or 1005m), the computer system abandons displaying a second scale (e.g., 1018 and / or 1020) based on the determination that the first input was initially detected at a location corresponding to a first location (e.g., locations 1006, 1008 and / or 1010). In some embodiments, in response to detecting a first input and based on the determination that the first input was initially detected at a location corresponding to a first location, the computer system abandons changing the output of the first device. In some embodiments, in response to detecting a first input and based on the determination that the first input was initially detected at a location corresponding to a second location (e.g., locations 1006, 1008 and / or 1010), the computer system abandons displaying a first scale (e.g., 1014 and / or 1018). In some implementations, in response to detecting a first input and determining that the first input was initially detected at a location corresponding to the second location, the computer system refrains from changing the output of the second device. By not displaying the second scale based on determining that the first input was initially detected at a location corresponding to the first location, and by not displaying the first scale based on determining that the first input was initially detected at a location corresponding to the second location, the computer system can intelligently provide feedback to the user regarding the device corresponding to the second scale not being adjusted, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing operations without requiring further user input when a set of conditions has been met, and / or providing improved visual feedback.

[0293] In some embodiments, a first indicator (e.g., 1006, 1008, and / or 1010) and a second indicator (e.g., 1006, 1008, and / or 1010) are displayed inside a physical recess (e.g., 1004) (e.g., a depression and / or indentation in a physical surface) of the computer system (e.g., 1000). In some embodiments, both the first and second indicators are displayed in a single recess. In some embodiments, the first indicator is displayed in a first recess, and the second indicator is displayed in a second recess different from the first recess. In some embodiments, the first and second indicators are displayed concurrently. In some embodiments, the first indicator is positioned inside the physical recess, and the second indicator is positioned inside the physical recess. Displaying the first and second indicators inside a physical recess of the computer system allows the computer system to display the indicators within a physical recess where a first input can potentially be detected, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing operations when a set of conditions has been met without requiring further user input, and / or providing improved visual feedback.

[0294] In some embodiments, a physical recess (e.g., 1004) at least partially surrounds (e.g., encloses and / or is adjacent to) a physical input mechanism (e.g., 1002 and / or 1004) (e.g., a physical button, a touchscreen, and / or a rotatable input mechanism). In some embodiments, the computer system detects a second input (e.g., 1005b, 1005e, 1005g, 1005h, 1005j, 1005l, and / or 1005m) corresponding to the physical input mechanism via one or more input components (e.g., input pointing at the physical input mechanism, rotation input, and in some embodiments, different inputs such as mouse clicks, air gestures (e.g., tap air gestures, swipe air gestures, and / or flick air gestures), gaze gestures (e.g., gaze moving from one location to another), voice commands, swipe inputs, and / or rotation of the physical input mechanism). In some implementations, in response to the detection of a second input corresponding to a physical input mechanism, the computer system performs an operation different from (and in some implementations, excluding) at least one of the following (e.g., pausing media, playing media, rewinding media, skipping media, opening a door, closing a door, opening a window, and / or closing a window): (1) causing the first device (e.g., as relative to...) Figures 10A to 10M The output of the described display device, lighting device, and / or sound output device (e.g., rel...

Claims

1. A method, the method comprising: At the computer system communicating with the display components: Detect changes in the coupling state of the computer system; as well as In response to detecting the change in the coupling state of the computer system: Based on the determination that one or more criteria of a first set are met, a first user interface including one or more controls of the first set is displayed via the display component, wherein the first set of one or more criteria includes criteria that are met when it is determined that the computer system is currently magnetically coupled to a corresponding region; and Based on the determination that one or more criteria of a second group are met, a second user interface including one or more controls of a second group is displayed via the display component, wherein the one or more criteria of the second group include criteria that are met when it is determined that the computer system is currently not magnetically coupled, wherein the one or more controls of the second group are different from the one or more controls of the first group.

2. The method of claim 1, wherein the first set of one or more criteria includes criteria satisfied when determining that the corresponding region is associated with a first type of device, the method further comprising: In response to detecting the change in the coupling state of the computer system and determining that the computer system is currently magnetically coupled to a second corresponding area, the display of the first group of one or more controls is abandoned, wherein the second corresponding area is associated with a second type of device that is different from the first type of device.

3. The method according to any one of claims 1 to 2, further comprising: When displaying the first user interface including one or more controls of the first group, a first set of indications corresponding to one or more settings associated with the corresponding area is displayed via the display component.

4. The method according to any one of claims 1 to 3, further comprising: In response to detecting the change in the coupling state of the computer system and determining that the computer system is currently magnetically connected to a third corresponding region different from the first corresponding region, a third group of one or more controls different from the first group of one or more controls are displayed via the display component.

5. The method according to any one of claims 1 to 4, further comprising: In response to detecting the change in the coupling state of the computer system, the display component is switched from a first state to a second state different from the first state.

6. The method according to any one of claims 1 to 5, wherein the first group of one or more controls are local controls that point to one or more devices associated with the corresponding region and not a fourth corresponding region different from the corresponding region, and wherein the second group of one or more controls are global controls that point to one or more devices associated with the corresponding region and the fourth corresponding region.

7. The method according to any one of claims 1 to 6, wherein the first group of one or more controls does not include controls that adjust the output of the media when selected, and the second group of one or more controls includes controls that adjust the output of the media when selected.

8. The method according to any one of claims 1 to 7, wherein the first group of one or more controls includes a control that, when selected, adjusts the output of a device affecting ambient temperature, and the second group of one or more controls does not include a control that, when selected, adjusts the output of a device affecting ambient temperature.

9. The method according to any one of claims 1 to 8, further comprising: When displaying one or more controls in the second group, detect input pointing to one of the controls in the second group; as well as In response to detecting input directed to one of the controls in the second group, an indication of the adjusted value is displayed via the display component.

10. The method according to any one of claims 1 to 9, further comprising: When displaying the first group of one or more controls, detect input pointing to one of the controls in the first group of one or more controls; as well as In response to detecting input directed to one of the controls in the first group of one or more controls, the display of an indication of the adjusted value via the display component is abandoned.

11. The method according to any one of claims 1 to 10, the method further comprising: While displaying the first group of one or more controls, a group of one or more inputs is detected, the group of one or more inputs including inputs pointing to the corresponding controls in the first group of one or more controls; as well as In response to the detection of the set of one or more inputs, the output of the device associated with the corresponding region is changed.

12. The method according to any one of claims 1 to 11, wherein the second group of one or more controls consists of a first number of controls, and wherein the first group of one or more controls consists of a second number of controls different from the first number of controls.

13. The method according to any one of claims 1 to 11, wherein the second group of one or more controls includes controls included in the first group of one or more controls.

14. The method according to any one of claims 1 to 13, wherein the first group of one or more controls includes at least one control not included in the second group of one or more controls.

15. The method according to any one of claims 1 to 14, wherein each control in the first group of one or more controls is different from each control in the second group of one or more controls.

16. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs including instructions for performing the method according to any one of claims 1 to 15.

17. A computer system communicating with a display component, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 15.

18. A computer system communicating with a display component, the computer system comprising: Components for performing the method according to any one of claims 1 to 15.

19. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 15.

20. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs including instructions for: Detect changes in the coupling state of the computer system; and In response to detecting the change in the coupling state of the computer system: Based on the determination that one or more criteria of a first set are met, a first user interface including one or more controls of the first set is displayed via the display component, wherein the first set of one or more criteria includes criteria that are met when it is determined that the computer system is currently magnetically coupled to a corresponding region; and Based on the determination that one or more criteria of a second group are met, a second user interface including one or more controls of a second group is displayed via the display component, wherein the one or more criteria of the second group include criteria that are met when it is determined that the computer system is currently not magnetically coupled, wherein the one or more controls of the second group are different from the one or more controls of the first group.

21. A computer system communicating with a display component, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: Detect changes in the coupling state of the computer system; and In response to detecting the change in the coupling state of the computer system: Based on the determination that one or more criteria of a first set are met, a first user interface including one or more controls of the first set is displayed via the display component, wherein the first set of one or more criteria includes criteria that are met when it is determined that the computer system is currently magnetically coupled to a corresponding region; and Based on the determination that one or more criteria of a second group are met, a second user interface including one or more controls of a second group is displayed via the display component, wherein the one or more criteria of the second group include criteria that are met when it is determined that the computer system is currently not magnetically coupled, wherein the one or more controls of the second group are different from the one or more controls of the first group.

22. A computer system communicating with a display component, the computer system comprising: Components used for: detecting changes in the coupling state of the computer system; as well as In response to detecting the change in the coupling state of the computer system: Components for the following operations: displaying a first user interface including one or more controls via the display component based on determining that one or more criteria of a first set are met, wherein the first set of one or more criteria includes criteria that are met when it is determined that the computer system is currently magnetically coupled to a corresponding area; as well as The component is used to display a second user interface, including one or more controls, via the display component, based on the determination that one or more criteria of a second set are met, wherein the one or more criteria of the second set include criteria that are met when it is determined that the computer system is currently not magnetically coupled, wherein the one or more controls of the second set are different from the one or more controls of the first set.

23. A computer program product comprising one or more programs configured to execute by one or more processors of a computer system in communication with a display component, the one or more programs comprising instructions for: Detect changes in the coupling state of the computer system; and In response to detecting the change in the coupling state of the computer system: Based on the determination that one or more criteria of a first set are met, a first user interface including one or more controls of the first set is displayed via the display component, wherein the first set of one or more criteria includes criteria that are met when it is determined that the computer system is currently magnetically coupled to a corresponding region; and Based on the determination that one or more criteria of a second group are met, a second user interface including one or more controls of a second group is displayed via the display component, wherein the one or more criteria of the second group include criteria that are met when it is determined that the computer system is currently not magnetically coupled, wherein the one or more controls of the second group are different from the one or more controls of the first group.

24. A method, the method comprising: At the computer system communicating with the display components: A first user interface including first content and a first plurality of selection indicators is displayed via the display component, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; While displaying the first user interface, including the first content and the first plurality of selection indicators, and the selection indicator indicating that the first content has been selected, via the display component, a change in the coupling state of the computer system is detected; and In response to detecting the change in the coupling state of the computer system: Stop displaying the selection indicator that indicates the first content has been selected; as well as A second user interface, including second content and a plurality of selection indicators, is displayed via the display component. The plurality of selection indicators include a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

25. The method of claim 24, wherein the first content comprises a first group of one or more controls, and wherein the second content comprises a second group of one or more controls that are different from the first group of one or more controls.

26. The method of any one of claims 24 to 25, wherein the second plurality of selection indicators includes an indicator indicating that the first content has not been selected.

27. The method according to any one of claims 24 to 26, further comprising: In response to detecting the change in the coupling state of the computer system, the display of the first content is stopped.

28. The method of claim 27, wherein the first content is displayed at a corresponding location before the change in the coupling state of the computer system is detected, and wherein the second content is displayed at the corresponding location in response to the detection of the change in the coupling state of the computer system.

29. The method of any one of claims 24 to 28, wherein displaying the second user interface including the second content includes replacing the first user interface including the first content with the second user interface including the second content.

30. The method of any one of claims 24 to 29, wherein displaying the second user interface including the second content includes scrolling the first user interface including the first content to display the second user interface including the second content.

31. The method according to any one of claims 24 to 30, wherein detecting the change in the coupling state of the computer system includes detecting that the computer system is in an installed state.

32. The method of claim 31, wherein the second content includes one or more global controls.

33. The method according to any one of claims 24 to 32, wherein detecting the change in the coupling state of the computer system includes detecting that the computer system is in an installed state.

34. The method of claim 33, wherein the second content includes one or more local controls.

35. The method of any one of claims 24 to 34, wherein detecting the change in the coupling state of the computer system comprises detecting the computer system magnetically coupled to a region.

36. The method of any one of claims 24 to 35, wherein detecting the change in the coupling state of the computer system comprises detecting that the computer system is coupled to a corresponding device via a wired or wireless connection.

37. The method according to any one of claims 24 to 36, the method further comprising: When displaying the second user interface including the second content and the second plurality of selection indicators, input with a first directional component is detected; as well as In response to detecting the input having the first direction component: Stop displaying the second user interface, which includes the second content and the second plurality of selection indicators; as well as The first user interface, including the first content and the first plurality of selection indicators, is displayed via the display component.

38. The method of claim 37, further comprising: When displaying the second user interface including the second content and the second plurality of selection indicators, an input having a second directional component different from the first directional component is detected; as well as In response to detecting the input having the second direction component: Stop displaying the second user interface, which includes the second content and the second plurality of selection indicators; as well as A third user interface, comprising third content and a third plurality of selection indicators, is displayed via the display component. The third plurality of selection indicators include a selection indicator indicating that the third content is selected, wherein the third content is different from the first content and the second content.

39. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs including instructions for performing the method according to any one of claims 24 to 38.

40. A computer system communicating with a display component, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 24 to 38.

41. A computer system communicating with a display component, the computer system comprising: Components for performing the method according to any one of claims 24 to 38.

42. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs comprising instructions for performing the method according to any one of claims 24 to 38.

43. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs including instructions for: A first user interface including first content and a first plurality of selection indicators is displayed via the display component, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; While displaying the first user interface, including the first content and the first plurality of selection indicators, and the selection indicator indicating that the first content has been selected, via the display component, a change in the coupling state of the computer system is detected; and In response to detecting the change in the coupling state of the computer system: Stop displaying the selection indicator that indicates the first content has been selected; as well as A second user interface, including second content and a plurality of selection indicators, is displayed via the display component. The plurality of selection indicators include a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

44. A computer system communicating with a display component, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: A first user interface including first content and a first plurality of selection indicators is displayed via the display component, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; While displaying the first user interface, including the first content and the first plurality of selection indicators, and the selection indicator indicating that the first content has been selected, via the display component, a change in the coupling state of the computer system is detected; and In response to detecting the change in the coupling state of the computer system: Stop displaying the selection indicator that indicates the first content has been selected; as well as A second user interface, including second content and a plurality of selection indicators, is displayed via the display component. The plurality of selection indicators include a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

45. A computer system communicating with a display component, the computer system comprising: The component is used to display a first user interface including first content and a first plurality of selection indicators via the display component, wherein the first plurality of selection indicators includes a selection indicator indicating that the first content is selected; Components for the following operations: detecting changes in the coupling state of the computer system when a first user interface including the first content and the first plurality of selection indicators and the selection indicator indicating that the first content is selected is displayed via the display component; and In response to detecting the change in the coupling state of the computer system: The component is used to: stop displaying the selection indicator that indicates the first content has been selected; as well as The component is used to display a second user interface via the display component, including second content and a plurality of selection indicators, the plurality of selection indicators including a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

46. ​​A computer program product comprising one or more programs configured to execute by one or more processors of a computer system in communication with a display component, the one or more programs comprising instructions for performing the following operations: A first user interface including first content and a first plurality of selection indicators is displayed via the display component, the first plurality of selection indicators including a selection indicator indicating that the first content is selected; While displaying the first user interface, including the first content and the first plurality of selection indicators, and the selection indicator indicating that the first content has been selected, via the display component, a change in the coupling state of the computer system is detected; and In response to detecting the change in the coupling state of the computer system: Stop displaying the selection indicator that indicates the first content has been selected; as well as A second user interface, including second content and a plurality of selection indicators, is displayed via the display component. The plurality of selection indicators include a selection indicator indicating that the second content is selected, wherein the second content is different from the first content.

47. A method comprising: At a computer system that communicates with a display component, one or more devices in a first group excluding the object, one or more devices in a second group excluding the object, and one or more input devices: A request to identify the location of the object is detected via the one or more input devices; as well as In response to the detection of the request identifying the location of the object: Based on the determination that one or more devices in the first group meet one or more criteria of the corresponding group and one or more devices in the second group do not meet the one or more criteria of the corresponding group, the one or more devices in the first group provide output indicating the location of the object in the environment, while the one or more devices in the second group provide output indicating the location of the object in the environment; as well as Based on the determination that one or more devices in the first group do not meet the corresponding group criteria and one or more devices in the second group meet the corresponding group criteria, the one or more devices in the second group provide an output indicating the location of the object in the environment, while the one or more devices in the first group provide an output indicating the location of the object in the environment.

48. The method of claim 47, wherein the object is an electronic device.

49. The method according to claim 48, further comprising: In response to the request that identifies the location of the object, the electronic device provides output.

50. The method of any one of claims 47 to 49, wherein the output indicating the location of the object comprises light directed toward the object.

51. The method according to any one of claims 47 to 50, wherein the output indicating the location of the object includes a sound output pointing to the object.

52. The method according to any one of claims 47 to 51, wherein causing the first group of one or more devices to provide an output indicating the location of the object in the environment comprises: The first device in the first group of one or more devices provides a first output based on the orientation of the first device relative to the object; as well as A second device in one or more of the first group of devices provides a second output based on the orientation of the second device relative to the object, wherein the first output is different from the second output.

53. The method according to any one of claims 47 to 52, wherein the first group of one or more devices comprises a first type of device and a second type of device different from the first type of device.

54. The method according to any one of claims 47 to 53, wherein the output indicating the location of the object in the environment is provided within a predetermined time period.

55. The method according to any one of claims 47 to 54, the method further comprising: In response to the detection of the request identifying the location of the object, an indication of the location of the object is displayed via the display component.

56. The method of claim 55, wherein in response to detecting the request identifying the location of the object, the indication of the location of the object is displayed relative to one or more representations of one or more locations of one or more devices in the first group of one or more devices in the environment and one or more representations of one or more locations of one or more devices in the second group of one or more devices in the environment.

57. The method according to any one of claims 55 to 56, wherein: In response to the detection of the request identifying the location of the object: Based on the determination that one or more devices in the first group meet the corresponding group one or more criteria and one or more devices in the second group do not meet the corresponding group one or more criteria, the one or more representations of the locations of one or more devices in the first group one or more devices in the environment include at least one indication regarding whether the first group one or more devices are providing output; and Based on the determination that one or more devices in the first group do not meet the corresponding group criteria and one or more devices in the second group meet the corresponding group criteria, the one or more representations of one or more locations of one or more devices in the second group in the environment include at least one indication regarding the output being provided by the one or more devices in the second group.

58. The method according to any one of claims 47 to 57, the method further comprising: After the first group of one or more devices provides an output indicating the location of the object in the environment, it is detected that the object has been retrieved; as well as In response to detecting that the object has been retrieved, the first group of one or more devices stops providing output indicating the location of the object in the environment.

59. The method according to any one of claims 47 to 58, wherein the corresponding group of one or more criteria includes criteria satisfied when determining that the object is not installed.

60. The method of any one of claims 47 to 59, wherein the request to detect the location of the object includes input on a detection control.

61. The method of claim 60, wherein: Based on the confirmed installation of the object, the control is unselectable; and If it is determined that the object is not installed, the control is selectable.

62. The method according to any one of claims 60 to 61, wherein: Based on the confirmed installation of the object, the control is invisible; and The control is visible if it is determined that the object is not installed.

63. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with a display component, a first group of one or more devices excluding an object, a second group of one or more devices excluding the object, and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 47 to 62.

64. A computer system communicating with a display component, one or more devices excluding an object, one or more devices excluding the object, and one or more input devices, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 47 to 62.

65. A computer system communicating with a display component, one or more devices excluding an object, one or more devices excluding the object, and one or more input devices, the computer system comprising: Components for performing the method according to any one of claims 47 to 62.

66. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, one or more devices of a first group excluding the object, one or more devices of a second group excluding the object, and one or more input devices, the one or more programs comprising instructions for performing the method according to any one of claims 47 to 62.

67. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with a display component, one or more devices of a first group excluding an object, one or more devices of a second group excluding the object, and one or more input devices, the one or more programs including instructions for performing the following operations: A request to identify the location of the object is detected via the one or more input devices; and In response to the detection of the request identifying the location of the object: Based on the determination that one or more devices in the first group meet one or more criteria of the corresponding group and one or more devices in the second group do not meet the one or more criteria of the corresponding group, the first group of one or more devices provides output indicating the location of the object in the environment, while the second group of one or more devices does not provide output indicating the location of the object in the environment; and Based on the determination that one or more devices in the first group do not meet the corresponding group criteria and one or more devices in the second group meet the corresponding group criteria, the one or more devices in the second group provide an output indicating the location of the object in the environment, while the one or more devices in the first group provide an output indicating the location of the object in the environment.

68. A computer system communicating with a display component, one or more devices excluding an object, one or more devices excluding the object, and one or more input devices, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: A request to identify the location of the object is detected via the one or more input devices; and In response to the detection of the request identifying the location of the object: Based on the determination that one or more devices in the first group meet one or more criteria of the corresponding group and one or more devices in the second group do not meet the one or more criteria of the corresponding group, the one or more devices in the first group provide output indicating the location of the object in the environment, while the one or more devices in the second group provide output indicating the location of the object in the environment; as well as Based on the determination that one or more devices in the first group do not meet the corresponding group criteria and one or more devices in the second group meet the corresponding group criteria, the one or more devices in the second group provide an output indicating the location of the object in the environment, while the one or more devices in the first group provide an output indicating the location of the object in the environment.

69. A computer system communicating with a display component, one or more devices excluding an object, one or more devices excluding the object, and one or more input devices, the computer system comprising: Components for the following operation: detecting a request to identify the location of the object via the one or more input devices; as well as In response to the detection of the request identifying the location of the object: Components for the following operation: based on determining that one or more devices in the first group meet one or more criteria of the corresponding group and one or more devices in the second group do not meet the one or more criteria of the corresponding group, causing one or more devices in the first group to provide output indicating the location of the object in the environment, while not causing one or more devices in the second group to provide output indicating the location of the object in the environment; as well as Components for the following operation: based on determining that one or more devices in the first group do not meet one or more criteria of the corresponding group and one or more devices in the second group meet one or more criteria of the corresponding group, causing one or more devices in the second group to provide output indicating the location of the object in the environment, without causing one or more devices in the first group to provide output indicating the location of the object in the environment.

70. A computer program product comprising one or more programs configured to execute by one or more processors of a computer system in communication with a display component, one or more devices of a first group excluding an object, one or more devices of a second group excluding the object, and one or more input devices, the one or more programs comprising instructions for performing the following operations: A request to identify the location of the object is detected via the one or more input devices; and In response to the detection of the request identifying the location of the object: Based on the determination that one or more devices in the first group meet one or more criteria of the corresponding group and one or more devices in the second group do not meet the one or more criteria of the corresponding group, the first group of one or more devices provides output indicating the location of the object in the environment, while the second group of one or more devices does not provide output indicating the location of the object in the environment; and Based on the determination that one or more devices in the first group do not meet the corresponding group criteria and one or more devices in the second group meet the corresponding group criteria, the one or more devices in the second group provide an output indicating the location of the object in the environment, while the one or more devices in the first group provide an output indicating the location of the object in the environment.

71. A method, the method comprising: At a computer system communicating with one or more devices in a first group that do not include the object: While causing the first group of one or more devices to provide a first output indicating where the object is located, a change in the location relationship between the first user and the object is detected; as well as In response to detecting a change in the location relationship between the first user and the object, the first group of one or more devices provides a second output indicating where the object is located, wherein the second output is different from the first output.

72. The method of claim 71, wherein the first output corresponds to light output in a first direction, and wherein the second output corresponds to light output in a second direction different from the first direction.

73. The method according to any one of claims 71 to 72, wherein the first output comprises audio having a first spatial output attribute, and wherein the second output comprises audio having a second spatial output attribute different from the first spatial output.

74. The method according to any one of claims 71 to 73, wherein the positioning relationship between the first user and the object changes at a speed rate, and wherein: Based on the determination that the speed rate corresponds to the first speed rate, the second output has the first output rate; as well as Based on the determination that the speed rate corresponds to a second speed rate different from the first speed rate, the second output has a second output rate different from the first output rate.

75. The method according to any one of claims 71 to 74, wherein: In response to detecting a change in the location relationship between the first user and the object: Based on the determination that the first user and the object have a first location relationship after detecting the change in the location relationship between the first user and the object, the second output has a first set of characteristics; as well as Based on the determination that after detecting the change in the location relationship between the first user and the object, the first user and the object have a second location relationship different from the first location relationship, the second output has a second set of characteristics different from the first set of characteristics.

76. The method of any one of claims 71 to 75, wherein the first group of one or more devices is in a first location before the change in the location relationship between the first user and the object is detected, and wherein causing the first group of one or more devices to provide the second output includes moving the first group of one or more devices from the first location to a second location different from the first location.

77. The method according to any one of claims 71 to 76, wherein the first output and the second output are outputs of the same type.

78. The method of any one of claims 71 to 77, wherein the computer system communicates with a second group of one or more devices, excluding the object, different from the first group of one or more devices, and wherein the change in the location relationship between the first user and the object is detected when the second group of one or more devices provides a third output indicating where the object is located, the method further comprising: In response to detecting a change in the location relationship between the first user and the object, one or more devices in the second group output a fourth output indicating where the object is located, wherein the fourth output is different from the second output and the third output.

79. The method of any one of claims 71 to 78, wherein the computer system communicates with one or more third groups of devices, excluding the object, which are different from the first group of one or more devices, and wherein the change in the location relationship between the first user and the object is detected when the third group of one or more devices provides a fifth output indicating where the object is located, the method further comprising: In response to detecting a change in the location relationship between the first user and the object, the third group of one or more devices continue to provide the fifth output.

80. The method according to any one of claims 71 to 79, the method further comprising: While enabling the first group of one or more devices to provide the first output, a change in the positioning relationship between the second user and the object is detected; In response to detecting a change in the location relationship between the second user and the object, the system abandons the practice of having the first group of one or more devices provide an output different from the first output.

81. The method of claim 80, wherein the first user is a target user, and wherein the second user is a non-target user.

82. The method according to any one of claims 71 to 81, wherein the computer system communicates with one or more devices in a fourth group that do not include the object, different from the first group of one or more devices, the method further comprising: In response to detecting a change in the location relationship between the first user and the object, the fourth group of one or more devices moves from the first location to the second location.

83. The method of claim 82, wherein when the fourth group of one or more devices is in the first position, the fourth group of one or more devices is located between the user and the object.

84. The method according to any one of claims 82 to 83, wherein the fourth group of one or more devices occludes the object before moving the fourth group of one or more devices from the first position to the second position.

85. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more devices of a first group excluding an object, the one or more programs including instructions for performing the method according to any one of claims 71 to 84.

86. A computer system for communicating with one or more devices, excluding an object, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 71 to 84.

87. A computer system for communicating with a first group of one or more devices that do not include an object, the computer system comprising: Components for performing the method according to any one of claims 71 to 84.

88. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more devices, excluding an object, the one or more programs comprising instructions for performing the method according to any one of claims 71 to 84.

89. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more devices, excluding an object, the one or more programs including instructions for: While causing the first group of one or more devices to provide a first output indicating where the object is located, a change in the location relationship between the first user and the object is detected; and In response to detecting a change in the location relationship between the first user and the object, the first group of one or more devices provides a second output indicating where the object is located, wherein the second output is different from the first output.

90. A computer system for communicating with one or more devices, excluding an object, said computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: While causing the first group of one or more devices to provide a first output indicating where the object is located, a change in the location relationship between the first user and the object is detected; as well as In response to detecting a change in the location relationship between the first user and the object, the first group of one or more devices provides a second output indicating where the object is located, wherein the second output is different from the first output.

91. A computer system for communicating with one or more devices, excluding an object, said computer system comprising: Components for the following operation: detecting changes in the location relationship between a first user and the object when the first group of one or more devices provides a first output indicating where the object is located; as well as Components for the following operation: in response to detecting a change in the location relationship between the first user and the object, causing one or more devices in the first group to provide a second output indicating where the object is located, wherein the second output is different from the first output.

92. A computer program product comprising one or more programs configured to execute by one or more processors of a computer system communicating with one or more devices, excluding an object, the one or more programs comprising instructions for: While causing the first group of one or more devices to provide a first output indicating where the object is located, a change in the location relationship between the first user and the object is detected; and In response to detecting a change in the location relationship between the first user and the object, the first group of one or more devices provides a second output indicating where the object is located, wherein the second output is different from the first output.

93. A method, the method comprising: At the computer system communicating with the first group of one or more devices: When the first group of one or more devices is operated in a first manner, a first movement of the user is detected; as well as In response to detecting the user's first movement: Based on the determination of the existence of a first context, the first group of one or more devices are caused to operate in a second manner different from the first manner; as well as Based on the determination of the existence of a second context, the first group of one or more devices are caused to operate in a third manner different from the second and first methods.

94. The method of claim 93, wherein the first group of one or more devices includes one or more output devices.

95. The method of claim 94, wherein operating the first group of one or more devices in the first manner comprises operating the first group of one or more devices in a first direction without operating the first group of one or more devices in a second direction, and wherein operating the first group of one or more devices in the second manner comprises operating the first group of one or more devices in the second direction without operating the first group of one or more devices in the first direction.

96. The method according to any one of claims 94 to 95, wherein the first output propagates throughout the physical environment.

97. The method according to any one of claims 94 to 96, wherein operating the first group of one or more devices in the first manner includes causing the first group of one or more devices to provide a second output having a first spatial attribute, and wherein operating the first group of one or more devices in the second manner includes causing the first group of one or more devices to provide a second output having a second spatial attribute different from the first spatial attribute.

98. The method of any one of claims 93 to 97, wherein the first group of one or more devices includes an actuator, and wherein operating the first group of one or more devices in the second manner includes moving the actuator from a first position to a second position different from the first position.

99. The method of any one of claims 93 to 98, wherein the computer system communicates with a second group of one or more devices, and wherein prior to detecting the first movement of the user, the computer system causes the second group of one or more devices to operate in a fourth manner, the method further comprising: In response to detecting the user's first movement, the second group of one or more devices are caused to operate in a fifth manner, different from the fourth manner.

100. The method according to any one of claims 93 to 99, wherein the computer system communicates with an external wearable device, and wherein the user's first movement is detected via the external wearable device.

101. The method according to any one of claims 93 to 100, wherein the computer system communicates with a group of one or more cameras, and wherein the first movement of the user is detected via image data captured by the group of one or more cameras.

102. The method according to any one of claims 93 to 101, the method further comprising: When the first group of one or more devices is operated in the first manner and when the user is in the focus area, a second movement of the user is detected. as well as In response to detecting the user's second movement: Based on determining that the user is located within the focus area, the first group of one or more devices continues to operate in the first manner; as well as Based on the determination that the user is not located within the focus area, the first group of one or more devices is made to operate in a fifth manner, different from the first manner.

103. The method according to any one of claims 93 to 102, wherein the first movement of the user is not detected via a motion sensor.

104. The method according to any one of claims 93 to 103, wherein the first context corresponds to a first movement state of the computer system, and wherein the second context corresponds to a second movement state of the computer system that is different from the second movement state.

105. The method according to any one of claims 93 to 104, wherein the first context corresponds to a first operating state of the computer system, and wherein the second context corresponds to a second operating state of the computer system.

106. The method according to any one of claims 93 to 106, wherein the first context corresponds to a first body pose of the user, and wherein the second context corresponds to a second body pose of the user that is different from the first body pose.

107. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more devices of a first group, the one or more programs including instructions for performing the method according to any one of claims 93 to 106.

108. A computer system that communicates with a first group of one or more devices, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 93 to 106.

109. A computer system that communicates with a first group of one or more devices, the computer system comprising: Components for performing the method according to any one of claims 93 to 106.

110. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more devices of a first group, the one or more programs comprising instructions for performing the method according to any one of claims 93 to 106.

111. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more first groups of devices, the one or more programs including instructions for: When the first group of one or more devices is operated in a first manner, a first movement of the user is detected; as well as In response to detecting the user's first movement: Based on the determination of the existence of a first context, the first group of one or more devices are caused to operate in a second manner different from the first manner; as well as Based on the determination of the existence of a second context, the first group of one or more devices are caused to operate in a third manner different from the second and first methods.

112. A computer system that communicates with a first group of one or more devices, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: When the first group of one or more devices is operated in a first manner, a first movement of the user is detected; as well as In response to detecting the user's first movement: Based on the determination of the existence of a first context, the first group of one or more devices are caused to operate in a second manner different from the first manner; as well as Based on the determination of the existence of a second context, the first group of one or more devices are caused to operate in a third manner different from the second and first methods.

113. A computer system that communicates with a first group of one or more devices, the computer system comprising: Components for the following operation: detecting a first movement of the user when the first group of one or more devices is operated in a first manner; as well as In response to detecting the user's first movement: Components for the following operation: based on determining the existence of a first context, causing one or more devices in the first group to operate in a second manner different from the first manner; as well as Components for the following operation: based on the determination of the existence of a second context, causing one or more devices in the first group to operate in a third mode different from the second mode and the first mode.

114. A computer program product comprising one or more programs configured to execute by one or more processors of a computer system communicating with one or more devices of a first group, the one or more programs comprising instructions for: When the first group of one or more devices is operated in a first manner, a first movement of the user is detected; as well as In response to detecting the user's first movement: Based on the determination of the existence of a first context, the first group of one or more devices are caused to operate in a second manner different from the first manner; as well as Based on the determination of the existence of a second context, the first group of one or more devices are caused to operate in a third manner different from the second and first methods.

115. A method, the method comprising: At the computer system that communicates with the display component and one or more input components: The display component displays a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; When the first instruction is displayed at the first location and the second instruction is displayed at the second location, the first input is detected via the one or more input components; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at the location corresponding to the first location: The display component displays a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; as well as The output of the first device changes based on the movement of the first input; as well as Based on the determination that the first input was initially detected at a location corresponding to the second location: The first portion of the second scale is displayed at the second location via the display component; as well as The output of the second device is changed based on the movement of the first input, wherein the second device is different from the first device.

116. The method according to claim 115, wherein: The first device is a device of the first type; The second device is a second type of device that is different from the first type of device; The first type of device has a setting type corresponding to the first setting; The first type of device does not have a setting type corresponding to the second setting; The second type of device has a setting type corresponding to the second setting; and The second type of device does not have a setting type corresponding to the first setting.

117. The method according to any one of claims 115 to 116, further comprising: In response to the detection of the first input: Based on the determination that the first input was initially detected at the location corresponding to the first location, the display of the second scale is abandoned; as well as Based on the determination that the first input was initially detected at the location corresponding to the second location, the display of the first scale is abandoned.

118. The method according to any one of claims 115 to 117, wherein the first indication and the second indication are displayed inside a physical recess in the computer system.

119. The method of claim 118, wherein the physical recess at least partially surrounds the physical input mechanism, the method further comprising: Detect a second input corresponding to the physical input mechanism via the one or more input components; as well as In response to detecting the second input corresponding to the physical input mechanism, an operation different from at least one selected from the group that causes the output of the first device and the output of the second device is performed.

120. The method according to any one of claims 115 to 119, the method further comprising: A third indication corresponding to the third setting is displayed via the display component, wherein the third indication is displayed at a third location different from the second location and the first location; When the first instruction is displayed at the first location, the second instruction is displayed at the second location, and the third instruction is displayed at the third location, a third input is detected via the one or more input components; as well as In response to detecting the third input and determining that the third input was initially detected at a location corresponding to the third location: The first portion of the third scale is displayed at the third location via the display component; as well as The output of the third device changes based on the movement of the third input.

121. The method of claim 120, wherein the first indication, the second indication, and the third indication are equidistant.

122. The method according to any one of claims 120 to 121, the method further comprising: In response to the detection of the third input and based on the determination that the third input was initially detected at a location corresponding to the third location, a portion of the third scale is displayed at the first location via the display component, while the other portion of the third scale is not displayed at the second location.

123. The method according to any one of claims 115 to 122, the method further comprising: After the first input is detected, a fourth input is detected via the one or more input components; as well as In response to the detection of the fourth input: Based on the determination that the fourth input is detected within a predetermined time period of the first input, based on the determination that the first input is initially detected at the location corresponding to the first location, and based on the determination that the fourth input is initially detected at the location corresponding to the second location, the output of the first device is changed based on the movement of the fourth input. Based on the determination that the fourth input was not detected within the predetermined time period, based on the determination that the fourth input was initially detected at the location corresponding to the first location, and based on the determination that the fourth input was initially detected at the location corresponding to the second location, the decision is to abandon changing the output of the first device based on the movement of the fourth input.

124. The method according to claim 123, further comprising: In response to the detection of the fourth input: Based on the determination that the fourth input was not detected within the predetermined time period, based on the determination that the fourth input was initially detected at the location corresponding to the first location, and based on the determination that the fourth input was initially detected at the location corresponding to the second location, the output of the second device is changed based on the movement of the fourth input.

125. The method according to any one of claims 115 to 124, the method further comprising: When the first instruction is displayed at the first location and the second instruction is displayed at the second location, a fifth input is detected via the one or more input components; as well as In response to the detection of a fifth input: Based on determining that the fifth input was initially detected at a location corresponding to the first location, and based on determining that the fifth input was in a first direction, the output of the first device is changed in a first manner based on the movement of the fifth input; as well as Based on determining that the fifth input was initially detected at a location corresponding to the first location, and based on determining that the fifth input is in a second direction different from the first direction, the output of the first device is changed in a second manner based on the movement of the fifth input, wherein the second manner is different from the first manner.

126. The method according to any one of claims 115 to 125, the method further comprising: When the first instruction is displayed at the first location and the second instruction is displayed at the second location, a sixth input is detected via the one or more input components; as well as In response to the detection of the sixth input: Based on determining that the sixth input was initially detected at the location corresponding to the first location and based on determining that the sixth input is a gesture of the first type, the first portion of the first scale is displayed at the first location via the display component; as well as Based on the determination that the sixth input was initially detected at the location corresponding to the first location and based on the determination that the sixth input is a second type of gesture different from the first type of gesture, a user interface object representing the value of the first setting is displayed via the display component.

127. The method according to any one of claims 115 to 126, the method further comprising: When the first instruction is displayed at the first location and the second instruction is displayed at the second location, a seventh input is detected via the one or more input components; as well as In response to detecting the seventh input and determining that the seventh input was initially detected at a location corresponding to the first location, a third indication corresponding to the third setting and a fourth indication corresponding to the fourth setting are displayed via the display component, wherein the fourth indication is different from the third indication, the second indication and the first indication; When the third and fourth indications are displayed, an eighth input is detected via the one or more input components; as well as In response to the detection of the eighth input: Based on the determination that the eighth input was initially detected at a location corresponding to the third indication, the third indication is selected, wherein in response to the detection of movement of the corresponding input when the third indication is selected, the output of the first device is changed in a third manner based on the movement of the corresponding input; as well as Based on the determination that the eighth input was initially detected at a location corresponding to the fourth indication, the fourth indication is selected, wherein in response to the detection of movement of the corresponding input when the fourth indication is selected, the output of the first device is changed in a fourth manner based on the movement of the corresponding input, and wherein the fourth manner is different from the third manner.

128. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs including instructions for performing the method according to any one of claims 115 to 127.

129. A computer system communicating with a display component, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 115 to 127.

130. A computer system communicating with a display component, the computer system comprising: Components for performing the method according to any one of claims 115 to 127.

131. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs comprising instructions for performing the method according to any one of claims 115 to 127.

132. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display component and one or more input components, the one or more programs including instructions for: The display component displays a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; When the first instruction is displayed at the first location and the second instruction is displayed at the second location, the first input is detected via the one or more input components; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at the location corresponding to the first location: The display component displays a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; as well as The output of the first device changes based on the movement of the first input; as well as Based on the determination that the first input was initially detected at a location corresponding to the second location: The first portion of the second scale is displayed at the second location via the display component; as well as The output of the second device is changed based on the movement of the first input, wherein the second device is different from the first device.

133. A computer system communicating with a display component and one or more input components, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: The display component displays a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; When the first instruction is displayed at the first location and the second instruction is displayed at the second location, the first input is detected via the one or more input components; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at the location corresponding to the first location: The display component displays a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; as well as The output of the first device changes based on the movement of the first input; as well as Based on the determination that the first input was initially detected at a location corresponding to the second location: The first portion of the second scale is displayed at the second location via the display component; as well as The output of the second device is changed based on the movement of the first input, wherein the second device is different from the first device.

134. A computer system communicating with a display component and one or more input components, the computer system comprising: The component is used to display a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting via the display component, wherein the first indication is displayed at a first location and wherein the second indication is displayed at a second location different from the first location; Components for the following operation: detecting a first input via the one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at the location corresponding to the first location: A component for the following operation: displaying a first portion of a first scale at a first location and a second portion of the first scale at a second location via the display component, wherein the second portion is different from the first portion; as well as A component for the following operation: causing the output of the first device to change based on the movement of the first input; as well as Based on the determination that the first input was initially detected at a location corresponding to the second location: A component for the following operation: displaying a first portion of a second scale at the second location via the display assembly; as well as A component for operating such that the output of a second device changes based on the movement of the first input, wherein the second device is different from the first device.

135. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display component and one or more input components, the one or more programs comprising instructions for: The display component displays a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; When the first instruction is displayed at the first location and the second instruction is displayed at the second location, the first input is detected via the one or more input components; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at the location corresponding to the first location: The display component displays a first portion of a first scale at the first location and a second portion of the first scale at the second location, wherein the second portion is different from the first portion; as well as The output of the first device changes based on the movement of the first input; as well as Based on the determination that the first input was initially detected at a location corresponding to the second location: The first portion of the second scale is displayed at the second location via the display component; as well as The output of the second device is changed based on the movement of the first input, wherein the second device is different from the first device.

136. A method, the method comprising: At the computer system that communicates with the display component and one or more input components: The display component displays a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; When the first instruction is displayed at the first location and the second instruction is displayed at the second location, the first input is detected via the one or more input components; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at a location corresponding to the first indication, a first scale including one or more values ​​corresponding to the first setting is displayed via the display component; as well as Based on the determination that the first input was initially detected at a location corresponding to the second indication, a second scale including one or more values ​​corresponding to the second setting is displayed via the display component, wherein the display of the first scale is visually different from the display of the second scale.

137. The method of claim 136, wherein the first indication and the second indication are displayed in a physical recess.

138. The method of claim 137, wherein the first scale and the second scale are displayed inside the physical groove.

139. The method according to any one of claims 136 to 137, wherein the first scale and the second scale are displayed in a region different from the physical groove.

140. The method according to any one of claims 136 to 138, wherein the first scale is displayed at the first location, and wherein the second scale is displayed at the second location.

141. The method according to any one of claims 136 to 140, the method further comprising: While displaying the first scale, a second input is detected via the one or more input components; In response to the detection of the second input: Based on determining that the second input is of the first type, the first scale is changed to include the first color characteristic; and Based on the determination that the second user input is a second type different from the first type, the first scale is changed to include a second color characteristic different from the first color characteristic.

142. The method according to any one of claims 136 to 141, the method further comprising: When the first instruction is displayed at the first location and the second instruction is displayed at the second location, a third input is detected via the one or more input components; as well as In response to the detection of the third input: Based on the determination that the third input is detected at the third location, the first part of the third scale is displayed at the first location and the second part of the third scale is displayed at the second location via the display component.

143. The method according to any one of claims 136 to 142, the method further comprising: When the first instruction is displayed at the first location and the second instruction is displayed at the second location, a fourth input is detected via the one or more input components; as well as In response to the detection of the fourth input: Based on the determination that the fourth input is detected at the fifth location, the first part of the fourth scale is displayed at the first location and the second part of the fourth scale is displayed at the fifth location via the display component; as well as Based on the determination that the fourth input was initially detected at a sixth location different from the fifth location, the first portion of the fourth scale is displayed at the first location and the second portion of the fourth scale is displayed at the sixth location via the display component.

144. The method according to any one of claims 136 to 143, wherein: Based on the determination that the first setting is a first type and the first scale is a first size; and Based on the determination that the second setting is a second type different from the first type, and the second scale is a second size different from the first size.

145. The method according to any one of claims 136 to 144, the method further comprising: When displaying the first scale: Based on determining that the value set is a first value, a first indication of the first value is displayed via the display component at a first position excluding a portion of the first scale; and Based on the determination that the value of the first setting is a second value different from the first value, a second indication of the second value is displayed via the display component at a second position excluding a portion of the first scale, wherein the second indication is different from the first indication.

146. The method according to any one of claims 136 to 145, the method further comprising: After the first input is detected, a fifth input is detected via the one or more input components; as well as In response to the detection of a fifth input: Based on the determination that the fifth input was detected within a predetermined time period of the first input, based on the determination that the fifth input was initially detected at a location corresponding to the first location, and based on the determination that the fifth input was initially detected at a location corresponding to the second location, the first scale continues to be displayed; as well as Based on the determination that the fifth input was not detected within the predetermined time period, based on the determination that the fifth input was initially detected at a location corresponding to the first location, and based on the determination that the fifth input was initially detected at a location corresponding to the second location, the display of the first scale is abandoned.

147. The method according to claim 146, further comprising: In response to the detection of the fifth input, based on the determination that the fifth input was detected outside the predetermined time period, based on the determination that the fifth input was initially detected at a location corresponding to the first location, and based on the determination that the fifth input was initially detected at a location corresponding to the second location, the second scale including the one or more values ​​corresponding to the second setting is displayed via the display component.

148. The method according to any one of claims 136 to 147, the method further comprising: When the first instruction is displayed at the first location and the second instruction is displayed at the second location, a sixth input is detected via the one or more input components; as well as In response to the detection of the sixth input: Based on the determination that the sixth input was initially detected at a location corresponding to the first location, and based on the determination that the sixth input was in a first direction, a first indicator corresponding to the first scale is displayed via the display component, wherein the first indicator corresponds to the current value of the first setting; as well as Based on the determination that the sixth input was initially detected at a location corresponding to the first location and based on the determination that the sixth input is in a second direction different from the first direction, a second indicator corresponding to the first scale is displayed via the display component, wherein the second indicator corresponds to the current value of the first setting, and wherein the second indicator is smaller than the first indicator.

149. The method according to any one of claims 136 to 148, the method further comprising: When the first instruction is displayed at the first location and the second instruction is displayed at the second location, a seventh input is detected via the one or more input components; In response to the detection of the seventh input: Based on determining that the seventh input was initially detected at a location corresponding to the first location and based on determining that the seventh input is a gesture of the first type, the first scale is displayed at the first location via the display component; as well as Based on the determination that the sixth input was initially detected at a location corresponding to the first location and based on the determination that the seventh input is a second type of gesture different from the first type of gesture, a user interface object representing the value of the first setting is displayed via the display component; as well as After the seventh input is detected and in response to no longer detecting the seventh input: Based on the determination that the sixth input was initially detected at a location corresponding to the first location and based on the determination that the sixth input is a gesture of the first type, the display of the first scale is stopped; as well as Based on the determination that the sixth input was initially detected at the location corresponding to the first location and based on the determination that the sixth input is a gesture of the second type, the first scale continues to be displayed at the first location and the user interface object is displayed.

150. The method according to any one of claims 136 to 149, the method further comprising: After the first input is detected, in response to the first input no longer being detected, and based on the determination that the first input was initially detected at the location corresponding to the first indication, the display of the first scale is stopped.

151. The method according to any one of claims 136 to 150, the method further comprising: In response to the detection of the first input: Haptic feedback is provided based on the determination that the first input was initially detected at the location corresponding to the first instruction and based on the determination that the first input was detected at the fifth position of the first scale; as well as Based on the determination that the first input was initially detected at the location corresponding to the second indication and based on the determination that the first input was detected at the fifth location on the second scale, haptic feedback is abandoned.

152. The method according to any one of claims 136 to 151, wherein the length of the second scale is different from the length of the first scale.

153. The method according to any one of claims 136 to 152, wherein the first scale is displayed as including a first number of distinct portions, and wherein the second scale is displayed as including a second number of distinct portions different from the first number of distinct portions.

154. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs including instructions for performing the method according to any one of claims 136 to 153.

155. A computer system communicating with a display component, the computer system comprising: One or more processors; as well as A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 136 to 153.

156. A computer system communicating with a display component, the computer system comprising: Components for performing the method according to any one of claims 136 to 153.

157. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display component, the one or more programs comprising instructions for performing the method according to any one of claims 136 to 153.

158. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display component and one or more input components, the one or more programs including instructions for: The display component displays a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; When the first instruction is displayed at the first location and the second instruction is displayed at the second location, the first input is detected via the one or more input components; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at a location corresponding to the first indication, a first scale including one or more values ​​corresponding to the first setting is displayed via the display component; as well as Based on the determination that the first input was initially detected at a location corresponding to the second indication, a second scale including one or more values ​​corresponding to the second setting is displayed via the display component, wherein the display of the first scale is visually different from the display of the second scale.

159. A computer system communicating with a display component and one or more input components, the computer system comprising: One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: The display component displays a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; When the first instruction is displayed at the first location and the second instruction is displayed at the second location, the first input is detected via the one or more input components; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at a location corresponding to the first indication, a first scale including one or more values ​​corresponding to the first setting is displayed via the display component; as well as Based on the determination that the first input was initially detected at a location corresponding to the second indication, a second scale including one or more values ​​corresponding to the second setting is displayed via the display component, wherein the display of the first scale is visually different from the display of the second scale.

160. A computer system communicating with a display component and one or more input components, the computer system comprising: The component is used to display a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting via the display component, wherein the first indication is displayed at a first location and wherein the second indication is displayed at a second location different from the first location; Components for the following operation: detecting a first input via the one or more input components when the first indication is displayed at the first location and the second indication is displayed at the second location; as well as In response to the detection of the first input: The component is used to: display a first scale including one or more values ​​corresponding to the first setting, based on the determination that the first input was initially detected at a location corresponding to the first indication; as well as The component is used to: based on the determination that the first input was initially detected at a location corresponding to the second indication, display via the display component a second scale including one or more values ​​corresponding to the second setting, wherein the display of the first scale is visually different from the display of the second scale.

161. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display component and one or more input components, the one or more programs comprising instructions for: The display component displays a first indication corresponding to a first setting and a second indication corresponding to a second setting different from the first setting, wherein the first indication is displayed at a first location and the second indication is displayed at a second location different from the first location; When the first instruction is displayed at the first location and the second instruction is displayed at the second location, the first input is detected via the one or more input components; as well as In response to the detection of the first input: Based on the determination that the first input was initially detected at a location corresponding to the first indication, a first scale including one or more values ​​corresponding to the first setting is displayed via the display component; as well as Based on the determination that the first input was initially detected at a location corresponding to the second indication, a second scale including one or more values ​​corresponding to the second setting is displayed via the display component, wherein the display of the first scale is visually different from the display of the second scale.

Images