User interface for managing accessories

Abstract

The invention relates to a user interface for managing accessories. The present disclosure generally relates to managing accessories. In some examples, a device displays a user interface having a plurality of category options, and in response to detecting a selection of a category option, the device displays an accessory control and a sub-category option. In some examples, a device arranges a scene in accordance with context-based conditions. In some examples, when an accessory added to an automation system meets a set of one or more criteria, a device automatically groups the accessory together with one or more additional accessories. In some examples, a device displays an arrangement of camera views having different sizes and may vary the respective positioning of the camera views relative to each other. In some examples, when in an edit mode, a device may rearrange and / or resize one or more representations of an accessory based on different types of inputs.

Description

[0001] This application is a divisional application of the patent application with application number 202380044263X, application date June 2, 2023, and invention name “User interface for managing accessories”.

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS

[0003] This application claims priority to U.S. Provisional Patent Application No. 63 / 349,014, entitled “USER INTERFACES FOR MANAGING ACCESSORIES,” filed on June 3, 2022, and U.S. Patent Application No. 18 / 204,888, entitled “USER INTERFACES FOR MANAGING ACCESSORIES,” filed on June 1, 2023. The contents of each of these patent applications are incorporated herein by reference in their entirety. Technical Field

[0004] The present disclosure relates generally to computer user interfaces and, more particularly, to techniques for managing accessories. Background Art

[0005] The electronic device can communicate with various electronic accessories such as lights, sockets, locks, speakers and / or other devices. In addition, when connected to an accessory, the electronic device can adjust the status, settings and / or position of the accessory. Summary of the Invention

[0006] However, some techniques for managing accessories using electronic devices are often cumbersome and inefficient. For example, some existing techniques use complex and time-consuming user interfaces that may include multiple button presses or keystrokes. These techniques require more time than necessary, resulting in wasted user time and device energy. This latter consideration is particularly important in battery-powered devices.

[0007] Thus, the present technology provides electronic devices with faster, more efficient methods and interfaces for managing accessories. Such methods and interfaces optionally supplement or replace other methods for managing accessories. Such methods and interfaces reduce the cognitive burden placed on the user and produce a more efficient human-computer interface. For example, such methods and interfaces display related accessories and / or user interface objects that reduce the number of inputs required to control and / or adjust the corresponding accessories. In addition, such methods and interfaces provide improved techniques for rearranging accessory user interface objects that reduce the number of unnecessary and / or irrelevant user inputs. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charges.

[0008] According to some embodiments, a method is described. The method is performed at a computer system in communication with a display generation component and one or more input devices. The method includes: when displaying a user interface associated with a home automation system via the display generating component, the user interface includes multiple selectable category options corresponding to corresponding contexts of the home automation system, detecting user input corresponding to a selection of a first selectable category option among the multiple selectable category options via the one or more input devices, wherein the first selectable category option among the multiple selectable category options corresponds to a first context of the home automation system; and in response to detecting the user input corresponding to the selection of the first selectable category option among the multiple selectable category options, displaying via the display generating component: a first accessory user interface object on the user interface, wherein the first accessory user interface object corresponds to a first accessory of the home automation system associated with the first context of the first selectable category option; a second accessory user interface object on the user interface, wherein the second accessory user interface object corresponds to a second accessory of the home automation system associated with the first context of the first selectable category option; and a first selectable subcategory option, the first selectable subcategory option corresponding to a subcategory of the category associated with the first selectable category option, wherein the first selectable subcategory option includes a status indication related to one or more accessories of the home automation system associated with the subcategory.

[0009] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for the following operations: when displaying a user interface associated with a home automation system via the display generation component, the user interface including a plurality of selectable category options corresponding to respective contexts of the home automation system, detecting a user input corresponding to a selection of a first selectable category option in the plurality of selectable category options via the one or more input devices, wherein the first selectable category option in the plurality of selectable category options corresponds to a first context of the home automation system; and in response to detecting a user input corresponding to a selection of the first selectable category option in the plurality of selectable category options, The user input corresponding to the selection of the category option is displayed via the display generating component: a first accessory user interface object on the user interface, wherein the first accessory user interface object corresponds to a first accessory of the home automation system associated with the first context of the first selectable category option; a second accessory user interface object on the user interface, wherein the second accessory user interface object corresponds to a second accessory of the home automation system associated with the first context of the first selectable category option; and a first selectable subcategory option, the first selectable subcategory option corresponding to a subcategory of the category associated with the first selectable category option, wherein the first selectable subcategory option includes a status indication related to one or more accessories of the home automation system associated with the subcategory.

[0010] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for the following operations: when displaying a user interface associated with a home automation system via the display generation component, the user interface including a plurality of selectable category options corresponding to respective contexts of the home automation system, detecting a user input corresponding to a selection of a first selectable category option in the plurality of selectable category options via the one or more input devices, wherein the first selectable category option in the plurality of selectable category options corresponds to a first context of the home automation system; and in response to detecting a user input corresponding to a selection of the first selectable category option in the plurality of selectable category options, The user input corresponding to the selection of the category option is displayed via the display generating component: a first accessory user interface object on the user interface, wherein the first accessory user interface object corresponds to a first accessory of the home automation system associated with the first context of the first selectable category option; a second accessory user interface object on the user interface, wherein the second accessory user interface object corresponds to a second accessory of the home automation system associated with the first context of the first selectable category option; and a first selectable subcategory option, the first selectable subcategory option corresponding to a subcategory of the category associated with the first selectable category option, wherein the first selectable subcategory option includes a status indication related to one or more accessories of the home automation system associated with the subcategory.

[0011] According to some embodiments, a computer system is described. The computer system communicates with a display generation component and one or more input devices. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: when a user interface associated with a home automation system is displayed via the display generation component, the user interface includes a plurality of selectable category options corresponding to a corresponding context of the home automation system, detecting a user input corresponding to a selection of a first selectable category option in the plurality of selectable category options via the one or more input devices, wherein the first selectable category option in the plurality of selectable category options corresponds to a first context of the home automation system; and in response to detecting a user input corresponding to a selection of the first selectable category option in the plurality of selectable category options, The user input corresponding to the selection of the item is displayed via the display generating component: a first accessory user interface object on the user interface, wherein the first accessory user interface object corresponds to a first accessory of the home automation system associated with the first context of the first selectable category option; a second accessory user interface object on the user interface, wherein the second accessory user interface object corresponds to a second accessory of the home automation system associated with the first context of the first selectable category option; and a first selectable subcategory option, the first selectable subcategory option corresponding to a subcategory of the category associated with the first selectable category option, wherein the first selectable subcategory option includes a status indication related to one or more accessories of the home automation system associated with the subcategory.

[0012] According to some embodiments, a computer system is described. The computer system communicates with a display generation component and one or more input devices. The computer system includes: a device for performing the following operations: when a user interface associated with a home automation system is displayed via the display generation component, the user interface includes multiple selectable category options corresponding to corresponding contexts of the home automation system, detecting a user input corresponding to a selection of a first selectable category option in the multiple selectable category options via the one or more input devices, wherein the first selectable category option in the multiple selectable category options corresponds to a first context of the home automation system; and a device for performing the following operations: in response to detecting the user input corresponding to the selection of the first selectable category option in the multiple selectable category options, Displaying: a first accessory user interface object on the user interface, wherein the first accessory user interface object corresponds to a first accessory of the home automation system associated with the first context of the first selectable category option; a second accessory user interface object on the user interface, wherein the second accessory user interface object corresponds to a second accessory of the home automation system associated with the first context of the first selectable category option; and a first selectable subcategory option, the first selectable subcategory option corresponding to a subcategory of the category associated with the first selectable category option, wherein the first selectable subcategory option includes a status indication related to one or more accessories of the home automation system associated with the subcategory.

[0013] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs including instructions for the following operations: when displaying a user interface associated with a home automation system via the display generation component, the user interface including a plurality of selectable category options corresponding to respective contexts of the home automation system, detecting a user input corresponding to a selection of a first selectable category option in the plurality of selectable category options via the one or more input devices, wherein the first selectable category option in the plurality of selectable category options corresponds to a first context of the home automation system; and in response to detecting a user input corresponding to a selection of the first selectable category option in the plurality of selectable category options, The user input corresponding to the selection of a category option is displayed via the display generating component: a first accessory user interface object on the user interface, wherein the first accessory user interface object corresponds to a first accessory of the home automation system associated with the first context of the first selectable category option; a second accessory user interface object on the user interface, wherein the second accessory user interface object corresponds to a second accessory of the home automation system associated with the first context of the first selectable category option; and a first selectable subcategory option, the first selectable subcategory option corresponding to a subcategory of the category associated with the first selectable category option, wherein the first selectable subcategory option includes a status indication related to one or more accessories of the home automation system associated with the subcategory.

[0014] According to some embodiments, a method is described. The method is performed at a computer system in communication with one or more input devices and a display generation component. The method includes: receiving a request to display a user interface of a home automation system via the one or more input devices; in response to receiving the request to display the user interface of the home automation system, displaying the user interface of the home automation system including two or more representations of scenes associated with one or more corresponding devices of the home automation system via the display generation component, wherein: based on determining a first relative priority of the scenes indicated by a set of one or more recommended criteria, the two or more representations of the scenes are displayed in a first arrangement on the user interface of the home automation system; and based on determining a second relative priority different from the first relative priority of the scenes indicated by the set of one or more recommended criteria, the two or more representations of the scenes are displayed in a second arrangement different from the first arrangement on the user interface of the home automation system; and after displaying the user interface of the home automation system including the two or more representations of the scenes: based on determining a change in the relative priority of the scenes indicated by the set of one or more recommended criteria, the user interface of the home automation system is displayed as having the two or more representations of the scenes in a third arrangement on the user interface of the home automation system.

[0015] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for the following operations: receiving a request to display a user interface of a home automation system via the one or more input devices; in response to receiving the request to display the user interface of the home automation system, displaying the user interface of the home automation system including two or more representations of scenes associated with one or more corresponding devices of the home automation system via the display generation component, wherein: according to determining a first relative priority of the scenes in a set of one or more recommended criteria, the first relative priority of the scenes in the home automation system is displayed; displaying the two or more representations of the scenes in a first arrangement on the user interface of the home automation system; and displaying the two or more representations of the scenes in a second arrangement different from the first arrangement on the user interface of the home automation system based on determining that the set of one or more recommended criteria indicates a second relative priority of the scenes different from the first relative priority; and after displaying the user interface of the home automation system including the two or more representations of the scenes: displaying the user interface of the home automation system to have the two or more representations of the scenes in a third arrangement on the user interface of the home automation system based on determining that the set of one or more recommended criteria indicates a change in the relative priorities of the scenes.

[0016] According to some embodiments, a transitory computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices and a display generation component, the one or more programs including instructions for: receiving a request to display a user interface of a home automation system via the one or more input devices; in response to receiving the request to display the user interface of the home automation system, displaying, via the display generation component, the user interface of the home automation system including two or more representations of scenes associated with one or more corresponding devices of the home automation system, wherein: based on determining a first relative priority of the scenes indicated by a set of one or more recommended criteria, the two or more representations of the scenes are displayed in a first arrangement on the user interface of the home automation system; and based on determining a second relative priority of the scenes indicated by the set of one or more recommended criteria that is different from the first relative priority, the two or more representations of the scenes are displayed in a second arrangement different from the first arrangement on the user interface of the home automation system; and after displaying the user interface of the home automation system including the two or more representations of the scenes: based on determining a change in the relative priority of the scenes indicated by the set of one or more recommended criteria, the user interface of the home automation system is displayed to have the two or more representations of the scenes in a third arrangement on the user interface of the home automation system.

[0017] According to some embodiments, a computer system is described that is in communication with one or more input devices and a display generation component. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: receiving a request to display a user interface of a home automation system via the one or more input devices; in response to receiving the request to display the user interface of the home automation system, displaying the user interface of the home automation system including two or more representations of scenes associated with one or more corresponding devices of the home automation system via the display generation component, wherein: based on determining a first relative priority of the scenes indicated by a set of one or more recommended criteria, the two or more representations of the scenes are displayed in a first arrangement on the user interface of the home automation system; and based on determining a second relative priority of the scenes indicated by the set of one or more recommended criteria that is different from the first relative priority, the two or more representations of the scenes are displayed in a second arrangement different from the first arrangement on the user interface of the home automation system; and after displaying the user interface of the home automation system including the two or more representations of the scenes: based on determining a change in the relative priority of the scenes indicated by the set of one or more recommended criteria, the user interface of the home automation system is displayed as having the two or more representations of the scenes in a third arrangement on the user interface of the home automation system.

[0018] According to some embodiments, a computer system is described that is in communication with one or more input devices and a display generation component. The computer system includes: an apparatus for: receiving a request to display a user interface of a home automation system via the one or more input devices; an apparatus for: in response to receiving the request to display the user interface of the home automation system, displaying the user interface of the home automation system including two or more representations of scenes associated with one or more corresponding devices of the home automation system via the display generation component, wherein: based on determining a first relative priority of the scenes indicated by a set of one or more recommended criteria, the two or more representations of the scenes are displayed in a first arrangement on the user interface of the home automation system; and based on determining a second relative priority of the scenes indicated by the set of one or more recommended criteria that is different from the first relative priority, the two or more representations of the scenes are displayed in a second arrangement different from the first arrangement on the user interface of the home automation system; and an apparatus for: after displaying the user interface of the home automation system including the two or more representations of the scenes: based on determining a change in the relative priority of the scenes indicated by the set of one or more recommended criteria, displaying the user interface of the home automation system as having the two or more representations of the scenes in a third arrangement on the user interface of the home automation system.

[0019] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices and a display generation component, the one or more programs including instructions for: receiving a request to display a user interface of a home automation system via the one or more input devices; in response to receiving the request to display the user interface of the home automation system, displaying the user interface of the home automation system including two or more representations of scenes associated with one or more corresponding devices of the home automation system via the display generation component, wherein: based on determining a first relative priority of the scenes indicated by a set of one or more recommended criteria, the two or more representations of the scenes are displayed in a first arrangement on the user interface of the home automation system; and based on determining a second relative priority of the scenes indicated by the set of one or more recommended criteria that is different from the first relative priority, the two or more representations of the scenes are displayed in a second arrangement different from the first arrangement on the user interface of the home automation system; and after displaying the user interface of the home automation system including the two or more representations of the scenes: based on determining a change in the relative priority of the scenes indicated by the set of one or more recommended criteria, the user interface of the home automation system is displayed to have the two or more representations of the scenes in a third arrangement on the user interface of the home automation system.

[0020] According to some embodiments, a method is described. The method is performed at a computer system in communication with one or more input devices and a display generation component. The method includes: when displaying a user interface associated with a home automation system including a first accessory via the display generating component, receiving a set of one or more user inputs including a request to associate a second accessory with the home automation system via the one or more input devices; and in response to receiving the set of one or more user inputs including the request to associate the second accessory with the home automation system: based on determining that the second accessory meets a set of one or more criteria: grouping the first accessory and the second accessory into an accessory group so that the first accessory and the second accessory operate in conjunction with each other, and wherein the accessory group is configured to include the first accessory and the second accessory until a request to remove the first accessory and / or the second accessory from the accessory group is received; and displaying an accessory group user interface object corresponding to the accessory group on the user interface via the display generating component without displaying a first user interface object corresponding to the first accessory that is different from the accessory group user interface object, and without displaying a second user interface object corresponding to the second accessory that is different from the accessory group user interface object; and based on determining that the second accessory does not meet the set of one or more criteria, associating the second accessory with the home automation system without grouping the first accessory and the second accessory into the accessory group.

[0021] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for the following operations: when a user interface associated with a home automation system including a first accessory is displayed via the display generation component, receiving a set of one or more user inputs including a request to associate a second accessory with the home automation system via the one or more input devices; and in response to receiving the set of one or more user inputs including a request to associate the second accessory with the home automation system: based on determining that the second accessory meets a set of one or more criteria: grouping the first accessory and the second accessory into an accessory group, so that The first accessory and the second accessory operate in conjunction with each other, and wherein the accessory group is configured to include the first accessory and the second accessory until a request to remove the first accessory and / or the second accessory from the accessory group is received; and an accessory group user interface object corresponding to the accessory group is displayed on the user interface via the display generating component, without displaying a first user interface object corresponding to the first accessory that is different from the accessory group user interface object, and without displaying a second user interface object corresponding to the second accessory that is different from the accessory group user interface object; and based on determining that the second accessory does not meet one or more criteria of the group, the second accessory is associated with the home automation system without grouping the first accessory and the second accessory into the accessory group.

[0022] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for the following operations: when displaying a user interface associated with a home automation system including a first accessory via the display generation component, receiving a set of one or more user inputs including a request to associate a second accessory with the home automation system via the one or more input devices; and in response to receiving the set of one or more user inputs including a request to associate the second accessory with the home automation system: based on determining that the second accessory satisfies a set of one or more criteria: grouping the first accessory and the second accessory into an accessory group such that The first accessory and the second accessory operate in conjunction with each other, and wherein the accessory group is configured to include the first accessory and the second accessory until a request to remove the first accessory and / or the second accessory from the accessory group is received; and an accessory group user interface object corresponding to the accessory group is displayed on the user interface via the display generating component, without displaying a first user interface object corresponding to the first accessory that is different from the accessory group user interface object, and without displaying a second user interface object corresponding to the second accessory that is different from the accessory group user interface object; and based on determining that the second accessory does not meet one or more criteria of the group, the second accessory is associated with the home automation system without grouping the first accessory and the second accessory into the accessory group.

[0023] According to some embodiments, a computer system is described. The computer system communicates with one or more input devices and a display generation component. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: when a user interface associated with a home automation system including a first accessory is displayed via the display generation component, a set of one or more user inputs including a request to associate a second accessory with the home automation system is received via the one or more input devices; and in response to receiving the set of one or more user inputs including a request to associate the second accessory with the home automation system: based on determining that the second accessory meets a set of one or more criteria: grouping the first accessory and the second accessory into an accessory group so that the first accessory and the second accessory operate in conjunction with each other, and wherein the accessory group is configured to include the first accessory and the second accessory until a request to remove the first accessory and / or the second accessory from the accessory group is received; and an accessory group user interface object corresponding to the accessory group is displayed on the user interface via the display generating component, without displaying a first user interface object corresponding to the first accessory that is different from the accessory group user interface object, and without displaying a second user interface object corresponding to the second accessory that is different from the accessory group user interface object; and based on determining that the second accessory does not meet one or more criteria of the group, the second accessory is associated with the home automation system without grouping the first accessory and the second accessory into the accessory group.

[0024] According to some embodiments, a computer system is described. The computer system communicates with one or more input devices and a display generation component. The computer system includes: a device for performing the following operations: when a user interface associated with a home automation system including a first accessory is displayed via the display generation component, receiving a set of one or more user inputs including a request to associate a second accessory with the home automation system via the one or more input devices; and a device for performing the following operations: in response to receiving the set of one or more user inputs including a request to associate the second accessory with the home automation system: based on determining that the second accessory meets a set of one or more criteria: grouping the first accessory and the second accessory into an accessory group so that the first accessory and the second accessory operate in conjunction with each other, and wherein the accessory group is Configured to include the first accessory and the second accessory until a request to remove the first accessory and / or the second accessory from the accessory group is received; and displaying the accessory group user interface object corresponding to the accessory group on the user interface via the display generating component, without displaying the first user interface object corresponding to the first accessory that is different from the accessory group user interface object, and without displaying the second user interface object corresponding to the second accessory that is different from the accessory group user interface object; and based on determining that the second accessory does not meet one or more criteria of the group, associating the second accessory with the home automation system without grouping the first accessory and the second accessory into the accessory group.

[0025] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for the following operations: when a user interface associated with a home automation system including a first accessory is displayed via the display generation component, receiving a set of one or more user inputs including a request to associate a second accessory with the home automation system via the one or more input devices; and in response to receiving the set of one or more user inputs including a request to associate the second accessory with the home automation system: based on determining that the second accessory meets a set of one or more criteria: grouping the first accessory and the second accessory into an accessory group such that the first accessory and the second accessory meet a set of one or more criteria; An accessory and a second accessory operate in conjunction with each other, and wherein the accessory group is configured to include the first accessory and the second accessory until a request to remove the first accessory and / or the second accessory from the accessory group is received; and an accessory group user interface object corresponding to the accessory group is displayed on the user interface via the display generating component, without displaying a first user interface object corresponding to the first accessory that is different from the accessory group user interface object, and without displaying a second user interface object corresponding to the second accessory that is different from the accessory group user interface object; and based on determining that the second accessory does not meet one or more criteria of the group, the second accessory is associated with the home automation system without grouping the first accessory and the second accessory into the accessory group.

[0026] According to some embodiments, a method is described. The method is performed at a computer system in communication with one or more input devices and a display generation component. The method includes: displaying a user interface of an application associated with multiple camera accessories via the display generation component, wherein the user interface of the application includes an arrangement of camera tiles corresponding to the multiple cameras, the arrangement of camera tiles including: a first camera tile having a first size, the first camera tile being displayed at a first location on the user interface of the application; and a second camera tile having a second size different from the first size, the second camera tile being displayed at a second location different from the first location on the user interface of the application; when displaying the user interface, receiving user input corresponding to the first camera tile via the one or more input devices; and in response to receiving the user input corresponding to the first camera tile: displaying the first camera tile at a third location different from the first location; and displaying the first camera tile at the second size.

[0027] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for the following operations: displaying, via the display generation component, a user interface of an application associated with multiple camera accessories, wherein the user interface of the application includes an arrangement of camera tiles corresponding to the multiple cameras, the arrangement of camera tiles including: a first camera tile having a first size, the first camera tile being displayed at a first location on the user interface of the application; and a second camera tile having a second size different from the first size, the second camera tile being displayed at a second location different from the first location on the user interface of the application; when displaying the user interface, receiving user input corresponding to the first camera tile via the one or more input devices; and in response to receiving the user input corresponding to the first camera tile: displaying the first camera tile at a third location different from the first location; and displaying the first camera tile at the second size.

[0028] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for the following operations: displaying, via the display generation component, a user interface of an application associated with multiple camera accessories, wherein the user interface of the application includes an arrangement of camera tiles corresponding to the multiple cameras, the arrangement of camera tiles including: a first camera tile having a first size, the first camera tile being displayed at a first location on the user interface of the application; and a second camera tile having a second size different from the first size, the second camera tile being displayed at a second location on the user interface of the application different from the first location; when displaying the user interface, receiving, via the one or more input devices, user input corresponding to the first camera tile; and in response to receiving the user input corresponding to the first camera tile: displaying the first camera tile at a third location different from the first location; and displaying the first camera tile at the second size.

[0029] According to some embodiments, a computer system is described. The computer system communicates with one or more input devices and a display generation component. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: displaying a user interface of an application associated with multiple camera accessories via the display generation component, wherein the user interface of the application includes an arrangement of camera tiles corresponding to the multiple cameras, the arrangement of camera tiles including: a first camera tile having a first size, the first camera tile being displayed at a first position on the user interface of the application; and a second camera tile having a second size different from the first size, the second camera tile being displayed at a second position different from the first position on the user interface of the application; when displaying the user interface, receiving user input corresponding to the first camera tile via the one or more input devices; and in response to receiving the user input corresponding to the first camera tile: displaying the first camera tile at a third position different from the first position; and displaying the first camera tile at the second size.

[0030] According to some embodiments, a computer system is described. The computer system communicates with one or more input devices and a display generation component. The computer system includes: a device for performing the following operations: displaying a user interface of an application associated with multiple camera accessories via the display generation component, wherein the user interface of the application includes an arrangement of camera tiles corresponding to the multiple cameras, the arrangement of camera tiles including: a first camera tile having a first size, the first camera tile being displayed at a first location on the user interface of the application; and a second camera tile having a second size different from the first size, the second camera tile being displayed at a second location different from the first location on the user interface of the application; a device for performing the following operations: when displaying the user interface, receiving user input corresponding to the first camera tile via the one or more input devices; and a device for performing the following operations: in response to receiving the user input corresponding to the first camera tile: displaying the first camera tile at a third location different from the first location; and displaying the first camera tile at the second size.

[0031] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for: displaying, via the display generation component, a user interface of an application associated with multiple camera accessories, wherein the user interface of the application includes an arrangement of camera tiles corresponding to the multiple cameras, the arrangement of camera tiles including: a first camera tile having a first size, the first camera tile being displayed at a first location on the user interface of the application; and a second camera tile having a second size different from the first size, the second camera tile being displayed at a second location on the user interface of the application different from the first location; while displaying the user interface, receiving, via the one or more input devices, user input corresponding to the first camera tile; and in response to receiving the user input corresponding to the first camera tile: displaying the first camera tile at a third location different from the first location; and displaying the first camera tile at the second size.

[0032] According to some embodiments, a method is described. The method is performed at a computer system in communication with one or more input devices and a display generation component. The method includes: displaying a user interface of an application associated with multiple accessories via the display generation component, wherein the user interface of the application includes: a first area, the first area including one or more first accessory user interface objects in a first arrangement, wherein the one or more first accessory user interface objects correspond to one or more first accessories associated with a first context in the multiple accessories, and wherein the one or more first accessory user interface objects include a second accessory user interface object displayed at a first size; when displaying the user interface of the application and when the computer system is in an edit operation mode, receiving user input corresponding to the second accessory user interface object in the one or more first accessory user interface objects; and in response to receiving the user input: based on determining that the user input is a first type, displaying the one or more first accessory user interface objects in a second arrangement different from the first arrangement; and based on determining that the user input is a second type different from the first type, displaying the second accessory user interface object in a second size different from the first size.

[0033] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for: displaying, via the display generation component, a user interface of an application associated with a plurality of accessories, wherein the user interface of the application comprises: a first area comprising one or more first accessory user interface objects in a first arrangement, wherein the one or more first accessory user interface objects correspond to one or more first accessories in the plurality of accessories associated with a first context, and wherein the one or more first accessory user interface objects include a second accessory user interface object displayed at a first size; while displaying the user interface of the application and when the computer system is in an edit operation mode, receiving user input corresponding to the second accessory user interface object of the one or more first accessory user interface objects; and in response to receiving the user input: based on determining that the user input is of a first type, displaying the one or more first accessory user interface objects in a second arrangement different from the first arrangement; and based on determining that the user input is of a second type different from the first type, displaying the second accessory user interface object at a second size different from the first size.

[0034] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for: displaying, via the display generation component, a user interface of an application associated with a plurality of accessories, wherein the user interface of the application comprises: a first area comprising one or more first accessory user interface objects in a first arrangement, wherein the one or more first accessory user interface objects correspond to one or more first accessories in the plurality of accessories associated with a first context, and wherein the one or more first accessory user interface objects include a second accessory user interface object displayed at a first size; while displaying the user interface of the application and when the computer system is in an edit operation mode, receiving user input corresponding to the second accessory user interface object of the one or more first accessory user interface objects; and in response to receiving the user input: based on determining that the user input is of a first type, displaying the one or more first accessory user interface objects in a second arrangement different from the first arrangement; and based on determining that the user input is of a second type different from the first type, displaying the second accessory user interface object at a second size different from the first size.

[0035] According to some embodiments, a computer system is described. The computer system communicates with one or more input devices and a display generation component. The computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for the following operations: displaying, via the display generation component, a user interface of an application associated with a plurality of accessories, wherein the user interface of the application includes: a first area, the first area including one or more first accessory user interface objects in a first arrangement, wherein the one or more first accessory user interface objects correspond to one or more first accessories in the plurality of accessories associated with a first context, and wherein the one or more first accessory user interface objects include a second accessory user interface object displayed at a first size; while displaying the user interface of the application and when the computer system is in an edit operation mode, receiving user input corresponding to the second accessory user interface object in the one or more first accessory user interface objects; and in response to receiving the user input: based on determining that the user input is of a first type, displaying the one or more first accessory user interface objects in a second arrangement different from the first arrangement; and based on determining that the user input is of a second type different from the first type, displaying the second accessory user interface object at a second size different from the first size.

[0036] According to some embodiments, a computer system is described. The computer system communicates with one or more input devices and a display generation component. The computer system includes instructions for: displaying, via the display generation component, a user interface of an application associated with a plurality of accessories, wherein the user interface of the application includes: a first area, the first area including one or more first accessory user interface objects in a first arrangement, wherein the one or more first accessory user interface objects correspond to one or more first accessories in the plurality of accessories associated with a first context, and wherein the one or more first accessory user interface objects include a second accessory user interface object displayed at a first size; means for: receiving user input corresponding to the second accessory user interface object in the one or more first accessory user interface objects while displaying the user interface of the application and when the computer system is in an edit operation mode; and means for: in response to receiving the user input: displaying the one or more first accessory user interface objects in a second arrangement different from the first arrangement based on determining that the user input is of a first type; and displaying the second accessory user interface object in a second size different from the first size based on determining that the user input is of a second type different from the first type.

[0037] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more input devices and a display generation component, the one or more programs including instructions for: displaying, via the display generation component, a user interface of an application associated with a plurality of accessories, wherein the user interface of the application includes: a first area including one or more first accessory user interface objects in a first arrangement, wherein the one or more first accessory user interface objects correspond to one or more first accessories in the plurality of accessories associated with a first context, and wherein the one or more first accessory user interface objects include a second accessory user interface object displayed at a first size; while displaying the user interface of the application and when the computer system is in an edit operation mode, receiving user input corresponding to the second accessory user interface object of the one or more first accessory user interface objects; and in response to receiving the user input: based on determining that the user input is of a first type, displaying the one or more first accessory user interface objects in a second arrangement different from the first arrangement; and based on determining that the user input is of a second type different from the first type, displaying the second accessory user interface object at a second size different from the first size.

[0038] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are optionally included in a transient computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0039] Thus, devices are provided with a faster, more efficient method and interface for managing accessories, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices.Such methods and interfaces can supplement or replace other methods for managing accessories. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0041] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.

[0042] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.

[0043] Figure 2A portable multifunction device with a touch screen according to some embodiments is illustrated.

[0044] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0045] Figure 4A An exemplary user interface for a menu of applications on a portable multifunction device according to some embodiments is illustrated.

[0046] Figure 4B An exemplary user interface for a multifunction device having a touch-sensitive surface separate from the display is illustrated according to some embodiments.

[0047] Figure 5A A personal electronic device according to some embodiments is illustrated.

[0048] Figure 5B is a block diagram illustrating a personal electronic device according to some embodiments.

[0049] Figures 6A to 6R Illustrated are example user interfaces for managing accessories for a home automation system according to some embodiments.

[0050] Figures 7A to 7G is a flow chart illustrating a method for managing accessories for a home automation system according to some embodiments.

[0051] Figures 8A to 8P Illustrated are exemplary user interfaces for managing accessory groups according to some embodiments.

[0052] Figures 9A to 9C is a flow chart illustrating a method for managing accessory groups according to some embodiments.

[0053] Figures 10A to 10AA Illustrated are exemplary user interfaces for managing speaker accessories according to some embodiments.

[0054] Figures 11A to 11G is a flowchart illustrating a method for managing speaker accessories according to some embodiments.

[0055] 12A to 12I Illustrated are exemplary user interfaces for managing camera accessories according to some embodiments.

[0056] 13A to 13C is a flow chart illustrating a method for managing camera accessories according to some embodiments.

[0057] Figures 14A to 14M An exemplary user interface for displaying an accessory user interface object according to some embodiments is illustrated.

[0058] 15A to 15D is a flowchart illustrating a method for displaying an accessory user interface object according to some embodiments. DETAILED DESCRIPTION

[0059] The following description sets forth exemplary methods, parameters, etc. However, it should be recognized that such description is not intended to limit the scope of the present disclosure, but is provided as a description of exemplary embodiments.

[0060] There is a need for electronic devices that provide efficient methods and interfaces for managing accessories. For example, there is a need for electronic devices that provide displayed groups of accessories and / or devices associated with corresponding categories and / or subcategories of a home automation system. There is also a need for electronic devices that recommend and / or predict adjustments to the status of one or more accessories. In addition, there is a need for electronic devices that group two or more accessories into an infinitely persistent accessory group. In addition, there is a need for electronic devices that facilitate the ability for a user to rearrange and / or resize the display of accessory user interface objects and / or camera user interface objects. Such techniques can reduce the cognitive burden on a user managing accessories, thereby increasing productivity. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0061] under Figure 1A to Figure 1B 、 Figure 2 、 Figure 3 、 Figures 4A to 4B and Figures 5A to 5B A description of an example device for performing techniques for managing accessories is provided. Figures 6A to 6R An exemplary user interface for managing accessories of a home automation system is illustrated. Figures 7A to 7G is a flow chart illustrating a method of managing accessories for a home automation system according to some embodiments. Figures 6A to 6R The user interface in the example is used to illustrate the process described below, including Figures 7A to 7G in the process. Figures 8A to 8P An exemplary user interface for managing accessory groups is illustrated. Figures 9A to 9C is a flow chart illustrating a method of managing accessory groups according to some embodiments. Figures 8A to 8P The user interface in the example is used to illustrate the process described below, including 9A to 9C in the process. Figures 10A to 10AA An exemplary user interface for managing a speaker accessory is illustrated. Figures 11A to 11G is a flowchart illustrating a method of managing speaker accessories according to some embodiments. Figures 10A to 10AA The user interface in the example is used to illustrate the process described below, including Figures 11A to 11G in the process. 12A to 12I An exemplary user interface for managing a camera accessory is illustrated. 13A to 13Cis a flow chart illustrating a method of managing a camera accessory according to some embodiments.

[0062] 12A to 12I The user interface in the example is used to illustrate the process described below, including 13A to 13C in the process. Figures 14A to 14M An exemplary user interface for displaying an accessory user interface object is illustrated. 15A to 15D is a flowchart illustrating a method for displaying an accessory user interface object according to some embodiments. Figures 14A to 14M The user interface in the example is used to illustrate the process described below, including 15A to 15D in the process.

[0063] The processes described below enhance the operability of the device and make the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device) through various techniques, including providing improved visual feedback to the user, reducing the number of inputs required to perform an operation, providing additional control options without cluttering the user interface with additional display controls, performing an operation without further user input when a set of conditions have been met, and / or additional techniques. These techniques also reduce power usage and extend the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0064] In addition, in the method described herein where one or more steps depend on having met one or more conditions, it should be understood that the method can be repeated in multiple repetitions so that in the process of repetition, all conditions of the steps in the method of determining the method have been met in different repetitions of the method. For example, if the method needs to perform the first step (if the condition is met), and perform the second step (if the condition is not met), then those of ordinary skill will know that the steps stated are repeated until both the condition is met and the condition is not met (in no particular order). Therefore, the method described as having one or more steps depending on having met one or more conditions can be rewritten as a method of repeating until each condition described in the method is met. However, this does not require a system or computer-readable medium to declare that the system or computer-readable medium includes instructions for performing a contingent operation based on the satisfaction of the corresponding one or more conditions, and is therefore able to determine whether a possible situation has been met without explicitly repeating the steps of the method until all conditions of the steps in the method of determining the method have been met. Those of ordinary skill in the art will also understand that, similar to the method with a contingent step, a system or computer-readable storage medium can repeat the steps of the method as needed multiple times to ensure that all contingent steps have been performed.

[0065] Although the following description uses the terms "first," "second," etc. to describe various elements, these elements should not be limited by the terms. In some embodiments, these terms are used to distinguish one element from another. For example, a first touch can be named a second touch and similarly, a second touch can be named a first touch without departing from the scope of the various described embodiments. In some embodiments, the first touch and the second touch are two separate references to the same touch. In some embodiments, both the first touch and the second touch are touches, but they are not the same touch.

[0066] The terms used in the description of the various described embodiments herein are only for the purpose of describing specific embodiments and are not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms "a" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the terms "and / or" used herein refer to and encompass any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "comprises" and / or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their groupings.

[0067] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that," or "if [stated condition or event] is detected" are optionally interpreted to mean "upon determining," or "in response to determining," or "upon detecting [stated condition or event]," or "in response to detecting [stated condition or event]," depending on the context.

[0068] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or music player functions. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc. (Cupertino, California). Devices, iPod Equipment and Device. Optionally, other portable electronic devices are used, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touchpads). In some embodiments, the electronic device is a computer system that communicates with the display generation component (e.g., via wireless communication, via wired communication). The display generation component is configured to provide visual output, such as display via a CRT display, display via an LED display, or display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separated from the computer system. As used herein, "display" content includes transmitting data (e.g., image data or video data) to an integrated or external display generation component via a wired or wireless connection to visually generate content to display content (e.g., video data rendered or decoded by display controller 156).

[0069] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.

[0070] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a rendering application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0071] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports various applications with a user interface that is intuitive and clear to the user.

[0072] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1Ais a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. Touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a "touch-sensitive display system." Device 100 includes memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and external ports 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact force sensors 165 for detecting the intensity of contacts on device 100 (e.g., a touch-sensitive surface, such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0073] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, the force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface near the contact and / or its change, and / or the resistance of the touch-sensitive surface near the contact and / or its change are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the surrogate measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the surrogate measurement). In some embodiments, the surrogate measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functionality that would otherwise be inaccessible to the user on a smaller device with limited real estate, which is used to display an indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0074] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of a device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device that will be detected by a user using the user's sense of touch. For example, when a device or a component of the device is in contact with a surface that is touch-sensitive to a user (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation that corresponds to a perceived change in a physical property of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" on a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click," even when the physical actuation button associated with the touch-sensitive surface that was physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when the smoothness of the touch-sensitive surface does not change, movement of the touch-sensitive surface may optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. While such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.

[0075] It should be understood that device 100 is merely one example of a portable multifunction device and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application specific integrated circuits.

[0076] Memory 102 optionally includes high-speed random access memory and optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0077] The peripheral device interface 118 can be used to couple the input peripheral devices and output peripheral devices of the device to the CPU 120 and the memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data. In some embodiments, the peripheral device interface 118, the CPU 120, and the memory controller 122 are optionally implemented on a single chip such as the chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0078] RF (radio frequency) circuitry 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuitry 108 converts electrical signals into / from electromagnetic signals and communicates with a communication network and other communication devices via the electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, memory, and the like. RF circuitry 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuitry 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via a short-range communication radio. The wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution, Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11d), IEEE 802.11e, IEEE 802.11f, IEEE 802.11g, IEEE 802.11g), IEEE 802.11f, IEEE 802.11g ... 11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)) and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.

[0079] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).

[0080] The I / O subsystem 106 couples input / output peripherals on the device 100, such as the touch screen 112 and other input control devices 116, to a peripherals interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some embodiments, the input controller 160 is optionally coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an up / down button for volume control of the speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2206 in). In some embodiments, the electronic device is a computer system that communicates (e.g., via wireless communication, via wired communication) with one or more input devices. In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking a user's gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system. In some embodiments, an air gesture is a gesture that is detected without the user touching an input element that is part of the device (or independent of an input element that is part of the device) and is based on detected movement of a part of the user's body through the air, including movement of the user's body relative to an absolute reference (for example, the angle of the user's arm relative to the ground or the distance of the user's hand relative to the ground), movement relative to another part of the user's body (for example, movement of the user's hand relative to the user's shoulder, movement of one of the user's hands relative to the user's other hand, and / or movement of the user's fingers relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (for example, a tap gesture involving movement of the hand in a predetermined position by a predetermined amount and / or speed, or a shake gesture involving a predetermined speed or amount of rotation of a part of the user's body).

[0081] A quick press of the push button optionally releases the lock on the touch screen 112 or optionally initiates the process of unlocking the device using gestures on the touch screen, as described in U.S. patent application Ser. No. 11 / 322,549, filed Dec. 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," (i.e., U.S. Pat. No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functions of one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0082] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0083] The touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from the user based on tactile and / or haptic contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact on the touch screen 112 (and any movement or interruption of that contact) and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0084] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the Apple ® Touch Controller from Apple Inc. (Cupertino, California). and iPod The technology used in

[0085] The touch-sensitive display in some embodiments of the touch screen 112 is optionally similar to the multi-touch-sensitive touchpads described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays visual output from the device 100, whereas a touch-sensitive touchpad does not provide visual output.

[0086] The touch-sensitive display in some embodiments of the touch screen 112 is described in the following applications: (1) U.S. patent application No. 11 / 381,313, filed on May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. patent application No. 10 / 840,862, filed on May 6, 2004, “Multipoint Touchscreen”; (3) U.S. patent application No. 10 / 903,964, filed on July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. patent application No. 11 / 048,264, filed on January 31, 2005, “Gestures For Touch Sensitive Input Devices”; (5) U.S. patent application No. 11 / 038,590, filed on January 18, 2005, “Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices”; (6) U.S. patent application Ser. No. 11 / 228,758, filed Sep. 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. patent application Ser. No. 11 / 228,700, filed Sep. 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. patent application Ser. No. 11 / 228,737, filed Sep. 16, 2005, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. patent application Ser. No. 11 / 367,749, filed Mar. 3, 2006, “Multi-Functional Hand-Held Device”. All of these applications are incorporated herein by reference in their entirety.

[0087] The touch screen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or appendage, such as a stylus, a finger, or the like, to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​a finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positioning or commands for performing the actions desired by the user.

[0088] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0089] Device 100 also includes a power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power fault detection circuitry, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0090] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor is shown coupled to the optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, facing away from the touchscreen display 112 on the front of the device, enabling the touchscreen display to be used as a viewfinder for still and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing the user to optionally capture an image of the user for video conferencing while viewing other video conference participants on the touchscreen display. In some embodiments, the positioning of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing), allowing a single optical sensor 164 to be used with the touchscreen display for both video conferencing and still and / or video image acquisition.

[0091] Device 100 optionally also includes one or more depth camera sensors 175 . Figure 1A A depth camera sensor is shown coupled to a depth camera controller 169 in the I / O subsystem 106. The depth camera sensor 175 receives data from the environment to create a three-dimensional model of objects (e.g., faces) within the scene from a viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with the imaging module 143 (also referred to as a camera module), the depth camera sensor 175 is optionally used to determine depth maps for different portions of an image captured by the imaging module 143. In some embodiments, the depth camera sensor is located on the front of the device 100, enabling the user to optionally capture an image of the user with depth information for video conferencing while viewing other video conference participants on the touchscreen display, and to capture selfies with depth map data. In some embodiments, the depth camera sensor 175 is located on the rear of the device, or on both the rear and front of the device 100. In some embodiments, the positioning of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor in the device housing), enabling the depth camera sensor 175 to be used in conjunction with the touchscreen display for both video conferencing and still and / or video image acquisition.

[0092] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1AA contact force sensor is shown coupled to force sensor controller 159 in I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of a contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100, opposite touch screen display 112 located on the front of device 100.

[0093] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1A A proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 is optionally implemented as described in the following U.S. patent application serial numbers: 11 / 241,839, entitled “Proximity Detector In Handheld Device”; 11 / 240,788, entitled “Proximity Detector In Handheld Device”; 11 / 620,702, entitled “Using Ambient Light Sensor To Augment Proximity Sensor Output”; 11 / 586,862, entitled “Automated Response To And Sensing Of User Activity In Portable Devices”; and 11 / 638,251, entitled “Methods And Systems For Automatic Configuration Of Peripherals,” which are hereby incorporated by reference in their entireties. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch screen 112.

[0094] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1AA tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components for converting electrical signals into tactile outputs on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates tactile outputs on the device 100 that can be felt by the user of the device 100. In some embodiments, at least one tactile output generator is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112) and optionally generates tactile outputs by moving the touch-sensitive surface vertically (e.g., inward / outward toward the surface of the device 100) or laterally (e.g., back and forth in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.

[0095] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripherals interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 optionally implements as described in the following U.S. Patent Publication Nos. 20050190059, entitled “Acceleration-based Theft Detection System for Portable Electronic Devices” and 20060017692, entitled “Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer,” both of which are incorporated herein by reference in their entireties. In some embodiments, information is displayed on the touch screen display in a portrait view or a landscape view based on analysis of data received from one or more accelerometers. The device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver in addition to the accelerometer 168 for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.

[0096] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) storage device / global internal state 157, such as Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: active application state, which indicates which application, if any, is currently active; display state, which indicates what applications, views, or other information occupy various areas of the touch screen display 112; sensor state, which includes information obtained from the device's various sensors and input control devices 116; and position information relating to the device's position and / or posture.

[0097] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitating communication between various hardware components and software components.

[0098] The communication module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are suitable for coupling directly to other devices or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external ports are connected to (trademark of Apple Inc.) devices.

[0099] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger down event), determining the strength of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there has been movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has ceased (e.g., detecting a finger up event or contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single-finger contact) or multiple points of contact simultaneously (e.g., "multi-touch" / multiple-finger contact). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on the touchpad.

[0100] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, a mouse "click" threshold for a touchpad or touchscreen can be set to any one of a large range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0101] Contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Thus, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.

[0102] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0103] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes specifying the graphics to be displayed from an application or the like, along with coordinate data and other graphic attribute data if necessary, and then generates screen image data for output to the display controller 156.

[0104] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0105] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (eg, contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0106] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services, such as a weather widget, a local yellow pages widget, and a map / navigation widget).

[0107] Application 136 optionally includes the following modules (or instruction sets), or a subset or superset thereof:

[0108] ● Contacts module 137 (sometimes called address book or contact list);

[0109] ● Telephone module 138;

[0110] ● Video conferencing module 139;

[0111] ● Email client module 140;

[0112] Instant messaging (IM) module 141;

[0113] ●Fitness support module 142;

[0114] A camera module 143 for still and / or video images;

[0115] Image management module 144;

[0116] ●Video player module;

[0117] Music player module;

[0118] ●Browser module 147;

[0119] ●Calendar module 148;

[0120] A widget module 149 , which optionally includes one or more of the following: a weather widget 149 - 1 , a stock market widget 149 - 2 , a calculator widget 149 - 3 , an alarm clock widget 149 - 4 , a dictionary widget 149 - 5 , and other widgets acquired by the user, and a user-created widget 149 - 6 ;

[0121] A widget creator module 150 for forming user-created widgets 149-6;

[0122] ●Search module 151;

[0123] ● Video and music player module 152, which merges the video player module and the music player module;

[0124] ●Note module 153;

[0125] ● Map module 154; and / or

[0126] ●Online video module 155.

[0127] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0128] In combination with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132 and text input module 134, the contacts module 137 is optionally used to manage an address book or contact list (for example, stored in the application internal state 192 of the contacts module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140 or IM 141; and so on.

[0129] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a character sequence corresponding to a phone number, access one or more phone numbers in contacts module 137, modify an entered phone number, dial the corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is complete. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0130] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0131] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0132] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for entering a character sequence corresponding to an instant message, modifying previously entered characters, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0133] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154, and the music player module, the fitness support module 142 includes executable instructions for creating a workout (e.g., with time, distance, and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for a workout; and displaying, storing, and transmitting fitness data.

[0134] In combination with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.

[0135] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0136] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching for, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0137] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing a calendar and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.

[0138] In conjunction with the RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, the widget module 149 is a mini-application that is optionally downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or created by a user (e.g., user-created widget 149-6). In some embodiments, a widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, a widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., a Yahoo! widget).

[0139] In combination with the RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, the widget creator module 150 is optionally used by a user to create widgets (e.g., converting a user-specified portion of a web page into a widget).

[0140] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0141] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0142] In conjunction with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the note module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.

[0143] In combination with the RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 is optionally used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data relating to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0144] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for allowing a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on the touch screen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send links to specific online videos. Additional descriptions of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.

[0145] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as independent software programs (such as computer programs (e.g., including instructions)), processes, or modules, and therefore various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1A In some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.

[0146] In some embodiments, device 100 is a device where operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touchpad. By using a touch screen and / or a touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on device 100 is optionally reduced.

[0147] A predefined set of functions that are exclusively performed through the touch screen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, home menu, or root menu. In such embodiments, the touchpad is used to implement a "menu button." In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touchpad.

[0148] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0149] Event classifier 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information is to be delivered. Event classifier 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0150] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by application 136-1, a state queue for enabling the user to return to a previous state or view of application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0151] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about sub-events (e.g., a user touch on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0152] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0153] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0154] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0155] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to programmatic levels within the application's programmatic or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as a hit view, and the set of events that are recognized as correct input is optionally determined based at least in part on the hit view of the initial touch that started the touch-based gesture.

[0156] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-events. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0157] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, views higher in the hierarchy will still remain actively participating views.

[0158] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizer determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores the event information in an event queue, which is retrieved by corresponding event receiver 182.

[0159] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or part of another module stored in memory 102, such as contact / motion module 130.

[0160] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events that occur within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more of event recognizers 180 are part of a separate module, such as a user interface toolkit or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update the application internal state 192. Alternatively, one or more of the application views 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of the data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0161] A corresponding event identifier 180 receives event information (e.g., event data 179) from event classifier 170 and identifies an event based on the event information. Event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0162] The event receiver 182 receives event information from the event classifier 170. The event information includes information about sub-events such as touches or touch movements. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of a touch, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0163] Event comparator 184 compares event information with predefined event or sub-event definitions and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in an event (e.g., 187-1 and / or 187-2) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0164] In some embodiments, event definition 186 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler that is associated with the sub-event and the object that triggered the hit test.

[0165] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.

[0166] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definitions 186, the corresponding event recognizer 180 enters the event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0167] In some embodiments, corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery for actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0168] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and performs a predefined process.

[0169] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and executes a predetermined process.

[0170] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.

[0171] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0172] It should be understood that the above discussion of event handling for user touches on a touch-sensitive display also applies to other forms of user input utilizing input devices to operate the multifunction device 100, and not all user input is initiated on the touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or holddowns; contact movement on a touchpad, such as taps, drags, scrolls, etc.; stylus input; movement of the device; spoken commands; detected eye movement; biometric input; and / or any combination thereof, are optionally used as input corresponding to sub-events defining the event to be recognized.

[0173] Figure 2A portable multifunction device 100 with a touch screen 112 according to some embodiments is illustrated. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of the graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of the one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or rolling of the finger that has made contact with the device 100 (from right to left, from left to right, up and / or down). In some implementations or in some cases, inadvertent contact with a graphic does not select the graphic. For example, a swipe gesture that sweeps over an application icon does not select the corresponding application when the gesture corresponding to selection is a tap.

[0174] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications optionally being executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

[0175] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and for locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and holding it in the depressed state for a predefined time interval; to lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions via the microphone 113. The device 100 also optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for the user of the device 100.

[0176] Figure 33 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. The device 300 does not have to be portable. In some embodiments, the device 300 is a laptop, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a gaming system, or a control device (e.g., a home controller or an industrial controller). The device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. The device 300 includes an input / output (I / O) interface 330 having a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above referenced device). Figure 1A Tactile output generator 167 as described above), sensor 359 (e.g., optical sensor, acceleration sensor, proximity sensor, touch sensitive sensor and / or contact intensity sensor (similar to the above reference Figure 1A 310). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU 310. In some embodiments, memory 370 stores data related to portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100( Figure 1A )'s memory 102 optionally does not store these modules.

[0177] Figure 3Each element in the above-mentioned elements in is optionally stored in one or more memory devices of the memory device mentioned previously.Each module in the above-mentioned modules corresponds to the instruction set for performing the function described above.Above-mentioned modules or computer programs (for example, instruction sets or including instructions) need not be realized with independent software programs (such as computer programs (for example, including instructions)), processes or modules, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments.In some embodiments, memory 370 optionally stores the subset of above-mentioned modules and data structures.In addition, memory 370 optionally stores additional modules and data structures not described above.

[0178] Attention is now turned to an embodiment of a user interface, optionally implemented on, for example, portable multifunction device 100 .

[0179] Figure 4A An exemplary user interface for an application menu on portable multifunction device 100 is illustrated according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0180] Signal strength indicators 402 for wireless communications such as cellular and Wi-Fi signals;

[0181] ●Time 404;

[0182] Bluetooth indicator 405;

[0183] Battery status indicator 406;

[0184] A tray 408 with icons for commonly used applications such as:

[0185] o An icon 416 labeled “Phone” for the phone module 138 , which optionally includes an indicator 414 of the number of missed calls or voicemails;

[0186] o An icon 418 of the email client module 140 labeled “Mail,” which optionally includes an indicator 410 of the number of unread emails;

[0187] o An icon 420 labeled "Browser" of the browser module 147; and

[0188] o Video and music player module 152 (also known as iPod (Apple Inc.

[0189] Inc.) module 152) labeled "iPod" icon 422; and

[0190] ● Icons for other apps, such as:

[0191] o Icon 424 labeled “Messages” of IM module 141;

[0192] o Icon 426 labeled “Calendar” of calendar module 148;

[0193] o Icon 428 labeled “Photos” of the image management module 144;

[0194] o An icon 430 labeled “Camera” of the camera module 143;

[0195] o Icon 432 labeled “Online Video” of the online video module 155;

[0196] o Icon 434 labeled “Stock Market” of the stock market widget 149 - 2 ;

[0197] o Icon 436 labeled “Map” of the map module 154;

[0198] o Icon 438 labeled “Weather” of weather widget 149 - 1 ;

[0199] o Icon 440 labeled “Clock” of the alarm clock widget 149 - 4 ;

[0200] o An icon 442 labeled “Fitness Support” of the fitness support module 142 ;

[0201] o An icon 444 labeled "Notes" of the notes module 153; and

[0202] o An icon 446 of a settings application or module labeled “Settings” that provides access to settings for the device 100 and its various applications 136 .

[0203] It should be pointed out that Figure 4A The illustrated icon labels are merely exemplary. For example, the icon 422 of the video and music player module 152 is labeled "Music" or "Music Player." Other labels are optionally used for various application icons. In some embodiments, the label of a respective application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0204] Figure 4B A touch-sensitive surface 451 (eg, touch screen display 112) is illustrated as being separate from a display 450 (eg, touch screen display 112). Figure 3 tablet or touchpad 355) of the device (e.g., Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.

[0205] Although some of the examples below will be given with reference to input on a touch screen display 112 (where the touch-sensitive surface and display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the main axis (for example, Figure 4B According to these embodiments, the device detects a position corresponding to a corresponding position on the display (e.g., Figure 4B , 460 corresponds to 468 and 462 corresponds to 470 ) at contact with touch-sensitive surface 451 (e.g., Figure 4B 460 and 462 in FIG. 4. Thus, when the touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4B When the user interface 450 in FIG. 1 is separated, the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0206] Additionally, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). For another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting the contact, followed by ceasing to detect the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or mice and finger contacts are optionally used simultaneously.

[0207] Figure 5AAn exemplary personal electronic device 500 is illustrated. The device 500 includes a body 502. In some embodiments, the device 500 may include components related to devices 100 and 300 (e.g., Figures 1A to 4B ) some or all of the features described in . In some embodiments, device 500 has a touch-sensitive display screen 504, referred to hereinafter as touch screen 504. Alternatively, or in addition to touch screen 504, device 500 also has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of the contact (e.g., touch) applied. The one or more intensity sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of the touch. The user interface of device 500 can respond to the touch based on the intensity of the touch, which means that touches of different intensities can invoke different user interface operations on device 500.

[0208] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” filed on May 8, 2013, published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” filed on November 11, 2013, published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.

[0209] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508 (if included) can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) can allow the device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear the device 500.

[0210] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, the device 500 may include information about Figure 1A 、 Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples an I / O portion 514 to one or more computer processors 516 and a memory 518. The I / O portion 514 can be connected to a display 504, which can have a touch-sensitive component 522 and optionally a strength sensor 524 (e.g., a contact strength sensor). In addition, the I / O portion 514 can be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, the input mechanism 506 is optionally a rotatable input device or a depressible input device and a rotatable input device. In some examples, the input mechanism 508 is optionally a button.

[0211] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to I / O portion 514.

[0212] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including processes 700, 900, 1100, 1300, and 1500 ( Figures 7A to 7G 、 9A to 9C 、 Figures 11A to 11G 、 13A to 13C as well as 15A to 15D). Computer-readable storage media can be any medium that can tangibly contain or store computer-executable instructions for use by or in conjunction with instruction execution systems, devices, and apparatuses. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory, solid-state drives, and the like. Personal electronic device 500 is not limited to Figure 5B components and configurations, but may include other components or additional components in a variety of configurations.

[0213] As used herein, the term "indicator" refers to an indication that is optionally provided on device 100, 300, and / or 500 ( Figure 1A 、 Figure 3 and Figures 5A to 5B ) is a user-interactive graphical user interface object displayed on a display screen of a computer. For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) optionally each constitute an affordance.

[0214] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in FIG, the particular user interface element is adjusted according to the detected input. In the case of a touch screen display (e.g., a touch screen display) that enables direct interaction with user interface elements on the touch screen display Figure 1A touch-sensitive display system 112 or Figure 4AIn some implementations of the touch screen 112 in FIG, 2 , a contact detected on the touch screen acts as a “focus selector” such that when input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some implementations, the focus moves from one area of ​​the user interface to another area of ​​the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves according to the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or contact on the touch screen display) that is controlled by the user to deliver the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0215] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact begins to move, before contact ends, before or after contact is detected to increase in intensity, and / or before or after contact is detected to decrease in intensity). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose feature strength does not exceed the first threshold results in a first operation, a contact whose feature strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose feature strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the feature strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to abandon the corresponding operation) rather than to determine whether to perform the first operation or the second operation.

[0216] Attention is now turned to an embodiment of a user interface ("UI") and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.

[0217] Figures 6A to 6R Illustrated are exemplary user interfaces for managing accessories for a home automation system according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including Figures 7A to 7G in the process.

[0218] In some embodiments, any of the inputs described herein (e.g., inputs 650a, 650b, 650c, 650d, 650e, 650f, 650g, 650h, 650i, 650j, 650k, and / or 650l) is or includes a touch input (e.g., a tap gesture and / or a swipe gesture). In some embodiments, any of the inputs described herein (e.g., inputs 650a, 650b, 650c, 650d, 650e, 650f, 650g, 650h, 650i, 650j, 650k, and / or 650l) is or includes a voice input (e.g., a voice command for selecting a user interface element or for activating a feature or performing a function, such as a feature or function associated with a user interface element). In some embodiments, any of the inputs described herein (e.g., inputs 650a, 650b, 650c, 650d, 650e, 650f, 650g, 650h, 650i, 650j, 650k, and / or 650l) is or includes an air gesture (e.g., an air gesture for selecting a user interface element or for activating a feature or performing a function, such as a feature or function associated with a user interface element). In some embodiments, any of the inputs described herein (e.g., inputs 650a, 650b, 650c, 650d, 650e, 650f, 650g, 650h, 650i, 650j, 650k, and / or 650l) is or includes activation (e.g., pressing, rotating, and / or moving) of a hardware device (e.g., a button, a rotatable input mechanism, a rotatable depressible input mechanism, a mouse button, a remote control button, and / or a joystick). In some embodiments, any of the user interface elements described herein as selected (e.g., icons, indicators, buttons, and / or selectable options) is selected by activating a hardware device while the user interface element is in focus (e.g., highlighted, bolded, outlined, visually distinguished from other user interface elements, and / or located at or near a cursor).

[0219] Figure 6A An electronic device 600 is illustrated displaying a home user interface 604 associated with a home automation system via a display 602. In some embodiments, the home automation system includes one or more accessory devices (e.g., devices configured to communicate with and / or be controlled by the electronic device 600) associated with a location (such as a building, home, office, and / or apartment). Figure 6A At , the electronic device 600 is configured to adjust and / or control the status and / or settings of one or more accessory devices of the home automation system via the home user interface 604. In some embodiments, the home user interface 604 is the user interface first displayed by the electronic device 600 in response to launching an application associated with the home automation system.

[0220] exist Figure 6A , the home user interface 604 includes a home indicator 604a (e.g., "123 Main Street") that provides an indication of the location (e.g., physical address) of a location associated with the home automation system. Additionally, the home user interface 604 includes a category area 606, a camera area 608, a scene area 610, and a first room area 612. As explained below, the home user interface 604 is scrollable such that one or more additional areas corresponding to respective rooms and / or accessory devices of the home automation system can be displayed in response to a swipe and / or scroll gesture on the home user interface 604.

[0221] The category area 606 includes category user interface objects 606a-606c associated with corresponding categories of the home automation system. For example, the first category user interface object 606a corresponds to the climate category of the home automation system, the second category user interface object 606b corresponds to the lighting category of the home automation system, and the third category user interface object 606c corresponds to the security category of the home automation system. In some embodiments, the corresponding categories associated with the category user interface objects 606a-606c include information about accessory devices of the home automation system, wherein the accessory devices of the home automation system include different types of accessory devices (e.g., accessory devices configured to perform different functions (e.g., primary functions)) and / or accessory devices associated with different rooms of a location associated with the home automation system. As explained below, in response to user input selecting a corresponding category user interface object, the electronic device 600 displays a category user interface associated with the selected category user interface object. The category user interface includes a user interface object that identifies the accessory device associated with the selected category user interface object, and / or information about the category associated with the selected category user interface object. Furthermore, as explained below, category area 606 is scrollable, such that electronic device 600 displays additional category user interface objects (e.g., Figure 6G The fourth category of user interface objects 606d is shown).

[0222] exist Figure 6AAt , the first category user interface object 606a includes a status indicator 607a that provides information about the current state of the climate category of the home automation system. The status indicator 607a includes a temperature range of 68° to 70°, which indicates the current temperature detected and / or measured by one or more thermometers and / or thermostats of the home automation system. In some embodiments, the home automation system includes a single thermostat, so that the status indicator 607a includes a single temperature instead of a temperature range. The second category user interface object 606b includes a status indicator 607b that provides information about the current state of the lighting category of the home automation system. The status indicator 607b indicates that two lighting devices (e.g., lights and / or sockets) are currently active and / or turned on. Similarly, the third category user interface object 606c includes a status indicator 607c that provides information about the current state of the security category of the home automation system. The status indicator 607c indicates that a lock (e.g., a door lock, a window lock, a garage lock, and / or a vehicle lock) is currently unlocked and / or open. Thus, category user interface objects 606a-606c provide information about the current status of the corresponding category.

[0223] In some embodiments, when the electronic device 600 determines that no accessory devices associated with the climate category are active, enabled, and / or turned on, the electronic device 600 does not display the status indicator 607a. For example, when all thermostats of the home automation system are turned off (e.g., not enabled to cause heating, cooling, and / or ventilation of the location of the home automation system), the electronic device 600 does not display the status indicator 607a. Similarly, in some embodiments, when no lighting devices of the home automation system are currently turned on, the electronic device 600 does not display the status indicator 607b (or displays a status such as "off"), and / or when all lock devices of the home automation system are locked, the electronic device 600 does not display the status indicator 607c (or displays a status such as "locked"). In some embodiments, the electronic device 600 displays different states of the category user interface objects 606a-606c based on the priority of the corresponding states. For example, in some embodiments, when the security alarm of the home automation system has been triggered and / or activated, the electronic device 600 does not display the status indicator 607c of the third category user interface object 606c. In some embodiments, the electronic device 600 replaces the status indicator 607c with a status indicator indicating that the security alarm has been triggered because the security alarm status has a higher priority than the status indicator 607c indicating that the lock device is in the unlocked state.

[0224] The camera area 608 includes one or more camera tiles 608a-608c having camera views of camera accessory devices of the home automation system. 12A to 12I Describes the characteristics of the camera area 608. The scene area 610 includes scene user interface objects 610a and 610b, which correspond to predetermined automations for adjusting the state of one or more accessory devices of the home automation system. Figures 8A to 8P The scene area 610 is described in detail. The first room area 612 includes accessory user interface objects 612a-612c corresponding to accessory devices of the home automation system, which are associated with (e.g., programmatically mapped to) a specific room (e.g., "entrance") of a location associated with the home automation system. Figures 14A to 14M A first room area 612 is described.

[0225] exist Figure 6A At , the electronic device 600 detects a user input 650a (e.g., a tap gesture or other selection / navigation input) corresponding to a selection of the first category user interface object 606a. In response to detecting the user input 650a, the electronic device 600 displays the climate category user interface 614 via the display 602, as shown in FIG. Figure 6B Additionally or alternatively, the electronic device 600 detects user input 650b (e.g., a swipe gesture or other selection / navigation input) corresponding to the category area 606. In response to detecting the user input 650b, the electronic device 600 scrolls and / or moves the category user interface objects 606a-606c to display a fourth category user interface object 606d, as shown. Figure 6G shown.

[0226] exist Figure 6B , the climate category user interface 614 includes a category area 606, a subcategory area 616, and an accessories area 618. The category area 606 includes category user interface objects 606a-606c, wherein the first category user interface object 606a includes an emphasis 620 (e.g., a bold outline, an outline having a different color than the category user interface objects 606b and / or 606c, and / or a thicker outline than the category user interface objects 606b and / or 606c) indicating that the first category user interface object 606a has been selected.

[0227] The subcategory area 616 includes subcategory user interface objects 616a and 616b that correspond to subcategories of the category (e.g., climate) associated with the first category user interface object 606a. Figure 6B At , the subcategory user interface objects 616a and 616b include information about the subcategories of the climate category, such as status information. Figure 6B, the first subcategory user interface object 616a corresponds to the temperature subcategory of the climate category and includes information about one or more current temperatures of a location associated with the home automation system. The first subcategory user interface object 616a includes a visual indicator 622a and a status indicator 622b. The visual indicator 622a includes an image, icon, text, and / or symbol representing the subcategory associated with the first subcategory user interface object 616a. Figure 6B At , visual indicator 622a includes a temperature setting symbol (e.g., a partial ring with dots and / or marks indicating the temperature setting) and text (e.g., "70°"), both of which provide information about the current temperature setting, where one or more accessory devices are configured to adjust the temperature of the location associated with the home automation system toward the current temperature setting (e.g., heat and / or cool the temperature of the location toward the current temperature setting). Status indicator 622b includes the status of one or more current temperatures of the location associated with the home automation system. For example, status indicator 622b indicates that the temperature range for the location is 68° to 70°. At , visual indicator 622a includes a temperature setting symbol (e.g., a partial ring with dots and / or marks indicating the temperature setting) and text (e.g., "70°"), both of which provide information about the current temperature setting, where one or more accessory devices are configured to adjust the temperature of the location associated with the home automation system toward the current temperature setting (e.g., heat and / or cool the temperature of the location toward the current temperature setting). Figure 6B In some embodiments, the home automation system includes more than one thermostat (e.g., more than one temperature control accessory device), such that the status indicator 622b includes a temperature range associated with the measurements of the thermostats. In some embodiments, the home automation system includes a single thermostat, such that the status indicator includes a single current temperature associated with the single thermostat.

[0228] The second subcategory user interface object 616b corresponds to the air quality subcategory of the climate category and includes information about the current air quality of the location associated with the home automation system. The second subcategory user interface object 616b includes a visual indicator 624a and a status indicator 624b. The visual indicator 624a includes an image, icon, text, and / or symbol representing the subcategory associated with the second subcategory user interface object 616b. Figure 6B At , visual indicator 624a includes an air quality setting symbol (e.g., a partial ring with dots and / or marks indicating air quality settings) and text (e.g., "90"), both of which provide information about the current air quality setting, wherein one or more accessory devices are configured to detect the air quality of the location associated with the home automation system and / or adjust the air quality toward the current air quality setting (e.g., increase and / or decrease the air quality of the location of the home automation system toward the current air quality setting). Status indicator 624b includes the status of the current air quality of the location associated with the home automation system. For example, status indicator 624b indicates that the air quality of the location is "good."

[0229] The accessories area 618 includes accessory user interface objects 618a-618e of the home automation system that correspond to corresponding accessory devices associated with the climate category. For example, the accessory user interface objects 618a-618e include thermostat devices and fan devices that are configured to regulate, control, and / or adjust the climate of a location associated with the home automation system. In some embodiments, an accessory device of the home automation system is included in a corresponding category when the accessory device includes functionality (e.g., primary functionality) that matches and / or is suitable for the corresponding category (e.g., the accessory device includes functionality that matches and / or corresponds to the functionality, description, and / or purpose associated with the corresponding category). Figure 6B In some embodiments, the accessory user interface objects 618a-618e are arranged, grouped, and / or listed based on the room of the location associated with the home automation system. In some embodiments, the accessory user interface objects 618a-618e are arranged, grouped, and / or listed based on device type and / or based on another criterion (e.g., most recently active and / or most recently used).

[0230] exist Figure 6B , accessory user interface objects 618a-618e include status indicators 626 that provide information about the status of the respective accessory devices corresponding to accessory user interface objects 618a-618e. For example, status indicator 626 of third accessory user interface object 618c indicates that the thermostat (e.g., a kitchen thermostat) corresponding to third accessory user interface object 618c is heating at least a portion of the location associated with the home automation system to 70°. Thus, climate category user interface 614 includes information about subcategories and individual accessory devices of the climate category, which enables a user to easily obtain information about the climate of the location associated with the home automation system.

[0231] exist Figure 6B At , the electronic device 600 detects user input 650c (e.g., a swipe gesture or other selection / navigation input) corresponding to the subcategory area 616. In response to detecting the user input 650c, the electronic device 600 scrolls the subcategory user interface objects 616a and 616b while displaying the climate category user interface 614 (e.g., maintaining its display), as shown. Figure 6C Additionally or alternatively, the electronic device 600 detects a user input 650d (e.g., a tap gesture or other selection / navigation input) corresponding to a selection of the first subcategory user interface object 616a. In response to detecting the user input 650d, the electronic device 600 displays the subcategory user interface 628, as shown. Figure 6F shown.

[0232] exist Figure 6C, the electronic device 600 has scrolled and / or moved the subcategory user interface objects 616a and 616b (e.g., scrolled and / or moved them to the left relative to the display 602) and displays a third subcategory user interface object 616c. The third subcategory user interface object 616c corresponds to the humidity subcategory of the climate category and includes information about the current humidity of the location associated with the home automation system. In some embodiments, the electronic device 600 is configured to display additional subcategory user interface objects in response to receiving one or more additional swipe and / or scroll gestures. Figure 6C At , the third subcategory user interface object 616c includes a visual indicator 630a (e.g., an image, icon, and / or symbol of a water droplet) and a status indicator 630b (e.g., "70%"). The status indicator 630b includes the current humidity status of the location associated with the home automation system. For example, the status indicator 630b indicates that the humidity at the location is "70%."

[0233] exist Figure 6C At , the electronic device 600 detects user input 650e (e.g., a tap gesture or other selection / navigation input) corresponding to selection of the third accessory user interface object 618c. In response to detecting the user input 650e, the electronic device 600 displays the accessory user interface 632, as shown in FIG. Figure 6D In response to continuing to detect the user input 650e for a predetermined amount of time (eg, the user maintains the user input 650e for one second, two seconds, or five seconds), the electronic device 600 displays a menu 634, such as Figure 6E shown.

[0234] exist Figure 6D At , the accessory user interface 632 enables the electronic device 600 to adjust one or more settings of the thermostat corresponding to the third accessory user interface object 618c. For example, in response to detecting the user input corresponding to the temperature adjustment user interface object 636, the electronic device 600 causes the thermostat to heat and / or cool the temperature within at least a portion of the location to a different temperature setting. Figure 6D , accessory user interface 632 indicates that the thermostat is currently configured to heat the temperature within at least a portion of the location to 70° and cool the temperature within at least a portion of the location to 75°. Accordingly, electronic device 600 can change the current temperature setting of the thermostat in response to detecting the user input corresponding to temperature adjustment user interface object 636. In some embodiments, electronic device 600 transmits data and / or information to the thermostat (e.g., via a server) in response to detecting the user input on temperature adjustment user interface object 636 to cause the thermostat to change the temperature setting.

[0235] As explained above, in response to continuing to detect the user input 650e for a predetermined amount of time, the electronic device 600 displays the menu 634, such as Figure 6E 6. The menu 634 includes selectable options 634a-634c that enable the electronic device 600 to customize the third accessory user interface object 618c and / or the home user interface 604. For example, in response to detecting a selection of the first selectable option 634a, the electronic device 600 changes whether information about the thermostat associated with the third accessory user interface object 618c (e.g., information received from the thermostat) is included in the state of the home automation system (such as, status indicator 607a and / or status indicator 622b). In some embodiments, when the thermostat associated with the third accessory user interface object 618c is not included in the state of the home automation system, the electronic device 600 does not use the information about the thermostat. In some embodiments, when the thermostat associated with the third accessory user interface object 618c is not included in the state of the home automation system, the electronic device 600 displays status indicators 607a and / or 622b with information about other thermostats and / or accessory devices of the home automation system.

[0236] In some embodiments, in response to detecting selection of the second selectable option 634b, the electronic device 600 stops and / or does not display the third accessory user interface object 618c on the home user interface 604 (and optionally, on the climate category user interface 614). In some embodiments, in response to detecting selection of the third selectable option 634c, the electronic device activates an editing mode that enables the accessory user interface objects 618a-618e to be rearranged and / or moved relative to each other on the climate category user interface 614. Figures 14A to 14M The editing mode of the electronic device 600 is discussed in detail.

[0237] As explained above, in response to detecting the user input 650d corresponding to the selection of the first subcategory user interface object 616a, the electronic device 600 displays the subcategory user interface 628, as shown in FIG. Figure 6F As shown. Figure 6F At , the subcategory user interface 628 includes a first accessory user interface object 618a, a third accessory user interface object 618c, and a fifth accessory user interface object 618e. The first subcategory user interface object 616a corresponds to the temperature subcategory of the climate category. Therefore, the electronic device 600 displays user interface objects corresponding to accessory devices related to the temperature subcategory. For example, in Figure 6F8. In the example embodiment, the first accessory user interface object 618a corresponds to a living room thermostat of the home automation system, the third accessory user interface object 618c corresponds to a kitchen thermostat of the home automation system, and the fifth accessory user interface object 618e corresponds to a bedroom thermostat of the home automation system. Because thermostats are configured to cause an adjustment to the temperature of a location associated with the home automation system, the electronic device 600 includes the first accessory user interface object 618a, the third accessory user interface object 618c, and the fifth accessory user interface object 618e on the sub-category user interface 628 associated with the temperature sub-category.

[0238] In some embodiments, electronic device 600 is configured to display accessory user interface 632 in response to detecting user input corresponding to third accessory user interface object 618c. Additionally, in some embodiments, electronic device 600 is configured to display a user interface similar to accessory user interface 632 in response to detecting user input selecting first accessory user interface object 618a and / or fifth accessory user interface object 618e. Thus, subcategory user interface 628 enables a user to view accessory devices associated with a subcategory associated with first subcategory user interface object 616a, and also enables the user to control individual accessory devices in response to one or more additional user inputs.

[0239] exist Figure 6F In some embodiments, the electronic device 600 does not include the second accessory user interface object 618b and / or the fourth accessory user interface object 618d on the subcategory user interface 628. The second accessory user interface object 618b corresponds to a living room fan of the home automation system, and the fourth accessory user interface object 618d corresponds to a kitchen fan of the home automation system. Because the fans do not directly cause temperature adjustments to the location of the home automation system, the second accessory user interface object 618b and the fourth accessory user interface object 618d are not included on the subcategory user interface 628 associated with the temperature subcategory. In some embodiments, the electronic device 600 includes the second accessory user interface object 618b and / or the fourth accessory user interface object 618d on a subcategory user interface associated with the ventilation subcategory of the climate category (e.g., a subcategory user interface different from the subcategory user interface 628).

[0240] As explained above, in response to detecting the user input 650b corresponding to the category area 606, the electronic device 600 scrolls and / or moves the category user interface objects 606a-606c to display the fourth category user interface object 606d, such as Figure 6G As shown. Figure 6GAt , the fourth category user interface object 606d corresponds to the entertainment (e.g., "speakers and TV") category of the home automation system. The fourth category user interface object 606d does not include a status indicator (e.g., 607a-607c). In some embodiments, the fourth category user interface object 606d does not include a status indicator because the electronic device 600 determines that the accessory device associated with the entertainment category of the home automation system is not in an on and / or active state. For example, the speaker and / or TV accessory device of the home automation system is not currently outputting media, such as music, audiobooks, podcasts, videos, and / or television programs. In some embodiments, when the electronic device 600 determines that the accessory device associated with the entertainment category of the home automation system is in an on and / or active state, the electronic device 600 includes a status indicator on the fourth category user interface object 606d.

[0241] exist Figure 6G At , the electronic device 600 detects a user input 650f (eg, a tap gesture or other selection / navigation input) corresponding to the third category user interface object 606c. In response to detecting the user input 650f, the electronic device 600 displays the security category user interface 638, such as Figure 6H Additionally or alternatively, in response to continuing to detect the user input 650f for a predetermined amount of time (e.g., continuing and / or maintaining the input for one second, two seconds, or five seconds), the electronic device 600 displays the menu 640, such as Figure 6I shown.

[0242] exist Figure 6H , the security category user interface 638 includes a category area 606, a subcategory area 642, and an accessories area 644. The category area 606 includes category user interface objects 606a-606c, wherein the third category user interface object 606c includes an emphasis 620 (e.g., a bold outline, an outline having a different color than the category user interface objects 606a and / or 606b, and / or a thicker outline than the category user interface objects 606a and / or 606b) indicating that the third category user interface object 606c has been selected.

[0243] Accessory area 644 includes a camera tile 644a with a camera view associated with a camera (e.g., a security camera) of the home automation system. The camera is associated with the security category of the home automation system, and therefore, electronic device 600 includes camera tile 644a in security category user interface 638. Electronic device 600 does not include a camera tile and / or user interface object in climate category user interface 614 because the camera accessory device of the home automation system does not belong to and / or correspond to the climate category. Therefore, electronic device 600 displays related user interface objects and / or information about accessory devices associated with and / or belonging to the category of the corresponding category user interface.

[0244] The subcategory area 642 includes subcategory user interface objects 642a and 642b that correspond to subcategories of the security category associated with the third category user interface object 606c. Figure 6H At , the subcategory user interface objects 642a and 642b include information about the subcategories of the security category, such as status information. Figure 6H , the first subcategory user interface object 642a corresponds to the lock subcategory of the security category and includes information about the number of current lock devices in the unlocked state at a location associated with the home automation system. The first subcategory user interface object 642a includes a visual indicator 648a and a status indicator 648b. The visual indicator 648a includes an image, icon, text, and / or symbol representing the subcategory associated with the first subcategory user interface object 642a. Figure 6H At , visual indicator 648a includes an unlock symbol indicating that the first subcategory user interface object 642a corresponds to a lock device in an unlocked state. State indicator 648b includes a state of multiple (e.g., "1") lock devices in an unlocked state and / or an indication of which lock devices (e.g., "windows") and / or lock device types are in an unlocked state.

[0245] The second subcategory user interface object 642b corresponds to a detected security category event and includes information about current and / or recent events detected by one or more accessory devices associated with the security category. The second subcategory user interface object 642b includes a visual indicator 652a and a status indicator 652b. The visual indicator 652a includes an image, icon, text, and / or symbol representing the subcategory associated with the second subcategory user interface object 642b. Figure 6H At , visual indicator 652a includes a symbol of a person moving, which provides information about the type of event detected (e.g., motion detected via a motion sensor device of a home automation system). Status indicator 652b includes text related to the detected event, such as "motion detected."

[0246] In addition to the camera tile 644a, the accessories area 644 includes accessory user interface objects 644b-646d corresponding to respective accessory devices of the home automation system that are associated with the security category. For example, the accessory user interface objects 644b-644d include lock devices that are configured to enhance, monitor, and / or improve security at locations associated with the home automation system. In some embodiments, when an accessory device of the home automation system includes functionality (e.g., primary functionality) that matches and / or is suitable for the security category (e.g., the respective accessory device includes functionality that matches and / or corresponds to the functionality, description, and / or purpose associated with the security category), the accessory device is included within the security category and / or displayed on the security category user interface 638. Figure 6H In some embodiments, the accessory user interface objects 644b-644d are arranged, grouped, and / or listed based on the room of the location associated with the home automation system. In some embodiments, the accessory user interface objects 644b-644d are arranged, grouped, and / or listed based on device type and / or based on another criterion (e.g., recent activity and / or recent use).

[0247] exist Figure 6H 646a-646c. For example, the state indicator 654 of the first accessory user interface object 646a indicates that the door lock (e.g., the front door lock) corresponding to the first accessory user interface object 646a is in the unlocked state. Thus, the security category user interface 638 includes information about the subcategories and individual accessory devices of the security category, which enables a user to easily obtain information about the security of a location associated with the home automation system.

[0248] exist Figure 6HAt 6:00, the electronic device 600 detects user input 650g (e.g., a tap gesture or other selection / navigation input) corresponding to the first portion 656a of the first accessory user interface object 646a. In some embodiments, in response to detecting the user input 650g, the electronic device 600 causes the door lock associated with the first accessory user interface object 646a to transition from an unlocked state to a locked state. Thus, the first portion 656a of the first accessory user interface object 646a acts as a switch that enables the door lock to be quickly locked and / or unlocked via the user input 650g. In some embodiments, after detecting the user input 650g, the electronic device changes and / or modifies the appearance of the first accessory user interface object 646a (e.g., changes color, changes brightness, and / or changes the thickness of the border surrounding the first accessory user interface object 646a) to provide a visual indication that the door lock has transitioned from the unlocked state to the locked state.

[0249] Additionally or alternatively, the electronic device 600 detects a user input 650h (e.g., a tap gesture or other selection / navigation input) corresponding to the second portion 656b of the first accessory user interface object 646a. In response to detecting the user input 650h, the electronic device 600 displays a lock user interface object 658, such as Figure 6J As described below, lock user interface 658 enables electronic device 600 to control the state of a door lock associated with first accessory user interface object 646a and enables electronic device 600 to adjust and / or modify one or more settings of the door lock. Accordingly, accessory user interface objects 644b-644dc (and optionally, accessory tiles 612a-612c and / or accessory user interface objects 618a-618e) include different portions that enable electronic device 600 to quickly control and / or adjust the state of a corresponding accessory device and / or provide additional controls for the corresponding accessory device.

[0250] exist Figure 6H At , the electronic device 600 detects (e.g., in addition to or in lieu of detecting user input 650g and / or 650h) a user input 650i (e.g., a tap gesture or other selection / navigation input) corresponding to the second category user interface object 606b. In response to detecting the user input 650i, the electronic device 600 displays the lighting category user interface 660, as shown in FIG. Figure 6M shown.

[0251] As explained above, in response to continuing to detect the user input 650f for a predetermined amount of time (e.g., continuing and / or maintaining the input for one second, two seconds, or five seconds), the electronic device 600 displays the menu 640, such as Figure 6I As shown. Figure 6IAt , menu 640 includes selectable options 640a and 640b corresponding to the third category user interface object 606c. In some embodiments, in response to detecting a selection of the first selectable option 640a, the electronic device 600 is configured to perform an action with respect to multiple accessory devices associated with a security category (e.g., a category associated with the second category user interface object 606b). For example, in some embodiments, in response to detecting a user input selecting the first selectable option 640a, the electronic device 600 causes all lock devices associated with and / or included in the security category to be set to (e.g., transitioned to) a locked state (e.g., causes all lock devices in an unlocked state to transition to a locked state). Thus, the electronic device 600 can control multiple accessory devices of the security category after detecting the user input 650f for a predetermined amount of time, without requiring multiple user inputs to separately request control of each accessory device.

[0252] In some embodiments, in response to detecting user input corresponding to the second selectable option 640b, the electronic device 600 displays a user interface (e.g., a user interface different from the security category user interface 638) that includes a list of all accessory devices of the home automation system that are included in and / or associated with the security category.

[0253] As explained above, in response to detecting the user input 650h corresponding to the second portion 656b of the first accessory user interface object 646a, the electronic device 600 displays the lock user interface 658, such as Figure 6J As shown. Figure 6J At , the lock user interface 658 includes a control user interface object 658a and a settings user interface object 658b. In some embodiments, in response to detecting a user input corresponding to the control user interface object 658a, the electronic device 600 causes the door lock to transition from a locked state to an unlocked state, or vice versa. Thus, the electronic device 600 is configured to cause the door lock to transition between states (e.g., an unlocked state and a locked state) in response to a user input corresponding to the first portion 656a of the first accessory user interface object 646a (e.g., user input 650g) and / or a user input corresponding to the control user interface object 658a.

[0254] exist Figure 6J At , the electronic device 600 detects a user input 650j (e.g., a tap gesture or other selection / navigation input) corresponding to the settings user interface object 658b. In response to detecting the user input 650j, the electronic device 600 displays the settings user interface 662, as shown in FIG. Figure 6K As shown. Figure 6KAt , the settings user interface 662 enables the electronic device 600 to adjust and / or configure the settings of the door lock associated with the first accessory user interface object 646a. Figure 6K At , the electronic device 600 detects a user input 650k (e.g., a tap gesture or other selection / navigation input) corresponding to the device indicator 662a of the setting user interface 662. In response to detecting the user input 650k, the electronic device 600 displays the appearance setting user interface 664, as shown in FIG. Figure 6L shown.

[0255] exist Figure 6L At , the appearance settings user interface 664 enables the electronic device to modify, change, and / or customize the appearance of the first accessory user interface object 646a. The appearance settings user interface 664 includes an appearance indicator 664a that provides a visual indication of the current appearance of the first accessory user interface object 646a. Figure 6L , appearance indicator 664a includes a lock icon and a first color associated with first accessory user interface object 646a (e.g., as indicated by the lack of shading in appearance indicator 664a). Appearance settings user interface 664 includes a color area 664b and an icon area 664c, which include selectable options for customizing the color and symbol of first accessory user interface object 646a, respectively. For example, in some embodiments, in response to detecting user input corresponding to selectable color option 664d in color area 664b, electronic device 600 adjusts and / or modifies the appearance of first accessory user interface object 646a to include the color corresponding to selectable color option 664d. In some embodiments, in response to detecting user input corresponding to selectable icon option 664e in icon area 664c, electronic device 600 adjusts and / or modifies the symbol and / or icon included on first accessory user interface object 646a. Thus, a user of electronic device 600 can customize the appearance of first accessory user interface object 646a so that the user can quickly identify and interact with first accessory user interface object 646a.

[0256] As explained above, in response to detecting the user input 650i corresponding to the second category user interface object 606b, the electronic device 600 displays the lighting category user interface 660, such as Figure 6M As shown. Figure 6M At , the lighting category user interface 660 includes accessory user interface objects 660a-660f corresponding to accessory devices of the home automation system associated with the lighting category. Figure 6MAt , accessory user interface objects 660a-660f are associated with light devices (e.g., accessory user interface objects 660a, 660b, 660d, and 660e) and are associated with outlet devices (e.g., accessory user interface objects 660c and 660f). In some embodiments, the light devices include lights (e.g., smart lights), light bulbs (e.g., smart light bulbs), and / or other physical lighting devices configured to be controlled by the electronic device 600. In some embodiments, the outlet devices include smart outlets and / or smart plugs that control, adjust, and / or regulate power to another device. For example, the outlet device is connected to both a power source and a device so that the outlet device controls when power is supplied or not supplied from the power source to the connected device via the circuit of the outlet device. In some embodiments, the electronic device 600 associates one or more outlet devices with a lighting category based on a user designation of the one or more outlet devices (e.g., a user provides one or more user inputs that associate the one or more outlet devices with a lighting category). In some embodiments, the electronic device 600 is configured to determine that one or more outlet devices are associated with a lighting category based on information received from the one or more outlet devices and / or devices connected to the one or more outlet devices.

[0257] exist Figure 6N At , the electronic device 600 displays a home user interface 604 including a notification 666 based on receiving and / or detecting an event associated with the home automation system. For example, at Figure 6N At , notification 666 relates to the unavailability and / or disconnection of the wireless network of the home automation system. For example, in some embodiments, an accessory device of the home automation system is connected to one or more wireless networks, which enables the electronic device 600 to communicate with and / or control the accessory device. In some embodiments, the electronic device 600 determines that the wireless network of the home automation system is unavailable and / or disconnected based on the absence of communication with one or more accessory devices of the home automation system. For example, in some embodiments, the electronic device 600 periodically receives information from one or more accessory devices of the home automation system, the information including the status and / or current status of the one or more accessory devices. In some embodiments, when the electronic device 600 does not receive information from one or more accessory devices of the home automation system within a predetermined time, the electronic device 600 determines that the wireless network of the home automation system is unavailable and / or disconnected. In some embodiments, the electronic device 600 determines that the wireless network of the home automation system is unavailable and / or disconnected based on the absence of a connection between the electronic device 600 and the wireless network.

[0258] The electronic device 600 is configured to prioritize notifications (such as notification 666) displayed on the home user interface 604 based on the importance and / or urgency of the notifications. Figure 6OAt , electronic device 600 displays notification 668 and does not display notification 666 based on receiving information about an event having a higher priority than the wireless network being unavailable and / or disconnected (e.g., the event associated with notification 666). Figure 6O At this point, notification 668 relates to an accessory device of the home automation system detecting an alarm, such as a smoke alarm. Electronic device 600 displays notification 668 and does not display notification 666 because the detection of the alarm has a higher urgency than the unavailability and / or disconnection of the wireless network. Therefore, electronic device 600 displays the notification determined to be more important to the user and / or requiring action by the user of electronic device 600 on home user interface 604.

[0259] When the electronic device 600 receives information about multiple events that are determined to have the same importance and / or urgency, the electronic device 600 displays multiple notifications on the home user interface 604, such as Figure 6P As shown. Figure 6P At , the electronic device 600 displays notification 668 and notification 670 simultaneously on the home user interface 604. As described above, notification 668 relates to an accessory device of the home automation system detecting an alarm. Notification 670 relates to a security device of the home automation system detecting a security event, such as an event associated with a motion sensor, a glass break sensor, and / or an entry sensor. Figure 6P At , the electronic device 600 determines that the event associated with the notification 668 and the event associated with the notification 670 include the same priority level, importance, and / or urgency, and therefore, the electronic device 600 displays both the notification 668 and the notification 670 on the home user interface 604. In some embodiments, when the electronic device 600 receives information about more than two events having the same priority level, importance, and / or urgency, the electronic device 600 displays the more than two notifications on the home user interface 604. As explained above, when the electronic device detects an event having a higher priority level, importance, and / or urgency, the electronic device 600 does not display notifications associated with events having a lower priority level, importance, and / or urgency.

[0260] exist Figure 6P At , the electronic device 600 detects user input 6501 (e.g., a swipe gesture or other selection / navigation input) on the home user interface 604. In response to detecting the user input 6501, the electronic device 600 scrolls the home user interface 604 and displays the favorites area 672, the first room area 612, and the second room area 676, as shown in FIG. Figure 6Q shown.

[0261] exist Figure 6Q, the favorites area 672 of the home user interface 604 includes accessory user interface objects 672a-672d corresponding to respective accessory devices of the home automation system that have been designated as favorites. In some embodiments, the electronic device 600 designates an accessory device of the home automation system as a favorite accessory device in response to detecting one or more user inputs. In some embodiments, the user of the electronic device 600 designates an accessory device as a favorite accessory device when the user frequently controls and / or interacts with the accessory device via the electronic device 600. Figure 6Q , accessory user interface objects 672a-672d of favorites region 672 include room indicators 678 that indicate that the corresponding accessory devices are located in and / or associated with a location associated with the home automation system. Electronic device 600 displays room indicators 678 for accessory user interface objects 672a-672d of favorites region 672 because accessory devices from any room and / or area of ​​a location associated with the home automation system can be included and / or designated as favorite accessory devices. Figure 6Q At , the electronic device 600 does not display the room indicators 678 on the accessory user interface objects 612a-612c of the first room area 612 and / or on the accessory user interface objects 676a-676c of the second room area 676. The electronic device does not display the room indicators 678 on the accessory user interface objects 612a-612c and / or the accessory user interface objects 676a-676c because they are displayed in room areas corresponding to specific rooms and / or areas of a location associated with the home automation system (e.g., the first room area 674 and the second room area 676).

[0262] exist Figure 6R At , the electronic device 600 displays (e.g., in response to detecting the absence of user input for a predetermined amount of time and / or in response to detecting a request to display the wake screen user interface 680) a wake screen user interface 680 (e.g., a lock screen). The wake screen user interface 680 includes a time indicator 680a, a date indicator 680b, a home status indicator 680c, a weather indicator 680d, and an accessory user interface object 680e. The home status indicator 680c includes a summary of information associated with the home automation system so that a user can quickly view the information without providing authentication input to unlock the electronic device 600 (e.g., unlocking the electronic device 600 causes the electronic device 600 to display an additional user interface different from the wake screen user interface 680). For example, the home status indicator 680c includes status information for a climate category, a lighting category, and a security category of the home automation system. The status information of the home status indicator 680c is based on information received from one or more accessory devices of the home automation system. At Figure 6R At , the home status indicator 680c is divided into categories corresponding to the category user interface objects 606a-606c. In some embodiments, the home status indicator 680c includes different information and / or status related to the home automation system. In some embodiments, the electronic device 600 updates the home status indicator 680c when the electronic device 600 receives information from one or more accessory devices of the home automation system.

[0263] exist Figure 6R At the wake screen user interface 680, accessory user interface object 680e corresponds to a garage opener of the home automation system. In some embodiments, the electronic device 600 displays the accessory user interface object 680e in response to receiving one or more user inputs requesting that the accessory user interface object 680e be pinned and / or included on the wake screen user interface 680. In some embodiments, the electronic device 600 causes the garage opener to open and / or close the garage door in response to receiving the user input corresponding to the accessory user interface object 680e. In some embodiments, the electronic device 600 can cause the garage opener to open and / or close the garage door without detecting an authenticated user input to unlock the electronic device 600. In some embodiments, the electronic device 600 displays one or more accessory user interface objects corresponding to accessory devices of the home automation system that are distinct from the garage opener.

[0264] Figures 7A to 7G 700 is a flowchart illustrating a method for managing accessories of a home automation system using a computer system according to some embodiments. Method 700 is performed at a computer system (e.g., 100, 300, 500, and / or 600) (e.g., an electronic device; a smart device, such as a smart phone or smartwatch; a mobile device; a wearable device) that communicates with a display generation component (e.g., 602) (e.g., a display controller, a touch-sensitive display system, a projector, a display screen, a display monitor, and / or a holographic display) and one or more input devices (e.g., a touch-sensitive surface, a touch-sensitive display, a mouse, a keyboard, and / or a controller). Some operations in method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.

[0265] As described below, method 700 provides an intuitive way to manage accessories for a home automation system. This method reduces the cognitive burden on users of home automation system accessories, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to manage home automation system accessories more quickly and efficiently conserves power and increases the time between battery charges.

[0266] When a user interface (e.g., 604, 614, 638, and / or 660) associated with a home automation system (or application) (e.g., a system or application that includes one or more accessories and / or devices of a home and / or other building that can be controlled and / or adjusted via a computer system) is displayed via a display generating component (e.g., 602) (e.g., a default user interface of a home user interface and / or application that is configured to enable control of one or more accessories and / or devices that are part of the home automation system), including a plurality of selectable category options (e.g., 606a-606d) corresponding to respective contexts of the home automation system (e.g., functions, operations, and / or actions of the home automation system) (e.g., climate control, security control, and / or entertainment When a user interface (e.g., 604, 614, 638, and / or 660) of a home automation system (e.g., control) is accessed, the computer system (e.g., 100, 300, 500, and / or 600) detects (702) via one or more input devices a user input (e.g., 650a, 650f, and / or 650i) (e.g., a tap gesture) corresponding to a selection of a first selectable category option (e.g., 606a-606d) among a plurality of selectable category options (e.g., 606a-606d), wherein the first selectable category option (e.g., 606a-606d) among the plurality of selectable category options (e.g., 606a-606d) corresponds to a first context of the home automation system (e.g., a first function, operation, and / or action of the home automation system). In some embodiments, the context of the selectable category options (e.g., 606a-606d) does not include a physical location, such as a group of devices and / or accessories within a room and / or area of ​​a building, and / or device type (e.g., a group of devices all of the same type).

[0267] In response to detecting a user input (e.g., 650a, 650f, and / or 650i) corresponding to a selection of a first selectable category option (e.g., 606a-606d) of a plurality of selectable category options (e.g., 606a-606d), the computer system (e.g., 100, 300, 500, and / or 600) displays (704) (e.g., simultaneously displays) a first accessory user interface object (706) (e.g., 618a-618e, 644a-644d, and / or 660a-660f) (e.g., For example, a first user interface object and / or enable representation associated with a first accessory of a home automation system, which first user interface object and / or enable representation is configured to control and / or adjust the state and / or settings of the first accessory of the home automation system when selected), wherein the first accessory user interface object (e.g., 618a-618e, 644a-644d and / or 660a-660f) corresponds to a first accessory of the home automation system associated with a first context of a first selectable category option (e.g., the first accessory user interface object corresponds to a first accessory of the home automation system configured to perform a function consistent with the first context).

[0268] In response to detecting a user input (e.g., 650a, 650f, and / or 650i) corresponding to a selection of a first selectable category option (e.g., 606a-606d) of a plurality of selectable category options (e.g., 606a-606d), the computer system (e.g., 100, 300, 500, and / or 600) displays (704) (e.g., simultaneously displays) a second accessory user interface object (708) (e.g., 618a-618e, 644a-644d, and / or 660a-660f) (e.g., For example, a second user interface object and / or affordance associated with a second accessory of the home automation system, which second user interface object and / or affordance is configured to control and / or adjust the state and / or settings of the second accessory of the home automation system when selected), wherein the second accessory user interface object (e.g., 618a-618e, 644a-644d and / or 660a-660f) corresponds to a second accessory of the home automation system associated with the first context of the first selectable category option (e.g., the second accessory user interface object corresponds to a second accessory of the home automation system configured to perform functions consistent with the first context). In some embodiments, the user interface (e.g., 604, 614, 638 and / or 660) includes accessory user interface objects (e.g., 618a-618e, 644a-644d and / or 660a-660f) corresponding to all accessories of the home automation system configured to perform functions consistent with the first context. In some embodiments, the user interface (e.g., 604, 614, 638, and / or 660) does not include an accessory user interface object that does not correspond to an accessory of the home automation system that is not configured to perform a function consistent with the first context. In some embodiments, the first context includes climate control functionality, and the first accessory user interface object and the second accessory user interface object correspond to a thermostat, a fan, a heating device, a cooling device, a ventilator, a humidity device and / or sensor, and / or an air quality device and / or sensor. In some embodiments, the first context includes security functionality, and the first accessory user interface object and the second accessory user interface object correspond to an alarm, a lock, a window sensor, a door sensor, a security camera, and / or a glass break sensor.

[0269] In response to detecting user input (e.g., 650a, 650f, and / or 650i) corresponding to a selection of a first selectable category option (e.g., 606a-606d) from a plurality of selectable category options (e.g., 606a-606d), the computer system (e.g., 100, 300, 500, and / or 600) displays (704) (e.g., simultaneously displays) a first selectable subcategory option (710) (e.g., 616a-616c, 642a, and / or 642b) corresponding to a subcategory of the category associated with the first selectable category option (e.g., 606a-606d) via a display generation component (e.g., a user interface object and / or affordance that, when selected, is configured to cause the computer system to display one or more third accessory user interface objects corresponding to corresponding accessories of the home automation system that are associated with and / or belong to a subcategory of the first selectable subcategory option (e.g., the first selectable subcategory option). Selecting a subcategory option is associated with a subset of devices in the device that is associated with a first context of the first selectable category option), wherein the first selectable subcategory option (e.g., 616a-616c, 642a and / or 642b) includes status indications (e.g., 622a, 622b, 624a, 624b, 630a, 630b, 648a, 648b, 652a and / or 652b) related to one or more accessories of the home automation system associated with the subcategory (e.g., one or more accessories of the home automation system associated with a second context of the subcategory (such as a function, operation and / or action of the home automation system)) (e.g., information and / or feedback regarding a current state and / or status of the subset of devices of the subcategory, such as one or more temperatures, an indication of air quality, an indication of humidity, an indication of a number of devices in a predetermined state (e.g., an active state, an on state and / or an unlocked state), and / or an indication of an event detected by devices in the subset of devices).

[0270] Displaying the first accessory user interface object, the second accessory user interface object, and the first selectable subcategory option in response to detecting user input corresponding to selection of a first category selectable option allows a user of the computer system to view relevant information about a category of the home automation system without having to search for individual accessories in the category, thereby providing improved visual feedback and reducing the number of inputs required to perform operations.

[0271] In some embodiments, in response to detecting user input (e.g., 650a, 650f, and / or 650i) corresponding to a selection of a first selectable category option (e.g., 606a-606d) from a plurality of selectable category options (e.g., 606a-606d), a computer system (e.g., 100, 300, 500, and / or 600) displays (712) a plurality of accessory user interface objects (e.g., 618a-618e, 644a-644d, and / or 660a-660f) (e.g., a plurality of user interface objects and / or affordances associated with respective accessories of a home automation system, which, when selected, are configured to control and / or adjust states and / or settings of respective accessories of the home automation system) on a user interface (e.g., 604, 614, 638, and / or 660) via a display generation component (e.g., 602), The plurality of accessory user interface objects (e.g., 618a-618e, 644a-644d and / or 660a-660f) include a first accessory user interface object (e.g., 618a-618e, 644a-644d and / or 660a-660f) and a second accessory user interface object (e.g., 618a-618e, 644a-644d and / or 660a-660f), and wherein the plurality of accessory user interface objects (e.g., 618a-618e, 644a-644d and / or 660a-660f) correspond to all accessories of the home automation system associated with a first context of a first selectable category option (e.g., 606a-606d) (e.g., selection of the first selectable category option causes the computer system to display user interface objects of all accessories belonging to a category of the first selectable category option and / or corresponding to a category of the first selectable category option). In some embodiments, the computer system does not display multiple accessory user interface objects (e.g., 618a-618e, 644a-644d, and / or 660a-660f) simultaneously with each other. In some embodiments, the computer system displays a first subset of multiple accessory user interface objects (e.g., 618a-618e, 644a-644d, and / or 660a-660f) in response to detecting user input (e.g., 650a, 650f, and / or 650i) corresponding to a selection of a first selectable category option (e.g., 606a-606d), and displays a second subset of multiple accessory user interface objects (e.g., 618a-618e, 644a-644d, and / or 660a-660f) in response to detecting a second user input requesting to scroll a user interface (e.g., 614, 638, and / or 660) on which the multiple accessory user interface objects (e.g., 618a-618e, 644a-644d, and / or 660a-660f) are displayed.

[0272] Displaying multiple accessory user interface objects corresponding to all accessories of the home automation system associated with the first context of a first selectable category option allows a user of the computer system to quickly find and / or view accessories belonging to a particular category without having to search and / or provide additional user input, thereby providing improved visual feedback and reducing the number of inputs required to perform operations.

[0273] In some embodiments, when a first accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f), a second accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f), and a first selectable subcategory option (e.g., 616a-616c, 642a, and / or 642b) are displayed via a display generation component (e.g., 602), the computer system (e.g., 100, 300, 500, and / or 600) detects (714) a second user input (e.g., 650e) (e.g., a tap gesture) corresponding to a selection of the first accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f) via one or more input devices. In response to detecting a second user input (e.g., 650e) corresponding to a selection of a first accessory user interface object (e.g., 618a-618e, 644a-644d and / or 660a-660f), the computer system (e.g., 100, 300, 500 and / or 600) displays (716) via a display generation component (e.g., 602) a second user interface (e.g., 632 and / or 634) of the first accessory (e.g., a user interface including one or more control user interface objects that enable the computer system to adjust the operating state of the first accessory corresponding to the first accessory user interface object and / or one or more settings user interface objects that enable the computer system to modify and / or configure the settings of the first accessory corresponding to the first accessory user interface object) for controlling (e.g., adjusting the operating state of the first accessory (e.g., on, off, opened, shut down, locked, unlocked state, play and / or pause) and / or modifying and / or configuring the settings of the first accessory (e.g., audio settings, playback settings, automation settings, authorization settings and / or notification settings)). Displaying a second user interface for controlling the first accessory in response to detecting a second user input corresponding to selection of the first accessory user interface object allows a user of the computer system to quickly access controls for the first accessory, thereby reducing the number of inputs required to perform operations.

[0274] In some embodiments, the second user interface (e.g., 632 and / or 634) for controlling the first accessory includes a status user interface object (e.g., 634a) (e.g., a selectable user interface object, slider, switch, and / or enable representation) (e.g., including a visual indication of summary and / or related information about the first accessory, the second accessory, and / or additional accessories associated with the category of the first selectable category option), which, when selected, causes the computer system (e.g., 100, 300, 500, and / or 600) to adjust whether information associated with the first accessory (e.g., information received from the first accessory including measurements collected by the first accessory, data collected and / or captured by the first accessory, the current operating state of the first accessory, and / or events detected by the first accessory) is included in the status (e.g., 607a-607d) displayed on the first selectable category option (e.g., 606a-606d). Enabling the user to include information associated with the first accessory in the status displayed on the first selectable category option allows the user of the computer system to tailor information about the categories in the first selectable category that are most relevant to the user, thereby providing improved visual feedback.

[0275] In some embodiments, when displaying the first accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f), the second accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f), and the first selectable subcategory option (e.g., 616a-616c, 642a, and / or 642b) via the display generation component (e.g., 602), the computer system (e.g., , 100, 300, 500 and / or 600) detects (718) via one or more input devices a third user input (e.g., 650g and / or 650h) corresponding to a selection of a first accessory user interface object (e.g., 618a-618e, 644a-644d and / or 660a-660f) (e.g., a tap gesture corresponding to the first portion of the first accessory user interface object or a tap gesture corresponding to the second portion of the first accessory user interface object). In response to detecting a third user input (e.g., 650g and / or 650h) corresponding to a selection of a first accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f) (720) and based on determining that the third user input (e.g., 650g and / or 650h) corresponds to a first portion (e.g., 656a) of the first accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f). (e.g., a switching portion including a left portion, a right portion, a top portion, or a bottom portion of a first accessory user interface object), the computer system (e.g., 100, 300, 500, and / or 600) adjusts (722) the operating state of the first accessory from a first state (e.g., turned on, opened, unlocked, and / or outputting content) (e.g., transmitting data and / or information to the first accessory that causes the first accessory to change between operating states) to a second state (e.g., turned off, shut down, locked, and / or paused, and / or stopped outputting content).In response to detecting a third user input (e.g., 650g and / or 650h) corresponding to a selection of a first accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f) (720) and based on determining that the third user input (e.g., 650g and / or 650h) corresponds to a second portion (e.g., 656b) of the first accessory user interface object (e.g., 618a-618e, 644a-644d, and / or 660a-660f) that is distinct from the first portion (e.g., 656a) (e.g., a non-switched portion including a left portion, a right portion, a top portion, or a bottom portion of the first accessory user interface object) (e.g., the first portion and the second portion of the first accessory user interface object are visually distinct and / or do not overlap each other on the display generating component), the computer system (e.g., 100, 300) , 500 and / or 600) displays (724) a third user interface (e.g., 632 and / or 658) (e.g., a user interface including one or more control user interface objects that enable the computer system to adjust the operating state of the first accessory corresponding to the first accessory user interface object and / or one or more setting user interface objects that enable the computer system to modify and / or configure the settings of the first accessory corresponding to the first accessory user interface object) for controlling the first accessory (e.g., adjusting the operating state of the first accessory (e.g., turning on, off, opened, shut down, locked, unlocked, playing and / or paused) and / or modifying and / or configuring the settings of the first accessory (e.g., audio settings, playback settings, automation settings, authorization settings and / or notification settings)) via a display generation component (e.g., 602 (and optionally without adjusting the operating state of the first accessory). In some embodiments, the third user interface includes additional control user interface objects and / or setting user interface objects that adjust and / or control the operation of the first accessory in a manner different from the first portion of the first accessory user interface object.

[0276] A first accessory user interface object that includes different portions that perform different operations in response to user input allows a user of the computer system to quickly adjust the state of the first accessory and / or access additional controls for the first accessory, thereby reducing the amount of input required to perform the operation.

[0277] In some embodiments, when a first accessory user interface object (e.g., 618a-618e, 644a-644d and / or 660a-660f), a second accessory user interface object (e.g., 618a-618e, 644a-644d and / or 660a-660f), and a first selectable subcategory option (e.g., 616a-616c, 642a and / or 642b) are displayed via a display generation component (e.g., 602), the computer system (e.g., 100, 300, 500 and / or 600) detects (726) a fourth user input (e.g., 650d) (e.g., a tap gesture) corresponding to a selection of the first selectable subcategory option (e.g., 616a-616c, 642a and / or 642b) via one or more input devices. In response to detecting a fourth user input (e.g., 650d) corresponding to a selection of the first selectable subcategory option (e.g., 616a-616c, 642a, and / or 642b), the computer system (e.g., 100, 300, 500, and / or 600) displays (728) via the display generation component (602) a status indication (e.g., 622a, 622b) of the home automation system that facilitates the first selectable subcategory option (e.g., 616a-616c, 642a, and / or 642b). 2b, 624a, 624b, 630a, 630b, 648a, 648b, 652a and / or 652b) corresponding to a third accessory user interface object (730) (e.g., 618a-618e) (e.g., a third user interface object and / or affordance associated with a third accessory of the home automation system that, when selected, is configured to control and / or adjust a state and / or setting of the third accessory of the home automation system) (e.g., The computer system receives first information and / or data about a third accessory and displays a status indication of a first selectable subcategory option based on the first information and / or data), and a fourth accessory user interface object (732) (e.g., 618a-618e) corresponding to a fourth accessory of the home automation system that facilitates a status indication (e.g., 622a, 622b, 624a, 624b, 630a, 630b, 648a, 648b, 652a and / or 652b) of the home automation system (e.g., a fourth user interface object and / or enable representation associated with a fourth accessory of the home automation system, which, when selected, is configured to control and / or adjust the status and / or settings of the fourth accessory of the home automation system) (e.g., the computer system receives second information and / or data about the fourth accessory and displays a status indication of the first selectable subcategory option based on the second information and / or data).

[0278] Displaying the third accessory user interface object and the fourth accessory user interface object in response to detecting a fourth user input corresponding to a selection of a first subcategory option allows a user of the computer system to quickly view and / or access controls for a subset of accessories corresponding to the first subcategory, thereby providing improved visual feedback and reducing the number of inputs required to perform operations.

[0279] In some embodiments, when a third accessory user interface object (e.g., 618a-618e) and a fourth accessory user interface object (e.g., 618a-618e) are displayed via a display generating component (e.g., 602), the computer system (e.g., 100, 300, 500 and / or 600) detects (734) a fifth user input (e.g., a tap gesture) corresponding to a selection of the third accessory user interface object (e.g., 618a-618e) via one or more input devices. In response to detecting a fifth user input corresponding to a selection of the third accessory user interface object (e.g., 618a-618e), the computer system (e.g., 100, 300, 500, and / or 600) displays (736) via the display generating component (e.g., 602) a home automation system facilitating first selectable subcategory option (e.g., 616) for controlling (e.g., adjusting an operational state of the third accessory (e.g., on, off, opened, shut down, locked, unlocked, playing, and / or paused) and / or modifying and / or configuring settings of the third accessory (e.g., audio settings, playback settings, automation settings, authorization settings, and / or notification settings)). a-616c, 642a and / or 642b) of a fourth user interface (e.g., 632 and / or 658) of a third accessory (e.g., a user interface including one or more control user interface objects that enable the computer system to adjust the operating state of the third accessory corresponding to the third accessory user interface object and / or one or more setting user interface objects that enable the computer system to modify and / or configure the settings of the third accessory corresponding to the third accessory user interface object).

[0280] Displaying a fourth user interface for controlling the third accessory in response to detecting a fifth user input corresponding to selection of the third accessory user interface object allows a user of the computer system to quickly access controls for the third accessory, thereby reducing the number of inputs required to perform operations.

[0281] In some embodiments, when a third accessory user interface object (e.g., 618a-618e) and a fourth accessory user interface object (e.g., 618a-618e) are displayed via a display generating component (e.g., 602), the computer system (e.g., 100, 300, 500 and / or 600) detects (738) via one or more input devices a sixth user input (e.g., a gesture having a duration that satisfies a threshold duration) corresponding to a selection of the third accessory user interface object (e.g., 618a-618e). In response to detecting a sixth user input corresponding to selection of a third accessory user interface object (e.g., 618a-618e), the computer system (e.g., 100, 300, 500, and / or 600) displays (740) via the display generation component (e.g., 602) a state user interface object (e.g., 634a) (e.g., a selectable user interface object, a slider, a switch, and / or an affordance) that, when selected, causes the computer system (e.g., 100, 300, 500, and / or 600) to stop the home automation system from being used. The third accessory includes a status indicator (e.g., 622a, 622b, 624a, 624b, 630a, 630b, 648a, 648b, 652a and / or 652b) as a contributing factor to the first selectable subcategory option (e.g., 616a-616c, 642a and / or 642b) (e.g., the computer system does not display the status indicator for the first selectable subcategory option based on information about the third accessory, and / or the computer system ignores and / or does not receive information about the third accessory when determining what the status indicator includes).

[0282] Enabling the user to include information associated with the third accessory in the status indicator of the first selectable subcategory option allows a user of the computer system to customize the information displayed about the subcategory of the first selectable subcategory option that is most relevant to the user, thereby providing improved visual feedback.

[0283] In some embodiments, in response to detecting a third user input (e.g., 650d) corresponding to a selection of a first selectable subcategory option (e.g., 616a-616c, 642a, and / or 642b) (742) and based on determining that a fifth accessory of the home automation system satisfies a set of one or more enabling criteria (e.g., the fifth accessory includes a primary function and a secondary function, wherein the primary function of the first accessory is consistent with, corresponds to, and / or belongs to a subcategory of the first selectable subcategory option), the computer system (e.g., 100, 300, 500, and / or 600) via A fifth accessory user interface object (e.g., 618a-618e) corresponding to a fifth accessory of the home automation system is displayed (744) by a display generating component (e.g., 602) (e.g., a fifth user interface object and / or enable representation associated with the fifth accessory of the home automation system, which fifth user interface object and / or enable representation is configured to control and / or adjust the state and / or settings of the fifth accessory of the home automation system when selected) (e.g., the computer system displays an accessory user interface object associated with a subcategory of the first selectable subcategory option in response to detecting a selection of the first selectable subcategory option). In response to detecting a third user input (e.g., 650d) (742) corresponding to a selection of a first selectable subcategory option (e.g., 616a-616c, 642a and / or 642b) and based on determining that a fifth accessory of the home automation system does not satisfy one or more of the set of facilitating criteria (e.g., the fifth accessory includes a primary function and a secondary function, wherein the primary function of the fifth accessory is not consistent with, corresponds to, and / or belongs to a subcategory of the first selectable subcategory option (e.g., even where the secondary function is consistent with, corresponds to, and / or belongs to a subcategory of the first selectable subcategory option)), the computer system (e.g., 100, 300, 500, and / or 600) abandons (746) display of a fifth accessory user interface object (e.g., 618a-618e) corresponding to the fifth accessory of the home automation system (e.g., the computer system does not display an accessory user interface object that is not related to a subcategory of the first selectable subcategory option in response to detecting the selection of the first selectable subcategory option). In some embodiments, the subcategories of the first selectable subcategory options (e.g., 616a-616c, 642a, and / or 642b) include a temperature subcategory, and the fifth accessory is a thermostat having a primary function of controlling temperature. Thus, in response to detecting a third user input (e.g., 650d) corresponding to a selection of the first selectable category option, the fifth user interface object (e.g., 618a-618e) is displayed.In some embodiments, the subcategories of the first selectable subcategory option include a temperature subcategory, and the fifth accessory is a smart speaker having a secondary function of measuring temperature. Accordingly, the fifth user interface object is not displayed in response to detecting the third user input corresponding to the selection of the first selectable category option because the primary function of the smart speaker is not to control temperature.

[0284] Forgoing display of the fifth accessory user interface object when the fifth accessory does not satisfy the set of one or more contributing criteria allows a user of the computer system to view the most relevant accessories for the subcategory of the first selectable subcategory option, thereby providing improved visual feedback.

[0285] In some embodiments, displaying a user interface (e.g., 604, 614, 638, and / or 660) that includes a plurality of selectable category options (e.g., 606a-606d) corresponding to respective contexts of a home automation system includes: based on determining that a set of one or more status criteria are satisfied (e.g., one or more accessory devices associated with a first context of a first selectable category option are active (e.g., turned on, opened, unlocked, actively measuring and / or collecting data and / or outputting content) and / or have detected (e.g., within a predetermined amount of time from a current time) an event (e.g., a motion detection event and / or a security alert)), a computer system (e.g., , 100, 300, 500 and / or 600) displays a first selectable category option (e.g., 606a-606d) of a plurality of selectable category options (e.g., 606a-606d) via a display generating component as having a status indicator (e.g., 607a-607d) (e.g., information and / or feedback about the current state and / or status of one or more accessories associated with the category of the first selectable category option, such as one or more temperatures, indications of air quality, indications of humidity, indications of the number of accessories in a predetermined state (e.g., an active state, an on state and / or an unlocked state), and / or indications of events detected by the accessories). In some embodiments, displaying a user interface (e.g., 604, 614, 638, and / or 660) including a plurality of selectable category options (e.g., 606a-606d) corresponding to respective contexts of the home automation system includes: displaying a user interface (e.g., 604, 614, 638, and / or 660) including a plurality of selectable category options corresponding to respective contexts of the home automation system based on determining that one or more status criteria of the set are not satisfied (e.g., no accessory device associated with the first context of the first selectable category option is in an active state (e.g., turned on, opened, unlocked, actively measuring and / or collecting data and / or outputting content) and / or detected (e.g., at a predetermined time from the current time) time) event (e.g., a motion detection event and / or a security alert)), the computer system (e.g., 100, 300, 500 and / or 600) displays a first selectable category option (e.g., 606a-606d) of a plurality of selectable category options (e.g., 606a-606d) without a status indicator (e.g., 607a-607d) (e.g., the first selectable category option is displayed without information and / or feedback about the current state and / or status of one or more accessories associated with the category of the first selectable category option).

[0286] Displaying the status indicator when one or more status criteria are met and forgoing displaying the status indicator when one or more status criteria are not met provides information to a user of the computer system that may require action by the user, thereby providing improved visual feedback.

[0287] In some embodiments, the set of one or more state criteria includes criteria that are met when a sixth accessory of the home automation system associated with the first context of the first selectable category option (e.g., 606a-606d) is in an active state (e.g., an on state, an open state, an unlocked state, a state including actively measuring and / or collecting data, and / or a state including outputting content). Displaying the state indicator when the sixth accessory is in the active state provides information to a user of the computer system that may require action by the user, thereby providing improved visual feedback.

[0288] In some embodiments, a computer system (e.g., 100, 300, 500, and / or 600) displays (748) a first selectable category option (e.g., 606a-606d) via a display generating component (e.g., 602) as having a first state indicator (e.g., 607a-607d) corresponding to a first state of a category associated with the first selectable category option (e.g., 606a-606d) (e.g., first information and / or feedback regarding a current state and / or status of one or more accessories associated with the category of the first selectable category option, such as one or more temperatures, indications of air quality, indications of humidity, indications of the number of accessories in a predetermined state (e.g., an active state, an on state, and / or an unlocked state), and / or indications of events detected by the accessories), wherein the first state includes a first priority (e.g., a first importance and / or urgency level). In response to receiving an indication (750) of a change in state of a category (e.g., 606a-606d) associated with a first selectable category option (e.g., the state of the category associated with the first selectable category option changes from a first state to a second state or from a first state to a third state) and based on determining that the change in state indicates a second state of the category associated with the first selectable category option (e.g., 606a-606d), the second state including a second priority level that is greater than or equal to the first priority level (e.g., a second importance and / or urgency level that is the same as and / or greater than the first priority level), the computer system (e.g., 100, 300, 500, and / or 600), via the display generation component (e.g., 602), displays (750) the first selectable category option (e.g., 606a-606d). 2) having a second state indicator (e.g., 607a-607d) corresponding to a second state (e.g., second information and / or feedback regarding the current state and / or status of one or more accessories associated with the category of the first selectable category option, such as one or more temperatures, indications of air quality, indications of humidity, indications of the number of accessories in a predetermined state (e.g., an active state, an on state, and / or an unlocked state), and / or indications of events detected by the accessories) (e.g., the computer system modifies and / or the first selectable category option to reflect the second state because the second state is determined to be at least as relevant and / or useful to a user of the computer system as the first state) (in some embodiments, the computer system replaces display of the first state indicator with the second state indicator).In response to receiving an indication (750) of a change in state of a category (e.g., 606a-606d) associated with a first selectable category option (e.g., the state of the category associated with the first selectable category option changes from a first state to a second state or from a first state to a third state) and based on determining that the change in state indicates a third state of the category associated with the first selectable category option (e.g., 606a-606d), the third state comprising a third priority lower than the first priority (e.g., a third importance and / or urgency level lower than the first priority), the computer system (e.g., 100, 300, 500, and / or 600) maintains (754) displaying the first selectable category option (e.g., 606a-606d) with a first state indicator (e.g., 607a-607d) corresponding to the first state (e.g., the computer system does not modify and / or update the first selectable category option to reflect the third state because the first state is determined to be more relevant to and / or more useful to a user of the computer system than the third state).

[0289] Displaying the second state indicator when the second state has a higher priority than the first state and maintaining display of the first state indicator when the third state has a lower priority than the first state provides the user of the computer system with the most timely and / or relevant information that may require the user to take action, thereby providing improved visual feedback.

[0290] In some embodiments, the user input (e.g., 650a, 650f, and / or 650i) is of a first type (e.g., a tap gesture). In response to detecting a seventh user input (e.g., 650f) corresponding to a selection of a first selectable category option (e.g., 606a-606d) of a second type (e.g., a gesture having a duration that satisfies a threshold duration) different from the first type via one or more input devices (e.g., the second user input of the second type is detected for a longer period of time than the first user input, and / or the end of the first type of user input is detected before a predetermined amount of time has elapsed since the first type of user input was first detected), the computer system (e.g., 100, 300, 500, and / or 600) displays (756) the first selectable category option (e.g., 606a-606d) via the display generation component (e.g., 602). A selection option (e.g., 640a) (e.g., a selectable user interface object and / or an affordance) that, when selected, causes one or more accessories of the home automation system associated with a first context of a first selectable category option (e.g., 606a-606d) (e.g., all accessories of the home automation system associated with the first context of the first selectable category option and / or all accessories of the home automation system associated with the first context of the first selectable category option and in a predefined state) to perform a predetermined action (e.g., causing each of the one or more accessories to transition between a first operating state (e.g., turned on, opened, unlocked, and / or outputting content) and a second operating state (e.g., turned off, shut down, locked, and / or not outputting content)).

[0291] Displaying selectable options in response to detecting the seventh user input of the second type allows a user of the computer system to adjust and / or control multiple accessory devices together without having to provide multiple inputs to control each accessory device individually, thereby reducing the number of inputs required to perform operations.

[0292] In some embodiments, in response to detecting a seventh user input (e.g., 650a, 650f, and / or 650i) of a second type, different from the first type, corresponding to a selection of a first selectable category option (e.g., 606a-606d) among a plurality of selectable category options (e.g., 606a-606d), the computer system (e.g., 100, 300, 500, and / or 600) displays (758) a second selectable option (e.g., 640b) (e.g., a selectable user interface object and / or affordance) via the display generation component (e.g., 602), which, when selected, causes the computer system (e.g., 100, 300, 500, and / or 600) to display a third user interface object. In one embodiment, the computer system displays a third user interface (e.g., 614, 628, 638, and / or 660) (e.g., a user interface that includes one or more accessory user interface objects but does not include multiple selectable category options and / or a first selectable sub-category option), the third user interface includes one or more accessory user interface objects (e.g., 618a-618e, 644a-644d, and / or 660a-660f) corresponding to one or more accessories of the home automation system associated with the first context of the first selectable category option (e.g., 606a-606d) (e.g., the third user interface includes accessory user interface objects corresponding to all accessories of the home automation system associated with the first context of the first selectable category option). Displaying the second selectable option in response to detecting the seventh user input of the second type allows a user of the computer system to quickly view accessories included in the category of the first selectable category option, thereby improving visual feedback and reducing the number of inputs required to perform an operation.

[0293] In some embodiments, a first selectable category option (e.g., 606a-606d) among the plurality of selectable category options (e.g., 606a-606d) includes a first appearance (e.g., a first color, a first brightness, a first contrast, a first hue, and / or a first icon, image, and / or symbol) associated with a first context of the home automation system (e.g., the first appearance visually indicates a function, operation, and / or action of the home automation system that is performed, monitored, and / or controlled by one or more accessory devices included in the category associated with the first selectable category option), and the plurality of selectable category options The second selectable category options (e.g., 606a-606d) in (e.g., 606a-606d) include a second appearance (e.g., a second color, a second brightness, a second contrast, a second hue, and / or a second icon, image, and / or symbol) associated with a second context of the home automation system that is different from the first appearance (e.g., the second appearance is visually distinguishable from the first appearance) (e.g., the second appearance visually indicates a function, operation, and / or action of the home automation system that is performed, monitored, and / or controlled by one or more accessory devices included in the category associated with the second selectable category option). Displaying the first selectable category option with the first appearance and displaying the second selectable category option with a second appearance that is different from the first appearance allows a user of the computer system to easily determine the category associated with the selectable category option and / or distinguish the selectable category options from each other, thereby improving visual feedback.

[0294] In some embodiments, the user interface (e.g., 604) includes (e.g., displayed simultaneously with multiple selectable category options) a first notification (e.g., 666, 668, and / or 670) associated with the home automation system (e.g., a banner, user interface object, and / or affordance that includes information, such as text, images, symbols, icons, and / or visual elements, about an event associated with the home automation system (such as a safety and / or security event detected by an accessory of the home automation system, an event affecting communication between the computer system and one or more accessories of the computer system (e.g., an accessory is offline, the Internet connection is interrupted and / or unavailable, and / or power is not supplied to one or more accessories), and / or an event associated with setting up and / or configuring one or more accessories) that may require user action. In some embodiments, the computer system (e.g., 100, 300, 500, and / or 600) maintains displaying the notification (e.g., 666, 668, and / or 670) until the event associated with the notification has been resolved. In some embodiments, the computer system maintains displaying the notification until the computer system detects user input corresponding to the notification. In some embodiments, the computer system maintains displaying the notification until the computer system detects a second event having a higher priority and / or urgency than the first event associated with the notification. In some embodiments, the notification is associated with setting up and / or configuring one or more accessories and / or the home automation system when the computer system has not detected and / or received an indication of an event associated with and / or detected by an accessory of the home automation system. Displaying a notification associated with the home automation system provides information to a user of the computer system about the event that may require action by the user, thereby providing improved visual feedback.

[0295] In some embodiments, the first notification (e.g., 666, 668, and / or 670) corresponds to a first event of a first type (e.g., an event having a first priority, a first importance level, and / or a first urgency) (e.g., a safety and / or security event detected by an accessory of the home automation system, an event affecting communication between the computer system and one or more accessories of the computer system (e.g., an accessory is offline, the Internet connection is interrupted and / or unavailable, and / or power is not supplied to one or more accessories), and / or an event associated with setting up and / or configuring one or more accessories). In response to receiving an indication (760) of a second event of a second type (e.g., an event having a second priority, a second importance level, and / or a second urgency) that is different from the first type (e.g., an event having a second priority, a second importance level, and / or a second urgency), and based on determining the second event of the second type, Because the event is associated with a lower priority (e.g., a lower level of importance and / or a lower urgency) than the first event of the first type, the computer system (e.g., 100, 300, 500, and / or 600) forgoes (762) display of (e.g., does not display) a second notification (e.g., 666, 668, and / or 670) corresponding to a second event of the second type (e.g., a banner, user interface object, and / or affordance that includes information about the event associated with the home automation system that may require user action, such as text, images, symbols, icons, and / or visual elements).

[0296] Forgoing display of the second notification corresponding to the second event of the second type provides information to the user of the computer system regarding the most relevant and / or urgent events that may require action by the user, thereby providing improved visual feedback.

[0297] In some embodiments, the first notification (e.g., 666, 668, and / or 670) corresponds to a first event of a first type (e.g., an event having a first priority, a first level of importance, and / or a first degree of urgency) (e.g., a safety and / or security event detected by an accessory of the home automation system, an event affecting communication between the computer system and one or more accessories of the computer system (e.g., an accessory is offline, the Internet connection is interrupted and / or unavailable, and / or power is not supplied to one or more accessories), and / or an event associated with setting up and / or configuring one or more accessories). In response to receiving an indication of a third event (e.g., a safety and / or security event detected by an accessory of the home automation system, an event affecting communication between the computer system and one or more accessories of the computer system (e.g., an accessory is offline, the Internet connection is interrupted and / or unavailable, and / or power is not supplied to one or more accessories), and / or an event associated with setting up and / or configuring one or more accessories) of a first type (e.g., the third event includes the same priority, importance level, and / or urgency as the first event), the computer system (e.g., 100, 300, 500, and / or 600) displays (764) a third notification (e.g., 666, 668, and / or 670) (e.g., a banner, user interface object, and / or affordance that includes information about the event associated with the home automation system that may require user action, such as text, images, symbols, icons, and / or visual elements) via a display generating component (e.g., 602) and simultaneously with the first notification (e.g., 666, 668, and / or 670) corresponding to the third event of the first type.

[0298] Concurrently displaying the first notification and the third notification provides information to a user of the computer system regarding multiple events that may require action by the user, thereby providing improved visual feedback.

[0299] In some embodiments, in response to detecting user input (e.g., 650a, 650f, and / or 650i) corresponding to a selection of a first selectable category option (e.g., 606a-606d) from a plurality of selectable category options (e.g., 606a-606d), a computer system (e.g., 100, 300, 500, and / or 600) displays (766) via a display generation component (e.g., 602) a first camera view user interface object (e.g., 644a) associated with a first camera associated with a first context of the first selectable category option (e.g., 606a-606d) (e.g., a user interface object that includes images and / or video (e.g., a live video feed) captured by a first camera of the home automation system). Displaying the first camera view user interface object in response to detecting user input corresponding to selection of the first selectable category option allows a user of the computer system to obtain additional information about a location associated with the home automation system, thereby providing improved visual feedback.

[0300] It should be noted that the above description with respect to method 700 (e.g., Figures 7A to 7G ) also apply in a similar manner to the methods described below. For example, methods 900, 1100, 1300, and / or 1500 optionally include one or more features of the various methods described above with reference to method 700. For example, a computer system executing methods 900, 1100, 1300, and / or 1500 may display a first accessory user interface object, a second accessory user interface object, and / or a first selectable subcategory option in response to detecting a selection of a first selectable category option. For the sake of brevity, these details are not repeated below.

[0301] Figures 8A to 8P Illustrated are exemplary user interfaces for managing accessory groups according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including 9A to 9C in the process.

[0302] In some embodiments, any of the inputs described herein (e.g., inputs 850a, 850b, 850c, 850d, 850e, 850f, 850g, 850h, 850i, 850j, 850k, 850l, 850m, and / or 850n) is or includes a touch input (e.g., a tap gesture and / or a swipe gesture). In some embodiments, any of the inputs described herein (e.g., inputs 850a, 850b, 850c, 850d, 850e, 850f, 850g, 850h, 850i, 850j, 850k, 850l, 850m, and / or 850n) is or includes a voice input (e.g., a voice command for selecting a user interface element or for activating a feature or performing a function, such as a feature or function associated with a user interface element). In some embodiments, any of the inputs described herein (e.g., inputs 850a, 850b, 850c, 850d, 850e, 850f, 850g, 850h, 850i, 850j, 850k, 850l, 850m and / or 850n) is or includes an air gesture (e.g., an air gesture for selecting a user interface element or for activating a feature or performing a function, such as a feature or function associated with a user interface element). In some embodiments, any of the inputs described herein (e.g., inputs 850a, 850b, 850c, 850d, 850e, 850f, 850g, 850h, 850i, 850j, 850k, 850l, 850m, and / or 850n) is or includes activation (e.g., pressing, rotating, and / or moving) of a hardware device (e.g., a button, a rotatable input mechanism, a rotatable depressible input mechanism, a mouse button, a remote control button, and / or a joystick). In some embodiments, any of the user interface elements described herein as being selected (e.g., an icon, an affordance, a button, and / or a selectable option) is selected by activating a hardware device while the user interface element is in focus (e.g., highlighted, bolded, outlined, visually distinguished from other user interface elements, and / or located at or near a cursor).

[0303] Figure 8A The electronic device 600 is illustrated as displaying a home user interface 604 associated with a home automation system via a display 602. Figure 8A , the home user interface 604 includes a home indicator 604a (e.g., "123 Main Street") that provides an indication of a location (e.g., a physical address) associated with the home automation system. In addition, the home user interface 604 includes a category area 606, a camera area 608, a scene area 610, and a first room area 612.

[0304] The scene area 610 includes scene user interface objects 610a and 610b, which correspond to predetermined automations for adjusting the state of one or more accessory devices of the home automation system. In some embodiments, scenes enable the electronic device 600 to control and / or adjust the state of one or more accessory devices of the home automation system via user input based on the location of the electronic device 600 and / or based on satisfying a condition (e.g., the current time of day is a predetermined time associated with activating and / or deactivating a scene). In some embodiments, scenes are user-defined, in that the user selects which accessory devices of the home automation system are included in the scene and how the selected accessory devices are controlled when the scene is activated. In some embodiments, scenes are predetermined and / or suggested by the electronic device 600 based on user habits. In some embodiments, the electronic device 600 selects a scene user interface object (e.g., scene user interface objects 610a and / or 610b) in response to a single user input to control and / or adjust the state of multiple accessory devices of the home automation system. Thus, scenes allow the user to easily control accessory devices and / or groups of accessory devices of the home automation system and reduce the number of user inputs required to control and / or adjust accessory devices and / or groups of accessory devices.

[0305] exist Figure 8A In some embodiments, the electronic device 600 displays the scene user interface objects 610a and 610b at the first location 800a and the second location 800b of the scene area 610, respectively. As explained below, in some embodiments, the electronic device 600 displays the scene user interface objects 610a and 610b at the first location 800a and the second location 800b, respectively, based on a set of criteria. For example, in some embodiments, the electronic device 600 arranges and / or displays the scene user interface objects 610a and 610b within the scene area 610 based on context-based conditions (such as time of day, location of the electronic device 600, and / or habits of the user) that indicate which scene user interface objects are more likely to be used and / or interacted with by the user.

[0306] In some embodiments, the electronic device 600 arranges and / or displays the scene user interface objects 610a and 610b in the scene area 610 based on the number of scene user interface objects. In some embodiments, because the scene area 610 includes Figure 8AIn some embodiments, when the scene area 610 includes a predetermined number of scene user interface objects (e.g., two) or less than a predetermined number of scene user interface objects, the electronic device 600 does not arrange and / or display the scene user interface objects according to the context-based conditions.

[0307] exist Figure 8A At , the electronic device 600 displays a first scene user interface object 610a having a scene indicator 801a and a second scene user interface object 610b having a scene indicator 801b. The scene indicator 801a and the scene indicator 801b provide visual indications of the respective scenes corresponding to the first scene user interface object 610a and the second scene user interface object 610b, respectively. For example, at Figure 8A At , the scene indicator 801a includes an icon of a person leaving home, which indicates that the scene associated with the first scene user interface object 610a is relevant to the user when the user leaves and / or is about to leave the location associated with the home automation system. The scene indicator 801b includes an icon of a sunrise, which indicates that the scene associated with the second scene user interface object 610b is relevant to the user during the morning hours of the day. As described below with reference to Figure 8M As illustrated, the electronic device 600 may change and / or modify the scene indicator 801a and / or the scene indicator 801b (eg, change and / or modify the appearance of the scene indicator 801a and / or the scene indicator 801b) in response to detecting one or more user inputs.

[0308] exist Figure 8A At , the electronic device 600 detects a user input 850a (e.g., a tap gesture or other selection / navigation input) corresponding to the add user interface object 802 of the home user interface 604. In response to detecting the user input 850a, the electronic device 600 displays the menu 804, such as Figure 8A As shown. Figure 8A At , the electronic device 600 detects a user input 850b (e.g., a tap gesture or other selection / navigation input) corresponding to the add scene user interface object 804a of the menu 804. In response to detecting the user input 850b, the electronic device 600 displays the add scene user interface 806, as shown in FIG. Figure 8B shown.

[0309] exist Figure 8BAt , the add scene user interface 806 enables the electronic device 600 to create a new scene and / or display a new scene user interface object associated with the new scene on the scene area 610. The add scene user interface 806 includes a scene name user interface object 806a and an add accessories user interface object 806b. Figure 8B At 806a, the electronic device 600 detects user input 850c (e.g., a tap gesture or other selection / navigation input) corresponding to the selection of the scene name user interface object 806a. In some embodiments, in response to detecting the user input 850c, the electronic device 600 displays a keyboard (e.g., a virtual keyboard) that enables the user of the electronic device 600 to provide and / or enter the name of the new scene. In some embodiments, the electronic device 600 detects one or more user inputs associated with naming the new scene "Morning" (e.g., Figure 8D shown). Figure 8B At , the electronic device 600 detects user input 850d (eg, a tap gesture or other selection / navigation input) corresponding to the add accessory user interface object 806b. In response to detecting the user input 850d, the electronic device 600 displays the accessory user interface 808, such as Figure 8C shown.

[0310] exist Figure 8C At , the accessory user interface 808 includes accessory user interface objects 808a-808e corresponding to respective accessory devices of the home automation system. Figure 8C At , the electronic device 600 arranges and / or sorts the accessory user interface objects 808a-808e by room of a location associated with the home automation system. In some embodiments, the electronic device 600 arranges and / or sorts the accessory user interface objects 808a-808e based on different criteria (e.g., alphabetical order). In some embodiments, the accessory user interface 808 includes all accessory devices of the home automation system (e.g., such as all accessory devices that have been associated with the home automation system via user input). In some embodiments, the accessory user interface 808 includes more than five accessory user interface objects and is scrollable. For example, in some embodiments, the electronic device 600 displays additional accessory user interface objects on the accessory user interface 808 in response to detecting a swipe and / or scroll gesture. Figure 8C At , the electronic device 600 detects a user input 850e (e.g., a tap gesture or other selection / navigation input) corresponding to the first accessory user interface object 808a. In response to detecting the user input 850e, the electronic device 600 displays the scene user interface 810, such as Figure 8D shown.

[0311] exist Figure 8DAt , the scene user interface 810 includes a scene name user interface object 810a, which includes a scene name user interface object 810b. Figure 8B The scene user interface 810 includes a first accessory user interface object 810b based on a selection of the first accessory user interface object 808a (e.g., in response to user input 850e). Figure 8D , a first accessory user interface object 810b is associated with a bedside lamp of a home automation system. The first accessory user interface object 810b indicates that the bedside lamp is configured to turn on when a scene is activated (e.g., a user input selecting a scene user interface object). In some embodiments, in response to a user input selecting the first accessory user interface object 810b (e.g., a gesture or other selection / navigation input having a duration that satisfies a threshold duration), the electronic device 600 displays one or more selectable options corresponding to various controls and / or adjustments to the bedside lamp that the electronic device 600 can perform when the scene is activated.

[0312] exist Figure 8D At , the electronic device 600 detects a user input 850f (e.g., a tap gesture or other selection / navigation input) corresponding to a selection of the user interface object 810c that completes the scene user interface 810. In response to detecting the user input 850f, the electronic device 600 creates a new scene (e.g., a morning scene) and displays the home user interface 604, as shown in FIG. Figure 8E shown.

[0313] exist Figure 8E At , the scene area 610 of the home user interface 604 includes a first scene user interface object 610a, a second scene user interface object 610b, and a third scene user interface object 610c. The third scene user interface object 610c corresponds to a new scene created by the electronic device 600 in response to detecting the user input 850f. Figure 8E , the first scenario user interface object 610a is displayed at the second location 800b on the home user interface 604, the second scenario user interface object 610b is displayed at the first location 800a, and the third scenario user interface object 610c is displayed at the third location 800c. As explained above, in some embodiments, the electronic device 600 displays the scenario user interface objects 610a-610c in different arrangements and / or at different locations on the home user interface 604 according to context-based conditions. In some embodiments, when the home automation system includes more than a predetermined number of scenes (e.g., more than two scenes), the electronic device 600 determines the corresponding locations of the scenario user interface objects 610a-610c according to the context-based conditions.

[0314] exist Figure 8E Where, with Figure 8A , the electronic device 600 has changed (e.g., switched) the positioning of the first scene user interface object 610a and the second scene user interface object 610b compared to the corresponding positioning shown at . In some embodiments, the first positioning 800a of the home user interface 604 is the primary positioning that facilitates the user to interact with the scene user interface object displayed at the first positioning 800a. In some embodiments, the scene user interface object displayed at the first positioning 800a corresponds to a suggested scene and / or the scene that the electronic device 600 determines (e.g., predicts) is most relevant to the user (e.g., compared to other scenes of the home automation system). For example, in some embodiments, the electronic device 600 determines the priority of the scenes associated with the displayed scene user interface objects (e.g., scene user interface objects 610a-610c) according to context-based conditions. In some embodiments, the electronic device 600 determines the likelihood of the user selecting a scene, activating a scene, and / or interacting with a scene based on the current time of day, the location of the electronic device 600, and / or the user's habits (e.g., historical user input occurring within the same time range within the use cycle of the electronic device 600). In some embodiments, the electronic device 600 determines the priority of the scenes according to context-based conditions and displays the scene user interface object associated with the scene with the highest priority at position 800a, displays the scene user interface object associated with the scene with the second highest priority at position 800b, and displays the scene user interface object associated with the scene with the third highest priority at position 800c.

[0315] exist Figure 8E At 800a, the electronic device 600 displays the second scene user interface object 610b at the first location 800a based on determining that the scene associated with the second scene user interface object 610b has the highest priority (e.g., is most likely to be selected, activated and / or interacted with compared to other scenes). For example, the second scene user interface object 610b corresponds to an evening scene that corresponds to a user-friendly adjustment of the state of one or more accessory devices of the home automation system during the evening hours of the day. Figure 8E At , the electronic device 600 indicates that the current time is 10:09 p.m. In some embodiments, the electronic device 600 determines that the evening scene associated with the second scene user interface object 610b is most likely relevant to the user because the current time is during the night / evening period.

[0316] exist Figure 8EAt 800 b, the electronic device 600 displays the first scene user interface object 610 a at the second location 800 b based on determining that the scene associated with the first scene user interface object 610 a is the next most relevant scene to the user after the evening scene. The first scene user interface object 610 a is associated with an away scene, which corresponds to a user-friendly adjustment of the state of one or more accessory devices of the home automation system when the user leaves the location associated with the home automation system. In some embodiments, the electronic device 600 determines that the away scene is the next most relevant scene and / or has the second highest priority because the user typically activates the away scene later in the day (e.g., historical usage of the electronic device 600 indicates that the user activates the away scene during the evening / night time).

[0317] exist Figure 8E At 800c, the electronic device 600 displays the third scene user interface object 610c at a third location 800c based on determining that the scene associated with the third scene user interface object 610c is the third most relevant scene for the user. As explained above, the third scene user interface object 610c is associated with a morning scene, which corresponds to a user-friendly adjustment of the state of one or more accessory devices of the home automation system during the morning hours of the day. In some embodiments, the electronic device 600 determines that the morning scene is the third most relevant scene and / or has the third highest priority based on the current time not being within the typical morning hours. Therefore, the electronic device 600 can arrange the scene user interface objects 610a-610c to display the scene user interface objects 610a-610c at corresponding locations that enable the user to quickly select the scene determined to be most relevant to the user.

[0318] exist Figure 8E At 8:00, the electronic device 600 detects user input 850g (e.g., a tap gesture or other selection / navigation input) corresponding to selection of the first scene user interface object 610a. In response to detecting the user input 850g, the electronic device 600 initiates a process for activating the scene associated with the first scene user interface object 610a and displays the first scene user interface object 610a in a different appearance, such as Figure 8F shown.

[0319] exist Figure 8FAt , the electronic device 600 displays a first scene user interface object 610a with an activation indicator 812. The activation indicator 812 includes a ring shape (e.g., a partial ring shape) to indicate and / or confirm that the electronic device 600 has initiated activation of the scene associated with the first scene user interface object 610a. In some embodiments, the electronic device 600 animates the activation indicator 812 so that the activation indicator 812 appears to turn and / or rotate over time. Figure 8F At this point, the electronic device 600 displays the activation indicator 812 and does not display the scene indicator 801a (eg, the electronic device 600 replaces (eg, temporarily replaces) the display of the scene indicator 801a with the activation indicator 812).

[0320] In some embodiments, the electronic device 600 displays the activation indicator 812 before receiving confirmation that one or more accessory devices associated with the scene have transitioned between states. For example, in some embodiments, the scene associated with the first scene user interface object 610a includes adjusting the operational state of one or more accessory devices of the home automation system, such as from an on state to an off state (or vice versa), from an open state to a shut down state (or vice versa), and / or from a locked state to an unlocked state (or vice versa). In some embodiments, the electronic device 600 communicates with one or more accessory devices to cause the one or more accessory devices to transition between operational states and / or receives information from one or more accessory devices confirming that the transition between operational states has occurred. Therefore, in some embodiments, the electronic device 600 displays the activation indicator 812 to confirm that the electronic device 600 is causing one or more accessory devices to transition between operational states, even though the one or more accessory devices may not have yet completed the transition.

[0321] exist Figure 8G At 814, the electronic device 600 determines that the operating state of one or more accessory devices of the scene (e.g., the scene associated with the first scene user interface object 610a) has been adjusted and / or transitioned (e.g., the electronic device 600 receives confirmation from the one or more devices). In response to determining that the operating state of the one or more accessory devices has been adjusted and / or transitioned, the electronic device 600 displays the first scene user interface object 610a having an appearance 814, such as Figure 8G As shown. Appearance 814 includes Figure 8A 、 8E and the appearance of the first scene user interface object 610a shown in FIG8F (e.g., by Figure 8A 、 8E and the unshaded line at 8F) (e.g., indicated by a different color, shade, brightness, darkness, and / or contrast than Figure 8G). Accordingly, electronic device 600 changes the appearance of first scene user interface object 610a to appearance 814 to provide visual confirmation that the scene has been activated (e.g., one or more accessory devices associated with the scene have transitioned between operating states).

[0322] exist Figures 8E to 8G At 800c, the electronic device 600 partially displays a third scene user interface object 610c at a third location 800c. The scene area 610 of the home user interface 604 is scrollable so that the user of the electronic device 600 can view and / or interact with additional scene user interface objects that are not displayed and / or partially displayed on the scene area 610. For example, at Figure 8G At , the electronic device 600 detects a user input 850h (e.g., a swipe gesture or other selection / navigation input) corresponding to the scene area 610. In response to detecting the user input 850h, the electronic device 600 scrolls and / or moves the scene user interface objects 610a-610c, such as Figure 8H shown.

[0323] exist Figure 8H At 850h, the electronic device 600 displays (e.g., fully displays) the third scene user interface object 610c in response to detecting the user input 850h. As the electronic device 600 scrolls and / or moves the scene user interface objects 610a-610c on the home user interface 604, the electronic device 600 maintains the order and / or respective positioning of the scene user interface objects 610a-610c relative to each other. For example, the electronic device 600 has not detected and / or determined (e.g., based on context-based conditions) a change in the priority of the scenes associated with the scene user interface objects 610a-610c, and therefore maintains the arrangement and / or order of the scene user interface objects 610a-610c within the scene area 610.

[0324] exist Figure 8I At 800a, the electronic device 600 determines that the priorities of the scenes associated with the scene user interface objects 610a-610c have changed. In response to detecting that the priorities of the scenes have changed, the electronic device 600 displays the third scene user interface object 610c at the first location 800a, displays the first scene user interface object 610a at the second location 800b, and displays the second scene user interface object 610b at the third location 800c. Figure 8IAt 6:45 a.m., the electronic device 600 indicates that the current time is 6:45 a.m. The electronic device 600 determines that the scene associated with the third scene user interface 610c has the highest priority compared to other scenes according to context-based criteria, and displays the third scene user interface object 610c at the first location 800a. In some embodiments, the electronic device 600 determines that the scene associated with the third scene user interface object 610c has the highest priority because the current time of day is 6:45 a.m., which is during the morning time of day. Therefore, the electronic device 600 determines that the morning scene associated with the third scene user interface object 610c may be most relevant to the user (e.g., compared to other scenes) and displays the third scene user interface object 610c at the first location 800a (e.g., the primary location within the scene area 610).

[0325] exist Figure 8I At 800 b, the electronic device 600 displays the first scene user interface object 610 a at the second location 800 b because the electronic device 600 determines that the leaving scene associated with the first scene user interface object 610 a comprises the second highest priority among the scenes of the electronic device 600. In some embodiments, the electronic device 600 determines that the leaving scene has the second highest priority based on the current time of day, the location of the electronic device 600, and / or the user's habits indicating that the user is likely to leave the location associated with the home automation system. The electronic device 600 displays the second scene user interface object 610 b at the third location 800 c based on determining that the evening scene comprises the third highest priority among the scenes. In some embodiments, the electronic device 600 displays the second scene user interface object 610 b at the third location 800 c based on the current time of day, the location of the electronic device 600, and / or the user's habits indicating that the user is unlikely to use and / or activate the evening scene.

[0326] exist Figure 8I At , the electronic device 600 detects a user input 850i corresponding to the third scene user interface object 610c (e.g., a gesture or other selection / navigation input having a duration that satisfies a threshold duration). In response to detecting the user input 850i, the electronic device 600 displays a menu 816, such as Figure 8J Additionally or alternatively, the electronic device 600 detects a user input 850j (e.g., a tap gesture or other selection / navigation input) corresponding to the scene user interface object 818 of the scene area 610. In response to detecting the user input 850j, the electronic device 600 displays the scene user interface 820, as shown. Figure 8K shown.

[0327] exist Figure 8JAt , the menu 816 includes selectable options 816a-816c that enable the electronic device 600 to configure and / or modify settings associated with the third scene user interface object 610c and / or the home user interface 604. For example, in some embodiments, in response to detecting a selection of the first selectable option 816a, the electronic device 600 displays a user interface (e.g., similar to the home user interface) that enables the electronic device 600 to edit, modify, and / or change the scene associated with the third scene user interface object 610c. Figure 8L In some embodiments, in response to detecting selection of the second selectable option 816b, the electronic device 600 stops displaying the third scene user interface object 610c on the home user interface 604 (e.g., on the scene area 610 of the home user interface 604). In some embodiments, in response to selection of the second selectable option 816b, the electronic device 600 displays a user interface object corresponding to the scene associated with the third scene user interface object 610c on the scene user interface 820 (e.g., Figure 8K ), but does not display the third scene user interface object 610c on the home user interface 604. In some embodiments, in response to detecting selection of the third selectable option 816c, the electronic device 600 activates an editing mode that allows the user to rearrange the user interface objects displayed on the home user interface 604. Figures 14A to 14M The editing mode of the electronic device 600 is discussed.

[0328] As explained above, in response to detecting the user input 850j corresponding to the selection of the scene user interface object 818, the electronic device 600 displays the scene user interface 820, such as Figure 8K As shown. Figure 8K At , the scene user interface 820 includes scene user interface objects 820a-820d. The first scene user interface object 820a corresponds to the first scene user interface object 610a of the home user interface 604, the third scene user interface object 820c corresponds to the second scene user interface object 610b of the home user interface 604, and the fourth scene user interface object 820d corresponds to the third scene user interface object 610c of the home user interface 604. The second scene user interface object 820b does not correspond to the Figures 8A to 8J The scene user interface object displayed on the home user interface 604 at Figure 8LAs discussed, in some embodiments, the second scene user interface object 820b corresponds to a scene of the home automation system that has been designated not to be displayed on the home user interface 604. In some embodiments, the scene user interface 820 includes scene user interface objects corresponding to all scenes of the home automation system (e.g., regardless of whether the scene has been designated to be displayed on the home user interface 604). In some embodiments, even when a scene is designated not to be displayed on the home user interface 604, the scene user interface object for the scene is still displayed on the scene user interface 820. Thus, a user of the electronic device 600 can view, interact with, and / or modify scenes of the home automation system via the scene user interface 820.

[0329] exist Figure 8K At , the electronic device 600 detects a user input 850k (e.g., a tap gesture or other selection / navigation input) corresponding to a selection of the second scene user interface object 820b. In response to detecting the user input 850k, the electronic device 600 displays the scene setting user interface 822, as shown in FIG. Figure 8L Additionally or alternatively, the electronic device 600 detects a user input 8501 (e.g., a tap gesture or other selection / navigation input) corresponding to a selection of the setting user interface object 820e of the scenario user interface 820. In response to detecting the user input 8501, the electronic device 600 displays the scenario suggestion user interface 824, as shown. Figure 8O shown.

[0330] exist Figure 8L At 820b, the scene setting user interface 822 includes an appearance user interface object 822a, an accessories area 826, a test scene user interface object 822b, an edit accessory user interface object 822c, a display user interface object 822d, and a delete scene user interface object 822e. The accessories area 826 includes accessory user interface objects 826a-826c corresponding to respective accessory devices that are controlled and / or adjusted when the scene associated with the second scene user interface object 820b is activated. Although Figure 8L The accessories area 826 at includes three accessory user interface objects 826a-826c corresponding to three corresponding accessory devices of the home automation system, but in some embodiments, the electronic device 600 can add or remove accessories associated with the scene via user input (e.g., user input 850n) selecting edit accessory user interface object 822c.

[0331] exist Figure 8LAt , the display user interface object 822d is in an inactive and / or closed position indicating that the electronic device 600 does not display a scenario user interface object corresponding to the scene (e.g., the "Arriving Home" scene) on the home user interface 604. As explained above, the electronic device 600 maintains display of the second scenario user interface object 820b on the scenario user interface 820 even though the electronic device 600 does not display the scenario user interface object corresponding to the scene on the home user interface 604. In some embodiments, in response to detecting user input selecting the display user interface object 822d, the electronic device 600 displays the scenario user interface object corresponding to the scene on the home user interface 604 (and optionally, displays the display user interface object 822d with a different appearance to indicate that the display user interface object 822d is in the active and / or opened position).

[0332] exist Figure 8L At , the electronic device 600 detects a user input 850m (e.g., a tap gesture or other selection / navigation input) corresponding to a selection of the appearance user interface object 822a. In response to detecting the user input 850m, the electronic device 600 displays the appearance settings user interface 828, such as Figure 8M Additionally or alternatively, the electronic device 600 detects user input 850n (e.g., a tap gesture or other selection / navigation input) corresponding to editing the accessory user interface object 822c. In response to detecting the user input 850n, the electronic device 600 displays the accessory user interface 830, as shown. Figure 8N shown.

[0333] exist Figure 8M At , the appearance settings user interface 828 enables the electronic device 600 to modify, change and / or customize the appearance of the second scene user interface object 820b. The appearance settings user interface 828 includes an appearance indicator 828a that provides a visual indication of the current appearance of the second scene user interface object 820b. The second scene user interface object 820b corresponds to an arrival home scene that can be used by the user when the user is approaching a location associated with the home automation system. Figure 8MAt , the appearance indicator 828a includes an image, icon and / or symbol of a person located at and / or arriving at the home, and the appearance indicator 828a includes a first color (e.g., as indicated by the absence of a hatched line in the appearance indicator 828a). The appearance settings user interface 828 includes a color area 828b and an icon area 828c, which include selectable options for customizing the color and symbol of the second scene user interface object 820b, respectively. For example, in some embodiments, in response to detecting a user input corresponding to the selectable color option 828d of the color area 828b, the electronic device 600 adjusts and / or modifies the appearance of the second scene user interface object 820b to include a color corresponding to the selectable color option 828d. In some embodiments, in response to detecting a user input corresponding to the icon selectable option 828e of the icon area 828c, the electronic device 600 adjusts and / or modifies the symbol and / or icon included on the second scene user interface object 820b. Therefore, the user of the electronic device 600 can customize the appearance of the second-scene user interface object 820b so that the user can quickly identify and interact with the second-scene user interface object 820b.

[0334] As explained above, in response to detecting the user input 850n corresponding to the edit user interface object 822c, the electronic device 600 displays the accessory user interface 830, such as Figure 8N The accessory user interface 830 includes accessory user interface objects 830a-830h corresponding to respective accessory devices of the home automation system. Figure 8N In some embodiments, the accessory user interface 830 includes accessory user interface objects for all accessory devices of the home automation system (e.g., all accessory devices that have been associated with the home automation system). In some embodiments, the accessory user interface 830 is scrollable, such that the electronic device 600 displays additional accessory user interface objects (e.g., accessory user interface objects different from the accessory user interface objects 830a-830h) in response to receiving a scroll and / or swipe gesture on the accessory user interface 830.

[0335] As explained above, in response to detecting the user input 8501 corresponding to the selection of the setting user interface object 820e of the setting user interface 820, the electronic device 600 displays the scene suggestion user interface 824, such as Figure 8O As shown. Figure 8OAt position 800a, the scene suggestion user interface 824 includes a scene suggestion user interface object 824a in an active and / or open position. When the scene suggestion user interface object 824a is in an active and / or open position, the electronic device 600 arranges and / or sorts the scene user interface objects 610a-610c of the scene area 610 according to context-based conditions. For example, as described above, the electronic device 600 determines which scene associated with the scene user interface object 610a-610c has the highest priority compared to other scenes, and displays the corresponding scene user interface object for that scene at position 800a. In some embodiments, when the scene suggestion user interface object 824a is in an active and / or open position, when the electronic device 600 is configured to display more than a predetermined number (e.g., two) of scene user interface objects in the scene area 610, the electronic device 600 arranges and / or sorts the scene user interface objects 610a-610b according to context-based conditions.

[0336] In some embodiments, in response to detecting user input selecting the scene suggestion user interface object 824a, the electronic device 600 places the scene suggestion user interface object 824a in an inactive and / or closed position. In some embodiments, when the scene suggestion user interface object 824a is in an inactive and / or closed position, the electronic device 600 does not arrange and / or sort the scene user interface objects 610a-610c according to context-based conditions (e.g., even when the electronic device 600 is configured to display more than a predetermined number of scene user interface objects in the scene area 610). In some embodiments, when the scene suggestion user interface object 824a is in an inactive and / or closed position, the electronic device 600 displays the scene user interface objects 610a-610c at corresponding positions based on alphabetical order, the last activated scene, and / or a user-defined order.

[0337] The electronic device 600 can also display the contextual user interface object on a user interface different from the home user interface 604. For example, Figure 8PAt , the electronic device 600 displays a first room user interface 832 corresponding to the entry room and / or area of ​​the location associated with the home automation system. As explained above, in some embodiments...

Claims

1. A method comprising: At a computer system in communication with a display generating component and one or more input devices: when displaying, via the display generating component, a user interface associated with a home automation system, wherein the user interface includes a plurality of selectable category options corresponding to respective contexts of the home automation system, detecting, via the one or more input devices, a user input corresponding to a selection of a first selectable category option of the plurality of selectable category options, wherein the first selectable category option of the plurality of selectable category options corresponds to a first context of the home automation system; as well as In response to detecting the user input corresponding to a selection of the first of the plurality of selectable category options, displaying, via the display generating component: a first accessory user interface object on the user interface, wherein the first accessory user interface object corresponds to a first accessory of the home automation system associated with the first context of the first selectable category option; a second accessory user interface object on the user interface, wherein the second accessory user interface object corresponds to a second accessory of the home automation system associated with the first context of the first selectable category option; and A first selectable subcategory option corresponding to a subcategory of a category associated with the first selectable category option, wherein the first selectable subcategory option includes a status indication relating to one or more accessories of the home automation system associated with the subcategory.

2. The method according to claim 1, further comprising: In response to detecting the user input corresponding to a selection of the first selectable category option from the plurality of selectable category options, displaying a plurality of accessory user interface objects on the user interface via the display generating component, wherein the plurality of accessory user interface objects include the first accessory user interface object and the second accessory user interface object, and wherein the plurality of accessory user interface objects correspond to all accessories of the home automation system associated with the first context of the first selectable category option.

3. The method according to any one of claims 1 to 2, further comprising: detecting, via the one or more input devices, a second user input corresponding to a selection of the first accessory user interface object while displaying, via the display generating component, the first accessory user interface object, the second accessory user interface object, and the first selectable sub-category option; as well as In response to detecting the second user input corresponding to selection of the first accessory user interface object, displaying, via the display generation component, a second user interface for controlling the first accessory.

4. A method according to claim 3, wherein the second user interface for controlling the first accessory includes a status user interface object, which, when selected, causes the computer system to adjust whether information associated with the first accessory is included in the status displayed on the first selectable category option.

5. The method according to any one of claims 1 to 2, further comprising: detecting, via the one or more input devices, a third user input corresponding to a selection of the first accessory user interface object while displaying, via the display generating component, the first accessory user interface object, the second accessory user interface object, and the first selectable sub-category option; as well as In response to detecting the third user input corresponding to selection of the first accessory user interface object: adjusting an operational state of the first accessory from a first state to a second state based on determining that the third user input corresponds to a first portion of the first accessory user interface object; as well as Based on determining that the third user input corresponds to a second portion of the first accessory user interface object that is different from the first portion, displaying, via the display generation component, a third user interface for controlling the first accessory.

6. The method according to any one of claims 1 to 2, further comprising: detecting, via the one or more input devices, a fourth user input corresponding to a selection of the first selectable subcategory option while displaying, via the display generating component, the first accessory user interface object, the second accessory user interface object, and the first selectable subcategory option; as well as In response to detecting the fourth user input corresponding to a selection of the first selectable sub-category option, displaying, via the display generating component: a third accessory user interface object corresponding to a third accessory of the home automation system that facilitates the status indication of the first selectable sub-category option; and A fourth accessory user interface object corresponding to a fourth accessory of the home automation system that facilitates the status indication of the first selectable sub-category option.

7. The method according to claim 6, further comprising: detecting, via the one or more input devices, a fifth user input corresponding to a selection of the third accessory user interface object while displaying, via the display generating component, the third accessory user interface object and the fourth accessory user interface object; as well as In response to detecting the fifth user input corresponding to selection of the third accessory user interface object, displaying, via the display generating component, a fourth user interface of the third accessory of the home automation system for controlling the status indicator that facilitates the first selectable subcategory option.

8. The method according to claim 6, further comprising: detecting, via the one or more input devices, a sixth user input corresponding to a selection of the third accessory user interface object while displaying, via the display generating component, the third accessory user interface object and the fourth accessory user interface object; as well as In response to detecting the sixth user input corresponding to selection of the third accessory user interface object, a status user interface object is displayed via the display generating component, which, when selected, causes the computer system to stop including the third accessory of the home automation system as a contributing factor to the status indicator of the first selectable subcategory option.

9. The method according to claim 6, further comprising: In response to detecting the fourth user input corresponding to selection of the first selectable sub-category option: displaying, via the display generation component, a fifth accessory user interface object corresponding to the fifth accessory of the home automation system based on determining that the fifth accessory of the home automation system satisfies a set of one or more facilitating criteria; as well as Based on determining that the fifth accessory of the home automation system does not satisfy the set of one or more facilitating criteria, display of the fifth accessory user interface object corresponding to the fifth accessory of the home automation system is foregone.

10. The method of any one of claims 1 to 2, wherein displaying the user interface including the plurality of selectable category options corresponding to respective contexts of the home automation system comprises: displaying, via the display generating component, the first of the plurality of selectable category options with a status indicator based on determining that a set of one or more status criteria are satisfied; as well as Based on determining that the set of one or more status criteria is not satisfied, the first of the plurality of selectable category options is displayed without the status indicator.

11. The method of claim 10, wherein the set of one or more status criteria includes a criterion that is satisfied when a sixth accessory of the home automation system associated with the first context of the first selectable category option is in an active state.

12. The method according to any one of claims 1 to 2, further comprising: displaying, via the display generating component, the first selectable category option with a first state indicator corresponding to a first state of the category associated with the first selectable category option, wherein the first state includes a first priority; as well as In response to receiving an indication of a change in state of the category associated with the first selectable category option: in response to determining that the state change indicates a second state of the category associated with the first selectable category option, the second state comprising a second priority level greater than or equal to the first priority level, displaying, via the display generation component, the first selectable category option with a second state indicator corresponding to the second state; as well as Based on determining that the state change indicates a third state of the category associated with the first selectable category option, the third state comprising a third priority lower than the first priority, maintaining display of the first selectable category option with the first state indicator corresponding to the first state.

13. A method according to any one of claims 1 to 2, wherein the user input is of a first type, the method further comprising: In response to detecting via the one or more input devices a seventh user input of a second type different from the first type corresponding to a selection of the first selectable category option among the multiple selectable category options, a first selectable option is displayed via the display generating component, and when the first selectable option is selected, the one or more accessories of the home automation system associated with the first context of the first selectable category option perform a predetermined action.

14. The method according to claim 13, further comprising: In response to detecting the seventh user input of the second type different from the first type corresponding to a selection of the first selectable category option among the multiple selectable category options, a second selectable option is displayed via the display generating component, and the second selectable option, when selected, causes the computer system to display a third user interface, the third user interface including one or more accessory user interface objects, and the one or more accessory user interface objects correspond to the one or more accessories of the home automation system associated with the first context of the first selectable category option.

15. A method according to any one of claims 1 to 2, wherein the first selectable category option among the multiple selectable category options includes a first appearance associated with the first context of the home automation system, and the second selectable category option among the multiple selectable category options includes a second appearance different from the first appearance and associated with a second context of the home automation system.

16. The method of any one of claims 1 to 2, wherein the user interface comprises a first notification associated with the home automation system.

17. The method of claim 16, wherein the first notification corresponds to a first event of a first type, the method further comprising: In response to receiving an indication of a second event of a second type different from the first type: Based on determining that the second event of the second type is associated with a lower priority than the first event of the first type, display of a second notification corresponding to the second event of the second type is foregone.

18. The method of claim 16, wherein the first notification corresponds to a first event of a first type, the method further comprising: In response to receiving an indication of a third event of the first type, a third notification corresponding to the third event of the first type is displayed concurrently with the first notification via the display generation component.

19. The method according to any one of claims 1 to 2, further comprising: In response to detecting the user input corresponding to a selection of the first selectable category option from the plurality of selectable category options, displaying, via the display generating component, a first camera view user interface object associated with a first camera, the first camera being associated with the first context of the first selectable category option.

20. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component and one or more input devices, the one or more programs comprising instructions for executing a method according to any one of claims 1 to 19.

21. A computer system configured to communicate with a display generation component and one or more input devices, the computer system comprising: one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 19.

22. A computer system configured to communicate with a display generation component and one or more input devices, the computer system comprising: Device for carrying out the method according to any one of claims 1 to 19.

23. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component and one or more input devices, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 19.

Images