Managing an environment

WO2026165202A2PCT designated stage Publication Date: 2026-08-06APPLE INC
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
APPLE INC
Filing Date
2026-01-29
Publication Date
2026-08-06

Smart Images

  • Figure 00000179_0000
    Figure 00000179_0000
  • Figure 00000180_0000
    Figure 00000180_0000
  • Figure 00000181_0000
    Figure 00000181_0000
Patent Text Reader

Abstract

The present disclosure generally relates to managing an environment. Some techniques are for providing guest access to an environment while on a call in accordance with some embodiments. Other techniques are for displaying status of an environment in accordance with some embodiments. Other techniques are for providing access to accessories in an environment in accordance with some embodiments. Other techniques are for displaying a live feed of various cameras in accordance with some embodiments. Other techniques are for assisting a subject with an authentication process in accordance with some embodiments. Other techniques are for initiating an automation in accordance with some embodiments.
Need to check novelty before this filing date? Find Prior Art

Description

Attorney Docket No. 081501-P71165W01MANAGING AN ENVIRONMENTCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is an international patent application of U.S. Non-Provisional Patent Application Serial No. 19 / 462,324, entitled “MANAGING AN ENVIRONMENT,” filed January 28, 2026, which claims priority to U.S. Provisional Patent Application Serial No. 63 / 870,781, entitled “MANAGING AN ENVIRONMENT” filed January 28, 2026, U.S. Provisional Patent Application Serial No. 63 / 754,560 entitled “MANAGING AN ENVIRONMENT” filed February 6, 2025, and U.S. Provisional Patent Application Serial No. 63 / 751,258, entitled “MANAGING AN ENVIRONMENT” filed January 29, 2025. The content of these applications is hereby incorporated by reference in their entirety.BACKGROUND

[0002] Homes are becoming increasingly populated with devices. For example, devices are often utilized to increase security and / or provide monitoring of a home. Handling alerts and / or configuring security permissions is difficult as devices often require separate applications that can be cumbersome. Thus, there is a need to improve techniques for managing an environment.SUMMARY

[0003] Some techniques described herein enable electronic devices to be faster, more efficient, and / or more effective for managing an environment. Such techniques can replace and / or work in conjunction with existing techniques for managing an environment.

[0004] In some embodiments, a method that is performed at a first computer system that is in communication with one or more output devices and one or more input devices is described. In some embodiments, the method comprises: displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment; detecting, via the one or more input devices, a set of one or more inputs that includes: a first input that corresponds to a request to provide a respective level of guest access to the environment; and a second input that is directed to the user interface element for providing guest access to the environment;14920-1811-1627Attorney Docket No. 081501-P71165W01and in response to detecting the set of one or more inputs: in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; and in accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

[0005] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first computer system that is in communication with one or more output devices and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment; detecting, via the one or more input devices, a set of one or more inputs that includes: a first input that corresponds to a request to provide a respective level of guest access to the environment; and a second input that is directed to the user interface element for providing guest access to the environment; and in response to detecting the set of one or more inputs: in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; and in accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

[0006] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first computer system that is in communication with one or more output devices and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an24920-1811-1627Attorney Docket No. 081501-P71165W01environment; detecting, via the one or more input devices, a set of one or more inputs that includes: a first input that corresponds to a request to provide a respective level of guest access to the environment; and a second input that is directed to the user interface element for providing guest access to the environment; and in response to detecting the set of one or more inputs: in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; and in accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

[0007] In some embodiments, a first computer system configured to communicate with one or more output devices and one or more input devices is described. In some embodiments, the first computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment; detecting, via the one or more input devices, a set of one or more inputs that includes: a first input that corresponds to a request to provide a respective level of guest access to the environment; and a second input that is directed to the user interface element for providing guest access to the environment; and in response to detecting the set of one or more inputs: in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; and in accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

[0008] In some embodiments, a first computer system configured to communicate with one or more output devices and one or more input devices is described. In some embodiments, the first computer system comprises means for performing each of the34920-1811-1627Attorney Docket No. 081501-P71165W01following steps: displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment; detecting, via the one or more input devices, a set of one or more inputs that includes: a first input that corresponds to a request to provide a respective level of guest access to the environment; and a second input that is directed to the user interface element for providing guest access to the environment; and in response to detecting the set of one or more inputs: in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; and in accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

[0009] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a first computer system that is in communication with one or more output devices and one or more input devices. In some embodiments, the one or more programs include instructions for: displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment; detecting, via the one or more input devices, a set of one or more inputs that includes: a first input that corresponds to a request to provide a respective level of guest access to the environment; and a second input that is directed to the user interface element for providing guest access to the environment; and in response to detecting the set of one or more inputs: in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; and in accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.44920-1811-1627Attorney Docket No. 081501-P71165W01

[0010] In some embodiments, a method that is performed at a computer system is described. In some embodiments, the method comprises: detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment: in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; and in accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

[0011] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system is described. In some embodiments, the one or more programs includes instructions for: detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment: in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; and in accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

[0012] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system is described. In some embodiments, the one or more programs includes instructions for: detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment: in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; and in accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

[0013] In some embodiments, a computer system is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment: in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; and 54920-1811-1627Attorney Docket No. 081501-P71165W01in accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

[0014] In some embodiments, a computer system is described. In some embodiments, the computer system comprises means for performing each of the following steps: detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment: in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; and in accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

[0015] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system. In some embodiments, the one or more programs include instructions for: detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment: in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; and in accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

[0016] In some embodiments, a method that is performed at a computer system that is in communication with one or more input devices and one or more output devices including one or more display components is described. In some embodiments, the method comprises: displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance; while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance; in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; and in response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a respective set of one or more other64920-1811-1627Attorney Docket No. 081501-P71165W01computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

[0017] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including one or more display components is described. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance; while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance; in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; and in response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

[0018] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including one or more display components is described. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance; while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance; in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; and in response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a74920-1811-1627Attorney Docket No. 081501-P71165W01respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

[0019] In some embodiments, a computer system configured to communicate with one or more input devices and one or more output devices including one or more display components is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance; while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance; in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; and in response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

[0020] In some embodiments, a computer system configured to communicate with one or more input devices and one or more output devices including one or more display components is described. In some embodiments, the computer system comprises means for performing each of the following steps: displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance; while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance; in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; and in response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a84920-1811-1627Attorney Docket No. 081501-P71165W01respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

[0021] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including one or more display components. In some embodiments, the one or more programs include instructions for: displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance; while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance; in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; and in response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

[0022] In some embodiments, a method that is performed at a computer system that is in communication with one or more output devices is described. In some embodiments, the method comprises: receiving an indication that a set of one or more operations is performed based on a subject entering an environment; and in response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment: in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.94920-1811-1627Attorney Docket No. 081501-P71165W01

[0023] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices is described. In some embodiments, the one or more programs includes instructions for: receiving an indication that a set of one or more operations is performed based on a subject entering an environment; and in response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment: in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

[0024] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices is described. In some embodiments, the one or more programs includes instructions for: receiving an indication that a set of one or more operations is performed based on a subject entering an environment; and in response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment: in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

[0025] In some embodiments, a computer system configured to communicate with one or more output devices is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by104920-1811-1627Attorney Docket No. 081501-P71165W01the one or more processors. In some embodiments, the one or more programs includes instructions for: receiving an indication that a set of one or more operations is performed based on a subject entering an environment; and in response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment: in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

[0026] In some embodiments, a computer system configured to communicate with one or more output devices is described. In some embodiments, the computer system comprises means for performing each of the following steps: receiving an indication that a set of one or more operations is performed based on a subject entering an environment; and in response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment: in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

[0027] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices. In some embodiments, the one or more programs include instructions for: receiving an indication that a set of one or more operations is performed based on a subject entering an environment; and in response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:114920-1811-1627Attorney Docket No. 081501-P71165W01in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

[0028] In some embodiments, a method that is performed at a computer system is described. In some embodiments, the method comprises: receiving an indication that an identified subject with a respective authentication level is detected in an environment; and in response to receiving the indication that the identified subject with the respective authentication level is detected in the environment: in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; and in accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

[0029] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system is described. In some embodiments, the one or more programs includes instructions for: receiving an indication that an identified subject with a respective authentication level is detected in an environment; and in response to receiving the indication that the identified subject with the respective authentication level is detected in the environment: in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; and in accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the124920-1811-1627Attorney Docket No. 081501-P71165W01second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

[0030] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system is described. In some embodiments, the one or more programs includes instructions for: receiving an indication that an identified subject with a respective authentication level is detected in an environment; and in response to receiving the indication that the identified subject with the respective authentication level is detected in the environment: in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; and in accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

[0031] In some embodiments, a computer system is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: receiving an indication that an identified subject with a respective authentication level is detected in an environment; and in response to receiving the indication that the identified subject with the respective authentication level is detected in the environment: in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; and in accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.134920-1811-1627Attorney Docket No. 081501-P71165W01

[0032] In some embodiments, a computer system is described. In some embodiments, the computer system comprises means for performing each of the following steps: receiving an indication that an identified subject with a respective authentication level is detected in an environment; and in response to receiving the indication that the identified subject with the respective authentication level is detected in the environment: in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; and in accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

[0033] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system. In some embodiments, the one or more programs include instructions for: receiving an indication that an identified subject with a respective authentication level is detected in an environment; and in response to receiving the indication that the identified subject with the respective authentication level is detected in the environment: in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; and in accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

[0034] In some embodiments, a method that is performed at a computer system is described. In some embodiments, the method comprises: detecting a subject in an environment; in response to detecting the subject in the environment: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with144920-1811-1627Attorney Docket No. 081501-P71165W01respect to a user account using a first set of one or more authentication techniques, initiating an automation; and in accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.

[0035] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system is described. In some embodiments, the one or more programs includes instructions for: detecting a subject in an environment; in response to detecting the subject in the environment: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; and in accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.

[0036] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system is described. In some embodiments, the one or more programs includes instructions for: detecting a subject in an environment; in response to detecting the subject in the environment: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; and in accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation154920-1811-1627Attorney Docket No. 081501-P71165W01of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.

[0037] In some embodiments, a computer system is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: detecting a subject in an environment; in response to detecting the subject in the environment: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; and in accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.

[0038] In some embodiments, a computer system is described. In some embodiments, the computer system comprises means for performing each of the following steps: detecting a subject in an environment; in response to detecting the subject in the environment: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; and in accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.

[0039] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system. In some embodiments, the one or more programs include instructions for: detecting a subject in an environment; in response 164920-1811-1627Attorney Docket No. 081501-P71165W01to detecting the subject in the environment: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; and in accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.

[0040] A computer-readable storage medium or other computer program product that is set up to run on one or more processors can optionally include executable instructions for carrying out steps described above.DESCRIPTION OF THE FIGURES

[0041] To gain a clearer understanding of techniques described herein, references to various embodiments are described below in the Detailed Description. In conjunction with the Detailed Description, drawings are provided in which reference numerals refer to related parts across the drawings.

[0042] FIG. l is a block diagram illustrating a computer system in accordance with some embodiments.

[0043] FIG. 2A is a block diagram illustrating a device and a system in accordance with some embodiments.

[0044] FIG. 2B illustrates a computer system with a touch screen in accordance with some embodiments.

[0045] FIG. 3 is a block diagram illustrating an ecosystem including a computer system with other accessory devices in accordance with some embodiments.

[0046] FIGS. 4A-4H illustrate exemplary user interfaces for providing guest access to an environment while on a call in accordance with some embodiments.174920-1811-1627Attorney Docket No. 081501-P71165W01

[0047] FIG. 5 is a flow diagram illustrating a process for providing guest access to an environment while on a call in accordance with some embodiments.

[0048] FIGS. 6A-6C illustrate exemplary user interfaces for displaying status of an environment in accordance with some embodiments.

[0049] FIG. 7 is a flow diagram illustrating a process for displaying status of an environment in accordance with some embodiments.

[0050] FIGS. 8A-8G illustrate exemplary user interfaces for providing access to accessories in an environment in accordance with some embodiments.

[0051] FIG. 9 is a flow diagram illustrating a process for providing access to accessories in an environment in accordance with some embodiments.

[0052] FIGS. 10A-10V illustrate exemplary user interfaces for detecting a presence of a subject in accordance with some embodiments.

[0053] FIG. 11 is a flow diagram illustrating a process for displaying a live feed of various cameras in accordance with some embodiments.

[0054] FIG. 12 is a flow diagram illustrating a process for assisting a subject with an authentication process in accordance with some embodiments.

[0055] FIGS. 13A-13G illustrate an exemplary environment for performing automations in accordance with some embodiments.

[0056] FIG. 14 is a flow diagram illustrating a process for initiating an automation in accordance with some embodiments.DETAILED DESCRIPTION

[0057] The description that follows covers exemplary embodiments and examples.However, it should be acknowledged that this description is given as an explanation and is not meant to restrict the scope of the current disclosure. For example, terms used to describe different embodiments and different examples are not meant to be restrictive unless explicitly stated.184920-1811-1627Attorney Docket No. 081501-P71165W01

[0058] In some embodiments, one or more steps of a process can be contingent upon fulfillment of one or more conditions. To fulfill the one or more conditions, a process can be repeated multiple times. In such embodiments, different conditions can be satisfied in different repetitions. For example, steps can be repeated until all conditions have been satisfied. In some embodiments, electronic devices, computer systems, and / or computer readable mediums include instructions for performing one or more steps that are contingent upon one or more conditions being satisfied. Such instructions can include logic that determines whether the one or more conditions have been fulfilled without repetition of a step.

[0059] Although terms such as “first”, “second”, and so forth are used with different elements in the following description, these elements should not be constrained by the terms unless explicitly stated otherwise. In some embodiments, the terms are used to differentiate one element from another. For example, a “first” input can be different from a “second” input, though the terms “first” and “second” can be switched without changing the meaning of either input. In some embodiments, the “first” input and the “second” input are two different references to the same input unless explicitly stated otherwise.

[0060] Unless context makes it apparent otherwise, singular forms of “a”, “an”, and “the” are meant to cover plural forms. Additionally, the term “and / or” is meant to be interpreted to apply to and include any and all potential combinations of one or more of the related mentioned things. The terms “has”, “having”, “includes”, “including”, “comprises”, and / or “comprising” are meant to cover the presence of different elements; however, they do not preclude the presence or addition of one or more additional elements. The term “if’ is meant to be interpreted to indicate “when”, “upon”, “in response to determining”, or “in response to detecting”. Accordingly, depending on the context, the expressions “if it is determined” or “if [a stated condition] is detected” can be interpreted as meaning “upon determining”, “in response to determining”, “upon detecting [the stated condition]”, or “in response to detecting [the stated condition]”.

[0061] Some processes described below enhance the operability of devices and make interfaces better, such as by helping a user provide proper inputs and / or reduce mistakes when using devices, through various techniques. For example, some processes perform an operation when a set of conditions has been met without requiring further input, such as input by a user. For another example, some processes provide additional control options without 194920-1811-1627Attorney Docket No. 081501-P71165W01cluttering user interfaces with additional displayed controls. For another example, some processes reduce the number of inputs needed to perform an operation. For another example, some processes provide improved feedback (e.g., visual, haptic, acoustic, and / or tactile feedback) to a user. Additional techniques include increasing the security and / or privacy of the device and / or reducing burn-in. These techniques also reduce power usage and / or improve battery life of devices, such as by enabling a user to use devices better, more quickly, and / or efficiently.

[0062] Below, FIGS. 1, 2A-2B, and 3 provide description of exemplary devices for implementing techniques described below. FIGS. 4A-4H illustrate exemplary user interfaces for providing guest access to an environment while on a call in accordance with some embodiments. FIG. 5 is a flow diagram illustrating a process for providing guest access to an environment while on a call in accordance with some embodiments. The user interfaces in FIGS. 4A-4H are used to illustrate the processes described below, including the processes in FIG. 5. FIGS. 6A-6C illustrate exemplary user interfaces for displaying status of an environment in accordance with some embodiments. FIG. 7 is a flow diagram illustrating a process for displaying status of an environment in accordance with some embodiments. The user interfaces in FIGS. 6A-6C are used to illustrate the processes described below, including the processes in FIG. 7. FIGS. 8A-8G illustrate exemplary user interfaces for providing access to accessories in an environment in accordance with some embodiments. FIG. 9 is a flow diagram illustrating a process for providing access to accessories in an environment in accordance with some embodiments. The user interfaces in FIGS. 8A-8G are used to illustrate the processes described below, including the processes in FIG. 9. FIGS. 10A-10V illustrate exemplary user interfaces for detecting a presence of a subject in accordance with some embodiments. FIG. 11 is a flow diagram illustrating a process for displaying a live feed of various cameras in accordance with some embodiments. FIG. 12 is a flow diagram illustrating a process for assisting a subject with an authentication process in accordance with some embodiments. The user interfaces in FIGS. 10A-10V are used to illustrate the processes described below, including the processes in FIGS. 11-12. FIGS. 13A-13G illustrate an exemplary environment for performing automations in accordance with some embodiments. FIG. 14 is a flow diagram illustrating a process for initiating an automation in accordance with some embodiments. The environments in FIGS. 13A-13G are used to illustrate the processes described below, including the processes in FIG. 14.204920-1811-1627Attorney Docket No. 081501-P71165W01

[0063] FIG. l is a block diagram illustrating a computer system in accordance with some embodiments. While FIG. 1 illustrates one computer system, two or more computer systems working together can implement techniques described herein. It should be acknowledged that the computer system (e.g., computer system 100) is sometimes referred to as a device, an electronic device, an electronic system, a compute system, and / or a system. In some embodiments, computer system 100 is a personal computer system, a server system, a smart phone, a system on a chip, a smart watch, a wearable device, a tablet, a laptop computer, a fitness tracking device, a head-mounted display (HMD) device, a desktop computer, a communal device (e.g., a smart speaker, connected thermostat, and / or other home-based computer systems), an accessory (e.g., a switch, light, speaker, air conditioner, heater, window cover, fan, lock, media playback device, and / or television), a controller, a hub device, or a sensor.

[0064] As illustrated in FIG. 1, computer system 100 includes CPU subsystem 110, system memory 120, and VO interface 130. Such components are able to communicate with one another through interconnect 150. In some embodiments, interconnect 150 is an electrical means of communication such as a system bus, one or more memory locations, and / or additional electrical channels for connecting multiple components of computer system 100.

[0065] It should be acknowledged that computer system 100 is only one example of a computer system to carry out techniques described below and that one or more other computer systems can carry out such techniques. Furthermore, while FIG. 1 illustrates a particular computer architecture of computer system 100, techniques described herein can be carried out by other computer architectures, such as by incorporating more, less, similar, and / or different components than the components illustrated.

[0066] In some embodiments, CPU subsystem 110 includes one or more processing units that can carry out techniques described herein. For example, CPU subsystem 110 can execute system-level and / or application-level instructions to perform an operation. In some embodiments, computer system 100 has several processing subsystems (e.g., multiple instances of CPU subsystem 110).

[0067] In some embodiments, CPU subsystem 110 is capable of carrying out instructions stored on a storage medium, such as a non-transitory or transitory computer-readable medium. A computer-readable storage medium (or many physical computer-readable storage214920-1811-1627Attorney Docket No. 081501-P71165W01media of one or more types) including one or more computer-readable instructions can be used to realize implementations falling partially or fully under the purview of the current disclosure. It should be acknowledged that computer-readable instructions can be arranged in any way, such as components, software, processes, widgets, and / or applications.

[0068] It should be acknowledged that the storage medium can be any medium that can physically include or store computer-executable instructions. For example, the storage medium can be temporary or non-temporary. Examples of storage medium include magnetic (e.g., hard drives and / or magnetic disks), optical (e.g., optical drives and / or optical discs based on CD, DVD, and Blu-ray technologies), solid state (e.g., solid state drives and / or flash drives), and / or semiconductor (e.g., random access memory) storages. In some embodiments, the storage medium is system memory 120. In such embodiments, each instruction stored by system memory 120 and executed by CPU subsystem 110 corresponds to an operation for completing functionality described herein. For example, instructions for processes 500, 700, 900, 1100, 1200, and 1400 can be stored in system memory 120.

[0069] In some embodiments, system memory 120 implements a range of distinct physical, non -transitory memory media. Examples of system memory 120 include a storage array, a storage area network (SAN), a removable flash drive, flash memory, hard disk storage, optical drive storage, floppy disk storage, removable disk storage, random access memory (such as SDRAM, DDR SDRAM, RAM-SRAM, EDO RAM, and / or RAMBUS RAM), and / or read-only memory (such as PROM and / or EEPROM). In some embodiments, computer system 100 has several memory components coupled, either directly or via interconnect 150, to CPU subsystem 110.

[0070] In some embodiments, computer system 100 communicates with external devices through VO interface 130, which can be one or more types of interfaces. For example, VO interface 130 can include a bridge chip that connects a front-side bus to one or more backside buses. In some embodiments, VO interface 130 allows communication through one or more appropriate buses or other interfaces with one or more VO devices, such as VO device 140. For example, VO device 140 can include one or more: physical user-interface devices (e.g., a physical keyboard, a mouse, a button, a touch-sensitive surface, a rotatable component, and / or a joystick), storage devices (e.g., as described above with respect to system memory 120), network interface devices (e.g., to a local and / or wide-area network), sensor devices (e.g., a camera, a microphone, a motion detector, and / or a temperature sensor),224920-1811-1627Attorney Docket No. 081501-P71165W01audio output devices (e.g., speaker, audio jacks, and / or hearing loops), and / or visual output devices (e.g., screen, light, and / or projector). In some embodiments, I / O device 140 includes a network interface device that enables computer system 100 to establish a wired or wireless connection to a network or other computer systems. Examples of network interface devices include Ethernet, USB, Bluetooth, NFC, Wi-Fi, and / or Thunderbolt communication devices. In some embodiments, VO device 140 is wired or wirelessly connected to VO interface 130.

[0071] In some embodiments, a component of computer system 100 incorporates VO device 140 with other components. For example, a single component can include VO interface 130 and VO device 140. In some embodiments, VO device 140 is a discrete component, meaning it is not incorporated into another part of computer system 100. In some embodiments, functionality of different components is integrated into a component of computer system 100 that is composed of VO interface 130 and VO device 140. Additionally, it should be acknowledged that computer system 100 can include one or more VO interfaces that connect to one or more VO devices.

[0072] In some embodiments, VO device 140 can be used to detect a subject (e.g., a user, a person, an animal, another computer system different from computer system 100, and / or an object) and / or an input (e.g., a verbal input, a tap input, a swipe input, a hold-and-drag input, a gaze input, an air-gesture input, a physical input and / or a passive input) from a detected subject. In some embodiments, a user has an account enabled by and / or linked to computer system 100, and computer system 100 can determine if a detected subject is a user with an account (e.g., a known user). Determining if a detected subject has an account includes identifying and / or authenticating the detected subject. In some embodiments, identifying and / or authenticating the detected subject includes comparing detected information to stored information about known users. For example, comparing detected information can include comparing biometric data (e.g., facial scans, iris scans, fingerprint scans, and / or voice recognition data) of detected subjects to stored biometric data of known users. For another example, comparing detected information can include comparing detected identification (e.g., MAC address and / or IP address) of a computer system of a detected subject to known identifications of computer systems of known users. For yet another example, comparing detected information can include comparing detected passcodes (e.g., usernames, passwords, passphrases, and / or PINs). In another example, computer system 100 can detect a known user (e.g., a user that corresponds to an account) and allow access to an environment when the234920-1811-1627Attorney Docket No. 081501-P71165W01user is identified. In some embodiments, computer system 100 detects unknown subjects and enables guest accounts for the unknown subjects to utilize computer system 100.

[0073] In some embodiments, computer system 100 collects information without the need for physical inputs via a sensor of I / O device 140. For example, computer system 100 can recognize subject inputs, including air-gesture inputs and / or passive inputs via a camera. In some embodiments, an air-gesture input is that is a detected intentional motion of a portion of the subject’s body without the subject touching an input element in communication with or of the device. In some embodiments, a passive input is a detected input that is not purposefully directed at computer system 100 and / or a component in communication with computer system 100. Examples of passive inputs that can be detected by a camera include, but are not limited to, the subject entering an environment, the motion of the subject through an environment, the location of the subject in the environment, the direction the subject is looking and / or facing, and / or light levels of the environment. In some embodiments, computer system 100 can send visual and / or video data to an application from one or more cameras. For example, computer system 100 can send video data to an application for the purpose of making a video phone call. For another example, computer system 100 can detect the sound of a subject talking, glass breakings, and / or music playing via a microphone of VO device 140. In some embodiments, computer system 100 recognizes speech as verbal a input from a subject that are detected via a microphone.

[0074] In some embodiments, computer system 100 detects information about the environment via other types of sensors of VO device 140. Examples of such sensors include a flow sensor, a gas sensor, a humidity sensor, a chemical sensor, a contact sensor, a precipitation sensor, a pressure sensor, a proximity sensor, a motion sensor, an occupancy sensor, an electricity sensor, and / or a flood sensor.

[0075] In some embodiments, computer system 100 detects a physical input via a physical user-interface device of VO device 140 that allow a subject to communicate with computer system 100 directly. In some embodiments, computer system 100 includes one or more input devices as described above, and data from one input device is combined with data from one or more other input devices (e.g., that are a part of computer system 100 and / or other computer systems) to gather information about the physical environment.244920-1811-1627Attorney Docket No. 081501-P71165W01

[0076] In some embodiments, computer system 100 outputs visual information via a component of I / O device 140, such as a display screen, a projector, a touch-sensitive display, and / or a light. For example, I / O device 140 can include a light to indicate a status of computer system 100, such as an on / off status. For another example, VO device 140 can include a display screen for displaying user interface elements. In some embodiments, “outputting” visual information includes sending data (e.g., image and / or video data) to an external display component via a wired or wireless connection, causing the external display component can display the visual information.

[0077] In some embodiments, computer system 100 emits sound via an audio output device of I / O device 140, such as a speaker, a headphone, an earbud, an audio jack, an optical audio output, a Bluetooth audio output, an HDMI audio output, and / or a hearing loop. For example, computer system 100 can provide a subject with information and / or audio-based content via speakers of I / O device 140.

[0078] In some embodiments, I / O device 140 includes a tactile output device. For example, VO device 140 can include a haptic element that allows computer system 100 to communicate with a subject who is in close proximity to or in physical contact with computer system 100.

[0079] FIG. 2A is a block diagram illustrating a device and a system in accordance with some embodiments. In some embodiments, device 200 is a personal computing device, a server system, a smart phone, a smart watch, a tablet, a laptop computer, a fitness tracking device, a head-mounted display (HMD) device, a desktop computer, a communal device (e.g., a smart speaker, connected thermostat, and / or other home-based computer systems), an accessory (e.g., a switch, light, speaker, air conditioner, heater, window cover, fan, lock, media playback device, and / or television), a controller, a hub device, or a sensor. In some embodiments, system 210 is an operating system hosted on device 200. In some embodiments, system 210 is an operating system hosted on an external device (e.g., a server, a peripheral device, an accessory, and / or a personal computing device). It should be acknowledged that device 200 and / or system 210 can include more, fewer, and / or different components than illustrated in FIG. 2A.

[0080] As illustrated in FIG. 2 A, device 200 includes an application (e.g., application 204) that, when executed by one or more processing units, causes device 200 to perform one254920-1811-1627Attorney Docket No. 081501-P71165W01or more processes and / or methods described herein. In some embodiments, application 204 is an application that is pre-installed on device 200 by a manufacture of device 200 (e.g., a first-party application). In some embodiments, application 204 is an application that is provided to device 200 via an operating system update file (e.g., a first-party application or a second-party application). In some embodiments, application 204 is an application that is installed by a user of device 200, such as through an application store installed on device 200. It should be acknowledged that application 204 can be any suitable type of application such a browser application, a fitness application, a health application, a digital payments application, a media application, a social network application, a messaging application, a maps application, and / or an application that functions as an execution environment for plug-ins, widgets and / or other applications. In some embodiments, application 204 causes device 200 to perform processes 500, 700, 900, 1100, 1200, and 1400.

[0081] In some embodiments, a software platform has a set of frameworks that provide objects and / or behaviors that a software developer uses to build applications on the software platform. Software developers use the set of frameworks to display and / or interact with content, and / or manage interactions with the software platform. In some embodiments, an application relies on the set of frameworks for their behavior. In such embodiments, the set frameworks can provide different ways for the software developer to customize behavior of the application to match specific needs of the application.

[0082] In some embodiments, interaction with a device includes transfer and / or receipt of one or more API calls between multiple different software processes (e.g., different portions of an operating system, an application and an operating system, or different applications) via one or more APIs. For example, when an input is detected, raw sensor data can be processed into one or more input events that are provided (e.g., via an API) to a receiving software process that makes some determination based on the one or more input events, and then sends (e.g., via an API) information to a software process to perform an operation (e.g., change a device state and / or user interface).

[0083] In some embodiments, an object and / or a behavior is accessed via an API, specifying a format for communication between processes, including specifying and grouping available protocols, variables, and / or functions. For example, an API call, sometimes referred to as an API request, can be sent from a first software process to a second software process as a way to accomplish different things. The first software process can request information from 264920-1811-1627Attorney Docket No. 081501-P71165W01the second software process. The first software process can provide information to the second software process. The first software process can request action by the second software process. The first software process can provide information to the second software process about action taken by the first software process.

[0084] In some embodiments, while a determination and an operation performed in response can be made by the same software process, alternatively, a determination can be made in a first software process and relayed (e.g., via an API) to a second software process different from the first software process. Relaying the determination can cause an operation to be performed by the second software process. Alternatively, the second software process can relay one or more instructions (e.g., via an API) to a third software process different from the first software process and / or the second software process. The one nor more instructions can be to perform an operation.

[0085] It should be acknowledged that some or all subject interactions with a computer system can involve one or more API calls within a step of interacting with the computer system, such as between different software components of the computer system or between a software component of the computer system and a software component of one or more remote computer systems.

[0086] As illustrated in FIG. 2A, application 204 includes application implementation module 206 and API calling module 208. In some embodiments, application implementation module 206 includes a set of one or more instructions corresponding to one or more operations performed by application 204. For example, when application 204 is a messaging application, application implementation module 206 can include operations to receive and send messages.

[0087] In some embodiments, API calling module 208 is a module that can receive application programming interface (API) calls, respond to API calls, and / or send API calls. In some embodiments, application implementation module 206 communicates with API calling module 208 to communicate with a system, such as system 210. In some embodiments, communication 220 represents one or more API calls and / or one or more other forms of communication between device 200 (e.g., one or more components of device 200) and system 210 (e.g., one or more components of system 210).274920-1811-1627Attorney Docket No. 081501-P71165W01

[0088] As illustrated in FIG. 2 A, system 210 includes API 212 and implementation module 214. In some embodiments, API 212 is a software and / or hardware module that can receive API calls, respond to API calls, and / or send API calls. In some embodiments, API 212 is a software module (e.g., a collection of computer-readable instructions) that provides an interface that allows a different module (e.g., API calling module 208) to access and / or use one or more functions, methods, procedures, data structures, classes, and / or other services provided by implementation module 214. For example, API calling module 208 can make an API call to API 212 to access and use a feature of implementation module 214 that is specified by API 212. In some embodiments, API 212 is implemented in part by firmware, microcode, or other low-level logic that executes in part on the hardware component.

[0089] In some embodiments, API calling module 208 passes data and / or controls information within implementation module 214 through the one or more API calls via API 212. In some embodiments, API 212 includes one or more features for translating API calls and returns between implementation module 214 and API calling module 208, which allows multiple API-calling modules written in different programming languages to communicate with implementation module 214. For example, API calling module 208 can call using APIs from different providers such as a set of APIs from an OS provider, another set of APIs from a plug-in provider, and / or another set of APIs from another provider (e.g., the provider of a software library) or creator of the other set of APIs.

[0090] In some embodiments, implementation module 214 is a system (e.g., operating system, and / or server system) software module that is constructed to perform an operation in response to receiving an API call via API 212. In some embodiments, implementation module 214 is constructed to provide an API response (via API 212) as a result of processing an API call. In some embodiments, implementation module 214 is embodied at least in part in firmware, microcode, or hardware logic. In some embodiments, implementation module 214 calls one or more other components via an underlying API and thus is both an implementation module and an API calling module similar to API calling module 208. For example, implementation module 214 and API calling module 208 can each be any one of an operating system, a library, a device driver, an API, an application program, or other module. It should be acknowledged that implementation module 214 and API calling module 208 can be the same or different type of module from each other.284920-1811-1627Attorney Docket No. 081501-P71165W01

[0091] In some embodiments, various API calls are transferred between API calling module 208 and implementation module 214. It should be acknowledged that transferring API calls can include issuing, initiating, invoking, calling, receiving, returning, and / or responding to a function of calls or messages. In other words, transferring API calls can describe actions by either API calling module 208 or implementation module 214. In some embodiments, in response to an API call from API calling module 208, implementation module 214 returns (via API 212) a value to report to application 204 the capabilities or state of a hardware component of device 200, such as input capabilities and state, output capabilities and state, processing capability, power state, storage capacity and state, and / or communications capability.

[0092] In some embodiments, implementation module 214 provides more than one API, with different APIs supplying different aspects of functionality performed by implementation module 214 while protecting some aspects of functionality from view. For example, one API of implementation module 214 can provide a first set of functions and can be exposed to third-party developers while another API of implementation module 214 can be hidden (e.g., not exposed) and provide a subset of the first set of functions and / or provide a different set of functions, such as testing or debugging functions which are not in the first set of functions. It should be acknowledged that implementation module 214 can include additional functions, methods, classes, data structures, and / or other features that are not specified through API 212 and are not available to API calling module 208. In some embodiments, implementation module 214, API 212, and / or API calling module 208 are stored in a machine-readable medium, which includes any mechanism for storing information in a form readable by a machine (e.g., a computer or other data processing system). For example, a machine-readable medium can include magnetic disks, optical disks, random access memory; read only memory, and / or flash memory devices.

[0093] In some embodiments, in response to and / or after receiving information from one or more hardware components of device 200, one or more software modules of device 200, and / or one or more hardware components external to device 200 (e.g., a peripheral device, an accessory device, and / or a server), application 204 executes a task with the information. In some embodiments, the tasks executed include: providing a notification based on the information, sending a message based on the information, displaying the information, controlling a user interface of a fitness application based on the information, controlling a294920-1811-1627Attorney Docket No. 081501-P71165W01user interface of a health application based on the information, controlling a focus mode based on the information, setting a reminder based on the information, adding a calendar entry based on the information, and / or calling API 212 of system 210 based on the information. In some embodiments, after receiving the information, application 204 executes the task in response to a trigger, such as a detection of an event, a notification received from system 210, an input, and / or a response to a call to an API provided by system 210.

[0094] In some embodiments, application 204 calling API 212 (e.g., as part of a task executed by application 204 in response to and / or after receiving information) includes using one or more parameters defined by API 212. In some embodiments, the one or more parameters include a constant, a key, a data structure, an object, an object class, a variable, a data type, a pointer, an array, a list or a pointer to a function or method, and / or another way to reference a data or other item to be passed via API 212.

[0095] In some embodiments, in response to and / or after receiving the information, application 204 transfers the information to system 210 via communication 220. In some embodiments, after receiving the information, application 204 transfers the information to system 210 in response to a trigger.

[0096] FIG. 2B illustrates a computer system with a touch screen in accordance with some embodiments. In some embodiments, computer system 222 is a portable multifunction device that is a personal device of a user. It should be acknowledged that computer system 222 can be computer system 100 and / or device 200 as described above.

[0097] As illustrated in FIG. 2B, computer system 222 includes touch screen 224, touch screen 230, menu button 226, and microphone 228. In some embodiments, computer system 222 displays, via touch screen 224, a user interface (UI) including one or more user interface elements, such as controls, graphics, and / or content. Computer system 222 can then detect an input, such as a tap input using a finger of a user or a stylus, on a user interface element to select the user interface element. In some embodiments, the user interface element is selected when touch screen 223 no longer detects the input.

[0098] In some embodiments, microphone 228 is an input device for detecting sounds near computer system 222, including verbal inputs from a user. For example, computer system 222 can detect a subject making a verbal request and / or command to computer system 222 via microphone 228. In some embodiments, computer system 222 collects data and / or 304920-1811-1627Attorney Docket No. 081501-P71165W01information about a subject via microphone 228. For example, computer system 222 can confirm an identity of a subject by matching a verbal input of the subject to a voice profile of a user. At FIG. 2B, microphone 228 is part of computer system 222. In some embodiments, microphone 228 is not part of but is in communication (e.g., via a wired and / or wireless communication) with computer system 222.

[0099] In some embodiments, camera 230 is an input device that includes an image or video sensor (such as one or more optical sensors and / or one or more depth sensors) that allows computer system 222 to detect objects and / or inputs (e.g., hand and / or air-gesture inputs) near computer system 222. In some embodiments, computer system 222 collects data and / or information about a subject via camera 230. For example, computer system 222 can confirm an identity a subject by matching a facial scan of a subject to a biometric profile of a user. At FIG. 2B, camera 230 is part of computer system 222. In some embodiments, camera 230 is not part of computer system 222 but is in communication (e.g., via a wired and / or wireless connection) with computer system 222. In some embodiments, camera 230 is always on and continuously capturing images (e.g., periodically and / or without interruption). In some embodiments, camera 230 begins to capture an image when an input and / or interaction is detected.

[0100] In some embodiments, menu button 226 is a physical button that, when depressed, provides a physical input for computer system 222. In some embodiments, touch screen 224 and / or menu button 226 are used for turning computer system 222 on and off and / or locking it. For example, menu button 226 can be used to lock computer system 222 by pressing and releasing menu button 226 before a predetermined amount of time (e.g., 2-10 seconds) has passed. For another example, menu button 226 can be used to unlock computer system 222 or start an unlocking process, or to turn computer system 222 on or off by pressing and holding menu button 226 in the depressed state for longer than the predetermined amount of time. In some embodiments, microphone 228 allows computer system 222 to detect a verbal input for turning on or off certain features. Additionally, computer system 222 can optionally have one or more tactile output devices to provide tactile outputs (e.g., haptic outputs) to the user and / or one or more contact intensity sensors to detect the intensity of contacts on touch screen 224

[0101] FIG. 3 is a block diagram illustrating a logical environment in accordance with some embodiments. As illustrated in FIG. 3, logical environment 300 includes multiple 314920-1811-1627Attorney Docket No. 081501-P71165W01devices that are in communication (e.g., wired and / or wirelessly) with each other. In some embodiments, logical environment 300 is a software-defined construct that represents state, capabilities, and / or permissible interactions of devices within logical environment 300. For example, logical environment 300 can maintain a data model including (1) unique identifiers for different devices and / or assigned roles for each device, (2) a capability map describing supported functions and / or data formats, (3) a relationship graph indicating pairing status, hierarchy, and / or authorized communication paths, (4) contextual state parameters such as operating modes, user profiles, and / or session data, and / or (5) policy constraints that govern security, power management, and / or permissible commands. In some embodiments, logical environment 300 enables controller devices (e.g., hub device 304, personal device A 314, personal device 316, and / or server 318) to discover, address, control, and / or configure accessory devices (e.g., camera 306, smart speaker 308, smart light 310, smart lock 310, and / or hub device 304). In such embodiments, logical environment 300 can be independent of underlying physical transports and / or physical location.

[0102] As illustrated in FIG. 3, logical environment 300 includes (e.g., involves) devices within physical environment 302 (e.g., camera 306, smart speaker 308, smart light 310, smart lock 312, and hub device 304). In some embodiments, physical environment 302 is a physical location, such a home, an office building, a warehouse, and / or an apartment building. It should be acknowledged that techniques described herein can be used with any type of physical location.

[0103] In some embodiments, the devices within logical environment 300 work together using one or more of the techniques described herein for detecting an activity in, interacting with, capturing sensor data related to, and / or communicating data about physical environment 302. Such control and / or communication can be via a homeowner and / or administrator of physical environment 302 and / or logical environment 300. In some embodiments, detecting an activity includes detecting and / or identifying a subject within physical environment 302. In some embodiments, in response to detecting the activity, a device (e.g., camera 306, smart speaker 308, smart light 310, smart lock 312, and / or hub device 304) within physical environment 302 captures sensor data in physical environment 302 and / or performs an operation. In such embodiments, the operation can includes allowing or denying a subject access to all or part of physical environment 302, turning on a light, and / or playing music.324920-1811-1627Attorney Docket No. 081501-P71165W01

[0104] At FIG. 3, devices illustrated within the dashed box of physical environment 302 are located within physical environment 302. Such devices include hub device 304, camera 306, smart speaker 308, smart light 310, and smart lock 312. In some embodiments, such devices and are in communication via one or more local area networks (e.g., WiFi and / or ethernet), one or more personal area network (e.g., Bluetooth, Zigbee, and / or Thread), one or more wide area networks (e.g., Internet and / or cellular), and / or one or more peer-to-peer connections.

[0105] At FIG. 3, devices illustrated outside the dashed box of physical environment 302 are located outside of physical environment 302 or are mobile with the ability to be inside or outside of physical environment 302. Such devices include personal device A 314, personal device B 316, and server 318. It should be acknowledged that logical environment 300 and physical environment 302 are described for explanatory purposes and that techniques described below can be carried out with more, less, similar, and / or different devices than the devices and / or the configurations discussed above.

[0106] In some embodiments, hub device 304 is a stationary or semi -stationary computer system that communicates with accessory devices located within physical environment 302 including, but not limited to, camera 306, smart speaker 308, smart light 310 and / or smart lock 312. In some embodiments, hub device 304 communicates with one or more accessory devices on behalf of (e.g., communicates information to and / or from) one or more controller devices, such as personal device A 314 and / or personal device B 316. In some embodiments, hub device 304 provides centralized coordination, routing, and / or persistent data storage for physical environment 302. In some embodiments, hub device 304 includes a component for detecting other devices, such as a camera, a microphone, and / or Bluetooth and / or Ultra-Wideband (UWB) component. While hub device 304 is depicted in FIG. 3 as a single device, the functionality described below can be implemented with two or more resident devices operating together. Examples of hub device 304 include a smart speaker, a set-top box, a router, a home-automation bridge, a television, and / or a desktop computer.

[0107] In some embodiments, hub device 304 communicates with devices outside of physical environment 302. For example, hub device 304 can communicate with other hub devices that belong to different environments. For another example, hub device 304 can communicate with other accessory devices and / or other controller devices. In such embodiments, hub device 304 communicates with other devices through one or more334920-1811-1627Attorney Docket No. 081501-P71165W01communication channels described above (e.g., a local area network, a personal area network, a peer-to-peer connection, and / or a wide area network).

[0108] In some embodiments, hub device 304 includes and / or is in communication with one or more cameras with which hub device 304 can capture an image and / or a video of a subject and / or activity within physical environment 302. In some embodiments, hub device 304 includes and / or is in communication with one or more microphones with which hub device 304 can detect noise (e.g., glass breaking, an alarm going off, and / or a subject talking) within physical environment 302. In some embodiments, a microphone enables hub device 304 to detect verbal inputs from a subject, enabling the subject to interact with hub device 304 without making physical contact with hub device 304 or another computer system within physical environment 302.

[0109] In some embodiments, hub device 304 includes and / or is in communication with one or more sensors. In some embodiments, a sensor includes a hardware component capable of detecting (e.g., sensing and / or processing) information about physical environment 302 in proximity to the hardware component. For example, a sensor can be configured to detect information surrounding the sensor, detect information in one or more directions away from the sensor, and / or detect information based on contact of the sensor with an element of physical environment 302. In some embodiments, a hardware component of a sensor includes a sensing component (e.g., a temperature and / or image sensor), a transmitting component (e.g., a radio transmitter and / or laser transmitter), and / or a receiving component (e.g., a radio receiver and / or laser receiver). It should be acknowledged that a sensor can be multiple types of sensors. For example, a sensor can be an angle sensor, a breakage sensor, a flow sensor, a force sensor, a gas sensor, a humidity or moisture sensor, a glass breakage sensor, a chemical sensor, a contact sensor, a non-contact sensor, an image sensor (e.g., a RGB camera and / or an infrared sensor), a particle sensor, a photoelectric sensor (e.g., ambient light and / or solar), a position sensor (e.g., a global positioning system), a precipitation sensor, a pressure sensor, a proximity sensor, a radiation sensor, an inertial measurement unit, a leak sensor, a level sensor, a metal sensor, a motion sensor, a range or depth sensor (e.g., RADAR and / or LiDAR), a speed sensor, a temperature sensor, a time-of-flight sensor, a torque sensor, and an ultrasonic sensor, a vacancy sensor, a presence sensor, a voltage and / or current sensor, a conductivity sensor, a resistivity sensor, a capacitive sensor, and / or a water sensor. In some344920-1811-1627Attorney Docket No. 081501-P71165W01embodiments, hub device 304 combines data from multiple sensors to generate information about physical environment 302.

[0110] In some embodiments, hub device 304 includes and / or is in communication with one or more speakers that can output audio content into physical environment 302. In some embodiments, hub device 304 includes and / or is in communication with one or more display component, such as a display, a projector, a touch-sensitive display, a head-mounted display (HMD), and / or another device component that presents visual content to a subject. In some embodiments, hub device 304 includes and / or is in communication with a touch-sensitive surface (such as a touchpad or a touch screen display) from which hub device 304 detects inputs.[OHl] In some embodiments, camera 306 is a computer system for capturing and / or recording images in the form of digital photos and / or videos. In some embodiments, camera 306 includes and / or is in communication with one or more sensors, such as those mentioned above with respect to hub device 304. In some embodiments, camera 306 captures an image and / or a video continuously and / or in response to detecting an activity via a sensor. In some embodiments, camera 306 combines data from multiple sensors (e.g., that are part of camera 306 and / or one or more additional devices in communication with camera 306) to generate information about physical environment 302. While camera 306 is presented as an individual device, it should be acknowledged that camera 306 can represent multiple devices capable of capturing images and / or videos. For example, camera 306 can include cameras positioned to observe important areas of physical environment 302, such as an entrance, a hallway, and / or a living room area.

[0112] In some embodiments, smart speaker 308 is a computer system that converts electrical signals into sound and includes one or more components for outputting audio, such as speakers, audio distributors, soundbars, headphones, earphones, earbuds, television speakers, HMD speakers, audio jacks, optical audio outputs, Bluetooth audio outputs, and / or HDMI audio outputs. For example, smart speaker 308 can output audio content to provide information to a subject. In some embodiments, smart speaker 308 includes one or more microphones that can be used by smart speaker 308 to obtain data and / or information from a subject and / or about physical environment 302. For example, smart speaker 308 can detect if a subject is in the room by detecting a subject talking via a microphone. In some embodiments, the information that smart speaker 308 obtains via the microphone includes 354920-1811-1627Attorney Docket No. 081501-P71165W01verbal inputs from a subject. For example, a subject can request smart speaker 308 to perform an action and / or obtain information for the subject. While smart speaker 308 is presented as an individual device, it should be acknowledged that smart speaker 308 can represent multiple devices capable of outputting audio.

[0113] In some embodiments, smart light 310 is a computer system for outputting light and includes one more components for outputting light, such as an incandescent, LED, fiber optic, fluorescent, halogen, and / or neon light. In some embodiments, smart light 310 includes and / or is in communication with one or more sensors, such as those mentioned above with respect to hub device 304. In some embodiments, smart light 310 outputs light or ceases outputting light in response to detecting an activity via a sensor. For example, smart light 310 can turn on in response to detecting a sound via a microphone. For another example, smart light 310 can turn off in response to detecting light from another light source via a light sensor. While smart light 310 is presented as an individual device, it should be acknowledged that smart light 310 can represent multiple devices capable of outputting light.

[0114] In some embodiments, smart lock 312 is a computer system for locking and unlocking an area and includes one or more components for such locking, such as a deadbolt, mortise, electromagnet, and / or latch lock. In some embodiments, smart lock 312 includes and / or is in communication with one or more sensors, such as those mentioned above with respect to hub device 304, and locks or unlocks in response to detecting an activity via a sensor. For example, smart lock 312 can lock in response to detecting a contact sensor close, indicating that a door has closed. In some embodiments, smart lock 312 includes and / or is in communication with an input component capable of detecting physical inputs, such as a physical input mechanism (e.g., one or more buttons) and / or a touch sensitive surface and / or screen, and locks or unlocks in response to detecting inputs via the input component. For example, smart lock 312 can unlock in response to detecting a correct PIN code being entered via the input component. In some embodiments, smart lock 312 includes a component for detecting other devices, such as Bluetooth, UWB, and / or Near Field Communication (NFC) component, and locks or unlocks in response to detecting another device. For example, smart lock 312 can unlock in response to detecting, via UWB, a personal device of a user approach smart lock 312. While smart lock 312 is presented as an individual device, it should be acknowledged that smart lock 312 can represent multiple devices capable of locking and unlocking areas.364920-1811-1627Attorney Docket No. 081501-P71165W01

[0115] Personal device A 314 and personal device B 316 are computer systems belonging to users and / or groups of users. For example, personal device A 314 and / or personal device B 316 can be a smart phone, a tablet, a smart watch, a laptop, a communal device, a personal gaming system, a desktop computer, a fitness tracking device, and / or an HMD. In some embodiments, personal device A 314 and personal device B 316 are the same type of device. For example, both personal device A 314 and personal device B 316 can both be smart phones. In other embodiments, personal device A 314 and personal device B 316 are different types of devices. For example, personal device A 314 can be a smartwatch while personal device B 316 can be a smart phone.

[0116] In some embodiments server 318 is a remotely accessible digital storage system, that is hosted by a service provider and accessible by registered devices of logical environment 300 (e.g., hub device 304 and / or other device with appropriate user credentials). In some embodiments, hub device 304 communicates with server 318 via a wired or wireless connection, such as Wi-Fi, ethernet, and / or cellular network.

[0117] In some embodiments, one or more devices within logical environment 300 communicate with hub device 304 about an activity detected within physical environment 302. For example, in response to unlocking, smart lock 312 can communicate the unlocking to hub device 304. In some embodiments, in response to a device communicating a detected activity, hub device 304 captures a photo and / or a video of physical environment 302 (e.g., via camera 306 and / or a camera of hub device 304). For example, in response to smart speaker 308 communicating about detecting a noise, hub device 304 can send a command to camera 306 to capture video of physical environment 302 near smart speaker 308. In some embodiments, one or more devices within logical environment 300 send information (e.g., images, video, audio, inputs and / or status updates from sensors) regarding an activity to hub device 304 and, in response, hub device 304 analyzes the information. For example, when camera 306 captures a video in response to detecting motion (e.g., as discussed above), camera 306 can send the video to hub device 304 to analyze. For example, hub device 304 can analyze a captured image of physical environment 302 that includes smoke and determine a fire is in physical environment 302.

[0118] In some embodiments, devices outside of hub device 304 analyze data to make determination. For example, camera 306 can determine an identity of a subject within an image and send the identity to hub device 304 rather than sending the image. For another 374920-1811-1627Attorney Docket No. 081501-P71165W01example, in response to smart lock 312 detecting the presence of a personal device of a user (e.g., personal device A 314), hub device 304 can request camera 306 to capture an image. After capturing the image, camera 306 can identify a subject in the image to determine whether the image includes the user.

[0119] In some embodiments, after a subject is identified (e.g., such as using camera 306 as described above), hub device 304 initiates an authentication process to authenticate the subject. The authentication process can verify and / or confirm the identity of the subject in physical environment 302. For example, if the subject is registered with hub device 304, in conjunction with identifying the subject (e.g., via camera 306 as described above), hub device 304 communicates with a personal device (e.g., personal device A 314 or personal device B 316) registered to the subject through wireless signal (e.g., UWB signal, Bluetooth signal, and / or Wi-Fi signal) to authenticate the subject. In some embodiments, hub device 304 captures and / or receives multiple types of information at once and is able to identify and authenticate the subject simultaneously. For example, in a scenario where the subject in physical environment 302 is speaking while being within the field-of-view of camera 306, hub device 304 can identify the subject using an image captured via camera 306 using facial recognition and authenticate the subject using audio captured via smart speaker 308 to match voice biometrics. In some embodiments, hub device 304 receives an authentication key (e.g., PIN code and / or key fob authenticator) for a user (such as when the user enters the authentication key at smart lock 312) and uses the fact that the authentication key corresponds to same user as detected in physical environment 302 via another device, such as camera 306, to authenticate the user.

[0120] In some embodiments, when a subject is identified and not authenticated, hub device 304 sends an authentication request to a personal device (e.g., personal device A 314 or personal device B 316) of the subject. For example, hub device 304 can send a request for a facial scan and / or a PIN to personal device A 314, and consider the subject authenticated upon receiving a notification from personal device 412 that correct information has been entered and / or received. In some embodiments, hub device 304 sends an authentication request to a personal device detected within physical environment 302.

[0121] In some embodiments, personal device B 316 is a personal device (e.g., phone, watch and / or tablet) belonging to an administrator (e.g., a resident, owner, and / or caretaker) of logical environment 300. Personal device B 316 can be in communication with hub device 384920-1811-1627Attorney Docket No. 081501-P71165W01304, and allow the administrator to view and / or remotely control aspects of logical environment 300, such as managing camera views and / or visitor access. In some embodiments, in response to detecting an inquiry (e.g., “Who is at the door?” and / or “Is anyone home?”), personal device B 316 sends a request to hub device 304 to capture an image (e.g., via camera 306) and send the image to personal device B 316. It should be acknowledged that communication between devices within physical environment 302 and personal device B 316 can occur even when personal device B 316 is outside physical environment 302, such as through a secure outside internet or cellular connection.

[0122] In some embodiments, hub device 304 sends a notification to personal device B 316 in response to detecting (e.g., directly and / or via another device of ecosystem 400) an activity. For example, hub device 304 can send a notification to personal device B 316 in response to not being able to identify a subject detected in physical environment 302. In some embodiments, the notification sent by hub device 304 to personal device B 316 includes information corresponding to a time and / or a location that the activity and / or subject was detected. In some embodiments, the notification includes an image and / or a video of the activity. For example, the notification can include a video of smoke filling a room where smoke was detected. In some embodiments, the notification includes identifying information (e.g., name, photo, and / or video) of the subject in physical environment 302. In some embodiments, hub device 304 sends a notification without sending images to personal device B 316. For example, an administrator might want to be notified if someone they recognize is at the front door without showing a video feed of a camera at the front door. For another example, the notification might not require an image, such as a notification that a thermostat has detected a temperature outside of a predetermined range. In other embodiments, hub device 304 does not send a notification if certain identified subjects are detected, thus avoiding unnecessary notifications (e.g., an administrator might not care to be notified if their spouse or roommate is detected at the front door).

[0123] In some embodiments, the notification sent by hub device 304 to personal device B 316 includes an option to authenticate a detected subject via the notification (e.g., a control within the notification and / or an application corresponding the notification). In some embodiments, if the detected subject is identified, the notification includes a control to initiate communication (e.g., text and / or call) with the detected subject. In some embodiments, the notification includes a control to initiate communication with a subject394920-1811-1627Attorney Docket No. 081501-P71165W01detected in physical environment 302 via smart speaker 308. In some embodiments, the notification includes escalation options such as a control contacting emergency services. In some embodiments, the administrator corresponding to personal device B 316 creates a profile for a subject in physical environment 302 that automatically authenticates the subject.

[0124] In some embodiments, devices within physical environment 302 output content to communicate information to a subject within physical environment 302. For example, in response to a subject being identified but not authenticated, hub device 304 can output via smart speaker 308 a request for the subject to authenticate themselves. For another example, in response to detecting a door being opened, hub device 304 can indicate the door is opened by outputting light via smart light 310 near the door. In some embodiments, devices within physical environment 302 output content to communicate an event escalation. For example, in response to personal device B 316 detecting an input on the control to contact emergency services (e.g., as described above), smart light 310 can flash its lights and smart speaker 308 can output alarm noises.

[0125] In some embodiments, hub device 304 allows communication with administrators of logical environment 300. For example, a person in physical environment 302 can request to call an administrator of logical environment 300 (e.g., initiate a call to personal device B 316) to request access to physical environment 302 and / or devices within physical environment 302. In some embodiments, hub device 304 detect such a request directly or via an input on a personal device (e.g., personal device A 314). In such embodiments, the administrator can give allowance to subject in physical environment 302 and personal device B 316 communicates to hub device 304 that the subject in physical environment 302 has been authenticated.

[0126] In some embodiments, after the subject in physical environment 302 is identified and authenticated, hub device 304 enables the subject access to physical environment 302 and / or one or more devices with physical environment 302. In some embodiments, hub device 304 enables the subject access to physical environment 302s for a predefined amount of time (e.g., 1 hour to 10 days). In such embodiments, the predefined amount of time can vary depending on the type of authorization provided to the subject. For example, a guest of physical environment 302 can have access for less time than a temporary resident of physical environment 302.404920-1811-1627Attorney Docket No. 081501-P71165W01

[0127] In some embodiments, data about activities detected within physical environment 302 is recorded and stored. Some or all of such activity data can be stored locally and / or on server 318. Storing activity data can allow an administrator of physical environment 302 to review a history of activity in physical environment 302.

[0128] Reference is made herein to environmental context (also referred to herein as a “context of an environment” and / or “a context corresponding to an environment”). In some embodiments, an environmental context is a context based on one or more characteristics of physical environment 302 (e.g., subjects, locations, time, weather, and / or lighting). For example, an environmental context can include that it is raining outside, that it is daytime, and / or that a device is currently located in a park. In some embodiments, a device (e.g., using an agent) determines an environmental context (e.g., to be currently true, occurring, and / or applicable) by detecting input (e.g., via one or more input devices) and / or receiving data (e.g., from one or more other devices and / or components in communication with the device).

[0129] Reference is made herein to user context (also referred to herein as a “context of a user” and / or “a context corresponding to a user”). In some embodiments, a user context is a context based on one or more characteristics of a user. For example, a user context can include a subject’s appearance and / or clothing, personality, actions, behavior, movement, location, and / or pose. In some embodiments, a device (e.g., using an agent) determines a user context (e.g., to be currently true, occurring, and / or applicable) by detecting input (e.g., via one or more input devices) and / or receiving data (e.g., from one or more other devices and / or components in communication with the device). In some embodiments, a device determines user context based on historical context and / or learned characteristics of the subject, where one or more characteristics of the subject are learned and / or stored over a period of time by the device.

[0130] Reference is made herein to operational context (also referred to herein as a “context of operation” and / or an “operating context”). In some embodiments, an operational context is a context based on one or more characteristics of the operation of a device (e.g., the device determining and / or accessing the operational context and / or one or more other devices). For example, an operational context can include an internal state of the device (and / or of one or more components of the device), an internal dialogue of the device (e.g., the device’s understanding of a context), operations being performed by the device, applications and / processes that are executing (e.g., running and / or open) on the device. In some414920-1811-1627Attorney Docket No. 081501-P71165W01embodiments, a device (e.g., using an agent) determines an operational context (e.g., to be currently true, occurring, and / or applicable) by detecting input (e.g., via one or more input devices) and / or receiving data (e.g., from one or more other devices and / or components in communication with the device). In some embodiments, a device (e.g., using an agent) determines an operational context (e.g., to be currently true, occurring, and / or applicable) by assessing one or more internal states (e.g., accessed, retrieved, and / or queried by a process of the device).

[0131] Reference is made herein to “performing output,” “causing output,” “outputting,” and / or similar phrases. Such phrases can be interchangeable and / or include computer system itself performing such output or causing another computer system perform such output.Reference is made herein to “displaying,” “causing display of,” “outputting visual content,” and / or similar phrases. Such phrases can be interchangeable and / or include computer system itself displaying or causing another computer system perform such display. Reference is made herein to “outputting audio,” “causing output of audio,” “providing audio output,” and / or similar phrases. Such phrases can be interchangeable and / or include computer system itself outputting audio or causing another computer system perform such output.

[0132] Attention is now directed towards embodiments of user interfaces (“UI”) and associated processes that are implemented on an electronic device, such as computer system 100, device 200, computer system 222, hub device 304, camera 306, smart speaker 308, smart light 310, smart lock 312, personal device A 314, personal device B 316, or server 318.

[0133] FIGS. 4A-4H illustrate exemplary user interfaces for managing guest access in an environment while on a call in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIG. 5.

[0134] In some embodiments, managing guest access is a process where an administrator of an environment is able to grant access to a guest within the environment and / or create a guest profile for the guest within an ecosystem (e.g., a set of one or more interconnected computer systems and / or accessories that interact with subjects within the environment) corresponding to the environment. In some embodiments, the environment is a location (e.g., a house, an apartment, a building, a living room and / or a locality configured by a user and / or defined by a computer system) that includes multiple accessories (e.g., a camera, a speaker,424920-1811-1627Attorney Docket No. 081501-P71165W01and / or other type of accessory) in communication with each other and / or a resident device (e.g., resident device 400). In such embodiments, the multiple accessories can be in communication with one or more controllers (e.g., personal device 424) directly or via the resident device. In some embodiments, an accessory can detect the guest and communicate with the resident device within the environment to determine how to respond to detection of the guest as described further below. For example, in response to receiving a communication that the guest is at the environment, the resident device can communicate with a personal device of an administrator (e.g., personal device 424). In some embodiments, in response to receiving the communication, the administrator is able to review the guest at the environment. In such embodiments, reviewing the guest can include the ability to grant permission to the guest in the environment and / or create a guest profile for the guest.

[0135] In some embodiments, an administer is a resident of the environment with control of access to the environment and / or to the one or more accessories in the environment for others. In some embodiments, a resident is a person and / or a device with access to the environment and / or to the one or more accessories in the environment but does not have control of access for others. In some embodiments, similar to a resident, a guest is a person and / or a device without control of access for others. In such embodiments, the guest might have different access to the environment on and / or to the one or more accessories in the environment than a resident.

[0136] FIGS. 4A-4H illustrate resident device 400 on the left and personal device 424 on the right. At FIG. 4A, resident device 400 is mounted on a wall at an entryway of a home and is in communication with personal device 424 and / or one or more accessory devices. It should be recognized that a home and aspects of resident device 400 are used as an example and that other locations (e.g., and / or environment such as, an office building, a warehouse, a parking lot, a public park, and / or an apartment building) and / or other aspects of resident device 400 can be used with techniques described herein.

[0137] In some embodiments, resident device 400 is a device that is installed within the home (e.g., a fixture) and / or is part of a local area network within the home. In some embodiments, resident device 400 is a device that is actively connected to a network within the home and / or consistently part of a network within the home. In some embodiments, resident device 400 is an always-on device within the home. In some embodiments, resident device 400 is a semi-permanent device and / or fixture (e.g., once installed in an environment,434920-1811-1627Attorney Docket No. 081501-P71165W01is confined to that environment), a connected-home device, a smart-home fixture, a core device, a home-hub device, a persistent device, a network device, an in-home node, an active device, a connected node, a local device, a resident node, a device that communicates with one or more accessory devices on behalf of one or more controller devices, a home-based device, and / or a fixed-location device. In some embodiments, resident device 400 includes and / or is in communication with one or more cameras. In some embodiments, resident device 400 includes one or more components and / or features described above in relation to computer system 100.

[0138] FIGS. 4A-4H illustrate personal device 424 as a smart phone belonging to the administrator. It should be recognized that personal device 424 can be other types of computer systems such as a tablet, a smart watch, a laptop, a communal device, an accessory, a personal gaming system, a desktop computer, a fitness tracking device, and / or a headmounted display (HMD) device. In some embodiments, personal device 424 includes and / or is in communication with one or more input devices (e.g., a sensor, a camera, a lidar detector, a motion sensor, an infrared sensor, a touch-sensitive surface, a physical input mechanism, and / or a microphone). In some embodiments, personal device 424 includes and / or is in communication with one or more output devices (e.g., a display screen, a projector, a touch-sensitive display, and / or a speaker). In some embodiments, personal device 424 includes one or more components and / or features described above in relation to computer system 100.

[0139] While the examples in FIGS. 4A-4H include resident device 400 and / or personal device 424 detecting one or more inputs, it should be recognized that such inputs are merely for explanatory purposes and that such inputs can be other types of inputs such as voice inputs via one or more microphones, touch inputs via one or more touch-sensitive surfaces, physical inputs via one or more physical input mechanisms, and / or hand-gesture inputs via one or more cameras. In some embodiments, another computer system within the environment detects one or more inputs.

[0140] As illustrated in FIG. 4A, resident device 400 displays identification user interface 412. In some embodiments, resident device 400 displays identification user interface 412 in response to receiving a communication from an accessory within the environment that is unable to identify the guest. In such embodiments, identification can be defined as the accessory detecting a guest within the environment and, in response to detecting the guest, attempting to identify an identity of the guest. In some embodiments, attempting to identify 444920-1811-1627Attorney Docket No. 081501-P71165W01the identity of the guest includes attempting recognition through media captured by a camera, biometrics (e.g., face and / or voice), and / or communication (e.g., via UWB, Bluetooth, WiFi, NFC, and / or the like) with a personal device of the guest to verify the identity of the guest. In some embodiments, resident device 400 detects an approaching guest and, in response, communicates with the accessory to attempt to identify the approaching guest. For example, in response to receiving a communication of the approaching guest, the accessory can attempt to identify the approaching guest by capturing an image of the approaching guest.

[0141] As illustrated in FIG. 4 A, identification user interface 412 includes an indication that the guest is unable to be identified (e.g., “Welcome” and “Home does not recognize you. Please identify yourself to home members.”), control 412a, and contact control 412b. It should also be recognized that more, fewer, and / or different elements can be included in identification user interface 412.

[0142] In some embodiments, authentication is defined as a recognition and / or authorization of a guest. In some embodiments, authentication requires two factors in order to be successful. In such embodiments, the two factor authentication can include multiple different forms of authentication, each having different requirements. For example, a first form of authentication can include identifying the guest in media captured via a camera. In such an example, a second form of authentication can include detecting a personal device of the guest in an environment and / or receiving an indication that a PIN code corresponding to the guest has been recently entered. As will be discussed further below with reference to FIGS. 4F-4G, a PIN code can be assigned to a guest by the administrator in a guest profile.

[0143] In some embodiments, in response to detecting an input directed to PIN control 468b, resident device 400 ceases display of identification user interface 412 and displays a PIN code user interface to allow a guest to authenticate themselves. In some embodiments, in response to detecting an input directed to contact control 412b, resident device 400 ceases display of identification user interface 412 and sends an invitation to personal device 424 (e.g., the personal device of the administrator) to join a telecommunications connection. In some embodiments, the telecommunications connection is a video call (e.g., receiving and / or transmitting audio data and video data). In other embodiments, the telecommunications connection call is an audio call (e.g., receiving and / or transmitting audio data). In some embodiments, in response to detecting an input directed to contact control 412b, resident device 400 ceases display of identification user interface 412 and sends an invitation to 454920-1811-1627Attorney Docket No. 081501-P71165W01another computer system belonging to a resident of the environment. In some embodiments, in response to detecting an input directed to contact control 412b, resident device 400 displays a messaging user interface to allow the guest to send a message to the administrator.

[0144] At FIG. 4A, resident device 400 detects input 405al directed to contact control 412b. It should be recognized that input 405al is an example of a selection input as a tap input but can be other inputs, such as a mouse click, a verbal input (e.g., “Call the homeowner.”), and / or a button press. At FIG. 4A, in response to detecting input 405al, resident device 400 sends an invitation to personal device 424 to join a telecommunications connection. In some embodiments, in response to detecting input 405al, resident device 400 initiates a telecommunications connection between itself and personal device 424. It should also be recognized that input 405al is an example of a first type of selection input and other intermediate steps may be needed before resident device 400 sends the invitation to personal device 424. For example, resident device 400 can display a list of administrators that a guest can pick from before sending the invitation to initiate the telecommunications connection with a personal device of a selected administrator.

[0145] As illustrated in FIG. 4 A, in response to receiving an invitation to join a telecommunications connection from resident device 400, personal device 424 displays call user interface 436. In some embodiments, rather than display call user interface 436, personal device 424 displays a notification on a home screen that resident device 400 is calling.

[0146] As illustrated in FIG. 4A, call user interface 436 includes call indication 448 (e.g., “Front door calling”) which indicates a location of the origin of the call. In some embodiments, personal device 424 displays call indication 448 differently if the location of the origin of the call is different. For example, if the environment has another resident device at the back door and personal device 424 receives an invitation to join a telecommunications connection from the other resident device at the back door, personal device 424 displays call indication 448 as, “Back door calling.”

[0147] As illustrated in FIG. 4 A, call user interface 436 includes decline control 436a and answer control 436b. In some embodiments, in response to detecting an input directed to decline control 436a, personal device 424 rejects the invitation to join a telecommunications connection with resident device 400 and ceases display of call user interface 436. In some embodiments, in response to detecting an input directed to answer control 436b, personal464920-1811-1627Attorney Docket No. 081501-P71165W01device 424 accepts the invitation to join a telecommunications connection with resident device 400 and establishes the telecommunications connection. It should also be recognized that more, fewer, and / or different elements can be included in call user interface 436.

[0148] At FIG. 4A, resident device 400 detects input 405a2 directed to answer control 436b. It should be recognized that input 405a2 is an example of a selection input as a tap input but can be other inputs, such as a mouse click, a verbal input (e.g., “Answer the call.”), and / or a button press.

[0149] In between FIGS. 4A and 4B, in response to detecting input 405a2, personal device 424 establishes the telecommunications connection with resident device 400 and begins the call between the administrator and the guest at the entrance of the environment. As illustrated in FIG. 4B, in response to a successful telecommunications connection, resident device 400 ceases display of identification user interface 412 and displays contact user interface 470. Contact user interface 470 includes administrator indication 430, icon 490, PIN control 412a, and exit control 402. In some embodiments, administrator indication 430 indicates to the guest that they are on an active call with the administrator. In some embodiments, administrator indication 430 includes the name of the administrator to indicate which administrator, if multiple, they are on the active call with. As illustrated in FIG. 4B, icon 490 is an image of a person with no features. In some embodiments, icon 490 includes an image of an administrator such as their contact card or user profile picture. At FIG. 4B, resident device 400 displays icon 490 in response to a determination that the setting for a call between the administrator and the guest includes a setting that the camera of the administrator should be off when starting the telecommunications connection. In some embodiments, the setting for the call between the administrator and the guest includes starting the call with the camera of the administrator being on. For example, when the guest is identified but not authenticated, a security setting can determine the guest is a known subject and begin the telecommunications connection with the camera of the administrator being on.

[0150] In some embodiments, in response to detecting an input directed to exit control 402, resident device 400 ends the call. In such embodiments, personal device 424 communicates with resident device 400 and / or a camera accessory to not grant access to the guest.474920-1811-1627Attorney Docket No. 081501-P71165W01

[0151] As illustrated in FIG. 4B, in response to a successful telecommunications connection, personal device 424 ceases display of decline control 436a and answer control 436b and displays live feed 460, allow control 484 (e.g., “Allow this person?”), and camera control 496. Additionally, in response to a successful telecommunications connection, personal device 424 updates call indication 448 to indicate that the ongoing call is originating from the front door. It should also be recognized that more, fewer, and / or different elements can be included, removed, and / or changed in call user interface 436. For example, in some embodiments, a microphone control that turns off and / or on a microphone of personal device 424 may also be included in call user interface 436.

[0152] As illustrated in FIG. 4B, live feed 460 is a live feed captured by a camera connected to and / or in communication with resident device 400 and / or the accessory and transmitted to personal device 424. As illustrated in FIG. 4A, live feed 460 includes guest representation 460a (e.g., a representation of the guest at the environment), and live feed 472. Live feed 472 is a live feed captured by a camera connected to and / or in communication with personal device 424. As illustrated in FIG. 4B, live feed 472 includes icon 472a when the camera of personal device 424 is turned off. As illustrated in FIG. 4B, icon 472a is an image of a person with no features. In some embodiments, icon 427a includes an image of the administrator such as their contact card or user profile picture. In some embodiments, rather than a live feed, personal device 424 outputs audio of the guest in the environment captured by the camera accessory and / or resident device 400 (e.g., similar to a phone call) instead of live feed 460. In some embodiments, rather than a live feed, resident device 400 displays a profile picture of the guest (e.g., in the scenario that the guest has a guest profile)

[0153] As illustrated in FIG. 4B, allow control 484 is a suggested action for the administrator that allows them to reject (e.g., reject control 484b) or allow (e.g., allow control 484) access to the guest in the environment. An input directed to allow control 484 allows the guest within the environment and / or creates a guest profile for the guest with the environment’s ecosystem. An input directed to reject control 484 indicates that the administrator does not want the guest to have access in the environment. In some embodiments, in response to detecting an input on reject control 484b, personal device 424 ends the telecommunications connection. In some embodiments, after detecting an input directed to reject control 484b, personal device 424 sends information to resident device 400 and / or one or more accessory devices corresponding to the environment. In such484920-1811-1627Attorney Docket No. 081501-P71165W01embodiments, after receiving information from personal device 424, resident device 400 and / or the one or more accessory devices can output an indication (e.g., display an indication, output an audio output, and / or output a light output) to the guest in the environment. For example, resident device 400 can display a message that the administrator rejected access to the guest. For another example, a speaker in the environment can output a statement that the administrator rejected access to the guest. As illustrated in FIG. 4B, personal device 424 displays exit control 474. In some embodiments, in response to detecting an input corresponding to exit control 474, personal device 424 ends the call and does not provide access to the guest in the environment.

[0154] As illustrated in FIG. 4B, camera control 496 includes a line over camera control 496 to show that the camera of personal device 424 is off. Camera control 496 allows the administrator to control whether the camera of personal device 424 is on or off. In this example, the camera of personal device 424 being off is based on a determination that the camera should remain off while starting the telecommunications connection. In some embodiments, the determination is based on a previous setting of personal device 424, resident device 400, and / or an application corresponding to the telecommunications connection. For example, when the guest in the environment is not identified, personal device 424 can determine that the guest in the environment may not be a person that the administrator would recognize and start the telecommunications connection with the camera off. In some embodiments, based on a determination that different set of conditions are met, personal device 424 starts the telecommunications connection with the camera on. For example, when the guest in the environment is identified but not authenticated, personal device 424 can determine that the guest in the environment is a known subject that the administrator would recognize and start the telecommunications connection with the camera on. In this example, live feed 472 would not include icon 472a and instead include a live feed captured by a camera included in and / or in communication with personal device 424.

[0155] At FIG. 4B, personal device 424 detects input 405b, from the homeowner, directed to camera control 496. It should be recognized that input 405b is an example of a selection input as a tap input but can be other inputs, such as a mouse click, a verbal input (e.g., “Turn on the camera.”), and / or a button press.

[0156] As illustrated in FIG. 4C, in response to detecting input 405b, personal device 424 turns the administrator’s camera on. After or in response to turning on the administrator’s 494920-1811-1627Attorney Docket No. 081501-P71165W01camera on, personal device 424 removes icon 472a and displays a live feed captured by a camera included in and / or in communication with personal device 424. The live feed includes administrator representation 420 (e.g., a representation of the administrator corresponding to personal device 424). While the administrator’s camera is turned on, personal device 424 sends video data to resident device 400. As illustrated in FIG. 4C, in response to detecting input 405b and personal device 424 turning on the administrator’s camera, resident device 400 removes icon 490 and displays live feed 408.

[0157] At FIG. 4C, personal device 424 detects input 405c directed to allow control 484. It should be recognized that input 405c is an example of a selection input as a tap input but can be other inputs, such as a mouse click, a verbal input (e.g., “They are allowed.”), and / or a button press.

[0158] As illustrated in FIG. 4D, in response to detecting input 405c and while maintaining live feed 472, personal device 424 displays guest access menu 432 that includes controls for different levels of guest access. Guest access menu 432 is a user interface element that allows the administrator to select how long the guest has access to the environment. As illustrated in FIG. 4B, guest access menu 432 includes one hour control 432a, day control 432b, and schedule control 432c. In some embodiments, in response to detecting an input directed to one hour control 432a, personal device 424 communicates with resident device 400 to grant access to the environment for one hour. In some embodiments, in response to detecting an input directed to day control 432b, personal device 424 communicates with resident device 400 to grant access to the environment for the rest of the day. In some embodiments, in response to detecting an input directed to schedule control 432c, personal device 424 ceases display of call user interface 436 and displays a schedule user interface that gives the administrator the ability to create an exact schedule for when the guest is allowed to enter the environment and / or how long they can remain in the environment. In some embodiments, different levels of access give the guest access to the same one or more accessories within the environment. In other embodiments, different levels of guest access include access to different types of one or more accessories within the environment.

[0159] In some embodiments, at FIG. 4D, personal device 424 detects input 405dl directed to day control 432b, causing personal device 424 to react as discussed below with respect to FIG. 4E. It should be recognized that input 405dl is an example of a selection 504920-1811-1627Attorney Docket No. 081501-P71165W01input as a tap input but can be other inputs, such as a mouse click, a verbal input (e.g., “Give access for today.”), and / or a button press. In some embodiments, at FIG. 4D, personal device 424 detects input 405d2 as a tap directed to schedule control 432c, causing personal device 424 to react as discussed below with respect to FIG. 4F. It should be recognized that input 405d2 is an example of a selection input as a tap input but can be other inputs, such as a mouse click, a verbal input (e.g., “Let make them a profile.”), and / or a button press.

[0160] As illustrated in FIG. 4E, in response to detecting input 405dl at day control 432b, personal device 424 ceases display of allow control 484 and guest access menu 432 and displays confirmation indication 456 (e.g., Allowed until end of day.”). Confirmation indication 456 indicates to the administrator that the guest in the environment has been granted permission for the day. In some embodiments, personal device 424 outputs a request for the administrator to further specify what accessories the guest will have access to before displaying confirmation indication 456.

[0161] At FIG. 4E, in response to detecting input 405dl on day control 432b, personal device 424 communicates with resident device 400 to allow the guest access for the rest of the day. In some embodiments, the end of the day is when the administrator changes a mode (e.g., sleep mode or lock mode) of personal device 424, resident device 400, and / or one or more accessories in the environment. In some embodiments, the end of the day is at midnight on the day when the administrator gave the guest access. At FIG. 4E, in response to receiving a communication from personal device 424 to allow the guest access for the rest of the day, resident device 400 authenticates the guest at the entry way of the environment and grants the guest access to the environment. As illustrated in FIG. 6E, in response to personal device 424 communicating with the resident device 400, resident device 400 displays confirmation indication 444 (“Access granted, Welcome!). Confirmation indication 444 indicates to the guest in the environment that they have been granted access.

[0162] In FIGS. 4F-4H, personal device 424 displays different user interfaces initiated by personal device 424 in response to detecting input 405d2 on schedule control 432c. As illustrated in FIG. 4F, in response to detecting input 405d2, personal device 424 ceases display of call user interface 436 and displays review user interface 468. As illustrated in FIG. 4F, review user interface 468 includes a series of user interface elements that allow a user to view, create, and / or edit a guest profile (e.g., including data and permissions)514920-1811-1627Attorney Docket No. 081501-P71165W01corresponding to the guest, including image 480, create name control 92, PIN control 404, schedule control 416, accessories control 428, and remote access control 440.

[0163] As illustrated in FIG. 4F, image 480 is the same image as guest representation 460a. In some embodiments, image 480 is an image of when the guest was detected and / or identified, it should be recognized that personal device 424 uses image 480 as the profile image for the guest. In some embodiments, a default profile image (e.g., of a blank head icon) is displayed within image 480 instead of the same image as guest representation 460a.Additionally, as illustrated within FIG. 4F, personal device 424 displays add control 480a within image 480. In some embodiments, in response to detecting an input directed to add control 480a, personal device 424 ceases display of review user interface 468 and displays a photo user interface that allows the administrator to select a different image for the guest.

[0164] As illustrated in FIG. 4F, create name control 492 has the words, “Create name” within create name control 492, indicating that no name has been created for the guest. In some embodiments, in response to detecting an input directed to create name control 492, personal device 424 displays a digital keyboard that allows the administrator to create a name for the guest.

[0165] As illustrated in FIG. 4F, PIN control 404 does not include any text or numbers within PIN control 404, indicating that no PIN has been created for the guest. In some embodiments, in response to detecting an input directed to PIN control 404, personal device 424 displays a digital keyboard to allow the administrator to create a PIN for the guest.Additionally, as illustrated in FIG. 4E, personal device 424 displays edit control 404a within PIN control 404. In some embodiments, in response to detecting an input to edit control 404a when no PIN has been created, personal device 424 displays a digital keyboard to allow the administrator to create a PIN for the guest. In some embodiments, in response to detecting an input to edit control 404a when a PIN has been created, personal device 424 displays a digital keyboard to allow the administrator to edit an existing PIN for the guest. It should be recognized that once a PIN is created for the guest, the guest can use it as a means of authentication and / or entry.

[0166] As illustrated in FIG. 4F, schedule control 416 does not include any dates and / or times within schedule control 416, indicating that no schedule has been created for the guest. In some embodiments, in response to detecting an input directed to schedule control 416,524920-1811-1627Attorney Docket No. 081501-P71165W01personal device 424 ceases display of review user interface 468 and displays a scheduling user interface to allow the administrator to create a custom schedule for the guest. For example, the administrator can create a schedule that only allows the guest access on Monday, Wednesday, and Friday, from the times of 8:00AM to 11 :00AM. For another example, the administrator can create a schedule that allows the guest access to the environment every Sunday, all day. Additionally, as illustrated in FIG. 4F, personal device 424 displays edit control 416a within schedule control 416. In some embodiments, in response to detecting an input to edit control 416a when no schedule has been created, personal device 424 ceases display of review user interface 468 and displays a scheduling user interface to allow the administrator to create a schedule for the guest. In some embodiments, in response to detecting an input to edit control 416a when a schedule has been created, personal device 424 ceases display of review user interface 468 and displays a scheduling user interface to allow the administrator to edit an existing schedule for the guest. It should be recognized that once a schedule is created for the guest, the guest is only granted access to the environment including particular accessories defined in accessories control 428 during the selected times and / or dates of the schedule. In some embodiments, if the guest tries to access the environment during a time not selected within the schedule, resident device 400 communicates with personal device 424 to notify the administrator.

[0167] As illustrated in FIG. 4F, accessories control 428 does not include any selected accessory indicators within accessories control 428, indicating that no accessories have been selected to be accessed by the guest. In some embodiments, in response to detecting an input directed to accessories control 428, personal device 424 ceases display of review user interface 468 and displays an accessory user interface including a list of accessories in the environment. In such embodiments, in response to an input to select an accessory, personal device 424 enables the accessory to be controlled by the guest. For example, the administrator can grant the guest access to use the television, the lights in the living room, and access into the laundry room. For another example, the administrator can grant the guest access to every accessory in the environment. For another example, the administrator can grant the guest access to only the living room and the backyard. Additionally, as illustrated in FIG. 4F, personal device 424 displays edit control 428a within accessories control 428. In some embodiments, in response to detecting an input to edit control 428a when no accessories have been selected, personal device 424 ceases display of review user interface 468 and displays an accessory user interface to allow the administrator to select which 534920-1811-1627Attorney Docket No. 081501-P71165W01accessories within the environment can be accessed by the guest. In some embodiments, in response to detecting an input to edit control 428a when accessories have been selected, personal device 424 ceases display of review user interface 468 and displays an accessory user interface to allow the administrator to edit which accessories within the environment can be accessed by the guest. In some embodiments, if the guest tries to access and / or use nonselected accessories, resident device 400 can communicate with personal device 424 to notify the administrator.

[0168] In some embodiments, in response to detecting an input directed to remote access control 440, personal device 424 grants the guest the ability to remotely control accessories that the guest has been granted access from their personal device while their personal device is away from the environment. For example, the guest can turn on the lights remotely if given remote access. For another example, the guest can unlock the front door remotely if given remote access.

[0169] As illustrated in FIG. 4E, in response to detecting input 405d2, personal device 424 displays live feed 460 that includes guest representation 460a (e.g., a representation of the guest) within review user interface 468. Live feed 460 is displayed in a different area and size as compared to live feed 460 display in call user interface 436. It should be recognized that the size and location of live feed 460 in review user interface 468 is an exemplary location and size to show that the call with resident device 400 is ongoing. In some embodiments, live feed 460 in review user interface 468 is displayed at a different size (e.g., smaller and / or larger) and / or a different location. In some embodiments, live feed 460 is not displayed in review user interface 468 while the call is ongoing. In some embodiments, personal device 424 ends the call with resident device 400 while displaying review user interface 468. In such embodiments, personal device 424 communicates with resident device 400 to grant the guest access to the environment, where the type of access (e.g., schedule and / or accessories) is updated after the administrator creates the guest profile.

[0170] In between FIG. 4F and FIG. 4G, the administrator enters information for the guest profile. For example, the administrator provides instructions on when and what access the guest can have. As illustrated in FIG. 4G, the administrator is granting the guest a PIN code of “0714”, (e.g., PIN code indication 404b) for access to the guest every Tuesday and Thursday (e.g., schedule indication 416b) for the living room and entry way of the environment (e.g., accessories indication 428b).544920-1811-1627Attorney Docket No. 081501-P71165W01

[0171] At FIG. 4G, personal device 424 detects input 405g directed to done control 452. It should be recognized that input 405c is an example of a selection input as a tap input but can be other inputs, such as a mouse click, a verbal input (e.g., “Create this profile for Dave.”), and / or a button press.

[0172] As illustrated in FIG. 4H, in response to detecting input 405g, personal device 424 ceases display of review user interface 468 and redisplays call user interface 436. As illustrated in FIG. 4H, call user interface 436 includes live feed 460, live feed 472, and indication 478. At FIG. 4H, in response to detecting input 405g, personal device 424 creates and saves the guest profile and displays indication 478. Indication 478 is used to indicate to the administrator that the guest profile has been created.

[0173] At FIG. 4H, in response to detecting input 405g, personal device 424 communicates with resident device 400 and to grant the guest access to the environment using Dave’s profile. As illustrated in FIG. 4H, after personal device 424 communicates with resident device 400 to grant the guest access, resident device 400 displays indication 464 (e.g., “Access granted.” And “Welcome Dave!”) while maintaining the call with the administrator. As illustrated in FIG. 4H, indication 464 includes the name given to the guest by the administrator. In some embodiments, resident device 400 displays indication 464 after the call with the administrator has ended. In some embodiments, indication 464 includes other identifying indications such as the profile picture corresponding to the profile of the guest.

[0174] FIG. 5 is a flow diagram illustrating a process (e.g., process 500) for providing guest access to an environment while on a call in accordance with some embodiments. Some operations in process 500 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.

[0175] As described below, process 500 provides an intuitive way for providing guest access to an environment while on a call. Process 500 reduces the cognitive burden on a user, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to interact with such devices faster and more efficiently conserves power and increases the time between battery charges.

[0176] In some embodiments, process 500 is performed at a first computer system (e.g., 424) that is in communication (e.g., wired communication and / or wireless communication)554920-1811-1627Attorney Docket No. 081501-P71165W01with (and / or includes) one or more output devices (e.g., a display component, an audio generation component, and / or a haptic generation component) and one or more input devices (e.g., a camera, a depth sensor, a microphone, a hardware input mechanism, a rotatable input mechanism, a physical input mechanism, and / or a touch-sensitive surface). In some embodiments, the first computer system is a watch, a phone, a tablet, a fitness tracking device, a processor, a head-mounted display (HMD) device, and / or a personal computing device. In some embodiments, the display component includes a display screen, a projector, and / or a touch-sensitive display. In some embodiments, the audio generation component includes a speaker, a smart speaker, a soundbar, a headphone, an earphone, an earbud, an audio jack, an optical audio output, and / or Bluetooth audio output.

[0177] The first computer system displays (502), via the one or more output devices, a call user interface (e.g., 436) corresponding to a connection (e.g., a call, a wired and / or wireless connection, an audio call, and / or a video call) with a second computer system (e.g., 400) external to the first computer system, wherein the call user interface includes a user interface element (e.g., 484 and / or 432) for providing guest access to an environment (e.g., a home, a business, an area, a predefined area, a defined area, a group of one or more devices, and / or a group of one or more accessory devices) (e.g., as describe above with respect to FIG.4B). In some embodiments, the call user interface includes a plurality of user interface elements, such as the user interface element for providing guest access to the environment and a user interface element for controlling an output device of the one or more output devices.

[0178] The first computer system detects (504), via the one or more input devices, a set of one or more inputs (e.g., 405c, 405dl, 405d2, and / or 405g) that includes: (506) a first input (e.g., 405c) that corresponds to a request to provide a respective level of guest access to the environment (e.g., as describe above with respect to FIG. 4C); and a (508) second input (e.g., 405dl, 405d2, and / or 405g) that is directed to the user interface element for providing guest access to the environment (e.g., as describe above with respect to FIG. 4D and / or FIG. 4G). In some embodiments, the respective level of guest access to the environment includes a period of time, one time access, and / or a schedule. In some embodiments, the set of one or more inputs is a single input. In some embodiments, the second input is the first input. In some embodiments, the second input is different and / or separate from the first input.564920-1811-1627Attorney Docket No. 081501-P71165W01

[0179] In response to (510) detecting the set of one or more inputs, in accordance with a determination that the respective level of guest access to the environment is a first level of guest access (e.g. ,432c) to the environment, the first computer system provides (512) (e.g., to a subject corresponding to and / or detected by the second computer system) the first level of guest access to the environment (e.g., as describe above with respect to FIGS. 4F-4H).

[0180] In response to (510) detecting the set of one or more inputs, in accordance with a determination that the respective level of guest access to the environment is a second level of guest access (e.g., 432a and / or 432b) to the environment, the first computer system provides (514) (e.g., to a subject corresponding to and / or detected by the second computer system) the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment (e.g., as describe above with respect to FIG. 4E). Providing different levels of guest access to an environment via a call user interface corresponding to a connection between different computer systems allows the first computer system to enable guest access to the environment for others directly from a call, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0181] In some embodiments, the first level of guest access (e.g., 432c) includes a frequency (e.g., a schedule, such as a day, month, year, and / or time) of access (e.g., 416) (e.g., as described above with respect to FIGS. 4F-4G). In some embodiments, the second level of guest access includes another frequency (e.g., a schedule, such as a day, month, year, and / or time) of access different from the frequency of access. Providing guest access for a particular frequency to an environment via a call user interface corresponding to a connection between different computer systems allows the first computer system to configure different guest access levels to the environment for others directly from a call, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0182] In some embodiments, the first level of guest access (e.g., 432c) includes access (e.g., 428) to (e.g., control, access to a current status, ability to modify a state of) one or more computer systems (e.g., an accessory device, a communal device, a personal device, a television, and / or a speaker) in the environment (e.g., locations included in 428b). In some embodiments, the one or more computer systems are external to the first computer system 574920-1811-1627Attorney Docket No. 081501-P71165W01(e.g., 424) and the second computer system (e.g., 400) (e.g., as described above with respect to FIGS. 4F-4G). In some embodiments, the second level of guest access includes access to (e.g., control, access to a current status, ability to modify a state of) one or more other computer systems (e.g., an accessory device, a communal device, a personal device, a television, and / or a speaker) in the environment different from the other or more computer systems. In some embodiments, the one or more other computer systems are external to the first computer system and the second computer system. In some embodiments, the second level of guest access does not include access to (e.g., control, access to a current status, ability to modify a state of) another computer system (e.g., an accessory device, a communal device, a personal device, a television, and / or a speaker) in the environment. In some embodiments, the other computer system is external to the first computer system and the second computer system. Providing guest access to one or more computer systems in an environment via a call user interface corresponding to a connection between different computer systems allows the first computer system to enable guest access to particular computer systems for others directly from a call, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0183] In some embodiments, the first level of guest access (e.g., 432c) is provided to a subject (e.g., represented by 460a) (e.g., a personal device, a person, and / or a wearable device) detected (e.g., via receiving a communication from the subject, via detection of the subject on a wireless network of and / or associated with the environment, via a camera, and / or via a microphone) in the environment. In some embodiments, the first level of guest access (e.g., 432c) includes remote access (e.g., 440) to one or more computer systems in the environment (e.g., locations included in 428b). In some embodiments, the one or more computer systems are external to the first computer system and the second computer system (e.g., as described above with respect to FIGS. 4A-4G). In some embodiments, the second level of guest access is provided to the subject. In some embodiments, the second level of guest access does not include remote access (e.g., and only local access, such as while the subject is connected to a wireless network of and / or associated with the environment) to the one or more computer systems in the environment. In some embodiments, remote access is while the subject is not connected to a wireless network of and / or associated with the environment. In some embodiments, remote access is via cellular. Providing remote guest access to a subject in an environment via a call user interface corresponding to a connection 584920-1811-1627Attorney Docket No. 081501-P71165W01between different computer systems allows the first computer system to enable remote control for others directly from a call, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0184] In some embodiments, the first level of guest access (e.g., 432c) is provided via an authentication code (e.g., 404b) (e.g., a password, a PIN, and / or a set of one or more characters) (e.g., as described above with respect to FIGS. 4F-4G). In some embodiments, the authentication code is defined via the second computer system. In some embodiments, the authentication code is defined via the first computer system and sent and / or provided to the second computer system. In some embodiments, the authentication code is defined for the second computer system. In some embodiments, the second level of guest access is provided via another authentication code (e.g., a password, a PIN, and / or a set of one or more characters) different from the authentication code. In some embodiments, the other authentication code is defined for the second computer system. In some embodiments, the second level of guest access is not provided via an authentication code defined for the second computer system. In some embodiments, entering the authentication code enables access to the environment, such as entering the authentication code on the second computer system and / or another computer system separate from the first computer system and the second computer system. Providing guest access via an authentication code to an environment via a call user interface corresponding to a connection between different computer systems allows the first computer system to enable guest access with the authentication code for others directly from a call, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0185] In some embodiments, in accordance with the determination that the respective level of guest access to the environment is the first level of guest access to the environment, the first input (e.g., 405d2) corresponds to a first user interface element for the first level of guest access (e.g., 432c) to the environment (e.g., when the respective level of guest access to the environment is the first level of guest access to the environment). In some embodiments, in accordance with the determination that the respective level of guest access to the environment is the second level of guest access (e.g., 432a and / or 432b) to the environment, the first input (e.g., 405dl) corresponds to a second user interface element for the second594920-1811-1627Attorney Docket No. 081501-P71165W01level of guest access (e.g., 432b) to the environment (e.g., when the respective level of guest access to the environment is the second level of guest access to the environment). In some embodiments, the second user interface element is separate from the first user interface element (e.g., as described above with respect to FIG. 4D). In some embodiments, the first user interface element is concurrently displayed with the second user interface element. Providing different levels of guest access to an environment using different user interface elements via a call user interface corresponding to a connection between different computer systems allows the first computer system to configure different levels of guest access to the environment for others directly from a call, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0186] In some embodiments, the second input is the first input. Providing guest access to an environment using a single input via a call user interface corresponding to a connection between different computer systems allows the first computer system to quickly grant access directly from a call, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0187] In some embodiments, the second input (e.g., 405dl, 405d2, and / or 405g) is separate (and / or different) from the first input (e.g., 405c) (e.g., as described above with respect to FIGS. 4C-4G). Providing guest access to an environment using at least one input detected via a call user interface corresponding to a connection between different computer systems and another input to define a level of the guest access allows the first computer system to configure different levels of guest access with a starting point from the call user interface, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0188] In some embodiments, the second computer system (e.g., 400) is a resident device (e.g., a communication hub, a controller, a home hub, and / or a hub device) that is in communication with (and / or manages communication with) one or more accessories (e.g., a light, a lock, a speaker, a television, a fan, an air conditioner, and / or a heater) within the environment. In some embodiments, the first level of guest access (e.g., 432c) is with respect to the one or more accessories. In some embodiments, the second level of guest access (e.g., 432a and / or 432b) is with respect to the one or more accessories (e.g., as described above 604920-1811-1627Attorney Docket No. 081501-P71165W01with respect to FIGS. 4D-4G). In some embodiments, the resident device and the one or more accessories are on the same wireless network, such as a local area network or a mesh network. Providing different levels of guest access to one or more accessories via a call user interface corresponding to a connection between the first computer system and a resident device associated with the one or more accessories allows the first computer system to communicate with the resident device while providing guest access through the resident device, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0189] In some embodiments, the one or more accessories include a plurality of accessories (e.g., as described above with respect to FIGS. 4D-4H). In some embodiments, the plurality of accessories includes an accessory of a first type and an accessory of a second type different from the first type. In some embodiments, the accessory of the first type is separate from the accessory of the second type.

[0190] In some embodiments, the first computer system (e.g., 424) is a personal device of an administrator (e.g., represented by 420 and / or 472) (e.g., a resident and / or an owner) of the environment (e.g., as described above with respect to FIGS. 4A-4H). Providing different levels of guest access to an environment via a call user interface corresponding to a connection between a personal device of an administrator of the environment and another computer system allows the personal device to control access to the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0191] In some embodiments, the first computer system (e.g., 424) is a personal device of an administrator (e.g., represented by 420 and / or 472) (e.g., a resident and / or an owner) of the second computer system (e.g., 400) (e.g., as described above with respect to FIGS. 4A-4H). Providing different levels of guest access to an environment via a call user interface corresponding to a connection between (1) a personal device of an administrator of a second computer system and (2) the second computer system allows the personal device to control access to the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.614920-1811-1627Attorney Docket No. 081501-P71165W01

[0192] In some embodiments, the call user interface (e.g., 436) is displayed while detecting the first input (e.g., 405c, 405dl, 405d2, and / or 405g) and while providing the first level of guest access (e.g., 432c) to the environment (e.g., as described above with respect to FIGS. 4C-4H). In some embodiments, the call user interface is displayed while detecting the second input and / or while providing the second level of guest access to the environment. Maintaining a call user interface through inputs to provide guest access and providing guest access allows a user of the first computer system to continue to communicate with a user of another computer system while providing guest access, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0193] In some embodiments, the call user interface (e.g., 436) includes content (e.g., video, audio, and / or an image) (e.g., 460) received from the second computer system (e.g., 400) (e.g., as described above with respect to FIGS. 4B-4H).

[0194] In some embodiments, the connection is an audio call (e.g., as described above with respect to FIG. 4B).

[0195] In some embodiments, the connection is a video call (e.g., as described above with respect to FIGS. 4B-4H).

[0196] In some embodiments, the connection includes the first computer system (e.g., 424) receiving video (e.g., 460) and audio from the second computer system (e.g., 400). In some embodiments, the connection includes, at a first time, the first computer system sending audio without sending video to the second computer system (e.g., as described above with respect to FIG. 4B). Providing different levels of guest access to an environment via a call user interface corresponding to a connection between different computer systems that is receiving audio and video while only sending audio allows the first computer system to enable guest access to the environment for others directly from a call without requiring video to go both ways, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0197] In some embodiments, the connection includes, at a second time different from the first time, the first computer system (e.g., 424) sending audio and video (e.g., 408) to the second computer system (e.g., 400) (e.g., as described above with respect to FIG. 4C). In some embodiments, after sending audio without sending video to the second computer system, the first computer system detects, via the one or more input devices, an input (e.g., a 624920-1811-1627Attorney Docket No. 081501-P71165W01tap input and / or a voice request) corresponding to a request to send video to the second computer system. In some embodiments, in response to detecting the input corresponding to the request to send video to the second computer system, the first computer system sends video and audio to the second computer system. Providing different levels of guest access to an environment via a call user interface corresponding to a connection between different computer systems that is switches from only sending audio to sending both audio and video allows the first computer system to enable guest access to the environment while choosing how to communicate with another computer system, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0198] In some embodiments, the call user interface (e.g., 436) includes an identification (e.g., 448) of (e.g., a name and / or identifier assigned to) the environment (e.g., as described above with respect to FIGS. 4A-4E). In some embodiments, the identification of the environment corresponds to a location where a guest was detected via the second computer system or a location where the second computer system is located. Providing different levels of guest access to an environment via a call user interface that includes an identification of the environment allows the first computer system to identify where guest access is to be given when providing the guest access, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0199] In some embodiments, the call user interface (e.g., 436) includes an identification (e.g., a name, a username, an account, and / or a unique identifier) of a subject (e.g., represented by 460a) in the environment, (e.g., as described above with respect to FIGS. 4A-4B) In some embodiments, the subject is a person within the environment. Providing different levels of guest access to an environment via a call user interface that includes an identification of a person in the environment allows the first computer system to identify who is to be given guest access when providing the guest access, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0200] In some embodiments, the call user interface (e.g., 436) includes an indication that an unknown guest (e.g., represented by 460a) is in the environment (e.g., as described above with respect to FIGS. 4A-4B). In some embodiments, the unknown guest is a person within the environment. In some embodiments, the unknown guest is a subject that is not able to be recognized and / or identified by the first computer system, the second computer system, and / or another computer system separate from the first computer system and the second 634920-1811-1627Attorney Docket No. 081501-P71165W01computer system. Providing different levels of guest access to an environment via a call user interface that includes an indication that an unknown guest is in the environment allows the first computer system to identify the presence of an unknown guest when providing guest access, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0201] In some embodiments, in response to detecting the set of one or more inputs, in accordance with the determination that the respective level of guest access to the environment is the first level of guest access (e.g., 432c) to the environment, the first computer system outputs (and / or displays), via the one or more output devices, a confirmation (e.g., 478 and / or 464) (e.g., a visual and / or auditory confirmation, such as text that indicates access has been provided) that the first level of guest access has been provided (e.g., as described above with respect to FIG. 4H). In some embodiments, in response to detecting the set of one or more inputs, in accordance with the determination that the respective level of guest access to the environment is the second level of guest access (e.g., 432a and / or 432b) to the environment, the first computer system outputs (and / or displays), via the one or more output devices, a confirmation (e.g., 444 and / or 456) (e.g., a visual and / or auditory confirmation, such as text that indicates access has been provided) that the second level of guest access has been provided (e.g., as describe above with respect to FIG. 4E). Outputting a confirming when guest access is provided via a call user interface allows the first computer system to indicate a status of the guest access, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0202] In some embodiments, before displaying the call user interface (e.g., 436), the first computer system receives (e.g., from the second computer system or another computer system separate from the first computer system and the second computer system) a notification that an unrecognized subject (e.g., an unrecognized person and / or an unrecognized guest) is detected in the environment (e.g., as described above with respect to FIG. 4A). In some embodiments, in response to receiving the notification that an unrecognized subject is detected in the environment, the first computer system displays an indication of the notification. Receiving a notification that an unrecognized subject is detected in an environment before providing different levels of guest access to the environment via a call user interface allows the first computer system to first be notified of a644920-1811-1627Attorney Docket No. 081501-P71165W01situation before connecting to a call via the call user interface, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0203] In some embodiments, before displaying the call user interface (e.g., 436 as illustrated in FIGS. 4B-4E and / or 4H), the first computer system receives (e.g., from the second computer system or another computer system separate from the first computer system and the second computer system) a notification (e.g., call user interface 436 as illustrated in FIGS. 4A) that the second computer system (e.g., 400) is calling the first computer system (e.g., 424), wherein the call user interface is displayed in response to detecting an input (e.g., 405a2)(e.g., an input corresponding to a acceptance of a call from the second computer system) corresponding to the notification that the second computer system is calling the first computer system (e.g., as described above with respect to FIGS. 4A-4B). In some embodiments, in response to receiving the notification that the second computer system is calling the first computer system, the first computer system displays the notification that the second computer system is calling the first computer system. Receiving a notification that another computer system is calling the first computer system before providing different levels of guest access to the environment via a call user interface allows the first computer system to have a choice for whether to accept a call via the call user interface, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0204] In some embodiments, before displaying the call user interface (e.g., 436), the first computer system receives a call from a respective location within the environment, wherein the call user interface includes: in accordance with a determination that the respective location is a first location, an indication (e.g., 448) of the first location (e.g., as describe above with respect to FIG. 4A); and in accordance with a determination that the respective location is a second location, an indication of the second location (e.g., without including the indication of the first location), wherein the second location is different from the first location (e.g., as describe above with respect to FIG. 4 A). Including different indication of different locations depending on where a call is received from to provide different levels of guest access allows the first computer system to identify where a person is located before providing guest access to the person, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0205] In some embodiments, while displaying the call user interface (e.g. ,436) and before providing access to the environment, the first computer system detects, via the one or 654920-1811-1627Attorney Docket No. 081501-P71165W01more input devices, an input (e.g., a tap input and / or a voice request) (e.g., an input at exit control 474) corresponding to a request to end the connection (e.g., as described above with respect to FIG. 4B). In some embodiments, in response to detecting the input corresponding to the request to end the connection, the first computer system ends the connection without providing guest access to the environment (e.g., as described above with respect to FIG. 4B). Enabling the first computer system to end a connection with another computer system without providing guest access to an environment allows the first computer system to choose whether to provide the guest access while on a call with the other computer system, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0206] Note that details of the processes described above with respect to process 500 (e.g., FIG. 5) are also applicable in an analogous manner to other processes described herein. For example, process 900 optionally includes one or more of the characteristics of the various processes described above with reference to process 500. For example, the guest access provided in process 500 can include access to the one or more accessory devices in process 900. For brevity, these details are not repeated herein.

[0207] FIGS. 6A-6C illustrate exemplary user interfaces for managing notifications of an environment in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIG. 7.

[0208] In some embodiments, managing notifications of an environment includes multiple computer systems in an ecosystem (e.g., an interconnected system of computer systems and / or accessories that interact with people within the environment) detecting and identifying subjects leaving the environment and / or a state of the environment (e.g., door locked and / or garaged closed). In some embodiments, the environment is a location (e.g., a house, an apartment, a building, a living room and / or a locality configured by a user and / or defined by a computer system) that include multiple accessories (e.g., a camera, a speaker, and / or other type of accessory) in communication with each other and / or a resident device as described above. In some embodiments, an accessory can detect the guest and communicate with the resident device within the environment to determine how to respond to detection of the guest as described further below. For example, in response to receiving a communication that the guest is at the environment, the resident device can communicate with a personal device of an administrator (e.g., personal device 424). In some embodiments, in response to 664920-1811-1627Attorney Docket No. 081501-P71165W01receiving the communication, the administrator is able to review the guest at the environment. In such embodiments, reviewing the guest can include the ability to grant permission to the guest in the environment and / or create a guest profile for the guest.

[0209] FIGS. 6A-6C illustrate personal device 424 on the left and schematic 612 on the right. Personal device 424 is illustrated as a smart phone. It should be recognized that personal device 424 can be other types of computer systems such as a tablet, a smart watch, a laptop, a communal device, an accessory, a personal gaming system, a desktop computer, a fitness tracking device, and / or a head-mounted display (HMD) device. In some embodiments, personal device 424 includes and / or is in communication with one or more input devices (e.g., a sensor, a camera, a lidar detector, a motion sensor, an infrared sensor, a touch-sensitive surface, a physical input mechanism, and / or a microphone). In some embodiments, personal device 424 includes and / or is in communication with one or more output devices (e.g., a display screen, a projector, a touch-sensitive display, and / or a speaker). In some embodiments, personal device 424 includes one or more components and / or features described above in relation to computer system 100, resident device 310 and / or computer system 360. As illustrated in FIG. 6A, personal device 424 displays lock screen user interface 600. Lock screen user interface 600 includes an indication of the date and time (e.g., “Friday, October 11” and “9:41”). It should be recognized that personal device 424 is the personal computer system of an administrator of the environment, Alex.

[0210] FIGS. 6A-6C illustrate schematic 612 on the right, a representation of the environment of an interior of a home, which includes entryway 624 with front door 684, living room 648 and bedroom 636. In some embodiments, the environment is an apartment, a building, and / or a locality configured by a user (e.g., administrator and / or homeowner) and / or defined by a computer system such as a resident computer system. Schematic 612 also includes resident device representation 604 (e.g., a representation of resident device 400 as described above with respect to FIG.4A-4H), camera accessory representation 610 (e.g., a representation of the camera accessory within the home), administrator representation 660 (e.g., a representation of the administrator, Alex) near front door 684 and guest representation 672 (e.g., a representation of a guest, Brittany). It should be recognized that resident device representation 604 represents a resident device, such as a central computer system within the environment that connects to and / or communicates with multiple the systems and / or accessories within the environment. In some embodiments, resident device representation 604674920-1811-1627Attorney Docket No. 081501-P71165W01represents a communal device and / or a television. In some embodiments, the resident device includes and / or is in communication with one or more sensors (e.g., a camera, a LiDAR detector, a motion sensor, an infrared sensor, ultra-wideband (UWB) and / or a microphone). Such sensors can be used to detect presence, attention, statements, requests, and / or instructions from a subject in an environment. It should also be recognized that a camera accessory (e.g., exemplified by camera accessory representation 610) is in the same environment and in communication with a resident device (e.g., exemplified by resident device representation 604). In some embodiments, the camera accessory is included in (e.g., a part of and / or connected to) the resident device.

[0211] FIGS. 6A-6B illustrate a scenario where a subject, identified as the administrator, is detected leaving the environment. As illustrated in FIG. 6A, the administrator (e.g., represented by administrator representation 660) is leaving the environment through front door 684 as illustrated by the arrow originating from administrator representation 660. At FIG. 6A, the administrator, Alex, is detected leaving the environment. In some embodiments, the resident device detects and identifies that the administrator is leaving the environment. For example, the resident device can detect the movement of personal device 424 in the environment through UWB sensors. In some embodiments, the resident device uses one or more sensors to detect motion in the environment and determine that the administrator is leaving the environment using the one or more sensors. For example, the camera accessory can detect motion of a subject and transmit such information to the resident device that then identifies the subject as the administrator. In such an example, the camera accessory (e.g., exemplified by camera accessory representation 610) can detect a subject near the front door and send data to the resident device to determine that the administrator is the subject leaving the environment. In some embodiments, an accessory device such as a smart lock and / or garage security system is in communication with the resident device and detecting a subject has left the environment includes the resident device receiving an indication that the accessory device has changed status. For example, the resident device can detect that a smart lock at the front door is being opened and / or locked to determine someone has left through the front door. In some embodiments, the resident device and / or one or more accessory can detect an input that that a subject has left, such as a verbal statement (e.g., “I am leaving the house now!”) and determine that voice input of the subject matches a voice profile corresponding to the administrator.684920-1811-1627Attorney Docket No. 081501-P71165W01

[0212] As illustrated in FIG. 6B, the administrator is out the environment as illustrated by administrator representation 660 being on the other side of front door 684. At FIG. 6B, the administrator is determined to have left the environment. In some embodiments, the determination that the administrator has left the environment is determined by detecting that a personal device of the administrator is no longer in the environment. In some embodiments, the determination that the administrator has left the environment is determined by receiving (e.g., from a server, a personal device of the administrator, and / or an accessory device) one or more indications that the administrator has left the environment.

[0213] At FIG. 6B, in response to detecting the administrator has left, the resident device determines if there is anyone else left in the environment. At FIG.6B, the guest is determined to still be in the environment. In some embodiments, the resident device detects and identifies that the guest is still in the environment. For example, the resident device can detect the movement of, such as through UWB sensors, a personal device of the guest in the environment. In some embodiments, the resident device uses one or more sensors to determine if there is motion in the environment and detects motion of the guest using the one or more sensors. For example, the camera accessory can detect motion of a subject and transmit such information to the resident device that then identifies the subject as a guest. For another example, one or more accessories can detect a subject in the living room and send data of motion of the subject to the resident device to identify the guest. In some embodiments, the resident device and / or one or more accessories can detect an input that that a subject has left, such as a verbal statement (e.g., “I am still home!”) and determine that the verbal statement corresponds to a guest.

[0214] At FIG. 6B, the resident device determines that a guest is still in the environment. As illustrated in FIG. 6B, in response to detecting the administrator has left and a determination that the guest is still in the environment, personal device 424 does not display a notification of a status of the environment. In some embodiments, personal device 424 displays a notification after the determination the guest is still in the environment. In some embodiments, personal device 424 displays a notification for security purposes. For example, in a scenario where the guest is an unknown subject, the resident device can send an indication that someone the administrator does not know is still in the environment. For another example, in a scenario where the guest is a subject who is unable to leave (e.g., a bedridden grandmother) the environment, the resident device can ignore the guest and694920-1811-1627Attorney Docket No. 081501-P71165W01communicate with personal device 424 to display a notification (e.g., Everyone but Grandma has left the home). As illustrated in FIG. 6B, the guest, represented by guest representation 672, is heading to front door 684 as illustrated by the arrow originating from guest representation 672.

[0215] As illustrated in FIG. 6C, the guest is out of the environment as illustrated by guest representation 672 being on the other side of front door 684. At FIG. 6C, the guest is determined to have left the environment. In some embodiments, the determination that the guest has left the environment is determined by detecting that a personal device of the guest is no longer in the environment. In some embodiments, the determination that the guest has left the environment is determined by receiving (e.g., from a server, a personal device of the guest, and / or an accessory device) one or more indications that the guest has left the environment.

[0216] At FIG. 6C, the resident device determines that no subject is the environment. At FIG. 6C, in response to detecting the guest has left and a determination that no one is in the environment, the resident device determines a status of the environment. In some embodiments, in response to detecting the guest has left, the resident device communicates with multiple accessories in the environment and / or ecosystem to send live (e.g., current and / or present) data of each accessory. In some embodiments, communicating to send the live data includes commanding one or more accessories devices to capture media content, such as an image and / or a video. In some embodiments, communicating to send the live data includes commanding one or more accessories devices to provide status (e.g., device is locked, device is unlocked, a computer system is still in the environment and / or a malfunction of the device) of the accessories. In some embodiments, after determining that the guest has left and in response to receiving and analyzing the live data of the accessories, the resident device communicates with personal device 424 to display a notification. As illustrated in FIG. 6C, in response to detecting the guest has left and a determination that no one is in the environment, resident device sends an indication of the status of the environment to personal device 424 and personal device 424 displays the status of the environment as notification 696. In some embodiments, while displaying the status of the environment as notification 696, personal device 424 outputs audio corresponding to notification 696, such as an alert sound or a dictation of content included in notification 696.704920-1811-1627Attorney Docket No. 081501-P71165W01

[0217] As illustrated in FIG. 6C, notification 696 includes content about a state and / or a summary of the environment (e.g., Everyone is away and front door is locked”). In some embodiments, notification 696 includes states of multiple accessories in the environment. In some embodiments, content included in notification 696 is based on a setting of personal device 424, such as which accessories (e.g., front lock, back door, and or garage) to include in notifications. In some embodiments, notification 696 includes an indication of time (e.g., today at 9:43). In some embodiments, notification 696 includes an identification of the environment (e.g., “Miller home”). In some embodiments, notification 696 includes an indication of a location within the environment where a subject is detected to have left the environment (e.g., “front door” or “back door”). In some embodiments, notification 696 includes a representation of the set of one or more subjects (e.g., profile image from contacts and / or photo from external device when the respective subject was detected in the environment). In some embodiments, personal device 424 displays notification 696 after a predefined amount of time has passed since receiving the indication from the resident device.

[0218] FIG. 7 is a flow diagram illustrating a process (e.g., process 700) for displaying status of an environment in accordance with some embodiments. Some operations in process 700 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.

[0219] As described below, process 700 provides an intuitive way for displaying status of an environment. Process 700 reduces the cognitive burden on a user, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to interact with such devices faster and more efficiently conserves power and increases the time between battery charges.

[0220] In some embodiments, process 700 is performed at a computer system (e.g., 424). In some embodiments, the computer system is a resident device, a phone, a watch, a tablet, a fitness tracking device, a processor, a head-mounted display (HMD) device, and / or a personal computing device. In some embodiments, the display component includes a display screen, a projector, and / or a touch-sensitive display. In some embodiments, the audio generation component includes a speaker, a smart speaker, a soundbar, an audio jack, an optical audio output, and / or Bluetooth audio output.714920-1811-1627Attorney Docket No. 081501-P71165W01

[0221] The computer system detects (702) that a set of one or more subjects (e.g., a user, a person, a guest, a resident, an individual, and / or a primary and / or nearest user, person, and / or individual) (e.g., represented by 660 and / or 627) has left (e.g., exited and / or no longer detected) an environment (e.g., a location, a home, a room, a yard, a business, an area, a predefined area, a defined area, and / or a building) (e.g., 612) (e.g., as described above with respect to FIGS. 6A-6C). In some embodiments, detecting that the set of one or more subjects has left the environment includes detecting, via one or more input devices (e.g., a camera, a depth sensor, a microphone, a hardware input mechanism, a rotatable input mechanism, a physical input mechanism, and / or a touch-sensitive surface) that are in communication with and / or included with the computer system, that the set of one or more subjects has left the environment. In some embodiments, detecting that the set of one or more subjects has left the environment includes detecting that a personal device of a subject of the set of one or more subjects is no longer in the environment. In some embodiments, detecting that the set of one or more subjects has left the environment includes receiving (e.g., from a server, a personal device of a subject of the set of one or more subjects, and / or another computer system separate from the computer system) an indication that the one or more subjects has left the environment.

[0222] In response to (704) detecting that the set of one or more subjects has left the environment, in accordance with a determination that a subject (e.g., any subject or a particular subject such as a resident of the environment) is not detected in (and / or does not remain within) the environment, the computer system outputs (706) a notification (e.g., 696) (e.g., a summary of a state of the first computer and / or one or more external devices, such as an accessory device, a communal device, and / or a personal device, in communication with and separate from the computer system) corresponding to the environment (e.g., as described above with respect to FIG. 6C). In some embodiments, outputting the notification includes outputting, via one or more output devices (e.g., a display component, an audio generation component, and / or a haptic generation component) that are in communication with and / or included with the computer system, the notification. In some embodiments, outputting the notification includes sending, to another computer system (e.g., a phone, a tablet, a fitness tracking device, a processor, and / or a personal computing device) external to the first computer system, the notification.724920-1811-1627Attorney Docket No. 081501-P71165W01

[0223] In response to (704) detecting that the set of one or more subjects has left the environment, in accordance with a determination that a subject (e.g., any subject or a particular subject such as a resident of the environment) is detected in (and / or remains within) the environment, the computer system forgoes (708) output of the notification corresponding to the environment (e.g., as described above with respect to FIG. 6B). Selectively outputting a notification depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0224] In some embodiments, the notification (e.g., 696) corresponding to the environment (e.g., 612) includes: in accordance with a determination that an administrator (e.g., an owner and / or a logged-in user) of the computer system customized notifications corresponding to the environment in a first manner (e.g., established that such notification would include a status of certain accessories and / or include certain information corresponding to the environment), first content (e.g., a state and / or status of an accessory, an indication of a state and / or context corresponding to the environment, and / or an identification of presence of a person in the environment) (e.g., as describe above with respect to FIG. 6C); and in accordance with a determination that the administrator of the computer system customized notifications corresponding to the environment in a second manner (e.g., established that such notification would include a status of certain accessories and / or include certain information corresponding to the environment), second content (e.g., a state and / or status of an accessory, an indication of a state and / or context corresponding to the environment, and / or an identification of presence of a person in the environment) (e.g., without including the first content) different from the first content. In some embodiments, the second manner is different from the first manner (e.g., as describe above with respect to FIG.6C). Customizing a notification that is output depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide particular information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.734920-1811-1627Attorney Docket No. 081501-P71165W01

[0225] In some embodiments, the notification (e.g., 696) includes an indication of time (e.g., when the set of one or more subjects left the environment and / or when the notification was output) (e.g., as described above with respect to FIG. 6C). Selectively outputting a notification with an indication of time depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0226] In some embodiments, the notification (e.g., 696) includes a summary (e.g., no one is home, all of the doors are locked, one door is unlocked, all of the windows are closed, the garage door is open, the garage door is closed, all of the lights are off, lights remain on in one room, and / or the like) of a current state of the environment (e.g., as described above with respect to FIG. 6C). Selectively outputting a notification with a summary of an environment depending on whether a subject is detected in the environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0227] In some embodiments, the notification (e.g., 696) includes an indication of a current state (e.g., on, off, active, power-saving mode, turned up to high, and / or the like) of an accessory device (e.g., a communal device, a lock, a light, a television, a speaker, a fan, an air conditioner, and / or a heater) within the environment (e.g., 612) (e.g., as described above with respect to FIG. 6C). Selectively outputting a notification with indication of a current state of an accessory device depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0228] In some embodiments, the computer system (e.g., 424) is a resident device (e.g., a communication hub, a controller, a home hub, and / or a hub device) that is in communication with (and / or manages communication with) one or more accessories (e.g., a light, a lock, a speaker, a television, a fan, an air conditioner, and / or a heater) within the environment (e.g.,744920-1811-1627Attorney Docket No. 081501-P71165W01612). In some embodiments, the one or more accessories includes the accessory device (e.g., represented by 610) (e.g., as described above with respect to FIG. 6C). In some embodiments, the resident device and the one or more accessories are on the same wireless network, such as a local area network or a mesh network.

[0229] In some embodiments, in response to detecting that the set of one or more subjects (e.g., represented by 660 and / or 627) has left the environment (e.g., 612), the computer system obtains, via the accessory device, the current state of the accessory device (e.g., represented by 610) (e.g., as described above with respect to FIG. 6C). In some embodiments, obtaining, via the accessory device, the current state of the accessory device includes sending, to the accessory device, a request for the current state of the accessory device.

[0230] In some embodiments, the notification (e.g., 696) includes: an indication of a current state (e.g., on, off, active, power-saving mode, turned up to high, and / or the like) of a first accessory device (e.g., represented by 610) (e.g., a communal device, a lock, a light, a television, a speaker, a fan, an air conditioner, and / or a heater) within the environment (e.g., 612) (e.g., as described above with respect to FIG. 6C); and an indication of a current state (e.g., on, off, active, power-saving mode, turned up to high, and / or the like) of a second accessory device (e.g., a communal device, a lock, a light, a television, a speaker, a fan, an air conditioner, and / or a heater) within the environment. In some embodiments, the second accessory device is different from the first accessory device (e.g., as described above with respect to FIG. 6C). In some embodiments, the indication of the current state of the second accessory device is separate from the indication of the current state of the first accessory device. Selectively outputting a notification with indications of a current state of different accessory devices depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0231] In some embodiments, the notification (e.g., 696) includes an identification (e.g., “your home” and / or “New York home”) of the environment (e.g., 612) (e.g., as described above with respect to FIG. 6C). In some embodiments, the identification of the environment is defined by a user of the computer system. In some embodiments, the identification of the environment is automatically assigned by the computer system, such as being an address of 754920-1811-1627Attorney Docket No. 081501-P71165W01the environment or a default name. Selectively outputting a notification with an identification of an environment depending on whether a subject is detected in the environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0232] In some embodiments, the notification (e.g., 696) includes: in accordance with a determination that the set of one or more subjects left the environment via a first portion (e.g., a front door, a back door, or a garage) of the environment, an identification of the first portion of the environment (e.g., as described above with respect to FIG. 6C); and in accordance with a determination that the set of one or more subjects left the environment via a second portion (e.g., a front door, a back door, or a garage) of the environment, an identification of the second portion of the environment. In some embodiments, the second portion is different from the first portion (e.g., as described above with respect to FIG. 6C). In some embodiments, the identification of the second portion of the environment is different from the identification of the first portion of the environment. Selectively outputting a notification with an identification of a portion of an environment when a set of one or more subjects left the environment depending on whether a subject is detected in the environment in response to detecting that the set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0233] In some embodiments, the notification (e.g., 696) includes a representation (e.g., a profile image from contacts, an image from another computer system external to the computer system, and / or a video) of the set of one or more subjects (e.g., represented by 660 and / or 627) (e.g., as described above with respect to FIG. 6C). Selectively outputting a notification with a representation of a set of one or more subjects depending on whether a subject is detected in an environment in response to detecting that the set of one or more subjects has left the environment allows the computer system to provide information about who recently left the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.764920-1811-1627Attorney Docket No. 081501-P71165W01

[0234] In some embodiments, the notification (e.g., 696) includes an identification (and / or an indication) of when the set of one or more subjects (e.g., represented by 660 and / or 627) left the environment (e.g., as described above with respect to FIG. 6C). Selectively outputting a notification with an identification of when a set of one or more subjects left an environment depending on whether a subject is detected in an environment in response to detecting that the set of one or more subjects has left the environment allows the computer system to provide information about when the set of one or more subjects left the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0235] In some embodiments, the notification (e.g., 696) corresponding to the environment is a first notification corresponding to the environment. In some embodiments, in response to detecting that the set of one or more subjects (e.g., represented by 660 and / or 627) has left the environment, in accordance with a determination that a first subject (e.g., a particular subject such as a guest of the environment, and / or a particular type of subject) is detected in (and / or remains within) the environment, the computer system outputs a second notification (e.g., a summary of a state of the first computer and / or one or more external devices, such as an accessory device, a communal device, and / or a personal device, in communication with and separate from the computer system) corresponding to the environment;, wherein the second notification is different from the first notification (e.g., as described above with respect to FIG. 6B). In some embodiments, outputting the notification includes outputting, via one or more output devices (e.g., a display component, an audio generation component, and / or a haptic generation component) that are in communication with and / or included with the computer system, the notification. In some embodiments, outputting the notification includes sending, to another computer system (e.g., a phone, a tablet, a fitness tracking device, a processor, and / or a personal computing device) external to the first computer system, the notification. In some embodiments, in response to detecting that the set of one or more subjects has left the environment, in accordance with a determination that a second subject (e.g., a particular subject such as a resident of the environment, and / or a particular type of subject) is detected in (and / or remains within) the environment, the computer system forgoes output of a notification (e.g., 696) corresponding to the environment, wherein the second subject is different from the first subject (e.g., as described above with respect to FIG. 6B). Selectively outputting a notification depending on who is detected as remaining in an environment allows the computer system to provide information 774920-1811-1627Attorney Docket No. 081501-P71165W01about the environment when only particular subjects remain in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0236] In some embodiments, in response to detecting that the set of one or more subjects has left the environment and in accordance with a determination that a subject (e.g., 672) is detected in (and / or remains within) the environment, the computer system forgoes output of a notification corresponding to the environment (e.g., as described above with respect to FIG.6B). Selectively outputting a notification depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0237] In some embodiments, the notification (e.g., 696) corresponding to the environment (e.g., 612) is a first notification corresponding to the environment. In some embodiments, in response to detecting that the set of one or more subjects has left the environment and in accordance with a determination that a subject (e.g., 612) is detected in (and / or remains within) the environment, the computer system outputs a second notification corresponding to the environment, wherein the second notification is different from (e.g., includes different content than and / or has a different appearance from) the first notification (e.g., as described above with respect to FIG. 6B). Outputting a different notification depending on whether a subject remains in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when people leave the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0238] In some embodiments, detecting that the set of one or more subjects (e.g., represented by 660 and / or 627) has left the environment includes detecting that a personal device (e.g., 424) of the set of one or more subjects is no longer in the environment (e.g., 612) (e.g., as described above with respect to FIGS. 6A-6C).

[0239] In some embodiments, the notification (e.g., 696) corresponding to the environment is output after a predetermined amount of time (e.g., 30 seconds to 10 minutes) has passed since detecting that the set of one or more subjects (e.g., represented by 660784920-1811-1627Attorney Docket No. 081501-P71165W01and / or 627) has left the environment (e.g., 612) (e.g., as described above with respect to FIG.6C). In some embodiments, the predetermined amount of time is a non-zero amount of time. Outputting a notification after a predetermined amount of time has passed since detecting that a set of one or more subjects has left an environment depending on whether a subject is detected in the environment in response to detecting that the set of one or more subjects has left the environment allows the computer system to wait to confirm that the set of one or more subjects have actually left before providing information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0240] In some embodiments, outputting the notification (e.g., 696) corresponding to the environment includes outputting, via one or more speakers that are in communication with the computer system, audio (e.g., as described above with respect to FIG. 6C). Selectively outputting audio depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0241] In some embodiments, outputting the notification (e.g., 696) corresponding to the environment includes displaying, via one or more display components that are in communication with the computer system, content (e.g., as described above with respect to FIG. 6C). Selectively displaying content depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0242] In some embodiments, outputting the notification (e.g., 696) includes sending, to another computer system (e.g., a personal device of an administrator of the environment and / or the computer system) separate from the computer system, the notification (e.g., as described above with respect to FIG. 6C). Selectively sending a notification to another computer system depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the794920-1811-1627Attorney Docket No. 081501-P71165W01environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0243] In some embodiments, outputting the notification (e.g., 696) includes sending, to a plurality of different computer systems (e.g., personal device of different administrators of the environment and / or the computer system) separate from the computer system, the notification (e.g., as described above with respect to FIG. 6C). Selectively sending notifications to other computer systems depending on whether a subject is detected in an environment in response to detecting that a set of one or more subjects has left the environment allows the computer system to provide information about the environment when no one remains in the environment, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0244] Note that details of the processes described above with respect to process 700 (e.g., FIG. 7) are also applicable in an analogous manner to other processes described herein. For example, process 700 optionally includes one or more of the characteristics of the various processes described above with reference to process 700. For example, the status of the environment in process 700 can include a status of the one or more accessory devices in process 900. For brevity, these details are not repeated herein.

[0245] FIGS. 8A-8G illustrate exemplary user interfaces for managing access during an emergency in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIG. 9.

[0246] In some embodiments, managing access during an emergency includes an administrator receiving a notification of an activity in an environment. In some embodiments, the environment is a location (e.g., a house, an apartment, and / or a location) that includes multiple accessories e.g., a camera, a speaker, and / or other type of accessory) and / or sensors (e.g., a camera, a LiDAR detector, a motion sensor, an infrared sensor, ultra-wideband (UWB) and / or a microphone) in communication with each other and / or a resident device. In such embodiments, a camera accessory can detect the activity (e.g., a guest, a noise, and / or a sensor has been activated) and communicate with the resident device within the environment. In some embodiments, the resident device is a computer system that corresponds to and / or is in communication with accessories within the environment.804920-1811-1627Attorney Docket No. 081501-P71165W01

[0247] In some embodiments, the resident device includes a camera. In some embodiments, in response to receiving a communication that an activity is detected in the environment, the resident device communicates with a personal device of an administrator (e.g., personal device 424). In some embodiments, an administer is a resident of the environment with control of access to the environment and / or to the one or more accessories in the environment for others. In some embodiments, a resident is a person and / or a device with access to the environment and / or to the one or more accessories in the environment but does not have control of access for others.

[0248] FIGS. 8A-8G illustrate personal device 424 as a smart phone. It should be recognized that personal device 424 can be other types of computer systems such as a tablet, a smart watch, a laptop, a communal device, an accessory, a personal gaming system, a desktop computer, a fitness tracking device, and / or a head-mounted display (HMD) device. In some embodiments, personal device 424 includes and / or is in communication with one or more input devices (e.g., a sensor, a camera, a lidar detector, a motion sensor, an infrared sensor, a touch-sensitive surface, a physical input mechanism, and / or a microphone). In some embodiments, personal device 424 includes and / or is in communication with one or more output devices (e.g., a display screen, a projector, a touch-sensitive display, and / or a speaker).

[0249] While the examples in FIGS. 8A-8G include personal device 424 detecting one or more inputs, it should be recognized that such inputs are merely for explanatory purposes and that such inputs can be other types of inputs such as voice inputs via one or more microphones, touch inputs via one or more touch-sensitive surfaces, physical inputs via one or more physical input mechanisms, and / or hand-gesture inputs via one or more cameras. In some embodiments, another computer system within the environment detects one or more inputs.

[0250] It should be recognized that, before FIG. 8A, the resident device detected an activity (e.g., smoke within the environment in the environment. In response to detecting the activity in the environment, the resident device attempted to identify the activity. In some embodiments, identification is defined as the resident device detecting motion in the environment and, in response to detecting the activity, attempting to identify any issues in the environment. In some embodiments, attempting to identity any issues in the environment includes analyzing one or more images, including a video feed, through media captured by a camera included in the resident device or in communication with the resident device. It 814920-1811-1627Attorney Docket No. 081501-P71165W01should be recognized that the resident device was able to identify smoke and then, in response, communicate information of the smoke to personal device 424.

[0251] As illustrated in FIG. 8A, personal device 424 displays lock screen user interface 600. Lock screen user interface 600 includes an indication of the date and time “Friday, October 11” and “9:55” as well as, in response to receiving communication from the resident device, notification 800. It should be recognized that more, fewer, and / or different elements can be included in lock screen user interface 600.

[0252] As illustrated in FIG. 8A, notification 800 includes activity indication 812 (e.g., “Smoke detected.”) that includes information about the type of activity that was detected and identified in the environment by the resident device. Additionally, as illustrated in FIG. 8A, notification 800 includes view activity control 824 and get help control 836. In some embodiments, notification 800 includes other indications of the activity such as a location that the activity was detected in (e.g., kitchen and / or front door) and / or a time the activity was first detected. In some embodiments, personal device 424 does not display notification 800 if it is determined that the administrator or a resident is in the environment and / or that the activity can be ignored. In some embodiments, personal device 424 displays notification 800 on another user interface, such as a home user interface, an internet user interface, and / or a landing page user interface.

[0253] In some embodiments, in response to detecting an input directed to get help control 836, personal device 424 initiates a communication with emergency service (e.g., 911 and / or a security company) and / or an emergency contact. At FIG. 8A, personal device 424 detects input 805a directed to view activity control 824. It should be recognized that input 805a is an example of a selection input as tap inputs but can be other inputs, such as a mouse click, a verbal input (e.g., “Show me the activity.”), and / or a button press.

[0254] As illustrated in FIG. 8B, in response to detecting input 805a, personal device 424 ceases display of lock screen user interface 600 and displays activity user interface 848 that includes live feed 860. Live feed 860 is captured by a camera connected to and / or in communication with the resident device within the environment and is transmitted to personal device 424. Additionally, personal device 424 displays get help control 836 overlaid on of live feed 860.824920-1811-1627Attorney Docket No. 081501-P71165W01

[0255] At FIG. 8B, personal device 424 detects input 805b directed to get help control 448c. It should be recognized that input 805b is an example of a selection input as a tap input but can be other inputs, such as a mouse click, a verbal input (e.g., “I don’t know who that is.”, “Call my emergency contact.”, and / or “Call 911”), and / or a button press.

[0256] As illustrated in FIG. 8C, in response to detecting input 805b, personal device 424 displays menu 822 while maintaining display of live feed 860. Menu 822 includes emergency contact control 822a and contact emergency services control 822b. In some embodiments, in response to detecting an input directed to emergency contact control 822a, personal device 424 ceases display of activity user interface 848 and displays a call user interface with the administrator’s emergency contact. In some embodiments, the administrator’s emergency contact is a contact that that the administrator preselected for emergency conditions and / or is automatically set based on frequency of contact (e.g., calls and / or texts). In some embodiments, in a scenario where the administrator has multiple emergency contacts, personal device 424 displays a menu with a list of each emergency contact to allow the administrator to choose which emergency contact to call.

[0257] At FIG. 8C, personal device 424 detects input 805c directed to contact emergency services control 822b. It should be recognized that input 805c is an example of a selection input as tap inputs but can be other inputs, such as a mouse click, a verbal input (e.g., “Call 911.”), and / or a button press.

[0258] As illustrated in FIG. 8D, in response to detecting an input directed to contact emergency services control 822b, personal device 424 initiates an emergency call, ceases display of activity user interface 848, and displays call user interface 884. As illustrated in FIG. 8D, call user interface 884 includes a number of controls (e.g., control 896) that correspond to various functionalities that personal device 424 can perform while personal device 424 is a participant in the emergency call. During the emergency call, personal device 424 and the other computer system (e.g., computer system of 911) exchange audio data without exchanging video data. In some embodiments, video data from personal device 424 is able to be sent to the other computer system.

[0259] Between FIGS. 8D- 8E, time has passed (e.g., thirty-seven seconds). After the time has passed and in response to a determination that the administrator is on the emergency call with emergency services, personal device 424 outputs a request to share home access834920-1811-1627Attorney Docket No. 081501-P71165W01with emergency services. In some embodiments, personal device 424 outputs the request after a predefined amount of time has passed since the emergency call began. In some embodiments, personal device 424 outputs the request after a determination that nobody is in the environment at the time of the activity. In some embodiments, personal device 424 outputs the request as an audio output from a speaker of personal device 424. As illustrated in FIG. 8E, personal device 424 outputs the request by displaying prompt 808 within call user interface 884. Prompt 808 is a control that, when tapped on, allows the homeowner to share home access with emergency services.

[0260] At FIG. 8E, personal device 424 detects input 805e directed to prompt 808. It should be recognized that input 805e is an example of a selection input as tap inputs but can be other inputs, such as a mouse click, a verbal input (e.g., “Yes, I want to share access ”), and / or a button press.

[0261] It should also be recognized that FIG.8F is an example of personal device 424 outputting a request to share home access with emergency services. In some embodiments, personal device 424 does not display FIG. 8E and moves directly to displaying user interface elements as illustrated in FIG. 8F.

[0262] As illustrated in FIG. 8F, in response to detecting an input 805e, personal device 424 displays accessory device menu 820 while maintaining the emergency call with emergency services. Accessory device menu 820 includes identification of multiple home accessory devices within the environment. As illustrated in FIG. 8F, personal device 424 includes light control 832, camera 1 control 844, lock control 856, and camera 2 control 868. At FIG. 8F, all the home accessory devices displayed are shaded to indicate that they are selected to share. In some embodiments, the administrator selects each accessory device control. In some embodiments, personal device 424 detects an input (e.g., a tap input or a voice request to deselect light control 832) corresponding to light control 832 and, in response to the input corresponding to light control 832, deselects light control 865. In such embodiments, personal device 424 removes the shading inside light control 865 to indicate that the light corresponding to light control 832 will not be shared with emergency services. In some embodiments, a live feed preview of an accessory device is displayed within accessory device menu 820 for accessory device controls that include cameras. For example, camera 1 control 844 can includes live feed 860 as described above with respect to FIGS. 8B and 8C.844920-1811-1627Attorney Docket No. 081501-P71165W01

[0263] It should be recognized that more, less and / or of different accessory device controls can be included within accessory device menu 820. In some embodiments, accessory device menu 820 includes other accessory devices above and / or below options illustrated in FIG. 8F. For example, in response to detecting an upward swipe input, personal device 424 scrolls down to show other possible accessories devices available. In some embodiments, accessory device menu 820 includes all accessories within an ecosystem of the environment. In some embodiments, accessory device menu 82 only includes accessory devices that are relevant to the activity. For example, in a scenario where the activity is located in a kitchen of a two story home, personal device 424 provides options that are relevant to accessing the kitchen and not the entire home (e.g., personal device 424 does not display accessory devices on the second floor and / or the bedrooms). In some embodiments, different sets of accessories are displayed in accessory device menu 820. For example, in a scenario where multiple accessories are part of a of a defined location (e.g., living room, bedroom, and / or kitchen), the administrator can pick to share access to the kitchen but not the bedroom and / or living room. In response to the administrator choosing to share access to the kitchen, personal device 424 provides access a set of accessory devices corresponding to the kitchen with emergency services.

[0264] As illustrated in FIG. 8F, in response to detecting input 805e, personal device 424 displays not now control 880 and share control 892. In some embodiments, in response to detecting an input directed to not now control 880, computer system ceases display of accessory device menu 820 and displays call user interface 884 in a similar manner as illustrated in FIG. 8E that includes a control to share home access later in the call.

[0265] At FIG. 8F, personal device 424 detects input 805f directed to share control 892. It should be recognized that input 805f is an example of a selection input as tap inputs but can be other inputs, such as a mouse click, a verbal input (e.g., “Share these accessories.”), and / or a button press.

[0266] As illustrated in FIG. 8G, in response to detecting input 805f, personal device 424 provides access of the accessories chosen from accessory device menu 820 to emergency services while on the emergency call. Providing access of the accessories allows emergency services to monitor and / or access the environment while the administrator is on the emergency call. In some embodiments, providing access includes sending data (e.g., live feeds, access keys, and / or PIN codes) to a computer system corresponding to emergency 854920-1811-1627Attorney Docket No. 081501-P71165W01services. In some embodiments, providing access includes disarming one or more accessories devices for a predefined amount of time. In some embodiments, personal device 424 revokes access of the accessories chosen from accessory device menu 820 to emergency services after the call is over. In some embodiments, personal device 424 revokes access of the accessories chosen from accessory device menu 820 to emergency services after a predefined amount of time (e.g., one hour to one day) has passed after the call is over.

[0267] Also illustrated in FIG. 8G, in response to detecting input 805f, personal device 424 ceases display of accessory device menu 820 and displays indication 804 (e.g., “4 accessories devices shared”). In some embodiments, indication 804 is displayed for a predefined amount of time. In some embodiments, indication 804 is always displayed while the administrator is on the call with emergency services. In some embodiments, indication 804 includes a control to stop providing access. In some embodiments, in response to an input directed to indication 804, personal device 424 displays accessory device menu 820, as described with respect to FIG. 8F.

[0268] FIG. 9 is a flow diagram illustrating a process (e.g., process 900) for providing access to accessories in an environment in accordance with some embodiments. Some operations in process 900 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.

[0269] As described below, process 900 provides an intuitive way for providing access to accessories in an environment. Process 900 reduces the cognitive burden on a user, thereby creating a more efficient human -machine interface. For battery-operated computing devices, enabling a user to interact with such devices faster and more efficiently conserves power and increases the time between battery charges.

[0270] In some embodiments, process 900 is performed at a computer system (e.g., 424) that is in communication (e.g., wired communication and / or wireless communication) with (and / or includes) one or more input devices (e.g., a camera, a depth sensor, a microphone, a hardware input mechanism, a rotatable input mechanism, a physical input mechanism, and / or a touch-sensitive surface) and one or more output devices (e.g., a display component, an audio generation component, and / or a haptic generation component) including one or more display components (e.g., display screen, a projector, and / or a touch-sensitive display). In some embodiments, the first computer system is a watch, a phone, a tablet, a fitness tracking864920-1811-1627Attorney Docket No. 081501-P71165W01device, a processor, a head-mounted display (HMD) device, and / or a personal computing device. In some embodiments, the display component includes a display screen, a projector, and / or a touch-sensitive display. In some embodiments, the audio generation component includes a speaker, a smart speaker, a soundbar, a headphone, an earphone, an earbud, an audio jack, an optical audio output, and / or Bluetooth audio output.

[0271] The computer system displays (902), via the one or more display components, a call user interface (e.g., 884) corresponding to a connection (e.g., a call, a wired and / or wireless connection, an audio call, and / or a video call) with a resource (e.g., emergency contact, an Emergency Call Center (ECC), and / or 911) for emergency assistance. In some embodiments, the connection is established in response to detecting, via the one or more input devices, a set of one or more inputs that corresponds to a request to contact the resource for emergency assistance. In some embodiments, the connection is established in response to detecting, via the one or more input devices, an input corresponding to a user interface element displayed in response to receiving an indication (e.g., an alert and / or notification) of an activity (e.g., video, image, motion sense, loud noise, fire, glass break and / or door opening / closing) in an environment (e.g., a home, a room, a yard, and / or a building). In some embodiments, the indication of the activity is received from an external computer system (e.g., an external computer system that detected the activity and / or another external computer system different from the external computer system that detected the activity).

[0272] While displaying the call user interface corresponding to the connection with the resource for emergency assistance (and / or while maintaining the connection with the resource for emergency assistance), the computer system outputs (904), via the one or more output devices, a prompt (e.g., 808 and / or 820) to share access to one or more other computer systems (e.g., represented by 832, 844, 856, and / or 868) (e.g., one or more accessory devices) with the resource for emergency assistance (e.g., a personal device and / or computer system of the resource for emergency assistance) (e.g., as described above with respect to FIGS. 8D-8F). In some embodiments, outputting the prompt includes displaying, via the one or more display components, the prompt. In some embodiments, outputting the prompt includes auditorily outputting, via one or more speakers of the one or more output devices, the prompt.

[0273] In conjunction with (e.g., after or while) outputting the prompt (and / or while maintaining the connection with the resource for emergency assistance), the computer system detects (906), via the one or more input devices, an input (e.g., 805e and / or 805f) (e.g., a tap 874920-1811-1627Attorney Docket No. 081501-P71165W01input and / or a voice input) corresponding to a request to share access to one or more other computer systems (e.g., one or more accessory devices) with the resource for emergency assistance (e.g., as described above with respect to FIGS. 8E-8F).

[0274] In response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance (and / or while maintaining the connection with the resource for emergency assistance), the computer system shares (908), to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system (e.g., as described above with respect to FIGS. 8E-8G). In some embodiments, sharing access includes sending data (e.g., video and / or audio) to the resource for emergency assistance. In some embodiments, sharing access includes providing a pin code to allow entry to the environment. In some embodiments, after outputting the prompt without detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance, the computer system forgoes share of access of one or more other computer systems to the resource for emergency assistance. In some embodiments, while forgoing share of access of one or more other computer systems devices to the resource for emergency assistance, the computer system maintains the connection with the resource for emergency assistance. Sharing, to a resource for emergency assistance, access to a set of computer systems while displaying a call user interface corresponding to a connection with the resource for emergency assistance allows the computer system to facilitate help from the resource while on a call with the resource, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0275] In some embodiments, after sharing, to the resource for emergency assistance, access to the respective set of one or more other computer systems (e.g., represented by 832, 844, 856, and / or 868), the computer system maintains the connection with the resource for emergency assistance (e.g., as described above with respect to FIGS. 8F-8G). After sharing, to a resource for emergency assistance, access to a set of one or more computer systems, maintaining a connection with the resource for emergency assistance allows a user of the computer system to continue obtaining help from the resource even after the access is shared,884920-1811-1627Attorney Docket No. 081501-P71165W01thereby performing an operation when a set of conditions has been met without requiring further user input.

[0276] In some embodiments, in response to detecting that the connection with the resource for emergency assistance has ceased, the computer system ceases share of, to the resource for emergency assistance, access to the respective set of one or more other computer systems (e.g., represented by 832, 844, 856, and / or 868) (e.g., as described above with respect to FIG. 8G). No longer sharing, to a resource for emergency assistance, access to a set of one or more computer system to response to detecting that a connection with the resource for emergency assistance has ceased allows the computer system to share while the connection is maintained but maintain privacy and security after the connection is over without requiring an explicit input to revoke the access, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0277] In some embodiments, after detecting that the connection with the resource for emergency assistance has ceased and in response to a determination that a predefined period of time (e.g., 1 minute to 5 hours) has passed since the connection with the resource for emergency assistance has ceased, the computer system ceases share of, to the resource for emergency assistance, access to the respective set of one or more other computer systems (e.g., represented by 832, 844, 856, and / or 868) (e.g., as described above with respect to FIG.8G). In some embodiments, after detecting that the connection with the resource for emergency assistance has ceased and in response to a determination that the predefined period of time has not passed since the connection with the resource for emergency assistance has ceased, the computer system maintains, for the resource for emergency assistance, access to the respective set of one or more other computer systems. No longer sharing, to a resource for emergency assistance, access to a set of one or more computer system in response to a determination that a predefined period of time has passed since a connection with the resource for emergency assistance has ceased allows the computer system to maintain access to the resource for some time after the connection is over but still not require an explicit input to revoke the access, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.894920-1811-1627Attorney Docket No. 081501-P71165W01

[0278] In some embodiments, outputting the prompt (e.g., 808 and / or 820) to share access to one or more other computer systems (e.g., 808 and / or 820) with the resource for emergency assistance includes displaying, via the one or more display components, the prompt within the call user interface (e.g., as described above with respect to FIGS. 8E-8F). Displaying a prompt to share access to one or more computer system within a call user interface allows the computer system to couple sharing access with a communication without requiring navigating away from the call user interface, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0279] In some embodiments, the respective set of one or more other computer systems includes a first computer system (e.g., represented by 832 and / or 844) and a second computer system (e.g., represented by 856, and / or 868) separate from the first computer system. In some embodiments, the prompt (e.g., 820) includes an identification of the first computer system and an identification of the second computer system (e.g., as described above with respect to FIG. 8F). In some embodiments, the identification of the second computer system is separate from the identification of the first computer system. Identifying multiple computer systems within a prompt to share access to the multiple computer systems allows the computer system to indicate which computer systems are being provided access, thereby providing improved visual feedback to the user and / or performing an operation when a set of conditions has been met without requiring further user input.

[0280] In some embodiments, the respective set of one or more other computer systems includes a first computer system (e.g., represented by 844) and a second computer system (e.g., represented by 868) separate from the first computer system. In some embodiments, the prompt (e.g., 820) includes video (and / or an indication and / or a representation of video) received from the first computer system and video (and / or an indication and / or a representation of video) received from the second computer system (e.g., as described above with respect to FIG. 8F). In some embodiments, the video received from the second computer system is separate from the video received from the first computer system. Including video from multiple computer systems in a prompt to share access to the multiple computer systems allows the computer system to show what will be shared in a process for sharing, thereby providing improved visual feedback to the user and / or performing an operation when a set of conditions has been met without requiring further user input.904920-1811-1627Attorney Docket No. 081501-P71165W01

[0281] In some embodiments, the respective set of one or more other computer systems includes a first computer system (e.g., represented by 832 and / or 844) and a second computer system (e.g., represented by 856, and / or 868) separate from the first computer system. In some embodiments, the prompt includes a control for modifying a state of the first computer system and a control for modifying a state of the second computer system (e.g., as described above with respect to FIG. 8F). In some embodiments, the control for modifying the state of the second computer system is separate from the control for modifying the state of the first computer system. In some embodiments, the control for modifying the state of the second computer system and / or the control for modifying the state of the first computer system is selectable such that each control can be selected by detecting, via the one or more input devices, an input corresponding to a control. A prompt to share access to multiple computer systems including controls for selecting each computer system allows the computer system to provide functionality for selecting which computer systems to share, thereby providing improved visual feedback to the user and / or performing an operation when a set of conditions has been met without requiring further user input.

[0282] In some embodiments, the respective set of one or more other computer systems includes a first computer system (e.g., represented by 832 and / or 844) and a second computer system separate from the first computer system. In some embodiments, the second computer system (e.g., represented by 856, and / or 868) is a different type (e.g., a camera, a lock, a speaker, and / or the like) of computer system than the first computer system (e.g., as described above with respect to FIG. 8F). Sharing, to a resource for emergency assistance, access to multiple different types of computer systems while displaying a call user interface corresponding to a connection with the resource for emergency assistance allows the computer system to provide different types of functionality using different types of computer systems to the resource for emergency assistance, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0283] In some embodiments, sharing, to the resource for emergency assistance, access to the respective set of one or more other computer systems includes: in accordance with a determination that the respective set of one or more other computer systems is a first set of one or more other computer systems (e.g., represented by 832 and 844), sharing, to the resource for emergency assistance, access to the first set of one or more other computer systems (e.g., as described above with respect to FIGS. 8F-8G); and in accordance with a914920-1811-1627Attorney Docket No. 081501-P71165W01determination that the respective set of one or more other computer systems is a second set of one or more other computer systems (e.g., represented by 856, and 868), sharing, to the resource for emergency assistance, access to the second set of one or more other computer systems (e.g., as described above with respect to FIGS. 8F-8G) (e.g., without sharing access to the first set of one or more other computer system). Sharing, to a resource for emergency assistance, access to different sets of computer systems while displaying a call user interface corresponding to a connection with the resource for emergency assistance allows the computer system to customize access that it is giving for help from the resource while on a call with the resource, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0284] In some embodiments, while the connection with the resource for emergency assistance is maintained, the computer system detects, via the one or more input devices, an input (e.g., a tap input and / or a voice request) corresponding to a request to select the respective set of one or more other computer systems, wherein the determination that the respective set of one or more other computer systems is the first set of one or more other computer systems (e.g., represented by 832 and 844) is based on the input corresponding to the request to select the respective set of one or more other computer systems, and wherein the determination that the respective set of one or more other computer systems is the second set of one or more other computer systems (e.g., represented by 856, and 868) is based on the input corresponding to the request to select the respective set of one or more other computer systems (e.g., as described above with respect to FIG. 8F). Sharing, to a resource for emergency assistance, access to different sets of computer systems selected while displaying a call user interface corresponding to a connection with the resource for emergency assistance allows the computer system to customize access that it is giving for help from the resource while on a call with the resource, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0285] In some embodiments, the determination that the respective set of one or more other computer systems is the first set of one or more other computer systems (e.g., represented by 832 and 844) includes a determination that an emergency (and / or an event) is located at a first location. In some embodiments, the determination that the respective set of924920-1811-1627Attorney Docket No. 081501-P71165W01one or more other computer systems is the second set of one or more other computer systems (e.g., represented by 856, and 868) includes a determination that the emergency is located at a second location different from the first location (e.g., as described above with respect to FIG.8F). Sharing, to a resource for emergency assistance, access to different sets of computer systems depending on a location of an emergency while displaying a call user interface corresponding to a connection with the resource for emergency assistance allows the computer system to customize access that it is giving for help from the resource while on a call with the resource, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0286] In some embodiments, before displaying the call user interface (e.g., 884) corresponding to the connection with the resource for emergency assistance, the computer system displays, via the one or more display components, a notification (e.g., 800) of an activity (e.g., 812) (e.g., a stranger is at your home, a guest has arrived in your house, a person is in your living room, and / or a person from your home is calling you) at a location, wherein the connection is initiated from the notification of the activity at the location (e.g., as described above with respect to FIGS. 8A-8C). In some embodiments, the location is where the respective set of one or more other computer systems are located. In some embodiments, the computer system is at the location. In some embodiments, the computer system is away from the location. Initiating a connection with a resource for emergency assistance from a notification of an activity at a location allows the computer system to anticipate needs of a user and facility help from the resource without requiring the user navigate to a user interface for calling and entering a number, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0287] In some embodiments, the computer system (e.g., 424) is a first computer system. In some embodiments, the notification (e.g., 800) is received from a second computer system (e.g., a resident device as described above) different from the first computer system. In some embodiments, the second computer system detected the activity (e.g., 812) at the location (e.g., as described above with respect to FIG. 8 A). In some embodiments, the second computer system manages communication with and / or from the respective set of one or more other computer systems. Initiating a connection with a resource for emergency assistance934920-1811-1627Attorney Docket No. 081501-P71165W01from a notification of an activity at a location that is received from a computer system that detected the activity allows the computer system to anticipate needs of a user and facility help from the resource without requiring the user navigate to a user interface for calling and entering a number, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0288] In some embodiments, the notification (e.g., 800) includes an identification of the location (e.g., as described above with respect to FIG. 8A). Initiating a connection with a resource for emergency assistance from a notification of an activity at a location that includes an identification of the location allows a user to understand where the activity is located when obtaining help for the activity, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0289] In some embodiments, the notification (e.g., 800) includes media (e.g., video and / or audio) of (and / or from, associated with, corresponding to, and / or captured of) the location (e.g., as described above with respect to FIG. 8A). Initiating a connection with a resource for emergency assistance from a notification of an activity at a location that includes media of the location allows a user to understand what is occurring at the location when obtaining help for the activity, thereby reducing the number of inputs needed to perform an operation and / or performing an operation when a set of conditions has been met without requiring further user input.

[0290] In some embodiments, after (and / or in response to) sharing, to the resource for emergency assistance, access to the respective set of one or more other computer systems (e.g., represented by 832, 844, 856, and / or 868), the computer system displays, via the one or more display components, an indication (e.g., 804) that access was shared (e.g., as described above with respect to FIG. 8G). After sharing, to a resource for emergency assistance, access to a set of one or more computer systems, displaying an indication that access was shared allows the computer system to indicate a result of an operation after performing the operation, thereby performing an operation when a set of conditions has been met without requiring further user input.944920-1811-1627Attorney Docket No. 081501-P71165W01

[0291] In some embodiments, the indication (e.g., 804) that access was shared includes a control to stop sharing access. In some embodiments, while displaying the indication that access was shared, the computer system detects, via the one or more input devices, an input (e.g., a tap input and / or a voice request) corresponding to the control to stop sharing access (e.g., as described above with respect to FIG. 8G). In some embodiments, in response to detecting the input corresponding to the control to stop sharing access, the computer system ceases share of (and / or stops sharing), to the resource for emergency assistance, access to the respective set of one or more other computer systems (e.g., the resource for emergency assistance no longer has access to the respective set of one or more other computer system) (e.g., as described above with respect to FIG. 8G). After sharing, to a resource for emergency assistance, access to a set of one or more computer systems, displaying an indication that access was shared including a control to stop sharing access to the set of one or more computer systems allows the computer system to indicate a result of an operation after performing the operation with a way to reverse the result, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0292] In some embodiments, the indication (e.g., 804) that access was shared includes an identification of a number of computer systems included in the respective set of one or more other computer system (e.g., represented by 832, 844, 856, and / or 868) (e.g., as described above with respect to FIG. 8G). After sharing, to a resource for emergency assistance, access to a set of one or more computer systems, displaying an indication that access was shared including an identification of a number of computer systems included in the set of one or more computer systems allows the computer system to indicate a result of an operation after performing the operation with a magnitude of the operation, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0293] In some embodiments, the indication (e.g., 804) that access was shared includes an identification (e.g., a name and / or an identifier assigned, by a user and / or automatically, to the respective set of one or more other computer systems) of the respective set of one or more other computer systems(e.g., represented by 832, 844, 856, and / or 868) (e.g., as described above with respect to FIG. 8G) (e.g., in accordance with a determination that the respective set of one or more other computer systems includes a particular computer system, the indication that access was shared includes an identification, such as a name and / or an954920-1811-1627Attorney Docket No. 081501-P71165W01identifier assigned, by a user and / or automatically, to the particular computer system, of the particular computer system). After sharing, to a resource for emergency assistance, access to a set of one or more computer systems, displaying an indication that access was shared including an identification of the set of one or more computer systems allows the computer system to indicate a result of an operation after performing the operation with an identification of what was done, thereby performing an operation when a set of conditions has been met without requiring further user input.

[0294] In some embodiments, the prompt (e.g., 808 and / or 820) to share access to one or more other computer systems with the resource for emergency assistance is output in response to a determination that a predefined period of time (e.g., 5 seconds to 5 minutes) has passed since initiating the connection with the resource for emergency assistance (e.g., as described above with respect to FIGS. 8D-8F). Outputting a prompt to share access to one or more computer system with a resource for emergency assistance in response to a determination that a predefined period of time has passed since initiating a connection with the resource for emergency assistance allows a user to first interact with the resource before being prompted to provide access, thereby, performing an operation when a set of conditions has been met without requiring further user input.

[0295] Note that details of the processes described above with respect to process 900 (e.g., FIG. 9) are also applicable in an analogous manner to the processes described herein. For example, process 700 optionally includes one or more of the characteristics of the various processes described herein with reference to process 900. For example, the status of the environment in process 700 is detected via one or more accessory devices in process 900. For brevity, these details are not repeated herein.

[0296] FIGS. 10A-10V illustrate exemplary user interfaces for displaying and ceasing to display content in response to input in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS. 11 and 12.

[0297] FIGS. 10A-10V illustrate computer system 1000 as a smart phone. It should be recognized that computer system 1000 can be other types of computer systems such as a tablet, a smart watch, a laptop, a communal device, a smart speaker, an accessory, a personal gaming system, a desktop computer, a fitness tracking device, and / or a head-mounted display964920-1811-1627Attorney Docket No. 081501-P71165W01(HMD) device. In some embodiments, computer system 1000 includes and / or is in communication with one or more input devices (e.g., a sensor, a camera, a lidar detector, a motion sensor, an infrared sensor, a touch-sensitive surface, a physical input mechanism, and / or a microphone). In some embodiments, computer system 1000 includes and / or is in communication with one or more output devices (e.g., a display screen, a projector, a touch-sensitive display, a speaker, and / or a movement component). In some embodiments, computer system 1000 includes one or more components and / or features described above in relation to computer system 100 and / or electronic device 200.

[0298] FIGS. 10A-10V are split between a left side and a right side to illustrate a subject in a physical environment interacting with computer system 1090 via computer system 1000. In the examples illustrated in FIGS. 10A-10V, the right side illustrates a top-down schematic view of physical environment 1006 that includes tablet representation 1008 (e.g., representing a tablet located in the environment, and first user representation 1004 (e.g., a person interacting with computer system 1000 by providing inputs, the first user). In some embodiments, the relative positioning of first user representation 1010 is indicative of relative physical positioning of the first user in a physical environment. The left side of FIGS. 10A-10V illustrate output of computer system 1000. While FIGS. 10A-10V illustrate computer system 1000 outputting particular content, it should be recognized that such content is merely for explanatory purposes and that such content can be in different forms, at different locations, at different sizes, include different content, and / or that more, fewer, and / or different content can be output in accordance with techniques described herein.

[0299] While the examples in FIGS. 10A-10V include computer system 1090 detecting one or more inputs, it should be recognized that such inputs are merely for explanatory purposes and that such inputs can be other types of inputs such as voice inputs via one or more microphones, touch inputs via one or more touch-sensitive surfaces, physical inputs via one or more physical input mechanisms, and / or hand-gesture inputs via one or more cameras. In some embodiments, inputs detected by computer system 1090 are passive inputs that are not purposefully directed at computer system 1090 by a subject (e.g., a person, an animal, an object, and / or a device). Examples of such inputs include, but are not limited to, motion of the subject through the environment, location of the subject within the environment, direction that the subject is facing and / or looking, light levels within the environment, and / or sound levels within the environment.974920-1811-1627Attorney Docket No. 081501-P71165W01

[0300] FIG. 10A illustrates computer system 1000 displaying environment activities user interface 1002. As illustrated in FIG. 10A, within environment activities user interface 1002, computer system 1000 displays one or more indications of activities detected by computer system 1090 within in the environment in the order that they were detected.

[0301] FIG. 10B illustrates computer system 1000 displaying user activity user interface 1020. As illustrated in FIG. 10B, within user activity user interface 1020, computer system 1000 displays one or more indications of activities of a registered user (e.g., the first user) that are detected by computer system 1090 within the environment. As illustrated in FIG. 10B, computer system 1000 displays the indications of activities of the registered user in the order that they were detected.

[0302] FIG. 10C illustrates computer system 1000 displaying user activity user interface 1020 after a recognition scenario. In this recognition scenario, when the first user enters the environment, computer system 1090 detects computer system 1000, which is associated with the first user, and the first user’s face is recognized by computer system 1090 via one or more cameras in communication with computer system 1090. At FIG. 10C, in response to the first user being detected at the environment, via computer system 1090 detecting computer system 1000, computer system 1090 outputs a chime via living room smart speaker, as indicated by music notes 1022. Also at FIG. 10C, in response to the first user being recognized by computer system 1090, computer system 1090 outputs a greeting to the first user (e.g., “Welcome home, Jane.”) via the living room smart speaker, as indicated by output 1024. At FIG. 10C, in response to the first user arriving at the environment with computer system 1000 and computer system 1090 recognizing the first user, computer system 1090 activates the cooling of the environmental control system of the environment to 68 degrees. It should be noted that this is just an example and that other automations of the environment can be activated, such as lights, shades, music, televisions, and / or locks.

[0303] FIG. 10D illustrates computer system 1000 displaying user activity user interface 1020 after a first scenario where computer system 1090 does not recognize the first user and requires a second form of authentication to confirm the user. At FIG. 10D, the first user arrives at the environment and is detected by computer system 1090 by detecting computer system 1000. At FIG. 10D, in response to the first user being detected at the environment, via computer system 1090 detecting computer system 1000, computer system 1090 outputs a chime via living room smart speaker, as indicated by music notes 1022. At FIG. 10D, in 984920-1811-1627Attorney Docket No. 081501-P71165W01response to the first user arriving at the environment with their face obscured (e.g., wearing a head, scarf, facemask, makeup, and / or glasses), computer system 1090 requires the first user to verify their identity in a secondary manner. At FIG. 10D, the first user uses a facial recognition scan to unlock computer system 1000 via one or more cameras of computer system 1000. At FIG. 10D, in response to the first user unlocking computer system 1000 via facial recognition scan, computer system 1090 makes a determination that the first user is authenticated. At FIG. 10D, in response to computer system 1090 making a determination that the first user is authenticated, computer system 1090 computer system 1090 outputs a greeting to the first user (e.g., “Welcome home, Jane.”) via the living room smart speaker, as indicated by output 1024. At FIG. 10D, in response to the first user arriving at the environment with computer system 1000 and computer system 1090 making the determination that the first user is authenticated, computer system 1090 activates the cooling of the environmental control system of the environment to 68 degrees. It should be noted that this is just an example and that other automations of the environment can be activated, such as lights, shades, music, televisions, and / or locks.

[0304] FIG. 10E illustrates computer system 1000 displaying user activity user interface 1020 after a second scenario where computer system 1090 does not recognize the first user and requires a second form of authentication to confirm the user. At FIG. 10E, the first user arrives at the environment and is detected by computer system 1090 by detecting computer system 1000. At FIG. 10E, in response to the first user being detected at the environment, via computer system 1090 detecting computer system 1000, computer system 1090 outputs a chime via living room smart speaker, as indicated by music notes 1022. At FIG. 10E, in response to the first user arriving at the environment with their face obscured (e.g., wearing a head, scarf, facemask, makeup, and / or glasses), computer system 1090 requires the first user to verify their identity in a secondary manner. At FIG. 10E, the first user walks up the tablet and the first user’s face is recognized by the camera of the tablet. At FIG. 10E, in response to the tablet recognizing the first user’s face, computer system 1090 makes a determination that the first user is authenticated. At FIG. 10E, in response to computer system 1090 making a determination that the first user is authenticated, computer system 1090 computer system 1090 outputs a greeting to the first user (e.g., “Welcome home, Jane.”) via the living room smart speaker, as indicated by output 1024. At FIG. 10E, in response to the first user arriving at the environment with computer system 1000 and computer system 1090 making the determination that the first user is authenticated, computer system 1090 activates the cooling 994920-1811-1627Attorney Docket No. 081501-P71165W01of the environmental control system of the environment to 68 degrees. It should be noted that this is just an example and that other automations of the environment can be activated, such as lights, shades, music, televisions, and / or locks.

[0305] FIG. 10F illustrates computer system 1000 displaying user activity user interface 1020 after a third scenario where computer system 1090 does not recognize the first user and requires a second form of authentication to confirm the user. At FIG. 10F, the first user arrives at the environment and is detected by computer system 1090 by detecting computer system 1000. At FIG. 10F, in response to the first user being detected at the environment, via computer system 1090 detecting computer system 1000, computer system 1090 outputs a chime via living room smart speaker, as indicated by music notes 1022. At FIG. 10F, in response to the first user arriving at the environment with their face obscured (e.g., wearing a head, scarf, facemask, makeup, and / or glasses), computer system 1090 requires the first user to verify their identity in a secondary manner. At FIG. 10F, computer system 1090 sends a notification to the first user’s devices requesting that the first user confirm that it is them at the environment. At FIG. 10F, the first user confirms on the first user’s smart watch that it is the first user in the environment. At FIG. 10F, in response to the user confirming on the first user’s smart watch that it is the first user in the environment, computer system 1090 makes a determination that the first user is authenticated. At FIG. 10F, in response to computer system 1090 making a determination that the first user is authenticated, computer system 1090 computer system 1090 outputs a greeting to the first user (e.g., “Welcome home, Jane.”) via the living room smart speaker, as indicated by output 1024. At FIG. 10F, in response to the first user arriving at the environment with computer system 1000 and computer system 1090 making the determination that the first user is authenticated, computer system 1090 activates the cooling of the environmental control system of the environment to 68 degrees. It should be noted that this is just an example and that other automations of the environment can be activated, such as lights, shades, music, televisions, and / or locks.

[0306] FIG. 10G illustrates computer system 1000 displaying user activity user interface 1020 after a scenario where the first user arrives at the environment without computer system 1000. At FIG. 10F, the first user arrives at the environment and is identified by computer system 1090 via one or more cameras in communication with computer system 1090. At FIG.10G, in response to computer system 1090 detecting the first user at the environment while not detecting computer system 1000, computer system 1090 outputs a chime via living room1004920-1811-1627Attorney Docket No. 081501-P71165W01smart speaker, as indicated by music notes 1022. At FIG. 10G, in response to computer system 1090 detecting the first user at the environment while not detecting computer system 1000, computer system 1090 outputs content via the living room smart speaker requesting that the first user verify their identity in a secondary manner (e.g., “Hi, Jane. Can you confirm it is you by verifying your PIN.”), as indicated by content 1026. At FIG. 10G, the first user enters their PIN via the tablet. At FIG. 10G, in response to the first user entering their PIN via the tablet, computer system 1090 makes a determination that the first user is authenticated. In some embodiments, in response to computer system 1090 making a determination that the first user is authenticated, computer system 1090 computer system 1090 outputs a greeting to the first user (e.g., “Welcome home, Jane ”) via the living room smart speaker. At FIG. 10G, in response to the first user arriving at the environment with computer system 1000 and computer system 1090 making the determination that the first user is authenticated, computer system 1090 activates the cooling of the environmental control system of the environment to 68 degrees. It should be noted that this is just an example and that other automations of the environment can be activated, such as lights, shades, music, televisions, and / or locks.

[0307] FIG. 10H illustrates computer system 1000 displaying user activity user interface 1020 after a scenario where the first user arrives at the environment while another registered occupant of the environment (e.g., a second user) is already recognized by computer system 1090 at the environment. At FIG. 10H, in response to detecting the first user in the environment, via detecting computer system 1000 and / or identifying the first user via one or more cameras in communication with computer system 1090, while the second user is already in the environment, computer system 1090 outputs a chime via living room smart speaker, as indicated by music notes 1022. At FIG 10H, in response to detecting the first user in the environment while detecting the second user is already in the environment, computer system 1090 outputs content via the living room smart speaker alerting the second user that the first user has arrived at the environment (e.g., “Jane is home.”), as indicated by content 1028. At FIG. 10H, in response to the second user already being in the environment when the first user is detected, computer system 1090 does not activate the cooling of the environmental control system.

[0308] FIG. 101 illustrates computer system 1000 displaying lock screen user interface 1032. At FIG. 101, a first guest (e.g., Phil), who is registered with computer system 1090, arrives at the environment, as indicated by first guest representation 1034 being illustrated1014920-1811-1627Attorney Docket No. 081501-P71165W01within physical environment 1006, and is recognized by computer system 1090. As illustrated in FIG. 101, in response to computer system 1090 recognizing the first guest, computer system 1000 displays recognized guest indicator 1050 overlay ed on lockscreen user interface 1032. As illustrated in FIG. 101, in response to computer system 1090 continuing to detect the first guest at the environment, computer system 1000 displays recognized guest indicator 1050 indicating that the first guest is at the environment (e.g., Phil is at your home).

[0309] At FIG. 10H, at a time after FIG. 101, the first guest (e.g., Phil) who is registered with computer system 1090 is no longer at the environment, as indicated by first guest representation 1034 not being illustrated within physical environment 1006, and is no longer detected by computer system 1090. As illustrated in FIG. 10H, in response to computer system 1090 no longer detecting the first guest, computer system 1000 displays recognized guest indicator 1050 overlay ed on lock screen user interface 1032. As illustrated in FIG. 10H, in response to computer system 1090 no longer detecting the first guest at the environment, computer system 1000 displays recognized guest indicator 1050 indicating that the first guest was formerly at the environment (e.g., Phil visited your home).

[0310] FIG. 10J illustrates computer system 1000 displays recognized guest activity user interface 1046. As illustrated in FIG. 10J, within recognized guest activity user interface 1046, computer system 1000 displays one or more indications of activities of a recognized guest (e.g., the first guest) that are detected by computer system 1090 within the environment. As illustrated in FIG. 10J, computer system 1000 displays the indications of activities of a recognized guest in the order that they were detected.

[0311] FIG. 10K illustrates computer system 1000 displaying lock screen user interface 1032. At FIG. 10K, a second guest (e.g., John the plumber), who is not registered with computer system 1090, arrive at the environment. In response, computer system 1090 outputs content requesting that the unregistered guess.

[0312] FIG. 11 is a flow diagram illustrating a process (e.g., process 1100) for displaying a live feed of various cameras in accordance with some embodiments. Some operations in process 1100 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.

[0313] As described below, process 1100 provides an intuitive way for displaying a live feed of various cameras. Process 1100 reduces the cognitive burden on a user, thereby 1024920-1811-1627Attorney Docket No. 081501-P71165W01creating a more efficient human -machine interface. For battery-operated computing devices, enabling a user to interact with such devices faster and more efficiently conserves power and increases the time between battery charges.

[0314] In some embodiments, process 1100 is performed at a computer system that is in communication (e.g., wired or wirelessly) with (and / or includes) one or more output devices (e.g., a display generation component, an audio generation component, and / or a haptic generation component). In some embodiments, the computer system is a watch, a phone, a tablet, a fitness tracking device, a processor, a head-mounted display (HMD) device, a communal device, a media device, a speaker, a television, and / or a personal computing device. In some embodiments, the computer system is a resident device (e.g., a device that is installed within a location and / or is part of a connected network at the location, a device that is actively connected to a network at the location and / or consistently part of a network at the location, an always-on device at the location, a connected-home device, a smart-home fixture, a core device, a home-hub device, a persistent device, a network device, an in-home node, an active device, a connected node, a local device, a resident node, a device that communicates with one or more accessory devices on behalf of one or more controller devices, a homebased device, a fixed-location device, and / or a device).

[0315] The computer system receives (1102) an indication that a set of one or more operations (e.g., lowering blinds, powering on lights, powering on television, adjusting thermostat, and / or locking door) is performed based on (e.g., in response to detecting and / or in conjunction with) a subject entering an environment (e.g., a home, a room, an office, an environment of the computer system and / or an environment different from the environment of the computer system). In some embodiments, the set of one or more operations is a preconfigured automation. In some embodiments, the subject previously selected, set, and / or identified the set of one or more operations.

[0316] In response to (1104) (e.g., and / or in conjunction with) receiving the indication that the set of one or more operations is performed based on the subject entering the environment, in accordance with a determination that a first set of one or more criteria is satisfied (e.g., that the subject is a first subject, that the set of one or more operations includes a particular operation, that the one or more operations are performed at a specific time of day, and / or that the one or more operations are performed at a specific location of the environment), the computer system outputs (1106) (e.g., audibly outputs and / or visually 1034920-1811-1627Attorney Docket No. 081501-P71165W01outputs), via the one or more output devices, an indication (e.g., a notification and / or an audible description) that includes a first explanation regarding (e.g., for and / or corresponding to) performance of the set of one or more operations (e.g., why the one or more operations are being performed and / or what event and / or activity triggered the performance of the one or more operations).

[0317] In response to (1104) receiving the indication that the set of one or more operations is performed based on the subject entering the environment, in accordance with a determination that a second set of one or more criteria (e.g., that the subject is a first subject, that the set of one or more operations includes a particular operation, that the one or more operations are performed at a specific time of day, and / or that the one or more operations are performed at a specific location of the environment) is satisfied, the computer system outputs (1108) (e.g., audibly outputs and / or visually outputs), via the one or more output devices, the indication that includes a second explanation (e.g., why the one or more operations are being performed and / or what event and / or activity triggered the performance of the one or more operations) regarding (e.g., for and / or corresponding to) performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria. In some embodiments, while displaying a notification that indicates a first device (e.g., a first accessory device, such as a camera) is being remotely accessed (e.g., by emergency services), the computer system receives an indication that a second device (e.g., a second accessory device, such as a camera) is being remotely accessed (e.g., by emergency services) and, in response, update notification to indicate that the second device is being remotely accessed (e.g., by emergency services). In some embodiments, the second device is separate and / or different from the first device. Performing an operation when a set of conditions has been met without requiring further user input (such as by outputting different explanations of why one or more operations are performed based on which set of criteria is satisfied) enhances the operability of the device by reducing unnecessary inputs and / or steps to navigate through different user interfaces or sets of controls, reducing energy usage by the device. Providing improved feedback (such as by outputting an explanation regarding a performance of one or more operations) enhances the operability of the device by reducing accidental and mistaken inputs, reducing energy usage by the device. Reducing the number of inputs needed to perform an operation (such as by outputting an explanation regarding a performance of one or more operations in response to receiving an indication that the set of 1044920-1811-1627Attorney Docket No. 081501-P71165W01one or more operations are performed) enhances the operability of the device by reducing the number of inputs and time required to perform a particular operation, reducing energy usage by the device.

[0318] In some embodiments, outputting the indication includes outputting an identification of the subject (e.g., a graphical identification and / or a textual identification). In some embodiments, the identification of the subject is an image, video, representation of the name of the subject, and / or initials of the subject.

[0319] In some embodiments, the computer system is in communication (e.g., wired and / or wirelessly) with (or includes) one or more display components (e.g., a display screen, a projector, a head mounted display, and / or a touch-sensitive display). In some embodiments, outputting the indication includes displaying, via the one or more display components, the indication. In some embodiments, while displaying the indication, the computer system displays, via the one or more display components, one or more indications (e.g., a textual indication and / or a graphical indication) of one or more activities (e.g., subjects who have entered the environment, subjects who have exited the environment, that a subject is cooking in the environment, that playback of media has started, that an accessory device has been turned on or off) performed (e.g., currently performed or previously performed) in the environment. In some embodiments, computer system updates display of the one or more indications as additional activities are detected as being performed in the environment. In some embodiments, the one or more activities correspond to a single subject.

[0320] In some embodiments, the one or more activities are performed by the subject.

[0321] In some embodiments, at least one activity of the one or more activities is performed by another subject different from the subject.

[0322] In some embodiments, the indication includes an icon (e.g., a graphical representation and / or graphical element) corresponding to (e.g., directed to, of, related to, representative of, and / or associated with) one or more accessories (e.g., lights, thermostat, speakers, and / or television) that performed the set of one or more operations.

[0323] In some embodiments, the computer system is in communication (e.g. wired and / or wireless communication) with (or includes) one or more display components (e.g., a display screen, a projector, a head mounted display, and / or a touch-sensitive display) and one1054920-1811-1627Attorney Docket No. 081501-P71165W01or more input devices (e.g., a camera, a depth sensor, a microphone, a hardware input mechanism, a rotatable input mechanism, a physical input mechanism, a mechanical button, a touch-sensitive button, a button, a crown, a knob, a dial, a physical slider, an accelerometer, a mouse, a keyboard, a touchpad, and / or a touch-sensitive surface). In some embodiments, after outputting the second indication, the computer system detects, via the one or more input devices, an input (e.g., a tap input, a swipe input, voice command and / or air gesture) corresponding to (e.g., directed to, related to, and / or associated with) a request to display one or more representations of activities detected in the environment. In some embodiments, in response to detecting the input corresponding to the request to display the one or more representations of activities detected in the environment, the computer system displays, via the one or more display components, the indication (e.g., with the first explanation, the second explanation, or an explanation different from the first explanation and the second explanation). In some embodiments, in response to detecting the input corresponding to the request to display the one or more representations of activities detected in the environment, the computer system displays one or more representations of activities detected in the environment.

[0324] In some embodiments, the indication that includes the first explanation further includes an identification of the subject (e.g., as described above with respect to FIG. 13D) (e.g., a graphical identification and / or a textual identification). In some embodiments, the identification of the subject is an image, video, representation of the name of the subject, and / or initials of the subject. In some embodiments, the indication that includes the second explanation further includes the identification of the subject.

[0325] In some embodiments, the computer system is in communication (e.g., wired and / or wirelessly) with (or includes) one or more display components (e.g., a display screen, a projector, a head mounted display, and / or a touch-sensitive display). In some embodiments, outputting the indication that includes the first explanation includes displaying, via the one or more display components, the indication that includes the first explanation. In some embodiments, outputting the indication that includes the second explanation includes displaying, via the one or more display components, the indication that includes the second explanation. In some embodiments, in response to (e.g., and / or in conjunction with) receiving the indication that the set of one or more operations is performed based on the subject entering the environment, the computer system displays, via the one or more display1064920-1811-1627Attorney Docket No. 081501-P71165W01components, one or more indications (e.g., a textual indication and / or a graphical indication) of one or more activities (e.g., subjects who have entered the environment, subjects who have exited the environment, that a subject is cooking in the environment, that playback of media has started, that an accessory device has been turned on or off) performed (e.g., currently performed or previously performed) in the environment (e.g., as described above with respect to FIG. 13D). In some embodiments, computer system updates display of the one or more indications as additional activities are detected as being performed in the environment. In some embodiments, the one or more activities correspond to a single subject.

[0326] In some embodiments, the one or more activities are determined to be performed by the subject (e.g., as described above with respect to FIG. 13D).

[0327] In some embodiments, at least one activity of the one or more activities is determined to be performed by another subject different from the subject (e.g., as described above with respect to FIG. 13D).

[0328] In some embodiments, the indication that includes the first explanation includes an icon (e.g., a graphical representation and / or graphical element) corresponding to (e.g., directed to, of, related to, representative of, and / or associated with) one or more accessories (e.g., lights, thermostat, speakers, and / or television) that performed the set of one or more operations (e.g., as described above with respect to FIG. 13D). In some embodiments, the indication that includes the second explanation includes the icon corresponding to the one or more accessories that performed the set of one or more operations.

[0329] In some embodiments, the computer system is in communication (e.g. wired and / or wireless communication) with (or includes) one or more display components (e.g., a display screen, a projector, a head mounted display, and / or a touch-sensitive display) and one or more input devices (e.g., a camera, a depth sensor, a microphone, a hardware input mechanism, a rotatable input mechanism, a physical input mechanism, a mechanical button, a touch-sensitive button, a button, a crown, a knob, a dial, a physical slider, an accelerometer, a mouse, a keyboard, a touchpad, and / or a touch-sensitive surface). In some embodiments, after outputting the indication that includes the first explanation, the computer system detects, via the one or more input devices, an input (e.g., a tap input, a swipe input, voice command and / or air gesture) corresponding to (e.g., directed to, related to, and / or associated with) a request to view activity detected in the environment (e.g., as described above with respect to1074920-1811-1627Attorney Docket No. 081501-P71165W01FIG. 13D). In some embodiments, in response to detecting the input corresponding to the request to view activity detected in the environment, the computer system displays, via the one or more display components, the indication that includes the first explanation (e.g., as described above with respect to FIG. 13D).

[0330] Note that details of the processes described above with respect to process 1100 (e.g., FIG. 11) are also applicable in an analogous manner to other processes described herein. For example, process 1200 optionally includes one or more of the characteristics of the various processes described above with reference to process 1100. For example, the one or more camera feeds of process 1100 can be displayed in response to detecting the identity of the subject as described process 1200. For brevity, these details are not repeated herein.

[0331] FIG. 12 is a flow diagram illustrating a process (e.g., process 1200) for assisting a subject with an authentication process in accordance with some embodiments. Some operations in process 1200 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.

[0332] As described below, process 1200 provides an intuitive way for assisting a subject with an authentication process. Process 1200 reduces the cognitive burden on a user, thereby creating a more efficient human -machine interface. For battery-operated computing devices, enabling a user to interact with such devices faster and more efficiently conserves power and increases the time between battery charges.

[0333] In some embodiments, process 1200 is performed at a computer system. In some embodiments, the computer system is a watch, a phone, a tablet, a fitness tracking device, a processor, a head-mounted display (HMD) device, a communal device, a media device, a speaker, a television, and / or a personal computing device. In some embodiments, the computer system is a resident device (e.g., a device that is installed within a location and / or is part of a connected network at the location, a device that is actively connected to a network at the location and / or consistently part of a network at the location, an always-on device at the location, a connected-home device, a smart-home fixture, a core device, a home-hub device, a persistent device, a network device, an in-home node, an active device, a connected node, a local device, a resident node, a device that communicates with one or more accessory devices on behalf of one or more controller devices, a home-based device, a fixed-location device, and / or a device).1084920-1811-1627Attorney Docket No. 081501-P71165W01

[0334] The computer system receives (1202) an indication that an identified subject (e.g., a registered user, a known person, a recognized animal, another associated computer system different from the computer system, a device, and / or an object) with a respective authentication level is detected (and / or present) in an environment (e.g., a physical environment, such as a home, a room, a yard, and / or a building). In some embodiments, the indication that the identified subject with the respective authentication level is detected in the environment is received from another computer system external to the computer system. In some embodiments, the computer system is in communication with one or more input devices (e.g., a camera, a depth sensor, a microphone, a hardware input mechanism, a rotatable input mechanism, a physical input mechanism, a mechanical button, a touch-sensitive button, a button, a crown, a knob, a dial, a physical slider, an accelerometer, a mouse, a keyboard, a touchpad, and / or a touch-sensitive surface). In some embodiments, the indication that the identified subject with the respective authentication level is detected in the environment is detected via the one or more input devices.

[0335] In response to (1204) receiving the indication that the identified subject with the respective authentication level is detected in the environment, in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level (e.g., is authenticated and / or has been identified in two different manners), the computer system initiates (1206) an automation (e.g., operation and / or function).

[0336] In response to (1204) receiving the indication that the identified subject with the respective authentication level is detected in the environment, in accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level (e.g., is identified but not authenticated and / or has one identification but not a second separate identification), the computer system forgoes (1208) initiation of the automation, wherein the second authentication level is different from the first authen...

Claims

Attorney Docket No. 081501-P71165W01CLAIMSWhat is claimed is:

1. A method, comprising:at a first computer system that is in communication with one or more output devices and one or more input devices:displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment;detecting, via the one or more input devices, a set of one or more inputs that includes:a first input that corresponds to a request to provide a respective level of guest access to the environment; anda second input that is directed to the user interface element for providing guest access to the environment; andin response to detecting the set of one or more inputs:in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; andin accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

2. The method of claim 1, wherein the first level of guest access includes a frequency of access.

3. The method of any one of claims 1-2, wherein the first level of guest access includes access to one or more computer systems in the environment, and wherein the one or more computer systems are external to the first computer system and the second computer system.1414920-1811-1627Attorney Docket No. 081501-P71165W014. The method of any one of claims 1-3, wherein the first level of guest access is provided to a subject detected in the environment, wherein the first level of guest access includes remote access to one or more computer systems in the environment, and wherein the one or more computer systems are external to the first computer system and the second computer system.

5. The method of any one of claims 1-4, wherein the first level of guest access is provided via an authentication code.

6. The method of any one of claims 1-5, wherein, in accordance with the determination that the respective level of guest access to the environment is the first level of guest access to the environment, the first input corresponds to a first user interface element for the first level of guest access to the environment, wherein, in accordance with the determination that the respective level of guest access to the environment is the second level of guest access to the environment, the first input corresponds to a second user interface element for the second level of guest access to the environment, and wherein the second user interface element is separate from the first user interface element.

7. The method of any one of claims 1-6, wherein the second input is the first input.

8. The method of any one of claims 1-6, wherein the second input is separate from the first input.

9. The method of any one of claims 1-8, wherein the second computer system is a resident device that is in communication with one or more accessories within the environment, wherein the first level of guest access is with respect to the one or more accessories, and wherein the second level of guest access is with respect to the one or more accessories.

10. The method of claim 9, wherein the one or more accessories include a plurality of accessories.

11. The method of any one of claims 1-10, wherein the first computer system is a personal device of an administrator of the environment.1424920-1811-1627Attorney Docket No. 081501-P71165W0112. The method of any one of claims 1-10, wherein the first computer system is a personal device of an administrator of the second computer system.

13. The method of any one of claims 1-12, wherein the call user interface is displayed while detecting the first input and while providing the first level of guest access to the environment.

14. The method of any one of claims 1-13, wherein the call user interface includes content received from the second computer system.

15. The method of any one of claims 1-14, wherein the connection is an audio call.

16. The method of any one of claims 1-14, wherein the connection is a video call.

17. The method of any one of claims 1-16, wherein the connection includes the first computer system receiving video and audio from the second computer system, and wherein the connection includes, at a first time, the first computer system sending audio without sending video to the second computer system.

18. The method of claim 17, wherein the connection includes, at a second time different from the first time, the first computer system sending audio and video to the second computer system.

19. The method of any one of claims 1-18, wherein the call user interface includes an identification of the environment.

20. The method of any one of claims 1-19, wherein the call user interface includes an identification of a subject in the environment.

21. The method of any one of claims 1-20, wherein the call user interface includes an indication that an unknown guest is in the environment.

22. The method of any one of claims 1-21, further comprising:1434920-1811-1627Attorney Docket No. 081501-P71165W01in response to detecting the set of one or more inputs:in accordance with the determination that the respective level of guest access to the environment is the first level of guest access to the environment, outputting, via the one or more output devices, a confirmation that the first level of guest access has been provided; andin accordance with the determination that the respective level of guest access to the environment is the second level of guest access to the environment, outputting, via the one or more output devices, a confirmation that the second level of guest access has been provided.

23. The method of any one of claims 1-22, further comprising:before displaying the call user interface, receiving a notification that an unrecognized subject is detected in the environment.

24. The method of any one of claims 1-23, further comprising:before displaying the call user interface, receiving a notification that the second computer system is calling the first computer system, wherein the call user interface is displayed in response to detecting an input corresponding to the notification that the second computer system is calling the first computer system.

25. The method of any one of claims 1-24, further comprising:before displaying the call user interface, receiving a call from a respective location within the environment, wherein the call user interface includes:in accordance with a determination that the respective location is a first location, an indication of the first location; andin accordance with a determination that the respective location is a second location, an indication of the second location, wherein the second location is different from the first location.

26. The method of any one of claims 1-25, further comprising:while displaying the call user interface and before providing access to the environment, detecting, via the one or more input devices, an input corresponding to a request to end the connection; and1444920-1811-1627Attorney Docket No. 081501-P71165W01in response to detecting the input corresponding to the request to end the connection, ending the connection without providing guest access to the environment.

27. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a first computer system that is in communication with one or more output devices and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 1-26.

28. A first computer system that is configured to communicate with one or more output devices and one or more input devices, the first computer system comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 1-26.

29. A first computer system that is configured to communicate with one or more output devices and one or more input devices, the first computer system comprising:means for performing the method of any one of claims 1-26.

30. A computer program product, comprising one or more programs configured to be executed by one or more processors of a first computer system that is in communication with one or more output devices and one or more input devices, the one or more programs including instructions for performing the method of any one of claims 1-26.

31. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first computer system that is in communication with one or more output devices and one or more input devices, the one or more programs including instructions for:displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment;detecting, via the one or more input devices, a set of one or more inputs that includes:1454920-1811-1627Attorney Docket No. 081501-P71165W01a first input that corresponds to a request to provide a respective level of guest access to the environment; anda second input that is directed to the user interface element for providing guest access to the environment; andin response to detecting the set of one or more inputs:in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; andin accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

32. A first computer system configured to communicate with one or more output devices and one or more input devices, the first computer system comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment;detecting, via the one or more input devices, a set of one or more inputs that includes:a first input that corresponds to a request to provide a respective level of guest access to the environment; anda second input that is directed to the user interface element for providing guest access to the environment; andin response to detecting the set of one or more inputs:in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; andin accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the 1464920-1811-1627Attorney Docket No. 081501-P71165W01second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

33. A first computer system configured to communicate with one or more output devices and one or more input devices, the first computer system comprising:means for displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment;means for detecting, via the one or more input devices, a set of one or more inputs that includes:a first input that corresponds to a request to provide a respective level of guest access to the environment; anda second input that is directed to the user interface element for providing guest access to the environment; andin response to detecting the set of one or more inputs:means for, in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; andmeans for, in accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

34. A computer program product, comprising one or more programs configured to be executed by one or more processors of a first computer system that is in communication with one or more output devices and one or more input devices, the one or more programs including instructions for:displaying, via the one or more output devices, a call user interface corresponding to a connection with a second computer system external to the first computer system, wherein the call user interface includes a user interface element for providing guest access to an environment;detecting, via the one or more input devices, a set of one or more inputs that includes:1474920-1811-1627Attorney Docket No. 081501-P71165W01a first input that corresponds to a request to provide a respective level of guest access to the environment; anda second input that is directed to the user interface element for providing guest access to the environment; andin response to detecting the set of one or more inputs:in accordance with a determination that the respective level of guest access to the environment is a first level of guest access to the environment, providing the first level of guest access to the environment; andin accordance with a determination that the respective level of guest access to the environment is a second level of guest access to the environment, providing the second level of guest access to the environment, wherein the second level of guest access to the environment is different from the first level of guest access to the environment.

35. A method, comprising:at a computer system:detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment:in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; andin accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

36. The method of claim 35, wherein the notification corresponding to the environment includes:in accordance with a determination that an administrator of the computer system customized notifications corresponding to the environment in a first manner, first content; andin accordance with a determination that the administrator of the computer system customized notifications corresponding to the environment in a second manner, second content different from the first content, wherein the second manner is different from the first manner.1484920-1811-1627Attorney Docket No. 081501-P71165W0137. The method of any one of claims 35-36, wherein the notification includes an indication of time.

38. The method of any one of claims 35-37, wherein the notification includes a summary of a current state of the environment.

39. The method of any one of claims 35-38, wherein the notification includes an indication of a current state of an accessory device within the environment.

40. The method of claim 39, wherein the computer system is a resident device that is in communication with one or more accessories within the environment, and wherein the one or more accessories includes the accessory device.

41. The method of any one of claims 39-40, further comprising:in response to detecting that the set of one or more subjects has left the environment, obtaining, via the accessory device, the current state of the accessory device.

42. The method of any one of claims 35-41, wherein the notification includes:an indication of a current state of a first accessory device within the environment; and an indication of a current state of a second accessory device within the environment, wherein the second accessory device is different from the first accessory device.

43. The method of any one of claims 35-42, wherein the notification includes an identification of the environment.

44. The method of any one of claims 35-43, wherein the notification includes:in accordance with a determination that the set of one or more subjects left the environment via a first portion of the environment, an identification of the first portion of the environment; andin accordance with a determination that the set of one or more subjects left the environment via a second portion of the environment, an identification of the second portion of the environment, wherein the second portion is different from the first portion.1494920-1811-1627Attorney Docket No. 081501-P71165W0145. The method of any one of claims 35-44, wherein the notification includes a representation of the set of one or more subjects.

46. The method of any one of claims 35-45, wherein the notification includes an identification of when the set of one or more subjects left the environment.

47. The method of any one of claims 35-46, wherein the notification corresponding to the environment is a first notification corresponding to the environment, the method further comprising:in response to detecting that the set of one or more subjects has left the environment:in accordance with a determination that a first subject is detected in the environment, outputting a second notification corresponding to the environment;, wherein the second notification is different from the first notification; andin accordance with a determination that a second subject is detected in the environment, forgoing output of a notification corresponding to the environment, wherein the second subject is different from the first subject.

48. The method of any one of claims 35-47, further comprising:in response to detecting that the set of one or more subjects has left the environment and in accordance with a determination that a subject is detected in the environment, forgoing output of a notification corresponding to the environment.

49. The method of any one of claims 35-47, wherein the notification corresponding to the environment is a first notification corresponding to the environment, the method further comprising:in response to detecting that the set of one or more subjects has left the environment and in accordance with a determination that a subject is detected in the environment, outputting a second notification corresponding to the environment, wherein the second notification is different from the first notification.

50. The method of any one of claims 35-49, wherein detecting that the set of one or more subjects has left the environment includes detecting that a personal device of the set of one or more subjects is no longer in the environment.1504920-1811-1627Attorney Docket No. 081501-P71165W0151. The method of any one of claims 35-50, wherein the notification corresponding to the environment is output after a predetermined amount of time has passed since detecting that the set of one or more subjects has left the environment.

52. The method of any one of claims 35-51, wherein outputting the notification corresponding to the environment includes outputting, via one or more speakers that are in communication with the computer system, audio.

53. The method of any one of claims 35-52, wherein outputting the notification corresponding to the environment includes displaying, via one or more display components that are in communication with the computer system, content.

54. The method of any one of claims 35-53, wherein outputting the notification includes sending, to another computer system separate from the computer system, the notification.

55. The method of any one of claims 35-54, wherein outputting the notification includes sending, to a plurality of different computer systems separate from the computer system, the notification.

56. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method of any one of claims 35-55.

57. A computer system, comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 35-55.

58. A computer system, comprising:means for performing the method of any one of claims 35-55.1514920-1811-1627Attorney Docket No. 081501-P71165W0159. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method of any one of claims 35-55.

60. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for:detecting that a set of one or more subjects has left an environment; andin response to detecting that the set of one or more subjects has left the environment:in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; andin accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

61. A computer system, comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment:in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; andin accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

62. A computer system, comprising:means for detecting that a set of one or more subjects has left an environment; and in response to detecting that the set of one or more subjects has left the environment:means for, in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; and means for, in accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.1524920-1811-1627Attorney Docket No. 081501-P71165W0163. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for:detecting that a set of one or more subjects has left an environment; andin response to detecting that the set of one or more subjects has left the environment:in accordance with a determination that a subject is not detected in the environment, outputting a notification corresponding to the environment; andin accordance with a determination that a subject is detected in the environment, forgoing output of the notification corresponding to the environment.

64. A method, comprising:at a computer system that is in communication with one or more input devices and one or more output devices including one or more display components:displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance;while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance;in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; andin response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

65. The method of claim 64, further comprising:after sharing, to the resource for emergency assistance, access to the respective set of one or more other computer systems, maintaining the connection with the resource for emergency assistance.

66. The method of claim 65, further comprising:1534920-1811-1627Attorney Docket No. 081501-P71165W01in response to detecting that the connection with the resource for emergency assistance has ceased, ceasing share of, to the resource for emergency assistance, access to the respective set of one or more other computer systems.

67. The method of any one of claims 64-66, further comprising:after detecting that the connection with the resource for emergency assistance has ceased and in response to a determination that a predefined period of time has passed since the connection with the resource for emergency assistance has ceased, ceasing share of, to the resource for emergency assistance, access to the respective set of one or more other computer systems.

68. The method of any one of claims 64-67, wherein outputting the prompt to share access to one or more other computer systems with the resource for emergency assistance includes displaying, via the one or more display components, the prompt within the call user interface.

69. The method of claim 68, wherein the respective set of one or more other computer systems includes a first computer system and a second computer system separate from the first computer system, and wherein the prompt includes an identification of the first computer system and an identification of the second computer system.

70. The method of claim 68, wherein the respective set of one or more other computer systems includes a first computer system and a second computer system separate from the first computer system, and wherein the prompt includes video received from the first computer system and video received from the second computer system.

71. The method of claim 68, wherein the respective set of one or more other computer systems includes a first computer system and a second computer system separate from the first computer system, and wherein the prompt includes a control for modifying a state of the first computer system and a control for modifying a state of the second computer system.

72. The method of any one of claims 64-71, wherein the respective set of one or more other computer systems includes a first computer system and a second computer system1544920-1811-1627Attorney Docket No. 081501-P71165W01separate from the first computer system, and wherein the second computer system is a different type of computer system than the first computer system.

73. The method of any one of claims 64-72, wherein sharing, to the resource for emergency assistance, access to the respective set of one or more other computer systems includes:in accordance with a determination that the respective set of one or more other computer systems is a first set of one or more other computer systems, sharing, to the resource for emergency assistance, access to the first set of one or more other computer systems; andin accordance with a determination that the respective set of one or more other computer systems is a second set of one or more other computer systems, sharing, to the resource for emergency assistance, access to the second set of one or more other computer systems.

74. The method of claim 72, further comprising:while the connection with the resource for emergency assistance is maintained, detecting, via the one or more input devices, an input corresponding to a request to select the respective set of one or more other computer systems, wherein the determination that the respective set of one or more other computer systems is the first set of one or more other computer systems is based on the input corresponding to the request to select the respective set of one or more other computer systems, and wherein the determination that the respective set of one or more other computer systems is the second set of one or more other computer systems is based on the input corresponding to the request to select the respective set of one or more other computer systems.

75. The method of claim 72, wherein the determination that the respective set of one or more other computer systems is the first set of one or more other computer systems includes a determination that an emergency is located at a first location, and wherein the determination that the respective set of one or more other computer systems is the second set of one or more other computer systems includes a determination that the emergency is located at a second location different from the first location.

76. The method of any one of claims 64-75, further comprising:1554920-1811-1627Attorney Docket No. 081501-P71165W01before displaying the call user interface corresponding to the connection with the resource for emergency assistance, displaying, via the one or more display components, a notification of an activity at a location, wherein the connection is initiated from the notification of the activity at the location.

77. The method of claim 76, wherein the computer system is a first computer system, wherein the notification is received from a second computer system different from the first computer system, and wherein the second computer system detected the activity at the location.

78. The method of claim 76, wherein the notification includes an identification of the location.

79. The method of claim 76, wherein the notification includes media of the location.

80. The method of any one of claims 64-79, further comprising:after sharing, to the resource for emergency assistance, access to the respective set of one or more other computer systems, displaying, via the one or more display components, an indication that access was shared.

81. The method of claim 80, wherein the indication that access was shared includes a control to stop sharing access, the method further comprising:while displaying the indication that access was shared, detecting, via the one or more input devices, an input corresponding to the control to stop sharing access; andin response to detecting the input corresponding to the control to stop sharing access, ceasing share of, to the resource for emergency assistance, access to the respective set of one or more other computer systems.

82. The method of claim 80, wherein the indication that access was shared includes an identification of a number of computer systems included in the respective set of one or more other computer system.

83. The method of claim 80, wherein the indication that access was shared includes an identification of the respective set of one or more other computer systems.1564920-1811-1627Attorney Docket No. 081501-P71165W0184. The method of any one of claims 64-83, wherein the prompt to share access to one or more other computer systems with the resource for emergency assistance is output in response to a determination that a predefined period of time has passed since initiating the connection with the resource for emergency assistance.

85. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including one or more display components, the one or more programs including instructions for performing the method of any one of claims 64-84.

86. A computer system that is configured to communicate with one or more input devices and one or more output devices including one or more display components, the computer system comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 64-84.

87. A computer system that is configured to communicate with one or more input devices and one or more output devices including one or more display components, the computer system comprising:means for performing the method of any one of claims 64-84.

88. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including one or more display components, the one or more programs including instructions for performing the method of any one of claims 64-84.

89. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in1574920-1811-1627Attorney Docket No. 081501-P71165W01communication with one or more input devices and one or more output devices including one or more display components, the one or more programs including instructions for:displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance;while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance;in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; andin response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

90. A computer system configured to communicate with one or more input devices and one or more output devices including one or more display components, the computer system comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance;while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance;in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; andin response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing,1584920-1811-1627Attorney Docket No. 081501-P71165W01to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

91. A computer system configured to communicate with one or more input devices and one or more output devices including one or more display components, the computer system comprising:means for displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance;means for, while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance;means for, in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; andmeans for, in response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

92. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including one or more display components, the one or more programs including instructions for:displaying, via the one or more display components, a call user interface corresponding to a connection with a resource for emergency assistance;while displaying the call user interface corresponding to the connection with the resource for emergency assistance, outputting, via the one or more output devices, a prompt to share access to one or more other computer systems with the resource for emergency assistance;1594920-1811-1627Attorney Docket No. 081501-P71165W01in conjunction with outputting the prompt, detecting, via the one or more input devices, an input corresponding to a request to share access to one or more other computer systems with the resource for emergency assistance; andin response to detecting the input corresponding to the request to share access to one or more other computer systems with the resource for emergency assistance, sharing, to the resource for emergency assistance, access to a respective set of one or more other computer systems, wherein the respective set of one or more other computer systems do not include the computer system.

93. A method, comprising:at a computer system that is in communication with one or more output devices: receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; andin accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication with a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

94. The method of claim 93, wherein outputting the indication includes outputting an identification of the subject.

95. The method of any one of claims 93-94, wherein the computer system is in communication with one or more display components, and wherein outputting the indication includes displaying, via the one or more display components, the indication, the method further comprising:while displaying the indication, displaying, via the one or more display components, one or more indications of one or more activities performed in the environment.1604920-1811-1627Attorney Docket No. 081501-P71165W0196. The method of claim 95, wherein the one or more activities are performed by the subject.

97. The method of claim 95, wherein at least one activity of the one or more activities is performed by another subject different from the subject.

98. The method of any one of claims 93-97, wherein the indication includes an icon corresponding to one or more accessories that performed the set of one or more operations.

99. The method of any one of claims 93-98, wherein the computer system is in communication with one or more display components and one or more input devices, the method further comprising:after outputting the second indication, detecting, via the one or more input devices, an input corresponding to a request to display one or more representations of activities detected in the environment; andin response to detecting the input corresponding to the request to display the one or more representations of activities detected in the environment, displaying, via the one or more display components, the indication.

100. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, the one or more programs including instructions for performing the method of any one of claims 93-99.

101. A computer system that is configured to communicate with one or more output devices, the computer system comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 93-99.

102. A computer system that is configured to communicate with one or more output devices, the computer system comprising:means for performing the method of any one of claims 93-99.1614920-1811-1627Attorney Docket No. 081501-P71165W01103. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, the one or more programs including instructions for performing the method of any one of claims 93-99.

104. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, the one or more programs including instructions for:receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; andin accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication with a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

105. A computer system configured to communicate with one or more output devices, the computer system comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:1624920-1811-1627Attorney Docket No. 081501-P71165W01in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; andin accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication with a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

106. A computer system configured to communicate with one or more output devices, the computer system comprising:means for receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:means for, in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and means for, in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication with a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

107. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, the one or more programs including instructions for:receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and1634920-1811-1627Attorney Docket No. 081501-P71165W01in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication with a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

108. A method, comprising:at a computer system:receiving an indication that an identified subject with a respective authentication level is detected in an environment; andin response to receiving the indication that the identified subject with the respective authentication level is detected in the environment:in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; andin accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

109. The method of claim 108, wherein the automation is a first automation, the method further comprising:after initiating the first automation, receiving an indication that the identified subject has a third authentication level different from the first authentication level; andin response to receiving the indication that the identified subject has the third authentication level, initiating a second automation different from the first automation.

110. The method of any one of claims 108-109, wherein the computer system is a first computer system, wherein initiating the automation includes sending, to a second computer system, a request to change an accessory device to a first state, and wherein the second computer system is different from the first computer system.1644920-1811-1627Attorney Docket No. 081501-P71165W01111. The method of any one of claims 108-110, wherein the computer system is a first computer system, wherein the first set of one or more criteria includes a criterion that is satisfied when the automation includes changing a state of a security accessory device.

112. The method of any one of claims 108-111, wherein the identified subject is a first identified subject, wherein the automation is a first automation, the method further comprising:after initiating the first automation, receiving an indication that a second identified subject has a fourth authentication level, wherein the second identified subject is different from the first identified subject;in response to receiving the indication that the second identified subject has the fourth authentication level, initiating a third automation different from the first automation.

113. The method of any one of claims 108-112, wherein the identified subject is a first identified subject, wherein the automation is a first automation, the method further comprising:after initiating the first automation, receiving an indication that a third identified subject has a fifth authentication level, wherein the third identified subject is different from the first identified subject; andin response to receiving the indication that the third identified subject has the fifth authentication level, forgoing initiation of am automation.

114. The method of any one of claims 108-113, wherein the indication that the identified subject is detected in the environment is received from a personal device corresponding to the identified subject.

115. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method of any one of claims 108-114.

116. A computer system, comprising:one or more processors; and1654920-1811-1627Attorney Docket No. 081501-P71165W01memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 108-114.

117. A computer system, comprising:means for performing the method of any one of claims 108-114.

118. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method of any one of claims 108-114.

119. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for:receiving an indication that an identified subject with a respective authentication level is detected in an environment; andin response to receiving the indication that the identified subject with the respective authentication level is detected in the environment:in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; andin accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

120. A computer system, comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:receiving an indication that an identified subject with a respective authentication level is detected in an environment; and1664920-1811-1627Attorney Docket No. 081501-P71165W01in response to receiving the indication that the identified subject with the respective authentication level is detected in the environment:in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; andin accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

121. A computer system, comprising:means for receiving an indication that an identified subject with a respective authentication level is detected in an environment; andin response to receiving the indication that the identified subject with the respective authentication level is detected in the environment:means for, in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; andmeans for, in accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

122. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for:receiving an indication that an identified subject with a respective authentication level is detected in an environment; andin response to receiving the indication that the identified subject with the respective authentication level is detected in the environment:1674920-1811-1627Attorney Docket No. 081501-P71165W01in accordance with a determination that the respective authentication level satisfies a first set of one or more criteria, wherein the first set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a first authentication level, initiating an automation; andin accordance with a determination that the respective authentication level satisfies a second set of one or more criteria, wherein the second set of one or more criteria includes a criterion that is satisfied when the respective authentication level is a second authentication level, forgoing initiation of the automation, wherein the second authentication level is different from the first authentication level.

123. A method, comprising:at a computer system that is in communication with one or more output devices: receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; andin accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

124. The method of claim 123, wherein the indication that includes the first explanation further includes an identification of the subject.

125. The method of any one of claims 123-124, wherein the computer system is in communication with one or more display components, and wherein outputting the indication that includes the first explanation includes displaying, via the one or more display components, the indication that includes the first explanation, the method further comprising:in response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment, displaying, via the one or more 1684920-1811-1627Attorney Docket No. 081501-P71165W01display components, one or more indications of one or more activities performed in the environment.

126. The method of claim 125, wherein the one or more activities are determined to be performed by the subject.

127. The method of claim 125, wherein at least one activity of the one or more activities is determined to be performed by another subject different from the subject.

128. The method of any one of claims 123-127, wherein the indication that includes the first explanation includes an icon corresponding to one or more accessories that performed the set of one or more operations.

129. The method of any one of claims 123-128, wherein the computer system is in communication with one or more display components and one or more input devices, the method further comprising:after outputting the indication that includes the first explanation, detecting, via the one or more input devices, an input corresponding to a request to view activity detected in the environment; andin response to detecting the input corresponding to the request to view activity detected in the environment, displaying, via the one or more display components, the indication that includes the first explanation.

130. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, the one or more programs including instructions for performing the method of any one of claims 123-129.

131. A computer system that is configured to communicate with one or more output devices, the computer system comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 123-129.1694920-1811-1627Attorney Docket No. 081501-P71165W01132. A computer system that is configured to communicate with one or more output devices, the computer system comprising:means for performing the method of any one of claims 123-129.

133. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, the one or more programs including instructions for performing the method of any one of claims 123-129.

134. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, the one or more programs including instructions for:receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; andin accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

135. A computer system configured to communicate with one or more output devices, the computer system comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:receiving an indication that a set of one or more operations is performed based on a subject entering an environment; and1704920-1811-1627Attorney Docket No. 081501-P71165W01in response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; andin accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

136. A computer system configured to communicate with one or more output devices, the computer system comprising:means for receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:means for, in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; and means for, in accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

137. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, the one or more programs including instructions for:receiving an indication that a set of one or more operations is performed based on a subject entering an environment; andin response to receiving the indication that the set of one or more operations is performed based on the subject entering the environment:1714920-1811-1627Attorney Docket No. 081501-P71165W01in accordance with a determination that a first set of one or more criteria is satisfied, outputting, via the one or more output devices, an indication that includes a first explanation regarding performance of the set of one or more operations; andin accordance with a determination that a second set of one or more criteria is satisfied, outputting, via the one or more output devices, the indication that includes a second explanation regarding performance of the set of one or more operations, wherein the second explanation is different from the first explanation, and wherein the first set of one or more criteria is different from the second set of one or more criteria.

138. A method, comprising:at a computer system:detecting a subject in an environment;in response to detecting the subject in the environment:in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; andin accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.

139. The method of claim 138, wherein the automation is a first automation, the method further comprising:after initiating the first automation, receiving an indication that the subject has been authenticated with respect to the user account using a third set of one or more authentication techniques, wherein the third set of one or more authentication techniques is different from the first set of one or more authentication techniques; andin response to receiving the indication that the subject has been authenticated with respect to the user account using the third set of one or more authentication techniques, initiating a second automation different from the first automation.1724920-1811-1627Attorney Docket No. 081501-P71165W01140. The method of any one of claims 138-139, wherein the computer system is a first computer system, wherein initiating the automation includes sending, to a second computer system, a request to change an accessory device to a first state, and wherein the second computer system is different from the first computer system.

141. The method of any one of claims 138-140, wherein the computer system is a first computer system, wherein the first set of one or more criteria includes a criterion that is satisfied when the automation includes changing a state of a security accessory device.

142. The method of any one of claims 138-141, wherein the subject is a first subject, wherein the automation is a first automation, and wherein the user account is a first user account, the method further comprising:after initiating the first automation, detecting a second subject different from the first subject in the environment; andin response to detecting the second subject in the environment and in accordance with a determination that the second subject has been authenticated with respect to a second user account using a fourth set of one or more authentication techniques, initiating a third automation different from the first automation.

143. The method of any one of claims 138-142, wherein the subject is a first subject, wherein the automation is a first automation, and wherein the user account is a first user account, the method further comprising:after initiating the first automation, detecting a third subject, different from the first subject, in the environment; andin response to detecting the third subject in the environment and in accordance with a determination that the third subject has been authenticated with respect to a third user account using the first set of one or more authentication techniques, forgoing initiation of an automation.

144. The method of any one of claims 138-143, wherein the computer system detects the subject in in the environment via a communication with a personal device corresponding to the subject, and wherein the subject is authenticated via one or more cameras.1734920-1811-1627Attorney Docket No. 081501-P71165W01145. The method of any one of claims 138-144, wherein the computer system is in communication with one or more output devices, the method further comprising:after initiating the automation and in accordance with a determination that the automation is performed, outputting, via the one or more output devices, an indication that the automation has been performed.

146. The method of any one of claims 138-145, wherein the automation is a first automation, the method further comprising:in response to detecting the subject in the environment and in accordance with the determination that the second set of one or more criteria is satisfied, initiating a third automation, wherein the third automation is different from the first automation.

147. The method of claim 146, further comprising:in response to detecting the subject in the environment and in accordance with a determination that a third set of one or more criteria is satisfied, wherein the third set of one or more criteria includes a criterion that is satisfied when the subject is not authenticated with respect to a user account, forgoing initiation of an automation.

148. The method of any one of claims 138-147, wherein:the automation is a respective automation:in accordance with a determination that the subject is a first individual, the respective automation is a fourth automation; andin accordance with a determination that the subject is a second individual, the respective automation is a fifth automation that is different from the fourth automation; and the second individual is different from the first individual.

149. The method of any one of claims 138-148, wherein:the computer system is in communication with a first set of one or more devices and a second set of one or more devices different from the first set of one or more devices; and initiating the automation includes:causing the first set of one or more devices to perform a first set of one or more operations; andcausing the second set of one or more device to perform a second set of one or more operations different from the first set of one or more operations.1744920-1811-1627Attorney Docket No. 081501-P71165W01150. The method of any one of claims 138-149, wherein the first set of one or more authentication techniques results in a greater level of authentication than the second set of authentication techniques.

151. The method of any one of claims 138-150, wherein initiating the automation includes causing one or more devices to secure one or more areas of one or more environments.

152. The method of any one of claims 138-151, wherein the subject is detected in a first portion of the environment, and wherein initiating the automation includes causing a set of one or more devices to perform a set of one or more operations in a second portion of the environment different from the first portion of the environment.

153. The method of any one of claims 138-152, wherein the automation is a first automation, wherein the first set of one or more criteria includes a criterion that is satisfied when a set of one or more devices satisfy a fourth set of one or more criteria, and wherein the set of one or more devices are external to the computer system, the method further comprising:in response to detecting the subject in the environment and in accordance with a determination that the set of one or more devices do not satisfy the fourth set of one or more criteria, forgoing initiation of the first automation.

154. The method of claim 153, wherein the fourth set of one or more criteria includes a criterion that is satisfied when the set of one or more devices has a first state.

155. The method of any one of claims 138-154, wherein the subject is a first subject, the method further comprising:after initiating the automation, causing a personal computer system of a second subject registered with the computer system to display an indication of reasoning for performing the automation.

156. The method of claim 155, wherein the indication includes a description of one or more operations included in the automation.1754920-1811-1627Attorney Docket No. 081501-P71165W01157. The method of any one of claims 155-156, wherein the indication includes a representation of a time at which the automation is performed.

158. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method of any one of claims 138-157.

159. A computer system, comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 138-157.

160. A computer system, comprising:means for performing the method of any one of claims 138-157.

161. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for performing the method of any one of claims 138-157.

162. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for:detecting a subject in an environment;in response to detecting the subject in the environment:in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; andin accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or1764920-1811-1627Attorney Docket No. 081501-P71165W01more authentication techniques is different from the second set of one or more authentication techniques.

163. A computer system, comprising:one or more processors; andmemory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:detecting a subject in an environment;in response to detecting the subject in the environment:in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; andin accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.

164. A computer system, comprising:means for detecting a subject in an environment;in response to detecting the subject in the environment:means for, in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; andmeans for, in accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.1774920-1811-1627Attorney Docket No. 081501-P71165W01165. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for:detecting a subject in an environment;in response to detecting the subject in the environment:in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to a user account using a first set of one or more authentication techniques, initiating an automation; andin accordance with a determination that a second set of one or more criteria is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the subject has been authenticated with respect to the user account using a second set of authentication techniques, forgoing initiation of the automation, wherein the first set of one or more authentication techniques is different from the second set of one or more authentication techniques.1784920-1811-1627